2023-12-08T07:53:20.043 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T07:53:20.044 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761 --owner scheduled_vshankar@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --name vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi -- /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/orig.config.yaml 2023-12-08T07:53:20.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T07:53:20.182 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761 branch: wip-vshankar-testing-20231206.125818 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7483761' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20231206.125818 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a2cd52c00149b5caff897ea7f79d0529b62620da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2cd52c00149b5caff897ea7f79d0529b62620da kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231206.125818 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 4099 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da sleep_before_teardown: 0 subset: 359/1024 suite: fs suite_branch: wip-vshankar-testing-20231206.125818 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a2cd52c00149b5caff897ea7f79d0529b62620da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsSvy4Fb/xX6H8FmY89MqFUF5fwpGjpzvmHRVTcBGUvI0uw0q5i2MHhst/uft6mqIQFl+LCZfctE3ZeLwq7Glk= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoKPSIe36hn0B+dMRBoYZ/SYYbG5k41Gt8k88sLS+yJOPafC2Cnk4UJj2MUp7VXCwJ3wADi5iWo9MjmfeQa4fk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_07:46:48 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-08T07:53:20.182 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa; will attempt to use it 2023-12-08T07:53:20.183 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks 2023-12-08T07:53:20.183 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-08T07:53:20.185 INFO:teuthology.task.internal:Checking packages... 2023-12-08T07:53:20.209 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2cd52c00149b5caff897ea7f79d0529b62620da' 2023-12-08T07:53:20.209 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T07:53:20.209 INFO:teuthology.packaging:ref: None 2023-12-08T07:53:20.209 INFO:teuthology.packaging:tag: None 2023-12-08T07:53:20.209 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231206.125818 2023-12-08T07:53:20.209 INFO:teuthology.packaging:sha1: a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T07:53:20.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20231206.125818 2023-12-08T07:53:20.429 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-46.ga2cd52c0 2023-12-08T07:53:20.430 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-08T07:53:20.436 INFO:teuthology.task.internal:no buildpackages task found 2023-12-08T07:53:20.436 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-08T07:53:20.480 INFO:teuthology.task.internal:Saving configuration 2023-12-08T07:53:20.497 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-08T07:53:20.512 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T07:53:20.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:48:26.701898', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsSvy4Fb/xX6H8FmY89MqFUF5fwpGjpzvmHRVTcBGUvI0uw0q5i2MHhst/uft6mqIQFl+LCZfctE3ZeLwq7Glk='} 2023-12-08T07:53:20.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:48:26.699851', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoKPSIe36hn0B+dMRBoYZ/SYYbG5k41Gt8k88sLS+yJOPafC2Cnk4UJj2MUp7VXCwJ3wADi5iWo9MjmfeQa4fk='} 2023-12-08T07:53:20.560 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-08T07:53:20.566 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-08T07:53:20.566 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-08T07:53:20.566 INFO:teuthology.run_tasks:Running task console_log... 2023-12-08T07:53:20.659 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb46f68ba60>, signals=[15]) 2023-12-08T07:53:20.660 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-08T07:53:20.666 INFO:teuthology.task.internal:Opening connections... 2023-12-08T07:53:20.666 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T07:53:20.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:53:20.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T07:53:20.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:53:20.849 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-08T07:53:20.856 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-12-08T07:53:20.873 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-12-08T07:53:20.873 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T07:53:20.930 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T07:53:20.931 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T07:53:20.931 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-12-08T07:53:20.961 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-12-08T07:53:20.978 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-12-08T07:53:20.978 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-12-08T07:53:21.034 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-12-08T07:53:21.034 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2023-12-08T07:53:21.034 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-12-08T07:53:21.034 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-12-08T07:53:21.034 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T07:53:21.035 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T07:53:21.036 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-12-08T07:53:21.055 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-08T07:53:21.065 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-08T07:53:21.129 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-08T07:53:21.129 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-12-08T07:53:21.132 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2023-12-08T07:53:21.147 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-08T07:53:21.154 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-08T07:53:21.154 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-12-08T07:53:21.188 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2023-12-08T07:53:21.216 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-08T07:53:21.275 INFO:teuthology.run_tasks:Running task kernel... 2023-12-08T07:53:21.316 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-08T07:53:21.317 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-08T07:53:21.317 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-08T07:53:21.317 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T07:53:21.318 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T07:53:21.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T07:53:21.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-08T07:53:21.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T07:53:21.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-08T07:53:21.511 DEBUG:teuthology.task.kernel:sha1 for client.1 is 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:53:21.511 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6bcacf46b7888ce2bf7abad8aec37024810025d4"... 2023-12-08T07:53:21.511 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-12-08T07:53:21.528 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-361.el9.x86_64 2023-12-08T07:53:21.528 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:53:21.528 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-08T07:53:21.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum upgrade -y linux-firmware 2023-12-08T07:53:21.598 DEBUG:teuthology.task.kernel:sha1 for client.0 is 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:53:21.598 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6bcacf46b7888ce2bf7abad8aec37024810025d4"... 2023-12-08T07:53:21.598 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-08T07:53:21.616 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-361.el9.x86_64 2023-12-08T07:53:21.616 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:53:21.616 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-08T07:53:21.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum upgrade -y linux-firmware 2023-12-08T07:53:24.310 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 5.6 MB/s | 6.4 MB 00:01 2023-12-08T07:53:24.313 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - AppStream 6.2 MB/s | 6.4 MB 00:01 2023-12-08T07:53:25.913 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-12-08T07:53:26.486 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 1.7 MB/s | 2.0 MB 00:01 2023-12-08T07:53:28.462 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 7.9 MB 00:02 2023-12-08T07:53:28.926 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.9 MB 00:01 2023-12-08T07:53:30.429 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-12-08T07:53:32.471 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 18 MB 00:02 2023-12-08T07:53:35.616 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.8 MB 00:01 2023-12-08T07:53:37.561 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 5.8 MB 00:01 2023-12-08T07:53:38.837 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 15 kB 00:00 2023-12-08T07:53:41.488 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 3.2 kB/s | 15 kB 00:04 2023-12-08T07:53:42.975 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-08T07:53:43.899 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 20 MB 00:04 2023-12-08T07:53:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-08T07:53:48.671 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-08T07:53:50.226 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-12-08T07:53:50.237 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-12-08T07:53:50.237 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 1 Package 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 328 M 2023-12-08T07:53:50.238 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-12-08T07:53:51.000 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 1 Package 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 328 M 2023-12-08T07:53:51.011 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-12-08T07:53:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:linux-firmware-20231030-141.el9.noarch.rpm 43 MB/s | 328 MB 00:07 2023-12-08T07:53:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-12-08T07:53:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:Total 43 MB/s | 328 MB 00:07 2023-12-08T07:53:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-12-08T07:53:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-12-08T07:53:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-12-08T07:54:00.966 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-12-08T07:54:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-12-08T07:54:02.531 INFO:teuthology.orchestra.run.smithi045.stdout:linux-firmware-20231030-141.el9.noarch.rpm 27 MB/s | 328 MB 00:12 2023-12-08T07:54:02.532 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-12-08T07:54:02.532 INFO:teuthology.orchestra.run.smithi045.stdout:Total 27 MB/s | 328 MB 00:12 2023-12-08T07:54:02.533 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-12-08T07:54:02.651 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-12-08T07:54:02.651 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-12-08T07:54:04.867 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-12-08T07:54:04.867 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-12-08T07:54:06.892 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-12-08T07:54:07.313 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-08T07:54:07.394 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:08.301 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-08T07:54:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:08.694 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:54:08.695 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2023-12-08T07:54:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-08T07:54:08.695 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:54:08.695 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-12-08T07:54:08.995 INFO:teuthology.task.kernel:Downloading kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.1... 2023-12-08T07:54:08.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:54:09.214 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/ 2023-12-08T07:54:09.214 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g6bcacf46b788-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-08T07:54:09.217 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2023-12-08T07:54:10.859 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-12-08T07:54:11.185 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-08T07:54:11.282 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:12.090 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:12.090 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:54:12.500 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-12-08T07:54:12.821 INFO:teuthology.task.kernel:Downloading kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.0... 2023-12-08T07:54:12.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6bcacf46b7888ce2bf7abad8aec37024810025d4 2023-12-08T07:54:13.044 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/ 2023-12-08T07:54:13.045 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g6bcacf46b788-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-08T07:54:13.047 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-12-08T07:54:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08 07:54:21 URL:https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/kernel-6.6.0_g6bcacf46b788-1.x86_64.rpm [320732669/320732669] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-08T07:54:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2023-12-08 07:54:21-- 2023-12-08T07:54:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 12s 2023-12-08T07:54:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 306M in 12s (25.4 MB/s) 2023-12-08T07:54:21.652 INFO:teuthology.task.kernel:Installing kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.1... 2023-12-08T07:54:21.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-08T07:54:23.494 INFO:teuthology.orchestra.run.smithi114.stdout:Verifying... ######################################## 2023-12-08T07:54:23.543 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing... ######################################## 2023-12-08T07:54:23.622 INFO:teuthology.orchestra.run.smithi114.stdout:Updating / installing... 2023-12-08T07:54:30.709 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-6.6.0_g6bcacf46b788-1 ######################################## 2023-12-08T07:54:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08 07:54:45 URL:https://4.chacra.ceph.com/r/kernel/testing/6bcacf46b7888ce2bf7abad8aec37024810025d4/centos/9/flavors/default/x86_64/kernel-6.6.0_g6bcacf46b788-1.x86_64.rpm [320732669/320732669] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-08T07:54:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-12-08 07:54:45-- 2023-12-08T07:54:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 32s 2023-12-08T07:54:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 306M in 32s (9.58 MB/s) 2023-12-08T07:54:45.552 INFO:teuthology.task.kernel:Installing kernel 6bcacf46b7888ce2bf7abad8aec37024810025d4 on client.0... 2023-12-08T07:54:45.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-08T07:54:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-08T07:54:47.488 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying... ######################################## 2023-12-08T07:54:47.542 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing... ######################################## 2023-12-08T07:54:47.627 INFO:teuthology.orchestra.run.smithi045.stdout:Updating / installing... 2023-12-08T07:54:55.055 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-6.6.0_g6bcacf46b788-1 ######################################## 2023-12-08T07:55:07.164 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-08T07:55:07.165 DEBUG:teuthology.orchestra.run.smithi114:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/config-6.6.0-g6bcacf46b788 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel 2023-12-08T07:55:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-08T07:55:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel 2023-12-08T07:55:07.238 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ansi_cprng.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/anubis.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/arc4.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_memcpy.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_pq.ko 2023-12-08T07:55:07.239 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_tx.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_xor.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/raid6test.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authenc.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authencesn.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blake2b_generic.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_common.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_generic.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/camellia_generic.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast5_generic.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast6_generic.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast_common.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ccm.ko 2023-12-08T07:55:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cmac.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crc32_generic.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_engine.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_user.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cts.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/des_generic.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/dh_generic.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/echainiv.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/essiv.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/fcrypt.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/khazad.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4hc.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/md4.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/michael_mic.ko 2023-12-08T07:55:07.241 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcbc.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcrypt.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/rmd160.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/seed.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/serpent_generic.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tcrypt.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tea.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_common.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_generic.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/vmac.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/wp512.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xcbc.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xor.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xxhash_generic.ko 2023-12-08T07:55:07.242 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_pad.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/custom_method.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ec_sys.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/platform_profile.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbs.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbshc.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/video.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/acard-ahci.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci_platform.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ata_generic.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci_platform.ko 2023-12-08T07:55:07.243 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_acpi.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ali.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_amd.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_artop.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atiixp.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atp867x.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd640.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd64x.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cypress.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_efar.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt366.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt37x.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-08T07:55:07.244 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it8213.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it821x.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_jmicron.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_marvell.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_mpiix.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_netcell.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ninja32.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87410.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87415.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_oldpiix.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_opti.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_optidma.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pcmcia.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-08T07:55:07.245 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_piccolo.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rdc.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sch.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_serverworks.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sil680.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sis.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sl82c105.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_triflex.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_via.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pdc_adma.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_inic162x.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_mv.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_nv.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_promise.ko 2023-12-08T07:55:07.246 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_qstor.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil24.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sis.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_svw.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sx4.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_uli.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_via.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_vsc.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ks0108.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-08T07:55:07.247 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/bcma.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/aoe.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/brd.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/drbd.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/floppy.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/loop.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/nbd.ko 2023-12-08T07:55:07.248 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/null_blk.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/pktcdvd.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/rbd.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/virtio_blk.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkfront.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/zram.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hangcheck-timer.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-08T07:55:07.249 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/via-rng.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/lp.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/mwave.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ppdev.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tlclk.ko 2023-12-08T07:55:07.250 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/uv_mmtimer.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/virtio_console.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-08T07:55:07.251 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-aes.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-sha.ko 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio 2023-12-08T07:55:07.252 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/dca.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/devfreq 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/amd64_edac.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/e752x_edac.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/edac_mce_amd.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3000_edac.ko 2023-12-08T07:55:07.253 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3200_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5100_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5400_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7300_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7core_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i82975x_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ie31200_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/sb_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/x38_edac.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/edd.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ich.ko 2023-12-08T07:55:07.254 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-appleir.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-aureal.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-axff.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-dr.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elecom.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elo.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-emsff.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gaff.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gt683r.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gyration.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtekff.ko 2023-12-08T07:55:07.255 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-hyperv.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-icade.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-keytouch.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kye.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lcpower.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-led.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lenovo.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-multitouch.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ortek.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-penmount.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-petalynx.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-picolcd.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-pl.ko 2023-12-08T07:55:07.256 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-plantronics.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-primax.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-rmi.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-common.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat.ko 2023-12-08T07:55:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-saitek.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-samsung.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sjoy.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sony.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-speedlink.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-steelseries.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sunplus.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tivo.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tmff.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-topseed.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-twinhan.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-uclogic.ko 2023-12-08T07:55:07.258 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-waltop.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-wiimote.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-xinmo.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zpff.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zydacron.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/uhid.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/wacom.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_balloon.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_utils.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_vmbus.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru3.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7414.ko 2023-12-08T07:55:07.259 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7418.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adc128d818.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1025.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1026.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1029.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1031.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm9240.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ads7828.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7410.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7411.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7462.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7470.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7475.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7x10.ko 2023-12-08T07:55:07.260 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/amc6821.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/applesmc.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asb100.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asc7621.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/atxp1.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/coretemp.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dme1737.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds1621.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds620.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc1403.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc6w201.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71805f.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71882fg.ko 2023-12-08T07:55:07.261 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f75375s.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fam15h_power.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fschmd.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g760a.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g762.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl518sm.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl520sm.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5500_temp.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5k_amb.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmaem.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmpex.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina209.ko 2023-12-08T07:55:07.262 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina2xx.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/it87.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k10temp.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k8temp.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lineage-pem.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm63.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm73.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm75.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm77.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm78.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm80.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm83.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm85.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm87.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm90.ko 2023-12-08T07:55:07.263 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm92.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm93.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95234.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95241.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95245.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc2945.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4151.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4215.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4222.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4245.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4260.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4261.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max16065.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1619.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1668.ko 2023-12-08T07:55:07.264 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max197.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6639.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6650.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6697.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mcp3021.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6683.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775-core.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct7802.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87360.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87427.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pcf8591.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-08T07:55:07.265 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/powr1220.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5627.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5636.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-08T07:55:07.266 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht15.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht21.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/shtc1.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sis5595.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47b397.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m1.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m192.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/thmc50.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp102.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp103.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp401.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp421.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via-cputemp.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via686a.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt1211.ko 2023-12-08T07:55:07.267 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt8231.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627ehf.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627hf.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83781d.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83791d.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83792d.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83793.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83795.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l785ts.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l786ng.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses 2023-12-08T07:55:07.268 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-08T07:55:07.269 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-dev.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-mux.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-smbus.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-stub.ko 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband 2023-12-08T07:55:07.270 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_core.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5 2023-12-08T07:55:07.271 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input 2023-12-08T07:55:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/gameport.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/joydev.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/appletouch.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/bcm5974.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/cyapatp.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/sermouse.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-08T07:55:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/altera_ps2.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/arc_ps2.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serio_raw.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/sparse-keymap.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-blinkm.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3530.ko 2023-12-08T07:55:07.274 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp3944.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-ss4200.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/bcache.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bio-prison.ko 2023-12-08T07:55:07.275 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache-smq.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-crypt.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-delay.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-flakey.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log-userspace.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-multipath.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-queue-length.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-raid.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-round-robin.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-service-time.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-switch.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-thin-pool.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-verity.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/faulty.ko 2023-12-08T07:55:07.276 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/linear.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/multipath.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid0.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid1.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid10.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid456.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptbase.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptctl.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptfc.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptlan.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptsas.ko 2023-12-08T07:55:07.277 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptscsih.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptspi.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_ich.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_sch.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mfd-core.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/sm501.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/viperboard.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/vx855.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wl1273-core.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds9802als.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds990x.ko 2023-12-08T07:55:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/bh1770glc.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/cb710.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/at24.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/max6875.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/enclosure.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hpilo.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29003.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29020.ko 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d 2023-12-08T07:55:07.279 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-me.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-txe.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-gru 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_7xx1.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_core.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tsl2550.ko 2023-12-08T07:55:07.280 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_balloon.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/bonding.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dummy.ko 2023-12-08T07:55:07.281 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/eql.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere 2023-12-08T07:55:07.282 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-08T07:55:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade 2023-12-08T07:55:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco 2023-12-08T07:55:07.285 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dnet.ko 2023-12-08T07:55:07.286 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ethoc.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fealnx.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e 2023-12-08T07:55:07.287 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/jme.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-08T07:55:07.288 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-08T07:55:07.289 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc 2023-12-08T07:55:07.290 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rocker 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-08T07:55:07.291 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti 2023-12-08T07:55:07.292 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/geneve.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154 2023-12-08T07:55:07.293 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ifb.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvlan.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvtap.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mii.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/net_failover.ko 2023-12-08T07:55:07.294 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/netconsole.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/nlmon.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/amd.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm87xx.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/broadcom.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/cicada.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/davicom.ko 2023-12-08T07:55:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/dp83640.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/et1011c.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/icplus.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/lxt.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/marvell.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/micrel.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/national.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/phylink.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/qsemi.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/realtek.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/smsc.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ste10Xp.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/vitesse.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-08T07:55:07.296 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_async.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppoe.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppox.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pptp.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slhc.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slip.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sungem_phy.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tap.ko 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team 2023-12-08T07:55:07.297 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_random.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tun.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/veth.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/virtio_net.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/vxlan.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-08T07:55:07.298 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netfront.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ntb.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme-core.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_cs.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_pc.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_serial.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-08T07:55:07.299 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pcie 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/xen-pcifront.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/i82092.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pd6729.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acerhdf.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-08T07:55:07.300 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/hdaps.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel_ips.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-08T07:55:07.301 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps_parport.ko 2023-12-08T07:55:07.302 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/pps_core.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp_kvm.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-08T07:55:07.303 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-em3027.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max6900.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-08T07:55:07.304 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-x1205.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-9xxx.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-sas.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-xxxx.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/BusLogic.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/a100u2w.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/advansys.ko 2023-12-08T07:55:07.305 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/am53c974.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/atp870u.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/bfa.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-08T07:55:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ch.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dc395x.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-08T07:55:07.307 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dmx3191d.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esp_scsi.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/fnic.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hpsa.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hptiop.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hv_storvsc.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/initio.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ipr.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ips.ko 2023-12-08T07:55:07.308 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/isci.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/libfc.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/libsas.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-08T07:55:07.309 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvumi.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pmcraid.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla1280.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-08T07:55:07.310 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/raid_class.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_debug.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ses.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/st.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/stex.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/virtio_scsi.ko 2023-12-08T07:55:07.311 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/wd719x.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ssb.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_file.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_iblock.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_mod.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_pscsi.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_user.ko 2023-12-08T07:55:07.312 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-08T07:55:07.313 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_gsm.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_hdlc.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/nozomi.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-08T07:55:07.314 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/arc_uart.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_aec.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_cif.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pci_generic.ko 2023-12-08T07:55:07.315 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_sercos3.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-acm.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usblp.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usbtmc.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/mdc800.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/microtek.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/adutux.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/appledisplay.ko 2023-12-08T07:55:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi26.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi62.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ezusb.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/idmouse.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/iowarrior.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ldusb.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/legousbtower.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usb3503.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usblcd.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/uss720.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/yurex.ko 2023-12-08T07:55:07.317 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-generic.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/aircable.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ark3116.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ch341.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cp210x.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cyberjack.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/empeg.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-08T07:55:07.318 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_ti.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipaq.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipw.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ir-usb.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mct_u232.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7720.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7840.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/navman.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/omninet.ko 2023-12-08T07:55:07.319 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/opticon.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/option.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/oti6858.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/pl2303.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcaux.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcserial.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/quatech2.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/safe_serial.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/sierra.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ssu100.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/symbolserial.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_debug.ko 2023-12-08T07:55:07.320 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/visor.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/whiteheat.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/uas.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-karma.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-08T07:55:07.321 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/usb-storage.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-08T07:55:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_net.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_scsi.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/apple_bl.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lcd.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_balloon.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_mmio.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci.ko 2023-12-08T07:55:07.323 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_ring.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2482.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2490.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-08T07:55:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/wire.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/hpwdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/i6300esb.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ib700wdt.ko 2023-12-08T07:55:07.325 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ibmasr.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it87_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/machzwd.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/nv_tco.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/softdog.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/via_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-08T07:55:07.326 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wdt_pci.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/xen_wdt.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-evtchn.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntalloc.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntdev.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-privcmd.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs 2023-12-08T07:55:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/9p.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/affs.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/befs.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/binfmt_misc.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/btrfs.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/cachefiles.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ceph.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/coda.ko 2023-12-08T07:55:07.328 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/cramfs.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/dlm.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ecryptfs 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/f2fs.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/fat.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/msdos.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/vfat.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/fscache.ko 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse 2023-12-08T07:55:07.329 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/cuse.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/fuse.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/gfs2.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/hfs.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/hfsplus.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/isofs.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/jfs.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/lockd.ko 2023-12-08T07:55:07.330 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/minix.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/netfs.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfs.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv3.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv4.ko 2023-12-08T07:55:07.331 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/grace.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/nfs_acl.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/nfsd.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/nilfs2.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-celtic.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-centeuro.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-croatian.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-cyrillic.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-gaelic.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-greek.ko 2023-12-08T07:55:07.332 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-iceland.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-inuit.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-roman.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-romanian.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-turkish.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1250.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1251.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1255.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp737.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp775.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp850.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp852.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp855.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp857.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp860.ko 2023-12-08T07:55:07.333 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp861.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp862.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp863.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp864.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp865.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp866.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp869.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp874.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp932.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp936.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp949.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp950.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_euc-jp.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-1.ko 2023-12-08T07:55:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-13.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-14.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-15.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-2.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-3.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-4.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-5.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-6.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-7.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-9.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-r.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-ru.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-u.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_utf8.ko 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2 2023-12-08T07:55:07.335 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/overlay.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ramoops.ko 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs 2023-12-08T07:55:07.336 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/reiserfs.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/romfs.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/cifs.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_arc4.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_md4.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/squashfs.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/sysv.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/udf.ko 2023-12-08T07:55:07.337 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ufs.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/xfs.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/rcu 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/rcu/rcutorture.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/torture.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/trace 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/asn1_encoder.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc-itu-t.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc8.ko 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto 2023-12-08T07:55:07.338 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libarc4.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libdes.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/libcrc32c.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lru_cache.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4_compress.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4hc_compress.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/cordic.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/raid6_pq.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_bm.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_fsm.ko 2023-12-08T07:55:07.339 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_kmp.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/zstd 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/zstd/zstd_compress.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/mm 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/mm/hwpoison-inject.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/6lowpan.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_dest.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_fragment.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_hop.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_mobility.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_routing.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_udp.ko 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802 2023-12-08T07:55:07.340 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/garp.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/mrp.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/p8022.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/psnap.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/stp.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/8021q.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_fd.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_rdma.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_virtio.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/batman-adv.ko 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge 2023-12-08T07:55:07.341 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/br_netfilter.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/bridge.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-08T07:55:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtables.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/libceph.ko 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core 2023-12-08T07:55:07.343 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/failover.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/pktgen.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_diag.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv4.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv6.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dns_resolver 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dns_resolver/dns_resolver.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/dsa_core.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_brcm.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_dsa.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_none.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_trailer.ko 2023-12-08T07:55:07.344 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ah4.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/esp4.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/fou.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/gre.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/inet_diag.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_gre.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_tunnel.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_vti.ko 2023-12-08T07:55:07.345 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipcomp.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipip.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-08T07:55:07.346 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_bic.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_dctcp.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_diag.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_highspeed.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_htcp.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_hybla.ko 2023-12-08T07:55:07.347 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_illinois.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_lp.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_scalable.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_vegas.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_veno.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_westwood.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_yeah.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tunnel4.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_diag.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_tunnel.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ah6.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/esp6.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/fou6.ko 2023-12-08T07:55:07.348 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_tunnel.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_vti.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ipcomp6.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-08T07:55:07.349 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-08T07:55:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/sit.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/tunnel6.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/key 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/af_key.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_core.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_eth.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip6.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_netlink.ko 2023-12-08T07:55:07.351 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ppp.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/mac802154.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/mpls_gso.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-08T07:55:07.352 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-08T07:55:07.353 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conncount.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-08T07:55:07.354 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_log_syslog.ko 2023-12-08T07:55:07.355 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_irc.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_sip.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_tables.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_log.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_chain_nat.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_compat.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_ct.ko 2023-12-08T07:55:07.356 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fib.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_hash.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_limit.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_log.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_masq.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_nat.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_numgen.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_queue.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_quota.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_redir.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject_inet.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_socket.ko 2023-12-08T07:55:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_tunnel.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_AUDIT.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CT.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_DSCP.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HL.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HMARK.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LED.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LOG.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NETMAP.ko 2023-12-08T07:55:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFLOG.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_RATEEST.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_SECMARK.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TEE.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TPROXY.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TRACE.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_addrtype.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_bpf.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cgroup.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cluster.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_comment.ko 2023-12-08T07:55:07.359 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connbytes.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlabel.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlimit.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connmark.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_conntrack.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cpu.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dccp.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_devgroup.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dscp.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ecn.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_esp.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hashlimit.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_helper.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hl.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipcomp.ko 2023-12-08T07:55:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_iprange.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipvs.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_l2tp.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_length.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_limit.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mac.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mark.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_multiport.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nat.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nfacct.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_osf.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_owner.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_physdev.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_pkttype.ko 2023-12-08T07:55:07.361 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_policy.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_quota.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_rateest.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_realm.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_recent.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_sctp.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_set.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_socket.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_state.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_statistic.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_string.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpmss.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_time.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_u32.ko 2023-12-08T07:55:07.362 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/netlink_diag.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/nsh.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/openvswitch.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-geneve.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-gre.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-vxlan.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/af_packet_diag.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_rdma.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_tcp.ko 2023-12-08T07:55:07.363 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_csum.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_gact.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_ipt.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_mirred.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_nat.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_pedit.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_police.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_simple.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_skbedit.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_vlan.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_basic.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_bpf.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_flow.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_fw.ko 2023-12-08T07:55:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_route.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_u32.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_cmp.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_ipset.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_meta.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_nbyte.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_text.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_u32.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_choke.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_codel.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_drr.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_gred.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hfsc.ko 2023-12-08T07:55:07.365 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hhf.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_htb.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_ingress.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio_lib.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_multiq.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_netem.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_pie.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_plug.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_prio.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_qfq.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_red.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfb.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfq.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_tbf.ko 2023-12-08T07:55:07.366 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_teql.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp_diag.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/sunrpc.ko 2023-12-08T07:55:07.367 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/diag.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/tipc.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/unix_diag.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-08T07:55:07.368 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/encrypted-keys 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/trusted-keys 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/trusted-keys/trusted.ko 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/irqbypass.ko 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.alias 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.alias.bin 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.alias.bin 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.bin 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.modinfo 2023-12-08T07:55:07.369 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.dep 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.dep.bin 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.devname 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.order 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.softdep 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.symbols 2023-12-08T07:55:07.370 INFO:teuthology.orchestra.run.smithi114.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.symbols.bin 2023-12-08T07:55:07.370 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g6bcacf46b788 2023-12-08T07:55:07.371 DEBUG:teuthology.orchestra.run.smithi114:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-08T07:55:07.392 INFO:teuthology.orchestra.run.smithi114.stdout:postinstall scriptlet (using /bin/sh): 2023-12-08T07:55:07.392 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g6bcacf46b788 -a -r /boot/System.map-6.6.0-g6bcacf46b788 ]; then 2023-12-08T07:55:07.392 INFO:teuthology.orchestra.run.smithi114.stdout:cp /boot/vmlinuz-6.6.0-g6bcacf46b788 /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:cp /boot/System.map-6.6.0-g6bcacf46b788 /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:rm -f /boot/vmlinuz-6.6.0-g6bcacf46b788 /boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/installkernel 6.6.0-g6bcacf46b788 /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:rm -f /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:new-kernel-pkg --remove 6.6.0-g6bcacf46b788 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g6bcacf46b788.img 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-install remove 6.6.0-g6bcacf46b788 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-08T07:55:07.393 INFO:teuthology.orchestra.run.smithi114.stdout:/sbin/update-bootloader --remove 6.6.0-g6bcacf46b788 2023-12-08T07:55:07.394 INFO:teuthology.orchestra.run.smithi114.stdout:fi 2023-12-08T07:55:07.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 68.el9 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8264254 2023-12-08T07:55:07.470 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T07:55:07.471 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2023-12-08T07:55:07.472 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T07:55:07.472 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T07:55:07.473 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T07:55:07.473 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 6.6.0-g6bcacf46b788 2023-12-08T07:55:07.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T07:55:08.063 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2023-12-08T07:55:08.674 INFO:teuthology.orchestra.run.smithi045.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-08T07:55:09.376 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-08T07:55:09.412 INFO:teuthology.orchestra.run.smithi114.stderr:done 2023-12-08T07:55:09.416 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-12-08T07:55:09.432 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Bhju1RXiMO 2023-12-08T07:55:09.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Bhju1RXiMO 2023-12-08T07:55:09.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.Bhju1RXiMO 2023-12-08T07:55:09.645 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.Bhju1RXiMO is 6KB 2023-12-08T07:55:09.694 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.Bhju1RXiMO 2023-12-08T07:55:09.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T07:55:09.773 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-08T07:55:09.773 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-08T07:55:09.773 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-08T07:55:09.773 INFO:teuthology.orchestra.run.smithi114.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g6bcacf46b788.conf 2023-12-08T07:55:09.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g6bcacf46b788 2023-12-08T07:55:09.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2023-12-08T07:55:30.719 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-08T07:55:30.719 DEBUG:teuthology.orchestra.run.smithi045:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/config-6.6.0-g6bcacf46b788 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/vmlinuz-6.6.0-g6bcacf46b788 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86 2023-12-08T07:55:30.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-08T07:55:30.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/arch/x86/kvm/kvm.ko 2023-12-08T07:55:30.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ansi_cprng.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/anubis.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/arc4.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_memcpy.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_pq.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_tx.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/async_xor.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/async_tx/raid6test.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authenc.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/authencesn.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blake2b_generic.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_common.ko 2023-12-08T07:55:30.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/blowfish_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/camellia_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast5_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast6_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cast_common.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/ccm.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cmac.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crc32_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_engine.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/crypto_user.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/cts.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/des_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/dh_generic.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/echainiv.ko 2023-12-08T07:55:30.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/essiv.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/fcrypt.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/khazad.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/lz4hc.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/md4.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/michael_mic.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcbc.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/pcrypt.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/rmd160.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/seed.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/serpent_generic.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tcrypt.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/tea.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_common.ko 2023-12-08T07:55:30.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/twofish_generic.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/vmac.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/wp512.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xcbc.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xor.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/crypto/xxhash_generic.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/acpi_pad.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/custom_method.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/ec_sys.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/platform_profile.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbs.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/sbshc.ko 2023-12-08T07:55:30.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/acpi/video.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/acard-ahci.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ahci_platform.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/ata_generic.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/libahci_platform.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_acpi.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ali.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_amd.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_artop.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atiixp.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_atp867x.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd640.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cmd64x.ko 2023-12-08T07:55:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_cypress.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_efar.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt366.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt37x.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it8213.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_it821x.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_jmicron.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_marvell.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_mpiix.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_netcell.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ninja32.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87410.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_ns87415.ko 2023-12-08T07:55:30.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_oldpiix.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_opti.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_optidma.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pcmcia.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_piccolo.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_rdc.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sch.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_serverworks.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sil680.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sis.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_sl82c105.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_triflex.ko 2023-12-08T07:55:30.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pata_via.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/pdc_adma.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_inic162x.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_mv.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_nv.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_promise.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_qstor.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sil24.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sis.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_svw.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_sx4.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_uli.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_via.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ata/sata_vsc.ko 2023-12-08T07:55:30.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/auxdisplay/ks0108.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/bcma/bcma.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/aoe/aoe.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/brd.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/drbd/drbd.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/floppy.ko 2023-12-08T07:55:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/loop.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/nbd.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/null_blk/null_blk.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/pktcdvd.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/rbd.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/virtio_blk.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/xen-blkfront.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/block/zram/zram.ko 2023-12-08T07:55:30.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hangcheck-timer.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/via-rng.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-08T07:55:30.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/lp.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/mwave/mwave.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/ppdev.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tlclk.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/uv_mmtimer.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/char/virtio_console.ko 2023-12-08T07:55:30.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/ccp/ccp.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-08T07:55:30.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-aes.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/padlock-sha.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dca/dca.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/devfreq 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-08T07:55:30.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/amd64_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/e752x_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/edac_mce_amd.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3000_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i3200_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5100_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i5400_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7300_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i7core_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/i82975x_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/ie31200_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/sb_edac.ko 2023-12-08T07:55:30.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/edac/x38_edac.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/edd.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-ich.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-appleir.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-aureal.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-axff.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-dr.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elecom.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-elo.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-emsff.ko 2023-12-08T07:55:30.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gaff.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gt683r.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-gyration.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-holtekff.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-hyperv.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-icade.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-keytouch.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-kye.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lcpower.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-led.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-lenovo.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-multitouch.ko 2023-12-08T07:55:30.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-ortek.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-penmount.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-petalynx.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-picolcd.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-pl.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-plantronics.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-primax.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-rmi.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-common.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-08T07:55:30.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-roccat.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-saitek.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-samsung.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sjoy.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sony.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-speedlink.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-steelseries.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-sunplus.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-08T07:55:30.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tivo.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-tmff.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-topseed.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-twinhan.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-uclogic.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-waltop.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-wiimote.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-xinmo.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zpff.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/hid-zydacron.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/uhid.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hid/wacom.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_balloon.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_utils.ko 2023-12-08T07:55:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hv/hv_vmbus.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/abituguru3.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7414.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ad7418.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adc128d818.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1025.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1026.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1029.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm1031.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adm9240.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ads7828.ko 2023-12-08T07:55:30.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7410.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7411.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7462.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7470.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7475.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/adt7x10.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/amc6821.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/applesmc.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asb100.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asc7621.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/atxp1.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/coretemp.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/dme1737.ko 2023-12-08T07:55:30.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds1621.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ds620.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc1403.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/emc6w201.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71805f.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f71882fg.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/f75375s.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fam15h_power.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/fschmd.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g760a.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/g762.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl518sm.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/gl520sm.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5500_temp.ko 2023-12-08T07:55:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/i5k_amb.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmaem.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ibmpex.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina209.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ina2xx.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/it87.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k10temp.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/k8temp.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lineage-pem.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm63.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm73.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm75.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm77.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm78.ko 2023-12-08T07:55:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm80.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm83.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm85.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm87.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm90.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm92.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm93.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95234.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95241.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/lm95245.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc2945.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4151.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4215.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4222.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4245.ko 2023-12-08T07:55:30.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4260.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/ltc4261.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max16065.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1619.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max1668.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max197.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6639.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6650.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/max6697.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/mcp3021.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6683.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775-core.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct6775.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/nct7802.ko 2023-12-08T07:55:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87360.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pc87427.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pcf8591.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-08T07:55:30.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/powr1220.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5627.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch5636.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht15.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sht21.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/shtc1.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/sis5595.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47b397.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m1.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/smsc47m192.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/thmc50.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp102.ko 2023-12-08T07:55:30.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp103.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp401.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/tmp421.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via-cputemp.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/via686a.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt1211.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/vt8231.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627ehf.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83627hf.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83781d.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83791d.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83792d.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83793.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83795.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l785ts.ko 2023-12-08T07:55:30.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/hwmon/w83l786ng.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-08T07:55:30.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-08T07:55:30.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-dev.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-mux.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-smbus.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/i2c/i2c-stub.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_core.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw 2023-12-08T07:55:30.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert 2023-12-08T07:55:30.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/gameport/gameport.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/joydev.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/appletouch.ko 2023-12-08T07:55:30.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/bcm5974.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/cyapatp.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/sermouse.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/altera_ps2.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/arc_ps2.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/serio/serio_raw.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/input/sparse-keymap.ko 2023-12-08T07:55:30.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-blinkm.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lm3530.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-lp3944.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/leds-ss4200.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-08T07:55:30.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/bcache/bcache.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-bio-prison.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache-smq.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-cache.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-crypt.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-delay.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-flakey.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-log-userspace.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-multipath.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-queue-length.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-raid.ko 2023-12-08T07:55:30.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-round-robin.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-service-time.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-switch.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-thin-pool.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/dm-verity.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/faulty.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/linear.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/multipath.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid0.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid1.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid10.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/md/raid456.ko 2023-12-08T07:55:30.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptbase.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptctl.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptfc.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptlan.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptsas.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptscsih.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/message/fusion/mptspi.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_ich.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/lpc_sch.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/mfd-core.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/sm501.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/viperboard.ko 2023-12-08T07:55:30.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/vx855.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/mfd/wl1273-core.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds9802als.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/apds990x.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/bh1770glc.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/cb710/cb710.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/at24.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/eeprom/max6875.ko 2023-12-08T07:55:30.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/enclosure.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/hpilo.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29003.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/isl29020.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-me.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei-txe.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/mei/mei.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-gru 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-08T07:55:30.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_7xx1.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tifm_core.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/tsl2550.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_balloon.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/bonding/bonding.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-08T07:55:30.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/dummy.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/eql.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-08T07:55:30.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros 2023-12-08T07:55:30.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-08T07:55:30.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-08T07:55:30.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-08T07:55:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/dnet.ko 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet 2023-12-08T07:55:30.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ethoc.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/fealnx.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-08T07:55:30.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/jme.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-08T07:55:30.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-08T07:55:30.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-08T07:55:30.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rocker 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-08T07:55:30.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-08T07:55:30.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/geneve.ko 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv 2023-12-08T07:55:30.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ifb.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvlan.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/macvtap.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/mii.ko 2023-12-08T07:55:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/net_failover.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/netconsole.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/nlmon.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/amd.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/bcm87xx.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/broadcom.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/cicada.ko 2023-12-08T07:55:30.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/davicom.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/dp83640.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/et1011c.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/icplus.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/lxt.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/marvell.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/micrel.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/national.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/phylink.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/qsemi.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/realtek.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/smsc.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/ste10Xp.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/phy/vitesse.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-08T07:55:30.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_async.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppoe.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pppox.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/ppp/pptp.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slhc.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/slip/slip.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/sungem_phy.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tap.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team.ko 2023-12-08T07:55:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_random.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/tun.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/veth.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/virtio_net.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/vxlan/vxlan.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/net/xen-netfront.ko 2023-12-08T07:55:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ntb/ntb.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme-core.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/nvme/host/nvme.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_cs.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_pc.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/parport/parport_serial.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-08T07:55:30.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pcie 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pci/xen-pcifront.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/i82092.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/pd6729.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/acerhdf.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-08T07:55:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/hdaps.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/intel_ips.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-08T07:55:30.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/platform/x86/wmi.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-08T07:55:30.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/clients/pps_parport.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/pps/pps_core.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ptp/ptp_kvm.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-08T07:55:30.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-em3027.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-max6900.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-08T07:55:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/rtc/rtc-x1205.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-9xxx.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-sas.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/3w-xxxx.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/BusLogic.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/a100u2w.ko 2023-12-08T07:55:30.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/advansys.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/am53c974.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/atp870u.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bfa/bfa.ko 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc 2023-12-08T07:55:30.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ch.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dc395x.ko 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler 2023-12-08T07:55:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/dmx3191d.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/esp_scsi.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/fnic/fnic.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hpsa.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hptiop.ko 2023-12-08T07:55:30.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/hv_storvsc.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/initio.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ipr.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ips.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/isci/isci.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libfc/libfc.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/libsas/libsas.ko 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc 2023-12-08T07:55:30.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/mvumi.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/pmcraid.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla1280.ko 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx 2023-12-08T07:55:30.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/raid_class.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_debug.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/ses.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/st.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/stex.ko 2023-12-08T07:55:30.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/virtio_scsi.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/scsi/wd719x.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ssb/ssb.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_file.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_iblock.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_mod.ko 2023-12-08T07:55:30.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_pscsi.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/target_core_user.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-08T07:55:30.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_gsm.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/n_hdlc.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/nozomi.ko 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250 2023-12-08T07:55:30.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/arc_uart.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_aec.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_cif.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_pci_generic.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/uio/uio_sercos3.ko 2023-12-08T07:55:30.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-acm.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usblp.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/class/usbtmc.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/mdc800.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/image/microtek.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/adutux.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/appledisplay.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi26.ko 2023-12-08T07:55:30.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/emi62.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ezusb.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/idmouse.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/iowarrior.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/ldusb.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/legousbtower.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usb3503.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usblcd.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/uss720.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/misc/yurex.ko 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy 2023-12-08T07:55:30.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/phy/phy-generic.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/aircable.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ark3116.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ch341.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cp210x.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cyberjack.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/empeg.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/io_ti.ko 2023-12-08T07:55:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipaq.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ipw.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ir-usb.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mct_u232.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7720.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/mos7840.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/navman.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/omninet.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/opticon.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/option.ko 2023-12-08T07:55:30.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/oti6858.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/pl2303.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcaux.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/qcserial.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/quatech2.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/safe_serial.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/sierra.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ssu100.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/symbolserial.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_debug.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/visor.ko 2023-12-08T07:55:30.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/whiteheat.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/uas.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-karma.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-08T07:55:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/storage/usb-storage.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-08T07:55:30.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_net.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/vhost/vhost_scsi.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/apple_bl.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/lcd.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_balloon.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_mmio.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/virtio/virtio_ring.ko 2023-12-08T07:55:30.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2482.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/masters/ds2490.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-08T07:55:30.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/w1/wire.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/hpwdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/i6300esb.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ib700wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ibmasr.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/it87_wdt.ko 2023-12-08T07:55:30.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/machzwd.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/nv_tco.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/softdog.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/via_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/wdt_pci.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/watchdog/xen_wdt.ko 2023-12-08T07:55:30.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-evtchn.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntalloc.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-gntdev.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xen-privcmd.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/9p/9p.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/affs/affs.ko 2023-12-08T07:55:30.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/befs/befs.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/binfmt_misc.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/btrfs/btrfs.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cachefiles/cachefiles.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ceph/ceph.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/coda/coda.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/cramfs/cramfs.ko 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm 2023-12-08T07:55:30.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/dlm/dlm.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ecryptfs 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/f2fs/f2fs.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/fat.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/msdos.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fat/vfat.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fscache/fscache.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/cuse.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/fuse/fuse.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/gfs2/gfs2.ko 2023-12-08T07:55:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfs/hfs.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/hfsplus/hfsplus.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/isofs/isofs.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/jfs/jfs.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/lockd/lockd.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/minix/minix.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/netfs/netfs.ko 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs 2023-12-08T07:55:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfs.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv3.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs/nfsv4.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/grace.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfs_common/nfs_acl.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nfsd/nfsd.ko 2023-12-08T07:55:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nilfs2/nilfs2.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-celtic.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-centeuro.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-croatian.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-cyrillic.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-gaelic.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-greek.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-iceland.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-inuit.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-roman.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-romanian.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/mac-turkish.ko 2023-12-08T07:55:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1250.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1251.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp1255.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp737.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp775.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp850.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp852.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp855.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp857.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp860.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp861.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp862.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp863.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp864.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp865.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp866.ko 2023-12-08T07:55:30.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp869.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp874.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp932.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp936.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp949.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_cp950.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_euc-jp.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-1.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-13.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-14.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-15.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-2.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-3.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-4.ko 2023-12-08T07:55:30.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-5.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-6.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-7.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_iso8859-9.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-r.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-ru.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_koi8-u.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/nls/nls_utf8.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-08T07:55:30.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/overlayfs/overlay.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/pstore/ramoops.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/reiserfs/reiserfs.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/romfs/romfs.ko 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb 2023-12-08T07:55:30.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/client/cifs.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_arc4.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/smb/common/cifs_md4.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/squashfs/squashfs.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/sysv/sysv.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/udf/udf.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/ufs/ufs.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/fs/xfs/xfs.ko 2023-12-08T07:55:30.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/rcu 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/rcu/rcutorture.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/torture.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/trace 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/asn1_encoder.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc-itu-t.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crc8.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libarc4.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/crypto/libdes.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/libcrc32c.ko 2023-12-08T07:55:30.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lru_cache.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4_compress.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/lz4/lz4hc_compress.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/math/cordic.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/raid6/raid6_pq.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_bm.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_fsm.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/ts_kmp.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/zstd 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/lib/zstd/zstd_compress.ko 2023-12-08T07:55:30.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/mm 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/mm/hwpoison-inject.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/6lowpan.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_dest.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_fragment.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_hop.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_mobility.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_routing.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/6lowpan/nhc_udp.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/garp.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/mrp.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/p8022.ko 2023-12-08T07:55:30.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/psnap.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/802/stp.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/8021q/8021q.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_fd.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_rdma.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/9p/9pnet_virtio.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/batman-adv/batman-adv.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/br_netfilter.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/bridge.ko 2023-12-08T07:55:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-08T07:55:30.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/ebtables.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ceph/libceph.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/failover.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/core/pktgen.ko 2023-12-08T07:55:30.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_diag.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv4.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dccp/dccp_ipv6.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dns_resolver 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dns_resolver/dns_resolver.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/dsa_core.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_brcm.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_dsa.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_none.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/dsa/tag_trailer.ko 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan 2023-12-08T07:55:30.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ah4.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/esp4.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/fou.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/gre.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/inet_diag.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_gre.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_tunnel.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ip_vti.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipcomp.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/ipip.ko 2023-12-08T07:55:30.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-08T07:55:30.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_bic.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_dctcp.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_diag.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_highspeed.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_htcp.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_hybla.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_illinois.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_lp.ko 2023-12-08T07:55:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_scalable.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_vegas.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_veno.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_westwood.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tcp_yeah.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/tunnel4.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_diag.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/udp_tunnel.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ah6.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/esp6.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/fou6.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_tunnel.ko 2023-12-08T07:55:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ip6_vti.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/ipcomp6.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-08T07:55:30.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/sit.ko 2023-12-08T07:55:30.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/tunnel6.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/key 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/key/af_key.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_core.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_eth.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ip6.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_netlink.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/l2tp/l2tp_ppp.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/llc/llc.ko 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154 2023-12-08T07:55:30.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mac802154/mac802154.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/mpls/mpls_gso.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-08T07:55:30.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-08T07:55:30.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conncount.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-08T07:55:30.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_log_syslog.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat.ko 2023-12-08T07:55:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_irc.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_sip.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nf_tables.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_log.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_chain_nat.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_compat.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_ct.ko 2023-12-08T07:55:30.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fib.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_hash.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_limit.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_log.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_masq.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_nat.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_numgen.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_queue.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_quota.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_redir.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_reject_inet.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_socket.ko 2023-12-08T07:55:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/nft_tunnel.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_AUDIT.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_CT.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_DSCP.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HL.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_HMARK.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LED.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_LOG.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NETMAP.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFLOG.ko 2023-12-08T07:55:30.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_RATEEST.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_SECMARK.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TEE.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TPROXY.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_TRACE.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_addrtype.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_bpf.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cgroup.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cluster.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_comment.ko 2023-12-08T07:55:30.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connbytes.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlabel.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connlimit.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_connmark.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_conntrack.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_cpu.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dccp.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_devgroup.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_dscp.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ecn.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_esp.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hashlimit.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_helper.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_hl.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipcomp.ko 2023-12-08T07:55:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_iprange.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_ipvs.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_l2tp.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_length.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_limit.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mac.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_mark.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_multiport.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nat.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_nfacct.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_osf.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_owner.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_physdev.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_pkttype.ko 2023-12-08T07:55:30.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_policy.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_quota.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_rateest.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_realm.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_recent.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_sctp.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_set.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_socket.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_state.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_statistic.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_string.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_tcpmss.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_time.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netfilter/xt_u32.ko 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink 2023-12-08T07:55:30.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/netlink/netlink_diag.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/nsh/nsh.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/openvswitch.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-geneve.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-gre.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/openvswitch/vport-vxlan.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/packet/af_packet_diag.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_rdma.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/rds/rds_tcp.ko 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched 2023-12-08T07:55:30.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_csum.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_gact.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_ipt.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_mirred.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_nat.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_pedit.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_police.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_simple.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_skbedit.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/act_vlan.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_basic.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_bpf.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_flow.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_fw.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_route.ko 2023-12-08T07:55:30.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/cls_u32.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_cmp.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_ipset.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_meta.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_nbyte.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_text.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/em_u32.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_choke.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_codel.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_drr.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_fq.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_gred.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hfsc.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_hhf.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_htb.ko 2023-12-08T07:55:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_ingress.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_mqprio_lib.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_multiq.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_netem.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_pie.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_plug.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_prio.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_qfq.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_red.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfb.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_sfq.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_tbf.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sched/sch_teql.ko 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp 2023-12-08T07:55:30.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sctp/sctp_diag.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/sunrpc.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/diag.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/tipc/tipc.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/unix/unix_diag.ko 2023-12-08T07:55:30.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/encrypted-keys 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/trusted-keys 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/security/keys/trusted-keys/trusted.ko 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt 2023-12-08T07:55:30.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/kernel/virt/lib/irqbypass.ko 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.alias 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.alias.bin 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.alias.bin 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.bin 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.builtin.modinfo 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.dep 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.dep.bin 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.devname 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.order 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.softdep 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.symbols 2023-12-08T07:55:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g6bcacf46b788/modules.symbols.bin 2023-12-08T07:55:30.925 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g6bcacf46b788 2023-12-08T07:55:30.925 DEBUG:teuthology.orchestra.run.smithi045:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:postinstall scriptlet (using /bin/sh): 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g6bcacf46b788 -a -r /boot/System.map-6.6.0-g6bcacf46b788 ]; then 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/vmlinuz-6.6.0-g6bcacf46b788 /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/System.map-6.6.0-g6bcacf46b788 /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/vmlinuz-6.6.0-g6bcacf46b788 /boot/System.map-6.6.0-g6bcacf46b788 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/installkernel 6.6.0-g6bcacf46b788 /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/.vmlinuz-6.6.0-g6bcacf46b788-rpm /boot/.System.map-6.6.0-g6bcacf46b788-rpm 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-08T07:55:30.949 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:new-kernel-pkg --remove 6.6.0-g6bcacf46b788 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g6bcacf46b788.img 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-install remove 6.6.0-g6bcacf46b788 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/update-bootloader --remove 6.6.0-g6bcacf46b788 2023-12-08T07:55:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-12-08T07:55:30.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 68.el9 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8264254 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2023-12-08T07:55:31.031 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T07:55:31.032 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T07:55:31.033 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T07:55:31.033 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 6.6.0-g6bcacf46b788 2023-12-08T07:55:31.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T07:55:31.679 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-12-08T07:55:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-08T07:55:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-12-08T07:55:33.212 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T07:55:33.227 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.vMzhEdrAjf 2023-12-08T07:55:33.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vMzhEdrAjf 2023-12-08T07:55:33.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.vMzhEdrAjf 2023-12-08T07:55:33.451 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.vMzhEdrAjf is 6KB 2023-12-08T07:55:33.500 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.vMzhEdrAjf 2023-12-08T07:55:33.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T07:55:33.584 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-08T07:55:33.584 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-08T07:55:33.584 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-08T07:55:33.584 INFO:teuthology.orchestra.run.smithi045.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g6bcacf46b788.conf 2023-12-08T07:55:33.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g6bcacf46b788 2023-12-08T07:55:33.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-12-08T07:55:39.906 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-08T07:55:39.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T07:55:39.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:55:58.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-12-08T07:56:03.734 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-08T07:56:03.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T07:56:03.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:56:07.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T07:56:07.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:56:10.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-12-08T07:56:22.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-08T07:56:22.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T07:56:22.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:56:31.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T07:56:31.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:56:34.310 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-08T07:56:46.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T07:56:46.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T07:56:55.442 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-12-08T07:56:56.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T07:56:56.097 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g6bcacf46b788"... 2023-12-08T07:56:56.098 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-12-08T07:56:56.142 INFO:teuthology.orchestra.run.smithi114.stdout:6.6.0-g6bcacf46b788 2023-12-08T07:56:56.142 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g6bcacf46b788 vs 6.6.0-g6bcacf46b788 2023-12-08T07:56:56.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T07:56:56.142 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T07:56:57.144 DEBUG:teuthology.parallel:result is None 2023-12-08T07:57:18.133 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-08T07:57:18.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T07:57:18.919 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g6bcacf46b788"... 2023-12-08T07:57:18.919 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-08T07:57:18.965 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-g6bcacf46b788 2023-12-08T07:57:18.965 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g6bcacf46b788 vs 6.6.0-g6bcacf46b788 2023-12-08T07:57:18.966 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T07:57:18.966 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T07:57:19.967 DEBUG:teuthology.parallel:result is None 2023-12-08T07:57:19.967 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-08T07:57:19.974 INFO:teuthology.task.internal:Creating test directory... 2023-12-08T07:57:19.974 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T07:57:19.981 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T07:57:20.045 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-08T07:57:20.052 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-08T07:57:20.078 INFO:teuthology.task.internal:Creating archive directory... 2023-12-08T07:57:20.078 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T07:57:20.084 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T07:57:20.158 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-08T07:57:20.166 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-08T07:57:20.166 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T07:57:20.173 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T07:57:20.325 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T07:57:20.351 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T07:57:20.408 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T07:57:20.422 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T07:57:20.427 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-08T07:57:20.434 INFO:teuthology.task.internal:Configuring sudo... 2023-12-08T07:57:20.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T07:57:20.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T07:57:20.537 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-08T07:57:20.547 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-08T07:57:20.547 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T07:57:20.553 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T07:57:20.611 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T07:57:20.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T07:57:20.773 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T07:57:20.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T07:57:20.922 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T07:57:20.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T07:57:21.010 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T07:57:21.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T07:57:21.203 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T07:57:21.290 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T07:57:21.387 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T07:57:21.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T07:57:21.483 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-12-08T07:57:21.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2023-12-08T07:57:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T07:57:21.665 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T07:57:21.911 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-08T07:57:21.918 INFO:teuthology.task.internal:Starting timer... 2023-12-08T07:57:21.918 INFO:teuthology.run_tasks:Running task pcp... 2023-12-08T07:57:21.962 INFO:teuthology.run_tasks:Running task selinux... 2023-12-08T07:57:22.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-12-08T07:57:22.117 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-12-08T07:57:22.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2023-12-08T07:57:22.250 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2023-12-08T07:57:22.254 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-08T07:57:22.254 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-12-08T07:57:22.310 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-12-08T07:57:22.311 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2023-12-08T07:57:22.375 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2023-12-08T07:57:22.376 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi114.front.sepia.ceph.com': 'permissive'} 2023-12-08T07:57:22.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T07:57:22.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T07:57:22.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T07:57:22.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T07:57:22.559 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-08T07:57:22.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-12-08T07:57:22.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2023-12-08T07:57:22.790 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-08T07:57:22.800 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-08T07:57:22.800 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-08T07:57:22.820 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-08T07:57:22.821 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-08T08:09:31.606 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2023-12-08T08:09:31.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T08:09:31.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:09:31.750 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-08T08:09:31.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-08T08:09:31.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T08:09:31.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:09:32.052 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-12-08T08:09:32.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-12-08T08:09:32.201 INFO:teuthology.run_tasks:Running task clock... 2023-12-08T08:09:32.212 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-08T08:09:32.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:09:32.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:09:32.222 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:09:32.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T08:09:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T08:09:32.377 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T08:09:32.380 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T08:09:32.467 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2023-12-08T08:09:32.488 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-12-08T08:09:32.506 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2023-12-08T08:09:32.534 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-12-08T08:09:32.554 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T08:09:32.587 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T08:09:32.601 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T08:09:32.641 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T08:09:32.734 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:09:32.744 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:09:32.744 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-12-08T08:09:32.745 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.745 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.745 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.745 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.781 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:09:32.789 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:09:32.789 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-12-08T08:09:32.789 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.789 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.790 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.790 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:09:32.791 INFO:teuthology.run_tasks:Running task install... 2023-12-08T08:09:32.800 DEBUG:teuthology.task.install:project ceph 2023-12-08T08:09:32.800 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}} 2023-12-08T08:09:32.800 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'} 2023-12-08T08:09:32.800 INFO:teuthology.task.install:Using flavor: default 2023-12-08T08:09:32.806 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-08T08:09:32.806 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-08T08:09:32.807 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-08T08:09:32.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:09:32.809 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-08T08:09:32.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:09:32.954 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/ 2023-12-08T08:09:32.954 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-08T08:09:32.986 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/ 2023-12-08T08:09:32.986 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-08T08:09:33.069 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T08:09:33.070 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:09:33.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T08:09:33.157 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T08:09:33.157 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:09:33.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T08:09:33.183 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-08T08:09:33.183 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T08:09:33.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-08T08:09:33.259 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T08:09:33.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T08:09:33.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T08:09:33.478 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T08:09:33.530 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T08:09:33.578 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-12-08T08:09:33.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-12-08T08:09:33.625 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2023-12-08T08:09:33.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2023-12-08T08:09:33.958 INFO:teuthology.orchestra.run.smithi045.stdout:73 files removed 2023-12-08T08:09:33.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-08T08:09:34.000 INFO:teuthology.orchestra.run.smithi114.stdout:73 files removed 2023-12-08T08:09:34.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-08T08:09:35.033 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 160 kB/s | 78 kB 00:00 2023-12-08T08:09:35.061 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 146 kB/s | 78 kB 00:00 2023-12-08T08:09:35.567 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-12-08T08:09:35.636 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-08T08:09:36.151 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2023-12-08T08:09:36.208 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-12-08T08:09:36.771 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-08T08:09:36.994 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.4 MB 00:00 2023-12-08T08:09:38.330 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2023-12-08T08:09:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2023-12-08T08:09:39.277 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-08T08:09:40.772 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-12-08T08:09:41.886 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-12-08T08:09:44.209 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 18 MB 00:02 2023-12-08T08:09:47.220 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 5.8 MB 00:01 2023-12-08T08:09:48.930 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2023-12-08T08:09:50.368 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 5.8 MB 00:02 2023-12-08T08:09:50.548 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2023-12-08T08:09:52.019 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 15 kB 00:00 2023-12-08T08:09:56.081 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2023-12-08T08:09:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:09:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:09:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-08T08:09:58.821 INFO:teuthology.orchestra.run.smithi114.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-08T08:09:58.822 INFO:teuthology.orchestra.run.smithi114.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-08T08:09:58.824 INFO:teuthology.orchestra.run.smithi114.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-08T08:09:58.826 INFO:teuthology.orchestra.run.smithi114.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-08T08:09:58.830 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-08T08:09:58.831 INFO:teuthology.orchestra.run.smithi114.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-08T08:09:58.910 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================== 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================== 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 6.5 k 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 5.2 M 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 860 k 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 141 k 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 1.5 M 2023-12-08T08:09:58.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 133 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 1.8 M 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 7.4 M 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 50 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 8.6 M 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 41 M 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 262 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 801 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 217 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 18 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-08T08:09:58.934 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 31 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 719 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 126 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 161 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 320 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 298 k 2023-12-08T08:09:58.935 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 99 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 85 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 170 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-08T08:09:58.936 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.3 M 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 19 M 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 28 k 2023-12-08T08:09:58.937 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 2.1 M 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 243 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.4 M 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 18 M 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 15 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 24 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-08T08:09:58.938 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 164 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 476 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.8 M 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-08T08:09:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 45 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 129 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-08T08:09:58.940 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-08T08:09:58.941 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-08T08:09:58.942 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-08T08:09:58.943 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:========================================================================================== 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:Install 132 Packages 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 15 Packages 2023-12-08T08:09:58.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:09:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 204 M 2023-12-08T08:09:58.945 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2023-12-08T08:09:59.986 INFO:teuthology.orchestra.run.smithi114.stdout:(1/147): ceph-19.0.0-46.ga2cd52c0.el9.x86_64.rp 22 kB/s | 6.5 kB 00:00 2023-12-08T08:10:00.716 INFO:teuthology.orchestra.run.smithi114.stdout:(2/147): ceph-base-19.0.0-46.ga2cd52c0.el9.x86_ 5.1 MB/s | 5.2 MB 00:01 2023-12-08T08:10:00.817 INFO:teuthology.orchestra.run.smithi114.stdout:(3/147): ceph-immutable-object-cache-19.0.0-46. 1.4 MB/s | 141 kB 00:00 2023-12-08T08:10:00.867 INFO:teuthology.orchestra.run.smithi114.stdout:(4/147): ceph-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 978 kB/s | 860 kB 00:00 2023-12-08T08:10:01.092 INFO:teuthology.orchestra.run.smithi114.stdout:(5/147): ceph-mds-19.0.0-46.ga2cd52c0.el9.x86_6 7.6 MB/s | 2.1 MB 00:00 2023-12-08T08:10:01.393 INFO:teuthology.orchestra.run.smithi114.stdout:(6/147): ceph-common-19.0.0-46.ga2cd52c0.el9.x8 11 MB/s | 19 MB 00:01 2023-12-08T08:10:01.478 INFO:teuthology.orchestra.run.smithi114.stdout:(7/147): ceph-mgr-19.0.0-46.ga2cd52c0.el9.x86_6 2.4 MB/s | 1.5 MB 00:00 2023-12-08T08:10:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:(8/147): ceph-mon-19.0.0-46.ga2cd52c0.el9.x86_6 8.2 MB/s | 4.4 MB 00:00 2023-12-08T08:10:01.727 INFO:teuthology.orchestra.run.smithi114.stdout:(9/147): ceph-selinux-19.0.0-46.ga2cd52c0.el9.x 243 kB/s | 24 kB 00:00 2023-12-08T08:10:02.644 INFO:teuthology.orchestra.run.smithi114.stdout:(10/147): ceph-osd-19.0.0-46.ga2cd52c0.el9.x86_ 14 MB/s | 18 MB 00:01 2023-12-08T08:10:02.760 INFO:teuthology.orchestra.run.smithi114.stdout:(11/147): cephfs-mirror-19.0.0-46.ga2cd52c0.el9 1.8 MB/s | 217 kB 00:00 2023-12-08T08:10:02.836 INFO:teuthology.orchestra.run.smithi114.stdout:(12/147): libcephfs-devel-19.0.0-46.ga2cd52c0.e 418 kB/s | 31 kB 00:00 2023-12-08T08:10:03.011 INFO:teuthology.orchestra.run.smithi114.stdout:(13/147): libcephfs2-19.0.0-46.ga2cd52c0.el9.x8 4.0 MB/s | 719 kB 00:00 2023-12-08T08:10:03.162 INFO:teuthology.orchestra.run.smithi114.stdout:(14/147): ceph-radosgw-19.0.0-46.ga2cd52c0.el9. 5.1 MB/s | 8.6 MB 00:01 2023-12-08T08:10:03.195 INFO:teuthology.orchestra.run.smithi114.stdout:(15/147): libcephsqlite-19.0.0-46.ga2cd52c0.el9 897 kB/s | 164 kB 00:00 2023-12-08T08:10:03.228 INFO:teuthology.orchestra.run.smithi114.stdout:(16/147): librados-devel-19.0.0-46.ga2cd52c0.el 1.9 MB/s | 126 kB 00:00 2023-12-08T08:10:03.271 INFO:teuthology.orchestra.run.smithi114.stdout:(17/147): libradosstriper1-19.0.0-46.ga2cd52c0. 6.2 MB/s | 476 kB 00:00 2023-12-08T08:10:03.329 INFO:teuthology.orchestra.run.smithi114.stdout:(18/147): python3-ceph-argparse-19.0.0-46.ga2cd 794 kB/s | 45 kB 00:00 2023-12-08T08:10:03.396 INFO:teuthology.orchestra.run.smithi114.stdout:(19/147): python3-ceph-common-19.0.0-46.ga2cd52 1.9 MB/s | 129 kB 00:00 2023-12-08T08:10:03.505 INFO:teuthology.orchestra.run.smithi114.stdout:(20/147): python3-cephfs-19.0.0-46.ga2cd52c0.el 1.5 MB/s | 161 kB 00:00 2023-12-08T08:10:03.614 INFO:teuthology.orchestra.run.smithi114.stdout:(21/147): python3-rados-19.0.0-46.ga2cd52c0.el9 2.9 MB/s | 320 kB 00:00 2023-12-08T08:10:03.847 INFO:teuthology.orchestra.run.smithi114.stdout:(22/147): librgw2-19.0.0-46.ga2cd52c0.el9.x86_6 7.7 MB/s | 4.8 MB 00:00 2023-12-08T08:10:03.889 INFO:teuthology.orchestra.run.smithi114.stdout:(23/147): python3-rbd-19.0.0-46.ga2cd52c0.el9.x 1.1 MB/s | 298 kB 00:00 2023-12-08T08:10:03.923 INFO:teuthology.orchestra.run.smithi114.stdout:(24/147): python3-rgw-19.0.0-46.ga2cd52c0.el9.x 1.3 MB/s | 99 kB 00:00 2023-12-08T08:10:03.978 INFO:teuthology.orchestra.run.smithi114.stdout:(25/147): rbd-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 984 kB/s | 85 kB 00:00 2023-12-08T08:10:04.057 INFO:teuthology.orchestra.run.smithi114.stdout:(26/147): rbd-nbd-19.0.0-46.ga2cd52c0.el9.x86_6 2.1 MB/s | 170 kB 00:00 2023-12-08T08:10:04.157 INFO:teuthology.orchestra.run.smithi114.stdout:(27/147): ceph-grafana-dashboards-19.0.0-46.ga2 285 kB/s | 28 kB 00:00 2023-12-08T08:10:04.282 INFO:teuthology.orchestra.run.smithi114.stdout:(28/147): rbd-mirror-19.0.0-46.ga2cd52c0.el9.x8 8.4 MB/s | 3.0 MB 00:00 2023-12-08T08:10:04.316 INFO:teuthology.orchestra.run.smithi114.stdout:(29/147): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 843 kB/s | 133 kB 00:00 2023-12-08T08:10:04.608 INFO:teuthology.orchestra.run.smithi114.stdout:(30/147): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 5.4 MB/s | 1.8 MB 00:00 2023-12-08T08:10:04.691 INFO:teuthology.orchestra.run.smithi114.stdout:(31/147): ceph-mgr-modules-core-19.0.0-46.ga2cd 2.9 MB/s | 243 kB 00:00 2023-12-08T08:10:05.167 INFO:teuthology.orchestra.run.smithi114.stdout:(32/147): ceph-test-19.0.0-46.ga2cd52c0.el9.x86 12 MB/s | 41 MB 00:03 2023-12-08T08:10:05.192 INFO:teuthology.orchestra.run.smithi114.stdout:(33/147): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el9 100 kB/s | 50 kB 00:00 2023-12-08T08:10:05.234 INFO:teuthology.orchestra.run.smithi114.stdout:(34/147): ceph-prometheus-alerts-19.0.0-46.ga2c 230 kB/s | 15 kB 00:00 2023-12-08T08:10:05.268 INFO:teuthology.orchestra.run.smithi114.stdout:(35/147): ceph-volume-19.0.0-46.ga2cd52c0.el9.n 3.4 MB/s | 262 kB 00:00 2023-12-08T08:10:05.318 INFO:teuthology.orchestra.run.smithi114.stdout:(36/147): cephfs-top-19.0.0-46.ga2cd52c0.el9.no 370 kB/s | 18 kB 00:00 2023-12-08T08:10:05.368 INFO:teuthology.orchestra.run.smithi114.stdout:(37/147): cephadm-19.0.0-46.ga2cd52c0.el9.noarc 5.9 MB/s | 801 kB 00:00 2023-12-08T08:10:05.543 INFO:teuthology.orchestra.run.smithi114.stdout:(38/147): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2023-12-08T08:10:05.727 INFO:teuthology.orchestra.run.smithi114.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 920 kB 00:00 2023-12-08T08:10:05.769 INFO:teuthology.orchestra.run.smithi114.stdout:(40/147): automake-1.16.2-8.el9.noarch.rpm 1.4 MB/s | 662 kB 00:00 2023-12-08T08:10:05.794 INFO:teuthology.orchestra.run.smithi114.stdout:(41/147): boost-program-options-1.75.0-8.el9.x8 582 kB/s | 106 kB 00:00 2023-12-08T08:10:05.828 INFO:teuthology.orchestra.run.smithi114.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 225 kB/s | 21 kB 00:00 2023-12-08T08:10:05.853 INFO:teuthology.orchestra.run.smithi114.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 555 kB/s | 32 kB 00:00 2023-12-08T08:10:05.887 INFO:teuthology.orchestra.run.smithi114.stdout:(44/147): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 307 kB 00:00 2023-12-08T08:10:05.962 INFO:teuthology.orchestra.run.smithi114.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 17 kB 00:00 2023-12-08T08:10:06.037 INFO:teuthology.orchestra.run.smithi114.stdout:(46/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2023-12-08T08:10:06.096 INFO:teuthology.orchestra.run.smithi114.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 939 kB/s | 186 kB 00:00 2023-12-08T08:10:06.130 INFO:teuthology.orchestra.run.smithi114.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 62 kB/s | 10 kB 00:00 2023-12-08T08:10:06.155 INFO:teuthology.orchestra.run.smithi114.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 779 kB/s | 44 kB 00:00 2023-12-08T08:10:06.188 INFO:teuthology.orchestra.run.smithi114.stdout:(50/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 159 kB 00:00 2023-12-08T08:10:06.222 INFO:teuthology.orchestra.run.smithi114.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 661 kB 00:00 2023-12-08T08:10:06.264 INFO:teuthology.orchestra.run.smithi114.stdout:(52/147): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 578 kB 00:00 2023-12-08T08:10:06.289 INFO:teuthology.orchestra.run.smithi114.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 404 kB/s | 24 kB 00:00 2023-12-08T08:10:06.314 INFO:teuthology.orchestra.run.smithi114.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 543 kB/s | 46 kB 00:00 2023-12-08T08:10:06.348 INFO:teuthology.orchestra.run.smithi114.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2023-12-08T08:10:06.382 INFO:teuthology.orchestra.run.smithi114.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 537 kB/s | 34 kB 00:00 2023-12-08T08:10:06.432 INFO:teuthology.orchestra.run.smithi114.stdout:(57/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.9 MB/s | 217 kB 00:00 2023-12-08T08:10:06.607 INFO:teuthology.orchestra.run.smithi114.stdout:(58/147): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-12-08T08:10:06.674 INFO:teuthology.orchestra.run.smithi114.stdout:(59/147): postgresql-13.11-1.el9.x86_64.rpm 5.6 MB/s | 1.5 MB 00:00 2023-12-08T08:10:06.708 INFO:teuthology.orchestra.run.smithi114.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-12-08T08:10:06.733 INFO:teuthology.orchestra.run.smithi114.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2023-12-08T08:10:06.983 INFO:teuthology.orchestra.run.smithi114.stdout:(62/147): python3-jinja2-2.11.3-4.el9.noarch.rp 940 kB/s | 228 kB 00:00 2023-12-08T08:10:07.117 INFO:teuthology.orchestra.run.smithi114.stdout:(63/147): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-12-08T08:10:07.234 INFO:teuthology.orchestra.run.smithi114.stdout:(64/147): postgresql-server-13.11-1.el9.x86_64. 11 MB/s | 5.7 MB 00:00 2023-12-08T08:10:07.284 INFO:teuthology.orchestra.run.smithi114.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 82 kB/s | 24 kB 00:00 2023-12-08T08:10:07.334 INFO:teuthology.orchestra.run.smithi114.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 89 kB/s | 18 kB 00:00 2023-12-08T08:10:07.360 INFO:teuthology.orchestra.run.smithi114.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-08T08:10:07.410 INFO:teuthology.orchestra.run.smithi114.stdout:(68/147): python3-markupsafe-1.1.1-12.el9.x86_6 255 kB/s | 32 kB 00:00 2023-12-08T08:10:07.600 INFO:teuthology.orchestra.run.smithi114.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2023-12-08T08:10:07.635 INFO:teuthology.orchestra.run.smithi114.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-12-08T08:10:07.660 INFO:teuthology.orchestra.run.smithi114.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 741 kB/s | 174 kB 00:00 2023-12-08T08:10:07.711 INFO:teuthology.orchestra.run.smithi114.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 376 kB/s | 41 kB 00:00 2023-12-08T08:10:07.745 INFO:teuthology.orchestra.run.smithi114.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-12-08T08:10:07.770 INFO:teuthology.orchestra.run.smithi114.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 211 kB 00:00 2023-12-08T08:10:07.820 INFO:teuthology.orchestra.run.smithi114.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 439 kB/s | 47 kB 00:00 2023-12-08T08:10:07.887 INFO:teuthology.orchestra.run.smithi114.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 370 kB/s | 43 kB 00:00 2023-12-08T08:10:08.046 INFO:teuthology.orchestra.run.smithi114.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 172 kB/s | 39 kB 00:00 2023-12-08T08:10:08.121 INFO:teuthology.orchestra.run.smithi114.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2023-12-08T08:10:08.321 INFO:teuthology.orchestra.run.smithi114.stdout:(79/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2023-12-08T08:10:08.363 INFO:teuthology.orchestra.run.smithi114.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 186 kB/s | 56 kB 00:00 2023-12-08T08:10:08.388 INFO:teuthology.orchestra.run.smithi114.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 323 kB/s | 85 kB 00:00 2023-12-08T08:10:08.430 INFO:teuthology.orchestra.run.smithi114.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 964 kB/s | 63 kB 00:00 2023-12-08T08:10:08.481 INFO:teuthology.orchestra.run.smithi114.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 383 kB/s | 44 kB 00:00 2023-12-08T08:10:08.506 INFO:teuthology.orchestra.run.smithi114.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 682 kB/s | 79 kB 00:00 2023-12-08T08:10:08.539 INFO:teuthology.orchestra.run.smithi114.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-12-08T08:10:08.616 INFO:teuthology.orchestra.run.smithi114.stdout:(86/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2023-12-08T08:10:08.648 INFO:teuthology.orchestra.run.smithi114.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2023-12-08T08:10:08.699 INFO:teuthology.orchestra.run.smithi114.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.1 MB 00:00 2023-12-08T08:10:08.724 INFO:teuthology.orchestra.run.smithi114.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-08T08:10:08.749 INFO:teuthology.orchestra.run.smithi114.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-12-08T08:10:08.774 INFO:teuthology.orchestra.run.smithi114.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-08T08:10:08.834 INFO:teuthology.orchestra.run.smithi114.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2023-12-08T08:10:08.950 INFO:teuthology.orchestra.run.smithi114.stdout:(93/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2023-12-08T08:10:09.192 INFO:teuthology.orchestra.run.smithi114.stdout:(94/147): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2023-12-08T08:10:09.259 INFO:teuthology.orchestra.run.smithi114.stdout:(95/147): libarrow-doc-9.0.0-10.el9.noarch.rpm 418 kB/s | 26 kB 00:00 2023-12-08T08:10:09.318 INFO:teuthology.orchestra.run.smithi114.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 837 kB/s | 49 kB 00:00 2023-12-08T08:10:09.435 INFO:teuthology.orchestra.run.smithi114.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 579 kB/s | 67 kB 00:00 2023-12-08T08:10:09.510 INFO:teuthology.orchestra.run.smithi114.stdout:(98/147): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2023-12-08T08:10:09.596 INFO:teuthology.orchestra.run.smithi114.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 6.3 MB/s | 548 kB 00:00 2023-12-08T08:10:09.661 INFO:teuthology.orchestra.run.smithi114.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 684 kB/s | 43 kB 00:00 2023-12-08T08:10:09.727 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 20 MB 00:17 2023-12-08T08:10:09.728 INFO:teuthology.orchestra.run.smithi114.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 489 kB/s | 32 kB 00:00 2023-12-08T08:10:09.761 INFO:teuthology.orchestra.run.smithi114.stdout:(102/147): python3-devel-3.9.17-2.el9.x86_64.rp 249 kB/s | 245 kB 00:00 2023-12-08T08:10:09.803 INFO:teuthology.orchestra.run.smithi114.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2023-12-08T08:10:09.837 INFO:teuthology.orchestra.run.smithi114.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2023-12-08T08:10:09.887 INFO:teuthology.orchestra.run.smithi114.stdout:(105/147): python3-google-auth-2.23.4-1.el9.noa 3.9 MB/s | 197 kB 00:00 2023-12-08T08:10:09.954 INFO:teuthology.orchestra.run.smithi114.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 163 kB/s | 11 kB 00:00 2023-12-08T08:10:09.988 INFO:teuthology.orchestra.run.smithi114.stdout:(107/147): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2023-12-08T08:10:10.030 INFO:teuthology.orchestra.run.smithi114.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2023-12-08T08:10:10.072 INFO:teuthology.orchestra.run.smithi114.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2023-12-08T08:10:10.130 INFO:teuthology.orchestra.run.smithi114.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2023-12-08T08:10:10.173 INFO:teuthology.orchestra.run.smithi114.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2023-12-08T08:10:10.214 INFO:teuthology.orchestra.run.smithi114.stdout:(112/147): python3-jwt+crypto-2.4.0-1.el9.noarc 109 kB/s | 9.0 kB 00:00 2023-12-08T08:10:10.265 INFO:teuthology.orchestra.run.smithi114.stdout:(113/147): python3-jwt-2.4.0-1.el9.noarch.rpm 449 kB/s | 41 kB 00:00 2023-12-08T08:10:10.332 INFO:teuthology.orchestra.run.smithi114.stdout:(114/147): python3-logutils-0.3.5-21.el9.noarch 704 kB/s | 46 kB 00:00 2023-12-08T08:10:10.382 INFO:teuthology.orchestra.run.smithi114.stdout:(115/147): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2023-12-08T08:10:10.424 INFO:teuthology.orchestra.run.smithi114.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 865 kB/s | 79 kB 00:00 2023-12-08T08:10:10.449 INFO:teuthology.orchestra.run.smithi114.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 873 kB/s | 58 kB 00:00 2023-12-08T08:10:10.491 INFO:teuthology.orchestra.run.smithi114.stdout:(118/147): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2023-12-08T08:10:10.517 INFO:teuthology.orchestra.run.smithi114.stdout:(119/147): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2023-12-08T08:10:10.542 INFO:teuthology.orchestra.run.smithi114.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-12-08T08:10:10.567 INFO:teuthology.orchestra.run.smithi114.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 624 kB/s | 31 kB 00:00 2023-12-08T08:10:10.626 INFO:teuthology.orchestra.run.smithi114.stdout:(122/147): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-08T08:10:10.651 INFO:teuthology.orchestra.run.smithi114.stdout:(123/147): python3-rsa-4.9-2.el9.noarch.rpm 713 kB/s | 59 kB 00:00 2023-12-08T08:10:10.676 INFO:teuthology.orchestra.run.smithi114.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 725 kB/s | 36 kB 00:00 2023-12-08T08:10:10.702 INFO:teuthology.orchestra.run.smithi114.stdout:(125/147): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-08T08:10:10.735 INFO:teuthology.orchestra.run.smithi114.stdout:(126/147): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2023-12-08T08:10:10.761 INFO:teuthology.orchestra.run.smithi114.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-08T08:10:10.861 INFO:teuthology.orchestra.run.smithi114.stdout:(128/147): openssl-devel-3.0.7-25.el9.x86_64.rp 2.0 MB/s | 4.1 MB 00:02 2023-12-08T08:10:10.886 INFO:teuthology.orchestra.run.smithi114.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2023-12-08T08:10:10.920 INFO:teuthology.orchestra.run.smithi114.stdout:(130/147): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2023-12-08T08:10:10.953 INFO:teuthology.orchestra.run.smithi114.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-08T08:10:11.062 INFO:teuthology.orchestra.run.smithi114.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2023-12-08T08:10:11.121 INFO:teuthology.orchestra.run.smithi114.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2023-12-08T08:10:11.163 INFO:teuthology.orchestra.run.smithi114.stdout:(134/147): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-08T08:10:11.197 INFO:teuthology.orchestra.run.smithi114.stdout:(135/147): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-08T08:10:11.238 INFO:teuthology.orchestra.run.smithi114.stdout:(136/147): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-08T08:10:11.280 INFO:teuthology.orchestra.run.smithi114.stdout:(137/147): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-08T08:10:11.322 INFO:teuthology.orchestra.run.smithi114.stdout:(138/147): libacl-2.3.1-4.el9.x86_64.rpm 535 kB/s | 22 kB 00:00 2023-12-08T08:10:11.364 INFO:teuthology.orchestra.run.smithi114.stdout:(139/147): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-08T08:10:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:(140/147): NetworkManager-1.45.7-1.el9.x86_64.r 6.5 MB/s | 2.3 MB 00:00 2023-12-08T08:10:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:(141/147): librados2-19.0.0-46.ga2cd52c0.el9.x8 3.1 MB/s | 3.3 MB 00:01 2023-12-08T08:10:12.124 INFO:teuthology.orchestra.run.smithi114.stdout:(142/147): NetworkManager-libnm-1.45.7-1.el9.x8 4.4 MB/s | 1.8 MB 00:00 2023-12-08T08:10:12.232 INFO:teuthology.orchestra.run.smithi114.stdout:(143/147): NetworkManager-team-1.45.7-1.el9.x86 173 kB/s | 43 kB 00:00 2023-12-08T08:10:12.366 INFO:teuthology.orchestra.run.smithi114.stdout:(144/147): NetworkManager-tui-1.45.7-1.el9.x86_ 1.0 MB/s | 246 kB 00:00 2023-12-08T08:10:12.541 INFO:teuthology.orchestra.run.smithi114.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 4.0 MB/s | 1.2 MB 00:00 2023-12-08T08:10:12.633 INFO:teuthology.orchestra.run.smithi114.stdout:(146/147): librbd1-19.0.0-46.ga2cd52c0.el9.x86_ 1.8 MB/s | 3.0 MB 00:01 2023-12-08T08:10:12.783 INFO:teuthology.orchestra.run.smithi114.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.2 MB/s | 2.2 MB 00:00 2023-12-08T08:10:12.793 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:10:12.793 INFO:teuthology.orchestra.run.smithi114.stdout:Total 15 MB/s | 204 MB 00:13 2023-12-08T08:10:13.204 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2023-12-08T08:10:13.481 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2023-12-08T08:10:13.482 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2023-12-08T08:10:15.619 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2023-12-08T08:10:15.755 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2023-12-08T08:10:15.756 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2023-12-08T08:10:18.501 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:10:18.503 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:10:18.524 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-08T08:10:18.526 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-08T08:10:18.527 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-08T08:10:18.529 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-08T08:10:18.532 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-08T08:10:18.536 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-08T08:10:18.537 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-08T08:10:18.622 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================== 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================== 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 6.5 k 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 5.2 M 2023-12-08T08:10:18.642 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 860 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 141 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 1.5 M 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 133 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 1.8 M 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 7.4 M 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 50 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 8.6 M 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 41 M 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 262 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 801 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 217 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 18 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-08T08:10:18.643 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 31 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 719 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 126 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 161 k 2023-12-08T08:10:18.644 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 320 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 298 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 99 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 85 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 170 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-08T08:10:18.645 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.3 M 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-08T08:10:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 19 M 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 28 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 2.1 M 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 243 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.4 M 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 18 M 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 15 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 24 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-08T08:10:18.647 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 164 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 476 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.8 M 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-08T08:10:18.648 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 45 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 129 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-08T08:10:18.649 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-08T08:10:18.650 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-08T08:10:18.651 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-08T08:10:18.652 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================== 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:Install 132 Packages 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 15 Packages 2023-12-08T08:10:18.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:10:18.654 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 204 M 2023-12-08T08:10:18.654 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-12-08T08:10:19.521 INFO:teuthology.orchestra.run.smithi045.stdout:(1/147): ceph-19.0.0-46.ga2cd52c0.el9.x86_64.rp 19 kB/s | 6.5 kB 00:00 2023-12-08T08:10:20.054 INFO:teuthology.orchestra.run.smithi045.stdout:(2/147): ceph-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 1.6 MB/s | 860 kB 00:00 2023-12-08T08:10:20.163 INFO:teuthology.orchestra.run.smithi045.stdout:(3/147): ceph-immutable-object-cache-19.0.0-46. 1.3 MB/s | 141 kB 00:00 2023-12-08T08:10:20.788 INFO:teuthology.orchestra.run.smithi045.stdout:(4/147): ceph-mds-19.0.0-46.ga2cd52c0.el9.x86_6 3.3 MB/s | 2.1 MB 00:00 2023-12-08T08:10:21.255 INFO:teuthology.orchestra.run.smithi045.stdout:(5/147): ceph-base-19.0.0-46.ga2cd52c0.el9.x86_ 2.5 MB/s | 5.2 MB 00:02 2023-12-08T08:10:21.297 INFO:teuthology.orchestra.run.smithi045.stdout:(6/147): ceph-mgr-19.0.0-46.ga2cd52c0.el9.x86_6 2.9 MB/s | 1.5 MB 00:00 2023-12-08T08:10:22.064 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2023-12-08T08:10:22.289 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-12-08T08:10:22.325 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-12-08T08:10:22.410 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-12-08T08:10:22.473 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-12-08T08:10:22.512 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-12-08T08:10:22.547 INFO:teuthology.orchestra.run.smithi045.stdout:(7/147): ceph-mon-19.0.0-46.ga2cd52c0.el9.x86_6 3.5 MB/s | 4.4 MB 00:01 2023-12-08T08:10:22.604 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-12-08T08:10:23.019 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-12-08T08:10:23.259 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:10:23.434 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:10:23.459 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:10:23.586 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:10:23.626 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:10:23.700 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-12-08T08:10:23.839 INFO:teuthology.orchestra.run.smithi045.stdout:(8/147): ceph-radosgw-19.0.0-46.ga2cd52c0.el9.x 6.7 MB/s | 8.6 MB 00:01 2023-12-08T08:10:23.898 INFO:teuthology.orchestra.run.smithi045.stdout:(9/147): ceph-selinux-19.0.0-46.ga2cd52c0.el9.x 419 kB/s | 24 kB 00:00 2023-12-08T08:10:24.035 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-12-08T08:10:24.098 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-12-08T08:10:24.131 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:10:24.148 INFO:teuthology.orchestra.run.smithi045.stdout:(10/147): ceph-osd-19.0.0-46.ga2cd52c0.el9.x86_ 6.2 MB/s | 18 MB 00:02 2023-12-08T08:10:24.256 INFO:teuthology.orchestra.run.smithi045.stdout:(11/147): cephfs-mirror-19.0.0-46.ga2cd52c0.el9 2.0 MB/s | 217 kB 00:00 2023-12-08T08:10:24.262 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:10:24.315 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:10:24.374 INFO:teuthology.orchestra.run.smithi045.stdout:(12/147): libcephfs-devel-19.0.0-46.ga2cd52c0.e 268 kB/s | 31 kB 00:00 2023-12-08T08:10:24.507 INFO:teuthology.orchestra.run.smithi045.stdout:(13/147): libcephfs2-19.0.0-46.ga2cd52c0.el9.x8 5.3 MB/s | 719 kB 00:00 2023-12-08T08:10:24.618 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:10:24.716 INFO:teuthology.orchestra.run.smithi045.stdout:(14/147): libcephsqlite-19.0.0-46.ga2cd52c0.el9 789 kB/s | 164 kB 00:00 2023-12-08T08:10:24.816 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:10:24.816 INFO:teuthology.orchestra.run.smithi045.stdout:(15/147): librados-devel-19.0.0-46.ga2cd52c0.el 1.2 MB/s | 126 kB 00:00 2023-12-08T08:10:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:(16/147): libradosstriper1-19.0.0-46.ga2cd52c0. 3.7 MB/s | 476 kB 00:00 2023-12-08T08:10:24.958 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:10:25.154 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:10:25.215 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:10:25.542 INFO:teuthology.orchestra.run.smithi045.stdout:(17/147): librgw2-19.0.0-46.ga2cd52c0.el9.x86_6 7.9 MB/s | 4.8 MB 00:00 2023-12-08T08:10:25.548 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:10:25.727 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/162 2023-12-08T08:10:25.761 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-12-08T08:10:25.775 INFO:teuthology.orchestra.run.smithi045.stdout:(18/147): python3-ceph-argparse-19.0.0-46.ga2cd 194 kB/s | 45 kB 00:00 2023-12-08T08:10:25.867 INFO:teuthology.orchestra.run.smithi045.stdout:(19/147): python3-ceph-common-19.0.0-46.ga2cd52 1.4 MB/s | 129 kB 00:00 2023-12-08T08:10:25.899 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-12-08T08:10:25.959 INFO:teuthology.orchestra.run.smithi045.stdout:(20/147): python3-cephfs-19.0.0-46.ga2cd52c0.el 1.7 MB/s | 161 kB 00:00 2023-12-08T08:10:25.968 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-12-08T08:10:25.999 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-12-08T08:10:26.052 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-12-08T08:10:26.068 INFO:teuthology.orchestra.run.smithi045.stdout:(21/147): python3-rados-19.0.0-46.ga2cd52c0.el9 2.9 MB/s | 320 kB 00:00 2023-12-08T08:10:26.094 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-12-08T08:10:26.168 INFO:teuthology.orchestra.run.smithi045.stdout:(22/147): python3-rbd-19.0.0-46.ga2cd52c0.el9.x 2.9 MB/s | 298 kB 00:00 2023-12-08T08:10:26.189 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-12-08T08:10:26.234 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-12-08T08:10:26.259 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-12-08T08:10:26.260 INFO:teuthology.orchestra.run.smithi045.stdout:(23/147): python3-rgw-19.0.0-46.ga2cd52c0.el9.x 1.1 MB/s | 99 kB 00:00 2023-12-08T08:10:26.357 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-12-08T08:10:26.361 INFO:teuthology.orchestra.run.smithi045.stdout:(24/147): rbd-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 860 kB/s | 85 kB 00:00 2023-12-08T08:10:26.398 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 29/162 2023-12-08T08:10:26.449 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 30/162 2023-12-08T08:10:26.554 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 31/162 2023-12-08T08:10:26.738 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-12-08T08:10:26.786 INFO:teuthology.orchestra.run.smithi045.stdout:(25/147): rbd-mirror-19.0.0-46.ga2cd52c0.el9.x8 7.1 MB/s | 3.0 MB 00:00 2023-12-08T08:10:26.800 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-12-08T08:10:26.870 INFO:teuthology.orchestra.run.smithi045.stdout:(26/147): rbd-nbd-19.0.0-46.ga2cd52c0.el9.x86_6 2.0 MB/s | 170 kB 00:00 2023-12-08T08:10:26.987 INFO:teuthology.orchestra.run.smithi045.stdout:(27/147): ceph-grafana-dashboards-19.0.0-46.ga2 242 kB/s | 28 kB 00:00 2023-12-08T08:10:27.079 INFO:teuthology.orchestra.run.smithi045.stdout:(28/147): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 1.4 MB/s | 133 kB 00:00 2023-12-08T08:10:27.338 INFO:teuthology.orchestra.run.smithi045.stdout:(29/147): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 6.8 MB/s | 1.8 MB 00:00 2023-12-08T08:10:27.517 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-12-08T08:10:27.613 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-12-08T08:10:27.682 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-12-08T08:10:27.735 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-12-08T08:10:27.781 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 38/162 2023-12-08T08:10:27.870 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-12-08T08:10:28.065 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-12-08T08:10:28.088 INFO:teuthology.orchestra.run.smithi045.stdout:(30/147): ceph-mgr-diskprediction-local-19.0.0- 9.9 MB/s | 7.4 MB 00:00 2023-12-08T08:10:28.125 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-12-08T08:10:28.163 INFO:teuthology.orchestra.run.smithi045.stdout:(31/147): ceph-mgr-modules-core-19.0.0-46.ga2cd 3.2 MB/s | 243 kB 00:00 2023-12-08T08:10:28.271 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-12-08T08:10:28.522 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/162 2023-12-08T08:10:28.602 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-12-08T08:10:28.694 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-12-08T08:10:28.729 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-12-08T08:10:28.776 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-12-08T08:10:28.844 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-12-08T08:10:28.910 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-12-08T08:10:28.970 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-12-08T08:10:29.159 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-12-08T08:10:29.211 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-12-08T08:10:29.258 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-12-08T08:10:29.384 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-12-08T08:10:29.428 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-12-08T08:10:29.477 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-12-08T08:10:29.509 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-12-08T08:10:29.663 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/162 2023-12-08T08:10:29.713 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-12-08T08:10:29.782 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-12-08T08:10:29.805 INFO:teuthology.orchestra.run.smithi045.stdout:(32/147): ceph-test-19.0.0-46.ga2cd52c0.el9.x86 7.0 MB/s | 41 MB 00:05 2023-12-08T08:10:29.855 INFO:teuthology.orchestra.run.smithi045.stdout:(33/147): ceph-prometheus-alerts-19.0.0-46.ga2c 308 kB/s | 15 kB 00:00 2023-12-08T08:10:29.875 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-12-08T08:10:29.933 INFO:teuthology.orchestra.run.smithi045.stdout:(34/147): ceph-volume-19.0.0-46.ga2cd52c0.el9.n 3.4 MB/s | 262 kB 00:00 2023-12-08T08:10:30.048 INFO:teuthology.orchestra.run.smithi045.stdout:(35/147): cephadm-19.0.0-46.ga2cd52c0.el9.noarc 6.7 MB/s | 801 kB 00:00 2023-12-08T08:10:30.106 INFO:teuthology.orchestra.run.smithi045.stdout:(36/147): cephfs-top-19.0.0-46.ga2cd52c0.el9.no 316 kB/s | 18 kB 00:00 2023-12-08T08:10:30.130 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-12-08T08:10:30.185 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-12-08T08:10:30.298 INFO:teuthology.orchestra.run.smithi045.stdout:(37/147): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-08T08:10:30.357 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-12-08T08:10:30.365 INFO:teuthology.orchestra.run.smithi045.stdout:(38/147): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2023-12-08T08:10:30.407 INFO:teuthology.orchestra.run.smithi045.stdout:(39/147): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-08T08:10:30.412 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-12-08T08:10:30.437 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-12-08T08:10:30.441 INFO:teuthology.orchestra.run.smithi045.stdout:(40/147): elfutils-libelf-devel-0.190-1.el9.x86 659 kB/s | 21 kB 00:00 2023-12-08T08:10:30.476 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-12-08T08:10:30.483 INFO:teuthology.orchestra.run.smithi045.stdout:(41/147): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2023-12-08T08:10:30.516 INFO:teuthology.orchestra.run.smithi045.stdout:(42/147): flexiblas-3.0.4-8.el9.x86_64.rpm 965 kB/s | 32 kB 00:00 2023-12-08T08:10:30.518 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-12-08T08:10:30.556 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-12-08T08:10:30.597 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-12-08T08:10:30.625 INFO:teuthology.orchestra.run.smithi045.stdout:(43/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-08T08:10:30.650 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-12-08T08:10:30.658 INFO:teuthology.orchestra.run.smithi045.stdout:(44/147): flexiblas-openblas-openmp-3.0.4-8.el9 523 kB/s | 17 kB 00:00 2023-12-08T08:10:30.700 INFO:teuthology.orchestra.run.smithi045.stdout:(45/147): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-12-08T08:10:30.713 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-12-08T08:10:30.734 INFO:teuthology.orchestra.run.smithi045.stdout:(46/147): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2023-12-08T08:10:30.756 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-12-08T08:10:30.776 INFO:teuthology.orchestra.run.smithi045.stdout:(47/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-08T08:10:30.801 INFO:teuthology.orchestra.run.smithi045.stdout:(48/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 44 kB 00:00 2023-12-08T08:10:30.852 INFO:teuthology.orchestra.run.smithi045.stdout:(49/147): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-08T08:10:30.858 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-12-08T08:10:30.901 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-12-08T08:10:30.902 INFO:teuthology.orchestra.run.smithi045.stdout:(50/147): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-08T08:10:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:(51/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 998 kB/s | 24 kB 00:00 2023-12-08T08:10:30.936 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-12-08T08:10:30.953 INFO:teuthology.orchestra.run.smithi045.stdout:(52/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.9 MB/s | 46 kB 00:00 2023-12-08T08:10:30.987 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-12-08T08:10:30.995 INFO:teuthology.orchestra.run.smithi045.stdout:(53/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2023-12-08T08:10:31.030 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-12-08T08:10:31.037 INFO:teuthology.orchestra.run.smithi045.stdout:(54/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-08T08:10:31.071 INFO:teuthology.orchestra.run.smithi045.stdout:(55/147): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-08T08:10:31.165 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-12-08T08:10:31.204 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-12-08T08:10:31.212 INFO:teuthology.orchestra.run.smithi045.stdout:(56/147): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2023-12-08T08:10:31.288 INFO:teuthology.orchestra.run.smithi045.stdout:(57/147): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2023-12-08T08:10:31.335 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-12-08T08:10:31.346 INFO:teuthology.orchestra.run.smithi045.stdout:(58/147): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2023-12-08T08:10:31.388 INFO:teuthology.orchestra.run.smithi045.stdout:(59/147): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-12-08T08:10:31.402 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-12-08T08:10:31.555 INFO:teuthology.orchestra.run.smithi045.stdout:(60/147): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-12-08T08:10:31.715 INFO:teuthology.orchestra.run.smithi045.stdout:(61/147): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 5.8 MB 00:00 2023-12-08T08:10:31.756 INFO:teuthology.orchestra.run.smithi045.stdout:(62/147): python3-jinja2-2.11.3-4.el9.noarch.rp 5.5 MB/s | 228 kB 00:00 2023-12-08T08:10:31.790 INFO:teuthology.orchestra.run.smithi045.stdout:(63/147): python3-jsonpatch-1.21-16.el9.noarch. 742 kB/s | 24 kB 00:00 2023-12-08T08:10:31.823 INFO:teuthology.orchestra.run.smithi045.stdout:(64/147): python3-jsonpointer-2.0-4.el9.noarch. 550 kB/s | 18 kB 00:00 2023-12-08T08:10:31.865 INFO:teuthology.orchestra.run.smithi045.stdout:(65/147): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-08T08:10:31.899 INFO:teuthology.orchestra.run.smithi045.stdout:(66/147): python3-markupsafe-1.1.1-12.el9.x86_6 961 kB/s | 32 kB 00:00 2023-12-08T08:10:32.058 INFO:teuthology.orchestra.run.smithi045.stdout:(67/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-12-08T08:10:32.100 INFO:teuthology.orchestra.run.smithi045.stdout:(68/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2023-12-08T08:10:32.142 INFO:teuthology.orchestra.run.smithi045.stdout:(69/147): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-12-08T08:10:32.175 INFO:teuthology.orchestra.run.smithi045.stdout:(70/147): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-12-08T08:10:32.217 INFO:teuthology.orchestra.run.smithi045.stdout:(71/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-08T08:10:32.259 INFO:teuthology.orchestra.run.smithi045.stdout:(72/147): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-12-08T08:10:32.285 INFO:teuthology.orchestra.run.smithi045.stdout:(73/147): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-12-08T08:10:32.310 INFO:teuthology.orchestra.run.smithi045.stdout:(74/147): python3-requests-oauthlib-1.3.0-12.el 1.7 MB/s | 43 kB 00:00 2023-12-08T08:10:32.347 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-12-08T08:10:32.401 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-12-08T08:10:32.435 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-12-08T08:10:32.468 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-12-08T08:10:32.643 INFO:teuthology.orchestra.run.smithi045.stdout:(75/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2023-12-08T08:10:32.677 INFO:teuthology.orchestra.run.smithi045.stdout:(76/147): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-08T08:10:32.713 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-12-08T08:10:32.718 INFO:teuthology.orchestra.run.smithi045.stdout:(77/147): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-12-08T08:10:32.748 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-12-08T08:10:32.782 INFO:teuthology.orchestra.run.smithi045.stdout:(78/147): uuid-1.6.2-55.el9.x86_64.rpm 894 kB/s | 56 kB 00:00 2023-12-08T08:10:32.820 INFO:teuthology.orchestra.run.smithi045.stdout:(79/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.2 MB/s | 85 kB 00:00 2023-12-08T08:10:32.851 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-12-08T08:10:32.853 INFO:teuthology.orchestra.run.smithi045.stdout:(80/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-08T08:10:32.887 INFO:teuthology.orchestra.run.smithi045.stdout:(81/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-08T08:10:32.920 INFO:teuthology.orchestra.run.smithi045.stdout:(82/147): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-12-08T08:10:32.979 INFO:teuthology.orchestra.run.smithi045.stdout:(83/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-08T08:10:33.021 INFO:teuthology.orchestra.run.smithi045.stdout:(84/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2023-12-08T08:10:33.063 INFO:teuthology.orchestra.run.smithi045.stdout:(85/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-08T08:10:33.130 INFO:teuthology.orchestra.run.smithi045.stdout:(86/147): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2023-12-08T08:10:33.163 INFO:teuthology.orchestra.run.smithi045.stdout:(87/147): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-08T08:10:33.206 INFO:teuthology.orchestra.run.smithi045.stdout:(88/147): python3-pycparser-2.20-6.el9.noarch.r 2.9 MB/s | 124 kB 00:00 2023-12-08T08:10:33.248 INFO:teuthology.orchestra.run.smithi045.stdout:(89/147): python3-requests-2.25.1-7.el9.noarch. 2.7 MB/s | 113 kB 00:00 2023-12-08T08:10:33.290 INFO:teuthology.orchestra.run.smithi045.stdout:(90/147): python3-urllib3-1.26.5-4.el9.noarch.r 4.5 MB/s | 187 kB 00:00 2023-12-08T08:10:33.683 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-12-08T08:10:33.809 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-12-08T08:10:35.073 INFO:teuthology.orchestra.run.smithi045.stdout:(91/147): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el9 7.3 kB/s | 50 kB 00:06 2023-12-08T08:10:35.351 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-12-08T08:10:35.530 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-12-08T08:10:35.774 INFO:teuthology.orchestra.run.smithi045.stdout:(92/147): ceph-common-19.0.0-46.ga2cd52c0.el9.x 1.1 MB/s | 19 MB 00:16 2023-12-08T08:10:35.973 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-12-08T08:10:36.018 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-12-08T08:10:36.032 INFO:teuthology.orchestra.run.smithi045.stdout:(93/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-12-08T08:10:36.064 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-12-08T08:10:36.111 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-12-08T08:10:36.299 INFO:teuthology.orchestra.run.smithi045.stdout:(94/147): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2023-12-08T08:10:36.358 INFO:teuthology.orchestra.run.smithi045.stdout:(95/147): libarrow-doc-9.0.0-10.el9.noarch.rpm 450 kB/s | 26 kB 00:00 2023-12-08T08:10:36.416 INFO:teuthology.orchestra.run.smithi045.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 840 kB/s | 49 kB 00:00 2023-12-08T08:10:36.475 INFO:teuthology.orchestra.run.smithi045.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2023-12-08T08:10:36.506 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-12-08T08:10:36.535 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:10:36.567 INFO:teuthology.orchestra.run.smithi045.stdout:(98/147): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 838 kB 00:00 2023-12-08T08:10:36.643 INFO:teuthology.orchestra.run.smithi045.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 7.2 MB/s | 548 kB 00:00 2023-12-08T08:10:36.657 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:10:36.691 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 100/162 2023-12-08T08:10:36.701 INFO:teuthology.orchestra.run.smithi045.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 752 kB/s | 43 kB 00:00 2023-12-08T08:10:36.747 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-12-08T08:10:36.768 INFO:teuthology.orchestra.run.smithi045.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2023-12-08T08:10:36.827 INFO:teuthology.orchestra.run.smithi045.stdout:(102/147): python3-certifi-2021.10.8-2.el9.noar 259 kB/s | 15 kB 00:00 2023-12-08T08:10:36.885 INFO:teuthology.orchestra.run.smithi045.stdout:(103/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-12-08T08:10:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:(104/147): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2023-12-08T08:10:37.028 INFO:teuthology.orchestra.run.smithi045.stdout:(105/147): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-12-08T08:10:37.087 INFO:teuthology.orchestra.run.smithi045.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2023-12-08T08:10:37.145 INFO:teuthology.orchestra.run.smithi045.stdout:(107/147): python3-jaraco-classes-3.2.1-5.el9.n 305 kB/s | 18 kB 00:00 2023-12-08T08:10:37.204 INFO:teuthology.orchestra.run.smithi045.stdout:(108/147): python3-jaraco-collections-3.0.0-8.e 401 kB/s | 23 kB 00:00 2023-12-08T08:10:37.256 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/162 2023-12-08T08:10:37.262 INFO:teuthology.orchestra.run.smithi045.stdout:(109/147): python3-jaraco-functools-3.5.0-2.el9 336 kB/s | 19 kB 00:00 2023-12-08T08:10:37.287 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:10:37.321 INFO:teuthology.orchestra.run.smithi045.stdout:(110/147): python3-jaraco-text-3.2.0-6.el9.noar 340 kB/s | 20 kB 00:00 2023-12-08T08:10:37.379 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:10:37.380 INFO:teuthology.orchestra.run.smithi045.stdout:(111/147): python3-jwt+crypto-2.4.0-1.el9.noarc 156 kB/s | 9.0 kB 00:00 2023-12-08T08:10:37.406 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 104/162 2023-12-08T08:10:37.438 INFO:teuthology.orchestra.run.smithi045.stdout:(112/147): python3-jwt-2.4.0-1.el9.noarch.rpm 708 kB/s | 41 kB 00:00 2023-12-08T08:10:37.530 INFO:teuthology.orchestra.run.smithi045.stdout:(113/147): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2023-12-08T08:10:37.589 INFO:teuthology.orchestra.run.smithi045.stdout:(114/147): python3-logutils-0.3.5-21.el9.noarch 801 kB/s | 46 kB 00:00 2023-12-08T08:10:37.648 INFO:teuthology.orchestra.run.smithi045.stdout:(115/147): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-12-08T08:10:37.707 INFO:teuthology.orchestra.run.smithi045.stdout:(116/147): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2023-12-08T08:10:37.765 INFO:teuthology.orchestra.run.smithi045.stdout:(117/147): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-12-08T08:10:37.823 INFO:teuthology.orchestra.run.smithi045.stdout:(118/147): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2023-12-08T08:10:37.882 INFO:teuthology.orchestra.run.smithi045.stdout:(119/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2023-12-08T08:10:37.941 INFO:teuthology.orchestra.run.smithi045.stdout:(120/147): python3-repoze-lru-0.7-16.el9.noarch 531 kB/s | 31 kB 00:00 2023-12-08T08:10:37.991 INFO:teuthology.orchestra.run.smithi045.stdout:(121/147): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2023-12-08T08:10:38.058 INFO:teuthology.orchestra.run.smithi045.stdout:(122/147): python3-rsa-4.9-2.el9.noarch.rpm 895 kB/s | 59 kB 00:00 2023-12-08T08:10:38.117 INFO:teuthology.orchestra.run.smithi045.stdout:(123/147): python3-tempora-5.0.0-2.el9.noarch.r 618 kB/s | 36 kB 00:00 2023-12-08T08:10:38.175 INFO:teuthology.orchestra.run.smithi045.stdout:(124/147): python3-typing-extensions-4.4.0-2.el 882 kB/s | 51 kB 00:00 2023-12-08T08:10:38.236 INFO:teuthology.orchestra.run.smithi045.stdout:(125/147): python3-webob-1.8.7-6.el9.noarch.rpm 3.7 MB/s | 230 kB 00:00 2023-12-08T08:10:38.293 INFO:teuthology.orchestra.run.smithi045.stdout:(126/147): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2023-12-08T08:10:38.368 INFO:teuthology.orchestra.run.smithi045.stdout:(127/147): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2023-12-08T08:10:38.426 INFO:teuthology.orchestra.run.smithi045.stdout:(128/147): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2023-12-08T08:10:38.493 INFO:teuthology.orchestra.run.smithi045.stdout:(129/147): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2023-12-08T08:10:38.594 INFO:teuthology.orchestra.run.smithi045.stdout:(130/147): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2023-12-08T08:10:38.952 INFO:teuthology.orchestra.run.smithi045.stdout:(131/147): librados2-19.0.0-46.ga2cd52c0.el9.x8 9.3 MB/s | 3.3 MB 00:00 2023-12-08T08:10:39.211 INFO:teuthology.orchestra.run.smithi045.stdout:(132/147): librbd1-19.0.0-46.ga2cd52c0.el9.x86_ 12 MB/s | 3.0 MB 00:00 2023-12-08T08:10:39.236 INFO:teuthology.orchestra.run.smithi045.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 68 kB 00:00 2023-12-08T08:10:39.262 INFO:teuthology.orchestra.run.smithi045.stdout:(134/147): acl-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 69 kB 00:00 2023-12-08T08:10:39.296 INFO:teuthology.orchestra.run.smithi045.stdout:(135/147): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-08T08:10:39.346 INFO:teuthology.orchestra.run.smithi045.stdout:(136/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-08T08:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:(137/147): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-08T08:10:39.413 INFO:teuthology.orchestra.run.smithi045.stdout:(138/147): libacl-2.3.1-4.el9.x86_64.rpm 898 kB/s | 22 kB 00:00 2023-12-08T08:10:39.455 INFO:teuthology.orchestra.run.smithi045.stdout:(139/147): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2023-12-08T08:10:39.797 INFO:teuthology.orchestra.run.smithi045.stdout:(140/147): NetworkManager-1.45.7-1.el9.x86_64.r 6.6 MB/s | 2.3 MB 00:00 2023-12-08T08:10:39.889 INFO:teuthology.orchestra.run.smithi045.stdout:(141/147): NetworkManager-libnm-1.45.7-1.el9.x8 20 MB/s | 1.8 MB 00:00 2023-12-08T08:10:39.908 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:10:39.947 INFO:teuthology.orchestra.run.smithi045.stdout:(142/147): NetworkManager-team-1.45.7-1.el9.x86 748 kB/s | 43 kB 00:00 2023-12-08T08:10:39.961 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:10:40.006 INFO:teuthology.orchestra.run.smithi045.stdout:(143/147): NetworkManager-tui-1.45.7-1.el9.x86_ 4.2 MB/s | 246 kB 00:00 2023-12-08T08:10:40.098 INFO:teuthology.orchestra.run.smithi045.stdout:(144/147): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2023-12-08T08:10:40.273 INFO:teuthology.orchestra.run.smithi045.stdout:(145/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2023-12-08T08:10:40.605 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:10:40.648 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:10:40.826 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:10:40.827 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-08T08:10:40.827 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-08T08:10:40.827 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:40.866 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:10:53.619 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2023-12-08T08:10:53.620 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:53.852 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:10:53.900 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:10:53.900 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:10:53.900 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-08T08:10:53.901 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:55.640 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:10:55.722 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:10:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:10:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-08T08:10:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:10:55.722 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:10:55.723 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:55.965 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:10:56.059 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:56.558 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:10:56.629 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:56.743 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-12-08T08:10:57.306 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:10:57.369 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:10:57.425 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 114/162 2023-12-08T08:10:57.542 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 115/162 2023-12-08T08:10:57.573 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:10:57.901 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:10:57.940 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:10:59.067 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:10:59.091 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:10:59.231 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:10:59.398 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 119/162 2023-12-08T08:10:59.435 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:10:59.510 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:10:59.568 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:10:59.608 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:10:59.696 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 122/162 2023-12-08T08:11:00.557 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-12-08T08:11:00.587 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:11:00.657 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:11:00.657 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:11:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-08T08:11:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:11:00.658 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:11:00.658 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:00.713 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:11:00.783 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:11:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:11:00.783 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-08T08:11:00.784 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:00.864 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:11:00.941 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:11:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:11:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-08T08:11:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:11:00.942 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:11:00.942 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:01.298 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:11:01.385 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:11:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:11:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-08T08:11:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:11:01.386 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:11:01.386 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:05.504 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 128/162 2023-12-08T08:11:05.558 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 129/162 2023-12-08T08:11:05.613 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 130/162 2023-12-08T08:11:05.652 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-12-08T08:11:05.914 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-12-08T08:11:06.038 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-12-08T08:11:06.073 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 134/162 2023-12-08T08:11:06.106 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:11:06.186 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-12-08T08:11:06.254 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:11:06.324 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/162 2023-12-08T08:11:06.387 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 139/162 2023-12-08T08:11:06.433 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 140/162 2023-12-08T08:11:07.377 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:11:07.431 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:11:07.487 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:11:08.834 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 142/162 2023-12-08T08:11:08.966 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-12-08T08:11:09.019 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-12-08T08:11:09.088 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-12-08T08:11:09.260 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-12-08T08:11:09.717 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-12-08T08:11:09.758 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-12-08T08:11:09.800 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-12-08T08:11:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-12-08T08:11:09.842 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:11:10.034 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:11:10.093 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-12-08T08:11:10.151 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-12-08T08:11:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-12-08T08:11:10.188 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:11:10.326 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:11:10.356 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:11:10.395 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:11:10.396 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:11:10.730 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:11:10.731 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:11:10.890 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:11:10.925 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-12-08T08:11:10.993 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-12-08T08:11:11.027 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-12-08T08:11:11.154 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:11:11.420 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:11:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-08T08:11:11.420 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 1/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 3/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 4/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 6/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 7/162 2023-12-08T08:11:15.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 11/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 12/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 13/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 15/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 16/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 17/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 18/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 19/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 20/162 2023-12-08T08:11:15.808 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 21/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 22/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 23/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 24/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 25/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 26/162 2023-12-08T08:11:15.809 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 27/162 2023-12-08T08:11:15.821 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 28/162 2023-12-08T08:11:15.821 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/162 2023-12-08T08:11:15.821 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 30/162 2023-12-08T08:11:15.821 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 31/162 2023-12-08T08:11:15.821 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 33/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 34/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 35/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 36/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 37/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 38/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-12-08T08:11:15.822 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-12-08T08:11:15.823 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-12-08T08:11:15.824 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-12-08T08:11:15.825 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 96/162 2023-12-08T08:11:15.826 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 97/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 100/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-12-08T08:11:15.827 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-12-08T08:11:15.828 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 133/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-4.el9.x86_64 139/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : acl-2.3.1-3.el9.x86_64 140/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 141/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 142/162 2023-12-08T08:11:15.829 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 143/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 144/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 145/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 146/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 147/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 148/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 149/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 150/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 151/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 152/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 153/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 155/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:11:15.830 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 157/162 2023-12-08T08:11:15.831 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:11:15.831 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-12-08T08:11:15.831 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-12-08T08:11:15.831 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-08T08:11:18.023 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: acl-2.3.1-4.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2023-12-08T08:11:18.024 INFO:teuthology.orchestra.run.smithi114.stdout: automake-1.16.2-8.el9.noarch 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: bison-3.7.4-5.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.025 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-08T08:11:18.026 INFO:teuthology.orchestra.run.smithi114.stdout: flex-2.6.4-9.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: jq-1.6-16.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.027 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-08T08:11:18.028 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-13.11-1.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-08T08:11:18.029 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-08T08:11:18.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-08T08:11:18.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-08T08:11:18.032 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-08T08:11:18.033 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-3.el9.x86_64 2023-12-08T08:11:18.034 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:11:18.035 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2023-12-08T08:11:18.658 DEBUG:teuthology.parallel:result is None 2023-12-08T08:12:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:[MIRROR] openssl-devel-3.0.7-25.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/openssl-devel-3.0.7-25.el9.x86_64.rpm [Failed to connect to mirror.siena.edu port 80: Connection timed out] 2023-12-08T08:12:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:[MIRROR] python3-devel-3.9.17-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.17-2.el9.x86_64.rpm [Failed to connect to mirror.siena.edu port 80: Connection timed out] 2023-12-08T08:12:48.241 INFO:teuthology.orchestra.run.smithi045.stdout:(146/147): openssl-devel-3.0.7-25.el9.x86_64.rp 31 kB/s | 4.1 MB 02:14 2023-12-08T08:12:48.265 INFO:teuthology.orchestra.run.smithi045.stdout:(147/147): python3-devel-3.9.17-2.el9.x86_64.rp 1.8 kB/s | 245 kB 02:13 2023-12-08T08:12:48.271 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:12:48.272 INFO:teuthology.orchestra.run.smithi045.stdout:Total 1.4 MB/s | 204 MB 02:29 2023-12-08T08:12:48.709 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-12-08T08:12:49.005 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-12-08T08:12:49.006 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-12-08T08:12:51.233 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-12-08T08:12:51.234 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-12-08T08:12:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-12-08T08:12:57.605 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-12-08T08:12:57.641 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-12-08T08:12:57.740 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-12-08T08:12:57.806 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-12-08T08:12:57.841 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-12-08T08:12:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-12-08T08:12:58.359 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-12-08T08:12:58.405 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:12:58.565 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:12:58.589 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:12:58.715 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:12:58.756 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:12:58.814 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-12-08T08:12:59.107 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-12-08T08:12:59.171 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-12-08T08:12:59.195 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:12:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:12:59.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:12:59.792 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:12:59.968 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:13:00.057 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:13:00.269 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:00.338 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:00.715 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:00.896 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/162 2023-12-08T08:13:00.936 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-12-08T08:13:01.053 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-12-08T08:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-12-08T08:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-12-08T08:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-12-08T08:13:01.292 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-12-08T08:13:01.399 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-12-08T08:13:01.441 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-12-08T08:13:01.475 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-12-08T08:13:01.557 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-12-08T08:13:01.596 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 29/162 2023-12-08T08:13:01.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 30/162 2023-12-08T08:13:01.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 31/162 2023-12-08T08:13:01.933 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-12-08T08:13:02.007 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-12-08T08:13:02.727 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-12-08T08:13:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-12-08T08:13:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-12-08T08:13:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-12-08T08:13:02.987 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 38/162 2023-12-08T08:13:03.085 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-12-08T08:13:03.598 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-12-08T08:13:03.643 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-12-08T08:13:03.804 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-12-08T08:13:03.844 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/162 2023-12-08T08:13:03.916 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-12-08T08:13:04.008 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-12-08T08:13:04.045 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-12-08T08:13:04.100 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-12-08T08:13:04.171 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-12-08T08:13:04.236 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-12-08T08:13:04.296 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-12-08T08:13:04.491 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-12-08T08:13:04.535 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-12-08T08:13:04.574 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-12-08T08:13:04.703 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-12-08T08:13:04.780 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-12-08T08:13:04.845 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-12-08T08:13:04.903 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-12-08T08:13:05.076 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/162 2023-12-08T08:13:05.133 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-12-08T08:13:05.217 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-12-08T08:13:05.297 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-12-08T08:13:05.560 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-12-08T08:13:05.618 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-12-08T08:13:05.792 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-12-08T08:13:05.837 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-12-08T08:13:05.854 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-12-08T08:13:05.890 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-12-08T08:13:05.933 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-12-08T08:13:05.980 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-12-08T08:13:06.022 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-12-08T08:13:06.081 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-12-08T08:13:06.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-12-08T08:13:06.237 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-12-08T08:13:06.381 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-12-08T08:13:06.421 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-12-08T08:13:06.465 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-12-08T08:13:06.541 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-12-08T08:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-12-08T08:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-12-08T08:13:06.756 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-12-08T08:13:06.907 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-12-08T08:13:06.971 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-12-08T08:13:07.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-12-08T08:13:08.037 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-12-08T08:13:08.071 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-12-08T08:13:08.104 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-12-08T08:13:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-12-08T08:13:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-12-08T08:13:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-12-08T08:13:09.340 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-12-08T08:13:09.484 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-12-08T08:13:11.109 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-12-08T08:13:11.198 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-12-08T08:13:11.235 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-12-08T08:13:11.266 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-12-08T08:13:11.310 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-12-08T08:13:11.352 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-12-08T08:13:11.740 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-12-08T08:13:11.772 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:13:11.893 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:13:11.928 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 100/162 2023-12-08T08:13:11.986 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-12-08T08:13:12.516 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/162 2023-12-08T08:13:12.550 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:13:12.650 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:13:12.677 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 104/162 2023-12-08T08:13:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:15.299 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:15.980 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:16.037 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:13:16.211 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:13:16.211 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-08T08:13:16.211 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-08T08:13:16.211 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:16.254 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:13:29.247 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-12-08T08:13:29.248 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:29.481 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:13:29.534 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:13:29.534 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:29.534 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-08T08:13:29.534 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:13:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:13:31.411 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:31.411 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-08T08:13:31.412 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:13:31.412 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:13:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:31.675 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:13:31.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:32.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:13:32.380 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:13:32.381 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:32.381 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-08T08:13:32.381 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:13:32.381 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:13:32.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:32.504 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-12-08T08:13:33.154 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:13:33.187 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:13:33.232 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 114/162 2023-12-08T08:13:33.329 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 115/162 2023-12-08T08:13:33.359 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:13:33.685 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:13:33.718 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:13:34.875 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:13:34.926 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:13:35.085 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:13:35.260 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 119/162 2023-12-08T08:13:35.287 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:13:35.367 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:13:35.368 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:35.368 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-08T08:13:35.368 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:13:35.368 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:13:35.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:35.422 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:13:35.462 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:13:35.526 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 122/162 2023-12-08T08:13:36.423 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-12-08T08:13:36.457 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:13:36.538 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:13:36.538 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:36.539 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-08T08:13:36.539 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:13:36.539 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:13:36.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:36.583 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:13:36.678 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:13:36.678 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:36.678 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-08T08:13:36.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:36.742 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:13:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:13:36.853 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:36.853 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-08T08:13:36.853 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:13:36.853 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:13:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:13:37.346 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:13:37.346 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:37.346 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-08T08:13:37.346 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:13:37.347 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:13:37.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:41.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 128/162 2023-12-08T08:13:41.795 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 129/162 2023-12-08T08:13:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 130/162 2023-12-08T08:13:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-12-08T08:13:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-12-08T08:13:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-12-08T08:13:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 134/162 2023-12-08T08:13:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:13:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-12-08T08:13:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:13:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/162 2023-12-08T08:13:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 139/162 2023-12-08T08:13:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 140/162 2023-12-08T08:13:43.587 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:13:43.637 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:13:43.704 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:13:45.134 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 142/162 2023-12-08T08:13:45.245 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-12-08T08:13:45.292 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-12-08T08:13:45.356 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-12-08T08:13:45.503 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-12-08T08:13:45.539 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-12-08T08:13:45.564 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-12-08T08:13:45.598 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-12-08T08:13:45.639 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-12-08T08:13:45.640 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:13:45.756 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:13:45.808 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-12-08T08:13:45.857 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-12-08T08:13:45.902 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-12-08T08:13:45.903 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:13:46.040 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:13:46.071 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:13:46.112 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:13:46.112 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:13:46.461 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:13:46.462 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:13:46.605 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:13:46.649 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-12-08T08:13:46.682 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-12-08T08:13:46.716 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-12-08T08:13:46.848 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:13:47.122 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:13:47.122 INFO:teuthology.orchestra.run.smithi045.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-08T08:13:47.123 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 1/162 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2/162 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 3/162 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 4/162 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/162 2023-12-08T08:13:51.714 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 6/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 7/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 11/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 12/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 13/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 15/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 16/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 17/162 2023-12-08T08:13:51.715 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 18/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 19/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 20/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 21/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 22/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 23/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 24/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 25/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 26/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 27/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 28/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 30/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 31/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/162 2023-12-08T08:13:51.716 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 33/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 34/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 35/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 36/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 37/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 38/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-12-08T08:13:51.717 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-12-08T08:13:51.718 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-12-08T08:13:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 96/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 97/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 100/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-12-08T08:13:51.721 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-12-08T08:13:51.722 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 133/162 2023-12-08T08:13:51.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.3.1-4.el9.x86_64 139/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.3.1-3.el9.x86_64 140/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 141/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 142/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 143/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 144/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 145/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 146/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 147/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 148/162 2023-12-08T08:13:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 149/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 150/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 151/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 152/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 153/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 155/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 157/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-12-08T08:13:51.725 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-12-08T08:13:53.864 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-12-08T08:13:53.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:53.864 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-12-08T08:13:53.865 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-08T08:13:53.865 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-08T08:13:53.865 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-08T08:13:53.865 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-08T08:13:53.866 INFO:teuthology.orchestra.run.smithi045.stdout: acl-2.3.1-4.el9.x86_64 2023-12-08T08:13:53.866 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-08T08:13:53.866 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-08T08:13:53.866 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-08T08:13:53.867 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.2-8.el9.noarch 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.7.4-5.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-08T08:13:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-08T08:13:53.870 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.4-9.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-16.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-08T08:13:53.871 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-08T08:13:53.872 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-13.11-1.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-08T08:13:53.873 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-08T08:13:53.874 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-08T08:13:53.875 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-08T08:13:53.876 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-08T08:13:53.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.879 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-3.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:13:53.880 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-12-08T08:13:54.395 DEBUG:teuthology.parallel:result is None 2023-12-08T08:13:54.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:13:54.615 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T08:13:54.680 INFO:teuthology.orchestra.run.smithi045.stdout:19.0.0-46.ga2cd52c0.el9 2023-12-08T08:13:54.681 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el9 2023-12-08T08:13:54.681 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-08T08:13:54.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:13:54.893 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T08:13:54.972 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-46.ga2cd52c0.el9 2023-12-08T08:13:54.972 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el9 2023-12-08T08:13:54.972 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-08T08:13:54.973 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-08T08:13:54.973 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:54.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:13:55.067 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:55.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:13:55.170 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-08T08:13:55.170 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:55.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:13:55.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:13:55.394 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:55.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:13:55.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:13:55.616 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-08T08:13:55.616 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:55.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:13:55.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:13:55.823 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:55.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:13:55.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:13:56.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-08T08:13:56.026 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:56.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:13:56.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:13:56.222 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:56.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:13:56.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:13:56.390 INFO:teuthology.run_tasks:Running task ceph... 2023-12-08T08:13:56.466 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-08T08:13:56.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-12-08T08:13:56.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2023-12-08T08:13:56.558 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-08T08:13:56.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:13:56.563 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:13:56.643 INFO:tasks.ceph:Creating extra log directories... 2023-12-08T08:13:56.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:13:56.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:13:56.744 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-08T08:13:56.744 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-08T08:13:56.744 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-08T08:13:56.744 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:56.744 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:13:56.786 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:13:57.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-08T08:13:57.101 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:57.101 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:13:57.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:13:57.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-08T08:13:57.513 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-08T08:13:57.513 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-08T08:13:57.513 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761', 'branch': 'wip-vshankar-testing-20231206.125818', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7483761', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231206.125818'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231206.125818', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 4099, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'sleep_before_teardown': 0, 'subset': '359/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231206.125818', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsSvy4Fb/xX6H8FmY89MqFUF5fwpGjpzvmHRVTcBGUvI0uw0q5i2MHhst/uft6mqIQFl+LCZfctE3ZeLwq7Glk=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoKPSIe36hn0B+dMRBoYZ/SYYbG5k41Gt8k88sLS+yJOPafC2Cnk4UJj2MUp7VXCwJ3wADi5iWo9MjmfeQa4fk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-08_07:46:48', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-08T08:13:57.514 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:13:57.523 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:13:57.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:13:57.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:13:57.673 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:57.673 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:13:57.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:13:57.717 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-12-08T08:13:57.803 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:13:57.803 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:57.803 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-12-08T08:13:57.803 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:57.804 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:57.804 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-08 08:13:47.596306386 +0000 2023-12-08T08:13:57.804 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-08 08:06:55.989871613 +0000 2023-12-08T08:13:57.804 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-08 08:06:55.989871613 +0000 2023-12-08T08:13:57.804 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-12-08 08:06:55.989871613 +0000 2023-12-08T08:13:57.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:13:57.918 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-08T08:13:57.918 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-08T08:13:57.918 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000292283 s, 1.8 MB/s 2023-12-08T08:13:57.921 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:13:57.965 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-12-08T08:13:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:13:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-08 08:13:47.597306370 +0000 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-08 08:06:56.998855713 +0000 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-08 08:06:56.998855713 +0000 2023-12-08T08:13:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-12-08 08:06:56.998855713 +0000 2023-12-08T08:13:58.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:13:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-08T08:13:58.163 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-08T08:13:58.163 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000185085 s, 2.8 MB/s 2023-12-08T08:13:58.165 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:13:58.208 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-08 08:13:47.599306338 +0000 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-08 08:06:58.044839230 +0000 2023-12-08T08:13:58.295 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-08 08:06:58.044839230 +0000 2023-12-08T08:13:58.296 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-12-08 08:06:58.044839230 +0000 2023-12-08T08:13:58.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:13:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-08T08:13:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-08T08:13:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.0002074 s, 2.5 MB/s 2023-12-08T08:13:58.418 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:13:58.461 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-12-08T08:13:58.544 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:13:58.544 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-08 08:13:47.599306338 +0000 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-08 08:06:59.088822778 +0000 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-08 08:06:59.088822778 +0000 2023-12-08T08:13:58.545 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-12-08 08:06:59.088822778 +0000 2023-12-08T08:13:58.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:13:58.658 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-08T08:13:58.658 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-08T08:13:58.658 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00020035 s, 2.6 MB/s 2023-12-08T08:13:58.662 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:13:58.705 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:13:58.705 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:13:58.705 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:13:58.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:13:58.766 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2023-12-08T08:13:58.819 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-12-08 08:11:11.892353071 +0000 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-12-08 08:08:44.267502089 +0000 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-12-08 08:08:44.267502089 +0000 2023-12-08T08:13:58.820 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-12-08 08:08:44.267502089 +0000 2023-12-08T08:13:58.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:13:58.906 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-12-08T08:13:58.906 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-12-08T08:13:58.906 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000590114 s, 868 kB/s 2023-12-08T08:13:58.909 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:13:58.967 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2023-12-08T08:13:59.019 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:13:59.019 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-12-08T08:13:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:59.019 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-12-08 08:11:11.892353071 +0000 2023-12-08T08:13:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-12-08 08:08:45.280480588 +0000 2023-12-08T08:13:59.020 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-12-08 08:08:45.280480588 +0000 2023-12-08T08:13:59.020 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-12-08 08:08:45.280480588 +0000 2023-12-08T08:13:59.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:13:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-12-08T08:13:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-12-08T08:13:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000348037 s, 1.5 MB/s 2023-12-08T08:13:59.112 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:13:59.167 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-12-08 08:11:11.893353049 +0000 2023-12-08T08:13:59.215 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-12-08 08:08:46.323458449 +0000 2023-12-08T08:13:59.216 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-12-08 08:08:46.323458449 +0000 2023-12-08T08:13:59.216 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-12-08 08:08:46.323458449 +0000 2023-12-08T08:13:59.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:13:59.303 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-12-08T08:13:59.303 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-12-08T08:13:59.303 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000335569 s, 1.5 MB/s 2023-12-08T08:13:59.307 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:13:59.364 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2023-12-08T08:13:59.416 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:13:59.416 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-12-08 08:11:11.894353028 +0000 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-12-08 08:08:47.341436842 +0000 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-12-08 08:08:47.341436842 +0000 2023-12-08T08:13:59.417 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2023-12-08 08:08:47.341436842 +0000 2023-12-08T08:13:59.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:13:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-12-08T08:13:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-12-08T08:13:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00034249 s, 1.5 MB/s 2023-12-08T08:13:59.513 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:13:59.575 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:13:59.576 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:13:59.576 INFO:tasks.ceph:Generating config... 2023-12-08T08:13:59.577 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-08T08:13:59.577 INFO:tasks.ceph:[client] debug client = 20 2023-12-08T08:13:59.577 INFO:tasks.ceph:[client] debug ms = 1 2023-12-08T08:13:59.577 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-08T08:13:59.577 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-08T08:13:59.577 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-08T08:13:59.577 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-08T08:13:59.577 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-08T08:13:59.577 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-08T08:13:59.578 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-08T08:13:59.578 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-08T08:13:59.579 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-08T08:13:59.580 INFO:tasks.ceph:Setting up mon.a... 2023-12-08T08:13:59.580 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-08T08:13:59.707 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-12-08T08:13:59.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-08T08:13:59.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:13:59.891 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.114'), ('mon.c', '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]')] 2023-12-08T08:13:59.891 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-08T08:13:59.892 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:13:59.892 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:13:59.934 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.114 --addv c '[v2:172.21.15.114:3301,v1:172.21.15.114:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:00.066 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-12-08T08:14:00.064490+0000 2023-12-08T08:14:00.067 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-12-08T08:14:00.064490+0000 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] mon.c 2023-12-08T08:14:00.068 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-08T08:14:00.070 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:14:00.123 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2... 2023-12-08T08:14:00.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:14:00.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-08T08:14:00.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.284 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:14:00.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-08T08:14:00.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug trim objects = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-08T08:14:00.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.288 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-08T08:14:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-08T08:14:00.290 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.291 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-08T08:14:00.292 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-08T08:14:00.293 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-12-08T08:14:00.294 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-08T08:14:00.294 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-08T08:14:00.294 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-08T08:14:00.307 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-12-08T08:14:00.307 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2023-12-08T08:14:00.307 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2023-12-08T08:14:00.308 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2023-12-08T08:14:00.309 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:14:00.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2023-12-08T08:14:00.311 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.45,172.21.15.114,[v2:172.21.15.114:3301,v1:172.21.15.114:6790]" 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.312 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:14:00.313 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:14:00.314 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-12-08T08:14:00.315 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:14:00.316 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2023-12-08T08:14:00.317 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-12-08T08:14:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-12-08T08:14:00.319 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-12-08T08:14:00.351 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-08T08:14:00.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-08T08:14:00.493 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-08T08:14:00.493 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:00.493 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-08T08:14:00.542 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:00.542 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-08T08:14:00.633 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:14:00.633 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:00.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:14:00.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:14:00.757 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:00.758 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:00.851 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:14:00.851 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:00.851 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:14:00.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:14:01.009 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:01.009 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:01.109 INFO:tasks.ceph:Setting up mon nodes... 2023-12-08T08:14:01.109 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-08T08:14:01.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:14:01.289 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:14:01.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:14:01.488 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:14:01.499 INFO:tasks.ceph:Setting up mds nodes... 2023-12-08T08:14:01.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:14:01.700 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:14:01.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-08T08:14:01.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:14:01.982 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:14:01.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-08T08:14:02.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:14:02.286 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:14:02.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-08T08:14:02.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:14:02.566 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:14:02.575 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-08T08:14:02.673 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-08T08:14:02.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-08T08:14:02.818 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-08T08:14:02.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-08T08:14:03.010 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-08T08:14:03.069 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-08T08:14:03.069 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:14:03.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-08T08:14:03.175 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:03.175 INFO:tasks.ceph:role: osd.0 2023-12-08T08:14:03.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:14:03.175 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:03.274 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:03.307 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-12-08T08:14:03.312 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-08T08:14:03.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-08T08:14:03.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-08T08:14:03.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-08T08:14:03.622 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:03.622 INFO:tasks.ceph:role: osd.1 2023-12-08T08:14:03.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:14:03.622 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:14:03.723 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:03.724 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:03.758 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-12-08T08:14:03.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-08T08:14:03.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-08T08:14:03.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-08T08:14:03.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-08T08:14:04.069 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:04.069 INFO:tasks.ceph:role: osd.2 2023-12-08T08:14:04.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:14:04.069 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:04.169 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:04.203 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-12-08T08:14:04.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-08T08:14:04.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-08T08:14:04.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-08T08:14:04.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-08T08:14:04.509 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:04.509 INFO:tasks.ceph:role: osd.3 2023-12-08T08:14:04.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:14:04.509 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:14:04.605 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:04.605 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:04.605 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:04.606 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:04.640 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-12-08T08:14:04.645 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-08T08:14:04.646 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-08T08:14:04.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-08T08:14:04.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.023+0000 7f9e1ce0f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-08T08:14:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.023+0000 7f9e1ce0f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-08T08:14:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.023+0000 7f9e1ce0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:14:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.024+0000 7f9e1ce0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:14:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.024+0000 7f9e1ce0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:14:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:05.027+0000 7f9e1ce0f500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-08T08:14:08.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T08:14:08.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.458+0000 7f6411625500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-08T08:14:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.458+0000 7f6411625500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-08T08:14:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.458+0000 7f6411625500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:14:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.458+0000 7f6411625500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:14:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.458+0000 7f6411625500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:14:08.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:08.461+0000 7f6411625500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-08T08:14:11.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T08:14:11.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:12.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.141+0000 7ff68d818500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-08T08:14:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.141+0000 7ff68d818500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-08T08:14:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.141+0000 7ff68d818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:14:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.141+0000 7ff68d818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:14:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.141+0000 7ff68d818500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:14:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:12.143+0000 7ff68d818500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-08T08:14:15.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T08:14:15.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:15.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.318+0000 7f2969746500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-08T08:14:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.319+0000 7f2969746500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-08T08:14:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.319+0000 7f2969746500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:14:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.319+0000 7f2969746500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:14:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.319+0000 7f2969746500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:14:15.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:15.321+0000 7f2969746500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-08T08:14:18.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T08:14:18.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-08T08:14:18.449 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:18.449 INFO:tasks.ceph:role: osd.4 2023-12-08T08:14:18.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:14:18.450 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:19.091 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-12-08T08:14:19.097 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-12-08T08:14:19.097 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-08T08:14:19.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-08T08:14:19.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-08T08:14:19.494 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:19.494 INFO:tasks.ceph:role: osd.5 2023-12-08T08:14:19.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:14:19.494 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:14:19.591 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:19.592 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:19.593 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:19.593 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:20.075 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-12-08T08:14:20.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-12-08T08:14:20.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-08T08:14:20.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-08T08:14:20.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-08T08:14:20.411 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:20.411 INFO:tasks.ceph:role: osd.6 2023-12-08T08:14:20.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:14:20.411 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:20.508 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:20.509 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:20.509 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:21.019 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-12-08T08:14:21.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-12-08T08:14:21.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-08T08:14:21.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-08T08:14:21.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-08T08:14:21.420 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:14:21.421 INFO:tasks.ceph:role: osd.7 2023-12-08T08:14:21.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:14:21.421 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:14:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:14:21.521 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:14:21.980 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2023-12-08T08:14:21.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-12-08T08:14:21.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-08T08:14:22.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-08T08:14:22.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:22.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.402+0000 7f9cad820500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-08T08:14:22.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.406+0000 7f9cad820500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-08T08:14:22.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.406+0000 7f9cad820500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:14:22.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.406+0000 7f9cad820500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:14:22.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.406+0000 7f9cad820500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:14:22.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:22.418+0000 7f9cad820500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-08T08:14:25.600 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T08:14:25.696 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:25.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.831+0000 7f4e3500e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-08T08:14:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.831+0000 7f4e3500e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-08T08:14:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.831+0000 7f4e3500e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:14:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.831+0000 7f4e3500e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:14:25.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.832+0000 7f4e3500e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:14:25.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:25.834+0000 7f4e3500e500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-08T08:14:27.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:14:27.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:14:28.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T08:14:28.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:29.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.003+0000 7fee15214500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-08T08:14:29.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.004+0000 7fee15214500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-08T08:14:29.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.004+0000 7fee15214500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:14:29.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.004+0000 7fee15214500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:14:29.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.004+0000 7fee15214500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:14:29.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:29.006+0000 7fee15214500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-08T08:14:31.927 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-08T08:14:32.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.162+0000 7f12f2729500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-08T08:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.162+0000 7f12f2729500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-08T08:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.162+0000 7f12f2729500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.163+0000 7f12f2729500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:14:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.163+0000 7f12f2729500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:14:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:32.165+0000 7f12f2729500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-08T08:14:35.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-08T08:14:35.190 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-08T08:14:35.190 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-08T08:14:35.304 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-08T08:14:35.407 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-08T08:14:35.508 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-08T08:14:35.609 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-08T08:14:35.713 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-08T08:14:35.816 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:35.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-08T08:14:35.919 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:35.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-08T08:14:36.023 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-08T08:14:36.119 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-08T08:14:36.209 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-08T08:14:36.303 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-08T08:14:36.393 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-08T08:14:36.483 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-08T08:14:36.581 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:36.581 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-08T08:14:36.644 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:36.644 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-08T08:14:36.703 INFO:tasks.ceph:Adding keys to all mons... 2023-12-08T08:14:36.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:14:36.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:14:36.805 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2023-12-08T08:14:36.805 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBJ0HJlKZgvERAAL98Wtoye5tepo7AlBftDNg== 2023-12-08T08:14:36.805 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-12-08T08:14:36.805 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBJ0HJla7GwKRAABCs1sRB3k9+U2d+Nv+6Qsg== 2023-12-08T08:14:36.805 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBJ0HJlkimAOhAARjxtAqp4aGMJAk9pQEuEcg== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBN0HJlen9oARAAcqoG1WYSzpUAuVNvDa1mKg== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBQ0HJlEsRmGxAAfml/gGZ8vfNzJsUlDsTbyg== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBU0HJl+ct7CBAAEuBM0fSR04+8zaRtqq8k/g== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBX0HJlVnwVExAAFxt0oSVa42WXjwm+S9Ts6Q== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBJ0HJl/rIKHRAAaJjZUtDXcmEgavGZvjHxow== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBK0HJlUl35EBAAKLS/fMIt6G9vqde16uAsoA== 2023-12-08T08:14:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBK0HJlhY+rIRAAOcH5Vdj4eehrPUQuDuwLRw== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBe0HJlqX4IGBAAoSzK53JRumPJ10WGo1EjYA== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBh0HJlA6GSMRAAqOCPmn8QGJzAco8jgWd3zQ== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBl0HJlXY8/ABAAXD0SJ5TMILJDA/sXMzLSRA== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBo0HJlBOSzCRAA8e0cUSeNL2bCJyy587oT2Q== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg== 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2023-12-08T08:14:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA== 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBJ0HJlKZgvERAAL98Wtoye5tepo7AlBftDNg== 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBJ0HJla7GwKRAABCs1sRB3k9+U2d+Nv+6Qsg== 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBJ0HJlkimAOhAARjxtAqp4aGMJAk9pQEuEcg== 2023-12-08T08:14:36.808 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBN0HJlen9oARAAcqoG1WYSzpUAuVNvDa1mKg== 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBQ0HJlEsRmGxAAfml/gGZ8vfNzJsUlDsTbyg== 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBU0HJl+ct7CBAAEuBM0fSR04+8zaRtqq8k/g== 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBX0HJlVnwVExAAFxt0oSVa42WXjwm+S9Ts6Q== 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBJ0HJl/rIKHRAAaJjZUtDXcmEgavGZvjHxow== 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-08T08:14:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlUl35EBAAKLS/fMIt6G9vqde16uAsoA== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlhY+rIRAAOcH5Vdj4eehrPUQuDuwLRw== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBe0HJlqX4IGBAAoSzK53JRumPJ10WGo1EjYA== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBh0HJlA6GSMRAAqOCPmn8QGJzAco8jgWd3zQ== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBl0HJlXY8/ABAAXD0SJ5TMILJDA/sXMzLSRA== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBo0HJlBOSzCRAA8e0cUSeNL2bCJyy587oT2Q== 2023-12-08T08:14:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-08T08:14:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg== 2023-12-08T08:14:36.811 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-08T08:14:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA== 2023-12-08T08:14:36.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:14:36.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:14:36.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:36.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:37.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:37.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:37.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:37.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:14:37.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:14:38.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:38.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:38.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:38.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:14:38.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:38.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:14:39.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:14:39.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:14:39.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:14:39.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:14:39.319 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-08T08:14:39.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-08T08:14:39.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:14:39.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-08T08:14:39.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-08T08:14:39.794 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:14:39.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-08T08:14:40.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-08T08:14:40.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:14:40.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-08T08:14:40.365 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:40.374 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:14:40.428 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-08T08:14:40.429 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-08T08:14:40.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-08T08:14:40.434 INFO:tasks.ceph.mon.a:Started 2023-12-08T08:14:40.434 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-08T08:14:40.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-08T08:14:40.440 INFO:tasks.ceph.mon.b:Started 2023-12-08T08:14:40.440 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-08T08:14:40.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-08T08:14:40.447 INFO:tasks.ceph.mon.c:Started 2023-12-08T08:14:40.447 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-08T08:14:40.448 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-08T08:14:40.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-08T08:14:40.456 INFO:tasks.ceph.mgr.y:Started 2023-12-08T08:14:40.456 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-08T08:14:40.456 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-08T08:14:40.461 INFO:tasks.ceph.mgr.x:Started 2023-12-08T08:14:40.461 INFO:tasks.ceph:Setting crush tunables to default 2023-12-08T08:14:40.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-12-08T08:14:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.639+0000 7faaa6ce5640 1 Processor -- start 2023-12-08T08:14:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.639+0000 7faaa6ce5640 1 -- start start 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.640+0000 7faaa6ce5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faaa00c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.640+0000 7faaa6ce5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 0x7faaa015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.640+0000 7faaa6ce5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa0158c20 con 0x7faaa00c7c90 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.640+0000 7faaa6ce5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa00bd750 con 0x7faaa00c4c50 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.640+0000 7faaa6ce5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0158f00 con 0x7faaa01560b0 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faa9ffff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faaa00c7c90 0x7faaa015c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:56320/0 (socket says 172.21.15.45:56320) 2023-12-08T08:14:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faa9ffff640 1 -- 172.21.15.45:0/3548856896 learned_addr learned my addr 172.21.15.45:0/3548856896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 0x7faaa015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa4a81640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faaa00c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 msgr2=0x7faaa015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 msgr2=0x7faaa015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 0x7faaa015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa4a81640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 msgr2=0x7faaa00c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa4a81640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 msgr2=0x7faaa00c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa4a81640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faaa00c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa4a81640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faaa00c4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:14:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.641+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 0x7faaa015c810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:14:40.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.663+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013620190 0 0) 0x7faaa0158c20 con 0x7faaa00c7c90 2023-12-08T08:14:40.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.663+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa90003520 con 0x7faaa00c7c90 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.1 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1757651379 0 0) 0x7faa90003520 con 0x7faaa00c7c90 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 msgr2=0x7faaa00c4710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faaa00c4710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 msgr2=0x7faaa015c810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3548856896 >> v2:172.21.15.45:3300/0 conn(0x7faaa00c4c50 0x7faaa015c810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa01591e0 con 0x7faaa00c7c90 2023-12-08T08:14:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.1 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7faa8c001670 con 0x7faaa00c7c90 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 >> v1:172.21.15.114:6789/0 conn(0x7faaa00c7c90 legacy=0x7faaa015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faa90003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa90003ff0 0x7faa900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa90004d00 0x7faa90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00bd750 con 0x7faa90004d00 2023-12-08T08:14:40.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0158f00 con 0x7faa90003ff0 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.669+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9000bc10 con 0x7faaa01560b0 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa90004d00 0x7faa90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa4a81640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faa90003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faa9ffff640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa90003ff0 0x7faa900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 msgr2=0x7faa90003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa01560b0 0x7faa90003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa90003ff0 msgr2=0x7faa900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa90003ff0 0x7faa900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.670+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90003520 con 0x7faa90004d00 2023-12-08T08:14:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.672+0000 7faaa5282640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa90004d00 0x7faa90005180 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faa98009fd0 tx=0x7faa900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866fcd4e126297fd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:40.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.673+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9802ccb0 con 0x7faa90004d00 2023-12-08T08:14:40.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.673+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9802ce10 con 0x7faa90004d00 2023-12-08T08:14:40.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.673+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3548856896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98034680 con 0x7faa90004d00 2023-12-08T08:14:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 -- 172.21.15.45:0/3548856896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa90004d00 msgr2=0x7faa90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 --2- 172.21.15.45:0/3548856896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa90004d00 0x7faa90005180 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faa98009fd0 tx=0x7faa900057f0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa5282640 1 -- 172.21.15.45:0/3548856896 reap_dead start 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 -- 172.21.15.45:0/3548856896 shutdown_connections 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 -- 172.21.15.45:0/3548856896 >> 172.21.15.45:0/3548856896 conn(0x7faaa00ab920 msgr2=0x7faaa00abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 -- 172.21.15.45:0/3548856896 shutdown_connections 2023-12-08T08:14:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.674+0000 7faaa6ce5640 1 -- 172.21.15.45:0/3548856896 wait complete. 2023-12-08T08:14:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.676+0000 7faaa6ce5640 1 Processor -- start 2023-12-08T08:14:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.676+0000 7faaa6ce5640 1 -- start start 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa90004d00 0x7faaa00c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa00bff10 0x7faaa00c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c27a0 con 0x7faaa00c3d40 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00c0900 con 0x7faaa00bff10 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faaa6ce5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa01ee700 con 0x7faa90004d00 2023-12-08T08:14:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.677+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49350/0 (socket says 172.21.15.45:49350) 2023-12-08T08:14:40.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 -- 172.21.15.45:0/2703427783 learned_addr learned my addr 172.21.15.45:0/2703427783 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:40.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faaa4a81640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa90004d00 0x7faaa00c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faaa5282640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa00bff10 0x7faaa00c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 -- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa90004d00 msgr2=0x7faaa00c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa90004d00 0x7faaa00c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 -- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa00bff10 msgr2=0x7faaa00c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa00bff10 0x7faaa00c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 -- 172.21.15.45:0/2703427783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa00c41c0 con 0x7faaa00c3d40 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.678+0000 7faa9ffff640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa8c007310 tx=0x7faa8c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.679+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00f8e0 con 0x7faaa00c3d40 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.679+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c00fa60 con 0x7faaa00c3d40 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.679+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa01eddd0 con 0x7faaa00c3d40 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.679+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00fe10 con 0x7faaa00c3d40 2023-12-08T08:14:40.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.679+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa01ee390 con 0x7faaa00c3d40 2023-12-08T08:14:40.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.680+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa8c01d760 con 0x7faaa00c3d40 2023-12-08T08:14:40.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.680+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7faa8c0137b0 con 0x7faaa00c3d40 2023-12-08T08:14:40.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.681+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa01ee550 con 0x7faaa00c3d40 2023-12-08T08:14:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.685+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7faa8c01dba0 con 0x7faaa00c3d40 2023-12-08T08:14:40.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.760+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7faaa0074670 con 0x7faaa00c3d40 2023-12-08T08:14:40.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.763+0000 7faa9d7fa640 1 -- 172.21.15.45:0/2703427783 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7faa8c01dd40 con 0x7faaa00c3d40 2023-12-08T08:14:40.766 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-12-08T08:14:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 msgr2=0x7faaa015b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa8c007310 tx=0x7faa8c0077d0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 shutdown_connections 2023-12-08T08:14:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa00bff10 0x7faaa00c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa00c3d40 0x7faaa015b760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 --2- 172.21.15.45:0/2703427783 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa90004d00 0x7faaa00c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 >> 172.21.15.45:0/2703427783 conn(0x7faaa00ab920 msgr2=0x7faaa006b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 shutdown_connections 2023-12-08T08:14:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:40.765+0000 7faaa6ce5640 1 -- 172.21.15.45:0/2703427783 wait complete. 2023-12-08T08:14:40.786 INFO:tasks.ceph:check_enable_crimson: False 2023-12-08T08:14:40.786 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-08T08:14:40.786 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:40.786 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-08T08:14:40.877 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:40.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-08T08:14:41.013 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:41.014 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-08T08:14:41.098 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:14:41.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-08T08:14:41.227 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:41.227 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-08T08:14:41.236 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:41.227+0000 7f60a477f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:14:41.240 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:41.237+0000 7f4e87e16040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:14:41.291 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:41.288+0000 7f60a477f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:14:41.302 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:41.300+0000 7f4e87e16040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:14:41.315 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:41.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-08T08:14:41.442 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:41.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-08T08:14:41.568 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:14:41.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-08T08:14:41.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new b16b74ac-7336-4c05-ba6c-83ef92715556 0 2023-12-08T08:14:41.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.892+0000 7f7224690640 1 Processor -- start 2023-12-08T08:14:41.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.892+0000 7f7224690640 1 -- start start 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f7224690640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f721c151db0 0x7f721c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f7224690640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 0x7f721c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f7224690640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c154620 con 0x7f721c0c5bb0 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f7224690640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0c8330 con 0x7f721c06b0c0 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f7224690640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0c63e0 con 0x7f721c151db0 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f722242c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f721c151db0 0x7f721c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f722242c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f721c151db0 0x7f721c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56486/0 (socket says 172.21.15.114:56486) 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.893+0000 7f722242c640 1 -- 172.21.15.114:0/202844469 learned_addr learned my addr 172.21.15.114:0/202844469 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f7222c2d640 1 --2- 172.21.15.114:0/202844469 >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 0x7f721c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f722242c640 1 -- 172.21.15.114:0/202844469 >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 msgr2=0x7f721c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:41.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f722242c640 1 --2- 172.21.15.114:0/202844469 >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 0x7f721c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f722242c640 1 -- 172.21.15.114:0/202844469 >> v1:172.21.15.114:6789/0 conn(0x7f721c0c5bb0 legacy=0x7f721c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:41.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f722242c640 1 -- 172.21.15.114:0/202844469 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c1548e0 con 0x7f721c151db0 2023-12-08T08:14:41.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.894+0000 7f7222c2d640 1 --2- 172.21.15.114:0/202844469 >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 0x7f721c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.895+0000 7f722242c640 1 --2- 172.21.15.114:0/202844469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c151db0 0x7f721c1550e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f721c08b380 tx=0x7f721802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7592041fb48d885 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.895+0000 7f722142a640 1 -- 172.21.15.114:0/202844469 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180317e0 con 0x7f721c151db0 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.895+0000 7f722142a640 1 -- 172.21.15.114:0/202844469 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218031940 con 0x7f721c151db0 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.895+0000 7f722142a640 1 -- 172.21.15.114:0/202844469 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218031cd0 con 0x7f721c151db0 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 -- 172.21.15.114:0/202844469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c151db0 msgr2=0x7f721c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:41.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 --2- 172.21.15.114:0/202844469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c151db0 0x7f721c1550e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f721c08b380 tx=0x7f721802b880 comp rx=0 tx=0).stop 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 -- 172.21.15.114:0/202844469 shutdown_connections 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 --2- 172.21.15.114:0/202844469 >> v2:172.21.15.45:3300/0 conn(0x7f721c06b0c0 0x7f721c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 --2- 172.21.15.114:0/202844469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c151db0 0x7f721c1550e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 -- 172.21.15.114:0/202844469 >> 172.21.15.114:0/202844469 conn(0x7f721c0c9d20 msgr2=0x7f721c0ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 -- 172.21.15.114:0/202844469 shutdown_connections 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.896+0000 7f7224690640 1 -- 172.21.15.114:0/202844469 wait complete. 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.898+0000 7f7224690640 1 Processor -- start 2023-12-08T08:14:41.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.898+0000 7f7224690640 1 -- start start 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.898+0000 7f7224690640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 0x7f721c1ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.898+0000 7f7224690640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 0x7f721c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7224690640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7224690640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0adf00 con 0x7f721c06b0c0 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7224690640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0afc80 con 0x7f721c0c5bb0 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7224690640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c1ead20 con 0x7f721c151db0 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7221c2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 0x7f721c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:37648/0 (socket says 172.21.15.114:37648) 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7221c2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 0x7f721c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56488/0 (socket says 172.21.15.114:56488) 2023-12-08T08:14:41.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 -- 172.21.15.114:0/1665912414 learned_addr learned my addr 172.21.15.114:0/1665912414 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:41.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f722242c640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 0x7f721c1ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 -- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 msgr2=0x7f721c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 0x7f721c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 -- 172.21.15.114:0/1665912414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 msgr2=0x7f721c1ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 0x7f721c1ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f7222c2d640 1 -- 172.21.15.114:0/1665912414 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180094d0 con 0x7f721c151db0 2023-12-08T08:14:41.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.899+0000 7f722242c640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 0x7f721c1ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7222c2d640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f721400cd50 tx=0x7f721400a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400f680 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400f800 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c0ac960 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400fbb0 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c146890 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f721400b040 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.900+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7214021730 con 0x7f721c151db0 2023-12-08T08:14:41.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.901+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c0744c0 con 0x7f721c151db0 2023-12-08T08:14:41.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.904+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f721400fd60 con 0x7f721c151db0 2023-12-08T08:14:41.921 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:41.918+0000 7f4e87e16040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:14:41.934 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:41.931+0000 7f60a477f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:14:41.985 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:41.982+0000 7f4e87e16040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:14:41.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.982+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b16b74ac-7336-4c05-ba6c-83ef92715556", "id": 0} v 0) v1 -- 0x7f721c0c47e0 con 0x7f721c151db0 2023-12-08T08:14:41.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.988+0000 7f7212ffd640 1 -- 172.21.15.114:0/1665912414 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b16b74ac-7336-4c05-ba6c-83ef92715556", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72140219c0 con 0x7f721c151db0 2023-12-08T08:14:41.991 INFO:teuthology.orchestra.run.smithi114.stdout:0 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 msgr2=0x7f721c155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f721400cd50 tx=0x7f721400a650 comp rx=0 tx=0).stop 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 shutdown_connections 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f721c151db0 0x7f721c155d70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f721c0c5bb0 0x7f721c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 --2- 172.21.15.114:0/1665912414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721c06b0c0 0x7f721c1ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 >> 172.21.15.114:0/1665912414 conn(0x7f721c0c9d20 msgr2=0x7f721c0c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 shutdown_connections 2023-12-08T08:14:41.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:41.990+0000 7f7224690640 1 -- 172.21.15.114:0/1665912414 wait complete. 2023-12-08T08:14:41.997 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:41.994+0000 7f60a477f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:14:42.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new f25d4e8d-6011-4ecf-beaf-19d993c8fb83 1 2023-12-08T08:14:42.040 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.037+0000 7f4e87e16040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:14:42.052 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.049+0000 7f60a477f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:14:42.105 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.103+0000 7f4e87e16040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:14:42.138 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.135+0000 7f60a477f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:14:42.157 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.155+0000 7f4e87e16040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:14:42.190 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.187+0000 7f60a477f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:14:42.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.190+0000 7f0999472640 1 Processor -- start 2023-12-08T08:14:42.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.190+0000 7f0999472640 1 -- start start 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0999472640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 0x7f09940c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0999472640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 0x7f09940c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0999472640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994155050 con 0x7f09940c4a60 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0999472640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0994154460 con 0x7f099414ae10 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0999472640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994154720 con 0x7f09940c8200 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f0993fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 0x7f09940c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.191+0000 7f09937fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 0x7f09940c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f0993fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 0x7f09940c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56490/0 (socket says 172.21.15.114:56490) 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f0993fff640 1 -- 172.21.15.114:0/3342755762 learned_addr learned my addr 172.21.15.114:0/3342755762 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f09937fe640 1 -- 172.21.15.114:0/3342755762 >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 msgr2=0x7f09940c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f09937fe640 1 --2- 172.21.15.114:0/3342755762 >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 0x7f09940c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f09937fe640 1 -- 172.21.15.114:0/3342755762 >> v1:172.21.15.114:6789/0 conn(0x7f09940c4a60 legacy=0x7f09940c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.192+0000 7f09937fe640 1 -- 172.21.15.114:0/3342755762 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994154a00 con 0x7f09940c8200 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.193+0000 7f09937fe640 1 --2- 172.21.15.114:0/3342755762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 0x7f09940c4520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0988009790 tx=0x7f098802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac7e258069cdfbf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.193+0000 7f0992ffd640 1 -- 172.21.15.114:0/3342755762 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880316f0 con 0x7f09940c8200 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.193+0000 7f0992ffd640 1 -- 172.21.15.114:0/3342755762 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988031850 con 0x7f09940c8200 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.193+0000 7f0992ffd640 1 -- 172.21.15.114:0/3342755762 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988031be0 con 0x7f09940c8200 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 -- 172.21.15.114:0/3342755762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 msgr2=0x7f09940c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 --2- 172.21.15.114:0/3342755762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 0x7f09940c4520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0988009790 tx=0x7f098802b790 comp rx=0 tx=0).stop 2023-12-08T08:14:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 -- 172.21.15.114:0/3342755762 shutdown_connections 2023-12-08T08:14:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 --2- 172.21.15.114:0/3342755762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f09940c8200 0x7f09940c4520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 --2- 172.21.15.114:0/3342755762 >> v2:172.21.15.114:3300/0 conn(0x7f099414ae10 0x7f09940c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 -- 172.21.15.114:0/3342755762 >> 172.21.15.114:0/3342755762 conn(0x7f09940ab730 msgr2=0x7f09940abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 -- 172.21.15.114:0/3342755762 shutdown_connections 2023-12-08T08:14:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.194+0000 7f0999472640 1 -- 172.21.15.114:0/3342755762 wait complete. 2023-12-08T08:14:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.196+0000 7f0999472640 1 Processor -- start 2023-12-08T08:14:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.196+0000 7f0999472640 1 -- start start 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09940c4a60 0x7f0994157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f099414ae10 0x7f09941ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940acfa0 con 0x7f09940c4a60 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940bf510 con 0x7f09940c8200 2023-12-08T08:14:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0999472640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940bf2a0 con 0x7f099414ae10 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f09937fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f09937fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56506/0 (socket says 172.21.15.114:56506) 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f09937fe640 1 -- 172.21.15.114:0/2263669317 learned_addr learned my addr 172.21.15.114:0/2263669317 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.197+0000 7f0998c71640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f099414ae10 0x7f09941ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0993fff640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09940c4a60 0x7f0994157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 -- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f099414ae10 msgr2=0x7f09941ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f099414ae10 0x7f09941ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 -- 172.21.15.114:0/2263669317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09940c4a60 msgr2=0x7f0994157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09940c4a60 0x7f0994157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 -- 172.21.15.114:0/2263669317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880093a0 con 0x7f09940c8200 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f09937fe640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09880098b0 tx=0x7f09880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988034680 con 0x7f09940c8200 2023-12-08T08:14:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988034820 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988034bd0 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940ac950 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.198+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994158520 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.199+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f098803b040 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.199+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f098803d7b0 con 0x7f09940c8200 2023-12-08T08:14:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.200+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09940ad150 con 0x7f09940c8200 2023-12-08T08:14:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.202+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0988067ce0 con 0x7f09940c8200 2023-12-08T08:14:42.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.274+0000 7f4e87e16040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-08T08:14:42.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.281+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f25d4e8d-6011-4ecf-beaf-19d993c8fb83", "id": 1} v 0) v1 -- 0x7f09940aa680 con 0x7f09940c8200 2023-12-08T08:14:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.286+0000 7f0990ff9640 1 -- 172.21.15.114:0/2263669317 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f25d4e8d-6011-4ecf-beaf-19d993c8fb83", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0988056030 con 0x7f09940c8200 2023-12-08T08:14:42.289 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:14:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 msgr2=0x7f09941ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09880098b0 tx=0x7f09880046c0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 shutdown_connections 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f099414ae10 0x7f09941ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c8200 0x7f09941ed300 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 --2- 172.21.15.114:0/2263669317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09940c4a60 0x7f0994157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 >> 172.21.15.114:0/2263669317 conn(0x7f09940ab730 msgr2=0x7f09940aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 shutdown_connections 2023-12-08T08:14:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.288+0000 7f0999472640 1 -- 172.21.15.114:0/2263669317 wait complete. 2023-12-08T08:14:42.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new e99577bd-c584-497f-93eb-8b0113d5044a 2 2023-12-08T08:14:42.311 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.308+0000 7f60a477f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-08T08:14:42.363 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.360+0000 7f4e87e16040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:14:42.396 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.392+0000 7f60a477f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:14:42.419 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.416+0000 7f4e87e16040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:14:42.451 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.448+0000 7f60a477f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:14:42.482 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.479+0000 7f4e87e16040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:14:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.496+0000 7f4f4b59e640 1 Processor -- start 2023-12-08T08:14:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.497+0000 7f4f4b59e640 1 -- start start 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f4b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f4c151ad0 0x7f4f4c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f4b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c151eb0 con 0x7f4f4c0ca610 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f4b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0c80d0 con 0x7f4f4c157a20 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f4b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c56a0 con 0x7f4f4c151ad0 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f43fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4f4c157a20 0x7f4f4c154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60536/0 (socket says 172.21.15.114:60536) 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.498+0000 7f4f43fff640 1 -- 172.21.15.114:0/1577907847 learned_addr learned my addr 172.21.15.114:0/1577907847 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1577907847 >> v2:172.21.15.45:3300/0 conn(0x7f4f4c151ad0 0x7f4f4c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851363775 0 0) 0x7f4f4c0c80d0 con 0x7f4f4c157a20 2023-12-08T08:14:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f38003520 con 0x7f4f4c157a20 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878381175 0 0) 0x7f4f38003520 con 0x7f4f4c157a20 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 >> v2:172.21.15.45:3300/0 conn(0x7f4f4c151ad0 msgr2=0x7f4f4c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 --2- 172.21.15.114:0/1577907847 >> v2:172.21.15.45:3300/0 conn(0x7f4f4c151ad0 0x7f4f4c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 >> v1:172.21.15.45:6789/0 conn(0x7f4f4c0ca610 legacy=0x7f4f4c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c154430 con 0x7f4f4c157a20 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f4f34001670 con 0x7f4f4c157a20 2023-12-08T08:14:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 >> v1:172.21.15.114:6789/0 conn(0x7f4f4c157a20 legacy=0x7f4f4c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 0x7f4f38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f380047c0 0x7f4f38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.499+0000 7f4f49d9b640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f38005180 0x7f4f3800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3800bff0 con 0x7f4f380047c0 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3800c160 con 0x7f4f38003970 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3800c320 con 0x7f4f38005180 2023-12-08T08:14:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 0x7f4f38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4ad9d640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f38005180 0x7f4f3800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f43fff640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f380047c0 0x7f4f38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 -- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f38005180 msgr2=0x7f4f3800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f38005180 0x7f4f3800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 -- 172.21.15.114:0/1577907847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f380047c0 msgr2=0x7f4f38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f380047c0 0x7f4f38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4a59c640 1 -- 172.21.15.114:0/1577907847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38003520 con 0x7f4f38003970 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.500+0000 7f4f4ad9d640 1 -- 172.21.15.114:0/1577907847 reap_dead start 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.501+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 0x7f4f38003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009ac0 tx=0x7f4f380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85423ec9eb49d8a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.501+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c02c6b0 con 0x7f4f38003970 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.501+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c02c810 con 0x7f4f38003970 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.501+0000 7f4f49d9b640 1 -- 172.21.15.114:0/1577907847 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c02cba0 con 0x7f4f38003970 2023-12-08T08:14:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 msgr2=0x7f4f38003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 0x7f4f38003d90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009ac0 tx=0x7f4f380057f0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1577907847 shutdown_connections 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1577907847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f38003970 0x7f4f38003d90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1577907847 >> 172.21.15.114:0/1577907847 conn(0x7f4f4c066610 msgr2=0x7f4f4c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1577907847 shutdown_connections 2023-12-08T08:14:42.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.502+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1577907847 wait complete. 2023-12-08T08:14:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.505+0000 7f4f4b59e640 1 Processor -- start 2023-12-08T08:14:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.505+0000 7f4f4b59e640 1 -- start start 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.506+0000 7f4f4b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f38003970 0x7f4f4c0ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f4c1483f0 0x7f4f4c0c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c0a40 con 0x7f4f38003970 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c36f0 con 0x7f4f4c147ec0 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0ad990 con 0x7f4f4c1483f0 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56524/0 (socket says 172.21.15.114:56524) 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 -- 172.21.15.114:0/1273187794 learned_addr learned my addr 172.21.15.114:0/1273187794 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4ad9d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f4c1483f0 0x7f4f4c0c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f4a59c640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f38003970 0x7f4f4c0ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 -- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f4c1483f0 msgr2=0x7f4f4c0c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f4c1483f0 0x7f4f4c0c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 -- 172.21.15.114:0/1273187794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f38003970 msgr2=0x7f4f4c0ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f38003970 0x7f4f4c0ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 -- 172.21.15.114:0/1273187794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0c3c20 con 0x7f4f4c147ec0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.507+0000 7f4f43fff640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e730 tx=0x7f4f3400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400ee40 con 0x7f4f4c147ec0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400c850 con 0x7f4f4c147ec0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400cc00 con 0x7f4f4c147ec0 2023-12-08T08:14:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c0ae360 con 0x7f4f4c147ec0 2023-12-08T08:14:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c0ad340 con 0x7f4f4c147ec0 2023-12-08T08:14:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4f34013720 con 0x7f4f4c147ec0 2023-12-08T08:14:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.508+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4f3401c9c0 con 0x7f4f4c147ec0 2023-12-08T08:14:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.509+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0adb40 con 0x7f4f4c147ec0 2023-12-08T08:14:42.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.512+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4f4c0adb40 con 0x7f4f4c147ec0 2023-12-08T08:14:42.517 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.514+0000 7f60a477f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:14:42.540 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:42.537+0000 7f4e87e16040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:14:42.574 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:42.571+0000 7f60a477f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:14:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.590+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e99577bd-c584-497f-93eb-8b0113d5044a", "id": 2} v 0) v1 -- 0x7f4f4c0743e0 con 0x7f4f4c147ec0 2023-12-08T08:14:42.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.597+0000 7f4f42ffd640 1 -- 172.21.15.114:0/1273187794 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e99577bd-c584-497f-93eb-8b0113d5044a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f3400cd60 con 0x7f4f4c147ec0 2023-12-08T08:14:42.600 INFO:teuthology.orchestra.run.smithi114.stdout:2 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 msgr2=0x7f4f4c0af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e730 tx=0x7f4f3400ebf0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 shutdown_connections 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f4c1483f0 0x7f4f4c0c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f4c147ec0 0x7f4f4c0af140 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 --2- 172.21.15.114:0/1273187794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f38003970 0x7f4f4c0ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 >> 172.21.15.114:0/1273187794 conn(0x7f4f4c066610 msgr2=0x7f4f4c1537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 shutdown_connections 2023-12-08T08:14:42.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.598+0000 7f4f4b59e640 1 -- 172.21.15.114:0/1273187794 wait complete. 2023-12-08T08:14:42.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4 3 2023-12-08T08:14:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.808+0000 7fa0e7409640 1 Processor -- start 2023-12-08T08:14:42.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.808+0000 7fa0e7409640 1 -- start start 2023-12-08T08:14:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e7409640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 0x7fa0e00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e7409640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00c4df0 con 0x7fa0e014ae10 2023-12-08T08:14:42.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e7409640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e0155050 con 0x7fa0e00c4520 2023-12-08T08:14:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e7409640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0154460 con 0x7fa0e00c4960 2023-12-08T08:14:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e5c06640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0e00c4520 0x7fa0e00c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60546/0 (socket says 172.21.15.114:60546) 2023-12-08T08:14:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.810+0000 7fa0e5c06640 1 -- 172.21.15.114:0/898471737 learned_addr learned my addr 172.21.15.114:0/898471737 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-12-08T08:14:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e6c08640 1 --2- 172.21.15.114:0/898471737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 0x7fa0e00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e5405640 1 -- 172.21.15.114:0/898471737 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593636872 0 0) 0x7fa0e0155050 con 0x7fa0e00c4520 2023-12-08T08:14:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e5405640 1 -- 172.21.15.114:0/898471737 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0cc003520 con 0x7fa0e00c4520 2023-12-08T08:14:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e6c08640 1 -- 172.21.15.114:0/898471737 >> v1:172.21.15.114:6789/0 conn(0x7fa0e00c4520 legacy=0x7fa0e00c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e6c08640 1 -- 172.21.15.114:0/898471737 >> v1:172.21.15.45:6789/0 conn(0x7fa0e014ae10 legacy=0x7fa0e00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.811+0000 7fa0e6c08640 1 -- 172.21.15.114:0/898471737 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0154720 con 0x7fa0e00c4960 2023-12-08T08:14:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.812+0000 7fa0e6c08640 1 --2- 172.21.15.114:0/898471737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 0x7fa0e00c8f10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009dc0 tx=0x7fa0d802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3329e051380f109 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.812+0000 7fa0e5405640 1 -- 172.21.15.114:0/898471737 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d802cc30 con 0x7fa0e00c4960 2023-12-08T08:14:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.813+0000 7fa0e5405640 1 -- 172.21.15.114:0/898471737 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d802cd90 con 0x7fa0e00c4960 2023-12-08T08:14:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.813+0000 7fa0e5405640 1 -- 172.21.15.114:0/898471737 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8034640 con 0x7fa0e00c4960 2023-12-08T08:14:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.813+0000 7fa0e7409640 1 -- 172.21.15.114:0/898471737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 msgr2=0x7fa0e00c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.813+0000 7fa0e7409640 1 --2- 172.21.15.114:0/898471737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 0x7fa0e00c8f10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009dc0 tx=0x7fa0d802be80 comp rx=0 tx=0).stop 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.814+0000 7fa0e7409640 1 -- 172.21.15.114:0/898471737 shutdown_connections 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.814+0000 7fa0e7409640 1 --2- 172.21.15.114:0/898471737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4960 0x7fa0e00c8f10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.814+0000 7fa0e7409640 1 -- 172.21.15.114:0/898471737 >> 172.21.15.114:0/898471737 conn(0x7fa0e00ab730 msgr2=0x7fa0e00abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.814+0000 7fa0e7409640 1 -- 172.21.15.114:0/898471737 shutdown_connections 2023-12-08T08:14:42.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.814+0000 7fa0e7409640 1 -- 172.21.15.114:0/898471737 wait complete. 2023-12-08T08:14:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.816+0000 7fa0e7409640 1 Processor -- start 2023-12-08T08:14:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.816+0000 7fa0e7409640 1 -- start start 2023-12-08T08:14:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 0x7fa0e0157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 0x7fa0e00bda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0157830 con 0x7fa0e014ae10 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00c1ba0 con 0x7fa0e00c4960 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e7409640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0156c20 con 0x7fa0e00c4520 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e6407640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e5c06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 0x7fa0e0157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e6407640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:37712/0 (socket says 172.21.15.114:37712) 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e6407640 1 -- 172.21.15.114:0/3212951150 learned_addr learned my addr 172.21.15.114:0/3212951150 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e6c08640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 0x7fa0e00bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.818+0000 7fa0e5c06640 1 -- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 msgr2=0x7fa0e01e98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e5c06640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e5c06640 1 -- 172.21.15.114:0/3212951150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 msgr2=0x7fa0e00bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e5c06640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 0x7fa0e00bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e5c06640 1 -- 172.21.15.114:0/3212951150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d8009a70 con 0x7fa0e00c4960 2023-12-08T08:14:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e6407640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:14:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e6c08640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 0x7fa0e00bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:14:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e5c06640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 0x7fa0e0157cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c700 tx=0x7fa0d000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0007270 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00073d0 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e0156f00 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0001d20 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01574c0 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.819+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa0d0005aa0 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.820+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa0d0005d50 con 0x7fa0e00c4960 2023-12-08T08:14:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.821+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e01579e0 con 0x7fa0e00c4960 2023-12-08T08:14:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.823+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa0e01579e0 con 0x7fa0e00c4960 2023-12-08T08:14:42.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.910+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4", "id": 3} v 0) v1 -- 0x7fa0e00673e0 con 0x7fa0e00c4960 2023-12-08T08:14:42.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.918+0000 7fa0d6ffd640 1 -- 172.21.15.114:0/3212951150 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0d0017070 con 0x7fa0e00c4960 2023-12-08T08:14:42.921 INFO:teuthology.orchestra.run.smithi114.stdout:3 2023-12-08T08:14:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 msgr2=0x7fa0e0157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 0x7fa0e0157cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c700 tx=0x7fa0d000cbc0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 shutdown_connections 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e014ae10 0x7fa0e00bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0e00c4960 0x7fa0e0157cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 --2- 172.21.15.114:0/3212951150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0e00c4520 0x7fa0e01e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 >> 172.21.15.114:0/3212951150 conn(0x7fa0e00ab730 msgr2=0x7fa0e00aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 shutdown_connections 2023-12-08T08:14:42.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:42.919+0000 7fa0e7409640 1 -- 172.21.15.114:0/3212951150 wait complete. 2023-12-08T08:14:42.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 7c27b34e-7830-48a0-b421-1b486bdd118e 4 2023-12-08T08:14:43.017 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.015+0000 7f4e87e16040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-08T08:14:43.068 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.065+0000 7f60a477f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-08T08:14:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.116+0000 7fee61e97640 1 Processor -- start 2023-12-08T08:14:43.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.116+0000 7fee61e97640 1 -- start start 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee61e97640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee61e97640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0c51d0 con 0x7fee5c0c7490 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee61e97640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c1553c0 con 0x7fee5c0c7eb0 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee61e97640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c5880 con 0x7fee5c14e580 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee5b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee5b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:37726/0 (socket says 172.21.15.114:37726) 2023-12-08T08:14:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee5b7fe640 1 -- 172.21.15.114:0/800340327 learned_addr learned my addr 172.21.15.114:0/800340327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee5b7fe640 1 -- 172.21.15.114:0/800340327 >> v1:172.21.15.114:6789/0 conn(0x7fee5c0c7eb0 legacy=0x7fee5c15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.119+0000 7fee5b7fe640 1 -- 172.21.15.114:0/800340327 >> v1:172.21.15.45:6789/0 conn(0x7fee5c0c7490 legacy=0x7fee5c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.118+0000 7fee5affd640 1 -- 172.21.15.114:0/800340327 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369423821 0 0) 0x7fee5c1553c0 con 0x7fee5c0c7eb0 2023-12-08T08:14:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.119+0000 7fee5b7fe640 1 -- 172.21.15.114:0/800340327 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0c69b0 con 0x7fee5c14e580 2023-12-08T08:14:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.120+0000 7fee5b7fe640 1 --2- 172.21.15.114:0/800340327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0098a0 tx=0x7fee4c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae17115820a041f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.120+0000 7fee5affd640 1 -- 172.21.15.114:0/800340327 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c031640 con 0x7fee5c14e580 2023-12-08T08:14:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.120+0000 7fee5affd640 1 -- 172.21.15.114:0/800340327 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c0317a0 con 0x7fee5c14e580 2023-12-08T08:14:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.120+0000 7fee5affd640 1 -- 172.21.15.114:0/800340327 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c031b30 con 0x7fee5c14e580 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 -- 172.21.15.114:0/800340327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 msgr2=0x7fee5c0c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 --2- 172.21.15.114:0/800340327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0098a0 tx=0x7fee4c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 -- 172.21.15.114:0/800340327 shutdown_connections 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 --2- 172.21.15.114:0/800340327 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c14e580 0x7fee5c0c4c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 -- 172.21.15.114:0/800340327 >> 172.21.15.114:0/800340327 conn(0x7fee5c0ab920 msgr2=0x7fee5c0abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 -- 172.21.15.114:0/800340327 shutdown_connections 2023-12-08T08:14:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.121+0000 7fee61e97640 1 -- 172.21.15.114:0/800340327 wait complete. 2023-12-08T08:14:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.123+0000 7fee61e97640 1 Processor -- start 2023-12-08T08:14:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.123+0000 7fee61e97640 1 -- start start 2023-12-08T08:14:43.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c0c7eb0 0x7fee5c0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee5c14e580 0x7fee5c0c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c2da0 con 0x7fee5c0c7eb0 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1563d0 con 0x7fee5c14e580 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee61e97640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c156900 con 0x7fee5c0c7490 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.114:37730/0 (socket says 172.21.15.114:37730) 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 -- 172.21.15.114:0/1821206480 learned_addr learned my addr 172.21.15.114:0/1821206480 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5bfff640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee5c14e580 0x7fee5c0c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee53fff640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c0c7eb0 0x7fee5c0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 -- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee5c14e580 msgr2=0x7fee5c0c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee5c14e580 0x7fee5c0c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 -- 172.21.15.114:0/1821206480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c0c7eb0 msgr2=0x7fee5c0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c0c7eb0 0x7fee5c0c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.124+0000 7fee5b7fe640 1 -- 172.21.15.114:0/1821206480 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0094d0 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee5b7fe640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee4c000c00 tx=0x7fee4c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c031ea0 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c03ac80 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0443f0 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c147080 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c0c1080 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee4c02f050 con 0x7fee5c0c7490 2023-12-08T08:14:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.125+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fee4c044d60 con 0x7fee5c0c7490 2023-12-08T08:14:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.126+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c0c8460 con 0x7fee5c0c7490 2023-12-08T08:14:43.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.131+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fee4c035020 con 0x7fee5c0c7490 2023-12-08T08:14:43.186 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.183+0000 7f4e87e16040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:14:43.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.208+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c27b34e-7830-48a0-b421-1b486bdd118e", "id": 4} v 0) v1 -- 0x7fee5c074670 con 0x7fee5c0c7490 2023-12-08T08:14:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.216+0000 7fee58ff9640 1 -- 172.21.15.114:0/1821206480 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c27b34e-7830-48a0-b421-1b486bdd118e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee4c02d040 con 0x7fee5c0c7490 2023-12-08T08:14:43.219 INFO:teuthology.orchestra.run.smithi114.stdout:4 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 msgr2=0x7fee5c0c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee4c000c00 tx=0x7fee4c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 shutdown_connections 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee5c14e580 0x7fee5c0c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c0c7eb0 0x7fee5c0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 --2- 172.21.15.114:0/1821206480 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0c7490 0x7fee5c0c3360 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.217+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 >> 172.21.15.114:0/1821206480 conn(0x7fee5c0ab920 msgr2=0x7fee5c149df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.218+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 shutdown_connections 2023-12-08T08:14:43.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.218+0000 7fee61e97640 1 -- 172.21.15.114:0/1821206480 wait complete. 2023-12-08T08:14:43.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 392cd1c2-94e7-4711-9810-3df34267722d 5 2023-12-08T08:14:43.247 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.245+0000 7f60a477f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:14:43.327 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.323+0000 7f4e87e16040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:14:43.382 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.379+0000 7f4e87e16040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:14:43.387 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.384+0000 7f60a477f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:14:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.425+0000 7f1684b47640 1 Processor -- start 2023-12-08T08:14:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.426+0000 7f1684b47640 1 -- start start 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1680151ad0 0x7f16800ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1680157a20 0x7f1680154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16800ca610 0x7f1680154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16800c56a0 con 0x7f1680157a20 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1680151eb0 con 0x7f1680151ad0 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f1684b47640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800c80d0 con 0x7f16800ca610 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f167f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1680151ad0 0x7f16800ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f167f7fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1680151ad0 0x7f16800ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56562/0 (socket says 172.21.15.114:56562) 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f167ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16800ca610 0x7f1680154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.427+0000 7f167f7fe640 1 -- 172.21.15.114:0/1676597285 learned_addr learned my addr 172.21.15.114:0/1676597285 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f1677fff640 1 --2- 172.21.15.114:0/1676597285 >> v2:172.21.15.45:3300/0 conn(0x7f1680157a20 0x7f1680154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f167f7fe640 1 -- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16800ca610 msgr2=0x7f1680154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f167f7fe640 1 --2- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16800ca610 0x7f1680154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f167f7fe640 1 -- 172.21.15.114:0/1676597285 >> v2:172.21.15.45:3300/0 conn(0x7f1680157a20 msgr2=0x7f1680154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f167f7fe640 1 --2- 172.21.15.114:0/1676597285 >> v2:172.21.15.45:3300/0 conn(0x7f1680157a20 0x7f1680154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.428+0000 7f167f7fe640 1 -- 172.21.15.114:0/1676597285 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680154430 con 0x7f1680151ad0 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.429+0000 7f167f7fe640 1 --2- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1680151ad0 0x7f16800ca0d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f168006c930 tx=0x7f167002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be3bad4b8857e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.429+0000 7f167effd640 1 -- 172.21.15.114:0/1676597285 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670031870 con 0x7f1680151ad0 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.429+0000 7f167effd640 1 -- 172.21.15.114:0/1676597285 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16700319d0 con 0x7f1680151ad0 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.429+0000 7f167effd640 1 -- 172.21.15.114:0/1676597285 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670031d60 con 0x7f1680151ad0 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 -- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1680151ad0 msgr2=0x7f16800ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 --2- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1680151ad0 0x7f16800ca0d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f168006c930 tx=0x7f167002b910 comp rx=0 tx=0).stop 2023-12-08T08:14:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 -- 172.21.15.114:0/1676597285 shutdown_connections 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 --2- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16800ca610 0x7f1680154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 --2- 172.21.15.114:0/1676597285 >> v2:172.21.15.45:3300/0 conn(0x7f1680157a20 0x7f1680154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 --2- 172.21.15.114:0/1676597285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1680151ad0 0x7f16800ca0d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 -- 172.21.15.114:0/1676597285 >> 172.21.15.114:0/1676597285 conn(0x7f1680066610 msgr2=0x7f1680066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 -- 172.21.15.114:0/1676597285 shutdown_connections 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.430+0000 7f1684b47640 1 -- 172.21.15.114:0/1676597285 wait complete. 2023-12-08T08:14:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.432+0000 7f1684b47640 1 Processor -- start 2023-12-08T08:14:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.432+0000 7f1684b47640 1 -- start start 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1680151ad0 0x7f16800ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1680157a20 0x7f16801462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800ac5a0 con 0x7f1680151ad0 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168014cca0 con 0x7f16800ca610 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1684b47640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800abd00 con 0x7f1680157a20 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1680157a20 0x7f16801462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56570/0 (socket says 172.21.15.114:56570) 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 -- 172.21.15.114:0/2603893303 learned_addr learned my addr 172.21.15.114:0/2603893303 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f1677fff640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1680151ad0 0x7f16800ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 -- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1680157a20 msgr2=0x7f16801462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1680157a20 0x7f16801462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 -- 172.21.15.114:0/2603893303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1680151ad0 msgr2=0x7f16800ab490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1680151ad0 0x7f16800ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.433+0000 7f167f7fe640 1 -- 172.21.15.114:0/2603893303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700094d0 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167f7fe640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16700097c0 tx=0x7f16700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167003abe0 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167003ad40 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16800abfe0 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670044630 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16800a9e30 con 0x7f16800ca610 2023-12-08T08:14:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1670044a90 con 0x7f16800ca610 2023-12-08T08:14:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.434+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f167002d040 con 0x7f16800ca610 2023-12-08T08:14:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.435+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168014ee00 con 0x7f16800ca610 2023-12-08T08:14:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.437+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1670035020 con 0x7f16800ca610 2023-12-08T08:14:43.444 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.441+0000 7f60a477f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:14:43.497 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.494+0000 7f4e87e16040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:14:43.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.515+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "392cd1c2-94e7-4711-9810-3df34267722d", "id": 5} v 0) v1 -- 0x7f16800c7a40 con 0x7f16800ca610 2023-12-08T08:14:43.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.523+0000 7f167cff9640 1 -- 172.21.15.114:0/2603893303 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "392cd1c2-94e7-4711-9810-3df34267722d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f167004d450 con 0x7f16800ca610 2023-12-08T08:14:43.526 INFO:teuthology.orchestra.run.smithi114.stdout:5 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 msgr2=0x7f16800a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16700097c0 tx=0x7f16700046c0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 shutdown_connections 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1680157a20 0x7f16801462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1680151ad0 0x7f16800ab490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 --2- 172.21.15.114:0/2603893303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16800ca610 0x7f16800a98f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 >> 172.21.15.114:0/2603893303 conn(0x7f1680066610 msgr2=0x7f1680152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 shutdown_connections 2023-12-08T08:14:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.524+0000 7f1684b47640 1 -- 172.21.15.114:0/2603893303 wait complete. 2023-12-08T08:14:43.543 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new e692ef1c-8c64-4bfa-a34a-8142b8cb1f12 6 2023-12-08T08:14:43.561 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.558+0000 7f60a477f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:14:43.613 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.610+0000 7f4e87e16040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:14:43.678 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.675+0000 7f60a477f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:14:43.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.753+0000 7f7a414b4640 1 Processor -- start 2023-12-08T08:14:43.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.753+0000 7f7a414b4640 1 -- start start 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.754+0000 7f7a414b4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.754+0000 7f7a414b4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c0ca610 0x7f7a3c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.754+0000 7f7a414b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3c151eb0 con 0x7f7a3c157a20 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.754+0000 7f7a414b4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0c56a0 con 0x7f7a3c151ad0 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.754+0000 7f7a414b4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0c80d0 con 0x7f7a3c0ca610 2023-12-08T08:14:43.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56574/0 (socket says 172.21.15.114:56574) 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 -- 172.21.15.114:0/2154522947 learned_addr learned my addr 172.21.15.114:0/2154522947 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a40cb3640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c0ca610 0x7f7a3c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 -- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c0ca610 msgr2=0x7f7a3c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c0ca610 0x7f7a3c155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 -- 172.21.15.114:0/2154522947 >> v1:172.21.15.114:6789/0 conn(0x7f7a3c157a20 legacy=0x7f7a3c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.755+0000 7f7a3bfff640 1 -- 172.21.15.114:0/2154522947 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c154430 con 0x7f7a3c151ad0 2023-12-08T08:14:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.756+0000 7f7a3bfff640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c154620 tx=0x7f7a2c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d97fce9545bfe99 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.756+0000 7f7a3affd640 1 -- 172.21.15.114:0/2154522947 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c030840 con 0x7f7a3c151ad0 2023-12-08T08:14:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.756+0000 7f7a3affd640 1 -- 172.21.15.114:0/2154522947 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0309a0 con 0x7f7a3c151ad0 2023-12-08T08:14:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a3affd640 1 -- 172.21.15.114:0/2154522947 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c030d30 con 0x7f7a3c151ad0 2023-12-08T08:14:43.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 -- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c151ad0 msgr2=0x7f7a3c0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c154620 tx=0x7f7a2c02b980 comp rx=0 tx=0).stop 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 -- 172.21.15.114:0/2154522947 shutdown_connections 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c0ca610 0x7f7a3c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2154522947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c151ad0 0x7f7a3c0ca0d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 -- 172.21.15.114:0/2154522947 >> 172.21.15.114:0/2154522947 conn(0x7f7a3c066610 msgr2=0x7f7a3c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 -- 172.21.15.114:0/2154522947 shutdown_connections 2023-12-08T08:14:43.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.757+0000 7f7a414b4640 1 -- 172.21.15.114:0/2154522947 wait complete. 2023-12-08T08:14:43.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.759+0000 7f7a414b4640 1 Processor -- start 2023-12-08T08:14:43.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.759+0000 7f7a414b4640 1 -- start start 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 0x7f7a3c1ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c151ad0 0x7f7a3c1e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0ac8d0 con 0x7f7a3c0ca610 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c1edd30 con 0x7f7a3c157a20 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a414b4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c150170 con 0x7f7a3c151ad0 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a40cb3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a40cb3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56576/0 (socket says 172.21.15.114:56576) 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a40cb3640 1 -- 172.21.15.114:0/2074582993 learned_addr learned my addr 172.21.15.114:0/2074582993 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.760+0000 7f7a3b7fe640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c151ad0 0x7f7a3c1e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a3bfff640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 0x7f7a3c1ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:43.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 -- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c151ad0 msgr2=0x7f7a3c1e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c151ad0 0x7f7a3c1e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 -- 172.21.15.114:0/2074582993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 msgr2=0x7f7a3c1ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 0x7f7a3c1ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 -- 172.21.15.114:0/2074582993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0094d0 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a3bfff640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 0x7f7a3c1ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a40cb3640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400efc0 tx=0x7f7a3400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34014480 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400f040 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c150710 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34014820 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.761+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c0c1850 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.762+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a34014cc0 con 0x7f7a3c157a20 2023-12-08T08:14:43.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.762+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7a3401d9f0 con 0x7f7a3c157a20 2023-12-08T08:14:43.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.762+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c0743e0 con 0x7f7a3c157a20 2023-12-08T08:14:43.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.765+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7a34018020 con 0x7f7a3c157a20 2023-12-08T08:14:43.781 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.778+0000 7f4e87e16040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:14:43.833 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.830+0000 7f4e87e16040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:14:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.842+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e692ef1c-8c64-4bfa-a34a-8142b8cb1f12", "id": 6} v 0) v1 -- 0x7f7a3c1ede70 con 0x7f7a3c157a20 2023-12-08T08:14:43.845 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.842+0000 7f60a477f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:14:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.848+0000 7f7a38ff9640 1 -- 172.21.15.114:0/2074582993 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e692ef1c-8c64-4bfa-a34a-8142b8cb1f12", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a3401d400 con 0x7f7a3c157a20 2023-12-08T08:14:43.851 INFO:teuthology.orchestra.run.smithi114.stdout:6 2023-12-08T08:14:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 msgr2=0x7f7a3c1e74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400efc0 tx=0x7f7a3400c490 comp rx=0 tx=0).stop 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 shutdown_connections 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a3c151ad0 0x7f7a3c1e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3c157a20 0x7f7a3c1e74b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 --2- 172.21.15.114:0/2074582993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a3c0ca610 0x7f7a3c1ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 >> 172.21.15.114:0/2074582993 conn(0x7f7a3c066610 msgr2=0x7f7a3c149fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 shutdown_connections 2023-12-08T08:14:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:43.849+0000 7f7a414b4640 1 -- 172.21.15.114:0/2074582993 wait complete. 2023-12-08T08:14:43.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new a34a659f-5fa8-468c-9e93-f0fadf7c8c35 7 2023-12-08T08:14:43.899 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:43.896+0000 7f60a477f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:14:43.999 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:43.996+0000 7f4e87e16040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:14:44.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.049+0000 7f76d2467640 1 Processor -- start 2023-12-08T08:14:44.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.050+0000 7f76d2467640 1 -- start start 2023-12-08T08:14:44.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d2467640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76cc0c4960 0x7f76cc0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d2467640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0c4df0 con 0x7f76cc14ae10 2023-12-08T08:14:44.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d2467640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc155050 con 0x7f76cc0c4520 2023-12-08T08:14:44.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d2467640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc154460 con 0x7f76cc0c4960 2023-12-08T08:14:44.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d0c64640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f76cc0c4520 0x7f76cc0c8800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54652/0 (socket says 172.21.15.114:54652) 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d0c64640 1 -- 172.21.15.114:0/3817297470 learned_addr learned my addr 172.21.15.114:0/3817297470 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.051+0000 7f76d1c66640 1 --2- 172.21.15.114:0/3817297470 >> v2:172.21.15.45:3300/0 conn(0x7f76cc0c4960 0x7f76cc0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901321612 0 0) 0x7f76cc155050 con 0x7f76cc0c4520 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b8003520 con 0x7f76cc0c4520 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035324099 0 0) 0x7f76cc0c4df0 con 0x7f76cc14ae10 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc155050 con 0x7f76cc14ae10 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.1 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884409442 0 0) 0x7f76b8003520 con 0x7f76cc0c4520 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76d1c66640 1 -- 172.21.15.114:0/3817297470 >> v1:172.21.15.114:6789/0 conn(0x7f76cc0c4520 legacy=0x7f76cc0c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76d1c66640 1 -- 172.21.15.114:0/3817297470 >> v1:172.21.15.45:6789/0 conn(0x7f76cc14ae10 legacy=0x7f76cc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.052+0000 7f76d1c66640 1 -- 172.21.15.114:0/3817297470 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc154720 con 0x7f76cc0c4960 2023-12-08T08:14:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.054+0000 7f76d1c66640 1 --2- 172.21.15.114:0/3817297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc0c8f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceab71a378b8e83e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.054+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0017f0 con 0x7f76cc0c4960 2023-12-08T08:14:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.054+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c402c8e0 con 0x7f76cc0c4960 2023-12-08T08:14:44.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.054+0000 7f76c3fff640 1 -- 172.21.15.114:0/3817297470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c402cc70 con 0x7f76cc0c4960 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 -- 172.21.15.114:0/3817297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 msgr2=0x7f76cc0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 --2- 172.21.15.114:0/3817297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc0c8f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009d90 tx=0x7f76c402bdb0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 -- 172.21.15.114:0/3817297470 shutdown_connections 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 --2- 172.21.15.114:0/3817297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc0c8f10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 -- 172.21.15.114:0/3817297470 >> 172.21.15.114:0/3817297470 conn(0x7f76cc0ab730 msgr2=0x7f76cc0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:44.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 -- 172.21.15.114:0/3817297470 shutdown_connections 2023-12-08T08:14:44.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.055+0000 7f76d2467640 1 -- 172.21.15.114:0/3817297470 wait complete. 2023-12-08T08:14:44.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.057+0000 7f76d2467640 1 Processor -- start 2023-12-08T08:14:44.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.057+0000 7f76d2467640 1 -- start start 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc1ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 0x7f76cc14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc14c620 con 0x7f76cc0c4960 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc14c900 con 0x7f76cc0c4520 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d2467640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc14cbe0 con 0x7f76cc14ae10 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d1465640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d1c66640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 0x7f76cc14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d1465640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49198/0 (socket says 172.21.15.114:49198) 2023-12-08T08:14:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d1465640 1 -- 172.21.15.114:0/2576987366 learned_addr learned my addr 172.21.15.114:0/2576987366 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d0c64640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc1ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.058+0000 7f76d1465640 1 -- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 msgr2=0x7f76cc14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1465640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 0x7f76cc14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1465640 1 -- 172.21.15.114:0/2576987366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 msgr2=0x7f76cc1ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1465640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc1ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1465640 1 -- 172.21.15.114:0/2576987366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009a70 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1c66640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 0x7f76cc14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d1465640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c430 tx=0x7f76c800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c80052d0 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c8005450 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8003830 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc14cec0 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc1eac90 con 0x7f76cc0c4520 2023-12-08T08:14:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.059+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f76c8003c90 con 0x7f76cc0c4520 2023-12-08T08:14:44.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.060+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f76c8012420 con 0x7f76cc0c4520 2023-12-08T08:14:44.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.060+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc0673e0 con 0x7f76cc0c4520 2023-12-08T08:14:44.066 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:44.062+0000 7f60a477f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:14:44.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.063+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f76c8017070 con 0x7f76cc0c4520 2023-12-08T08:14:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.140+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a34a659f-5fa8-468c-9e93-f0fadf7c8c35", "id": 7} v 0) v1 -- 0x7f76cc0c7aa0 con 0x7f76cc0c4520 2023-12-08T08:14:44.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.150+0000 7f76c1ffb640 1 -- 172.21.15.114:0/2576987366 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a34a659f-5fa8-468c-9e93-f0fadf7c8c35", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76c8011590 con 0x7f76cc0c4520 2023-12-08T08:14:44.153 INFO:teuthology.orchestra.run.smithi114.stdout:7 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 msgr2=0x7f76cc1ec230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c430 tx=0x7f76c800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 shutdown_connections 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76cc14ae10 0x7f76cc14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76cc0c4960 0x7f76cc1ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 --2- 172.21.15.114:0/2576987366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76cc0c4520 0x7f76cc1ec230 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 >> 172.21.15.114:0/2576987366 conn(0x7f76cc0ab730 msgr2=0x7f76cc0aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:44.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 shutdown_connections 2023-12-08T08:14:44.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-12-08T08:14:44.151+0000 7f76d2467640 1 -- 172.21.15.114:0/2576987366 wait complete. 2023-12-08T08:14:44.169 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-08T08:14:44.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-08T08:14:44.178 INFO:tasks.ceph.osd.0:Started 2023-12-08T08:14:44.178 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-08T08:14:44.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-08T08:14:44.187 INFO:tasks.ceph.osd.1:Started 2023-12-08T08:14:44.187 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-08T08:14:44.187 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-08T08:14:44.193 INFO:tasks.ceph.osd.2:Started 2023-12-08T08:14:44.194 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-08T08:14:44.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-08T08:14:44.201 INFO:tasks.ceph.osd.3:Started 2023-12-08T08:14:44.201 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-08T08:14:44.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-08T08:14:44.216 INFO:tasks.ceph.osd.4:Started 2023-12-08T08:14:44.216 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-08T08:14:44.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-08T08:14:44.222 INFO:tasks.ceph.osd.5:Started 2023-12-08T08:14:44.222 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-08T08:14:44.223 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-08T08:14:44.229 INFO:tasks.ceph.osd.6:Started 2023-12-08T08:14:44.229 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-08T08:14:44.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-08T08:14:44.234 INFO:tasks.ceph.osd.7:Started 2023-12-08T08:14:44.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:14:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.460+0000 7f1f9256e640 1 Processor -- start 2023-12-08T08:14:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.461+0000 7f1f9256e640 1 -- start start 2023-12-08T08:14:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f9256e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f8c0a4f30 0x7f1f8c155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f9256e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0c63b0 con 0x7f1f8c0aa2b0 2023-12-08T08:14:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f9256e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0a5380 con 0x7f1f8c154190 2023-12-08T08:14:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f9256e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0a9f20 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f83fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f8c0aa2b0 0x7f1f8c154a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48132/0 (socket says 172.21.15.45:48132) 2023-12-08T08:14:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f83fff640 1 -- 172.21.15.45:0/397943209 learned_addr learned my addr 172.21.15.45:0/397943209 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/397943209 >> v2:172.21.15.45:3300/0 conn(0x7f1f8c0a4f30 0x7f1f8c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198454770 0 0) 0x7f1f8c0c63b0 con 0x7f1f8c0aa2b0 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f78003520 con 0x7f1f8c0aa2b0 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727933801 0 0) 0x7f1f8c0a5380 con 0x7f1f8c154190 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c0c63b0 con 0x7f1f8c154190 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.462+0000 7f1f90b0b640 1 -- 172.21.15.45:0/397943209 >> v1:172.21.15.114:6789/0 conn(0x7f1f8c154190 legacy=0x7f1f8c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.463+0000 7f1f90b0b640 1 -- 172.21.15.45:0/397943209 >> v1:172.21.15.45:6789/0 conn(0x7f1f8c0aa2b0 legacy=0x7f1f8c154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.463+0000 7f1f90b0b640 1 -- 172.21.15.45:0/397943209 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0a9580 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.464+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/397943209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c155130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5146608901bf5c91 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:44.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.464+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8402cc60 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.464+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8402cdc0 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.464+0000 7f1f8b7fe640 1 -- 172.21.15.45:0/397943209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84034660 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 -- 172.21.15.45:0/397943209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0a4f30 msgr2=0x7f1f8c155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 --2- 172.21.15.45:0/397943209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c155130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009d90 tx=0x7f1f8402beb0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 -- 172.21.15.45:0/397943209 shutdown_connections 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 --2- 172.21.15.45:0/397943209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c155130 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 -- 172.21.15.45:0/397943209 >> 172.21.15.45:0/397943209 conn(0x7f1f8c0661f0 msgr2=0x7f1f8c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 -- 172.21.15.45:0/397943209 shutdown_connections 2023-12-08T08:14:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.465+0000 7f1f9256e640 1 -- 172.21.15.45:0/397943209 wait complete. 2023-12-08T08:14:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.467+0000 7f1f9256e640 1 Processor -- start 2023-12-08T08:14:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.467+0000 7f1f9256e640 1 -- start start 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c0bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 0x7f1f8c1ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0bfba0 con 0x7f1f8c0aa2b0 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c1532c0 con 0x7f1f8c0a4f30 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f9256e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0a6350 con 0x7f1f8c154190 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49408/0 (socket says 172.21.15.45:49408) 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f83fff640 1 -- 172.21.15.45:0/1230714800 learned_addr learned my addr 172.21.15.45:0/1230714800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 0x7f1f8c1ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.468+0000 7f1f8bfff640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c0bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 -- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8c0a4f30 msgr2=0x7f1f8c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c0bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 -- 172.21.15.45:0/1230714800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 msgr2=0x7f1f8c0a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 -- 172.21.15.45:0/1230714800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84009a70 con 0x7f1f8c154190 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f83fff640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.469+0000 7f1f90b0b640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 0x7f1f8c1ed170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f84033000 tx=0x7f1f84004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84040650 con 0x7f1f8c154190 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f840407b0 con 0x7f1f8c154190 2023-12-08T08:14:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84040b60 con 0x7f1f8c154190 2023-12-08T08:14:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c0aa6c0 con 0x7f1f8c154190 2023-12-08T08:14:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0bc050 con 0x7f1f8c154190 2023-12-08T08:14:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1f84049400 con 0x7f1f8c154190 2023-12-08T08:14:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.470+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1f84049d80 con 0x7f1f8c154190 2023-12-08T08:14:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.471+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c074600 con 0x7f1f8c154190 2023-12-08T08:14:44.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.475+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1f84067ce0 con 0x7f1f8c154190 2023-12-08T08:14:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.540+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f8c0c0720 con 0x7f1f8c154190 2023-12-08T08:14:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.541+0000 7f1f897fa640 1 -- 172.21.15.45:0/1230714800 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1f84056030 con 0x7f1f8c154190 2023-12-08T08:14:44.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:44.544 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:14:44.143889+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 msgr2=0x7f1f8c1ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 0x7f1f8c1ed170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f84033000 tx=0x7f1f84004a40 comp rx=0 tx=0).stop 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 shutdown_connections 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f8c154190 0x7f1f8c1ed170 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0aa2b0 0x7f1f8c0a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 --2- 172.21.15.45:0/1230714800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8c0a4f30 0x7f1f8c0bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 >> 172.21.15.45:0/1230714800 conn(0x7f1f8c0661f0 msgr2=0x7f1f8c0c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 shutdown_connections 2023-12-08T08:14:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:44.543+0000 7f1f9256e640 1 -- 172.21.15.45:0/1230714800 wait complete. 2023-12-08T08:14:44.561 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-08T08:14:44.562 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-08T08:14:44.897 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-08T08:14:44.894+0000 7fd6f8f4a500 -1 Falling back to public interface 2023-12-08T08:14:44.904 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-08T08:14:44.901+0000 7f5a9968c500 -1 Falling back to public interface 2023-12-08T08:14:44.905 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-08T08:14:44.902+0000 7fbc01e10500 -1 Falling back to public interface 2023-12-08T08:14:44.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-12-08T08:14:44.905+0000 7f197368c500 -1 Falling back to public interface 2023-12-08T08:14:44.909 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-12-08T08:14:44.906+0000 7f3916a15500 -1 Falling back to public interface 2023-12-08T08:14:44.926 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-08T08:14:44.924+0000 7f9b4bf8b500 -1 Falling back to public interface 2023-12-08T08:14:44.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-12-08T08:14:44.932+0000 7f154521a500 -1 Falling back to public interface 2023-12-08T08:14:44.943 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-12-08T08:14:44.940+0000 7f3818d10500 -1 Falling back to public interface 2023-12-08T08:14:45.164 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:45.161+0000 7f4e87e16040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:14:45.205 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:45.202+0000 7f60a477f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:14:45.368 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:14:45.484 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:45.481+0000 7f4e87e16040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:14:45.510 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:45.507+0000 7f60a477f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:14:45.547 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.544+0000 7f2b384e7640 1 Processor -- start 2023-12-08T08:14:45.547 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.544+0000 7f2b384e7640 1 -- start start 2023-12-08T08:14:45.547 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f4e87e16040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f2b384e7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 0x7f2b300ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f2b384e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b301581c0 0x7f2b301585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f2b384e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300c4880 con 0x7f2b3014e800 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f2b384e7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b30158b30 con 0x7f2b301581c0 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.545+0000 7f2b384e7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300c4b60 con 0x7f2b300ca0e0 2023-12-08T08:14:45.549 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b301581c0 0x7f2b301585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:45.550 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b35a82640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 0x7f2b300ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:45.550 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b301581c0 0x7f2b301585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35832/0 (socket says 172.21.15.45:35832) 2023-12-08T08:14:45.550 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 -- 172.21.15.45:0/2363214207 learned_addr learned my addr 172.21.15.45:0/2363214207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:45.550 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 -- 172.21.15.45:0/2363214207 >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 msgr2=0x7f2b300ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:45.550 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 --2- 172.21.15.45:0/2363214207 >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 0x7f2b300ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.551 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 -- 172.21.15.45:0/2363214207 >> v1:172.21.15.114:6789/0 conn(0x7f2b3014e800 legacy=0x7f2b30155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:45.551 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b36a84640 1 -- 172.21.15.45:0/2363214207 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300c4e40 con 0x7f2b301581c0 2023-12-08T08:14:45.551 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b35281640 1 -- 172.21.15.45:0/2363214207 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319037392 0 0) 0x7f2b300c4880 con 0x7f2b3014e800 2023-12-08T08:14:45.551 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.546+0000 7f2b35a82640 1 --2- 172.21.15.45:0/2363214207 >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 0x7f2b300ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:14:45.553 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.547+0000 7f2b36a84640 1 --2- 172.21.15.45:0/2363214207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b301581c0 0x7f2b301585f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b300c78a0 tx=0x7f2b2802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da766f71c146fd88 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:45.553 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b35281640 1 -- 172.21.15.45:0/2363214207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2802c9f0 con 0x7f2b301581c0 2023-12-08T08:14:45.553 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b35281640 1 -- 172.21.15.45:0/2363214207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2802cb50 con 0x7f2b301581c0 2023-12-08T08:14:45.553 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b35281640 1 -- 172.21.15.45:0/2363214207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280343f0 con 0x7f2b301581c0 2023-12-08T08:14:45.553 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 -- 172.21.15.45:0/2363214207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b301581c0 msgr2=0x7f2b301585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 --2- 172.21.15.45:0/2363214207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b301581c0 0x7f2b301585f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b300c78a0 tx=0x7f2b2802be50 comp rx=0 tx=0).stop 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 -- 172.21.15.45:0/2363214207 shutdown_connections 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 --2- 172.21.15.45:0/2363214207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b301581c0 0x7f2b301585f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 --2- 172.21.15.45:0/2363214207 >> v2:172.21.15.114:3300/0 conn(0x7f2b300ca0e0 0x7f2b300ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 -- 172.21.15.45:0/2363214207 >> 172.21.15.45:0/2363214207 conn(0x7f2b300663d0 msgr2=0x7f2b300667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:45.554 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 -- 172.21.15.45:0/2363214207 shutdown_connections 2023-12-08T08:14:45.555 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.548+0000 7f2b384e7640 1 -- 172.21.15.45:0/2363214207 wait complete. 2023-12-08T08:14:45.555 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.550+0000 7f2b384e7640 1 Processor -- start 2023-12-08T08:14:45.555 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.550+0000 7f2b384e7640 1 -- start start 2023-12-08T08:14:45.558 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b300ca0e0 0x7f2b30151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b301581c0 0x7f2b300a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c06b0 con 0x7f2b3014e800 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300ab960 con 0x7f2b301581c0 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b384e7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300abc40 con 0x7f2b300ca0e0 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b35a82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b35a82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35840/0 (socket says 172.21.15.45:35840) 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b35a82640 1 -- 172.21.15.45:0/3784903463 learned_addr learned my addr 172.21.15.45:0/3784903463 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b36a84640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b301581c0 0x7f2b300a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.551+0000 7f2b36283640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b300ca0e0 0x7f2b30151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:45.559 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 -- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b300ca0e0 msgr2=0x7f2b30151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b300ca0e0 0x7f2b30151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 -- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b301581c0 msgr2=0x7f2b300a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b301581c0 0x7f2b300a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 -- 172.21.15.45:0/3784903463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20009400 con 0x7f2b3014e800 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b35a82640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000e960 tx=0x7f2b2000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000ca00 con 0x7f2b3014e800 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000cb60 con 0x7f2b3014e800 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20013470 con 0x7f2b3014e800 2023-12-08T08:14:45.560 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b28009b30 con 0x7f2b3014e800 2023-12-08T08:14:45.561 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.552+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b30157540 con 0x7f2b3014e800 2023-12-08T08:14:45.561 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.553+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b20005c90 con 0x7f2b3014e800 2023-12-08T08:14:45.561 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.553+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2b20013ca0 con 0x7f2b3014e800 2023-12-08T08:14:45.561 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.553+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b300ac160 con 0x7f2b3014e800 2023-12-08T08:14:45.561 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.556+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2b300ac160 con 0x7f2b3014e800 2023-12-08T08:14:45.571 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:45.568+0000 7f60a477f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:14:45.626 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.623+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b300c7e50 con 0x7f2b3014e800 2023-12-08T08:14:45.627 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.624+0000 7f2b26ffd640 1 -- 172.21.15.45:0/3784903463 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2b20021060 con 0x7f2b3014e800 2023-12-08T08:14:45.627 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-08T08:14:45.628 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:14:44.143889+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:14:45.629 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 msgr2=0x7f2b301567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:45.629 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000e960 tx=0x7f2b2000ee20 comp rx=0 tx=0).stop 2023-12-08T08:14:45.629 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 shutdown_connections 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b301581c0 0x7f2b300a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3014e800 0x7f2b301567f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 --2- 172.21.15.45:0/3784903463 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b300ca0e0 0x7f2b30151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 >> 172.21.15.45:0/3784903463 conn(0x7f2b300663d0 msgr2=0x7f2b300c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 shutdown_connections 2023-12-08T08:14:45.630 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:45.626+0000 7f2b384e7640 1 -- 172.21.15.45:0/3784903463 wait complete. 2023-12-08T08:14:45.642 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T08:14:45.670 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:45.667+0000 7f4e87e16040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:14:45.687 INFO:tasks.ceph.mgr.x.smithi114.stderr:2023-12-08T08:14:45.684+0000 7f60a477f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:14:46.715 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:46.712+0000 7f4e28d15640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-08T08:14:46.716 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-08T08:14:46.713+0000 7f4e28d15640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-08T08:14:47.762 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-12-08T08:14:47.759+0000 7f154521a500 -1 osd.5 0 log_to_monitors true 2023-12-08T08:14:48.448 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-08T08:14:48.445+0000 7fbc01e10500 -1 osd.2 0 log_to_monitors true 2023-12-08T08:14:48.454 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-12-08T08:14:48.452+0000 7f197368c500 -1 osd.7 0 log_to_monitors true 2023-12-08T08:14:48.490 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-08T08:14:48.487+0000 7f9b4bf8b500 -1 osd.3 0 log_to_monitors true 2023-12-08T08:14:48.495 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-12-08T08:14:48.492+0000 7f3916a15500 -1 osd.6 0 log_to_monitors true 2023-12-08T08:14:48.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-12-08T08:14:48.510+0000 7f3818d10500 -1 osd.4 0 log_to_monitors true 2023-12-08T08:14:48.687 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-08T08:14:48.685+0000 7fd6f8f4a500 -1 osd.0 0 log_to_monitors true 2023-12-08T08:14:48.720 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-08T08:14:48.717+0000 7f5a9968c500 -1 osd.1 0 log_to_monitors true 2023-12-08T08:14:51.236 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-08T08:14:51.233+0000 7f9b47f19640 -1 osd.3 0 waiting for initial osdmap 2023-12-08T08:14:51.244 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-08T08:14:51.241+0000 7f9b3fd40640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:51.249 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-08T08:14:51.247+0000 7fbbfd7a9640 -1 osd.2 0 waiting for initial osdmap 2023-12-08T08:14:51.263 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-08T08:14:51.261+0000 7fd6f56ee640 -1 osd.0 0 waiting for initial osdmap 2023-12-08T08:14:51.268 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-08T08:14:51.266+0000 7fd6ecd01640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:51.269 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-08T08:14:51.267+0000 7fbbf55d0640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:51.892 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-08T08:14:51.889+0000 7f5a9561c640 -1 osd.1 0 waiting for initial osdmap 2023-12-08T08:14:51.901 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-08T08:14:51.898+0000 7f5a8d443640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:52.065 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-12-08T08:14:52.062+0000 7f391235a640 -1 osd.6 0 waiting for initial osdmap 2023-12-08T08:14:52.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2023-12-08T08:14:52.075+0000 7f390a181640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:52.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-12-08T08:14:52.126+0000 7f196f61c640 -1 osd.7 0 waiting for initial osdmap 2023-12-08T08:14:52.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2023-12-08T08:14:52.139+0000 7f1967443640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:52.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-12-08T08:14:52.143+0000 7f38154b2640 -1 osd.4 0 waiting for initial osdmap 2023-12-08T08:14:52.156 INFO:tasks.ceph.osd.4.smithi114.stderr:2023-12-08T08:14:52.153+0000 7f380cac5640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:52.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-12-08T08:14:52.172+0000 7f1540c7d640 -1 osd.5 0 waiting for initial osdmap 2023-12-08T08:14:52.184 INFO:tasks.ceph.osd.5.smithi114.stderr:2023-12-08T08:14:52.181+0000 7f1538aa4640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:14:52.447 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:14:52.642 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.639+0000 7f23a8ec3640 1 Processor -- start 2023-12-08T08:14:52.642 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.639+0000 7f23a8ec3640 1 -- start start 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a8ec3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a40a7910 0x7f23a40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a8ec3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23a40c1dc0 0x7f23a414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a8ec3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a4155850 con 0x7f23a41521b0 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a8ec3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40c0890 con 0x7f23a40c1dc0 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a8ec3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40c0b70 con 0x7f23a40a7910 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23a40c1dc0 0x7f23a414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:52.644 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23a40c1dc0 0x7f23a414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35936/0 (socket says 172.21.15.45:35936) 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.641+0000 7f23a2ffd640 1 -- 172.21.15.45:0/2746640025 learned_addr learned my addr 172.21.15.45:0/2746640025 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.642+0000 7f23a37fe640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a40a7910 0x7f23a40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.642+0000 7f23a2ffd640 1 -- 172.21.15.45:0/2746640025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a40a7910 msgr2=0x7f23a40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.642+0000 7f23a2ffd640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a40a7910 0x7f23a40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.642+0000 7f23a2ffd640 1 -- 172.21.15.45:0/2746640025 >> v1:172.21.15.114:6789/0 conn(0x7f23a41521b0 legacy=0x7f23a4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.642+0000 7f23a2ffd640 1 -- 172.21.15.45:0/2746640025 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40c0e50 con 0x7f23a40c1dc0 2023-12-08T08:14:52.645 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.643+0000 7f23a2ffd640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40c1dc0 0x7f23a414f5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb95992f66a4f78c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:52.646 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.643+0000 7f23a27fc640 1 -- 172.21.15.45:0/2746640025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980317c0 con 0x7f23a40c1dc0 2023-12-08T08:14:52.646 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.643+0000 7f23a27fc640 1 -- 172.21.15.45:0/2746640025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398031920 con 0x7f23a40c1dc0 2023-12-08T08:14:52.646 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.643+0000 7f23a27fc640 1 -- 172.21.15.45:0/2746640025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398031cb0 con 0x7f23a40c1dc0 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 -- 172.21.15.45:0/2746640025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40c1dc0 msgr2=0x7f23a414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40c1dc0 0x7f23a414f5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239802b860 comp rx=0 tx=0).stop 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 -- 172.21.15.45:0/2746640025 shutdown_connections 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40c1dc0 0x7f23a414f5e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/2746640025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a40a7910 0x7f23a40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 -- 172.21.15.45:0/2746640025 >> 172.21.15.45:0/2746640025 conn(0x7f23a40c5780 msgr2=0x7f23a40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 -- 172.21.15.45:0/2746640025 shutdown_connections 2023-12-08T08:14:52.647 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.644+0000 7f23a8ec3640 1 -- 172.21.15.45:0/2746640025 wait complete. 2023-12-08T08:14:52.648 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.645+0000 7f23a8ec3640 1 Processor -- start 2023-12-08T08:14:52.648 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 -- start start 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23a40c1dc0 0x7f23a4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a41521b0 0x7f23a4149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41ecbb0 con 0x7f23a40a7910 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41ece90 con 0x7f23a40c1dc0 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.646+0000 7f23a8ec3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41ed170 con 0x7f23a41521b0 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35938/0 (socket says 172.21.15.45:35938) 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 -- 172.21.15.45:0/1047641087 learned_addr learned my addr 172.21.15.45:0/1047641087 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 -- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a41521b0 msgr2=0x7f23a4149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:52.650 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a41521b0 0x7f23a4149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.651 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 -- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23a40c1dc0 msgr2=0x7f23a4154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:52.651 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23a40c1dc0 0x7f23a4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.651 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 -- 172.21.15.45:0/1047641087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23980094d0 con 0x7f23a40a7910 2023-12-08T08:14:52.651 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.647+0000 7f23a37fe640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f239400d800 tx=0x7f239400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.648+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239400b6c0 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.648+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239400b820 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.648+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239400bbb0 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.648+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a41ed450 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.648+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a4154790 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.649+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40743e0 con 0x7f23a40a7910 2023-12-08T08:14:52.652 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.650+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f239400bd10 con 0x7f23a40a7910 2023-12-08T08:14:52.654 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.651+0000 7f238bfff640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 0x7f239006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:52.654 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.651+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2394089570 con 0x7f23a40a7910 2023-12-08T08:14:52.654 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.651+0000 7f23a2ffd640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 0x7f239006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:52.654 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.652+0000 7f23a2ffd640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 0x7f239006d2a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2398036000 tx=0x7f2398030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:52.659 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.656+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2394054bc0 con 0x7f23a40a7910 2023-12-08T08:14:52.861 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.858+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23a414dcb0 con 0x7f23a40a7910 2023-12-08T08:14:52.862 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.860+0000 7f238bfff640 1 -- 172.21.15.45:0/1047641087 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10884 (secure 0 0 0) 0x7f23940581e0 con 0x7f23a40a7910 2023-12-08T08:14:52.863 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-08T08:14:52.863 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":14,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:14:52.229994+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:14:52.865 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.862+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 msgr2=0x7f239006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:52.865 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.862+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 0x7f239006d2a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2398036000 tx=0x7f2398030000 comp rx=0 tx=0).stop 2023-12-08T08:14:52.865 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.862+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 msgr2=0x7f23a41e9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.862+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f239400d800 tx=0x7f239400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 shutdown_connections 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f239006ade0 0x7f239006d2a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f23a41521b0 0x7f23a4149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23a40c1dc0 0x7f23a4154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 --2- 172.21.15.45:0/1047641087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a40a7910 0x7f23a41e9490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 >> 172.21.15.45:0/1047641087 conn(0x7f23a40c5780 msgr2=0x7f23a40c21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 shutdown_connections 2023-12-08T08:14:52.866 INFO:teuthology.misc.health.smithi045.stderr:2023-12-08T08:14:52.863+0000 7f23a8ec3640 1 -- 172.21.15.45:0/1047641087 wait complete. 2023-12-08T08:14:52.880 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-08T08:14:52.880 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-08T08:14:52.880 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:14:52.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:14:52.889 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:14:52.890 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:14:52.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:14:52.897 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:14:52.898 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:14:52.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:14:52.910 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:14:52.910 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:14:52.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:14:52.919 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:14:52.919 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-08T08:14:52.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:14:53.048 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:14:53.050 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:14:53.072 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-12-08T08:14:53.073 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:14:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.111+0000 7f7d08be2640 1 Processor -- start 2023-12-08T08:14:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.111+0000 7f7d08be2640 1 -- start start 2023-12-08T08:14:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.113+0000 7f7d08be2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d040c44d0 0x7f7d041584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.113+0000 7f7d08be2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d040c4a00 con 0x7f7d040c7a50 2023-12-08T08:14:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.113+0000 7f7d08be2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d040c4ce0 con 0x7f7d041519c0 2023-12-08T08:14:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.113+0000 7f7d08be2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d041579e0 con 0x7f7d040c44d0 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d02ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d040c44d0 0x7f7d041584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d03fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d040c7a50 0x7f7d040ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41906/0 (socket says 172.21.15.45:41906) 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d03fff640 1 -- 172.21.15.45:0/178713202 learned_addr learned my addr 172.21.15.45:0/178713202 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d02ffd640 1 -- 172.21.15.45:0/178713202 >> v1:172.21.15.114:6789/0 conn(0x7f7d041519c0 legacy=0x7f7d04154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d027fc640 1 -- 172.21.15.45:0/178713202 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950864355 0 0) 0x7f7d040c4ce0 con 0x7f7d041519c0 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d02ffd640 1 -- 172.21.15.45:0/178713202 >> v1:172.21.15.45:6789/0 conn(0x7f7d040c7a50 legacy=0x7f7d040ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.114+0000 7f7d02ffd640 1 -- 172.21.15.45:0/178713202 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04157cc0 con 0x7f7d040c44d0 2023-12-08T08:14:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.115+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/178713202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041584c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9d932707dc3c86 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d027fc640 1 -- 172.21.15.45:0/178713202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec02e070 con 0x7f7d040c44d0 2023-12-08T08:14:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d027fc640 1 -- 172.21.15.45:0/178713202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec0315a0 con 0x7f7d040c44d0 2023-12-08T08:14:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d027fc640 1 -- 172.21.15.45:0/178713202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec031930 con 0x7f7d040c44d0 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 -- 172.21.15.45:0/178713202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 msgr2=0x7f7d041584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 --2- 172.21.15.45:0/178713202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041584c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02b840 comp rx=0 tx=0).stop 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 -- 172.21.15.45:0/178713202 shutdown_connections 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 --2- 172.21.15.45:0/178713202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041584c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 -- 172.21.15.45:0/178713202 >> 172.21.15.45:0/178713202 conn(0x7f7d040661f0 msgr2=0x7f7d04066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.116+0000 7f7d08be2640 1 -- 172.21.15.45:0/178713202 shutdown_connections 2023-12-08T08:14:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.117+0000 7f7d08be2640 1 -- 172.21.15.45:0/178713202 wait complete. 2023-12-08T08:14:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.118+0000 7f7d08be2640 1 Processor -- start 2023-12-08T08:14:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.119+0000 7f7d08be2640 1 -- start start 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.119+0000 7f7d08be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.119+0000 7f7d08be2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d040c7a50 0x7f7d0414cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d08be2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d041519c0 0x7f7d0414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d08be2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0414c620 con 0x7f7d040c44d0 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d08be2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040af7f0 con 0x7f7d041519c0 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d08be2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041eda00 con 0x7f7d040c7a50 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35980/0 (socket says 172.21.15.45:35980) 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 -- 172.21.15.45:0/2145854882 learned_addr learned my addr 172.21.15.45:0/2145854882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d03fff640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d041519c0 0x7f7d0414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d040c7a50 0x7f7d0414cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 -- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d040c7a50 msgr2=0x7f7d0414cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d040c7a50 0x7f7d0414cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 -- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d041519c0 msgr2=0x7f7d0414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d041519c0 0x7f7d0414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.120+0000 7f7d037fe640 1 -- 172.21.15.45:0/2145854882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec009400 con 0x7f7d040c44d0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7d037fe640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c750 tx=0x7f7cf400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4003da0 con 0x7f7d040c44d0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400ce60 con 0x7f7d040c44d0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40052b0 con 0x7f7d040c44d0 2023-12-08T08:14:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0414c880 con 0x7f7d040c44d0 2023-12-08T08:14:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.121+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0414df00 con 0x7f7d040c44d0 2023-12-08T08:14:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.122+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d041edbc0 con 0x7f7d040c44d0 2023-12-08T08:14:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.124+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f7cf4005410 con 0x7f7d040c44d0 2023-12-08T08:14:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.124+0000 7f7cfbfff640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 0x7f7ce406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.125+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f7cf4088ef0 con 0x7f7d040c44d0 2023-12-08T08:14:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.125+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 0x7f7ce406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.126+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 0x7f7ce406d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cec036000 tx=0x7f7cec03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.129+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cf4054540 con 0x7f7d040c44d0 2023-12-08T08:14:53.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.335+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0414ca70 con 0x7f7d040c44d0 2023-12-08T08:14:53.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.336+0000 7f7cfbfff640 1 -- 172.21.15.45:0/2145854882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11068 (secure 0 0 0) 0x7f7cf4057b60 con 0x7f7d040c44d0 2023-12-08T08:14:53.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:53.339 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:14:53.233960+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:14:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 msgr2=0x7f7ce406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 0x7f7ce406d270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7cec036000 tx=0x7f7cec03d040 comp rx=0 tx=0).stop 2023-12-08T08:14:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 msgr2=0x7f7d041ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c750 tx=0x7f7cf400cc10 comp rx=0 tx=0).stop 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 shutdown_connections 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ce406adb0 0x7f7ce406d270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d040c7a50 0x7f7d0414cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d041519c0 0x7f7d0414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 --2- 172.21.15.45:0/2145854882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d040c44d0 0x7f7d041ed0e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 >> 172.21.15.45:0/2145854882 conn(0x7f7d040661f0 msgr2=0x7f7d040ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 shutdown_connections 2023-12-08T08:14:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.339+0000 7f7d08be2640 1 -- 172.21.15.45:0/2145854882 wait complete. 2023-12-08T08:14:53.361 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-08T08:14:53.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:14:53.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.579+0000 7fe7d3fff640 1 Processor -- start 2023-12-08T08:14:53.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.579+0000 7fe7d3fff640 1 -- start start 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 0x7fe7d414e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7d414e7a0 0x7fe7d4150e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d3fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d406cae0 con 0x7fe7d40c6e00 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d3fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40c1970 con 0x7fe7d414e7a0 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d3fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40c1c40 con 0x7fe7d406d580 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe7d40c6e00 0x7fe7d40c1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41918/0 (socket says 172.21.15.45:41918) 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d2ffd640 1 -- 172.21.15.45:0/3531182614 learned_addr learned my addr 172.21.15.45:0/3531182614 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d37fe640 1 --2- 172.21.15.45:0/3531182614 >> v2:172.21.15.45:3300/0 conn(0x7fe7d414e7a0 0x7fe7d4150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.581+0000 7fe7d27fc640 1 --2- 172.21.15.45:0/3531182614 >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 0x7fe7d414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d1ffb640 1 -- 172.21.15.45:0/3531182614 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747883066 0 0) 0x7fe7d406cae0 con 0x7fe7d40c6e00 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d1ffb640 1 -- 172.21.15.45:0/3531182614 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc003520 con 0x7fe7d40c6e00 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d37fe640 1 -- 172.21.15.45:0/3531182614 >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 msgr2=0x7fe7d414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d37fe640 1 --2- 172.21.15.45:0/3531182614 >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 0x7fe7d414e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d37fe640 1 -- 172.21.15.45:0/3531182614 >> v1:172.21.15.45:6789/0 conn(0x7fe7d40c6e00 legacy=0x7fe7d40c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d37fe640 1 -- 172.21.15.45:0/3531182614 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d406cd80 con 0x7fe7d414e7a0 2023-12-08T08:14:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.582+0000 7fe7d27fc640 1 --2- 172.21.15.45:0/3531182614 >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 0x7fe7d414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:14:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.583+0000 7fe7d37fe640 1 --2- 172.21.15.45:0/3531182614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d414e7a0 0x7fe7d4150e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40c5d30 tx=0x7fe7cc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a6f397daeb45f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d1ffb640 1 -- 172.21.15.45:0/3531182614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc02cbf0 con 0x7fe7d414e7a0 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d1ffb640 1 -- 172.21.15.45:0/3531182614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc02cd50 con 0x7fe7d414e7a0 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d1ffb640 1 -- 172.21.15.45:0/3531182614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc034640 con 0x7fe7d414e7a0 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3531182614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d414e7a0 msgr2=0x7fe7d4150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3531182614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d414e7a0 0x7fe7d4150e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40c5d30 tx=0x7fe7cc02be40 comp rx=0 tx=0).stop 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3531182614 shutdown_connections 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3531182614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d414e7a0 0x7fe7d4150e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3531182614 >> v2:172.21.15.114:3300/0 conn(0x7fe7d406d580 0x7fe7d414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3531182614 >> 172.21.15.45:0/3531182614 conn(0x7fe7d40a8a00 msgr2=0x7fe7d40a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3531182614 shutdown_connections 2023-12-08T08:14:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.584+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3531182614 wait complete. 2023-12-08T08:14:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.586+0000 7fe7d3fff640 1 Processor -- start 2023-12-08T08:14:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.586+0000 7fe7d3fff640 1 -- start start 2023-12-08T08:14:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d40c6e00 0x7fe7d41ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7d414e7a0 0x7fe7d41ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41da620 con 0x7fe7d406d580 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41e9ea0 con 0x7fe7d40c6e00 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d3fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41ea140 con 0x7fe7d414e7a0 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35998/0 (socket says 172.21.15.45:35998) 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.587+0000 7fe7d2ffd640 1 -- 172.21.15.45:0/3107172235 learned_addr learned my addr 172.21.15.45:0/3107172235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d27fc640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d40c6e00 0x7fe7d41ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d37fe640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7d414e7a0 0x7fe7d41ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 -- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7d414e7a0 msgr2=0x7fe7d41ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7d414e7a0 0x7fe7d41ecd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 -- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d40c6e00 msgr2=0x7fe7d41ec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d40c6e00 0x7fe7d41ec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 -- 172.21.15.45:0/3107172235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009a70 con 0x7fe7d406d580 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7d2ffd640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400c430 tx=0x7fe7c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4005ce0 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4005e40 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.588+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40072f0 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.589+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d41d98c0 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.589+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d41db700 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.590+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d40673e0 con 0x7fe7d406d580 2023-12-08T08:14:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.591+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe7c4007450 con 0x7fe7d406d580 2023-12-08T08:14:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.592+0000 7fe7bbfff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 0x7fe7c006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.592+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe7c40886c0 con 0x7fe7d406d580 2023-12-08T08:14:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.592+0000 7fe7d27fc640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 0x7fe7c006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.593+0000 7fe7d27fc640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 0x7fe7c006d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40c65e0 tx=0x7fe7c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.596+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7c4053d10 con 0x7fe7d406d580 2023-12-08T08:14:53.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.830+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d41db8c0 con 0x7fe7d406d580 2023-12-08T08:14:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.832+0000 7fe7bbfff640 1 -- 172.21.15.45:0/3107172235 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fe7c4017020 con 0x7fe7d406d580 2023-12-08T08:14:53.834 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:53.835 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-08T08:14:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2023-12-08T08:14:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.834+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 msgr2=0x7fe7c006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.834+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 0x7fe7c006d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40c65e0 tx=0x7fe7c8008040 comp rx=0 tx=0).stop 2023-12-08T08:14:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.834+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 msgr2=0x7fe7d406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.834+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400c430 tx=0x7fe7c400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 shutdown_connections 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c006adb0 0x7fe7c006d270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7d414e7a0 0x7fe7d41ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7d40c6e00 0x7fe7d41ec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3107172235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d406d580 0x7fe7d406a730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 >> 172.21.15.45:0/3107172235 conn(0x7fe7d40a8a00 msgr2=0x7fe7d40a6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 shutdown_connections 2023-12-08T08:14:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:53.835+0000 7fe7d3fff640 1 -- 172.21.15.45:0/3107172235 wait complete. 2023-12-08T08:14:55.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:14:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.064+0000 7f5001990640 1 Processor -- start 2023-12-08T08:14:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.064+0000 7f5001990640 1 -- start start 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f5001990640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f5001990640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 0x7f4ffc0c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f5001990640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc158530 con 0x7f4ffc151d20 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f5001990640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc06d800 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f5001990640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc158810 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60768/0 (socket says 172.21.15.45:60768) 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 -- 172.21.15.45:0/3098711285 learned_addr learned my addr 172.21.15.45:0/3098711285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ffb7fe640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 0x7f4ffc0c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 -- 172.21.15.45:0/3098711285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 msgr2=0x7f4ffc0c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 0x7f4ffc0c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 -- 172.21.15.45:0/3098711285 >> v1:172.21.15.45:6789/0 conn(0x7f4ffc151d20 legacy=0x7f4ffc0c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ff3fff640 1 -- 172.21.15.45:0/3098711285 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0bf8d0 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.067+0000 7f4ffb7fe640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 0x7f4ffc0c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:14:56.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.068+0000 7f4ff3fff640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009870 tx=0x7f4fe402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b774b30fbf5fbbff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f4ffa7fc640 1 -- 172.21.15.45:0/3098711285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4031640 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f4ffa7fc640 1 -- 172.21.15.45:0/3098711285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe40317a0 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f4ffa7fc640 1 -- 172.21.15.45:0/3098711285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4031b30 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 -- 172.21.15.45:0/3098711285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0c0db0 msgr2=0x7f4ffc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009870 tx=0x7f4fe402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 -- 172.21.15.45:0/3098711285 shutdown_connections 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0bedd0 0x7f4ffc0c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 --2- 172.21.15.45:0/3098711285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0c0db0 0x7f4ffc06d2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 -- 172.21.15.45:0/3098711285 >> 172.21.15.45:0/3098711285 conn(0x7f4ffc0661f0 msgr2=0x7f4ffc066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.069+0000 7f5001990640 1 -- 172.21.15.45:0/3098711285 shutdown_connections 2023-12-08T08:14:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.070+0000 7f5001990640 1 -- 172.21.15.45:0/3098711285 wait complete. 2023-12-08T08:14:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.071+0000 7f5001990640 1 Processor -- start 2023-12-08T08:14:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.071+0000 7f5001990640 1 -- start start 2023-12-08T08:14:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.072+0000 7f5001990640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.072+0000 7f5001990640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0c0db0 0x7f4ffc0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f5001990640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ffc151d20 0x7f4ffc1ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f5001990640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc070f00 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f5001990640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc070ae0 con 0x7f4ffc151d20 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f5001990640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc1e9cc0 con 0x7f4ffc0c0db0 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60784/0 (socket says 172.21.15.45:60784) 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 -- 172.21.15.45:0/3393350346 learned_addr learned my addr 172.21.15.45:0/3393350346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ff3fff640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0c0db0 0x7f4ffc0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffb7fe640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ffc151d20 0x7f4ffc1ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 -- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0c0db0 msgr2=0x7f4ffc0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0c0db0 0x7f4ffc0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 -- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ffc151d20 msgr2=0x7f4ffc1ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ffc151d20 0x7f4ffc1ea3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.073+0000 7f4ffaffd640 1 -- 172.21.15.45:0/3393350346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40094d0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f4ffaffd640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c430 tx=0x7f4fec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0052d0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec005430 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc0702d0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec003830 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.074+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc14e7f0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.076+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc074600 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.077+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f4fec003990 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.078+0000 7f4ff8ff9640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 0x7f4fdc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.078+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fec088710 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.078+0000 7f4ff3fff640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 0x7f4fdc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.079+0000 7f4ff3fff640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 0x7f4fdc06d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4036000 tx=0x7f4fe403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.084+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fec053bf0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.332+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ffc1516d0 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.333+0000 7f4ff8ff9640 1 -- 172.21.15.45:0/3393350346 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f4fec057210 con 0x7f4ffc0bedd0 2023-12-08T08:14:56.335 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-08T08:14:56.336 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 msgr2=0x7f4fdc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 0x7f4fdc06d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4036000 tx=0x7f4fe403c040 comp rx=0 tx=0).stop 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 msgr2=0x7f4ffc14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c430 tx=0x7f4fec00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 shutdown_connections 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4fdc06adb0 0x7f4fdc06d270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ffc0c0db0 0x7f4ffc0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ffc151d20 0x7f4ffc1ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 --2- 172.21.15.45:0/3393350346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ffc0bedd0 0x7f4ffc14e2b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 >> 172.21.15.45:0/3393350346 conn(0x7f4ffc0661f0 msgr2=0x7f4ffc0a90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 shutdown_connections 2023-12-08T08:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.335+0000 7f5001990640 1 -- 172.21.15.45:0/3393350346 wait complete. 2023-12-08T08:14:56.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:14:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.564+0000 7f1d5041e640 1 Processor -- start 2023-12-08T08:14:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.565+0000 7f1d5041e640 1 -- start start 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d5041e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d480ca560 0x7f1d4815ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d5041e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480c4880 con 0x7f1d480ca0e0 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d5041e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480c4b60 con 0x7f1d4814e800 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d5041e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480ca990 con 0x7f1d480ca560 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d4d9b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d480ca0e0 0x7f1d481581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44396/0 (socket says 172.21.15.45:44396) 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d4d9b9640 1 -- 172.21.15.45:0/1400352631 learned_addr learned my addr 172.21.15.45:0/1400352631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.566+0000 7f1d4e9bb640 1 --2- 172.21.15.45:0/1400352631 >> v2:172.21.15.45:3300/0 conn(0x7f1d480ca560 0x7f1d4815ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.567+0000 7f1d4d1b8640 1 -- 172.21.15.45:0/1400352631 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96936666 0 0) 0x7f1d480c4880 con 0x7f1d480ca0e0 2023-12-08T08:14:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.567+0000 7f1d4d1b8640 1 -- 172.21.15.45:0/1400352631 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d34003520 con 0x7f1d480ca0e0 2023-12-08T08:14:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.567+0000 7f1d4e9bb640 1 -- 172.21.15.45:0/1400352631 >> v1:172.21.15.114:6789/0 conn(0x7f1d4814e800 legacy=0x7f1d48155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.567+0000 7f1d4e9bb640 1 -- 172.21.15.45:0/1400352631 >> v1:172.21.15.45:6789/0 conn(0x7f1d480ca0e0 legacy=0x7f1d481581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.567+0000 7f1d4e9bb640 1 -- 172.21.15.45:0/1400352631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480c4e40 con 0x7f1d480ca560 2023-12-08T08:14:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d4e9bb640 1 --2- 172.21.15.45:0/1400352631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca560 0x7f1d4815ff10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736e8b47ef3bd976 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d4d1b8640 1 -- 172.21.15.45:0/1400352631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4002cb40 con 0x7f1d480ca560 2023-12-08T08:14:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d4d1b8640 1 -- 172.21.15.45:0/1400352631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4002cca0 con 0x7f1d480ca560 2023-12-08T08:14:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d4d1b8640 1 -- 172.21.15.45:0/1400352631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40034640 con 0x7f1d480ca560 2023-12-08T08:14:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d5041e640 1 -- 172.21.15.45:0/1400352631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca560 msgr2=0x7f1d4815ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.569+0000 7f1d5041e640 1 --2- 172.21.15.45:0/1400352631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca560 0x7f1d4815ff10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4002bd90 comp rx=0 tx=0).stop 2023-12-08T08:14:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.570+0000 7f1d5041e640 1 -- 172.21.15.45:0/1400352631 shutdown_connections 2023-12-08T08:14:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.570+0000 7f1d5041e640 1 --2- 172.21.15.45:0/1400352631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca560 0x7f1d4815ff10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.570+0000 7f1d5041e640 1 -- 172.21.15.45:0/1400352631 >> 172.21.15.45:0/1400352631 conn(0x7f1d480663d0 msgr2=0x7f1d480667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.570+0000 7f1d5041e640 1 -- 172.21.15.45:0/1400352631 shutdown_connections 2023-12-08T08:14:56.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.570+0000 7f1d5041e640 1 -- 172.21.15.45:0/1400352631 wait complete. 2023-12-08T08:14:56.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.571+0000 7f1d5041e640 1 Processor -- start 2023-12-08T08:14:56.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.572+0000 7f1d5041e640 1 -- start start 2023-12-08T08:14:56.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.572+0000 7f1d5041e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.572+0000 7f1d5041e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d480ca560 0x7f1d480be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d5041e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4814e800 0x7f1d480beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d5041e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480beff0 con 0x7f1d480ca0e0 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d5041e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4814c6f0 con 0x7f1d4814e800 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d5041e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480c0480 con 0x7f1d480ca560 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60814/0 (socket says 172.21.15.45:60814) 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 -- 172.21.15.45:0/906682266 learned_addr learned my addr 172.21.15.45:0/906682266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4d9b9640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d480ca560 0x7f1d480be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e9bb640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4814e800 0x7f1d480beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 -- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d480ca560 msgr2=0x7f1d480be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d480ca560 0x7f1d480be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 -- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4814e800 msgr2=0x7f1d480beab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4814e800 0x7f1d480beab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.573+0000 7f1d4e1ba640 1 -- 172.21.15.45:0/906682266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40009a70 con 0x7f1d480ca0e0 2023-12-08T08:14:56.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d4e1ba640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b3f0 tx=0x7f1d4400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011830 con 0x7f1d480ca0e0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44011990 con 0x7f1d480ca0e0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011d40 con 0x7f1d480ca0e0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d480c0760 con 0x7f1d480ca0e0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.574+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4814cc20 con 0x7f1d480ca0e0 2023-12-08T08:14:56.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.575+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48074600 con 0x7f1d480ca0e0 2023-12-08T08:14:56.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.576+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f1d4401a400 con 0x7f1d480ca0e0 2023-12-08T08:14:56.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.579+0000 7f1d3effd640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 0x7f1d2c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:56.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.579+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d44088f70 con 0x7f1d480ca0e0 2023-12-08T08:14:56.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.579+0000 7f1d4d9b9640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 0x7f1d2c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:56.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.579+0000 7f1d4d9b9640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 0x7f1d2c06d2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d481eb1c0 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:56.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.582+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d44054440 con 0x7f1d480ca0e0 2023-12-08T08:14:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.785+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d480be190 con 0x7f1d480ca0e0 2023-12-08T08:14:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.786+0000 7f1d3effd640 1 -- 172.21.15.45:0/906682266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f1d44057a60 con 0x7f1d480ca0e0 2023-12-08T08:14:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:14:56.627746+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:14:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 msgr2=0x7f1d2c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 0x7f1d2c06d2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d481eb1c0 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2023-12-08T08:14:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 msgr2=0x7f1d4814d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b3f0 tx=0x7f1d4400b8b0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 shutdown_connections 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2c06ade0 0x7f1d2c06d2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d480ca560 0x7f1d480be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4814e800 0x7f1d480beab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 --2- 172.21.15.45:0/906682266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d480ca0e0 0x7f1d4814d810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 >> 172.21.15.45:0/906682266 conn(0x7f1d480663d0 msgr2=0x7f1d480c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 shutdown_connections 2023-12-08T08:14:56.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:56.789+0000 7f1d5041e640 1 -- 172.21.15.45:0/906682266 wait complete. 2023-12-08T08:14:56.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:14:56.810 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:14:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.013+0000 7f8f9502e640 1 Processor -- start 2023-12-08T08:14:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.013+0000 7f8f9502e640 1 -- start start 2023-12-08T08:14:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.014+0000 7f8f9502e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.014+0000 7f8f9502e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f9014f850 0x7f8f9015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.014+0000 7f8f9502e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f900738e0 con 0x7f8f900aad00 2023-12-08T08:14:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.014+0000 7f8f9502e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f900726a0 con 0x7f8f9014f850 2023-12-08T08:14:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.014+0000 7f8f9502e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900abc70 con 0x7f8f900703e0 2023-12-08T08:14:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.015+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.015+0000 7f8f87fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58154/0 (socket says 172.21.15.45:58154) 2023-12-08T08:14:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.015+0000 7f8f87fff640 1 -- 172.21.15.45:0/4210200202 learned_addr learned my addr 172.21.15.45:0/4210200202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.015+0000 7f8f9482d640 1 --2- 172.21.15.45:0/4210200202 >> v2:172.21.15.114:3300/0 conn(0x7f8f9014f850 0x7f8f9015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f8f7fe640 1 -- 172.21.15.45:0/4210200202 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306487944 0 0) 0x7f8f900738e0 con 0x7f8f900aad00 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f8f7fe640 1 -- 172.21.15.45:0/4210200202 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003520 con 0x7f8f900aad00 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f87fff640 1 -- 172.21.15.45:0/4210200202 >> v2:172.21.15.114:3300/0 conn(0x7f8f9014f850 msgr2=0x7f8f9015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f87fff640 1 --2- 172.21.15.45:0/4210200202 >> v2:172.21.15.114:3300/0 conn(0x7f8f9014f850 0x7f8f9015ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f87fff640 1 -- 172.21.15.45:0/4210200202 >> v1:172.21.15.114:6789/0 conn(0x7f8f900aad00 legacy=0x7f8f90071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.017+0000 7f8f87fff640 1 -- 172.21.15.45:0/4210200202 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90152ef0 con 0x7f8f900703e0 2023-12-08T08:14:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.018+0000 7f8f87fff640 1 --2- 172.21.15.45:0/4210200202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009870 tx=0x7f8f7802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b935c13d8b6f1f72 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.018+0000 7f8f8f7fe640 1 -- 172.21.15.45:0/4210200202 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780317c0 con 0x7f8f900703e0 2023-12-08T08:14:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.018+0000 7f8f8f7fe640 1 -- 172.21.15.45:0/4210200202 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78031920 con 0x7f8f900703e0 2023-12-08T08:14:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.018+0000 7f8f8f7fe640 1 -- 172.21.15.45:0/4210200202 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78031cb0 con 0x7f8f900703e0 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 -- 172.21.15.45:0/4210200202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 msgr2=0x7f8f9014f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 --2- 172.21.15.45:0/4210200202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009870 tx=0x7f8f7802b860 comp rx=0 tx=0).stop 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 -- 172.21.15.45:0/4210200202 shutdown_connections 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 --2- 172.21.15.45:0/4210200202 >> v2:172.21.15.114:3300/0 conn(0x7f8f9014f850 0x7f8f9015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 --2- 172.21.15.45:0/4210200202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f900703e0 0x7f8f9014f310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 -- 172.21.15.45:0/4210200202 >> 172.21.15.45:0/4210200202 conn(0x7f8f900c2bb0 msgr2=0x7f8f900c2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 -- 172.21.15.45:0/4210200202 shutdown_connections 2023-12-08T08:14:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.020+0000 7f8f9502e640 1 -- 172.21.15.45:0/4210200202 wait complete. 2023-12-08T08:14:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.021+0000 7f8f9502e640 1 Processor -- start 2023-12-08T08:14:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.021+0000 7f8f9502e640 1 -- start start 2023-12-08T08:14:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900aad00 0x7f8f901511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f9014f850 0x7f8f9014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f901ecf10 con 0x7f8f900703e0 2023-12-08T08:14:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f901ed1f0 con 0x7f8f900aad00 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9502e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f901ed4d0 con 0x7f8f9014f850 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60830/0 (socket says 172.21.15.45:60830) 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f8ffff640 1 -- 172.21.15.45:0/946241130 learned_addr learned my addr 172.21.15.45:0/946241130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f9482d640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f9014f850 0x7f8f9014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.022+0000 7f8f87fff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900aad00 0x7f8f901511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 -- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f9014f850 msgr2=0x7f8f9014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f9014f850 0x7f8f9014b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 -- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900aad00 msgr2=0x7f8f901511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900aad00 0x7f8f901511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 -- 172.21.15.45:0/946241130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780094d0 con 0x7f8f900703e0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8ffff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c490 tx=0x7f8f8000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800052d0 con 0x7f8f900703e0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80005430 con 0x7f8f900703e0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f901ed7b0 con 0x7f8f900703e0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80012870 con 0x7f8f900703e0 2023-12-08T08:14:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.023+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f90151730 con 0x7f8f900703e0 2023-12-08T08:14:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.026+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f901edcd0 con 0x7f8f900703e0 2023-12-08T08:14:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.026+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f8f800129d0 con 0x7f8f900703e0 2023-12-08T08:14:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.027+0000 7f8f8d7fa640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 0x7f8f7006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.027+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f80088d50 con 0x7f8f900703e0 2023-12-08T08:14:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.027+0000 7f8f87fff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 0x7f8f7006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.028+0000 7f8f87fff640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 0x7f8f7006d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f78036000 tx=0x7f8f7803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.032+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f901edcd0 con 0x7f8f900703e0 2023-12-08T08:14:57.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.226+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f901edcd0 con 0x7f8f900703e0 2023-12-08T08:14:57.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.227+0000 7f8f8d7fa640 1 -- 172.21.15.45:0/946241130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f901edcd0 con 0x7f8f900703e0 2023-12-08T08:14:57.228 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:14:57.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 msgr2=0x7f8f7006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 0x7f8f7006d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f78036000 tx=0x7f8f7803d040 comp rx=0 tx=0).stop 2023-12-08T08:14:57.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 msgr2=0x7f8f901497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c490 tx=0x7f8f8000c950 comp rx=0 tx=0).stop 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 shutdown_connections 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8f7006adb0 0x7f8f7006d270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8f9014f850 0x7f8f9014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f900aad00 0x7f8f901511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 --2- 172.21.15.45:0/946241130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f900703e0 0x7f8f901497f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.229+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 >> 172.21.15.45:0/946241130 conn(0x7f8f900c2bb0 msgr2=0x7f8f9014c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.230+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 shutdown_connections 2023-12-08T08:14:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.230+0000 7f8f9502e640 1 -- 172.21.15.45:0/946241130 wait complete. 2023-12-08T08:14:57.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:14:57.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.457+0000 7fe80a6bb640 1 Processor -- start 2023-12-08T08:14:57.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.457+0000 7fe80a6bb640 1 -- start start 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe80a6bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe804151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe80a6bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe804151ea0 con 0x7fe8040c1670 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe80a6bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe804154850 con 0x7fe8040c1210 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe80a6bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80414ec20 con 0x7fe80414e840 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe809eba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8040c1670 0x7fe8040aa590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44410/0 (socket says 172.21.15.45:44410) 2023-12-08T08:14:57.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.459+0000 7fe809eba640 1 -- 172.21.15.45:0/2110926940 learned_addr learned my addr 172.21.15.45:0/2110926940 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe8096b9640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe804151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223877441 0 0) 0x7fe804151ea0 con 0x7fe8040c1670 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0003520 con 0x7fe8040c1670 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944607623 0 0) 0x7fe7f0003520 con 0x7fe8040c1670 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 msgr2=0x7fe804151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe804151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 >> v1:172.21.15.114:6789/0 conn(0x7fe8040c1210 legacy=0x7fe8040a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804154b30 con 0x7fe8040c1670 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe7fc001670 con 0x7fe8040c1670 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 >> v1:172.21.15.45:6789/0 conn(0x7fe8040c1670 legacy=0x7fe8040aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe7f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f0003f70 0x7fe7f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80414ec20 con 0x7fe7f0003f70 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000bc10 con 0x7fe7f0004d00 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.460+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000bdd0 con 0x7fe80414e840 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f0003f70 0x7fe7f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe8096b9640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe7f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe809eba640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 -- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 msgr2=0x7fe7f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414e840 0x7fe7f00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 -- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0004d00 msgr2=0x7fe7f0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.461+0000 7fe808eb8640 1 -- 172.21.15.45:0/2110926940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0003520 con 0x7fe7f0003f70 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.462+0000 7fe808eb8640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f0003f70 0x7fe7f00047c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001330 tx=0x7fe7f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa3674ef119f8df server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.462+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40052d0 con 0x7fe7f0003f70 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.462+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4005430 con 0x7fe7f0003f70 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.462+0000 7fe7fbfff640 1 -- 172.21.15.45:0/2110926940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4003830 con 0x7fe7f0003f70 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 -- 172.21.15.45:0/2110926940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f0003f70 msgr2=0x7fe7f00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/2110926940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f0003f70 0x7fe7f00047c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4001330 tx=0x7fe7f00057f0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe809eba640 1 -- 172.21.15.45:0/2110926940 reap_dead start 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 -- 172.21.15.45:0/2110926940 shutdown_connections 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 -- 172.21.15.45:0/2110926940 >> 172.21.15.45:0/2110926940 conn(0x7fe8040c5780 msgr2=0x7fe8040c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 -- 172.21.15.45:0/2110926940 shutdown_connections 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.463+0000 7fe80a6bb640 1 -- 172.21.15.45:0/2110926940 wait complete. 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.465+0000 7fe80a6bb640 1 Processor -- start 2023-12-08T08:14:57.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.465+0000 7fe80a6bb640 1 -- start start 2023-12-08T08:14:57.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0003f70 0x7fe804071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414f2e0 0x7fe8041ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804071140 con 0x7fe8041e0bb0 2023-12-08T08:14:57.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804070cb0 con 0x7fe7f0003f70 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe80a6bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe804070380 con 0x7fe80414f2e0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.466+0000 7fe808eb8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60850/0 (socket says 172.21.15.45:60850) 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 -- 172.21.15.45:0/3164001982 learned_addr learned my addr 172.21.15.45:0/3164001982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe809eba640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414f2e0 0x7fe8041ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 -- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414f2e0 msgr2=0x7fe8041ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414f2e0 0x7fe8041ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 -- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0003f70 msgr2=0x7fe804071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe8096b9640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0003f70 0x7fe804071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0003f70 0x7fe804071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 -- 172.21.15.45:0/3164001982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804070660 con 0x7fe8041e0bb0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.467+0000 7fe808eb8640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7f402de40 tx=0x7fe7f4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.468+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4006be0 con 0x7fe8041e0bb0 2023-12-08T08:14:57.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.468+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4006d40 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.468+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4003830 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.468+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe804070940 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.468+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe804070030 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.469+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804070b00 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.470+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe7f4003990 con 0x7fe8041e0bb0 2023-12-08T08:14:57.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.471+0000 7fe7f9ffb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 0x7fe7e806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.471+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7f40ab9b0 con 0x7fe8041e0bb0 2023-12-08T08:14:57.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.471+0000 7fe8096b9640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 0x7fe7e806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.472+0000 7fe8096b9640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 0x7fe7e806d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe800007380 tx=0x7fe80000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.475+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7f4076e80 con 0x7fe8041e0bb0 2023-12-08T08:14:57.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.672+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe8040743e0 con 0x7fe8041e0bb0 2023-12-08T08:14:57.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.673+0000 7fe7f9ffb640 1 -- 172.21.15.45:0/3164001982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe7f404b090 con 0x7fe8041e0bb0 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:14:57.675 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:14:57.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 msgr2=0x7fe7e806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 0x7fe7e806d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe800007380 tx=0x7fe80000b040 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 msgr2=0x7fe80414eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe7f402de40 tx=0x7fe7f4001120 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 shutdown_connections 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.675+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7e806adb0 0x7fe7e806d270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe80414f2e0 0x7fe8041ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8041e0bb0 0x7fe80414eda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 --2- 172.21.15.45:0/3164001982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7f0003f70 0x7fe804071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 >> 172.21.15.45:0/3164001982 conn(0x7fe8040c5780 msgr2=0x7fe8040beb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 shutdown_connections 2023-12-08T08:14:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.676+0000 7fe80a6bb640 1 -- 172.21.15.45:0/3164001982 wait complete. 2023-12-08T08:14:57.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:14:57.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:14:57.700 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:14:57.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.960+0000 7efce469b640 1 Processor -- start 2023-12-08T08:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.960+0000 7efce469b640 1 -- start start 2023-12-08T08:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.961+0000 7efce469b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcdc154190 0x7efcdc0aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.961+0000 7efce469b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcdc154a20 0x7efcdc154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.961+0000 7efce469b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0c63b0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce469b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0a9f20 con 0x7efcdc154a20 2023-12-08T08:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce469b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0a53c0 con 0x7efcdc154190 2023-12-08T08:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2c38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcdc154a20 0x7efcdc154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce1c36640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efcdc0a4f30 0x7efcdc0c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44416/0 (socket says 172.21.15.45:44416) 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce1c36640 1 -- 172.21.15.45:0/3763019599 learned_addr learned my addr 172.21.15.45:0/3763019599 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2437640 1 --2- 172.21.15.45:0/3763019599 >> v2:172.21.15.114:3300/0 conn(0x7efcdc154190 0x7efcdc0aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2c38640 1 -- 172.21.15.45:0/3763019599 >> v2:172.21.15.114:3300/0 conn(0x7efcdc154190 msgr2=0x7efcdc0aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2c38640 1 --2- 172.21.15.45:0/3763019599 >> v2:172.21.15.114:3300/0 conn(0x7efcdc154190 0x7efcdc0aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2c38640 1 -- 172.21.15.45:0/3763019599 >> v1:172.21.15.45:6789/0 conn(0x7efcdc0a4f30 legacy=0x7efcdc0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.962+0000 7efce2c38640 1 -- 172.21.15.45:0/3763019599 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0a9580 con 0x7efcdc154a20 2023-12-08T08:14:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.964+0000 7efce2c38640 1 --2- 172.21.15.45:0/3763019599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc154a20 0x7efcdc154e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0670b0 tx=0x7efcd402e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed458b732ca0a6b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.964+0000 7efce1435640 1 -- 172.21.15.45:0/3763019599 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd402edf0 con 0x7efcdc154a20 2023-12-08T08:14:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.964+0000 7efce1435640 1 -- 172.21.15.45:0/3763019599 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4036440 con 0x7efcdc154a20 2023-12-08T08:14:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.964+0000 7efce1435640 1 -- 172.21.15.45:0/3763019599 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40367d0 con 0x7efcdc154a20 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 -- 172.21.15.45:0/3763019599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc154a20 msgr2=0x7efcdc154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 --2- 172.21.15.45:0/3763019599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc154a20 0x7efcdc154e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0670b0 tx=0x7efcd402e040 comp rx=0 tx=0).stop 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 -- 172.21.15.45:0/3763019599 shutdown_connections 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 --2- 172.21.15.45:0/3763019599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc154a20 0x7efcdc154e40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 --2- 172.21.15.45:0/3763019599 >> v2:172.21.15.114:3300/0 conn(0x7efcdc154190 0x7efcdc0aa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 -- 172.21.15.45:0/3763019599 >> 172.21.15.45:0/3763019599 conn(0x7efcdc0661f0 msgr2=0x7efcdc066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 -- 172.21.15.45:0/3763019599 shutdown_connections 2023-12-08T08:14:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.965+0000 7efce469b640 1 -- 172.21.15.45:0/3763019599 wait complete. 2023-12-08T08:14:57.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.967+0000 7efce469b640 1 Processor -- start 2023-12-08T08:14:57.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.967+0000 7efce469b640 1 -- start start 2023-12-08T08:14:57.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcdc154190 0x7efcdc099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 0x7efcdc1e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1ea990 con 0x7efcdc0a4f30 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1e9d10 con 0x7efcdc154a20 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce469b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1e9ff0 con 0x7efcdc154190 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce2437640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce2437640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60872/0 (socket says 172.21.15.45:60872) 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.968+0000 7efce2437640 1 -- 172.21.15.45:0/4187904985 learned_addr learned my addr 172.21.15.45:0/4187904985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2c38640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 0x7efcdc1e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce1c36640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcdc154190 0x7efcdc099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 -- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcdc154190 msgr2=0x7efcdc099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcdc154190 0x7efcdc099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 -- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 msgr2=0x7efcdc1e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 0x7efcdc1e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 -- 172.21.15.45:0/4187904985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009a70 con 0x7efcdc0a4f30 2023-12-08T08:14:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2c38640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 0x7efcdc1e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:14:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efce2437640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcd800d800 tx=0x7efcd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800b6c0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd800b820 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.969+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800bbb0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.970+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc1ea2d0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.970+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc1555b0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.971+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0a72f0 con 0x7efcdc0a4f30 2023-12-08T08:14:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.972+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7efcd800bd10 con 0x7efcdc0a4f30 2023-12-08T08:14:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.973+0000 7efcceffd640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 0x7efcc006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.973+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcd8089680 con 0x7efcdc0a4f30 2023-12-08T08:14:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.973+0000 7efce1c36640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 0x7efcc006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:57.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.974+0000 7efce1c36640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 0x7efcc006d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcdc072c90 tx=0x7efcd0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:57.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:57.977+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcd8054bf0 con 0x7efcdc0a4f30 2023-12-08T08:14:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.174+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efcdc074600 con 0x7efcdc0a4f30 2023-12-08T08:14:58.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.290+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcd8089380 con 0x7efcdc0a4f30 2023-12-08T08:14:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.849+0000 7efcceffd640 1 -- 172.21.15.45:0/4187904985 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7efcd8087cc0 con 0x7efcdc0a4f30 2023-12-08T08:14:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 msgr2=0x7efcc006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 0x7efcc006d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcdc072c90 tx=0x7efcd0009040 comp rx=0 tx=0).stop 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 msgr2=0x7efcdc155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcd800d800 tx=0x7efcd800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 shutdown_connections 2023-12-08T08:14:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efcc006adb0 0x7efcc006d270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcdc154190 0x7efcdc099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc154a20 0x7efcdc1e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 --2- 172.21.15.45:0/4187904985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcdc0a4f30 0x7efcdc155070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.852+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 >> 172.21.15.45:0/4187904985 conn(0x7efcdc0661f0 msgr2=0x7efcdc0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.853+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 shutdown_connections 2023-12-08T08:14:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:58.853+0000 7efce469b640 1 -- 172.21.15.45:0/4187904985 wait complete. 2023-12-08T08:14:58.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-08T08:14:59.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.083+0000 7f9b0ffff640 1 Processor -- start 2023-12-08T08:14:59.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.083+0000 7f9b0ffff640 1 -- start start 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9b101510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100bfe00 con 0x7f9b1014e800 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0ffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b10151810 con 0x7f9b100a5e10 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1014ebe0 con 0x7f9b100a56b0 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b1014e800 0x7f9b100c1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44422/0 (socket says 172.21.15.45:44422) 2023-12-08T08:14:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.085+0000 7f9b0effd640 1 -- 172.21.15.45:0/775416588 learned_addr learned my addr 172.21.15.45:0/775416588 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9b101510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280966484 0 0) 0x7f9b100bfe00 con 0x7f9b1014e800 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af8003520 con 0x7f9b1014e800 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990028907 0 0) 0x7f9af8003520 con 0x7f9b1014e800 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 msgr2=0x7f9b101510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9b101510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 >> v1:172.21.15.114:6789/0 conn(0x7f9b100a5e10 legacy=0x7f9b10154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10151af0 con 0x7f9b1014e800 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9b00001670 con 0x7f9b1014e800 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.086+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 >> v1:172.21.15.45:6789/0 conn(0x7f9b1014e800 legacy=0x7f9b100c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9af80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af8003ee0 0x7f9af80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9af8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1014ebe0 con 0x7f9af8004d00 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af800ff90 con 0x7f9af8003ee0 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af80100d0 con 0x7f9b100a56b0 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9af8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0effd640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9af80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 -- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 msgr2=0x7f9af80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0e7fc640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af8003ee0 0x7f9af80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100a56b0 0x7f9af80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 -- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af8003ee0 msgr2=0x7f9af80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:14:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af8003ee0 0x7f9af80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.087+0000 7f9b0f7fe640 1 -- 172.21.15.45:0/775416588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8003520 con 0x7f9af8004d00 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9af8005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e170 tx=0x7f9af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6607034314b3eb44 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0802cbf0 con 0x7f9af8004d00 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800f040 con 0x7f9af8004d00 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0dffb640 1 -- 172.21.15.45:0/775416588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08034440 con 0x7f9af8004d00 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0ffff640 1 -- 172.21.15.45:0/775416588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 msgr2=0x7f9af8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.089+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/775416588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9af8005180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e170 tx=0x7f9af80057f0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.090+0000 7f9b0f7fe640 1 -- 172.21.15.45:0/775416588 reap_dead start 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.090+0000 7f9b0ffff640 1 -- 172.21.15.45:0/775416588 shutdown_connections 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.090+0000 7f9b0ffff640 1 -- 172.21.15.45:0/775416588 >> 172.21.15.45:0/775416588 conn(0x7f9b100c2200 msgr2=0x7f9b100c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.090+0000 7f9b0ffff640 1 -- 172.21.15.45:0/775416588 shutdown_connections 2023-12-08T08:14:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.090+0000 7f9b0ffff640 1 -- 172.21.15.45:0/775416588 wait complete. 2023-12-08T08:14:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.091+0000 7f9b0ffff640 1 Processor -- start 2023-12-08T08:14:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.092+0000 7f9b0ffff640 1 -- start start 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100bf980 0x7f9b10141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 0x7f9b1014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101520b0 con 0x7f9af8004d00 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10070ae0 con 0x7f9b10141dc0 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101e60c0 con 0x7f9b100bf980 2023-12-08T08:14:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60892/0 (socket says 172.21.15.45:60892) 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 -- 172.21.15.45:0/3797811999 learned_addr learned my addr 172.21.15.45:0/3797811999 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 0x7f9b1014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0e7fc640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100bf980 0x7f9b10141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 -- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100bf980 msgr2=0x7f9b10141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100bf980 0x7f9b10141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 -- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 msgr2=0x7f9b1014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 0x7f9b1014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0effd640 1 -- 172.21.15.45:0/3797811999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1014efd0 con 0x7f9af8004d00 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.093+0000 7f9b0f7fe640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 0x7f9b1014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:14:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9b0effd640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000e8c0 tx=0x7f9b0000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00005260 con 0x7f9af8004d00 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000053c0 con 0x7f9af8004d00 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000047e0 con 0x7f9af8004d00 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1014f2b0 con 0x7f9af8004d00 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.094+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1014f870 con 0x7f9af8004d00 2023-12-08T08:14:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.095+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b101521f0 con 0x7f9af8004d00 2023-12-08T08:14:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.097+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b00004940 con 0x7f9af8004d00 2023-12-08T08:14:59.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.097+0000 7f9af77fe640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 0x7f9afc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:14:59.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.098+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9b00089200 con 0x7f9af8004d00 2023-12-08T08:14:59.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.098+0000 7f9b0e7fc640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 0x7f9afc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:14:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.098+0000 7f9b0e7fc640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 0x7f9afc06d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b101459b0 tx=0x7f9b04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:14:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.101+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b00054470 con 0x7f9af8004d00 2023-12-08T08:14:59.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.297+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f9b100743e0 con 0x7f9af8004d00 2023-12-08T08:14:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.856+0000 7f9af77fe640 1 -- 172.21.15.45:0/3797811999 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f9b000190d0 con 0x7f9af8004d00 2023-12-08T08:14:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-08T08:14:59.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 msgr2=0x7f9afc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 0x7f9afc06d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b101459b0 tx=0x7f9b04009040 comp rx=0 tx=0).stop 2023-12-08T08:14:59.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 msgr2=0x7f9b100c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000e8c0 tx=0x7f9b0000ed80 comp rx=0 tx=0).stop 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 shutdown_connections 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9afc06ae70 0x7f9afc06d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b100bf980 0x7f9b10141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b10141dc0 0x7f9b1014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 --2- 172.21.15.45:0/3797811999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9af8004d00 0x7f9b100c3990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 >> 172.21.15.45:0/3797811999 conn(0x7f9b100c2200 msgr2=0x7f9b10154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:14:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 shutdown_connections 2023-12-08T08:14:59.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:14:59.860+0000 7f9b0ffff640 1 -- 172.21.15.45:0/3797811999 wait complete. 2023-12-08T08:14:59.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:15:00.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.088+0000 7f3933e1e640 1 Processor -- start 2023-12-08T08:15:00.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.088+0000 7f3933e1e640 1 -- start start 2023-12-08T08:15:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.089+0000 7f3933e1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f392c06d960 0x7f392c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.089+0000 7f3933e1e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f392c0c1930 0x7f392c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.089+0000 7f3933e1e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c152660 con 0x7f392c0aaf60 2023-12-08T08:15:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.089+0000 7f3933e1e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0a4d10 con 0x7f392c06d960 2023-12-08T08:15:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.089+0000 7f3933e1e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c153200 con 0x7f392c0c1930 2023-12-08T08:15:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f392c06d960 0x7f392c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f392c06d960 0x7f392c0c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60904/0 (socket says 172.21.15.45:60904) 2023-12-08T08:15:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 -- 172.21.15.45:0/3020906231 learned_addr learned my addr 172.21.15.45:0/3020906231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39323bb640 1 --2- 172.21.15.45:0/3020906231 >> v2:172.21.15.114:3300/0 conn(0x7f392c0c1930 0x7f392c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 -- 172.21.15.45:0/3020906231 >> v2:172.21.15.114:3300/0 conn(0x7f392c0c1930 msgr2=0x7f392c0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:00.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 --2- 172.21.15.45:0/3020906231 >> v2:172.21.15.114:3300/0 conn(0x7f392c0c1930 0x7f392c0c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 -- 172.21.15.45:0/3020906231 >> v1:172.21.15.114:6789/0 conn(0x7f392c0aaf60 legacy=0x7f392c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:00.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.090+0000 7f39313b9640 1 -- 172.21.15.45:0/3020906231 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0c3310 con 0x7f392c06d960 2023-12-08T08:15:00.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.092+0000 7f39313b9640 1 --2- 172.21.15.45:0/3020906231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c06d960 0x7f392c0c3830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f392c0c5230 tx=0x7f391c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c971d0757895c196 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:00.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.092+0000 7f3930bb8640 1 -- 172.21.15.45:0/3020906231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0317e0 con 0x7f392c06d960 2023-12-08T08:15:00.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.092+0000 7f3930bb8640 1 -- 172.21.15.45:0/3020906231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c031940 con 0x7f392c06d960 2023-12-08T08:15:00.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.092+0000 7f3930bb8640 1 -- 172.21.15.45:0/3020906231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c031cd0 con 0x7f392c06d960 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 -- 172.21.15.45:0/3020906231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c06d960 msgr2=0x7f392c0c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3020906231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c06d960 0x7f392c0c3830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f392c0c5230 tx=0x7f391c02b880 comp rx=0 tx=0).stop 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 -- 172.21.15.45:0/3020906231 shutdown_connections 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3020906231 >> v2:172.21.15.114:3300/0 conn(0x7f392c0c1930 0x7f392c0c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3020906231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c06d960 0x7f392c0c3830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 -- 172.21.15.45:0/3020906231 >> 172.21.15.45:0/3020906231 conn(0x7f392c0c2430 msgr2=0x7f392c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 -- 172.21.15.45:0/3020906231 shutdown_connections 2023-12-08T08:15:00.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.093+0000 7f3933e1e640 1 -- 172.21.15.45:0/3020906231 wait complete. 2023-12-08T08:15:00.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.095+0000 7f3933e1e640 1 Processor -- start 2023-12-08T08:15:00.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.095+0000 7f3933e1e640 1 -- start start 2023-12-08T08:15:00.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 0x7f392c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0c1930 0x7f392c149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c14e100 con 0x7f392c0aaf60 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c071220 con 0x7f392c0c1930 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f3933e1e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c0728c0 con 0x7f392c06d960 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f39313b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f39313b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60908/0 (socket says 172.21.15.45:60908) 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.096+0000 7f39313b9640 1 -- 172.21.15.45:0/3712832816 learned_addr learned my addr 172.21.15.45:0/3712832816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f3931bba640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 0x7f392c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39323bb640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0c1930 0x7f392c149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 -- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 msgr2=0x7f392c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 0x7f392c155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 -- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0c1930 msgr2=0x7f392c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0c1930 0x7f392c149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 -- 172.21.15.45:0/3712832816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0094d0 con 0x7f392c0aaf60 2023-12-08T08:15:00.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f3931bba640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 0x7f392c155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:00.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39313b9640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f391c02b8c0 tx=0x7f391c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:00.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.097+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c032880 con 0x7f392c0aaf60 2023-12-08T08:15:00.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.098+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c032a00 con 0x7f392c0aaf60 2023-12-08T08:15:00.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.098+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c032db0 con 0x7f392c0aaf60 2023-12-08T08:15:00.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.098+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c072090 con 0x7f392c0aaf60 2023-12-08T08:15:00.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.098+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c071ad0 con 0x7f392c0aaf60 2023-12-08T08:15:00.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.099+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c06cb00 con 0x7f392c0aaf60 2023-12-08T08:15:00.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.100+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f391c0453f0 con 0x7f392c0aaf60 2023-12-08T08:15:00.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.101+0000 7f39227fc640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 0x7f391006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:00.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.101+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f391c0ab8f0 con 0x7f392c0aaf60 2023-12-08T08:15:00.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.101+0000 7f3931bba640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 0x7f391006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:00.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.102+0000 7f3931bba640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 0x7f391006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3928003eb0 tx=0x7f3928009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.105+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f391c076aa0 con 0x7f392c0aaf60 2023-12-08T08:15:00.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.335+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f392c071390 con 0x7f392c0aaf60 2023-12-08T08:15:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.859+0000 7f39227fc640 1 -- 172.21.15.45:0/3712832816 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f391c07a0c0 con 0x7f392c0aaf60 2023-12-08T08:15:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2023-12-08T08:15:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 msgr2=0x7f391006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 0x7f391006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3928003eb0 tx=0x7f3928009040 comp rx=0 tx=0).stop 2023-12-08T08:15:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 msgr2=0x7f392c148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f391c02b8c0 tx=0x7f391c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 shutdown_connections 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f391006ae40 0x7f391006d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392c0c1930 0x7f392c149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c0aaf60 0x7f392c148b00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 --2- 172.21.15.45:0/3712832816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f392c06d960 0x7f392c155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.863+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 >> 172.21.15.45:0/3712832816 conn(0x7f392c0c2430 msgr2=0x7f392c152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.864+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 shutdown_connections 2023-12-08T08:15:00.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:00.864+0000 7f3933e1e640 1 -- 172.21.15.45:0/3712832816 wait complete. 2023-12-08T08:15:00.891 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-08T08:15:00.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-08T08:15:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.103+0000 7f59b4860640 1 Processor -- start 2023-12-08T08:15:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.103+0000 7f59b4860640 1 -- start start 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59b4860640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59b014f740 0x7f59b0156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59b4860640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f59b006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59b4860640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b0152290 con 0x7f59b0153780 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59b4860640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b0153180 con 0x7f59b014f740 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59b4860640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c16f0 con 0x7f59b00a4d10 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59a659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f59b0153780 0x7f59b0152a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44428/0 (socket says 172.21.15.45:44428) 2023-12-08T08:15:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.105+0000 7f59a659c640 1 -- 172.21.15.45:0/1182241828 learned_addr learned my addr 172.21.15.45:0/1182241828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59aed9d640 1 --2- 172.21.15.45:0/1182241828 >> v2:172.21.15.114:3300/0 conn(0x7f59b014f740 0x7f59b0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59af59e640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f59b006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254222871 0 0) 0x7f59b0152290 con 0x7f59b0153780 2023-12-08T08:15:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c003520 con 0x7f59b0153780 2023-12-08T08:15:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148432655 0 0) 0x7f599c003520 con 0x7f59b0153780 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 msgr2=0x7f59b006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f59b006ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 >> v2:172.21.15.114:3300/0 conn(0x7f59b014f740 msgr2=0x7f59b0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 --2- 172.21.15.45:0/1182241828 >> v2:172.21.15.114:3300/0 conn(0x7f59b014f740 0x7f59b0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00c19d0 con 0x7f59b0153780 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5998001670 con 0x7f59b0153780 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 >> v1:172.21.15.45:6789/0 conn(0x7f59b0153780 legacy=0x7f59b0152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.106+0000 7f59ae59c640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599c003970 0x7f599c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59ae59c640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f599c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59ae59c640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f599c004d00 0x7f599c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0153180 con 0x7f599c004d00 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c16f0 con 0x7f599c003970 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c00ba00 con 0x7f59b00a4d10 2023-12-08T08:15:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59af59e640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f599c004d00 0x7f599c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59a659c640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f599c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59af59e640 1 -- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 msgr2=0x7f599c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59af59e640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b00a4d10 0x7f599c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59af59e640 1 -- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599c003970 msgr2=0x7f599c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.107+0000 7f59aed9d640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599c003970 0x7f599c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.108+0000 7f59af59e640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599c003970 0x7f599c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.108+0000 7f59af59e640 1 -- 172.21.15.45:0/1182241828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c003520 con 0x7f599c004d00 2023-12-08T08:15:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.108+0000 7f59aed9d640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f599c003970 0x7f599c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.109+0000 7f59af59e640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f599c004d00 0x7f599c005180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009ac0 tx=0x7f599c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215437083a81a5cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.109+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a802c6b0 con 0x7f599c004d00 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.109+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a802c810 con 0x7f599c004d00 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.109+0000 7f59ae59c640 1 -- 172.21.15.45:0/1182241828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a802cba0 con 0x7f599c004d00 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 -- 172.21.15.45:0/1182241828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f599c004d00 msgr2=0x7f599c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 --2- 172.21.15.45:0/1182241828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f599c004d00 0x7f599c005180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009ac0 tx=0x7f599c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59af59e640 1 -- 172.21.15.45:0/1182241828 reap_dead start 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 -- 172.21.15.45:0/1182241828 shutdown_connections 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 -- 172.21.15.45:0/1182241828 >> 172.21.15.45:0/1182241828 conn(0x7f59b0066df0 msgr2=0x7f59b00a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 -- 172.21.15.45:0/1182241828 shutdown_connections 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.110+0000 7f59b4860640 1 -- 172.21.15.45:0/1182241828 wait complete. 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.112+0000 7f59b4860640 1 Processor -- start 2023-12-08T08:15:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.112+0000 7f59b4860640 1 -- start start 2023-12-08T08:15:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b01460b0 0x7f59b0072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b0151660 0x7f59b0070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b006ff40 con 0x7f59b014cff0 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01509f0 con 0x7f59b0151660 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59b4860640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0150c90 con 0x7f59b01460b0 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60918/0 (socket says 172.21.15.45:60918) 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59a659c640 1 -- 172.21.15.45:0/4245324535 learned_addr learned my addr 172.21.15.45:0/4245324535 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.113+0000 7f59af59e640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b0151660 0x7f59b0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59aed9d640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b01460b0 0x7f59b0072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 -- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b01460b0 msgr2=0x7f59b0072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b01460b0 0x7f59b0072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 -- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b0151660 msgr2=0x7f59b0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b0151660 0x7f59b0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 -- 172.21.15.45:0/4245324535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b006fbd0 con 0x7f59b014cff0 2023-12-08T08:15:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a659c640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f599800eaf0 tx=0x7f5998001620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599800c850 con 0x7f59b014cff0 2023-12-08T08:15:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599800c9d0 con 0x7f59b014cff0 2023-12-08T08:15:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599800cd80 con 0x7f59b014cff0 2023-12-08T08:15:01.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.114+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b0146490 con 0x7f59b014cff0 2023-12-08T08:15:01.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.115+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b00c5200 con 0x7f59b014cff0 2023-12-08T08:15:01.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.116+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b0067900 con 0x7f59b014cff0 2023-12-08T08:15:01.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.116+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f599801d460 con 0x7f59b014cff0 2023-12-08T08:15:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.117+0000 7f59a7fff640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 0x7f599006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.117+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5998089720 con 0x7f59b014cff0 2023-12-08T08:15:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.118+0000 7f59aed9d640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 0x7f599006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.118+0000 7f59aed9d640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 0x7f599006d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59b0152160 tx=0x7f59a000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.122+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59980547c0 con 0x7f59b014cff0 2023-12-08T08:15:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.327+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f59b006fa30 con 0x7f59b014cff0 2023-12-08T08:15:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.376+0000 7f59a7fff640 1 -- 172.21.15.45:0/4245324535 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f59b006fa30 con 0x7f59b014cff0 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 msgr2=0x7f599006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 0x7f599006d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59b0152160 tx=0x7f59a000b040 comp rx=0 tx=0).stop 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 msgr2=0x7f59b01e9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f599800eaf0 tx=0x7f5998001620 comp rx=0 tx=0).stop 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 shutdown_connections 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f599006ae40 0x7f599006d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b0151660 0x7f59b0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59b014cff0 0x7f59b01e9dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 --2- 172.21.15.45:0/4245324535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59b01460b0 0x7f59b0072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 >> 172.21.15.45:0/4245324535 conn(0x7f59b0066df0 msgr2=0x7f59b0154740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:01.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 shutdown_connections 2023-12-08T08:15:01.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.380+0000 7f59b4860640 1 -- 172.21.15.45:0/4245324535 wait complete. 2023-12-08T08:15:01.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:15:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.618+0000 7f686bfff640 1 Processor -- start 2023-12-08T08:15:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.619+0000 7f686bfff640 1 -- start start 2023-12-08T08:15:01.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.620+0000 7f686bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f686c154ce0 0x7f686c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.620+0000 7f686bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.620+0000 7f686bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c155230 con 0x7f686c0c64f0 2023-12-08T08:15:01.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.620+0000 7f686bfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0c45b0 con 0x7f686c154ce0 2023-12-08T08:15:01.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.620+0000 7f686bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0c4890 con 0x7f686c157da0 2023-12-08T08:15:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.621+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.621+0000 7f686a7fc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f686c154ce0 0x7f686c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.621+0000 7f686affd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f686c0c64f0 0x7f686c13d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:38856/0 (socket says 172.21.15.45:38856) 2023-12-08T08:15:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.621+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58266/0 (socket says 172.21.15.45:58266) 2023-12-08T08:15:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.621+0000 7f686affd640 1 -- 172.21.15.45:0/3136055114 learned_addr learned my addr 172.21.15.45:0/3136055114 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.622+0000 7f686b7fe640 1 -- 172.21.15.45:0/3136055114 >> v2:172.21.15.114:3300/0 conn(0x7f686c154ce0 msgr2=0x7f686c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.622+0000 7f686b7fe640 1 --2- 172.21.15.45:0/3136055114 >> v2:172.21.15.114:3300/0 conn(0x7f686c154ce0 0x7f686c06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.622+0000 7f686b7fe640 1 -- 172.21.15.45:0/3136055114 >> v1:172.21.15.114:6789/0 conn(0x7f686c0c64f0 legacy=0x7f686c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.622+0000 7f686b7fe640 1 -- 172.21.15.45:0/3136055114 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0c4b70 con 0x7f686c157da0 2023-12-08T08:15:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.623+0000 7f686b7fe640 1 --2- 172.21.15.45:0/3136055114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9edec181e96d2c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f6869ffb640 1 -- 172.21.15.45:0/3136055114 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686402f050 con 0x7f686c157da0 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f6869ffb640 1 -- 172.21.15.45:0/3136055114 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864031700 con 0x7f686c157da0 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f6869ffb640 1 -- 172.21.15.45:0/3136055114 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864031a90 con 0x7f686c157da0 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 -- 172.21.15.45:0/3136055114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 msgr2=0x7f686c158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 --2- 172.21.15.45:0/3136055114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f68640097a0 tx=0x7f686402b7a0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 -- 172.21.15.45:0/3136055114 shutdown_connections 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 --2- 172.21.15.45:0/3136055114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c157da0 0x7f686c158250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 --2- 172.21.15.45:0/3136055114 >> v2:172.21.15.114:3300/0 conn(0x7f686c154ce0 0x7f686c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 -- 172.21.15.45:0/3136055114 >> 172.21.15.45:0/3136055114 conn(0x7f686c0661f0 msgr2=0x7f686c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:01.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.624+0000 7f686bfff640 1 -- 172.21.15.45:0/3136055114 shutdown_connections 2023-12-08T08:15:01.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.625+0000 7f686bfff640 1 -- 172.21.15.45:0/3136055114 wait complete. 2023-12-08T08:15:01.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.626+0000 7f686bfff640 1 Processor -- start 2023-12-08T08:15:01.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.626+0000 7f686bfff640 1 -- start start 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 0x7f686c0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f686c157da0 0x7f686c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c1edda0 con 0x7f686c0c64f0 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c1ee020 con 0x7f686c157da0 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.627+0000 7f686bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0aba10 con 0x7f686c154ce0 2023-12-08T08:15:01.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60920/0 (socket says 172.21.15.45:60920) 2023-12-08T08:15:01.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 -- 172.21.15.45:0/2843571179 learned_addr learned my addr 172.21.15.45:0/2843571179 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686a7fc640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 0x7f686c0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686b7fe640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f686c157da0 0x7f686c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 -- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 msgr2=0x7f686c0ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 0x7f686c0ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 -- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f686c157da0 msgr2=0x7f686c0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f686c157da0 0x7f686c0ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 -- 172.21.15.45:0/2843571179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864009400 con 0x7f686c0c64f0 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686a7fc640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 0x7f686c0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.628+0000 7f686affd640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f685c00cba0 tx=0x7f685c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.629+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00ad40 con 0x7f686c0c64f0 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.629+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c012400 con 0x7f686c0c64f0 2023-12-08T08:15:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.629+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00aea0 con 0x7f686c0c64f0 2023-12-08T08:15:01.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.629+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c0abcf0 con 0x7f686c0c64f0 2023-12-08T08:15:01.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.629+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c154610 con 0x7f686c0c64f0 2023-12-08T08:15:01.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.630+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c0743e0 con 0x7f686c0c64f0 2023-12-08T08:15:01.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.631+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f685c007070 con 0x7f686c0c64f0 2023-12-08T08:15:01.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.632+0000 7f6863fff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 0x7f684c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:01.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.632+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f685c089620 con 0x7f686c0c64f0 2023-12-08T08:15:01.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.632+0000 7f686a7fc640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 0x7f684c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:01.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.633+0000 7f686a7fc640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 0x7f684c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6854009ac0 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:01.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.637+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f685c054600 con 0x7f686c0c64f0 2023-12-08T08:15:01.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:01.834+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f686c0c7b60 con 0x7f686c0c64f0 2023-12-08T08:15:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.387+0000 7f6863fff640 1 -- 172.21.15.45:0/2843571179 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f685c057c20 con 0x7f686c0c64f0 2023-12-08T08:15:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' created 2023-12-08T08:15:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 msgr2=0x7f684c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 0x7f684c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6854009ac0 tx=0x7f6854008040 comp rx=0 tx=0).stop 2023-12-08T08:15:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 msgr2=0x7f686c1540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f685c00cba0 tx=0x7f685c00a430 comp rx=0 tx=0).stop 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 shutdown_connections 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f684c06ae70 0x7f684c06d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f686c154ce0 0x7f686c0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f686c157da0 0x7f686c0ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 --2- 172.21.15.45:0/2843571179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f686c0c64f0 0x7f686c1540d0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f685c00cba0 tx=0x7f685c00a430 comp rx=0 tx=0).stop 2023-12-08T08:15:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.391+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 >> 172.21.15.45:0/2843571179 conn(0x7f686c0661f0 msgr2=0x7f686c139300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:03.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.392+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 shutdown_connections 2023-12-08T08:15:03.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.393+0000 7f686bfff640 1 -- 172.21.15.45:0/2843571179 wait complete. 2023-12-08T08:15:03.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-08T08:15:03.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.625+0000 7f1d245e5640 1 Processor -- start 2023-12-08T08:15:03.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.625+0000 7f1d245e5640 1 -- start start 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.626+0000 7f1d245e5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 0x7f1d1c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.626+0000 7f1d245e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.626+0000 7f1d245e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 0x7f1d1c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d245e5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c56a0 con 0x7f1d1c0c9720 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d245e5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c5250 con 0x7f1d1c151c10 2023-12-08T08:15:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d245e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c9290 con 0x7f1d1c0c8470 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60924/0 (socket says 172.21.15.45:60924) 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 -- 172.21.15.45:0/1477386769 learned_addr learned my addr 172.21.15.45:0/1477386769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d22b82640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 0x7f1d1c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d22381640 1 --2- 172.21.15.45:0/1477386769 >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 0x7f1d1c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 -- 172.21.15.45:0/1477386769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 msgr2=0x7f1d1c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 0x7f1d1c157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 -- 172.21.15.45:0/1477386769 >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 msgr2=0x7f1d1c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 --2- 172.21.15.45:0/1477386769 >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 0x7f1d1c0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d21b80640 1 -- 172.21.15.45:0/1477386769 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c151ff0 con 0x7f1d1c0c9720 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d22381640 1 --2- 172.21.15.45:0/1477386769 >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 0x7f1d1c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.627+0000 7f1d22b82640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 0x7f1d1c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.629+0000 7f1d21b80640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c06d6b0 tx=0x7f1d0c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f924e7cfe7c790 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.629+0000 7f1d2137f640 1 -- 172.21.15.45:0/1477386769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c030850 con 0x7f1d1c0c9720 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.629+0000 7f1d2137f640 1 -- 172.21.15.45:0/1477386769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0309b0 con 0x7f1d1c0c9720 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.629+0000 7f1d2137f640 1 -- 172.21.15.45:0/1477386769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c030d40 con 0x7f1d1c0c9720 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 -- 172.21.15.45:0/1477386769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c0c9720 msgr2=0x7f1d1c0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c06d6b0 tx=0x7f1d0c02b990 comp rx=0 tx=0).stop 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 -- 172.21.15.45:0/1477386769 shutdown_connections 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c8470 0x7f1d1c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 --2- 172.21.15.45:0/1477386769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c0c9720 0x7f1d1c0c7f30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 --2- 172.21.15.45:0/1477386769 >> v2:172.21.15.114:3300/0 conn(0x7f1d1c151c10 0x7f1d1c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 -- 172.21.15.45:0/1477386769 >> 172.21.15.45:0/1477386769 conn(0x7f1d1c0ab9c0 msgr2=0x7f1d1c0abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 -- 172.21.15.45:0/1477386769 shutdown_connections 2023-12-08T08:15:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.630+0000 7f1d245e5640 1 -- 172.21.15.45:0/1477386769 wait complete. 2023-12-08T08:15:03.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.631+0000 7f1d245e5640 1 Processor -- start 2023-12-08T08:15:03.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 -- start start 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d1c0c8470 0x7f1d1c0bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c9720 0x7f1d1c1de840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c1ea930 con 0x7f1d1c151c10 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c1e0a90 con 0x7f1d1c0c8470 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.632+0000 7f1d245e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c1e07b0 con 0x7f1d1c0c9720 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60926/0 (socket says 172.21.15.45:60926) 2023-12-08T08:15:03.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 -- 172.21.15.45:0/660752527 learned_addr learned my addr 172.21.15.45:0/660752527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d21b80640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c9720 0x7f1d1c1de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22381640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d1c0c8470 0x7f1d1c0bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 -- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c9720 msgr2=0x7f1d1c1de840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c9720 0x7f1d1c1de840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 -- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d1c0c8470 msgr2=0x7f1d1c0bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d1c0c8470 0x7f1d1c0bddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.633+0000 7f1d22b82640 1 -- 172.21.15.45:0/660752527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0094d0 con 0x7f1d1c151c10 2023-12-08T08:15:03.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d22b82640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400cef0 tx=0x7f1d1400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400d840 con 0x7f1d1c151c10 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400d9a0 con 0x7f1d1c151c10 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c1ea2e0 con 0x7f1d1c151c10 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400dd50 con 0x7f1d1c151c10 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.634+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0be300 con 0x7f1d1c151c10 2023-12-08T08:15:03.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.635+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c1ea140 con 0x7f1d1c151c10 2023-12-08T08:15:03.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.637+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d1401e3b0 con 0x7f1d1c151c10 2023-12-08T08:15:03.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.638+0000 7f1d12ffd640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 0x7f1d0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:03.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.638+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1d1408a5e0 con 0x7f1d1c151c10 2023-12-08T08:15:03.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.638+0000 7f1d22381640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 0x7f1d0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:03.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.639+0000 7f1d22381640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 0x7f1d0006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800b840 tx=0x7f1d18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:03.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.641+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d14055430 con 0x7f1d1c151c10 2023-12-08T08:15:03.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:03.835+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1d1c1ea140 con 0x7f1d1c151c10 2023-12-08T08:15:04.076 INFO:tasks.ceph.mds.d.smithi114.stderr:2023-12-08T08:15:04.074+0000 7f213f55a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:15:04.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.391+0000 7f1d12ffd640 1 -- 172.21.15.45:0/660752527 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1d1c1ea140 con 0x7f1d1c151c10 2023-12-08T08:15:04.393 INFO:teuthology.orchestra.run.smithi045.stderr:set pool 4 allow_ec_overwrites to true 2023-12-08T08:15:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.394+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 msgr2=0x7f1d0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.394+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 0x7f1d0006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800b840 tx=0x7f1d18008040 comp rx=0 tx=0).stop 2023-12-08T08:15:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.394+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 msgr2=0x7f1d1c14af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.394+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400cef0 tx=0x7f1d1400a710 comp rx=0 tx=0).stop 2023-12-08T08:15:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 shutdown_connections 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d0006ae40 0x7f1d0006d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d1c0c9720 0x7f1d1c1de840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d1c151c10 0x7f1d1c14af30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 --2- 172.21.15.45:0/660752527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d1c0c8470 0x7f1d1c0bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 >> 172.21.15.45:0/660752527 conn(0x7f1d1c0ab9c0 msgr2=0x7f1d1c0abda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 shutdown_connections 2023-12-08T08:15:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.395+0000 7f1d245e5640 1 -- 172.21.15.45:0/660752527 wait complete. 2023-12-08T08:15:04.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-08T08:15:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.626+0000 7fafb8600640 1 Processor -- start 2023-12-08T08:15:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.626+0000 7fafb8600640 1 -- start start 2023-12-08T08:15:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafb00c05a0 0x7fafb0159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0980 0x7fafb0155a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fafb00c0da0 0x7fafb0155f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00c1f00 con 0x7fafb00c05a0 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006c9a0 con 0x7fafb00c0da0 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb8600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb006bf30 con 0x7fafb00c0980 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb639c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafb00c05a0 0x7fafb0159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb639c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafb00c05a0 0x7fafb0159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60938/0 (socket says 172.21.15.45:60938) 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb639c640 1 -- 172.21.15.45:0/3668082526 learned_addr learned my addr 172.21.15.45:0/3668082526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb6b9d640 1 --2- 172.21.15.45:0/3668082526 >> v2:172.21.15.114:3300/0 conn(0x7fafb00c0da0 0x7fafb0155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.628+0000 7fafb5b9b640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0980 0x7fafb0155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.629+0000 7fafb639c640 1 -- 172.21.15.45:0/3668082526 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0980 msgr2=0x7fafb0155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.629+0000 7fafb639c640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0980 0x7fafb0155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.629+0000 7fafb639c640 1 -- 172.21.15.45:0/3668082526 >> v2:172.21.15.114:3300/0 conn(0x7fafb00c0da0 msgr2=0x7fafb0155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.629+0000 7fafb639c640 1 --2- 172.21.15.45:0/3668082526 >> v2:172.21.15.114:3300/0 conn(0x7fafb00c0da0 0x7fafb0155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.629+0000 7fafb639c640 1 -- 172.21.15.45:0/3668082526 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb006c210 con 0x7fafb00c05a0 2023-12-08T08:15:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.630+0000 7fafb639c640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb0159380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb006e590 tx=0x7fafac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c6a7ec875cf717 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.630+0000 7fafb539a640 1 -- 172.21.15.45:0/3668082526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac031870 con 0x7fafb00c05a0 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.630+0000 7fafb539a640 1 -- 172.21.15.45:0/3668082526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac0319d0 con 0x7fafb00c05a0 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.630+0000 7fafb539a640 1 -- 172.21.15.45:0/3668082526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac031d60 con 0x7fafb00c05a0 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 -- 172.21.15.45:0/3668082526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 msgr2=0x7fafb0159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb0159380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb006e590 tx=0x7fafac02b910 comp rx=0 tx=0).stop 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 -- 172.21.15.45:0/3668082526 shutdown_connections 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 --2- 172.21.15.45:0/3668082526 >> v2:172.21.15.114:3300/0 conn(0x7fafb00c0da0 0x7fafb0155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0980 0x7fafb0155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 --2- 172.21.15.45:0/3668082526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb0159380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 -- 172.21.15.45:0/3668082526 >> 172.21.15.45:0/3668082526 conn(0x7fafb00c2430 msgr2=0x7fafb00c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 -- 172.21.15.45:0/3668082526 shutdown_connections 2023-12-08T08:15:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.631+0000 7fafb8600640 1 -- 172.21.15.45:0/3668082526 wait complete. 2023-12-08T08:15:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.633+0000 7fafb8600640 1 Processor -- start 2023-12-08T08:15:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.633+0000 7fafb8600640 1 -- start start 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb00c0980 0x7fafb00ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 0x7fafb015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00aad90 con 0x7fafb00c05a0 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00aa180 con 0x7fafb00c0980 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb8600640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00aa460 con 0x7fafb00c0da0 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.634+0000 7fafb639c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60940/0 (socket says 172.21.15.45:60940) 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 -- 172.21.15.45:0/730462545 learned_addr learned my addr 172.21.15.45:0/730462545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 -- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 msgr2=0x7fafb015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb5b9b640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb00c0980 0x7fafb00ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb6b9d640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 0x7fafb015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 0x7fafb015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 -- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb00c0980 msgr2=0x7fafb00ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb00c0980 0x7fafb00ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 -- 172.21.15.45:0/730462545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094d0 con 0x7fafb00c05a0 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb6b9d640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 0x7fafb015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.635+0000 7fafb639c640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fafac02b950 tx=0x7fafac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.636+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac03ad30 con 0x7fafb00c05a0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.636+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac0443f0 con 0x7fafb00c05a0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.636+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0447a0 con 0x7fafb00c05a0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.636+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00aa740 con 0x7fafb00c05a0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.636+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb015a630 con 0x7fafb00c05a0 2023-12-08T08:15:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.637+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0074670 con 0x7fafb00c05a0 2023-12-08T08:15:04.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.638+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafac04d450 con 0x7fafb00c05a0 2023-12-08T08:15:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.639+0000 7fafa6ffd640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 0x7faf9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.639+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fafac02d040 con 0x7fafb00c05a0 2023-12-08T08:15:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.639+0000 7fafb5b9b640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 0x7faf9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:04.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.640+0000 7fafb5b9b640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 0x7faf9406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafb00a7360 tx=0x7fafa0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.644+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafac076cd0 con 0x7fafb00c05a0 2023-12-08T08:15:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:04.876+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fafb0155da0 con 0x7fafb00c05a0 2023-12-08T08:15:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.464+0000 7fafa6ffd640 1 -- 172.21.15.45:0/730462545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fafac035070 con 0x7fafb00c05a0 2023-12-08T08:15:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 4 to fsmap 2023-12-08T08:15:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 msgr2=0x7faf9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 0x7faf9406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafb00a7360 tx=0x7fafa0008040 comp rx=0 tx=0).stop 2023-12-08T08:15:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 msgr2=0x7fafb01edf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fafac02b950 tx=0x7fafac0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 shutdown_connections 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf9406ae40 0x7faf9406d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb00c0da0 0x7fafb015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb00c0980 0x7fafb00ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 --2- 172.21.15.45:0/730462545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb00c05a0 0x7fafb01edf40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 >> 172.21.15.45:0/730462545 conn(0x7fafb00c2430 msgr2=0x7fafb0158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:05.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.468+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 shutdown_connections 2023-12-08T08:15:05.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.469+0000 7fafb8600640 1 -- 172.21.15.45:0/730462545 wait complete. 2023-12-08T08:15:05.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.719+0000 7fc9ca1dc640 1 Processor -- start 2023-12-08T08:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.719+0000 7fc9ca1dc640 1 -- start start 2023-12-08T08:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.720+0000 7fc9ca1dc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9c4156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9ca1dc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c414c880 con 0x7fc9c40a4d10 2023-12-08T08:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9ca1dc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40c63b0 con 0x7fc9c414c4a0 2023-12-08T08:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9ca1dc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c4730 con 0x7fc9c4153f90 2023-12-08T08:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9c2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc9c40a4d10 0x7fc9c4153880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60046/0 (socket says 172.21.15.45:60046) 2023-12-08T08:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9c2ffd640 1 -- 172.21.15.45:0/1477430052 learned_addr learned my addr 172.21.15.45:0/1477430052 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979273830 0 0) 0x7fc9c414c880 con 0x7fc9c40a4d10 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003520 con 0x7fc9c40a4d10 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.721+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9c4156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550518761 0 0) 0x7fc9ac003520 con 0x7fc9c40a4d10 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 msgr2=0x7fc9c4156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9c4156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 >> v1:172.21.15.114:6789/0 conn(0x7fc9c414c4a0 legacy=0x7fc9c4155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40a5210 con 0x7fc9c40a4d10 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fc9b8001670 con 0x7fc9c40a4d10 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 >> v1:172.21.15.45:6789/0 conn(0x7fc9c40a4d10 legacy=0x7fc9c4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac0039a0 0x7fc9ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9ac004d00 0x7fc9ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c4730 con 0x7fc9ac004d00 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00bb60 con 0x7fc9ac0039a0 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00bd20 con 0x7fc9c4153f90 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9ac004d00 0x7fc9ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c37fe640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac0039a0 0x7fc9ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c2ffd640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c3fff640 1 -- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 msgr2=0x7fc9ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.722+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.723+0000 7fc9c3fff640 1 -- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac0039a0 msgr2=0x7fc9ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.723+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac0039a0 0x7fc9ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.723+0000 7fc9c3fff640 1 -- 172.21.15.45:0/1477430052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac003520 con 0x7fc9ac004d00 2023-12-08T08:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.723+0000 7fc9c2ffd640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c4153f90 0x7fc9ac0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.724+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9ac004d00 0x7fc9ac005180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007360 tx=0x7fc9ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e209945abdb2eba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.724+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc02ccd0 con 0x7fc9ac004d00 2023-12-08T08:15:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.724+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc02ce30 con 0x7fc9ac004d00 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.724+0000 7fc9c27fc640 1 -- 172.21.15.45:0/1477430052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc034660 con 0x7fc9ac004d00 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1477430052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9ac004d00 msgr2=0x7fc9ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1477430052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9ac004d00 0x7fc9ac005180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007360 tx=0x7fc9ac0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9c3fff640 1 -- 172.21.15.45:0/1477430052 reap_dead start 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1477430052 shutdown_connections 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1477430052 >> 172.21.15.45:0/1477430052 conn(0x7fc9c40661f0 msgr2=0x7fc9c4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:05.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1477430052 shutdown_connections 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.725+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1477430052 wait complete. 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.726+0000 7fc9ca1dc640 1 Processor -- start 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 -- start start 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac004d00 0x7fc9c414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c414f4a0 0x7fc9c414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4153340 con 0x7fc9c40a6880 2023-12-08T08:15:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40a7fb0 con 0x7fc9ac004d00 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.727+0000 7fc9ca1dc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40a8290 con 0x7fc9c414f4a0 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47634/0 (socket says 172.21.15.45:47634) 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 -- 172.21.15.45:0/1469003562 learned_addr learned my addr 172.21.15.45:0/1469003562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c37fe640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac004d00 0x7fc9c414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c3fff640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c414f4a0 0x7fc9c414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 -- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c414f4a0 msgr2=0x7fc9c414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c414f4a0 0x7fc9c414f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 -- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac004d00 msgr2=0x7fc9c414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac004d00 0x7fc9c414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.728+0000 7fc9c2ffd640 1 -- 172.21.15.45:0/1469003562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40a6080 con 0x7fc9c40a6880 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9c2ffd640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d8e0 tx=0x7fc9b800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80074e0 con 0x7fc9c40a6880 2023-12-08T08:15:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8007640 con 0x7fc9c40a6880 2023-12-08T08:15:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c40a6360 con 0x7fc9c40a6880 2023-12-08T08:15:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80049e0 con 0x7fc9c40a6880 2023-12-08T08:15:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.729+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c40a72e0 con 0x7fc9c40a6880 2023-12-08T08:15:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.730+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c40a84d0 con 0x7fc9c40a6880 2023-12-08T08:15:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.731+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9b8004b40 con 0x7fc9c40a6880 2023-12-08T08:15:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.733+0000 7fc9abfff640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.733+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9b80898b0 con 0x7fc9c40a6880 2023-12-08T08:15:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.733+0000 7fc9c37fe640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.734+0000 7fc9c37fe640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 0x7fc9b006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.737+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9c40a84d0 con 0x7fc9c40a6880 2023-12-08T08:15:05.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.975+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c40a84d0 con 0x7fc9c40a6880 2023-12-08T08:15:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.976+0000 7fc9abfff640 1 -- 172.21.15.45:0/1469003562 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fc9c40a84d0 con 0x7fc9c40a6880 2023-12-08T08:15:05.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:05.978 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:04.877736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T08:15:05.979 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 msgr2=0x7fc9b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 0x7fc9b006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4009040 comp rx=0 tx=0).stop 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 msgr2=0x7fc9c41e8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d8e0 tx=0x7fc9b800dda0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 shutdown_connections 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc9b006ae40 0x7fc9b006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9c414f4a0 0x7fc9c414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c40a6880 0x7fc9c41e8e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 --2- 172.21.15.45:0/1469003562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9ac004d00 0x7fc9c414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:05.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 >> 172.21.15.45:0/1469003562 conn(0x7fc9c40661f0 msgr2=0x7fc9c41558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:05.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 shutdown_connections 2023-12-08T08:15:05.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:05.979+0000 7fc9ca1dc640 1 -- 172.21.15.45:0/1469003562 wait complete. 2023-12-08T08:15:06.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.229+0000 7ffb3999e640 1 Processor -- start 2023-12-08T08:15:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.229+0000 7ffb3999e640 1 -- start start 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3999e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffb340c16a0 0x7ffb340aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3999e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb34154850 con 0x7ffb3414e840 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3999e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb34154b30 con 0x7ffb340c1210 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3999e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3414ec20 con 0x7ffb340c16a0 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3899c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffb3414e840 0x7ffb34151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60052/0 (socket says 172.21.15.45:60052) 2023-12-08T08:15:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.231+0000 7ffb3899c640 1 -- 172.21.15.45:0/3939077517 learned_addr learned my addr 172.21.15.45:0/3939077517 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633472311 0 0) 0x7ffb34154850 con 0x7ffb3414e840 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb1c005730 con 0x7ffb3414e840 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb3919d640 1 --2- 172.21.15.45:0/3939077517 >> v2:172.21.15.114:3300/0 conn(0x7ffb340c16a0 0x7ffb340aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380531217 0 0) 0x7ffb1c005730 con 0x7ffb3414e840 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 >> v2:172.21.15.114:3300/0 conn(0x7ffb340c16a0 msgr2=0x7ffb340aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 --2- 172.21.15.45:0/3939077517 >> v2:172.21.15.114:3300/0 conn(0x7ffb340c16a0 0x7ffb340aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 >> v1:172.21.15.114:6789/0 conn(0x7ffb340c1210 legacy=0x7ffb340a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34154e10 con 0x7ffb3414e840 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ffb30001670 con 0x7ffb3414e840 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 >> v1:172.21.15.45:6789/0 conn(0x7ffb3414e840 legacy=0x7ffb34151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c005bd0 0x7ffb1c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.232+0000 7ffb2b7fe640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb1c0069d0 0x7ffb1c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb2b7fe640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb1c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3414ec20 con 0x7ffb1c0074b0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c00e3d0 con 0x7ffb1c005bd0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c00e590 con 0x7ffb1c0069d0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb1c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3899c640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c005bd0 0x7ffb1c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 -- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb1c0069d0 msgr2=0x7ffb1c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb2bfff640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb1c0069d0 0x7ffb1c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb1c0069d0 0x7ffb1c006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 -- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c005bd0 msgr2=0x7ffb1c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c005bd0 0x7ffb1c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.233+0000 7ffb3919d640 1 -- 172.21.15.45:0/3939077517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c005730 con 0x7ffb1c0074b0 2023-12-08T08:15:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.234+0000 7ffb3919d640 1 -- 172.21.15.45:0/3939077517 reap_dead start 2023-12-08T08:15:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.234+0000 7ffb3919d640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb1c00db90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c007360 tx=0x7ffb1c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8003a6fcdfd4d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c02ccf0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c02ce90 con 0x7ffb1c0074b0 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb2b7fe640 1 -- 172.21.15.45:0/3939077517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c003bd0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 -- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 msgr2=0x7ffb1c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb1c00db90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c007360 tx=0x7ffb1c007a00 comp rx=0 tx=0).stop 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 -- 172.21.15.45:0/3939077517 shutdown_connections 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 --2- 172.21.15.45:0/3939077517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb1c00db90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 -- 172.21.15.45:0/3939077517 >> 172.21.15.45:0/3939077517 conn(0x7ffb340c5780 msgr2=0x7ffb340c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.235+0000 7ffb3999e640 1 -- 172.21.15.45:0/3939077517 shutdown_connections 2023-12-08T08:15:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.236+0000 7ffb3999e640 1 -- 172.21.15.45:0/3939077517 wait complete. 2023-12-08T08:15:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.237+0000 7ffb3999e640 1 Processor -- start 2023-12-08T08:15:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.237+0000 7ffb3999e640 1 -- start start 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 0x7ffb34150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3406d130 0x7ffb341e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341e96d0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3406ff60 con 0x7ffb341ed650 2023-12-08T08:15:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.238+0000 7ffb3999e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341e98e0 con 0x7ffb3406d130 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47648/0 (socket says 172.21.15.45:47648) 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 -- 172.21.15.45:0/680178110 learned_addr learned my addr 172.21.15.45:0/680178110 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 -- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3406d130 msgr2=0x7ffb341e9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3406d130 0x7ffb341e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 -- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 msgr2=0x7ffb34150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb2bfff640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 0x7ffb34150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 0x7ffb34150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 -- 172.21.15.45:0/680178110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb341edae0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb2bfff640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 0x7ffb34150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.239+0000 7ffb3899c640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007290 tx=0x7ffb30007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.240+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30001610 con 0x7ffb1c0074b0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.240+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000f960 con 0x7ffb1c0074b0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.240+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000fd10 con 0x7ffb1c0074b0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.240+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3406f9a0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.240+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb341506d0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.241+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340c5580 con 0x7ffb1c0074b0 2023-12-08T08:15:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.242+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb3001d460 con 0x7ffb1c0074b0 2023-12-08T08:15:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.243+0000 7ffb297fa640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 0x7ffb2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.243+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb30089980 con 0x7ffb1c0074b0 2023-12-08T08:15:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.243+0000 7ffb2bfff640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 0x7ffb2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.244+0000 7ffb2bfff640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 0x7ffb2006d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb34154de0 tx=0x7ffb24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.248+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffb300547d0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.448+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb341e9aa0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.451+0000 7ffb297fa640 1 -- 172.21.15.45:0/680178110 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7ffb30057df0 con 0x7ffb1c0074b0 2023-12-08T08:15:06.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:06.454 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 msgr2=0x7ffb2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 0x7ffb2006d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb34154de0 tx=0x7ffb24009040 comp rx=0 tx=0).stop 2023-12-08T08:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 msgr2=0x7ffb3414d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007290 tx=0x7ffb30007690 comp rx=0 tx=0).stop 2023-12-08T08:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 shutdown_connections 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffb2006ae40 0x7ffb2006d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffb3406d130 0x7ffb341e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb341ed650 0x7ffb34150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 --2- 172.21.15.45:0/680178110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1c0074b0 0x7ffb3414d260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.454+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 >> 172.21.15.45:0/680178110 conn(0x7ffb340c5780 msgr2=0x7ffb340c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.455+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 shutdown_connections 2023-12-08T08:15:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.455+0000 7ffb3999e640 1 -- 172.21.15.45:0/680178110 wait complete. 2023-12-08T08:15:06.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.704+0000 7f2e509fa640 1 Processor -- start 2023-12-08T08:15:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.704+0000 7f2e509fa640 1 -- start start 2023-12-08T08:15:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e509fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e4c06ce90 0x7f2e4c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e509fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0c3750 con 0x7f2e4c148d10 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e509fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0c3a30 con 0x7f2e4c0c2550 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e509fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c06d390 con 0x7f2e4c06ce90 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e4c06ce90 0x7f2e4c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e4c06ce90 0x7f2e4c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47658/0 (socket says 172.21.15.45:47658) 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e43fff640 1 -- 172.21.15.45:0/4245235150 learned_addr learned my addr 172.21.15.45:0/4245235150 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.706+0000 7f2e43fff640 1 -- 172.21.15.45:0/4245235150 >> v1:172.21.15.114:6789/0 conn(0x7f2e4c0c2550 legacy=0x7f2e4c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:06.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.707+0000 7f2e43fff640 1 -- 172.21.15.45:0/4245235150 >> v1:172.21.15.45:6789/0 conn(0x7f2e4c148d10 legacy=0x7f2e4c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.707+0000 7f2e4affd640 1 -- 172.21.15.45:0/4245235150 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984910631 0 0) 0x7f2e4c0c3750 con 0x7f2e4c148d10 2023-12-08T08:15:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.707+0000 7f2e43fff640 1 -- 172.21.15.45:0/4245235150 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c06d670 con 0x7f2e4c06ce90 2023-12-08T08:15:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.708+0000 7f2e43fff640 1 --2- 172.21.15.45:0/4245235150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c06ce90 0x7f2e4c152b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf10713144b071b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.708+0000 7f2e4affd640 1 -- 172.21.15.45:0/4245235150 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34030860 con 0x7f2e4c06ce90 2023-12-08T08:15:06.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.708+0000 7f2e4affd640 1 -- 172.21.15.45:0/4245235150 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340309c0 con 0x7f2e4c06ce90 2023-12-08T08:15:06.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.708+0000 7f2e4affd640 1 -- 172.21.15.45:0/4245235150 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34030d50 con 0x7f2e4c06ce90 2023-12-08T08:15:06.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 -- 172.21.15.45:0/4245235150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c06ce90 msgr2=0x7f2e4c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4245235150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c06ce90 0x7f2e4c152b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3402b9a0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 -- 172.21.15.45:0/4245235150 shutdown_connections 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4245235150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c06ce90 0x7f2e4c152b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 -- 172.21.15.45:0/4245235150 >> 172.21.15.45:0/4245235150 conn(0x7f2e4c066d40 msgr2=0x7f2e4c0c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 -- 172.21.15.45:0/4245235150 shutdown_connections 2023-12-08T08:15:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.709+0000 7f2e509fa640 1 -- 172.21.15.45:0/4245235150 wait complete. 2023-12-08T08:15:06.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.711+0000 7f2e509fa640 1 Processor -- start 2023-12-08T08:15:06.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.711+0000 7f2e509fa640 1 -- start start 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2e4c06ce90 0x7f2e4c0beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 0x7f2e4c1e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0aaab0 con 0x7f2e4c148d10 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1e7280 con 0x7f2e4c0c2550 2023-12-08T08:15:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e509fa640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1eccb0 con 0x7f2e4c06ce90 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47672/0 (socket says 172.21.15.45:47672) 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 -- 172.21.15.45:0/4242032649 learned_addr learned my addr 172.21.15.45:0/4242032649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4b7fe640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2e4c06ce90 0x7f2e4c0beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e43fff640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 0x7f2e4c1e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 -- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2e4c06ce90 msgr2=0x7f2e4c0beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2e4c06ce90 0x7f2e4c0beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.712+0000 7f2e4bfff640 1 -- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 msgr2=0x7f2e4c1e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e4bfff640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 0x7f2e4c1e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e4bfff640 1 -- 172.21.15.45:0/4242032649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094d0 con 0x7f2e4c148d10 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e43fff640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 0x7f2e4c1e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e4bfff640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e44001560 tx=0x7f2e4400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44003da0 con 0x7f2e4c148d10 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44005070 con 0x7f2e4c148d10 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c1546f0 con 0x7f2e4c148d10 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44005420 con 0x7f2e4c148d10 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.713+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c154cb0 con 0x7f2e4c148d10 2023-12-08T08:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.715+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c154550 con 0x7f2e4c148d10 2023-12-08T08:15:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.715+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e44005580 con 0x7f2e4c148d10 2023-12-08T08:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.716+0000 7f2e48ff9640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 0x7f2e2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.716+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e44089110 con 0x7f2e4c148d10 2023-12-08T08:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.717+0000 7f2e4b7fe640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 0x7f2e2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.717+0000 7f2e4b7fe640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 0x7f2e2c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c000f60 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.721+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e4c154550 con 0x7f2e4c148d10 2023-12-08T08:15:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.917+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c154550 con 0x7f2e4c148d10 2023-12-08T08:15:06.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.919+0000 7f2e48ff9640 1 -- 172.21.15.45:0/4242032649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2e4c154550 con 0x7f2e4c148d10 2023-12-08T08:15:06.921 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:06.922 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:06.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 msgr2=0x7f2e2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 0x7f2e2c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c000f60 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2023-12-08T08:15:06.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 msgr2=0x7f2e4c1e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:06.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e44001560 tx=0x7f2e4400cc70 comp rx=0 tx=0).stop 2023-12-08T08:15:06.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 shutdown_connections 2023-12-08T08:15:06.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2e2c06ae40 0x7f2e2c06d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4c148d10 0x7f2e4c1e6d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e4c0c2550 0x7f2e4c1e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 --2- 172.21.15.45:0/4242032649 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2e4c06ce90 0x7f2e4c0beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.922+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 >> 172.21.15.45:0/4242032649 conn(0x7f2e4c066d40 msgr2=0x7f2e4c0c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.923+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 shutdown_connections 2023-12-08T08:15:06.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:06.923+0000 7f2e509fa640 1 -- 172.21.15.45:0/4242032649 wait complete. 2023-12-08T08:15:06.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.191+0000 7f98161b6640 1 Processor -- start 2023-12-08T08:15:07.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.191+0000 7f98161b6640 1 -- start start 2023-12-08T08:15:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.192+0000 7f98161b6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9810151c10 0x7f98100c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.192+0000 7f98161b6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9810157b10 0x7f9810157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.192+0000 7f98161b6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100c9290 con 0x7f98100c9720 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.192+0000 7f98161b6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100c56a0 con 0x7f9810157b10 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.192+0000 7f98161b6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100c5250 con 0x7f9810151c10 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9810157b10 0x7f9810157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9810157b10 0x7f9810157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47678/0 (socket says 172.21.15.45:47678) 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 -- 172.21.15.45:0/1574606972 learned_addr learned my addr 172.21.15.45:0/1574606972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980f7fe640 1 --2- 172.21.15.45:0/1574606972 >> v2:172.21.15.114:3300/0 conn(0x7f9810151c10 0x7f98100c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 -- 172.21.15.45:0/1574606972 >> v2:172.21.15.114:3300/0 conn(0x7f9810151c10 msgr2=0x7f98100c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 --2- 172.21.15.45:0/1574606972 >> v2:172.21.15.114:3300/0 conn(0x7f9810151c10 0x7f98100c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 -- 172.21.15.45:0/1574606972 >> v1:172.21.15.114:6789/0 conn(0x7f98100c9720 legacy=0x7f98100c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.193+0000 7f980ffff640 1 -- 172.21.15.45:0/1574606972 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810151ff0 con 0x7f9810157b10 2023-12-08T08:15:07.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.194+0000 7f980ffff640 1 --2- 172.21.15.45:0/1574606972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9810157b10 0x7f9810157fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f981006d6b0 tx=0x7f980802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4032df6c97135e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.195+0000 7f980effd640 1 -- 172.21.15.45:0/1574606972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980802f850 con 0x7f9810157b10 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.195+0000 7f980effd640 1 -- 172.21.15.45:0/1574606972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980802f9b0 con 0x7f9810157b10 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.195+0000 7f980effd640 1 -- 172.21.15.45:0/1574606972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980802fd40 con 0x7f9810157b10 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.195+0000 7f98161b6640 1 -- 172.21.15.45:0/1574606972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9810157b10 msgr2=0x7f9810157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.195+0000 7f98161b6640 1 --2- 172.21.15.45:0/1574606972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9810157b10 0x7f9810157fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f981006d6b0 tx=0x7f980802ba30 comp rx=0 tx=0).stop 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 -- 172.21.15.45:0/1574606972 shutdown_connections 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 --2- 172.21.15.45:0/1574606972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9810157b10 0x7f9810157fa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 --2- 172.21.15.45:0/1574606972 >> v2:172.21.15.114:3300/0 conn(0x7f9810151c10 0x7f98100c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 -- 172.21.15.45:0/1574606972 >> 172.21.15.45:0/1574606972 conn(0x7f98100ab9c0 msgr2=0x7f98100abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 -- 172.21.15.45:0/1574606972 shutdown_connections 2023-12-08T08:15:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.196+0000 7f98161b6640 1 -- 172.21.15.45:0/1574606972 wait complete. 2023-12-08T08:15:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.197+0000 7f98161b6640 1 Processor -- start 2023-12-08T08:15:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.197+0000 7f98161b6640 1 -- start start 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 0x7f9810156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9810157b10 0x7f98100c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810157030 con 0x7f98100c9720 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101ddc50 con 0x7f9810157b10 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.198+0000 7f98161b6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101ddec0 con 0x7f9810151c10 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47684/0 (socket says 172.21.15.45:47684) 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 -- 172.21.15.45:0/256341713 learned_addr learned my addr 172.21.15.45:0/256341713 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:07.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f9806ffd640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 0x7f9810156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980ffff640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9810157b10 0x7f98100c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 -- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 msgr2=0x7f9810156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 0x7f9810156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 -- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9810157b10 msgr2=0x7f98100c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9810157b10 0x7f98100c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 -- 172.21.15.45:0/256341713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080094d0 con 0x7f98100c9720 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f9806ffd640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 0x7f9810156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.199+0000 7f980f7fe640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9800009db0 tx=0x7f980000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.200+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800014480 con 0x7f98100c9720 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.200+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000f040 con 0x7f98100c9720 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.200+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800014800 con 0x7f98100c9720 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.200+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98101de1a0 con 0x7f98100c9720 2023-12-08T08:15:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.200+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9810157200 con 0x7f98100c9720 2023-12-08T08:15:07.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.201+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9810074600 con 0x7f98100c9720 2023-12-08T08:15:07.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.202+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9800014960 con 0x7f98100c9720 2023-12-08T08:15:07.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.203+0000 7f980cff9640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 0x7f97f006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.203+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f980008a4b0 con 0x7f98100c9720 2023-12-08T08:15:07.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.203+0000 7f9806ffd640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 0x7f97f006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.204+0000 7f9806ffd640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 0x7f97f006d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98100c0be0 tx=0x7f97f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.208+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9800055250 con 0x7f98100c9720 2023-12-08T08:15:07.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.437+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98100673e0 con 0x7f98100c9720 2023-12-08T08:15:07.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.439+0000 7f980cff9640 1 -- 172.21.15.45:0/256341713 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f9800058870 con 0x7f98100c9720 2023-12-08T08:15:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:07.443 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:04.877736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T08:15:07.444 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2023-12-08T08:15:07.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 msgr2=0x7f97f006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 0x7f97f006d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98100c0be0 tx=0x7f97f8009040 comp rx=0 tx=0).stop 2023-12-08T08:15:07.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 msgr2=0x7f98101565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9800009db0 tx=0x7f980000c490 comp rx=0 tx=0).stop 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 shutdown_connections 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.441+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f97f006ae90 0x7f97f006d350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9810151c10 0x7f9810156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9810157b10 0x7f98100c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 --2- 172.21.15.45:0/256341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98100c9720 0x7f98101565b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 >> 172.21.15.45:0/256341713 conn(0x7f98100ab9c0 msgr2=0x7f9810150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 shutdown_connections 2023-12-08T08:15:07.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.442+0000 7f98161b6640 1 -- 172.21.15.45:0/256341713 wait complete. 2023-12-08T08:15:07.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:07.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.683+0000 7f75fb59e640 1 Processor -- start 2023-12-08T08:15:07.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.684+0000 7f75fb59e640 1 -- start start 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fb59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75fc1519c0 0x7f75fc1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc0c7a50 0x7f75fc0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fb59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0c4a00 con 0x7f75fc0c44d0 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fb59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0c4ce0 con 0x7f75fc1519c0 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc1579e0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75fc1519c0 0x7f75fc1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.685+0000 7f75fa59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75fc1519c0 0x7f75fc1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47700/0 (socket says 172.21.15.45:47700) 2023-12-08T08:15:07.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.686+0000 7f75fa59c640 1 -- 172.21.15.45:0/1726110317 learned_addr learned my addr 172.21.15.45:0/1726110317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:07.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.686+0000 7f75fa59c640 1 -- 172.21.15.45:0/1726110317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc0c7a50 msgr2=0x7f75fc0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:07.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.686+0000 7f75fa59c640 1 --2- 172.21.15.45:0/1726110317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc0c7a50 0x7f75fc0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.686+0000 7f75fa59c640 1 -- 172.21.15.45:0/1726110317 >> v1:172.21.15.114:6789/0 conn(0x7f75fc0c44d0 legacy=0x7f75fc154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:07.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.686+0000 7f75fa59c640 1 -- 172.21.15.45:0/1726110317 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc157cc0 con 0x7f75fc1519c0 2023-12-08T08:15:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.687+0000 7f75fa59c640 1 --2- 172.21.15.45:0/1726110317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc1519c0 0x7f75fc1584c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009870 tx=0x7f75ec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4466767ab4403bab server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.687+0000 7f75f959a640 1 -- 172.21.15.45:0/1726110317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0317c0 con 0x7f75fc1519c0 2023-12-08T08:15:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.687+0000 7f75f959a640 1 -- 172.21.15.45:0/1726110317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec031920 con 0x7f75fc1519c0 2023-12-08T08:15:07.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.687+0000 7f75f959a640 1 -- 172.21.15.45:0/1726110317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec031cb0 con 0x7f75fc1519c0 2023-12-08T08:15:07.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 -- 172.21.15.45:0/1726110317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc1519c0 msgr2=0x7f75fc1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 --2- 172.21.15.45:0/1726110317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc1519c0 0x7f75fc1584c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009870 tx=0x7f75ec02b860 comp rx=0 tx=0).stop 2023-12-08T08:15:07.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 -- 172.21.15.45:0/1726110317 shutdown_connections 2023-12-08T08:15:07.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 --2- 172.21.15.45:0/1726110317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc0c7a50 0x7f75fc0ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 --2- 172.21.15.45:0/1726110317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc1519c0 0x7f75fc1584c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 -- 172.21.15.45:0/1726110317 >> 172.21.15.45:0/1726110317 conn(0x7f75fc0661f0 msgr2=0x7f75fc066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:07.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 -- 172.21.15.45:0/1726110317 shutdown_connections 2023-12-08T08:15:07.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.688+0000 7f75fb59e640 1 -- 172.21.15.45:0/1726110317 wait complete. 2023-12-08T08:15:07.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.690+0000 7f75fb59e640 1 Processor -- start 2023-12-08T08:15:07.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.690+0000 7f75fb59e640 1 -- start start 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 0x7f75fc1ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 0x7f75fc14a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c3ac0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c3500 con 0x7f75fc0c44d0 2023-12-08T08:15:07.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75fb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c37e0 con 0x7f75fc1519c0 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75f9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75f9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47702/0 (socket says 172.21.15.45:47702) 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.691+0000 7f75f9d9b640 1 -- 172.21.15.45:0/3575351370 learned_addr learned my addr 172.21.15.45:0/3575351370 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fa59c640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 0x7f75fc1ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fad9d640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 0x7f75fc14a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 -- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 msgr2=0x7f75fc14a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 0x7f75fc14a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 -- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 msgr2=0x7f75fc1ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 0x7f75fc1ed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 -- 172.21.15.45:0/3575351370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0094d0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fa59c640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 0x7f75fc1ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fad9d640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 0x7f75fc14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75f9d9b640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75f000b3f0 tx=0x7f75f000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0011830 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0011990 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0011d40 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc0be040 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.692+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc0c26d0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.694+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0743e0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.694+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75f001a400 con 0x7f75fc0c7a50 2023-12-08T08:15:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.695+0000 7f75eaffd640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 0x7f75dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.696+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75f0089720 con 0x7f75fc0c7a50 2023-12-08T08:15:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.696+0000 7f75fa59c640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 0x7f75dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.696+0000 7f75fa59c640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 0x7f75dc06d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75ec036000 tx=0x7f75ec03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.700+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75f00544d0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.898+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75fc0c7190 con 0x7f75fc0c7a50 2023-12-08T08:15:07.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.900+0000 7f75eaffd640 1 -- 172.21.15.45:0/3575351370 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f75f0057af0 con 0x7f75fc0c7a50 2023-12-08T08:15:07.903 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:07.903 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.903+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 msgr2=0x7f75dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.903+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 0x7f75dc06d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75ec036000 tx=0x7f75ec03d040 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.903+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 msgr2=0x7f75fc1edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.903+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75f000b3f0 tx=0x7f75f000b8b0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 shutdown_connections 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75dc06ae70 0x7f75dc06d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f75fc1519c0 0x7f75fc14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc0c7a50 0x7f75fc1edbe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 --2- 172.21.15.45:0/3575351370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75fc0c44d0 0x7f75fc1ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:07.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 >> 172.21.15.45:0/3575351370 conn(0x7f75fc0661f0 msgr2=0x7f75fc0c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:07.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 shutdown_connections 2023-12-08T08:15:07.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:07.904+0000 7f75fb59e640 1 -- 172.21.15.45:0/3575351370 wait complete. 2023-12-08T08:15:08.325 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:15:00.337648+0000', 'modified': '2023-12-08T08:15:04.877736+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1952493586', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 1952493586}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1952493586}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-08T08:15:08.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:15:08.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-08T08:15:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.562+0000 7f7652d5c640 1 Processor -- start 2023-12-08T08:15:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.562+0000 7f7652d5c640 1 -- start start 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7652d5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f764c0c6550 0x7f764c0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7652d5c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7652d5c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0c6b30 con 0x7f764c14e310 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7652d5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0c6e10 con 0x7f764c0c6550 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7652d5c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c06ae80 con 0x7f764c06b960 2023-12-08T08:15:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7651d5a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f764c14e310 0x7f764c154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60078/0 (socket says 172.21.15.45:60078) 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7651559640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f764c0c6550 0x7f764c0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.564+0000 7f7651d5a640 1 -- 172.21.15.45:0/1183948827 learned_addr learned my addr 172.21.15.45:0/1183948827 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.565+0000 7f765255b640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.565+0000 7f7651559640 1 -- 172.21.15.45:0/1183948827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 msgr2=0x7f764c0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.565+0000 7f7651559640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.565+0000 7f7651559640 1 -- 172.21.15.45:0/1183948827 >> v1:172.21.15.45:6789/0 conn(0x7f764c14e310 legacy=0x7f764c154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.565+0000 7f7651559640 1 -- 172.21.15.45:0/1183948827 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c06b160 con 0x7f764c0c6550 2023-12-08T08:15:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7651559640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c0c7a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097a0 tx=0x7f763c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2441ba241d40e2e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7650d58640 1 -- 172.21.15.45:0/1183948827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c02f050 con 0x7f764c0c6550 2023-12-08T08:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7650d58640 1 -- 172.21.15.45:0/1183948827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c031700 con 0x7f764c0c6550 2023-12-08T08:15:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7650d58640 1 -- 172.21.15.45:0/1183948827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c031a90 con 0x7f764c0c6550 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7652d5c640 1 -- 172.21.15.45:0/1183948827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 msgr2=0x7f764c0c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.567+0000 7f7652d5c640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c0c7a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097a0 tx=0x7f763c02b7a0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 -- 172.21.15.45:0/1183948827 shutdown_connections 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 --2- 172.21.15.45:0/1183948827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c0c7a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 -- 172.21.15.45:0/1183948827 >> 172.21.15.45:0/1183948827 conn(0x7f764c0ab710 msgr2=0x7f764c0abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 -- 172.21.15.45:0/1183948827 shutdown_connections 2023-12-08T08:15:08.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.568+0000 7f7652d5c640 1 -- 172.21.15.45:0/1183948827 wait complete. 2023-12-08T08:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.570+0000 7f7652d5c640 1 Processor -- start 2023-12-08T08:15:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.570+0000 7f7652d5c640 1 -- start start 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c1ea800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f764c14e310 0x7f764c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1ead40 con 0x7f764c0c6550 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0ae360 con 0x7f764c14e310 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7652d5c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0aa2e0 con 0x7f764c06b960 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7651559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7651559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47722/0 (socket says 172.21.15.45:47722) 2023-12-08T08:15:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7651559640 1 -- 172.21.15.45:0/2811683475 learned_addr learned my addr 172.21.15.45:0/2811683475 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c1ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.572+0000 7f765255b640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f764c14e310 0x7f764c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 -- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 msgr2=0x7f764c1ea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c1ea800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 -- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f764c14e310 msgr2=0x7f764c146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f764c14e310 0x7f764c146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 -- 172.21.15.45:0/2811683475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009400 con 0x7f764c0c6550 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f7651559640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f763c02bdb0 tx=0x7f763c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.573+0000 7f76427fc640 1 -- 172.21.15.45:0/2811683475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c033b30 con 0x7f764c0c6550 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.574+0000 7f76427fc640 1 -- 172.21.15.45:0/2811683475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c033cb0 con 0x7f764c0c6550 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.574+0000 7f76427fc640 1 -- 172.21.15.45:0/2811683475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c03d650 con 0x7f764c0c6550 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.574+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c0c3b00 con 0x7f764c0c6550 2023-12-08T08:15:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.574+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c0acc60 con 0x7f764c0c6550 2023-12-08T08:15:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.576+0000 7f76427fc640 1 -- 172.21.15.45:0/2811683475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f763c03a050 con 0x7f764c0c6550 2023-12-08T08:15:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.577+0000 7f76427fc640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 0x7f763006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.578+0000 7f76427fc640 1 -- 172.21.15.45:0/2811683475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f763c0ab340 con 0x7f764c0c6550 2023-12-08T08:15:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.578+0000 7f7656c2d740 1 Processor -- start 2023-12-08T08:15:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.578+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 0x7f763006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.578+0000 7f7656c2d740 1 -- start start 2023-12-08T08:15:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.578+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 0x7f763006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f764c1543b0 tx=0x7f7648007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef6808880 con 0x563ef68ab880 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef6817ae0 con 0x563ef68e4b30 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef68151d0 con 0x563ef68e8340 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47730/0 (socket says 172.21.15.45:47730) 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 -- 172.21.15.45:0/180010626 learned_addr learned my addr 172.21.15.45:0/180010626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f765255b640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651d5a640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 -- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 msgr2=0x563ef68a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 -- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 msgr2=0x563ef68e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 -- 172.21.15.45:0/180010626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ef67d8860 con 0x563ef68ab880 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651d5a640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.579+0000 7f7651559640 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097a0 tx=0x7f763c0797c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa20dbe31e0e714 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.580+0000 7f762f7fe640 1 -- 172.21.15.45:0/180010626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c02f020 con 0x563ef68ab880 2023-12-08T08:15:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.580+0000 7f762f7fe640 1 -- 172.21.15.45:0/180010626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c07d070 con 0x563ef68ab880 2023-12-08T08:15:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.580+0000 7f762f7fe640 1 -- 172.21.15.45:0/180010626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c07df00 con 0x563ef68ab880 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.580+0000 7f7656c2d740 1 -- 172.21.15.45:0/180010626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 msgr2=0x563ef68e7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.580+0000 7f7656c2d740 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f763c0097a0 tx=0x7f763c0797c0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 -- 172.21.15.45:0/180010626 shutdown_connections 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68e7e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 --2- 172.21.15.45:0/180010626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 -- 172.21.15.45:0/180010626 >> 172.21.15.45:0/180010626 conn(0x563ef686bc70 msgr2=0x563ef68cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 -- 172.21.15.45:0/180010626 shutdown_connections 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 -- 172.21.15.45:0/180010626 wait complete. 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.581+0000 7f7656c2d740 1 -- start start 2023-12-08T08:15:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.582+0000 7f7656c2d740 1 Processor -- start 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef6810ac0 con 0x563ef68ab880 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef67ad2f0 con 0x563ef68e4b30 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef67cac70 con 0x563ef68e8340 2023-12-08T08:15:08.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7656c2d740 10 client.0 _ll_register_callbacks cb 0x563ef67cf3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47742/0 (socket says 172.21.15.45:47742) 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 -- 172.21.15.45:0/503349631 learned_addr learned my addr 172.21.15.45:0/503349631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f765255b640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651559640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 -- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 msgr2=0x563ef68c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 -- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 msgr2=0x563ef68ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.583+0000 7f7651d5a640 1 -- 172.21.15.45:0/503349631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c0acc60 con 0x563ef68ab880 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f7651d5a640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7648001e70 tx=0x7f7648000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6997308a638c9c17 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648013e00 con 0x563ef68ab880 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f764801b040 con 0x563ef68ab880 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ef6809aa0 con 0x563ef68ab880 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7648012560 con 0x563ef68ab880 2023-12-08T08:15:08.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f7656c2d740 10 client.4392 fetch_fsmap learned FSMap version 7 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563ef680f140 con 0x563ef68ab880 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ef6809aa0 con 0x563ef68ab880 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.584+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7648012070 con 0x563ef68ab880 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 10 client.4392 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 20 client.4392 populate_metadata read hostname 'smithi045' 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef68f9580 0x563ef68f9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 4 client.4392 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 --> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ef68097c0 con 0x563ef68f9580 2023-12-08T08:15:08.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.585+0000 7f7651559640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef68f9580 0x563ef68f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.586+0000 7f7651559640 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef68f9580 0x563ef68f9960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1920df3815ba899d server_cookie=f6a9d874b6e03ff9 in_seq=0 out_seq=0 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.586+0000 7f762cff9640 10 client.4392 ms_handle_connect on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f762cff9640 1 -- 172.21.15.45:0/503349631 <== mds.0 v2:172.21.15.114:6833/1952493586 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563ef68097c0 con 0x563ef68f9580 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f762cff9640 10 client.4392 handle_command_reply: tid=0 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 client.4392 shutdown 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 msgr2=0x563ef68ebf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7648001e70 tx=0x7f7648000bc0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 shutdown_connections 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef68f9580 0x563ef68f9960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e8340 0x563ef68c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef68ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 --2- 172.21.15.45:0/503349631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68ebf20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f762cff9640 0 client.4392 ms_handle_reset on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.588+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 >> 172.21.15.45:0/503349631 conn(0x563ef686bc70 msgr2=0x563ef68a4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.589+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 shutdown_connections 2023-12-08T08:15:08.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.589+0000 7f7656c2d740 1 -- 172.21.15.45:0/503349631 wait complete. 2023-12-08T08:15:08.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.589+0000 7f7656c2d740 20 client.4392 trim_cache size 0 max 16384 2023-12-08T08:15:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.606+0000 7f7656c2d740 1 Processor -- start 2023-12-08T08:15:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.606+0000 7f7656c2d740 1 -- start start 2023-12-08T08:15:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 0x563ef68a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef6908be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef6573f20 con 0x563ef68e8340 2023-12-08T08:15:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef68de110 con 0x563ef68e4b30 2023-12-08T08:15:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef6819250 con 0x563ef68ab880 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.607+0000 7f765255b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47752/0 (socket says 172.21.15.45:47752) 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 -- 172.21.15.45:0/1777123338 learned_addr learned my addr 172.21.15.45:0/1777123338 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f7651559640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef6908be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f7651d5a640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 0x563ef68a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 -- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 msgr2=0x563ef68a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 0x563ef68a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 -- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 msgr2=0x563ef6908be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef6908be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 -- 172.21.15.45:0/1777123338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ef67acb80 con 0x563ef68e8340 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f7651d5a640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 0x563ef68a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f765255b640 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76440039e0 tx=0x7f7644003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad73e55af1e09c6a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f762ffff640 1 -- 172.21.15.45:0/1777123338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440048a0 con 0x563ef68e8340 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.608+0000 7f762ffff640 1 -- 172.21.15.45:0/1777123338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440153f0 con 0x563ef68e8340 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f762ffff640 1 -- 172.21.15.45:0/1777123338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644015780 con 0x563ef68e8340 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 -- 172.21.15.45:0/1777123338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 msgr2=0x563ef68a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76440039e0 tx=0x7f7644003ea0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 -- 172.21.15.45:0/1777123338 shutdown_connections 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68e8340 0x563ef68a4de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e4b30 0x563ef6908be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 --2- 172.21.15.45:0/1777123338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68ab880 0x563ef68a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 -- 172.21.15.45:0/1777123338 >> 172.21.15.45:0/1777123338 conn(0x563ef686bc70 msgr2=0x563ef68ebd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 -- 172.21.15.45:0/1777123338 shutdown_connections 2023-12-08T08:15:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.609+0000 7f7656c2d740 1 -- 172.21.15.45:0/1777123338 wait complete. 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.610+0000 7f7656c2d740 1 -- start start 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.610+0000 7f7656c2d740 1 Processor -- start 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e4b30 0x563ef6953dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e8340 0x563ef68c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef68bef20 con 0x563ef68ab880 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ef69547d0 con 0x563ef68e8340 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ef68bf080 con 0x563ef68e4b30 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7656c2d740 10 client.0 _ll_register_callbacks cb 0x7f7648001b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7651d5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7651d5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47754/0 (socket says 172.21.15.45:47754) 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.611+0000 7f7651d5a640 1 -- 172.21.15.45:0/2267148114 learned_addr learned my addr 172.21.15.45:0/2267148114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651559640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e4b30 0x563ef6953dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 -- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e4b30 msgr2=0x563ef6953dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e4b30 0x563ef6953dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 -- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e8340 msgr2=0x563ef68c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e8340 0x563ef68c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 -- 172.21.15.45:0/2267148114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644009d00 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f7651d5a640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76480078c0 tx=0x7f764800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e2ba50e4e4c8a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f762cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.612+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648012ca0 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7648012e00 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f763c07d070 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764802c430 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 10 client.4398 fetch_fsmap learned FSMap version 7 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563ef67d2170 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c07d070 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f764801b050 con 0x563ef68ab880 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T08:15:08.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 10 client.4398 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:15:08.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 20 client.4398 populate_metadata read hostname 'smithi045' 2023-12-08T08:15:08.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef694e200 0x563ef68f6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 4 client.4398 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:15:08.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.613+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 --> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563ef65116c0 con 0x563ef694e200 2023-12-08T08:15:08.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.614+0000 7f7651559640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef694e200 0x563ef68f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7651559640 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef694e200 0x563ef68f6070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b7677606f563766 server_cookie=dd5da416e80ca734 in_seq=0 out_seq=0 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f762cff9640 10 client.4398 ms_handle_connect on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f762cff9640 1 -- 172.21.15.45:0/2267148114 <== mds.0 v2:172.21.15.114:6833/1952493586 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563ef65116c0 con 0x563ef694e200 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f762cff9640 10 client.4398 handle_command_reply: tid=0 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 client.4398 shutdown 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 msgr2=0x563ef68be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76480078c0 tx=0x7f764800a000 comp rx=0 tx=0).stop 2023-12-08T08:15:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 shutdown_connections 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x563ef694e200 0x563ef68f6070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x563ef68e4b30 0x563ef6953dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x563ef68e8340 0x563ef68c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 --2- 172.21.15.45:0/2267148114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ef68ab880 0x563ef68be9e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f762cff9640 0 client.4398 ms_handle_reset on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.615+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 >> 172.21.15.45:0/2267148114 conn(0x563ef686bc70 msgr2=0x563ef68ebd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 shutdown_connections 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7656c2d740 1 -- 172.21.15.45:0/2267148114 wait complete. 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7656c2d740 20 client.4398 trim_cache size 0 max 16384 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:15:08.620 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2", 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4273, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 7.7535860159999999, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 7, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 26, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 26, 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.539193767 2023-12-08T08:15:08.621 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 msgr2=0x7f763006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 0x7f763006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f764c1543b0 tx=0x7f7648007e80 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 msgr2=0x7f764c157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.616+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f763c02bdb0 tx=0x7f763c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 shutdown_connections 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f763006ae70 0x7f763006d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f764c14e310 0x7f764c146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f764c0c6550 0x7f764c157f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 --2- 172.21.15.45:0/2811683475 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f764c06b960 0x7f764c1ea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 >> 172.21.15.45:0/2811683475 conn(0x7f764c0ab710 msgr2=0x7f764c0aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 shutdown_connections 2023-12-08T08:15:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.617+0000 7f7652d5c640 1 -- 172.21.15.45:0/2811683475 wait complete. 2023-12-08T08:15:08.637 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:15:08.637 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:08.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:15:08.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.861+0000 7f39660bb640 1 Processor -- start 2023-12-08T08:15:08.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.861+0000 7f39660bb640 1 -- start start 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39660bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39600a7910 0x7f39600c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39660bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39601521b0 0x7f3960155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39660bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960155850 con 0x7f39600c1dc0 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39660bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600c0890 con 0x7f39601521b0 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39660bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600c0b70 con 0x7f39600a7910 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39658ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39601521b0 0x7f3960155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39658ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39601521b0 0x7f3960155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47770/0 (socket says 172.21.15.45:47770) 2023-12-08T08:15:08.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.863+0000 7f39658ba640 1 -- 172.21.15.45:0/2448825965 learned_addr learned my addr 172.21.15.45:0/2448825965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.864+0000 7f39658ba640 1 -- 172.21.15.45:0/2448825965 >> v2:172.21.15.114:3300/0 conn(0x7f39600a7910 msgr2=0x7f39600c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.864+0000 7f39658ba640 1 --2- 172.21.15.45:0/2448825965 >> v2:172.21.15.114:3300/0 conn(0x7f39600a7910 0x7f39600c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.864+0000 7f39658ba640 1 -- 172.21.15.45:0/2448825965 >> v1:172.21.15.114:6789/0 conn(0x7f39600c1dc0 legacy=0x7f396014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:08.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.864+0000 7f39658ba640 1 -- 172.21.15.45:0/2448825965 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600c0e50 con 0x7f39601521b0 2023-12-08T08:15:08.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.865+0000 7f39658ba640 1 --2- 172.21.15.45:0/2448825965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f3960155ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f396006ac30 tx=0x7f395802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dec6b95a166424d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.865+0000 7f3957fff640 1 -- 172.21.15.45:0/2448825965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395802c9f0 con 0x7f39601521b0 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.865+0000 7f3957fff640 1 -- 172.21.15.45:0/2448825965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395802cb50 con 0x7f39601521b0 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.865+0000 7f3957fff640 1 -- 172.21.15.45:0/2448825965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580343f0 con 0x7f39601521b0 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 -- 172.21.15.45:0/2448825965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 msgr2=0x7f3960155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 --2- 172.21.15.45:0/2448825965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f3960155ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f396006ac30 tx=0x7f395802be50 comp rx=0 tx=0).stop 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 -- 172.21.15.45:0/2448825965 shutdown_connections 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 --2- 172.21.15.45:0/2448825965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f3960155ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 --2- 172.21.15.45:0/2448825965 >> v2:172.21.15.114:3300/0 conn(0x7f39600a7910 0x7f39600c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 -- 172.21.15.45:0/2448825965 >> 172.21.15.45:0/2448825965 conn(0x7f39600c5780 msgr2=0x7f39600c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:08.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 -- 172.21.15.45:0/2448825965 shutdown_connections 2023-12-08T08:15:08.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.866+0000 7f39660bb640 1 -- 172.21.15.45:0/2448825965 wait complete. 2023-12-08T08:15:08.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.868+0000 7f39660bb640 1 Processor -- start 2023-12-08T08:15:08.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.868+0000 7f39660bb640 1 -- start start 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39600a7910 0x7f396014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39600c1dc0 0x7f39601dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600bf530 con 0x7f39601521b0 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600bf810 con 0x7f39600a7910 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39660bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a6490 con 0x7f39600c1dc0 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39658ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39658ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47774/0 (socket says 172.21.15.45:47774) 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.869+0000 7f39658ba640 1 -- 172.21.15.45:0/892923245 learned_addr learned my addr 172.21.15.45:0/892923245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39650b9640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39600a7910 0x7f396014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39648b8640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39600c1dc0 0x7f39601dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 -- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39600c1dc0 msgr2=0x7f39601dbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39600c1dc0 0x7f39601dbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 -- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39600a7910 msgr2=0x7f396014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39600a7910 0x7f396014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 -- 172.21.15.45:0/892923245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009b30 con 0x7f39601521b0 2023-12-08T08:15:08.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f39658ba640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3958036040 tx=0x7f3958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.870+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395803e450 con 0x7f39601521b0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.871+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395803e5d0 con 0x7f39601521b0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.871+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395803e980 con 0x7f39601521b0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.871+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39600a6770 con 0x7f39601521b0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.871+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396014f620 con 0x7f39601521b0 2023-12-08T08:15:08.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.872+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39600c0220 con 0x7f39601521b0 2023-12-08T08:15:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.873+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f395803eae0 con 0x7f39601521b0 2023-12-08T08:15:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.874+0000 7f3955ffb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 0x7f394406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.874+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39580ac800 con 0x7f39601521b0 2023-12-08T08:15:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.874+0000 7f39650b9640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 0x7f394406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.875+0000 7f39650b9640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 0x7f394406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b810 tx=0x7f395c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:08.878+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39580775b0 con 0x7f39601521b0 2023-12-08T08:15:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.115+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f396006ae00 con 0x7f39601521b0 2023-12-08T08:15:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.116+0000 7f3955ffb640 1 -- 172.21.15.45:0/892923245 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f395807abd0 con 0x7f39601521b0 2023-12-08T08:15:09.117 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:15:09.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 msgr2=0x7f394406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 0x7f394406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b810 tx=0x7f395c008040 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 msgr2=0x7f39601dc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3958036040 tx=0x7f3958004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 shutdown_connections 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f394406ae40 0x7f394406d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39600c1dc0 0x7f39601dbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39601521b0 0x7f39601dc4f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 --2- 172.21.15.45:0/892923245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39600a7910 0x7f396014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.118+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 >> 172.21.15.45:0/892923245 conn(0x7f39600c5780 msgr2=0x7f396014c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.119+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 shutdown_connections 2023-12-08T08:15:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:09.119+0000 7f39660bb640 1 -- 172.21.15.45:0/892923245 wait complete. 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:15:09.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T08:15:09.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:09.140 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:15:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42123sec preferred_lft 42123sec 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:15:09.198 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:15:09.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:15:09.198 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:09.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:09.681 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:15:09.766 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:15:09.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:09.770 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:15:09.832 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:15:09.832 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:15:09.832 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:15:09.832 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:15:09.832 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:15:09.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:10.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:10.604 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:15:10.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:10.668 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-08T08:15:10.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:10.725 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:10.725 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:10.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:10.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-08T08:15:10.725 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:10.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-08T08:15:10.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-08T08:15:10.881 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:11.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:11.183 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:11.183 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:11.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:15:11.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:15:11.183 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:11.357 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-08T08:15:11.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:11.358 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:11.408 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T08:15:11.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:11.408 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:11.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-08T08:15:11.595 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:15:11.643 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-12-08T08:15:11.643 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-12-08T08:15:11.644 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:11.645 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:11.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:11.646 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-08T08:15:11.693 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:15:11.693 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-08T08:15:11.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-08T08:15:11.827 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2023-12-08T08:15:11.870 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:15:11.871 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:11.872 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:11.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:11.873 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-08T08:15:11.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:2023-12-08T08:15:11.948+0000 7fb24a3b8480 -1 init, newargv = 0x56152a367700 newargc=15 2023-12-08T08:15:11.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[93965]: starting ceph client 2023-12-08T08:15:11.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[93965]: starting fuse 2023-12-08T08:15:11.965 INFO:teuthology.orchestra.run.smithi045.stdout:39 2023-12-08T08:15:11.966 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-08T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.admin")) 2023-12-08T08:15:11.967 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-08T08:15:12.171 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.admin.93965.asok 2023-12-08T08:15:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:15:12.188 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.93965.asok 2023-12-08T08:15:12.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:12.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.93965.asok status 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "admin", 2023-12-08T08:15:12.446 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "93965", 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4410, 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4410 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-08T08:15:12.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1925285187 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1925285187 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4410 192.168.0.1:0/1925285187", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1925285187", 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 7, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 26, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:15:12.448 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-08T08:15:12.449 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-08T08:15:12.449 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:15:12.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:12.464 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-08T08:15:12.465 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:12.518 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-08T08:15:12.518 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:12.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:12.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:12.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:12.616 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-08T08:15:12.717 INFO:teuthology.orchestra.run.smithi045.stdout:# file: . 2023-12-08T08:15:12.717 INFO:teuthology.orchestra.run.smithi045.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-08T08:15:12.717 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:12.718 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:15:12.719 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:15:12.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:13.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.008+0000 7f84396a3640 1 Processor -- start 2023-12-08T08:15:13.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.008+0000 7f84396a3640 1 -- start start 2023-12-08T08:15:13.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f84396a3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8434155ce0 0x7f8434156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f84396a3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434156670 con 0x7f84340a7910 2023-12-08T08:15:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f84396a3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434155850 con 0x7f84341521b0 2023-12-08T08:15:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f84396a3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340c0890 con 0x7f8434155ce0 2023-12-08T08:15:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f8433fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84340a7910 0x7f84340c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60084/0 (socket says 172.21.15.45:60084) 2023-12-08T08:15:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.010+0000 7f8433fff640 1 -- 172.21.15.45:0/4263465346 learned_addr learned my addr 172.21.15.45:0/4263465346 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8438ea2640 1 --2- 172.21.15.45:0/4263465346 >> v2:172.21.15.114:3300/0 conn(0x7f8434155ce0 0x7f8434156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069029359 0 0) 0x7f8424001110 con 0x7f84340a7910 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f841c003520 con 0x7f84340a7910 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618011236 0 0) 0x7f841c003520 con 0x7f84340a7910 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 >> v2:172.21.15.114:3300/0 conn(0x7f8434155ce0 msgr2=0x7f8434156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 --2- 172.21.15.45:0/4263465346 >> v2:172.21.15.114:3300/0 conn(0x7f8434155ce0 0x7f8434156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 >> v1:172.21.15.114:6789/0 conn(0x7f84341521b0 legacy=0x7f843414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340c0b70 con 0x7f84340a7910 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8424001800 con 0x7f84340a7910 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 >> v1:172.21.15.45:6789/0 conn(0x7f84340a7910 legacy=0x7f84340c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f841c0039c0 0x7f841c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 0x7f841c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0051d0 0x7f841c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c0890 con 0x7f841c0047c0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c00c120 con 0x7f841c0051d0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.011+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c00c2e0 con 0x7f841c0039c0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 0x7f841c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f8433fff640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f841c0039c0 0x7f841c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f8438ea2640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0051d0 0x7f841c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 -- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f841c0039c0 msgr2=0x7f841c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f841c0039c0 0x7f841c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 -- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0051d0 msgr2=0x7f841c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0051d0 0x7f841c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f84337fe640 1 -- 172.21.15.45:0/4263465346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c003520 con 0x7f841c0047c0 2023-12-08T08:15:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f8438ea2640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0051d0 0x7f841c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.012+0000 7f8438ea2640 1 -- 172.21.15.45:0/4263465346 reap_dead start 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.013+0000 7f84337fe640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 0x7f841c004c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8434152590 tx=0x7f841c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73701db5bd9e7744 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280052d0 con 0x7f841c0047c0 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842802e050 con 0x7f841c0047c0 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f8432ffd640 1 -- 172.21.15.45:0/4263465346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428003830 con 0x7f841c0047c0 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 -- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 msgr2=0x7f841c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 0x7f841c004c40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8434152590 tx=0x7f841c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 -- 172.21.15.45:0/4263465346 shutdown_connections 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 --2- 172.21.15.45:0/4263465346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841c0047c0 0x7f841c004c40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 -- 172.21.15.45:0/4263465346 >> 172.21.15.45:0/4263465346 conn(0x7f84340c5780 msgr2=0x7f84340c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 -- 172.21.15.45:0/4263465346 shutdown_connections 2023-12-08T08:15:13.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.014+0000 7f84396a3640 1 -- 172.21.15.45:0/4263465346 wait complete. 2023-12-08T08:15:13.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.016+0000 7f84396a3640 1 Processor -- start 2023-12-08T08:15:13.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.016+0000 7f84396a3640 1 -- start start 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 0x7f84341edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84340beda0 0x7f84341447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434149a00 con 0x7f8434144d30 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84341ee0d0 con 0x7f841c0047c0 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.017+0000 7f84396a3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434148c70 con 0x7f84340beda0 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47796/0 (socket says 172.21.15.45:47796) 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 -- 172.21.15.45:0/2978229632 learned_addr learned my addr 172.21.15.45:0/2978229632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f84337fe640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84340beda0 0x7f84341447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8433fff640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 0x7f84341edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 -- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84340beda0 msgr2=0x7f84341447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84340beda0 0x7f84341447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 -- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 msgr2=0x7f84341edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 0x7f84341edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 -- 172.21.15.45:0/2978229632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434148f50 con 0x7f8434144d30 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8433fff640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 0x7f84341edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:13.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.018+0000 7f8438ea2640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84340c32a0 tx=0x7f842c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.019+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c016420 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.019+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c016580 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.019+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0168f0 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.019+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8434149230 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.019+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84340c38e0 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.020+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84340743e0 con 0x7f8434144d30 2023-12-08T08:15:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.021+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f842c016a50 con 0x7f8434144d30 2023-12-08T08:15:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.022+0000 7f8430ff9640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 0x7f842006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.022+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f842c08a820 con 0x7f8434144d30 2023-12-08T08:15:13.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.022+0000 7f8433fff640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 0x7f842006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.023+0000 7f8433fff640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 0x7f842006d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f843404fab0 tx=0x7f8424001df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.027+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f842c0555d0 con 0x7f8434144d30 2023-12-08T08:15:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.226+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84340a92f0 con 0x7f8434144d30 2023-12-08T08:15:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.228+0000 7f8430ff9640 1 -- 172.21.15.45:0/2978229632 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f842c058bf0 con 0x7f8434144d30 2023-12-08T08:15:13.231 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:13.231 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 msgr2=0x7f842006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 0x7f842006d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f843404fab0 tx=0x7f8424001df0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 msgr2=0x7f84340c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84340c32a0 tx=0x7f842c00f520 comp rx=0 tx=0).stop 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 shutdown_connections 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f842006ae70 0x7f842006d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f84340beda0 0x7f84341447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8434144d30 0x7f84340c3e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 --2- 172.21.15.45:0/2978229632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f841c0047c0 0x7f84341edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 >> 172.21.15.45:0/2978229632 conn(0x7f84340c5780 msgr2=0x7f8434150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 shutdown_connections 2023-12-08T08:15:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.231+0000 7f84396a3640 1 -- 172.21.15.45:0/2978229632 wait complete. 2023-12-08T08:15:13.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:13.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.482+0000 7fab0352e640 1 Processor -- start 2023-12-08T08:15:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.482+0000 7fab0352e640 1 -- start start 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab0352e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faafc0c4970 0x7faafc0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab0352e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc155790 0x7faafc155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab0352e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc0c60c0 con 0x7faafc14c280 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab0352e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc152dc0 con 0x7faafc0c4970 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab0352e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc1521d0 con 0x7faafc155790 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab01d2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faafc0c4970 0x7faafc0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab01d2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faafc0c4970 0x7faafc0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47804/0 (socket says 172.21.15.45:47804) 2023-12-08T08:15:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.484+0000 7fab01d2b640 1 -- 172.21.15.45:0/226832321 learned_addr learned my addr 172.21.15.45:0/226832321 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.485+0000 7fab02d2d640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc155790 0x7faafc155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.485+0000 7fab01d2b640 1 -- 172.21.15.45:0/226832321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc155790 msgr2=0x7faafc155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.485+0000 7fab01d2b640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc155790 0x7faafc155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.485+0000 7fab01d2b640 1 -- 172.21.15.45:0/226832321 >> v1:172.21.15.45:6789/0 conn(0x7faafc14c280 legacy=0x7faafc06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.485+0000 7fab01d2b640 1 -- 172.21.15.45:0/226832321 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc14c660 con 0x7faafc0c4970 2023-12-08T08:15:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.486+0000 7fab01d2b640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc0c4970 0x7faafc0a4d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca68b17715169182 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.486+0000 7fab0152a640 1 -- 172.21.15.45:0/226832321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec031640 con 0x7faafc0c4970 2023-12-08T08:15:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.486+0000 7fab0152a640 1 -- 172.21.15.45:0/226832321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec0317a0 con 0x7faafc0c4970 2023-12-08T08:15:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.486+0000 7fab0152a640 1 -- 172.21.15.45:0/226832321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec031b30 con 0x7faafc0c4970 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 -- 172.21.15.45:0/226832321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc0c4970 msgr2=0x7faafc0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc0c4970 0x7faafc0a4d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 -- 172.21.15.45:0/226832321 shutdown_connections 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc155790 0x7faafc155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 --2- 172.21.15.45:0/226832321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc0c4970 0x7faafc0a4d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 -- 172.21.15.45:0/226832321 >> 172.21.15.45:0/226832321 conn(0x7faafc066ce0 msgr2=0x7faafc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 -- 172.21.15.45:0/226832321 shutdown_connections 2023-12-08T08:15:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.487+0000 7fab0352e640 1 -- 172.21.15.45:0/226832321 wait complete. 2023-12-08T08:15:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.489+0000 7fab0352e640 1 Processor -- start 2023-12-08T08:15:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 -- start start 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc0c4970 0x7faafc0a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 0x7faafc1ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc146140 con 0x7faafc155790 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc1eacf0 con 0x7faafc14c280 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.490+0000 7fab0352e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc153250 con 0x7faafc0c4970 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47814/0 (socket says 172.21.15.45:47814) 2023-12-08T08:15:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 -- 172.21.15.45:0/2658255947 learned_addr learned my addr 172.21.15.45:0/2658255947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab0252c640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc0c4970 0x7faafc0a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab01d2b640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 0x7faafc1ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 -- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc0c4970 msgr2=0x7faafc0a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc0c4970 0x7faafc0a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 -- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 msgr2=0x7faafc1ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 0x7faafc1ea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab02d2d640 1 -- 172.21.15.45:0/2658255947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0094d0 con 0x7faafc155790 2023-12-08T08:15:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.491+0000 7fab01d2b640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 0x7faafc1ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7fab02d2d640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d800 tx=0x7faaf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400b6c0 con 0x7faafc155790 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf400b840 con 0x7faafc155790 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400bbf0 con 0x7faafc155790 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc0aa800 con 0x7faafc155790 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.492+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0a6ed0 con 0x7faafc155790 2023-12-08T08:15:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.493+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc1e9f90 con 0x7faafc155790 2023-12-08T08:15:13.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.494+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faaf400bd50 con 0x7faafc155790 2023-12-08T08:15:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.495+0000 7faaf2ffd640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 0x7faae006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.495+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faaf4089e60 con 0x7faafc155790 2023-12-08T08:15:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.496+0000 7fab0252c640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 0x7faae006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.496+0000 7fab0252c640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 0x7faae006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a66f0 tx=0x7faaf8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.499+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faafc1e9f90 con 0x7faafc155790 2023-12-08T08:15:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.697+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faafc1e9f90 con 0x7faafc155790 2023-12-08T08:15:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.697+0000 7faaf2ffd640 1 -- 172.21.15.45:0/2658255947 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faafc1e9f90 con 0x7faafc155790 2023-12-08T08:15:13.700 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 msgr2=0x7faae006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 0x7faae006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faafc0a66f0 tx=0x7faaf8009040 comp rx=0 tx=0).stop 2023-12-08T08:15:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 msgr2=0x7faafc1ea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faaf400d800 tx=0x7faaf400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 shutdown_connections 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faae006ae70 0x7faae006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faafc155790 0x7faafc1ea7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faafc14c280 0x7faafc1ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 --2- 172.21.15.45:0/2658255947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faafc0c4970 0x7faafc0a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.700+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 >> 172.21.15.45:0/2658255947 conn(0x7faafc066ce0 msgr2=0x7faafc155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.701+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 shutdown_connections 2023-12-08T08:15:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.701+0000 7fab0352e640 1 -- 172.21.15.45:0/2658255947 wait complete. 2023-12-08T08:15:13.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.947+0000 7fda631ff640 1 Processor -- start 2023-12-08T08:15:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.947+0000 7fda631ff640 1 -- start start 2023-12-08T08:15:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.948+0000 7fda631ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c151ad0 0x7fda5c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.948+0000 7fda631ff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda5c157a20 0x7fda5c154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda631ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c151eb0 con 0x7fda5c0ca610 2023-12-08T08:15:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda631ff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0c56a0 con 0x7fda5c157a20 2023-12-08T08:15:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda631ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c80d0 con 0x7fda5c151ad0 2023-12-08T08:15:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda619fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda5c157a20 0x7fda5c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda629fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda5c0ca610 0x7fda5c154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60100/0 (socket says 172.21.15.45:60100) 2023-12-08T08:15:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda629fe640 1 -- 172.21.15.45:0/2967461054 learned_addr learned my addr 172.21.15.45:0/2967461054 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.949+0000 7fda621fd640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c151ad0 0x7fda5c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.950+0000 7fda611fb640 1 -- 172.21.15.45:0/2967461054 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185626680 0 0) 0x7fda5c151eb0 con 0x7fda5c0ca610 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.950+0000 7fda619fc640 1 -- 172.21.15.45:0/2967461054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c151ad0 msgr2=0x7fda5c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.950+0000 7fda619fc640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c151ad0 0x7fda5c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.950+0000 7fda619fc640 1 -- 172.21.15.45:0/2967461054 >> v1:172.21.15.45:6789/0 conn(0x7fda5c0ca610 legacy=0x7fda5c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.950+0000 7fda619fc640 1 -- 172.21.15.45:0/2967461054 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c154430 con 0x7fda5c157a20 2023-12-08T08:15:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.951+0000 7fda619fc640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c157a20 0x7fda5c154930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda480097a0 tx=0x7fda4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d5c6bb7e80d18e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.951+0000 7fda611fb640 1 -- 172.21.15.45:0/2967461054 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48031830 con 0x7fda5c157a20 2023-12-08T08:15:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.951+0000 7fda611fb640 1 -- 172.21.15.45:0/2967461054 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48031990 con 0x7fda5c157a20 2023-12-08T08:15:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.951+0000 7fda611fb640 1 -- 172.21.15.45:0/2967461054 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48031d20 con 0x7fda5c157a20 2023-12-08T08:15:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 -- 172.21.15.45:0/2967461054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c157a20 msgr2=0x7fda5c154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c157a20 0x7fda5c154930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda480097a0 tx=0x7fda4802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 -- 172.21.15.45:0/2967461054 shutdown_connections 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c157a20 0x7fda5c154930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 --2- 172.21.15.45:0/2967461054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c151ad0 0x7fda5c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 -- 172.21.15.45:0/2967461054 >> 172.21.15.45:0/2967461054 conn(0x7fda5c066610 msgr2=0x7fda5c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 -- 172.21.15.45:0/2967461054 shutdown_connections 2023-12-08T08:15:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.952+0000 7fda631ff640 1 -- 172.21.15.45:0/2967461054 wait complete. 2023-12-08T08:15:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.954+0000 7fda631ff640 1 Processor -- start 2023-12-08T08:15:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.954+0000 7fda631ff640 1 -- start start 2023-12-08T08:15:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 0x7fda5c0ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c157a20 0x7fda5c0abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0ac0c0 con 0x7fda5c0ca610 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0c14a0 con 0x7fda5c151ad0 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda631ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0a9800 con 0x7fda5c157a20 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda621fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda621fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47832/0 (socket says 172.21.15.45:47832) 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.955+0000 7fda621fd640 1 -- 172.21.15.45:0/639246295 learned_addr learned my addr 172.21.15.45:0/639246295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda629fe640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c157a20 0x7fda5c0abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda619fc640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 0x7fda5c0ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 -- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c157a20 msgr2=0x7fda5c0abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c157a20 0x7fda5c0abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 -- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 msgr2=0x7fda5c0ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 0x7fda5c0ab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 -- 172.21.15.45:0/639246295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009400 con 0x7fda5c0ca610 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda619fc640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 0x7fda5c0ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda621fd640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda5000efc0 tx=0x7fda5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50014480 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5000f040 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50014800 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.956+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0a9ae0 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.957+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0c1980 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.958+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0c1610 con 0x7fda5c0ca610 2023-12-08T08:15:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.959+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda50014960 con 0x7fda5c0ca610 2023-12-08T08:15:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.960+0000 7fda5affd640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 0x7fda4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.960+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda5008a420 con 0x7fda5c0ca610 2023-12-08T08:15:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.960+0000 7fda619fc640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 0x7fda4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.961+0000 7fda619fc640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 0x7fda4006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda48036000 tx=0x7fda4803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:13.964+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda5c0c1610 con 0x7fda5c0ca610 2023-12-08T08:15:14.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.157+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda5c0c1610 con 0x7fda5c0ca610 2023-12-08T08:15:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.158+0000 7fda5affd640 1 -- 172.21.15.45:0/639246295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda5c0c1610 con 0x7fda5c0ca610 2023-12-08T08:15:14.161 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 msgr2=0x7fda4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 0x7fda4006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda48036000 tx=0x7fda4803c040 comp rx=0 tx=0).stop 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 msgr2=0x7fda5c1ea370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda5000efc0 tx=0x7fda5000c490 comp rx=0 tx=0).stop 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 shutdown_connections 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fda4006ae70 0x7fda4006d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fda5c157a20 0x7fda5c0abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda5c151ad0 0x7fda5c0ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 --2- 172.21.15.45:0/639246295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda5c0ca610 0x7fda5c1ea370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 >> 172.21.15.45:0/639246295 conn(0x7fda5c066610 msgr2=0x7fda5c149d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 shutdown_connections 2023-12-08T08:15:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.161+0000 7fda631ff640 1 -- 172.21.15.45:0/639246295 wait complete. 2023-12-08T08:15:14.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.404+0000 7fd5f1506640 1 Processor -- start 2023-12-08T08:15:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.405+0000 7fd5f1506640 1 -- start start 2023-12-08T08:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.406+0000 7fd5f1506640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.406+0000 7fd5f1506640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec157a20 0x7fd5ec154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.406+0000 7fd5f1506640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec151eb0 con 0x7fd5ec0ca610 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.406+0000 7fd5f1506640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec0c56a0 con 0x7fd5ec151ad0 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.406+0000 7fd5f1506640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0c80d0 con 0x7fd5ec157a20 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47836/0 (socket says 172.21.15.45:47836) 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 -- 172.21.15.45:0/2847768853 learned_addr learned my addr 172.21.15.45:0/2847768853 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 -- 172.21.15.45:0/2847768853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec157a20 msgr2=0x7fd5ec154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 --2- 172.21.15.45:0/2847768853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec157a20 0x7fd5ec154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 -- 172.21.15.45:0/2847768853 >> v1:172.21.15.114:6789/0 conn(0x7fd5ec0ca610 legacy=0x7fd5ec154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.407+0000 7fd5ebfff640 1 -- 172.21.15.45:0/2847768853 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec154430 con 0x7fd5ec151ad0 2023-12-08T08:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.408+0000 7fd5ebfff640 1 --2- 172.21.15.45:0/2847768853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009e50 tx=0x7fd5dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f3b7b6a577d22c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5eaffd640 1 -- 172.21.15.45:0/2847768853 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc02ca70 con 0x7fd5ec151ad0 2023-12-08T08:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5eaffd640 1 -- 172.21.15.45:0/2847768853 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc02cbd0 con 0x7fd5ec151ad0 2023-12-08T08:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5eaffd640 1 -- 172.21.15.45:0/2847768853 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0343f0 con 0x7fd5ec151ad0 2023-12-08T08:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 -- 172.21.15.45:0/2847768853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec151ad0 msgr2=0x7fd5ec0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 --2- 172.21.15.45:0/2847768853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009e50 tx=0x7fd5dc02bed0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 -- 172.21.15.45:0/2847768853 shutdown_connections 2023-12-08T08:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 --2- 172.21.15.45:0/2847768853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec157a20 0x7fd5ec154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 --2- 172.21.15.45:0/2847768853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec0ca0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 -- 172.21.15.45:0/2847768853 >> 172.21.15.45:0/2847768853 conn(0x7fd5ec066610 msgr2=0x7fd5ec066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:14.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 -- 172.21.15.45:0/2847768853 shutdown_connections 2023-12-08T08:15:14.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.409+0000 7fd5f1506640 1 -- 172.21.15.45:0/2847768853 wait complete. 2023-12-08T08:15:14.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.411+0000 7fd5f1506640 1 Processor -- start 2023-12-08T08:15:14.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.411+0000 7fd5f1506640 1 -- start start 2023-12-08T08:15:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec0ca610 0x7fd5ec1ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec1ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec147270 con 0x7fd5ec157a20 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0afb10 con 0x7fd5ec151ad0 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f1506640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0aca00 con 0x7fd5ec0ca610 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.412+0000 7fd5f0d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47840/0 (socket says 172.21.15.45:47840) 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 -- 172.21.15.45:0/3046866903 learned_addr learned my addr 172.21.15.45:0/3046866903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5ebfff640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec0ca610 0x7fd5ec1ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5eb7fe640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec1ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 -- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec0ca610 msgr2=0x7fd5ec1ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec0ca610 0x7fd5ec1ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 -- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 msgr2=0x7fd5ec1ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec1ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 -- 172.21.15.45:0/3046866903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009b30 con 0x7fd5ec157a20 2023-12-08T08:15:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5eb7fe640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec1ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.413+0000 7fd5f0d05640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c410 tx=0x7fd5e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.414+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011790 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.414+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e40118f0 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.414+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011ce0 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.414+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec0c1090 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.414+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec1edf60 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.415+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec1eddd0 con 0x7fd5ec157a20 2023-12-08T08:15:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.416+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5e401c460 con 0x7fd5ec157a20 2023-12-08T08:15:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.417+0000 7fd5e8ff9640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 0x7fd5d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.417+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5e40895b0 con 0x7fd5ec157a20 2023-12-08T08:15:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.417+0000 7fd5ebfff640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 0x7fd5d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.418+0000 7fd5ebfff640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 0x7fd5d806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc035000 tx=0x7fd5dc030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.421+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5e4054360 con 0x7fd5ec157a20 2023-12-08T08:15:14.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.618+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5ec0743e0 con 0x7fd5ec157a20 2023-12-08T08:15:14.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.618+0000 7fd5e8ff9640 1 -- 172.21.15.45:0/3046866903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5e4057980 con 0x7fd5ec157a20 2023-12-08T08:15:14.621 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 msgr2=0x7fd5d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 0x7fd5d806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc035000 tx=0x7fd5dc030000 comp rx=0 tx=0).stop 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 msgr2=0x7fd5ec1ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c410 tx=0x7fd5e400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 shutdown_connections 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd5d806ae40 0x7fd5d806d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5ec157a20 0x7fd5ec1ed6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5ec151ad0 0x7fd5ec1ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 --2- 172.21.15.45:0/3046866903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd5ec0ca610 0x7fd5ec1ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 >> 172.21.15.45:0/3046866903 conn(0x7fd5ec066610 msgr2=0x7fd5ec0c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 shutdown_connections 2023-12-08T08:15:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.621+0000 7fd5f1506640 1 -- 172.21.15.45:0/3046866903 wait complete. 2023-12-08T08:15:14.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.865+0000 7f19daa61640 1 Processor -- start 2023-12-08T08:15:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.865+0000 7f19daa61640 1 -- start start 2023-12-08T08:15:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.866+0000 7f19daa61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19d40aaf60 0x7f19d40c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19daa61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19d40c1930 0x7f19d40c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19daa61640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d4152660 con 0x7f19d406d960 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19daa61640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40a4d10 con 0x7f19d40c1930 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19daa61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d4153200 con 0x7f19d40aaf60 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19d8ffe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19d40c1930 0x7f19d40c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19d8ffe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19d40c1930 0x7f19d40c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47844/0 (socket says 172.21.15.45:47844) 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19d8ffe640 1 -- 172.21.15.45:0/2151115234 learned_addr learned my addr 172.21.15.45:0/2151115234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19d37fe640 1 --1- 172.21.15.45:0/2151115234 >> v1:172.21.15.45:6789/0 conn(0x7f19d406d960 0x7f19d4152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60110/0 (socket says 172.21.15.45:60110) 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.867+0000 7f19d3fff640 1 --2- 172.21.15.45:0/2151115234 >> v2:172.21.15.114:3300/0 conn(0x7f19d40aaf60 0x7f19d40c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.868+0000 7f19d8ffe640 1 -- 172.21.15.45:0/2151115234 >> v2:172.21.15.114:3300/0 conn(0x7f19d40aaf60 msgr2=0x7f19d40c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.868+0000 7f19d8ffe640 1 --2- 172.21.15.45:0/2151115234 >> v2:172.21.15.114:3300/0 conn(0x7f19d40aaf60 0x7f19d40c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.868+0000 7f19d8ffe640 1 -- 172.21.15.45:0/2151115234 >> v1:172.21.15.45:6789/0 conn(0x7f19d406d960 legacy=0x7f19d4152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.868+0000 7f19d8ffe640 1 -- 172.21.15.45:0/2151115234 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40c3310 con 0x7f19d40c1930 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.869+0000 7f19d8ffe640 1 --2- 172.21.15.45:0/2151115234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40c1930 0x7f19d40c1de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19d40c2390 tx=0x7f19cc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cb11589496bbf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.869+0000 7f19d2ffd640 1 -- 172.21.15.45:0/2151115234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc02ca80 con 0x7f19d40c1930 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.869+0000 7f19d2ffd640 1 -- 172.21.15.45:0/2151115234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc02cbe0 con 0x7f19d40c1930 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.869+0000 7f19d2ffd640 1 -- 172.21.15.45:0/2151115234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0343f0 con 0x7f19d40c1930 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 -- 172.21.15.45:0/2151115234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40c1930 msgr2=0x7f19d40c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 --2- 172.21.15.45:0/2151115234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40c1930 0x7f19d40c1de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19d40c2390 tx=0x7f19cc02bee0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 -- 172.21.15.45:0/2151115234 shutdown_connections 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 --2- 172.21.15.45:0/2151115234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40c1930 0x7f19d40c1de0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 --2- 172.21.15.45:0/2151115234 >> v2:172.21.15.114:3300/0 conn(0x7f19d40aaf60 0x7f19d40c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 -- 172.21.15.45:0/2151115234 >> 172.21.15.45:0/2151115234 conn(0x7f19d40c2430 msgr2=0x7f19d40c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 -- 172.21.15.45:0/2151115234 shutdown_connections 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.870+0000 7f19daa61640 1 -- 172.21.15.45:0/2151115234 wait complete. 2023-12-08T08:15:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.872+0000 7f19daa61640 1 Processor -- start 2023-12-08T08:15:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.872+0000 7f19daa61640 1 -- start start 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 0x7f19d4151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19d40c1930 0x7f19d4146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d414f970 con 0x7f19d40aaf60 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40703b0 con 0x7f19d406d960 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19daa61640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d414fbc0 con 0x7f19d40c1930 2023-12-08T08:15:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47860/0 (socket says 172.21.15.45:47860) 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19d37fe640 1 -- 172.21.15.45:0/4241516935 learned_addr learned my addr 172.21.15.45:0/4241516935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19d8ffe640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19d40c1930 0x7f19d4146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.873+0000 7f19d3fff640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 0x7f19d4151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 -- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19d40c1930 msgr2=0x7f19d4146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19d40c1930 0x7f19d4146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 -- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 msgr2=0x7f19d4151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 0x7f19d4151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 -- 172.21.15.45:0/4241516935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc009b30 con 0x7f19d40aaf60 2023-12-08T08:15:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d3fff640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 0x7f19d4151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d37fe640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c450 tx=0x7f19c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8007480 con 0x7f19d40aaf60 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80075e0 con 0x7f19d40aaf60 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d406fb10 con 0x7f19d40aaf60 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8004a00 con 0x7f19d40aaf60 2023-12-08T08:15:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.874+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d40700d0 con 0x7f19d40aaf60 2023-12-08T08:15:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.875+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d406cb00 con 0x7f19d40aaf60 2023-12-08T08:15:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.876+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19c8004b60 con 0x7f19d40aaf60 2023-12-08T08:15:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.877+0000 7f19d0ff9640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 0x7f19c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.877+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19c80889f0 con 0x7f19d40aaf60 2023-12-08T08:15:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.878+0000 7f19d3fff640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 0x7f19c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:14.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.878+0000 7f19d3fff640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 0x7f19c006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006fd0 tx=0x7f19c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:14.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:14.882+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19c8053710 con 0x7f19d40aaf60 2023-12-08T08:15:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.078+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f19d40a5bd0 con 0x7f19d40aaf60 2023-12-08T08:15:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.079+0000 7f19d0ff9640 1 -- 172.21.15.45:0/4241516935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f19c8018020 con 0x7f19d40aaf60 2023-12-08T08:15:15.082 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 msgr2=0x7f19c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 0x7f19c006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006fd0 tx=0x7f19c4008040 comp rx=0 tx=0).stop 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 msgr2=0x7f19d4145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f19c800c450 tx=0x7f19c800c910 comp rx=0 tx=0).stop 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 shutdown_connections 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c006ae70 0x7f19c006d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19d40c1930 0x7f19d4146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19d40aaf60 0x7f19d4145c40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 --2- 172.21.15.45:0/4241516935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19d406d960 0x7f19d4151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 >> 172.21.15.45:0/4241516935 conn(0x7f19d40c2430 msgr2=0x7f19d40730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 shutdown_connections 2023-12-08T08:15:15.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.082+0000 7f19daa61640 1 -- 172.21.15.45:0/4241516935 wait complete. 2023-12-08T08:15:15.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:15:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.324+0000 7fd35bfff640 1 Processor -- start 2023-12-08T08:15:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.324+0000 7fd35bfff640 1 -- start start 2023-12-08T08:15:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.326+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c155d40 0x7fd35c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.326+0000 7fd35bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd35c159500 0x7fd35c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.326+0000 7fd35bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c0aa8e0 con 0x7fd35c0c5d20 2023-12-08T08:15:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.326+0000 7fd35bfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c0a9780 con 0x7fd35c159500 2023-12-08T08:15:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.326+0000 7fd35bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c158760 con 0x7fd35c155d40 2023-12-08T08:15:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd353fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd35c159500 0x7fd35c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd35affd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c155d40 0x7fd35c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd35b7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd35c0c5d20 0x7fd35c15bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:50468/0 (socket says 172.21.15.45:50468) 2023-12-08T08:15:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd35b7fe640 1 -- 172.21.15.45:0/3855351862 learned_addr learned my addr 172.21.15.45:0/3855351862 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd353fff640 1 -- 172.21.15.45:0/3855351862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c155d40 msgr2=0x7fd35c0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd353fff640 1 --2- 172.21.15.45:0/3855351862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c155d40 0x7fd35c0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd353fff640 1 -- 172.21.15.45:0/3855351862 >> v1:172.21.15.114:6789/0 conn(0x7fd35c0c5d20 legacy=0x7fd35c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.327+0000 7fd353fff640 1 -- 172.21.15.45:0/3855351862 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0c5010 con 0x7fd35c159500 2023-12-08T08:15:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.328+0000 7fd353fff640 1 --2- 172.21.15.45:0/3855351862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c0c3750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3440097a0 tx=0x7fd34402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ab7aa3fb56126e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35a7fc640 1 -- 172.21.15.45:0/3855351862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34402e070 con 0x7fd35c159500 2023-12-08T08:15:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35a7fc640 1 -- 172.21.15.45:0/3855351862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3440315a0 con 0x7fd35c159500 2023-12-08T08:15:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35a7fc640 1 -- 172.21.15.45:0/3855351862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344031930 con 0x7fd35c159500 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 -- 172.21.15.45:0/3855351862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 msgr2=0x7fd35c0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3855351862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c0c3750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd3440097a0 tx=0x7fd34402b840 comp rx=0 tx=0).stop 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 -- 172.21.15.45:0/3855351862 shutdown_connections 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3855351862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c0c3750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3855351862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c155d40 0x7fd35c0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.329+0000 7fd35bfff640 1 -- 172.21.15.45:0/3855351862 >> 172.21.15.45:0/3855351862 conn(0x7fd35c0a7600 msgr2=0x7fd35c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.330+0000 7fd35bfff640 1 -- 172.21.15.45:0/3855351862 shutdown_connections 2023-12-08T08:15:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.330+0000 7fd35bfff640 1 -- 172.21.15.45:0/3855351862 wait complete. 2023-12-08T08:15:15.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.331+0000 7fd35bfff640 1 Processor -- start 2023-12-08T08:15:15.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.331+0000 7fd35bfff640 1 -- start start 2023-12-08T08:15:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c0c5d20 0x7fd35c1e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 0x7fd35c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c1f2850 con 0x7fd35c159500 2023-12-08T08:15:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0700b0 con 0x7fd35c155d40 2023-12-08T08:15:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.332+0000 7fd35bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c1f22f0 con 0x7fd35c0c5d20 2023-12-08T08:15:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54110/0 (socket says 172.21.15.45:54110) 2023-12-08T08:15:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 -- 172.21.15.45:0/1754255135 learned_addr learned my addr 172.21.15.45:0/1754255135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35affd640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c0c5d20 0x7fd35c1e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd353fff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 0x7fd35c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 -- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c0c5d20 msgr2=0x7fd35c1e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c0c5d20 0x7fd35c1e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 -- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 msgr2=0x7fd35c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 0x7fd35c15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 -- 172.21.15.45:0/1754255135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd344009400 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd353fff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 0x7fd35c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.333+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd35400ca80 tx=0x7fd35400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.334+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35400ac30 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.334+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35400ad90 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.334+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354012600 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.334+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c1f2570 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.334+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c06fd40 con 0x7fd35c159500 2023-12-08T08:15:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.335+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c070220 con 0x7fd35c159500 2023-12-08T08:15:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.336+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd354007070 con 0x7fd35c159500 2023-12-08T08:15:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.337+0000 7fd3537fe640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 0x7fd33c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.337+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3540896e0 con 0x7fd35c159500 2023-12-08T08:15:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.337+0000 7fd35affd640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 0x7fd33c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.338+0000 7fd35affd640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 0x7fd33c06d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd35c06c3a0 tx=0x7fd34c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.342+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd354054540 con 0x7fd35c159500 2023-12-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.548+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd35c0743e0 con 0x7fd35c159500 2023-12-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.549+0000 7fd3537fe640 1 -- 172.21.15.45:0/1754255135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd354057b60 con 0x7fd35c159500 2023-12-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.551+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 msgr2=0x7fd33c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.551+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 0x7fd33c06d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd35c06c3a0 tx=0x7fd34c008040 comp rx=0 tx=0).stop 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.551+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 msgr2=0x7fd35c1ee3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.551+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd35400ca80 tx=0x7fd35400cf40 comp rx=0 tx=0).stop 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 shutdown_connections 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd33c06ae40 0x7fd33c06d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c159500 0x7fd35c1ee3a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35c155d40 0x7fd35c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 --2- 172.21.15.45:0/1754255135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd35c0c5d20 0x7fd35c1e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 >> 172.21.15.45:0/1754255135 conn(0x7fd35c0a7600 msgr2=0x7fd35c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 shutdown_connections 2023-12-08T08:15:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.552+0000 7fd35bfff640 1 -- 172.21.15.45:0/1754255135 wait complete. 2023-12-08T08:15:15.575 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:15:15.575 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:15:15.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.854+0000 7f888d9bc640 1 Processor -- start 2023-12-08T08:15:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.854+0000 7f888d9bc640 1 -- start start 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d9bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88880c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d9bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88880a9e80 0x7f88880aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d9bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8888154850 con 0x7f888814e840 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d9bc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888814ec20 con 0x7f88880a9e80 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d9bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8888154b30 con 0x7f88880c1210 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d1bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88880a9e80 0x7f88880aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d1bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88880a9e80 0x7f88880aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54124/0 (socket says 172.21.15.45:54124) 2023-12-08T08:15:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.855+0000 7f888d1bb640 1 -- 172.21.15.45:0/943777089 learned_addr learned my addr 172.21.15.45:0/943777089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:15.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.856+0000 7f8887fff640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88880c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.856+0000 7f888d1bb640 1 -- 172.21.15.45:0/943777089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 msgr2=0x7f88880c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:15.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.856+0000 7f888d1bb640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88880c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.856+0000 7f888d1bb640 1 -- 172.21.15.45:0/943777089 >> v1:172.21.15.114:6789/0 conn(0x7f888814e840 legacy=0x7f8888151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.856+0000 7f888d1bb640 1 -- 172.21.15.45:0/943777089 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888154e10 con 0x7f88880a9e80 2023-12-08T08:15:15.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.857+0000 7f888d1bb640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88880a9e80 0x7f88880aa310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f888002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df7886b945d7615 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f88877fe640 1 -- 172.21.15.45:0/943777089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888002ca70 con 0x7f88880a9e80 2023-12-08T08:15:15.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f88877fe640 1 -- 172.21.15.45:0/943777089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888002cbd0 con 0x7f88880a9e80 2023-12-08T08:15:15.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f88877fe640 1 -- 172.21.15.45:0/943777089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800343f0 con 0x7f88880a9e80 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 -- 172.21.15.45:0/943777089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88880a9e80 msgr2=0x7f88880aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88880a9e80 0x7f88880aa310 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f888002bed0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 -- 172.21.15.45:0/943777089 shutdown_connections 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88880a9e80 0x7f88880aa310 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 --2- 172.21.15.45:0/943777089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88880c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 -- 172.21.15.45:0/943777089 >> 172.21.15.45:0/943777089 conn(0x7f88880c5780 msgr2=0x7f88880c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:15.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 -- 172.21.15.45:0/943777089 shutdown_connections 2023-12-08T08:15:15.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.858+0000 7f888d9bc640 1 -- 172.21.15.45:0/943777089 wait complete. 2023-12-08T08:15:15.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.860+0000 7f888d9bc640 1 Processor -- start 2023-12-08T08:15:15.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.860+0000 7f888d9bc640 1 -- start start 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 0x7f888814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88881535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88881ecbd0 con 0x7f888814e840 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88881ea600 con 0x7f88880a9e80 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d9bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888814cae0 con 0x7f88880c1210 2023-12-08T08:15:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d1bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d1bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54136/0 (socket says 172.21.15.45:54136) 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.861+0000 7f888d1bb640 1 -- 172.21.15.45:0/3513517198 learned_addr learned my addr 172.21.15.45:0/3513517198 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f8887fff640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88881535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888c9ba640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 0x7f888814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 -- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 msgr2=0x7f88881535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88881535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 -- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 msgr2=0x7f888814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 0x7f888814c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 -- 172.21.15.45:0/3513517198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880009b30 con 0x7f888814e840 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888c9ba640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 0x7f888814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.862+0000 7f888d1bb640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f8880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.863+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880009510 con 0x7f888814e840 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.863+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888003e450 con 0x7f888814e840 2023-12-08T08:15:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.863+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888003e800 con 0x7f888814e840 2023-12-08T08:15:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.863+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88880c46f0 con 0x7f888814e840 2023-12-08T08:15:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.863+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88880c4cb0 con 0x7f888814e840 2023-12-08T08:15:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.864+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88880743e0 con 0x7f888814e840 2023-12-08T08:15:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.865+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f888003e960 con 0x7f888814e840 2023-12-08T08:15:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.866+0000 7f88857fa640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 0x7f886c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.866+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88800ac6b0 con 0x7f888814e840 2023-12-08T08:15:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.867+0000 7f888c9ba640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 0x7f886c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.867+0000 7f888c9ba640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 0x7f886c06d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f887c000f60 tx=0x7f887c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:15.871+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8880077460 con 0x7f888814e840 2023-12-08T08:15:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.068+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88880bf170 con 0x7f888814e840 2023-12-08T08:15:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.069+0000 7f88857fa640 1 -- 172.21.15.45:0/3513517198 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f888007aa80 con 0x7f888814e840 2023-12-08T08:15:16.073 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:16.073 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 msgr2=0x7f886c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 0x7f886c06d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f887c000f60 tx=0x7f887c009040 comp rx=0 tx=0).stop 2023-12-08T08:15:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 msgr2=0x7f88881ed040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f8880004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 shutdown_connections 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f886c06ae40 0x7f886c06d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88880c1210 0x7f88881535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f888814e840 0x7f88881ed040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 --2- 172.21.15.45:0/3513517198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88880a9e80 0x7f888814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 >> 172.21.15.45:0/3513517198 conn(0x7f88880c5780 msgr2=0x7f88880bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 shutdown_connections 2023-12-08T08:15:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.072+0000 7f888d9bc640 1 -- 172.21.15.45:0/3513517198 wait complete. 2023-12-08T08:15:16.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:16.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.322+0000 7f3b8e941640 1 Processor -- start 2023-12-08T08:15:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.322+0000 7f3b8e941640 1 -- start start 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.323+0000 7f3b8e941640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b881519b0 0x7f3b88154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8e941640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b880c7cb0 0x7f3b880c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8e941640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3b880c4c70 0x7f3b88158190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8e941640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b88157d70 con 0x7f3b880c7cb0 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8e941640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b881554e0 con 0x7f3b880c4c70 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8e941640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c67c0 con 0x7f3b881519b0 2023-12-08T08:15:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b877fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b880c7cb0 0x7f3b880c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b877fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b880c7cb0 0x7f3b880c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54152/0 (socket says 172.21.15.45:54152) 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b877fe640 1 -- 172.21.15.45:0/826902376 learned_addr learned my addr 172.21.15.45:0/826902376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b87fff640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b881519b0 0x7f3b88154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.324+0000 7f3b8cede640 1 --2- 172.21.15.45:0/826902376 >> v2:172.21.15.114:3300/0 conn(0x7f3b880c4c70 0x7f3b88158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.325+0000 7f3b877fe640 1 -- 172.21.15.45:0/826902376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b881519b0 msgr2=0x7f3b88154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.325+0000 7f3b877fe640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b881519b0 0x7f3b88154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.325+0000 7f3b877fe640 1 -- 172.21.15.45:0/826902376 >> v2:172.21.15.114:3300/0 conn(0x7f3b880c4c70 msgr2=0x7f3b88158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.325+0000 7f3b877fe640 1 --2- 172.21.15.45:0/826902376 >> v2:172.21.15.114:3300/0 conn(0x7f3b880c4c70 0x7f3b88158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.325+0000 7f3b877fe640 1 -- 172.21.15.45:0/826902376 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880c6aa0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.326+0000 7f3b877fe640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b880c4730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b88154520 tx=0x7f3b7c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af8dbd7046fe4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.326+0000 7f3b86ffd640 1 -- 172.21.15.45:0/826902376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0317d0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.326+0000 7f3b86ffd640 1 -- 172.21.15.45:0/826902376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c031930 con 0x7f3b880c7cb0 2023-12-08T08:15:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.326+0000 7f3b86ffd640 1 -- 172.21.15.45:0/826902376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c031cc0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 -- 172.21.15.45:0/826902376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 msgr2=0x7f3b880c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b880c4730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3b88154520 tx=0x7f3b7c02b870 comp rx=0 tx=0).stop 2023-12-08T08:15:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 -- 172.21.15.45:0/826902376 shutdown_connections 2023-12-08T08:15:16.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 --2- 172.21.15.45:0/826902376 >> v2:172.21.15.114:3300/0 conn(0x7f3b880c4c70 0x7f3b88158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b880c4730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 --2- 172.21.15.45:0/826902376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b881519b0 0x7f3b88154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 -- 172.21.15.45:0/826902376 >> 172.21.15.45:0/826902376 conn(0x7f3b880ab960 msgr2=0x7f3b880abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 -- 172.21.15.45:0/826902376 shutdown_connections 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.327+0000 7f3b8e941640 1 -- 172.21.15.45:0/826902376 wait complete. 2023-12-08T08:15:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.329+0000 7f3b8e941640 1 Processor -- start 2023-12-08T08:15:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.329+0000 7f3b8e941640 1 -- start start 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b880c4c70 0x7f3b881ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b881519b0 0x7f3b88157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881eddf0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88156c00 con 0x7f3b881519b0 2023-12-08T08:15:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.330+0000 7f3b8e941640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88156ec0 con 0x7f3b880c4c70 2023-12-08T08:15:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54164/0 (socket says 172.21.15.45:54164) 2023-12-08T08:15:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 -- 172.21.15.45:0/3715378367 learned_addr learned my addr 172.21.15.45:0/3715378367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b87fff640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b880c4c70 0x7f3b881ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b8cede640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b881519b0 0x7f3b88157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 -- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b880c4c70 msgr2=0x7f3b881ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b880c4c70 0x7f3b881ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 -- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b881519b0 msgr2=0x7f3b88157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b881519b0 0x7f3b88157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 -- 172.21.15.45:0/3715378367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0094d0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.331+0000 7f3b877fe640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c02b8b0 tx=0x7f3b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.332+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c032870 con 0x7f3b880c7cb0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.332+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c032a10 con 0x7f3b880c7cb0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.332+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c032dc0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.332+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b88154320 con 0x7f3b880c7cb0 2023-12-08T08:15:16.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.332+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b88153d60 con 0x7f3b880c7cb0 2023-12-08T08:15:16.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.333+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b88074670 con 0x7f3b880c7cb0 2023-12-08T08:15:16.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.335+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b7c030070 con 0x7f3b880c7cb0 2023-12-08T08:15:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.335+0000 7f3b84ff9640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 0x7f3b7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.336+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b7c0ab8a0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.336+0000 7f3b87fff640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 0x7f3b7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.337+0000 7f3b87fff640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 0x7f3b7406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b78006fd0 tx=0x7f3b78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.340+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b7c0765c0 con 0x7f3b880c7cb0 2023-12-08T08:15:16.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.539+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b8806c760 con 0x7f3b880c7cb0 2023-12-08T08:15:16.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.540+0000 7f3b84ff9640 1 -- 172.21.15.45:0/3715378367 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b7c0a9e60 con 0x7f3b880c7cb0 2023-12-08T08:15:16.543 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 msgr2=0x7f3b7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 0x7f3b7406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b78006fd0 tx=0x7f3b78008040 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 msgr2=0x7f3b88149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c02b8b0 tx=0x7f3b7c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 shutdown_connections 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b7406ae40 0x7f3b7406d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b881519b0 0x7f3b88157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b880c7cb0 0x7f3b88149590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 --2- 172.21.15.45:0/3715378367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b880c4c70 0x7f3b881ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 >> 172.21.15.45:0/3715378367 conn(0x7f3b880ab960 msgr2=0x7f3b8814dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 shutdown_connections 2023-12-08T08:15:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.543+0000 7f3b8e941640 1 -- 172.21.15.45:0/3715378367 wait complete. 2023-12-08T08:15:16.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.795+0000 7faa27fff640 1 Processor -- start 2023-12-08T08:15:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.796+0000 7faa27fff640 1 -- start start 2023-12-08T08:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.797+0000 7faa27fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faa28151ad0 0x7faa280ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.797+0000 7faa27fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa280ca610 0x7faa28155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.797+0000 7faa27fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa28151eb0 con 0x7faa28157a20 2023-12-08T08:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.797+0000 7faa27fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280c56a0 con 0x7faa280ca610 2023-12-08T08:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.797+0000 7faa27fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280c80d0 con 0x7faa28151ad0 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa277fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa280ca610 0x7faa28155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa1e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faa28157a20 0x7faa28154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34010/0 (socket says 172.21.15.45:34010) 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa1e7fc640 1 -- 172.21.15.45:0/3346875538 learned_addr learned my addr 172.21.15.45:0/3346875538 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa26ffd640 1 --2- 172.21.15.45:0/3346875538 >> v2:172.21.15.114:3300/0 conn(0x7faa28151ad0 0x7faa280ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa277fe640 1 -- 172.21.15.45:0/3346875538 >> v2:172.21.15.114:3300/0 conn(0x7faa28151ad0 msgr2=0x7faa280ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa277fe640 1 --2- 172.21.15.45:0/3346875538 >> v2:172.21.15.114:3300/0 conn(0x7faa28151ad0 0x7faa280ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa277fe640 1 -- 172.21.15.45:0/3346875538 >> v1:172.21.15.45:6789/0 conn(0x7faa28157a20 legacy=0x7faa28154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.798+0000 7faa277fe640 1 -- 172.21.15.45:0/3346875538 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28154430 con 0x7faa280ca610 2023-12-08T08:15:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.799+0000 7faa277fe640 1 --2- 172.21.15.45:0/3346875538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa28155040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa2806c930 tx=0x7faa2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3d32cad0b10adf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa267fc640 1 -- 172.21.15.45:0/3346875538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20031830 con 0x7faa280ca610 2023-12-08T08:15:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa267fc640 1 -- 172.21.15.45:0/3346875538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20031990 con 0x7faa280ca610 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa267fc640 1 -- 172.21.15.45:0/3346875538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20031d20 con 0x7faa280ca610 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 -- 172.21.15.45:0/3346875538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 msgr2=0x7faa28155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 --2- 172.21.15.45:0/3346875538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa28155040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa2806c930 tx=0x7faa2002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 -- 172.21.15.45:0/3346875538 shutdown_connections 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 --2- 172.21.15.45:0/3346875538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa28155040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 --2- 172.21.15.45:0/3346875538 >> v2:172.21.15.114:3300/0 conn(0x7faa28151ad0 0x7faa280ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 -- 172.21.15.45:0/3346875538 >> 172.21.15.45:0/3346875538 conn(0x7faa28066610 msgr2=0x7faa28066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 -- 172.21.15.45:0/3346875538 shutdown_connections 2023-12-08T08:15:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.800+0000 7faa27fff640 1 -- 172.21.15.45:0/3346875538 wait complete. 2023-12-08T08:15:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.802+0000 7faa27fff640 1 Processor -- start 2023-12-08T08:15:16.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.802+0000 7faa27fff640 1 -- start start 2023-12-08T08:15:16.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa28151ad0 0x7faa2814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa28157a20 0x7faa28155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2814df10 con 0x7faa280ca610 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2814ce60 con 0x7faa28157a20 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa27fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2814d620 con 0x7faa28151ad0 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.803+0000 7faa26ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54170/0 (socket says 172.21.15.45:54170) 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 -- 172.21.15.45:0/4183143361 learned_addr learned my addr 172.21.15.45:0/4183143361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 -- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa28151ad0 msgr2=0x7faa2814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa28151ad0 0x7faa2814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 -- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa28157a20 msgr2=0x7faa28155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa28157a20 0x7faa28155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 -- 172.21.15.45:0/4183143361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20009400 con 0x7faa280ca610 2023-12-08T08:15:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.804+0000 7faa26ffd640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ef0 tx=0x7faa1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.805+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18014620 con 0x7faa280ca610 2023-12-08T08:15:16.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.805+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18014780 con 0x7faa280ca610 2023-12-08T08:15:16.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.805+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18014b30 con 0x7faa280ca610 2023-12-08T08:15:16.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.805+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2814c8a0 con 0x7faa280ca610 2023-12-08T08:15:16.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.805+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2814bea0 con 0x7faa280ca610 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.806+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280743e0 con 0x7faa280ca610 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.807+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa18014c90 con 0x7faa280ca610 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.808+0000 7faa1ffff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 0x7faa0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.808+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa1808a310 con 0x7faa280ca610 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.808+0000 7faa1e7fc640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 0x7faa0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:16.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.809+0000 7faa1e7fc640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 0x7faa0806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa281572c0 tx=0x7faa10007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:16.812+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa180550c0 con 0x7faa280ca610 2023-12-08T08:15:17.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.006+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa280c7a40 con 0x7faa280ca610 2023-12-08T08:15:17.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.007+0000 7faa1ffff640 1 -- 172.21.15.45:0/4183143361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa180586e0 con 0x7faa280ca610 2023-12-08T08:15:17.009 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 msgr2=0x7faa0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 0x7faa0806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa281572c0 tx=0x7faa10007a40 comp rx=0 tx=0).stop 2023-12-08T08:15:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 msgr2=0x7faa2814d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ef0 tx=0x7faa1800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 shutdown_connections 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa0806ae40 0x7faa0806d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa28151ad0 0x7faa2814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.009+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa28157a20 0x7faa28155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.010+0000 7faa27fff640 1 --2- 172.21.15.45:0/4183143361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa280ca610 0x7faa2814d880 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.010+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 >> 172.21.15.45:0/4183143361 conn(0x7faa28066610 msgr2=0x7faa2814e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.010+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 shutdown_connections 2023-12-08T08:15:17.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.010+0000 7faa27fff640 1 -- 172.21.15.45:0/4183143361 wait complete. 2023-12-08T08:15:17.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:17.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.255+0000 7f3edeea3640 1 Processor -- start 2023-12-08T08:15:17.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.255+0000 7f3edeea3640 1 -- start start 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3ed8151ad0 0x7f3ed80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ed8157a20 0x7f3ed8154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed8154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80c56a0 con 0x7f3ed8157a20 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed8151eb0 con 0x7f3ed8151ad0 2023-12-08T08:15:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.256+0000 7f3edeea3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80c80d0 con 0x7f3ed80ca610 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ed8157a20 0x7f3ed8154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ed8157a20 0x7f3ed8154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54180/0 (socket says 172.21.15.45:54180) 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 -- 172.21.15.45:0/1442181786 learned_addr learned my addr 172.21.15.45:0/1442181786 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 -- 172.21.15.45:0/1442181786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 msgr2=0x7f3ed8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 --2- 172.21.15.45:0/1442181786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed8154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 -- 172.21.15.45:0/1442181786 >> v2:172.21.15.114:3300/0 conn(0x7f3ed8151ad0 msgr2=0x7f3ed80ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 --2- 172.21.15.45:0/1442181786 >> v2:172.21.15.114:3300/0 conn(0x7f3ed8151ad0 0x7f3ed80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.257+0000 7f3edd6a0640 1 -- 172.21.15.45:0/1442181786 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8154430 con 0x7f3ed8157a20 2023-12-08T08:15:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.258+0000 7f3edd6a0640 1 --2- 172.21.15.45:0/1442181786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8154930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3ed806c930 tx=0x7f3ec802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cf0deceffcbe00 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.258+0000 7f3edce9f640 1 -- 172.21.15.45:0/1442181786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8031870 con 0x7f3ed8157a20 2023-12-08T08:15:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.258+0000 7f3edce9f640 1 -- 172.21.15.45:0/1442181786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec80319d0 con 0x7f3ed8157a20 2023-12-08T08:15:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edce9f640 1 -- 172.21.15.45:0/1442181786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8031d60 con 0x7f3ed8157a20 2023-12-08T08:15:17.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 -- 172.21.15.45:0/1442181786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 msgr2=0x7f3ed8154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 --2- 172.21.15.45:0/1442181786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8154930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3ed806c930 tx=0x7f3ec802b910 comp rx=0 tx=0).stop 2023-12-08T08:15:17.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 -- 172.21.15.45:0/1442181786 shutdown_connections 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 --2- 172.21.15.45:0/1442181786 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed8154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 --2- 172.21.15.45:0/1442181786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8154930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 --2- 172.21.15.45:0/1442181786 >> v2:172.21.15.114:3300/0 conn(0x7f3ed8151ad0 0x7f3ed80ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 -- 172.21.15.45:0/1442181786 >> 172.21.15.45:0/1442181786 conn(0x7f3ed8066610 msgr2=0x7f3ed8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 -- 172.21.15.45:0/1442181786 shutdown_connections 2023-12-08T08:15:17.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.259+0000 7f3edeea3640 1 -- 172.21.15.45:0/1442181786 wait complete. 2023-12-08T08:15:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.261+0000 7f3edeea3640 1 Processor -- start 2023-12-08T08:15:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.261+0000 7f3edeea3640 1 -- start start 2023-12-08T08:15:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed81498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 0x7f3ed80a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80ac570 con 0x7f3ed8157a20 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80abff0 con 0x7f3ed8151ad0 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3edeea3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80af6d0 con 0x7f3ed80ca610 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3ede6a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3ede6a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54184/0 (socket says 172.21.15.45:54184) 2023-12-08T08:15:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.262+0000 7f3ede6a2640 1 -- 172.21.15.45:0/3308642087 learned_addr learned my addr 172.21.15.45:0/3308642087 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3eddea1640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed81498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3edd6a0640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 0x7f3ed80a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 -- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 msgr2=0x7f3ed81498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed81498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 -- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 msgr2=0x7f3ed80a9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 0x7f3ed80a9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 -- 172.21.15.45:0/3308642087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80094d0 con 0x7f3ed8157a20 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3edd6a0640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 0x7f3ed80a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ede6a2640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009fd0 tx=0x7f3ed000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0011830 con 0x7f3ed8157a20 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0011990 con 0x7f3ed8157a20 2023-12-08T08:15:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0011d20 con 0x7f3ed8157a20 2023-12-08T08:15:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.263+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed80a9820 con 0x7f3ed8157a20 2023-12-08T08:15:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.264+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed80a9b00 con 0x7f3ed8157a20 2023-12-08T08:15:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.265+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed80c3550 con 0x7f3ed8157a20 2023-12-08T08:15:17.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.266+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ed001b460 con 0x7f3ed8157a20 2023-12-08T08:15:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.267+0000 7f3ece7fc640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 0x7f3ebc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.267+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ed0089780 con 0x7f3ed8157a20 2023-12-08T08:15:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.267+0000 7f3eddea1640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 0x7f3ebc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.268+0000 7f3eddea1640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 0x7f3ebc06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009f20 tx=0x7f3ed40094f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.271+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ed80c3550 con 0x7f3ed8157a20 2023-12-08T08:15:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.467+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ed80c3550 con 0x7f3ed8157a20 2023-12-08T08:15:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.468+0000 7f3ece7fc640 1 -- 172.21.15.45:0/3308642087 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ed80c3550 con 0x7f3ed8157a20 2023-12-08T08:15:17.475 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:17.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 msgr2=0x7f3ebc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 0x7f3ebc06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009f20 tx=0x7f3ed40094f0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 msgr2=0x7f3ed8146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009fd0 tx=0x7f3ed000b8e0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 shutdown_connections 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3ebc06ae40 0x7f3ebc06d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ed8157a20 0x7f3ed8146d20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ed8151ad0 0x7f3ed80a9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 --2- 172.21.15.45:0/3308642087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3ed80ca610 0x7f3ed81498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 >> 172.21.15.45:0/3308642087 conn(0x7f3ed8066610 msgr2=0x7f3ed80c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 shutdown_connections 2023-12-08T08:15:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.471+0000 7f3edeea3640 1 -- 172.21.15.45:0/3308642087 wait complete. 2023-12-08T08:15:17.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:17.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.708+0000 7f2b6153e640 1 Processor -- start 2023-12-08T08:15:17.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.708+0000 7f2b6153e640 1 -- start start 2023-12-08T08:15:17.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.709+0000 7f2b6153e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0aaf60 0x7f2b5c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.709+0000 7f2b6153e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c152660 con 0x7f2b5c06d960 2023-12-08T08:15:17.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.709+0000 7f2b6153e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c153200 con 0x7f2b5c0c1930 2023-12-08T08:15:17.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.709+0000 7f2b6153e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c0a4d10 con 0x7f2b5c0aaf60 2023-12-08T08:15:17.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.710+0000 7f2b5a7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2b5c06d960 0x7f2b5c152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34024/0 (socket says 172.21.15.45:34024) 2023-12-08T08:15:17.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.710+0000 7f2b5a7fc640 1 -- 172.21.15.45:0/3257017641 learned_addr learned my addr 172.21.15.45:0/3257017641 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:17.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.710+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3257017641 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0aaf60 0x7f2b5c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.710+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363475962 0 0) 0x7f2b5c152660 con 0x7f2b5c06d960 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.710+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003520 con 0x7f2b5c06d960 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183431725 0 0) 0x7f2b48003520 con 0x7f2b5c06d960 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0aaf60 msgr2=0x7f2b5c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 --2- 172.21.15.45:0/3257017641 >> v2:172.21.15.114:3300/0 conn(0x7f2b5c0aaf60 0x7f2b5c0c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 >> v1:172.21.15.114:6789/0 conn(0x7f2b5c0c1930 legacy=0x7f2b5c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0c3310 con 0x7f2b5c06d960 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f2b4c0019f0 con 0x7f2b5c06d960 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 >> v1:172.21.15.45:6789/0 conn(0x7f2b5c06d960 legacy=0x7f2b5c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 0x7f2b48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480047c0 0x7f2b48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48005180 0x7f2b4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0a4d10 con 0x7f2b48003970 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4800c120 con 0x7f2b480047c0 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4800c2e0 con 0x7f2b48005180 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 0x7f2b48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b5affd640 1 -- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48005180 msgr2=0x7f2b4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b5b7fe640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48005180 0x7f2b4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.711+0000 7f2b5a7fc640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480047c0 0x7f2b48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48005180 0x7f2b4800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5affd640 1 -- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480047c0 msgr2=0x7f2b48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480047c0 0x7f2b48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5affd640 1 -- 172.21.15.45:0/3257017641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48003520 con 0x7f2b48003970 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5b7fe640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48005180 0x7f2b4800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5a7fc640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480047c0 0x7f2b48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.712+0000 7f2b5b7fe640 1 -- 172.21.15.45:0/3257017641 reap_dead start 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 0x7f2b48003d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009ac0 tx=0x7f2b480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643335362b09b2a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4402c6b0 con 0x7f2b48003970 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4402c810 con 0x7f2b48003970 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b59ffb640 1 -- 172.21.15.45:0/3257017641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4402cba0 con 0x7f2b48003970 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b6153e640 1 -- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 msgr2=0x7f2b48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.713+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 0x7f2b48003d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009ac0 tx=0x7f2b480057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.714+0000 7f2b6153e640 1 -- 172.21.15.45:0/3257017641 shutdown_connections 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.714+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3257017641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b48003970 0x7f2b48003d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.714+0000 7f2b6153e640 1 -- 172.21.15.45:0/3257017641 >> 172.21.15.45:0/3257017641 conn(0x7f2b5c0c2430 msgr2=0x7f2b5c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.714+0000 7f2b6153e640 1 -- 172.21.15.45:0/3257017641 shutdown_connections 2023-12-08T08:15:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.714+0000 7f2b6153e640 1 -- 172.21.15.45:0/3257017641 wait complete. 2023-12-08T08:15:17.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.716+0000 7f2b6153e640 1 Processor -- start 2023-12-08T08:15:17.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.716+0000 7f2b6153e640 1 -- start start 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 0x7f2b5c14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 0x7f2b5c1eb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c154950 con 0x7f2b5c1479d0 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c153ce0 con 0x7f2b5c1eabb0 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b6153e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c154390 con 0x7f2b48003970 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54206/0 (socket says 172.21.15.45:54206) 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 -- 172.21.15.45:0/3626310108 learned_addr learned my addr 172.21.15.45:0/3626310108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 0x7f2b5c14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 -- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 msgr2=0x7f2b5c14d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 0x7f2b5c14d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 -- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 msgr2=0x7f2b5c1eb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5b7fe640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 0x7f2b5c1eb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 0x7f2b5c1eb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.717+0000 7f2b5a7fc640 1 -- 172.21.15.45:0/3626310108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c154670 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 0x7f2b5c14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b5b7fe640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 0x7f2b5c1eb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b5a7fc640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b0d0 tx=0x7f2b4c00b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c004d60 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c0070d0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c153970 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c007440 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.718+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c148370 con 0x7f2b5c1479d0 2023-12-08T08:15:17.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.719+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c1537d0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.720+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b4c0075a0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.722+0000 7f2b537fe640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 0x7f2b3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:17.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.722+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b4c089e30 con 0x7f2b5c1479d0 2023-12-08T08:15:17.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.722+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 0x7f2b3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:17.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.723+0000 7f2b5affd640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 0x7f2b3c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b44036000 tx=0x7f2b44030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:17.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.726+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b5c1537d0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.922+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2b5c1537d0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.923+0000 7f2b537fe640 1 -- 172.21.15.45:0/3626310108 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2b5c1537d0 con 0x7f2b5c1479d0 2023-12-08T08:15:17.925 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 msgr2=0x7f2b3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 0x7f2b3c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b44036000 tx=0x7f2b44030000 comp rx=0 tx=0).stop 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 msgr2=0x7f2b5c147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b0d0 tx=0x7f2b4c00b590 comp rx=0 tx=0).stop 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 shutdown_connections 2023-12-08T08:15:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b3c06ae40 0x7f2b3c06d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b5c1eabb0 0x7f2b5c1eb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5c1479d0 0x7f2b5c147e30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 --2- 172.21.15.45:0/3626310108 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b48003970 0x7f2b5c14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.925+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 >> 172.21.15.45:0/3626310108 conn(0x7f2b5c0c2430 msgr2=0x7f2b5c0a6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.926+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 shutdown_connections 2023-12-08T08:15:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:17.926+0000 7f2b6153e640 1 -- 172.21.15.45:0/3626310108 wait complete. 2023-12-08T08:15:17.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:15:18.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.171+0000 7f795e5c9640 1 Processor -- start 2023-12-08T08:15:18.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.171+0000 7f795e5c9640 1 -- start start 2023-12-08T08:15:18.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795e5c9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f795814e310 0x7f79580c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795e5c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79580c7ef0 con 0x7f795806b960 2023-12-08T08:15:18.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795e5c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79580c6b30 con 0x7f79580c7a40 2023-12-08T08:15:18.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795e5c9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79580c6e10 con 0x7f795814e310 2023-12-08T08:15:18.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795ddc8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f795806b960 0x7f79580c44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34030/0 (socket says 172.21.15.45:34030) 2023-12-08T08:15:18.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795ddc8640 1 -- 172.21.15.45:0/1273204550 learned_addr learned my addr 172.21.15.45:0/1273204550 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:18.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.173+0000 7f795d5c7640 1 --2- 172.21.15.45:0/1273204550 >> v2:172.21.15.114:3300/0 conn(0x7f795814e310 0x7f79580c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223128861 0 0) 0x7f79580c7ef0 con 0x7f795806b960 2023-12-08T08:15:18.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7944003520 con 0x7f795806b960 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179744774 0 0) 0x7f7944003520 con 0x7f795806b960 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 >> v2:172.21.15.114:3300/0 conn(0x7f795814e310 msgr2=0x7f79580c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 --2- 172.21.15.45:0/1273204550 >> v2:172.21.15.114:3300/0 conn(0x7f795814e310 0x7f79580c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 >> v1:172.21.15.114:6789/0 conn(0x7f79580c7a40 legacy=0x7f7958154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795806ae80 con 0x7f795806b960 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f7950001670 con 0x7f795806b960 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 >> v1:172.21.15.45:6789/0 conn(0x7f795806b960 legacy=0x7f79580c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79440039c0 0x7f7944003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 0x7f7944004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440051d0 0x7f794400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580c6e10 con 0x7f79440047c0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794400c120 con 0x7f79440039c0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.174+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794400c2e0 con 0x7f79440051d0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 0x7f7944004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795d5c7640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79440039c0 0x7f7944003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795ddc8640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440051d0 0x7f794400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 -- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440051d0 msgr2=0x7f794400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440051d0 0x7f794400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 -- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79440039c0 msgr2=0x7f7944003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79440039c0 0x7f7944003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795cdc6640 1 -- 172.21.15.45:0/1273204550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944003520 con 0x7f79440047c0 2023-12-08T08:15:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.175+0000 7f795ddc8640 1 -- 172.21.15.45:0/1273204550 reap_dead start 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.176+0000 7f795cdc6640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 0x7f7944004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7948001e20 tx=0x7f79440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73949d0af553c4fb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948003b70 con 0x7f79440047c0 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948003cd0 con 0x7f79440047c0 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f794ffff640 1 -- 172.21.15.45:0/1273204550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948005310 con 0x7f79440047c0 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 -- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 msgr2=0x7f7944004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 0x7f7944004c40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7948001e20 tx=0x7f79440057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 -- 172.21.15.45:0/1273204550 shutdown_connections 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 --2- 172.21.15.45:0/1273204550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440047c0 0x7f7944004c40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 -- 172.21.15.45:0/1273204550 >> 172.21.15.45:0/1273204550 conn(0x7f79580ab710 msgr2=0x7f79580abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.177+0000 7f795e5c9640 1 -- 172.21.15.45:0/1273204550 shutdown_connections 2023-12-08T08:15:18.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.178+0000 7f795e5c9640 1 -- 172.21.15.45:0/1273204550 wait complete. 2023-12-08T08:15:18.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.179+0000 7f795e5c9640 1 Processor -- start 2023-12-08T08:15:18.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.179+0000 7f795e5c9640 1 -- start start 2023-12-08T08:15:18.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 0x7f795814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7958149420 0x7f7958151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795814f590 con 0x7f79581488f0 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79581492b0 con 0x7f7958149420 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.180+0000 7f795e5c9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795814ef30 con 0x7f79440047c0 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54218/0 (socket says 172.21.15.45:54218) 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 -- 172.21.15.45:0/3647650459 learned_addr learned my addr 172.21.15.45:0/3647650459 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795d5c7640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 0x7f795814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795cdc6640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7958149420 0x7f7958151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 -- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 msgr2=0x7f795814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 0x7f795814e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 -- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7958149420 msgr2=0x7f7958151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7958149420 0x7f7958151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795ddc8640 1 -- 172.21.15.45:0/3647650459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580c39c0 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.181+0000 7f795d5c7640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 0x7f795814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f795ddc8640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79580c7210 tx=0x7f795000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500074e0 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950007660 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950004a20 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79581504d0 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.182+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7958150a90 con 0x7f79581488f0 2023-12-08T08:15:18.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.183+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79580c4cb0 con 0x7f79581488f0 2023-12-08T08:15:18.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.184+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7950004b80 con 0x7f79581488f0 2023-12-08T08:15:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.186+0000 7f794dffb640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 0x7f793c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.186+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7950088fc0 con 0x7f79581488f0 2023-12-08T08:15:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.186+0000 7f795d5c7640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 0x7f793c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:18.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.187+0000 7f795d5c7640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 0x7f793c06d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f795804fab0 tx=0x7f7954008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.190+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7950053d70 con 0x7f79581488f0 2023-12-08T08:15:18.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.401+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79580721b0 con 0x7f79581488f0 2023-12-08T08:15:18.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.401+0000 7f794dffb640 1 -- 172.21.15.45:0/3647650459 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7950057390 con 0x7f79581488f0 2023-12-08T08:15:18.404 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:15:18.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.404+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 msgr2=0x7f793c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.404+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 0x7f793c06d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f795804fab0 tx=0x7f7954008040 comp rx=0 tx=0).stop 2023-12-08T08:15:18.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 msgr2=0x7f7958148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:18.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79580c7210 tx=0x7f795000d900 comp rx=0 tx=0).stop 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 shutdown_connections 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f793c06ae70 0x7f793c06d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79581488f0 0x7f7958148d70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7958149420 0x7f7958151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 --2- 172.21.15.45:0/3647650459 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79440047c0 0x7f795814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 >> 172.21.15.45:0/3647650459 conn(0x7f79580ab710 msgr2=0x7f7958153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 shutdown_connections 2023-12-08T08:15:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:18.405+0000 7f795e5c9640 1 -- 172.21.15.45:0/3647650459 wait complete. 2023-12-08T08:15:18.428 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-08T08:15:18.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:18.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:15:18.519 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[93965]: fuse finished with error 0 and tester_r 0 2023-12-08T08:15:18.524 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:15:24.626 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:15:24.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:24.626 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-08T08:15:24.701 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.932+0000 7f49e7fff640 1 Processor -- start 2023-12-08T08:15:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.933+0000 7f49e7fff640 1 -- start start 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.934+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 0x7f49e80c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.934+0000 7f49e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49e80ab2c0 0x7f49e8154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.934+0000 7f49e7fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e8073c40 con 0x7f49e8158320 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.934+0000 7f49e7fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e8151ed0 con 0x7f49e80ab2c0 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.934+0000 7f49e7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e806d380 con 0x7f49e8151af0 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49e80ab2c0 0x7f49e8154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49e77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f49e8158320 0x7f49e80bf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34040/0 (socket says 172.21.15.45:34040) 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49e77fe640 1 -- 172.21.15.45:0/4201439518 learned_addr learned my addr 172.21.15.45:0/4201439518 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49e6ffd640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 0x7f49e80c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49dffff640 1 -- 172.21.15.45:0/4201439518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 msgr2=0x7f49e80c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49dffff640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 0x7f49e80c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49dffff640 1 -- 172.21.15.45:0/4201439518 >> v1:172.21.15.45:6789/0 conn(0x7f49e8158320 legacy=0x7f49e80bf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49dffff640 1 -- 172.21.15.45:0/4201439518 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80c0c50 con 0x7f49e80ab2c0 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.935+0000 7f49e6ffd640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 0x7f49e80c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.936+0000 7f49dffff640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e80ab2c0 0x7f49e8154400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49d00097a0 tx=0x7f49d002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b7d44becc9afbb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e67fc640 1 -- 172.21.15.45:0/4201439518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d002f050 con 0x7f49e80ab2c0 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e67fc640 1 -- 172.21.15.45:0/4201439518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0031700 con 0x7f49e80ab2c0 2023-12-08T08:15:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e67fc640 1 -- 172.21.15.45:0/4201439518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0031a90 con 0x7f49e80ab2c0 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 -- 172.21.15.45:0/4201439518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e80ab2c0 msgr2=0x7f49e8154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e80ab2c0 0x7f49e8154400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49d00097a0 tx=0x7f49d002b7a0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 -- 172.21.15.45:0/4201439518 shutdown_connections 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e80ab2c0 0x7f49e8154400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 --2- 172.21.15.45:0/4201439518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8151af0 0x7f49e80c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 -- 172.21.15.45:0/4201439518 >> 172.21.15.45:0/4201439518 conn(0x7f49e806c220 msgr2=0x7f49e806c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 -- 172.21.15.45:0/4201439518 shutdown_connections 2023-12-08T08:15:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.937+0000 7f49e7fff640 1 -- 172.21.15.45:0/4201439518 wait complete. 2023-12-08T08:15:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.939+0000 7f49e7fff640 1 Processor -- start 2023-12-08T08:15:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.939+0000 7f49e7fff640 1 -- start start 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e80ab2c0 0x7f49e8143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8158320 0x7f49e81ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e814d3b0 con 0x7f49e8151af0 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81ea500 con 0x7f49e80ab2c0 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.940+0000 7f49e7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81e98a0 con 0x7f49e8158320 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54234/0 (socket says 172.21.15.45:54234) 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 -- 172.21.15.45:0/890173075 learned_addr learned my addr 172.21.15.45:0/890173075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49e77fe640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8158320 0x7f49e81ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 -- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8158320 msgr2=0x7f49e81ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49e6ffd640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e80ab2c0 0x7f49e8143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8158320 0x7f49e81ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 -- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e80ab2c0 msgr2=0x7f49e8143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e80ab2c0 0x7f49e8143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.941+0000 7f49dffff640 1 -- 172.21.15.45:0/890173075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009400 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49dffff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49d00098c0 tx=0x7f49d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0033c30 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0033d90 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d003c640 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e81e9b60 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.942+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e81ea120 con 0x7f49e8151af0 2023-12-08T08:15:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.943+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80743e0 con 0x7f49e8151af0 2023-12-08T08:15:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.944+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49d003a040 con 0x7f49e8151af0 2023-12-08T08:15:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.946+0000 7f49df7fe640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 0x7f49c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.946+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49d00ab330 con 0x7f49e8151af0 2023-12-08T08:15:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.946+0000 7f49e6ffd640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 0x7f49c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:24.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.946+0000 7f49e6ffd640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 0x7f49c806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49d8008850 tx=0x7f49d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:24.951+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49d0076200 con 0x7f49e8151af0 2023-12-08T08:15:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.146+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e8073e30 con 0x7f49e8151af0 2023-12-08T08:15:25.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.149+0000 7f49df7fe640 1 -- 172.21.15.45:0/890173075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f49d0079820 con 0x7f49e8151af0 2023-12-08T08:15:25.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:25.153 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.152+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 msgr2=0x7f49c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.152+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 0x7f49c806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49d8008850 tx=0x7f49d8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.152+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 msgr2=0x7f49e8145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.152+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f49d00098c0 tx=0x7f49d00046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 shutdown_connections 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c806ae40 0x7f49c806d300 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f49d8008850 tx=0x7f49d8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49e8158320 0x7f49e81ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49e8151af0 0x7f49e8145430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 --2- 172.21.15.45:0/890173075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e80ab2c0 0x7f49e8143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 >> 172.21.15.45:0/890173075 conn(0x7f49e806c220 msgr2=0x7f49e80bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 shutdown_connections 2023-12-08T08:15:25.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.153+0000 7f49e7fff640 1 -- 172.21.15.45:0/890173075 wait complete. 2023-12-08T08:15:25.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.398+0000 7f6e5f543640 1 Processor -- start 2023-12-08T08:15:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.398+0000 7f6e5f543640 1 -- start start 2023-12-08T08:15:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.399+0000 7f6e5f543640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6e580a7910 0x7f6e580c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.399+0000 7f6e5f543640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e58155850 con 0x7f6e580c1dc0 2023-12-08T08:15:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.399+0000 7f6e5f543640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580c0890 con 0x7f6e581521b0 2023-12-08T08:15:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.399+0000 7f6e5f543640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580c0b70 con 0x7f6e580a7910 2023-12-08T08:15:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.400+0000 7f6e5dd40640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6e580c1dc0 0x7f6e5814f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51808/0 (socket says 172.21.15.45:51808) 2023-12-08T08:15:25.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.400+0000 7f6e5dd40640 1 -- 172.21.15.45:0/1465956452 learned_addr learned my addr 172.21.15.45:0/1465956452 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.400+0000 7f6e5e541640 1 --2- 172.21.15.45:0/1465956452 >> v2:172.21.15.114:3300/0 conn(0x7f6e580a7910 0x7f6e580c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.400+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610150733 0 0) 0x7f6e58155850 con 0x7f6e580c1dc0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.400+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e44003520 con 0x7f6e580c1dc0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625978716 0 0) 0x7f6e44003520 con 0x7f6e580c1dc0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 >> v2:172.21.15.114:3300/0 conn(0x7f6e580a7910 msgr2=0x7f6e580c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 --2- 172.21.15.45:0/1465956452 >> v2:172.21.15.114:3300/0 conn(0x7f6e580a7910 0x7f6e580c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 >> v1:172.21.15.114:6789/0 conn(0x7f6e581521b0 legacy=0x7f6e58155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580c0e50 con 0x7f6e580c1dc0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f6e48001670 con 0x7f6e580c1dc0 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 >> v1:172.21.15.45:6789/0 conn(0x7f6e580c1dc0 legacy=0x7f6e5814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 0x7f6e44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440047c0 0x7f6e44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440051d0 0x7f6e4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580c0b70 con 0x7f6e440039c0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4400c120 con 0x7f6e440047c0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4400c2e0 con 0x7f6e440051d0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.401+0000 7f6e5e541640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 0x7f6e44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5ed42640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440051d0 0x7f6e4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5e541640 1 -- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440051d0 msgr2=0x7f6e4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5dd40640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440047c0 0x7f6e44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5e541640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440051d0 0x7f6e4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5e541640 1 -- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440047c0 msgr2=0x7f6e44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5e541640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440047c0 0x7f6e44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5e541640 1 -- 172.21.15.45:0/1465956452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44003520 con 0x7f6e440039c0 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5ed42640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440051d0 0x7f6e4400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5dd40640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e440047c0 0x7f6e44004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.402+0000 7f6e5ed42640 1 -- 172.21.15.45:0/1465956452 reap_dead start 2023-12-08T08:15:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.403+0000 7f6e5e541640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 0x7f6e44003de0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009a90 tx=0x7f6e440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d771ad8373f4f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.403+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5402c680 con 0x7f6e440039c0 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.403+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5402c7e0 con 0x7f6e440039c0 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.403+0000 7f6e5d53f640 1 -- 172.21.15.45:0/1465956452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5402cb70 con 0x7f6e440039c0 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 -- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 msgr2=0x7f6e44003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 0x7f6e44003de0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009a90 tx=0x7f6e440057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 -- 172.21.15.45:0/1465956452 shutdown_connections 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 --2- 172.21.15.45:0/1465956452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e440039c0 0x7f6e44003de0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 -- 172.21.15.45:0/1465956452 >> 172.21.15.45:0/1465956452 conn(0x7f6e580c5780 msgr2=0x7f6e580c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 -- 172.21.15.45:0/1465956452 shutdown_connections 2023-12-08T08:15:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.404+0000 7f6e5f543640 1 -- 172.21.15.45:0/1465956452 wait complete. 2023-12-08T08:15:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.406+0000 7f6e5f543640 1 Processor -- start 2023-12-08T08:15:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.406+0000 7f6e5f543640 1 -- start start 2023-12-08T08:15:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440039c0 0x7f6e580a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 0x7f6e580c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580a5910 con 0x7f6e5814bde0 2023-12-08T08:15:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5814c7d0 con 0x7f6e581548f0 2023-12-08T08:15:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5f543640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5806d810 con 0x7f6e440039c0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.407+0000 7f6e5ed42640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54678/0 (socket says 172.21.15.45:54678) 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 -- 172.21.15.45:0/2084201165 learned_addr learned my addr 172.21.15.45:0/2084201165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5dd40640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 0x7f6e580c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5e541640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440039c0 0x7f6e580a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 -- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440039c0 msgr2=0x7f6e580a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440039c0 0x7f6e580a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 -- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 msgr2=0x7f6e580c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 0x7f6e580c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 -- 172.21.15.45:0/2084201165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580a5630 con 0x7f6e5814bde0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5dd40640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 0x7f6e580c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.408+0000 7f6e5ed42640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e580c65d0 tx=0x7f6e5000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.409+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003b70 con 0x7f6e5814bde0 2023-12-08T08:15:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.409+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50003cf0 con 0x7f6e5814bde0 2023-12-08T08:15:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.409+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e581ea830 con 0x7f6e5814bde0 2023-12-08T08:15:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.409+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50003ea0 con 0x7f6e5814bde0 2023-12-08T08:15:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.409+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e581eab10 con 0x7f6e5814bde0 2023-12-08T08:15:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.410+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58155a00 con 0x7f6e5814bde0 2023-12-08T08:15:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.411+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e500052b0 con 0x7f6e5814bde0 2023-12-08T08:15:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.413+0000 7f6e4effd640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 0x7f6e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.413+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e50089220 con 0x7f6e5814bde0 2023-12-08T08:15:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.413+0000 7f6e5e541640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 0x7f6e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.414+0000 7f6e5e541640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 0x7f6e3c06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e54036000 tx=0x7f6e54030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.417+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e50053fd0 con 0x7f6e5814bde0 2023-12-08T08:15:25.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.613+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e580743e0 con 0x7f6e5814bde0 2023-12-08T08:15:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.616+0000 7f6e4effd640 1 -- 172.21.15.45:0/2084201165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f6e500575f0 con 0x7f6e5814bde0 2023-12-08T08:15:25.619 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:25.619 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.618+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 msgr2=0x7f6e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.618+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 0x7f6e3c06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e54036000 tx=0x7f6e54030000 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 msgr2=0x7f6e5814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e580c65d0 tx=0x7f6e5000dc00 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 shutdown_connections 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6e3c06ae70 0x7f6e3c06d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e5814bde0 0x7f6e5814c290 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e581548f0 0x7f6e580c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 --2- 172.21.15.45:0/2084201165 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6e440039c0 0x7f6e580a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 >> 172.21.15.45:0/2084201165 conn(0x7f6e580c5780 msgr2=0x7f6e581519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 shutdown_connections 2023-12-08T08:15:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.619+0000 7f6e5f543640 1 -- 172.21.15.45:0/2084201165 wait complete. 2023-12-08T08:15:25.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:15:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.869+0000 7f3186c09640 1 Processor -- start 2023-12-08T08:15:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.869+0000 7f3186c09640 1 -- start start 2023-12-08T08:15:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3186c09640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f318006ba10 0x7f31801591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3186c09640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318006d2d0 con 0x7f3180155e40 2023-12-08T08:15:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3186c09640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800c5470 con 0x7f31800c36e0 2023-12-08T08:15:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3186c09640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31801597a0 con 0x7f318006ba10 2023-12-08T08:15:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3185c07640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3180155e40 0x7f31800c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51810/0 (socket says 172.21.15.45:51810) 2023-12-08T08:15:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3185c07640 1 -- 172.21.15.45:0/497466902 learned_addr learned my addr 172.21.15.45:0/497466902 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.871+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729761928 0 0) 0x7f318006d2d0 con 0x7f3180155e40 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f316c003520 con 0x7f3180155e40 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3185406640 1 --2- 172.21.15.45:0/497466902 >> v2:172.21.15.114:3300/0 conn(0x7f318006ba10 0x7f31801591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3538271315 0 0) 0x7f316c003520 con 0x7f3180155e40 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 >> v2:172.21.15.114:3300/0 conn(0x7f318006ba10 msgr2=0x7f31801591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 --2- 172.21.15.45:0/497466902 >> v2:172.21.15.114:3300/0 conn(0x7f318006ba10 0x7f31801591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 >> v1:172.21.15.114:6789/0 conn(0x7f31800c36e0 legacy=0x7f31800c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800c4d00 con 0x7f3180155e40 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f317c001670 con 0x7f3180155e40 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 >> v1:172.21.15.45:6789/0 conn(0x7f3180155e40 legacy=0x7f31800c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 0x7f316c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f316c0047c0 0x7f316c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0051d0 0x7f316c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31801597a0 con 0x7f316c0039c0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c00c120 con 0x7f316c0051d0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.872+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c00c2e0 con 0x7f316c0047c0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 0x7f316c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185406640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f316c0047c0 0x7f316c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3186408640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0051d0 0x7f316c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 -- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f316c0047c0 msgr2=0x7f316c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f316c0047c0 0x7f316c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 -- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0051d0 msgr2=0x7f316c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0051d0 0x7f316c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3185c07640 1 -- 172.21.15.45:0/497466902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c003520 con 0x7f316c0039c0 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3186408640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0051d0 0x7f316c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.873+0000 7f3186408640 1 -- 172.21.15.45:0/497466902 reap_dead start 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.874+0000 7f3185c07640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 0x7f316c003de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f317c007fc0 tx=0x7f316c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171fe14aff80da0d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.874+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c005ad0 con 0x7f316c0039c0 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c005c30 con 0x7f316c0039c0 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3184c05640 1 -- 172.21.15.45:0/497466902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c02ca00 con 0x7f316c0039c0 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 -- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 msgr2=0x7f316c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 0x7f316c003de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f317c007fc0 tx=0x7f316c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 -- 172.21.15.45:0/497466902 shutdown_connections 2023-12-08T08:15:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 --2- 172.21.15.45:0/497466902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f316c0039c0 0x7f316c003de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 -- 172.21.15.45:0/497466902 >> 172.21.15.45:0/497466902 conn(0x7f3180066ce0 msgr2=0x7f31800a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 -- 172.21.15.45:0/497466902 shutdown_connections 2023-12-08T08:15:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.875+0000 7f3186c09640 1 -- 172.21.15.45:0/497466902 wait complete. 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.877+0000 7f3186c09640 1 Processor -- start 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.877+0000 7f3186c09640 1 -- start start 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0039c0 0x7f31800711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f318014f8e0 0x7f318014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180150730 con 0x7f31801ef6c0 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180071730 con 0x7f316c0039c0 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.878+0000 7f3186c09640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3180070770 con 0x7f318014f8e0 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54704/0 (socket says 172.21.15.45:54704) 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 -- 172.21.15.45:0/2027666584 learned_addr learned my addr 172.21.15.45:0/2027666584 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185c07640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0039c0 0x7f31800711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3186408640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f318014f8e0 0x7f318014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 -- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f318014f8e0 msgr2=0x7f318014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f318014f8e0 0x7f318014fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 -- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0039c0 msgr2=0x7f31800711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0039c0 0x7f31800711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 -- 172.21.15.45:0/2027666584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31801f2370 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.879+0000 7f3185406640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f317000f660 tx=0x7f317000fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.880+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000d8e0 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.880+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000da40 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.880+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000ddb0 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.880+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31800709f0 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.880+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3180071be0 con 0x7f31801ef6c0 2023-12-08T08:15:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.881+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31800678c0 con 0x7f31801ef6c0 2023-12-08T08:15:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.882+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3170014460 con 0x7f31801ef6c0 2023-12-08T08:15:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.883+0000 7f31767fc640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 0x7f316406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.883+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f317008a220 con 0x7f31801ef6c0 2023-12-08T08:15:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.883+0000 7f3185c07640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 0x7f316406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.884+0000 7f3185c07640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 0x7f316406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f317c034000 tx=0x7f317c007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:25.888+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3170054fd0 con 0x7f31801ef6c0 2023-12-08T08:15:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.128+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31801591c0 con 0x7f31801ef6c0 2023-12-08T08:15:26.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.758+0000 7f31767fc640 1 -- 172.21.15.45:0/2027666584 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f31700585f0 con 0x7f31801ef6c0 2023-12-08T08:15:26.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.762+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 msgr2=0x7f316406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:26.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.762+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 0x7f316406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f317c034000 tx=0x7f317c007000 comp rx=0 tx=0).stop 2023-12-08T08:15:26.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.762+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 msgr2=0x7f31801f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.762+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f317000f660 tx=0x7f317000fb20 comp rx=0 tx=0).stop 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 shutdown_connections 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f316406ae70 0x7f316406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f318014f8e0 0x7f318014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31801ef6c0 0x7f31801f1a30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 --2- 172.21.15.45:0/2027666584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0039c0 0x7f31800711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 >> 172.21.15.45:0/2027666584 conn(0x7f3180066ce0 msgr2=0x7f3180154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 shutdown_connections 2023-12-08T08:15:26.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:26.763+0000 7f3186c09640 1 -- 172.21.15.45:0/2027666584 wait complete. 2023-12-08T08:15:26.787 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-08T08:15:26.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:15:27.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.022+0000 7f339ab88640 1 Processor -- start 2023-12-08T08:15:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.022+0000 7f339ab88640 1 -- start start 2023-12-08T08:15:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.023+0000 7f339ab88640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 0x7f33940a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.023+0000 7f339ab88640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940c60c0 con 0x7f3394155790 2023-12-08T08:15:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.023+0000 7f339ab88640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3394152dc0 con 0x7f33940c4970 2023-12-08T08:15:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.023+0000 7f339ab88640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33941521d0 con 0x7f339414c280 2023-12-08T08:15:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.024+0000 7f339a387640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3394155790 0x7f3394155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51820/0 (socket says 172.21.15.45:51820) 2023-12-08T08:15:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.024+0000 7f339a387640 1 -- 172.21.15.45:0/2618452943 learned_addr learned my addr 172.21.15.45:0/2618452943 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.024+0000 7f3399b86640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 0x7f33940a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.024+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542386094 0 0) 0x7f338c001110 con 0x7f3394155790 2023-12-08T08:15:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.024+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003520 con 0x7f3394155790 2023-12-08T08:15:27.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4037272259 0 0) 0x7f337c003520 con 0x7f3394155790 2023-12-08T08:15:27.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 msgr2=0x7f33940a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 0x7f33940a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 >> v1:172.21.15.114:6789/0 conn(0x7f33940c4970 legacy=0x7f339406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339414c660 con 0x7f3394155790 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f338c001800 con 0x7f3394155790 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 >> v1:172.21.15.45:6789/0 conn(0x7f3394155790 legacy=0x7f3394155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337c0039a0 0x7f337c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0047c0 0x7f337c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 0x7f337c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941521d0 con 0x7f337c0039a0 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bb10 con 0x7f337c0047c0 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bcd0 con 0x7f339414c280 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.025+0000 7f3399b86640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337c0039a0 0x7f337c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.026+0000 7f3399b86640 1 -- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 msgr2=0x7f337c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.026+0000 7f3399b86640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f339414c280 0x7f337c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.026+0000 7f3399b86640 1 -- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0047c0 msgr2=0x7f337c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:27.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.026+0000 7f3399b86640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c0047c0 0x7f337c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.026+0000 7f3399b86640 1 -- 172.21.15.45:0/2618452943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c003520 con 0x7f337c0039a0 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.027+0000 7f3399b86640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337c0039a0 0x7f337c003dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3384009fc0 tx=0x7f337c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17d19baf257781 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.027+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338402cc60 con 0x7f337c0039a0 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.027+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400f040 con 0x7f337c0039a0 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.027+0000 7f3398b84640 1 -- 172.21.15.45:0/2618452943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384034440 con 0x7f337c0039a0 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 -- 172.21.15.45:0/2618452943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337c0039a0 msgr2=0x7f337c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 --2- 172.21.15.45:0/2618452943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337c0039a0 0x7f337c003dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3384009fc0 tx=0x7f337c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339a387640 1 -- 172.21.15.45:0/2618452943 reap_dead start 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 -- 172.21.15.45:0/2618452943 shutdown_connections 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 -- 172.21.15.45:0/2618452943 >> 172.21.15.45:0/2618452943 conn(0x7f3394066ce0 msgr2=0x7f33940a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 -- 172.21.15.45:0/2618452943 shutdown_connections 2023-12-08T08:15:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.028+0000 7f339ab88640 1 -- 172.21.15.45:0/2618452943 wait complete. 2023-12-08T08:15:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.030+0000 7f339ab88640 1 Processor -- start 2023-12-08T08:15:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.030+0000 7f339ab88640 1 -- start start 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 0x7f33940a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3394149520 0x7f33940bec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339414bb80 con 0x7f33940a7690 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339414b0b0 con 0x7f3394149520 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f339ab88640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339414b2e0 con 0x7f337c0039a0 2023-12-08T08:15:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f3399385640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f3399385640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54726/0 (socket says 172.21.15.45:54726) 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f3399385640 1 -- 172.21.15.45:0/2918023800 learned_addr learned my addr 172.21.15.45:0/2918023800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.031+0000 7f3399b86640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 0x7f33940a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f339a387640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3394149520 0x7f33940bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 -- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 msgr2=0x7f33940a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 0x7f33940a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 -- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3394149520 msgr2=0x7f33940bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3394149520 0x7f33940bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 -- 172.21.15.45:0/2918023800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339414b5c0 con 0x7f33940a7690 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399b86640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 0x7f33940a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f3399385640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f338800c530 tx=0x7f338800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880052d0 con 0x7f33940a7690 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388005430 con 0x7f33940a7690 2023-12-08T08:15:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.032+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339414b8a0 con 0x7f33940a7690 2023-12-08T08:15:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.033+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388012870 con 0x7f33940a7690 2023-12-08T08:15:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.033+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394146220 con 0x7f33940a7690 2023-12-08T08:15:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.034+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940678c0 con 0x7f33940a7690 2023-12-08T08:15:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.035+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33880129d0 con 0x7f33940a7690 2023-12-08T08:15:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.036+0000 7f33927fc640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.036+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33880894e0 con 0x7f33940a7690 2023-12-08T08:15:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.036+0000 7f3399b86640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.037+0000 7f3399b86640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 0x7f338006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3384037040 tx=0x7f338402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:27.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.040+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3388054210 con 0x7f33940a7690 2023-12-08T08:15:27.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.273+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f33940743e0 con 0x7f33940a7690 2023-12-08T08:15:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.768+0000 7f33927fc640 1 -- 172.21.15.45:0/2918023800 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3388057830 con 0x7f33940a7690 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 msgr2=0x7f338006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 0x7f338006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3384037040 tx=0x7f338402e000 comp rx=0 tx=0).stop 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 msgr2=0x7f33941ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f338800c530 tx=0x7f338800c9f0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 shutdown_connections 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338006ae70 0x7f338006d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3394149520 0x7f33940bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33940a7690 0x7f33941ea160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 --2- 172.21.15.45:0/2918023800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f337c0039a0 0x7f33940a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 >> 172.21.15.45:0/2918023800 conn(0x7f3394066ce0 msgr2=0x7f3394150040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 shutdown_connections 2023-12-08T08:15:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:27.772+0000 7f339ab88640 1 -- 172.21.15.45:0/2918023800 wait complete. 2023-12-08T08:15:27.797 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:15:27.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:27.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:15:27.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:15:28.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.020+0000 7f91071de640 1 Processor -- start 2023-12-08T08:15:28.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.021+0000 7f91071de640 1 -- start start 2023-12-08T08:15:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.022+0000 7f91071de640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f91000c6880 0x7f91000c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.022+0000 7f91071de640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.022+0000 7f91071de640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91000c80f0 con 0x7f91000c4e90 2023-12-08T08:15:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f91071de640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91000c83d0 con 0x7f91000c6880 2023-12-08T08:15:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f91071de640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000c86b0 con 0x7f9100155600 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f910577b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f910577b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40700/0 (socket says 172.21.15.45:40700) 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f910577b640 1 -- 172.21.15.45:0/3304182716 learned_addr learned my addr 172.21.15.45:0/3304182716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f90fffff640 1 --1- 172.21.15.45:0/3304182716 >> v1:172.21.15.114:6789/0 conn(0x7f91000c4e90 0x7f9100154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:60134/0 (socket says 172.21.15.45:60134) 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.023+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3304182716 >> v2:172.21.15.114:3300/0 conn(0x7f91000c6880 0x7f91000c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710393653 0 0) 0x7f91000c80f0 con 0x7f91000c4e90 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f0003520 con 0x7f91000c4e90 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f9104f7a640 1 -- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 msgr2=0x7f91000c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f9104f7a640 1 -- 172.21.15.45:0/3304182716 >> v1:172.21.15.114:6789/0 conn(0x7f91000c4e90 legacy=0x7f9100154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 <== mon.1 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321786798 0 0) 0x7f90f0003520 con 0x7f91000c4e90 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f9104f7a640 1 -- 172.21.15.45:0/3304182716 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000c2530 con 0x7f91000c6880 2023-12-08T08:15:28.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.024+0000 7f910577b640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:28.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.026+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c6880 0x7f91000c7aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097a0 tx=0x7f90f402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4ff969c7c11c59 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.026+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec001670 con 0x7f91000c6880 2023-12-08T08:15:28.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.026+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f402e050 con 0x7f91000c6880 2023-12-08T08:15:28.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.026+0000 7f90ff7fe640 1 -- 172.21.15.45:0/3304182716 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4030730 con 0x7f91000c6880 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 -- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c6880 msgr2=0x7f91000c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c6880 0x7f91000c7aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90f40097a0 tx=0x7f90f402b790 comp rx=0 tx=0).stop 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 -- 172.21.15.45:0/3304182716 shutdown_connections 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91000c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 --2- 172.21.15.45:0/3304182716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c6880 0x7f91000c7aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 -- 172.21.15.45:0/3304182716 >> 172.21.15.45:0/3304182716 conn(0x7f9100072240 msgr2=0x7f91000661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 -- 172.21.15.45:0/3304182716 shutdown_connections 2023-12-08T08:15:28.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.027+0000 7f91071de640 1 -- 172.21.15.45:0/3304182716 wait complete. 2023-12-08T08:15:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.029+0000 7f91071de640 1 Processor -- start 2023-12-08T08:15:28.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.029+0000 7f91071de640 1 -- start start 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c4e90 0x7f91001ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91001eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910014e170 con 0x7f91000c6880 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000aa500 con 0x7f91000c4e90 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f91071de640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91001ea340 con 0x7f9100155600 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54732/0 (socket says 172.21.15.45:54732) 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 -- 172.21.15.45:0/3108748889 learned_addr learned my addr 172.21.15.45:0/3108748889 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f910577b640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91001eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c4e90 0x7f91001ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 -- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 msgr2=0x7f91001eaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91001eaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 -- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c4e90 msgr2=0x7f91001ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c4e90 0x7f91001ed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.030+0000 7f90fffff640 1 -- 172.21.15.45:0/3108748889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8009b30 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f90fffff640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c750 tx=0x7f90ec00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec007270 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec0073f0 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4009400 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec005810 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.031+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910014fac0 con 0x7f91000c6880 2023-12-08T08:15:28.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.032+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91000c1f30 con 0x7f91000c6880 2023-12-08T08:15:28.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.033+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90ec005970 con 0x7f91000c6880 2023-12-08T08:15:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.034+0000 7f90fd7fa640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 0x7f90e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.035+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90ec089660 con 0x7f91000c6880 2023-12-08T08:15:28.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.035+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 0x7f90e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.035+0000 7f9104f7a640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 0x7f90e406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90f4034000 tx=0x7f90f402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.039+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f90ec054410 con 0x7f91000c6880 2023-12-08T08:15:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.270+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9100074600 con 0x7f91000c6880 2023-12-08T08:15:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.271+0000 7f90fd7fa640 1 -- 172.21.15.45:0/3108748889 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f90ec057a30 con 0x7f91000c6880 2023-12-08T08:15:28.274 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:28.274 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:15:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 msgr2=0x7f90e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 0x7f90e406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90f4034000 tx=0x7f90f402f000 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 msgr2=0x7f910014bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00c750 tx=0x7f90ec00cc10 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 shutdown_connections 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f90e406ae40 0x7f90e406d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9100155600 0x7f91001eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91000c6880 0x7f910014bb80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 --2- 172.21.15.45:0/3108748889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91000c4e90 0x7f91001ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 >> 172.21.15.45:0/3108748889 conn(0x7f9100072240 msgr2=0x7f91000661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.273+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 shutdown_connections 2023-12-08T08:15:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.274+0000 7f91071de640 1 -- 172.21.15.45:0/3108748889 wait complete. 2023-12-08T08:15:28.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:28.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.567+0000 7fd9bb0d7640 1 Processor -- start 2023-12-08T08:15:28.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.567+0000 7fd9bb0d7640 1 -- start start 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9bb0d7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b41519c0 0x7fd9b41584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9bb0d7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9b40c44d0 0x7fd9b4154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9bb0d7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b41553b0 con 0x7fd9b40c7a50 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9bb0d7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40c4a00 con 0x7fd9b40c44d0 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9bb0d7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c4ce0 con 0x7fd9b41519c0 2023-12-08T08:15:28.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.569+0000 7fd9b98d4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9b40c44d0 0x7fd9b4154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9ba8d6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9b40c7a50 0x7fd9b40ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51828/0 (socket says 172.21.15.45:51828) 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9ba8d6640 1 -- 172.21.15.45:0/2343286871 learned_addr learned my addr 172.21.15.45:0/2343286871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b98d4640 1 --2- 172.21.15.45:0/2343286871 >> v2:172.21.15.45:3300/0 conn(0x7fd9b40c44d0 0x7fd9b4154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54736/0 (socket says 172.21.15.45:54736) 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9ba0d5640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b41519c0 0x7fd9b41584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b90d3640 1 -- 172.21.15.45:0/2343286871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886051043 0 0) 0x7fd9b41553b0 con 0x7fd9b40c7a50 2023-12-08T08:15:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b98d4640 1 -- 172.21.15.45:0/2343286871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b41519c0 msgr2=0x7fd9b41584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b98d4640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b41519c0 0x7fd9b41584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b98d4640 1 -- 172.21.15.45:0/2343286871 >> v1:172.21.15.45:6789/0 conn(0x7fd9b40c7a50 legacy=0x7fd9b40ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.570+0000 7fd9b98d4640 1 -- 172.21.15.45:0/2343286871 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b41579e0 con 0x7fd9b40c44d0 2023-12-08T08:15:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9b98d4640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b4154e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40097a0 tx=0x7fd9a402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455ffc682be97bd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9b90d3640 1 -- 172.21.15.45:0/2343286871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4031780 con 0x7fd9b40c44d0 2023-12-08T08:15:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9b90d3640 1 -- 172.21.15.45:0/2343286871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a40318e0 con 0x7fd9b40c44d0 2023-12-08T08:15:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9b90d3640 1 -- 172.21.15.45:0/2343286871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4031c70 con 0x7fd9b40c44d0 2023-12-08T08:15:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/2343286871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 msgr2=0x7fd9b4154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.572+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b4154e70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40097a0 tx=0x7fd9a402b820 comp rx=0 tx=0).stop 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/2343286871 shutdown_connections 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b4154e70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/2343286871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b41519c0 0x7fd9b41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/2343286871 >> 172.21.15.45:0/2343286871 conn(0x7fd9b40661f0 msgr2=0x7fd9b4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/2343286871 shutdown_connections 2023-12-08T08:15:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.573+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/2343286871 wait complete. 2023-12-08T08:15:28.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.575+0000 7fd9bb0d7640 1 Processor -- start 2023-12-08T08:15:28.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.575+0000 7fd9bb0d7640 1 -- start start 2023-12-08T08:15:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b40c7a50 0x7fd9b40c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b41519c0 0x7fd9b40c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40ab560 con 0x7fd9b40c44d0 2023-12-08T08:15:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c39f0 con 0x7fd9b41519c0 2023-12-08T08:15:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9bb0d7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40a9730 con 0x7fd9b40c7a50 2023-12-08T08:15:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54752/0 (socket says 172.21.15.45:54752) 2023-12-08T08:15:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 -- 172.21.15.45:0/1387565675 learned_addr learned my addr 172.21.15.45:0/1387565675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 -- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b40c7a50 msgr2=0x7fd9b40c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b40c7a50 0x7fd9b40c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 -- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b41519c0 msgr2=0x7fd9b40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b41519c0 0x7fd9b40c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.576+0000 7fd9ba0d5640 1 -- 172.21.15.45:0/1387565675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4009400 con 0x7fd9b40c44d0 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9ba0d5640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0007f20 tx=0x7fd9b000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0014620 con 0x7fd9b40c44d0 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0014780 con 0x7fd9b40c44d0 2023-12-08T08:15:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0014b30 con 0x7fd9b40c44d0 2023-12-08T08:15:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b414c1e0 con 0x7fd9b40c44d0 2023-12-08T08:15:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.577+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b4157050 con 0x7fd9b40c44d0 2023-12-08T08:15:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.578+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b40a9870 con 0x7fd9b40c44d0 2023-12-08T08:15:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.579+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9b0014c90 con 0x7fd9b40c44d0 2023-12-08T08:15:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.581+0000 7fd9aaffd640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 0x7fd99806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.581+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9b008a380 con 0x7fd9b40c44d0 2023-12-08T08:15:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.581+0000 7fd9b98d4640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 0x7fd99806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.582+0000 7fd9b98d4640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 0x7fd99806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4036000 tx=0x7fd9a4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.585+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9b40a9870 con 0x7fd9b40c44d0 2023-12-08T08:15:28.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.779+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b40a9870 con 0x7fd9b40c44d0 2023-12-08T08:15:28.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.781+0000 7fd9aaffd640 1 -- 172.21.15.45:0/1387565675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fd9b40a9870 con 0x7fd9b40c44d0 2023-12-08T08:15:28.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:28.784 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 msgr2=0x7fd99806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 0x7fd99806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4036000 tx=0x7fd9a4030000 comp rx=0 tx=0).stop 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 msgr2=0x7fd9b414d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0007f20 tx=0x7fd9b000e570 comp rx=0 tx=0).stop 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 shutdown_connections 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99806ae40 0x7fd99806d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b40c7a50 0x7fd9b40c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b41519c0 0x7fd9b40c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 --2- 172.21.15.45:0/1387565675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b40c44d0 0x7fd9b414d670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 >> 172.21.15.45:0/1387565675 conn(0x7fd9b40661f0 msgr2=0x7fd9b40c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 shutdown_connections 2023-12-08T08:15:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:28.784+0000 7fd9bb0d7640 1 -- 172.21.15.45:0/1387565675 wait complete. 2023-12-08T08:15:28.807 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:15:28.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:15:29.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.030+0000 7f40d48da640 1 Processor -- start 2023-12-08T08:15:29.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.030+0000 7f40d48da640 1 -- start start 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40d48da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40d0155bf0 0x7f40d01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40d48da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40d48da640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d006d230 con 0x7f40d015c220 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40d48da640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00c6090 con 0x7f40d0155bf0 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40d48da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00c46c0 con 0x7f40d0159eb0 2023-12-08T08:15:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40ce59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f40d015c220 0x7f40d015c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51834/0 (socket says 172.21.15.45:51834) 2023-12-08T08:15:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.031+0000 7f40ce59c640 1 -- 172.21.15.45:0/229848209 learned_addr learned my addr 172.21.15.45:0/229848209 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cdd9b640 1 --2- 172.21.15.45:0/229848209 >> v2:172.21.15.45:3300/0 conn(0x7f40d0155bf0 0x7f40d01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40ced9d640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cd59a640 1 -- 172.21.15.45:0/229848209 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789454124 0 0) 0x7f40d006d230 con 0x7f40d015c220 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cd59a640 1 -- 172.21.15.45:0/229848209 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc003520 con 0x7f40d015c220 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cdd9b640 1 -- 172.21.15.45:0/229848209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 msgr2=0x7f40d015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cdd9b640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d015a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cdd9b640 1 -- 172.21.15.45:0/229848209 >> v1:172.21.15.45:6789/0 conn(0x7f40d015c220 legacy=0x7f40d015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.032+0000 7f40cdd9b640 1 -- 172.21.15.45:0/229848209 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d015cd10 con 0x7f40d0155bf0 2023-12-08T08:15:29.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.034+0000 7f40cdd9b640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d0155bf0 0x7f40d01560a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c4800 tx=0x7f40b802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12bf23333a7e542 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.034+0000 7f40cd59a640 1 -- 172.21.15.45:0/229848209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8031780 con 0x7f40d0155bf0 2023-12-08T08:15:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.034+0000 7f40cd59a640 1 -- 172.21.15.45:0/229848209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b80318e0 con 0x7f40d0155bf0 2023-12-08T08:15:29.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.034+0000 7f40cd59a640 1 -- 172.21.15.45:0/229848209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8031c70 con 0x7f40d0155bf0 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 -- 172.21.15.45:0/229848209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d0155bf0 msgr2=0x7f40d01560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d0155bf0 0x7f40d01560a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c4800 tx=0x7f40b802b820 comp rx=0 tx=0).stop 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 -- 172.21.15.45:0/229848209 shutdown_connections 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d015a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 --2- 172.21.15.45:0/229848209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d0155bf0 0x7f40d01560a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 -- 172.21.15.45:0/229848209 >> 172.21.15.45:0/229848209 conn(0x7f40d00661f0 msgr2=0x7f40d0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 -- 172.21.15.45:0/229848209 shutdown_connections 2023-12-08T08:15:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.035+0000 7f40d48da640 1 -- 172.21.15.45:0/229848209 wait complete. 2023-12-08T08:15:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.037+0000 7f40d48da640 1 Processor -- start 2023-12-08T08:15:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.037+0000 7f40d48da640 1 -- start start 2023-12-08T08:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 0x7f40d01f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d00717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01f2240 con 0x7f40d015c220 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00701d0 con 0x7f40d0155bf0 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40d48da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0072950 con 0x7f40d0159eb0 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40ced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40ced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54762/0 (socket says 172.21.15.45:54762) 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40ced9d640 1 -- 172.21.15.45:0/942577451 learned_addr learned my addr 172.21.15.45:0/942577451 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40cdd9b640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d00717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.038+0000 7f40ce59c640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 0x7f40d01f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 -- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 msgr2=0x7f40d00717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d00717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 -- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 msgr2=0x7f40d01f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 0x7f40d01f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 -- 172.21.15.45:0/942577451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8009400 con 0x7f40d015c220 2023-12-08T08:15:29.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ce59c640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 0x7f40d01f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40ced9d640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40c800e930 tx=0x7f40c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8009690 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800c980 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800cd30 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d0072670 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.039+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d006fe60 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.041+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d0074600 con 0x7f40d015c220 2023-12-08T08:15:29.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.042+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40c8013470 con 0x7f40d015c220 2023-12-08T08:15:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.043+0000 7f40c6ffd640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 0x7f40b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.043+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40c8089ec0 con 0x7f40d015c220 2023-12-08T08:15:29.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.043+0000 7f40ce59c640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 0x7f40b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.044+0000 7f40ce59c640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 0x7f40b006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40c0001560 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.047+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40c8054d30 con 0x7f40d015c220 2023-12-08T08:15:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.242+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40d0066b70 con 0x7f40b006ae40 2023-12-08T08:15:29.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.275+0000 7f40c6ffd640 1 -- 172.21.15.45:0/942577451 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345133 (secure 0 0 0) 0x7f40d0066b70 con 0x7f40b006ae40 2023-12-08T08:15:29.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:29.285 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:15:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 msgr2=0x7f40b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 0x7f40b006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40c0001560 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 msgr2=0x7f40d0070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40c800e930 tx=0x7f40c800edf0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 shutdown_connections 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f40b006ae40 0x7f40b006d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f40d0159eb0 0x7f40d00717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40d015c220 0x7f40d0070660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 --2- 172.21.15.45:0/942577451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40d0155bf0 0x7f40d01f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 >> 172.21.15.45:0/942577451 conn(0x7f40d00661f0 msgr2=0x7f40d015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 shutdown_connections 2023-12-08T08:15:29.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.283+0000 7f40d48da640 1 -- 172.21.15.45:0/942577451 wait complete. 2023-12-08T08:15:29.308 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-08T08:15:27.706382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2052074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005848"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415173+0000","last_change":"2023-12-08T08:14:59.898411+0000","last_active":"2023-12-08T08:15:04.415173+0000","last_peered":"2023-12-08T08:15:04.415173+0000","last_clean":"2023-12-08T08:15:04.415173+0000","last_became_active":"2023-12-08T08:14:59.898087+0000","last_became_peered":"2023-12-08T08:14:59.898087+0000","last_unstale":"2023-12-08T08:15:04.415173+0000","last_undegraded":"2023-12-08T08:15:04.415173+0000","last_fullsized":"2023-12-08T08:15:04.415173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418248+0000","last_change":"2023-12-08T08:15:00.400659+0000","last_active":"2023-12-08T08:15:04.418248+0000","last_peered":"2023-12-08T08:15:04.418248+0000","last_clean":"2023-12-08T08:15:04.418248+0000","last_became_active":"2023-12-08T08:15:00.400402+0000","last_became_peered":"2023-12-08T08:15:00.400402+0000","last_unstale":"2023-12-08T08:15:04.418248+0000","last_undegraded":"2023-12-08T08:15:04.418248+0000","last_fullsized":"2023-12-08T08:15:04.418248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458501+0000","last_change":"2023-12-08T08:15:04.453443+0000","last_active":"2023-12-08T08:15:05.458501+0000","last_peered":"2023-12-08T08:15:05.458501+0000","last_clean":"2023-12-08T08:15:05.458501+0000","last_became_active":"2023-12-08T08:15:04.452135+0000","last_became_peered":"2023-12-08T08:15:04.452135+0000","last_unstale":"2023-12-08T08:15:05.458501+0000","last_undegraded":"2023-12-08T08:15:05.458501+0000","last_fullsized":"2023-12-08T08:15:05.458501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418337+0000","last_change":"2023-12-08T08:14:59.893365+0000","last_active":"2023-12-08T08:15:04.418337+0000","last_peered":"2023-12-08T08:15:04.418337+0000","last_clean":"2023-12-08T08:15:04.418337+0000","last_became_active":"2023-12-08T08:14:59.893005+0000","last_became_peered":"2023-12-08T08:14:59.893005+0000","last_unstale":"2023-12-08T08:15:04.418337+0000","last_undegraded":"2023-12-08T08:15:04.418337+0000","last_fullsized":"2023-12-08T08:15:04.418337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414647+0000","last_change":"2023-12-08T08:15:00.406552+0000","last_active":"2023-12-08T08:15:04.414647+0000","last_peered":"2023-12-08T08:15:04.414647+0000","last_clean":"2023-12-08T08:15:04.414647+0000","last_became_active":"2023-12-08T08:15:00.406233+0000","last_became_peered":"2023-12-08T08:15:00.406233+0000","last_unstale":"2023-12-08T08:15:04.414647+0000","last_undegraded":"2023-12-08T08:15:04.414647+0000","last_fullsized":"2023-12-08T08:15:04.414647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459861+0000","last_change":"2023-12-08T08:15:04.424143+0000","last_active":"2023-12-08T08:15:05.459861+0000","last_peered":"2023-12-08T08:15:05.459861+0000","last_clean":"2023-12-08T08:15:05.459861+0000","last_became_active":"2023-12-08T08:15:04.423467+0000","last_became_peered":"2023-12-08T08:15:04.423467+0000","last_unstale":"2023-12-08T08:15:05.459861+0000","last_undegraded":"2023-12-08T08:15:05.459861+0000","last_fullsized":"2023-12-08T08:15:05.459861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:29.771854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447512+0000","last_change":"2023-12-08T08:14:59.904046+0000","last_active":"2023-12-08T08:15:04.447512+0000","last_peered":"2023-12-08T08:15:04.447512+0000","last_clean":"2023-12-08T08:15:04.447512+0000","last_became_active":"2023-12-08T08:14:59.903718+0000","last_became_peered":"2023-12-08T08:14:59.903718+0000","last_unstale":"2023-12-08T08:15:04.447512+0000","last_undegraded":"2023-12-08T08:15:04.447512+0000","last_fullsized":"2023-12-08T08:15:04.447512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420529+0000","last_change":"2023-12-08T08:15:00.406898+0000","last_active":"2023-12-08T08:15:04.420529+0000","last_peered":"2023-12-08T08:15:04.420529+0000","last_clean":"2023-12-08T08:15:04.420529+0000","last_became_active":"2023-12-08T08:15:00.406517+0000","last_became_peered":"2023-12-08T08:15:00.406517+0000","last_unstale":"2023-12-08T08:15:04.420529+0000","last_undegraded":"2023-12-08T08:15:04.420529+0000","last_fullsized":"2023-12-08T08:15:04.420529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459980+0000","last_change":"2023-12-08T08:15:04.428944+0000","last_active":"2023-12-08T08:15:05.459980+0000","last_peered":"2023-12-08T08:15:05.459980+0000","last_clean":"2023-12-08T08:15:05.459980+0000","last_became_active":"2023-12-08T08:15:04.428540+0000","last_became_peered":"2023-12-08T08:15:04.428540+0000","last_unstale":"2023-12-08T08:15:05.459980+0000","last_undegraded":"2023-12-08T08:15:05.459980+0000","last_fullsized":"2023-12-08T08:15:05.459980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:04.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447284+0000","last_change":"2023-12-08T08:14:59.902948+0000","last_active":"2023-12-08T08:15:04.447284+0000","last_peered":"2023-12-08T08:15:04.447284+0000","last_clean":"2023-12-08T08:15:04.447284+0000","last_became_active":"2023-12-08T08:14:59.902634+0000","last_became_peered":"2023-12-08T08:14:59.902634+0000","last_unstale":"2023-12-08T08:15:04.447284+0000","last_undegraded":"2023-12-08T08:15:04.447284+0000","last_fullsized":"2023-12-08T08:15:04.447284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420794+0000","last_change":"2023-12-08T08:15:00.406587+0000","last_active":"2023-12-08T08:15:04.420794+0000","last_peered":"2023-12-08T08:15:04.420794+0000","last_clean":"2023-12-08T08:15:04.420794+0000","last_became_active":"2023-12-08T08:15:00.406175+0000","last_became_peered":"2023-12-08T08:15:00.406175+0000","last_unstale":"2023-12-08T08:15:04.420794+0000","last_undegraded":"2023-12-08T08:15:04.420794+0000","last_fullsized":"2023-12-08T08:15:04.420794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460150+0000","last_change":"2023-12-08T08:15:04.431781+0000","last_active":"2023-12-08T08:15:05.460150+0000","last_peered":"2023-12-08T08:15:05.460150+0000","last_clean":"2023-12-08T08:15:05.460150+0000","last_became_active":"2023-12-08T08:15:04.431019+0000","last_became_peered":"2023-12-08T08:15:04.431019+0000","last_unstale":"2023-12-08T08:15:05.460150+0000","last_undegraded":"2023-12-08T08:15:05.460150+0000","last_fullsized":"2023-12-08T08:15:05.460150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:53.015719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414786+0000","last_change":"2023-12-08T08:15:00.410434+0000","last_active":"2023-12-08T08:15:04.414786+0000","last_peered":"2023-12-08T08:15:04.414786+0000","last_clean":"2023-12-08T08:15:04.414786+0000","last_became_active":"2023-12-08T08:15:00.410133+0000","last_became_peered":"2023-12-08T08:15:00.410133+0000","last_unstale":"2023-12-08T08:15:04.414786+0000","last_undegraded":"2023-12-08T08:15:04.414786+0000","last_fullsized":"2023-12-08T08:15:04.414786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447343+0000","last_change":"2023-12-08T08:14:59.900992+0000","last_active":"2023-12-08T08:15:04.447343+0000","last_peered":"2023-12-08T08:15:04.447343+0000","last_clean":"2023-12-08T08:15:04.447343+0000","last_became_active":"2023-12-08T08:14:59.900704+0000","last_became_peered":"2023-12-08T08:14:59.900704+0000","last_unstale":"2023-12-08T08:15:04.447343+0000","last_undegraded":"2023-12-08T08:15:04.447343+0000","last_fullsized":"2023-12-08T08:15:04.447343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462144+0000","last_change":"2023-12-08T08:15:04.426039+0000","last_active":"2023-12-08T08:15:05.462144+0000","last_peered":"2023-12-08T08:15:05.462144+0000","last_clean":"2023-12-08T08:15:05.462144+0000","last_became_active":"2023-12-08T08:15:04.425634+0000","last_became_peered":"2023-12-08T08:15:04.425634+0000","last_unstale":"2023-12-08T08:15:05.462144+0000","last_undegraded":"2023-12-08T08:15:05.462144+0000","last_fullsized":"2023-12-08T08:15:05.462144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418936+0000","last_change":"2023-12-08T08:15:00.393587+0000","last_active":"2023-12-08T08:15:04.418936+0000","last_peered":"2023-12-08T08:15:04.418936+0000","last_clean":"2023-12-08T08:15:04.418936+0000","last_became_active":"2023-12-08T08:15:00.393295+0000","last_became_peered":"2023-12-08T08:15:00.393295+0000","last_unstale":"2023-12-08T08:15:04.418936+0000","last_undegraded":"2023-12-08T08:15:04.418936+0000","last_fullsized":"2023-12-08T08:15:04.418936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412109+0000","last_change":"2023-12-08T08:14:59.888865+0000","last_active":"2023-12-08T08:15:04.412109+0000","last_peered":"2023-12-08T08:15:04.412109+0000","last_clean":"2023-12-08T08:15:04.412109+0000","last_became_active":"2023-12-08T08:14:59.887707+0000","last_became_peered":"2023-12-08T08:14:59.887707+0000","last_unstale":"2023-12-08T08:15:04.412109+0000","last_undegraded":"2023-12-08T08:15:04.412109+0000","last_fullsized":"2023-12-08T08:15:04.412109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:15.716120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461262+0000","last_change":"2023-12-08T08:15:04.436250+0000","last_active":"2023-12-08T08:15:05.461262+0000","last_peered":"2023-12-08T08:15:05.461262+0000","last_clean":"2023-12-08T08:15:05.461262+0000","last_became_active":"2023-12-08T08:15:04.435842+0000","last_became_peered":"2023-12-08T08:15:04.435842+0000","last_unstale":"2023-12-08T08:15:05.461262+0000","last_undegraded":"2023-12-08T08:15:05.461262+0000","last_fullsized":"2023-12-08T08:15:05.461262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:04.471421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411456+0000","last_change":"2023-12-08T08:15:00.384226+0000","last_active":"2023-12-08T08:15:04.411456+0000","last_peered":"2023-12-08T08:15:04.411456+0000","last_clean":"2023-12-08T08:15:04.411456+0000","last_became_active":"2023-12-08T08:15:00.383033+0000","last_became_peered":"2023-12-08T08:15:00.383033+0000","last_unstale":"2023-12-08T08:15:04.411456+0000","last_undegraded":"2023-12-08T08:15:04.411456+0000","last_fullsized":"2023-12-08T08:15:04.411456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406179+0000","last_change":"2023-12-08T08:14:59.899324+0000","last_active":"2023-12-08T08:15:04.406179+0000","last_peered":"2023-12-08T08:15:04.406179+0000","last_clean":"2023-12-08T08:15:04.406179+0000","last_became_active":"2023-12-08T08:14:59.898940+0000","last_became_peered":"2023-12-08T08:14:59.898940+0000","last_unstale":"2023-12-08T08:15:04.406179+0000","last_undegraded":"2023-12-08T08:15:04.406179+0000","last_fullsized":"2023-12-08T08:15:04.406179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:24:38.577538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101970+0000","last_change":"2023-12-08T08:15:04.455030+0000","last_active":"2023-12-08T08:15:07.101970+0000","last_peered":"2023-12-08T08:15:07.101970+0000","last_clean":"2023-12-08T08:15:07.101970+0000","last_became_active":"2023-12-08T08:15:04.454398+0000","last_became_peered":"2023-12-08T08:15:04.454398+0000","last_unstale":"2023-12-08T08:15:07.101970+0000","last_undegraded":"2023-12-08T08:15:07.101970+0000","last_fullsized":"2023-12-08T08:15:07.101970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:34.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409201+0000","last_change":"2023-12-08T08:15:00.388016+0000","last_active":"2023-12-08T08:15:04.409201+0000","last_peered":"2023-12-08T08:15:04.409201+0000","last_clean":"2023-12-08T08:15:04.409201+0000","last_became_active":"2023-12-08T08:15:00.387713+0000","last_became_peered":"2023-12-08T08:15:00.387713+0000","last_unstale":"2023-12-08T08:15:04.409201+0000","last_undegraded":"2023-12-08T08:15:04.409201+0000","last_fullsized":"2023-12-08T08:15:04.409201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:22.475961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446683+0000","last_change":"2023-12-08T08:14:59.899277+0000","last_active":"2023-12-08T08:15:04.446683+0000","last_peered":"2023-12-08T08:15:04.446683+0000","last_clean":"2023-12-08T08:15:04.446683+0000","last_became_active":"2023-12-08T08:14:59.898967+0000","last_became_peered":"2023-12-08T08:14:59.898967+0000","last_unstale":"2023-12-08T08:15:04.446683+0000","last_undegraded":"2023-12-08T08:15:04.446683+0000","last_fullsized":"2023-12-08T08:15:04.446683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462027+0000","last_change":"2023-12-08T08:15:04.436197+0000","last_active":"2023-12-08T08:15:05.462027+0000","last_peered":"2023-12-08T08:15:05.462027+0000","last_clean":"2023-12-08T08:15:05.462027+0000","last_became_active":"2023-12-08T08:15:04.435697+0000","last_became_peered":"2023-12-08T08:15:04.435697+0000","last_unstale":"2023-12-08T08:15:05.462027+0000","last_undegraded":"2023-12-08T08:15:05.462027+0000","last_fullsized":"2023-12-08T08:15:05.462027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:49.330205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411625+0000","last_change":"2023-12-08T08:15:00.391674+0000","last_active":"2023-12-08T08:15:04.411625+0000","last_peered":"2023-12-08T08:15:04.411625+0000","last_clean":"2023-12-08T08:15:04.411625+0000","last_became_active":"2023-12-08T08:15:00.390682+0000","last_became_peered":"2023-12-08T08:15:00.390682+0000","last_unstale":"2023-12-08T08:15:04.411625+0000","last_undegraded":"2023-12-08T08:15:04.411625+0000","last_fullsized":"2023-12-08T08:15:04.411625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414108+0000","last_change":"2023-12-08T08:14:59.899700+0000","last_active":"2023-12-08T08:15:04.414108+0000","last_peered":"2023-12-08T08:15:04.414108+0000","last_clean":"2023-12-08T08:15:04.414108+0000","last_became_active":"2023-12-08T08:14:59.899369+0000","last_became_peered":"2023-12-08T08:14:59.899369+0000","last_unstale":"2023-12-08T08:15:04.414108+0000","last_undegraded":"2023-12-08T08:15:04.414108+0000","last_fullsized":"2023-12-08T08:15:04.414108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460310+0000","last_change":"2023-12-08T08:15:04.455315+0000","last_active":"2023-12-08T08:15:05.460310+0000","last_peered":"2023-12-08T08:15:05.460310+0000","last_clean":"2023-12-08T08:15:05.460310+0000","last_became_active":"2023-12-08T08:15:04.454254+0000","last_became_peered":"2023-12-08T08:15:04.454254+0000","last_unstale":"2023-12-08T08:15:05.460310+0000","last_undegraded":"2023-12-08T08:15:05.460310+0000","last_fullsized":"2023-12-08T08:15:05.460310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:24.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418747+0000","last_change":"2023-12-08T08:15:00.396084+0000","last_active":"2023-12-08T08:15:04.418747+0000","last_peered":"2023-12-08T08:15:04.418747+0000","last_clean":"2023-12-08T08:15:04.418747+0000","last_became_active":"2023-12-08T08:15:00.395265+0000","last_became_peered":"2023-12-08T08:15:00.395265+0000","last_unstale":"2023-12-08T08:15:04.418747+0000","last_undegraded":"2023-12-08T08:15:04.418747+0000","last_fullsized":"2023-12-08T08:15:04.418747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.426589+0000","last_change":"2023-12-08T08:14:59.895090+0000","last_active":"2023-12-08T08:15:04.426589+0000","last_peered":"2023-12-08T08:15:04.426589+0000","last_clean":"2023-12-08T08:15:04.426589+0000","last_became_active":"2023-12-08T08:14:59.894777+0000","last_became_peered":"2023-12-08T08:14:59.894777+0000","last_unstale":"2023-12-08T08:15:04.426589+0000","last_undegraded":"2023-12-08T08:15:04.426589+0000","last_fullsized":"2023-12-08T08:15:04.426589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:42:30.101863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458217+0000","last_change":"2023-12-08T08:15:04.450602+0000","last_active":"2023-12-08T08:15:05.458217+0000","last_peered":"2023-12-08T08:15:05.458217+0000","last_clean":"2023-12-08T08:15:05.458217+0000","last_became_active":"2023-12-08T08:15:04.450177+0000","last_became_peered":"2023-12-08T08:15:04.450177+0000","last_unstale":"2023-12-08T08:15:05.458217+0000","last_undegraded":"2023-12-08T08:15:05.458217+0000","last_fullsized":"2023-12-08T08:15:05.458217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429732+0000","last_change":"2023-12-08T08:15:00.385032+0000","last_active":"2023-12-08T08:15:04.429732+0000","last_peered":"2023-12-08T08:15:04.429732+0000","last_clean":"2023-12-08T08:15:04.429732+0000","last_became_active":"2023-12-08T08:15:00.384743+0000","last_became_peered":"2023-12-08T08:15:00.384743+0000","last_unstale":"2023-12-08T08:15:04.429732+0000","last_undegraded":"2023-12-08T08:15:04.429732+0000","last_fullsized":"2023-12-08T08:15:04.429732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:35:06.342242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447602+0000","last_change":"2023-12-08T08:14:59.902751+0000","last_active":"2023-12-08T08:15:04.447602+0000","last_peered":"2023-12-08T08:15:04.447602+0000","last_clean":"2023-12-08T08:15:04.447602+0000","last_became_active":"2023-12-08T08:14:59.901168+0000","last_became_peered":"2023-12-08T08:14:59.901168+0000","last_unstale":"2023-12-08T08:15:04.447602+0000","last_undegraded":"2023-12-08T08:15:04.447602+0000","last_fullsized":"2023-12-08T08:15:04.447602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803013+0000","last_change":"2023-12-08T08:15:04.452893+0000","last_active":"2023-12-08T08:15:05.803013+0000","last_peered":"2023-12-08T08:15:05.803013+0000","last_clean":"2023-12-08T08:15:05.803013+0000","last_became_active":"2023-12-08T08:15:04.450264+0000","last_became_peered":"2023-12-08T08:15:04.450264+0000","last_unstale":"2023-12-08T08:15:05.803013+0000","last_undegraded":"2023-12-08T08:15:05.803013+0000","last_fullsized":"2023-12-08T08:15:05.803013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:28.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420877+0000","last_change":"2023-12-08T08:15:00.407555+0000","last_active":"2023-12-08T08:15:04.420877+0000","last_peered":"2023-12-08T08:15:04.420877+0000","last_clean":"2023-12-08T08:15:04.420877+0000","last_became_active":"2023-12-08T08:15:00.405681+0000","last_became_peered":"2023-12-08T08:15:00.405681+0000","last_unstale":"2023-12-08T08:15:04.420877+0000","last_undegraded":"2023-12-08T08:15:04.420877+0000","last_fullsized":"2023-12-08T08:15:04.420877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429823+0000","last_change":"2023-12-08T08:14:59.891702+0000","last_active":"2023-12-08T08:15:04.429823+0000","last_peered":"2023-12-08T08:15:04.429823+0000","last_clean":"2023-12-08T08:15:04.429823+0000","last_became_active":"2023-12-08T08:14:59.891334+0000","last_became_peered":"2023-12-08T08:14:59.891334+0000","last_unstale":"2023-12-08T08:15:04.429823+0000","last_undegraded":"2023-12-08T08:15:04.429823+0000","last_fullsized":"2023-12-08T08:15:04.429823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.998701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101106+0000","last_change":"2023-12-08T08:15:04.437404+0000","last_active":"2023-12-08T08:15:07.101106+0000","last_peered":"2023-12-08T08:15:07.101106+0000","last_clean":"2023-12-08T08:15:07.101106+0000","last_became_active":"2023-12-08T08:15:04.436999+0000","last_became_peered":"2023-12-08T08:15:04.436999+0000","last_unstale":"2023-12-08T08:15:07.101106+0000","last_undegraded":"2023-12-08T08:15:07.101106+0000","last_fullsized":"2023-12-08T08:15:07.101106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:02.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411360+0000","last_change":"2023-12-08T08:15:00.391653+0000","last_active":"2023-12-08T08:15:04.411360+0000","last_peered":"2023-12-08T08:15:04.411360+0000","last_clean":"2023-12-08T08:15:04.411360+0000","last_became_active":"2023-12-08T08:15:00.391313+0000","last_became_peered":"2023-12-08T08:15:00.391313+0000","last_unstale":"2023-12-08T08:15:04.411360+0000","last_undegraded":"2023-12-08T08:15:04.411360+0000","last_fullsized":"2023-12-08T08:15:04.411360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:34.599318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422649+0000","last_change":"2023-12-08T08:14:59.896775+0000","last_active":"2023-12-08T08:15:04.422649+0000","last_peered":"2023-12-08T08:15:04.422649+0000","last_clean":"2023-12-08T08:15:04.422649+0000","last_became_active":"2023-12-08T08:14:59.896211+0000","last_became_peered":"2023-12-08T08:14:59.896211+0000","last_unstale":"2023-12-08T08:15:04.422649+0000","last_undegraded":"2023-12-08T08:15:04.422649+0000","last_fullsized":"2023-12-08T08:15:04.422649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.102468+0000","last_change":"2023-12-08T08:15:04.438749+0000","last_active":"2023-12-08T08:15:07.102468+0000","last_peered":"2023-12-08T08:15:07.102468+0000","last_clean":"2023-12-08T08:15:07.102468+0000","last_became_active":"2023-12-08T08:15:04.436716+0000","last_became_peered":"2023-12-08T08:15:04.436716+0000","last_unstale":"2023-12-08T08:15:07.102468+0000","last_undegraded":"2023-12-08T08:15:07.102468+0000","last_fullsized":"2023-12-08T08:15:07.102468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:34.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406210+0000","last_change":"2023-12-08T08:15:00.376354+0000","last_active":"2023-12-08T08:15:04.406210+0000","last_peered":"2023-12-08T08:15:04.406210+0000","last_clean":"2023-12-08T08:15:04.406210+0000","last_became_active":"2023-12-08T08:15:00.374398+0000","last_became_peered":"2023-12-08T08:15:00.374398+0000","last_unstale":"2023-12-08T08:15:04.406210+0000","last_undegraded":"2023-12-08T08:15:04.406210+0000","last_fullsized":"2023-12-08T08:15:04.406210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:19.043505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395880+0000","last_change":"2023-12-08T08:14:59.884051+0000","last_active":"2023-12-08T08:15:04.395880+0000","last_peered":"2023-12-08T08:15:04.395880+0000","last_clean":"2023-12-08T08:15:04.395880+0000","last_became_active":"2023-12-08T08:14:59.883147+0000","last_became_peered":"2023-12-08T08:14:59.883147+0000","last_unstale":"2023-12-08T08:15:04.395880+0000","last_undegraded":"2023-12-08T08:15:04.395880+0000","last_fullsized":"2023-12-08T08:15:04.395880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101903+0000","last_change":"2023-12-08T08:15:04.440056+0000","last_active":"2023-12-08T08:15:07.101903+0000","last_peered":"2023-12-08T08:15:07.101903+0000","last_clean":"2023-12-08T08:15:07.101903+0000","last_became_active":"2023-12-08T08:15:04.434505+0000","last_became_peered":"2023-12-08T08:15:04.434505+0000","last_unstale":"2023-12-08T08:15:07.101903+0000","last_undegraded":"2023-12-08T08:15:07.101903+0000","last_fullsized":"2023-12-08T08:15:07.101903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:15:37.562984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409609+0000","last_change":"2023-12-08T08:15:00.394588+0000","last_active":"2023-12-08T08:15:04.409609+0000","last_peered":"2023-12-08T08:15:04.409609+0000","last_clean":"2023-12-08T08:15:04.409609+0000","last_became_active":"2023-12-08T08:15:00.394253+0000","last_became_peered":"2023-12-08T08:15:00.394253+0000","last_unstale":"2023-12-08T08:15:04.409609+0000","last_undegraded":"2023-12-08T08:15:04.409609+0000","last_fullsized":"2023-12-08T08:15:04.409609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:56.350634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446691+0000","last_change":"2023-12-08T08:14:59.898943+0000","last_active":"2023-12-08T08:15:04.446691+0000","last_peered":"2023-12-08T08:15:04.446691+0000","last_clean":"2023-12-08T08:15:04.446691+0000","last_became_active":"2023-12-08T08:14:59.898630+0000","last_became_peered":"2023-12-08T08:14:59.898630+0000","last_unstale":"2023-12-08T08:15:04.446691+0000","last_undegraded":"2023-12-08T08:15:04.446691+0000","last_fullsized":"2023-12-08T08:15:04.446691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804702+0000","last_change":"2023-12-08T08:15:04.450619+0000","last_active":"2023-12-08T08:15:05.804702+0000","last_peered":"2023-12-08T08:15:05.804702+0000","last_clean":"2023-12-08T08:15:05.804702+0000","last_became_active":"2023-12-08T08:15:04.450208+0000","last_became_peered":"2023-12-08T08:15:04.450208+0000","last_unstale":"2023-12-08T08:15:05.804702+0000","last_undegraded":"2023-12-08T08:15:05.804702+0000","last_fullsized":"2023-12-08T08:15:05.804702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.417267+0000","last_change":"2023-12-08T08:15:00.403719+0000","last_active":"2023-12-08T08:15:04.417267+0000","last_peered":"2023-12-08T08:15:04.417267+0000","last_clean":"2023-12-08T08:15:04.417267+0000","last_became_active":"2023-12-08T08:15:00.403491+0000","last_became_peered":"2023-12-08T08:15:00.403491+0000","last_unstale":"2023-12-08T08:15:04.417267+0000","last_undegraded":"2023-12-08T08:15:04.417267+0000","last_fullsized":"2023-12-08T08:15:04.417267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420401+0000","last_change":"2023-12-08T08:14:59.902488+0000","last_active":"2023-12-08T08:15:04.420401+0000","last_peered":"2023-12-08T08:15:04.420401+0000","last_clean":"2023-12-08T08:15:04.420401+0000","last_became_active":"2023-12-08T08:14:59.900551+0000","last_became_peered":"2023-12-08T08:14:59.900551+0000","last_unstale":"2023-12-08T08:15:04.420401+0000","last_undegraded":"2023-12-08T08:15:04.420401+0000","last_fullsized":"2023-12-08T08:15:04.420401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:18.269135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446793+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:15:04.446793+0000","last_peered":"2023-12-08T08:15:04.446793+0000","last_clean":"2023-12-08T08:15:04.446793+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:15:04.446793+0000","last_undegraded":"2023-12-08T08:15:04.446793+0000","last_fullsized":"2023-12-08T08:15:04.446793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808886+0000","last_change":"2023-12-08T08:15:04.456732+0000","last_active":"2023-12-08T08:15:05.808886+0000","last_peered":"2023-12-08T08:15:05.808886+0000","last_clean":"2023-12-08T08:15:05.808886+0000","last_became_active":"2023-12-08T08:15:04.454528+0000","last_became_peered":"2023-12-08T08:15:04.454528+0000","last_unstale":"2023-12-08T08:15:05.808886+0000","last_undegraded":"2023-12-08T08:15:05.808886+0000","last_fullsized":"2023-12-08T08:15:05.808886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:47.706869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447305+0000","last_change":"2023-12-08T08:15:00.407924+0000","last_active":"2023-12-08T08:15:04.447305+0000","last_peered":"2023-12-08T08:15:04.447305+0000","last_clean":"2023-12-08T08:15:04.447305+0000","last_became_active":"2023-12-08T08:15:00.407393+0000","last_became_peered":"2023-12-08T08:15:00.407393+0000","last_unstale":"2023-12-08T08:15:04.447305+0000","last_undegraded":"2023-12-08T08:15:04.447305+0000","last_fullsized":"2023-12-08T08:15:04.447305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396937+0000","last_change":"2023-12-08T08:14:59.900649+0000","last_active":"2023-12-08T08:15:04.396937+0000","last_peered":"2023-12-08T08:15:04.396937+0000","last_clean":"2023-12-08T08:15:04.396937+0000","last_became_active":"2023-12-08T08:14:59.900269+0000","last_became_peered":"2023-12-08T08:14:59.900269+0000","last_unstale":"2023-12-08T08:15:04.396937+0000","last_undegraded":"2023-12-08T08:15:04.396937+0000","last_fullsized":"2023-12-08T08:15:04.396937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808319+0000","last_change":"2023-12-08T08:15:04.450623+0000","last_active":"2023-12-08T08:15:05.808319+0000","last_peered":"2023-12-08T08:15:05.808319+0000","last_clean":"2023-12-08T08:15:05.808319+0000","last_became_active":"2023-12-08T08:15:04.450114+0000","last_became_peered":"2023-12-08T08:15:04.450114+0000","last_unstale":"2023-12-08T08:15:05.808319+0000","last_undegraded":"2023-12-08T08:15:05.808319+0000","last_fullsized":"2023-12-08T08:15:05.808319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420632+0000","last_change":"2023-12-08T08:15:00.405005+0000","last_active":"2023-12-08T08:15:04.420632+0000","last_peered":"2023-12-08T08:15:04.420632+0000","last_clean":"2023-12-08T08:15:04.420632+0000","last_became_active":"2023-12-08T08:15:00.399553+0000","last_became_peered":"2023-12-08T08:15:00.399553+0000","last_unstale":"2023-12-08T08:15:04.420632+0000","last_undegraded":"2023-12-08T08:15:04.420632+0000","last_fullsized":"2023-12-08T08:15:04.420632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425547+0000","last_change":"2023-12-08T08:14:59.883073+0000","last_active":"2023-12-08T08:15:04.425547+0000","last_peered":"2023-12-08T08:15:04.425547+0000","last_clean":"2023-12-08T08:15:04.425547+0000","last_became_active":"2023-12-08T08:14:59.882846+0000","last_became_peered":"2023-12-08T08:14:59.882846+0000","last_unstale":"2023-12-08T08:15:04.425547+0000","last_undegraded":"2023-12-08T08:15:04.425547+0000","last_fullsized":"2023-12-08T08:15:04.425547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:19.331838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803008+0000","last_change":"2023-12-08T08:15:04.429843+0000","last_active":"2023-12-08T08:15:05.803008+0000","last_peered":"2023-12-08T08:15:05.803008+0000","last_clean":"2023-12-08T08:15:05.803008+0000","last_became_active":"2023-12-08T08:15:04.429319+0000","last_became_peered":"2023-12-08T08:15:04.429319+0000","last_unstale":"2023-12-08T08:15:05.803008+0000","last_undegraded":"2023-12-08T08:15:05.803008+0000","last_fullsized":"2023-12-08T08:15:05.803008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:37.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447921+0000","last_change":"2023-12-08T08:15:00.410615+0000","last_active":"2023-12-08T08:15:04.447921+0000","last_peered":"2023-12-08T08:15:04.447921+0000","last_clean":"2023-12-08T08:15:04.447921+0000","last_became_active":"2023-12-08T08:15:00.410331+0000","last_became_peered":"2023-12-08T08:15:00.410331+0000","last_unstale":"2023-12-08T08:15:04.447921+0000","last_undegraded":"2023-12-08T08:15:04.447921+0000","last_fullsized":"2023-12-08T08:15:04.447921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:25.467790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396751+0000","last_change":"2023-12-08T08:14:59.886431+0000","last_active":"2023-12-08T08:15:04.396751+0000","last_peered":"2023-12-08T08:15:04.396751+0000","last_clean":"2023-12-08T08:15:04.396751+0000","last_became_active":"2023-12-08T08:14:59.884506+0000","last_became_peered":"2023-12-08T08:14:59.884506+0000","last_unstale":"2023-12-08T08:15:04.396751+0000","last_undegraded":"2023-12-08T08:15:04.396751+0000","last_fullsized":"2023-12-08T08:15:04.396751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:49.879584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.873898+0000","last_change":"2023-12-08T08:15:04.451208+0000","last_active":"2023-12-08T08:15:05.873898+0000","last_peered":"2023-12-08T08:15:05.873898+0000","last_clean":"2023-12-08T08:15:05.873898+0000","last_became_active":"2023-12-08T08:15:04.450428+0000","last_became_peered":"2023-12-08T08:15:04.450428+0000","last_unstale":"2023-12-08T08:15:05.873898+0000","last_undegraded":"2023-12-08T08:15:05.873898+0000","last_fullsized":"2023-12-08T08:15:05.873898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447664+0000","last_change":"2023-12-08T08:15:00.404999+0000","last_active":"2023-12-08T08:15:04.447664+0000","last_peered":"2023-12-08T08:15:04.447664+0000","last_clean":"2023-12-08T08:15:04.447664+0000","last_became_active":"2023-12-08T08:15:00.400794+0000","last_became_peered":"2023-12-08T08:15:00.400794+0000","last_unstale":"2023-12-08T08:15:04.447664+0000","last_undegraded":"2023-12-08T08:15:04.447664+0000","last_fullsized":"2023-12-08T08:15:04.447664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.400585+0000","last_change":"2023-12-08T08:14:59.892750+0000","last_active":"2023-12-08T08:15:04.400585+0000","last_peered":"2023-12-08T08:15:04.400585+0000","last_clean":"2023-12-08T08:15:04.400585+0000","last_became_active":"2023-12-08T08:14:59.892365+0000","last_became_peered":"2023-12-08T08:14:59.892365+0000","last_unstale":"2023-12-08T08:15:04.400585+0000","last_undegraded":"2023-12-08T08:15:04.400585+0000","last_fullsized":"2023-12-08T08:15:04.400585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459457+0000","last_change":"2023-12-08T08:15:04.426203+0000","last_active":"2023-12-08T08:15:05.459457+0000","last_peered":"2023-12-08T08:15:05.459457+0000","last_clean":"2023-12-08T08:15:05.459457+0000","last_became_active":"2023-12-08T08:15:04.425489+0000","last_became_peered":"2023-12-08T08:15:04.425489+0000","last_unstale":"2023-12-08T08:15:05.459457+0000","last_undegraded":"2023-12-08T08:15:05.459457+0000","last_fullsized":"2023-12-08T08:15:05.459457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:21.113790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447843+0000","last_change":"2023-12-08T08:15:00.409331+0000","last_active":"2023-12-08T08:15:04.447843+0000","last_peered":"2023-12-08T08:15:04.447843+0000","last_clean":"2023-12-08T08:15:04.447843+0000","last_became_active":"2023-12-08T08:15:00.408754+0000","last_became_peered":"2023-12-08T08:15:00.408754+0000","last_unstale":"2023-12-08T08:15:04.447843+0000","last_undegraded":"2023-12-08T08:15:04.447843+0000","last_fullsized":"2023-12-08T08:15:04.447843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395799+0000","last_change":"2023-12-08T08:14:59.894408+0000","last_active":"2023-12-08T08:15:04.395799+0000","last_peered":"2023-12-08T08:15:04.395799+0000","last_clean":"2023-12-08T08:15:04.395799+0000","last_became_active":"2023-12-08T08:14:59.893999+0000","last_became_peered":"2023-12-08T08:14:59.893999+0000","last_unstale":"2023-12-08T08:15:04.395799+0000","last_undegraded":"2023-12-08T08:15:04.395799+0000","last_fullsized":"2023-12-08T08:15:04.395799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804517+0000","last_change":"2023-12-08T08:15:04.433419+0000","last_active":"2023-12-08T08:15:05.804517+0000","last_peered":"2023-12-08T08:15:05.804517+0000","last_clean":"2023-12-08T08:15:05.804517+0000","last_became_active":"2023-12-08T08:15:04.432977+0000","last_became_peered":"2023-12-08T08:15:04.432977+0000","last_unstale":"2023-12-08T08:15:05.804517+0000","last_undegraded":"2023-12-08T08:15:05.804517+0000","last_fullsized":"2023-12-08T08:15:05.804517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413084+0000","last_change":"2023-12-08T08:15:00.396829+0000","last_active":"2023-12-08T08:15:04.413084+0000","last_peered":"2023-12-08T08:15:04.413084+0000","last_clean":"2023-12-08T08:15:04.413084+0000","last_became_active":"2023-12-08T08:15:00.396388+0000","last_became_peered":"2023-12-08T08:15:00.396388+0000","last_unstale":"2023-12-08T08:15:04.413084+0000","last_undegraded":"2023-12-08T08:15:04.413084+0000","last_fullsized":"2023-12-08T08:15:04.413084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416151+0000","last_change":"2023-12-08T08:14:59.887882+0000","last_active":"2023-12-08T08:15:04.416151+0000","last_peered":"2023-12-08T08:15:04.416151+0000","last_clean":"2023-12-08T08:15:04.416151+0000","last_became_active":"2023-12-08T08:14:59.887386+0000","last_became_peered":"2023-12-08T08:14:59.887386+0000","last_unstale":"2023-12-08T08:15:04.416151+0000","last_undegraded":"2023-12-08T08:15:04.416151+0000","last_fullsized":"2023-12-08T08:15:04.416151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:02.576945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460992+0000","last_change":"2023-12-08T08:15:04.453192+0000","last_active":"2023-12-08T08:15:05.460992+0000","last_peered":"2023-12-08T08:15:05.460992+0000","last_clean":"2023-12-08T08:15:05.460992+0000","last_became_active":"2023-12-08T08:15:04.451164+0000","last_became_peered":"2023-12-08T08:15:04.451164+0000","last_unstale":"2023-12-08T08:15:05.460992+0000","last_undegraded":"2023-12-08T08:15:05.460992+0000","last_fullsized":"2023-12-08T08:15:05.460992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:43.529090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447335+0000","last_change":"2023-12-08T08:15:00.399582+0000","last_active":"2023-12-08T08:15:04.447335+0000","last_peered":"2023-12-08T08:15:04.447335+0000","last_clean":"2023-12-08T08:15:04.447335+0000","last_became_active":"2023-12-08T08:15:00.399251+0000","last_became_peered":"2023-12-08T08:15:00.399251+0000","last_unstale":"2023-12-08T08:15:04.447335+0000","last_undegraded":"2023-12-08T08:15:04.447335+0000","last_fullsized":"2023-12-08T08:15:04.447335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422568+0000","last_change":"2023-12-08T08:14:59.900340+0000","last_active":"2023-12-08T08:15:04.422568+0000","last_peered":"2023-12-08T08:15:04.422568+0000","last_clean":"2023-12-08T08:15:04.422568+0000","last_became_active":"2023-12-08T08:14:59.900040+0000","last_became_peered":"2023-12-08T08:14:59.900040+0000","last_unstale":"2023-12-08T08:15:04.422568+0000","last_undegraded":"2023-12-08T08:15:04.422568+0000","last_fullsized":"2023-12-08T08:15:04.422568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:12.707626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459907+0000","last_change":"2023-12-08T08:15:04.452930+0000","last_active":"2023-12-08T08:15:05.459907+0000","last_peered":"2023-12-08T08:15:05.459907+0000","last_clean":"2023-12-08T08:15:05.459907+0000","last_became_active":"2023-12-08T08:15:04.451134+0000","last_became_peered":"2023-12-08T08:15:04.451134+0000","last_unstale":"2023-12-08T08:15:05.459907+0000","last_undegraded":"2023-12-08T08:15:05.459907+0000","last_fullsized":"2023-12-08T08:15:05.459907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:41.298759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403685+0000","last_change":"2023-12-08T08:15:00.391149+0000","last_active":"2023-12-08T08:15:04.403685+0000","last_peered":"2023-12-08T08:15:04.403685+0000","last_clean":"2023-12-08T08:15:04.403685+0000","last_became_active":"2023-12-08T08:15:00.390876+0000","last_became_peered":"2023-12-08T08:15:00.390876+0000","last_unstale":"2023-12-08T08:15:04.403685+0000","last_undegraded":"2023-12-08T08:15:04.403685+0000","last_fullsized":"2023-12-08T08:15:04.403685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412304+0000","last_change":"2023-12-08T08:14:59.891130+0000","last_active":"2023-12-08T08:15:04.412304+0000","last_peered":"2023-12-08T08:15:04.412304+0000","last_clean":"2023-12-08T08:15:04.412304+0000","last_became_active":"2023-12-08T08:14:59.890441+0000","last_became_peered":"2023-12-08T08:14:59.890441+0000","last_unstale":"2023-12-08T08:15:04.412304+0000","last_undegraded":"2023-12-08T08:15:04.412304+0000","last_fullsized":"2023-12-08T08:15:04.412304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:37.110835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.875742+0000","last_change":"2023-12-08T08:15:04.451191+0000","last_active":"2023-12-08T08:15:05.875742+0000","last_peered":"2023-12-08T08:15:05.875742+0000","last_clean":"2023-12-08T08:15:05.875742+0000","last_became_active":"2023-12-08T08:15:04.450325+0000","last_became_peered":"2023-12-08T08:15:04.450325+0000","last_unstale":"2023-12-08T08:15:05.875742+0000","last_undegraded":"2023-12-08T08:15:05.875742+0000","last_fullsized":"2023-12-08T08:15:05.875742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447388+0000","last_change":"2023-12-08T08:15:00.398759+0000","last_active":"2023-12-08T08:15:04.447388+0000","last_peered":"2023-12-08T08:15:04.447388+0000","last_clean":"2023-12-08T08:15:04.447388+0000","last_became_active":"2023-12-08T08:15:00.392487+0000","last_became_peered":"2023-12-08T08:15:00.392487+0000","last_unstale":"2023-12-08T08:15:04.447388+0000","last_undegraded":"2023-12-08T08:15:04.447388+0000","last_fullsized":"2023-12-08T08:15:04.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:18.522009+0000","last_change":"2023-12-08T08:14:59.891354+0000","last_active":"2023-12-08T08:15:18.522009+0000","last_peered":"2023-12-08T08:15:18.522009+0000","last_clean":"2023-12-08T08:15:18.522009+0000","last_became_active":"2023-12-08T08:14:59.889600+0000","last_became_peered":"2023-12-08T08:14:59.889600+0000","last_unstale":"2023-12-08T08:15:18.522009+0000","last_undegraded":"2023-12-08T08:15:18.522009+0000","last_fullsized":"2023-12-08T08:15:18.522009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101560+0000","last_change":"2023-12-08T08:15:04.436224+0000","last_active":"2023-12-08T08:15:07.101560+0000","last_peered":"2023-12-08T08:15:07.101560+0000","last_clean":"2023-12-08T08:15:07.101560+0000","last_became_active":"2023-12-08T08:15:04.435773+0000","last_became_peered":"2023-12-08T08:15:04.435773+0000","last_unstale":"2023-12-08T08:15:07.101560+0000","last_undegraded":"2023-12-08T08:15:07.101560+0000","last_fullsized":"2023-12-08T08:15:07.101560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:37.657486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404952+0000","last_change":"2023-12-08T08:15:00.389958+0000","last_active":"2023-12-08T08:15:04.404952+0000","last_peered":"2023-12-08T08:15:04.404952+0000","last_clean":"2023-12-08T08:15:04.404952+0000","last_became_active":"2023-12-08T08:15:00.388877+0000","last_became_peered":"2023-12-08T08:15:00.388877+0000","last_unstale":"2023-12-08T08:15:04.404952+0000","last_undegraded":"2023-12-08T08:15:04.404952+0000","last_fullsized":"2023-12-08T08:15:04.404952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425438+0000","last_change":"2023-12-08T08:14:59.895842+0000","last_active":"2023-12-08T08:15:04.425438+0000","last_peered":"2023-12-08T08:15:04.425438+0000","last_clean":"2023-12-08T08:15:04.425438+0000","last_became_active":"2023-12-08T08:14:59.895535+0000","last_became_peered":"2023-12-08T08:14:59.895535+0000","last_unstale":"2023-12-08T08:15:04.425438+0000","last_undegraded":"2023-12-08T08:15:04.425438+0000","last_fullsized":"2023-12-08T08:15:04.425438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:30.765400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459762+0000","last_change":"2023-12-08T08:15:04.427188+0000","last_active":"2023-12-08T08:15:05.459762+0000","last_peered":"2023-12-08T08:15:05.459762+0000","last_clean":"2023-12-08T08:15:05.459762+0000","last_became_active":"2023-12-08T08:15:04.425996+0000","last_became_peered":"2023-12-08T08:15:04.425996+0000","last_unstale":"2023-12-08T08:15:05.459762+0000","last_undegraded":"2023-12-08T08:15:05.459762+0000","last_fullsized":"2023-12-08T08:15:05.459762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:29.438014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414847+0000","last_change":"2023-12-08T08:15:00.406403+0000","last_active":"2023-12-08T08:15:04.414847+0000","last_peered":"2023-12-08T08:15:04.414847+0000","last_clean":"2023-12-08T08:15:04.414847+0000","last_became_active":"2023-12-08T08:15:00.405993+0000","last_became_peered":"2023-12-08T08:15:00.405993+0000","last_unstale":"2023-12-08T08:15:04.414847+0000","last_undegraded":"2023-12-08T08:15:04.414847+0000","last_fullsized":"2023-12-08T08:15:04.414847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421161+0000","last_change":"2023-12-08T08:14:59.899499+0000","last_active":"2023-12-08T08:15:04.421161+0000","last_peered":"2023-12-08T08:15:04.421161+0000","last_clean":"2023-12-08T08:15:04.421161+0000","last_became_active":"2023-12-08T08:14:59.899208+0000","last_became_peered":"2023-12-08T08:14:59.899208+0000","last_unstale":"2023-12-08T08:15:04.421161+0000","last_undegraded":"2023-12-08T08:15:04.421161+0000","last_fullsized":"2023-12-08T08:15:04.421161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:10.487847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458733+0000","last_change":"2023-12-08T08:15:04.428378+0000","last_active":"2023-12-08T08:15:05.458733+0000","last_peered":"2023-12-08T08:15:05.458733+0000","last_clean":"2023-12-08T08:15:05.458733+0000","last_became_active":"2023-12-08T08:15:04.427710+0000","last_became_peered":"2023-12-08T08:15:04.427710+0000","last_unstale":"2023-12-08T08:15:05.458733+0000","last_undegraded":"2023-12-08T08:15:05.458733+0000","last_fullsized":"2023-12-08T08:15:05.458733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420774+0000","last_change":"2023-12-08T08:15:00.401845+0000","last_active":"2023-12-08T08:15:04.420774+0000","last_peered":"2023-12-08T08:15:04.420774+0000","last_clean":"2023-12-08T08:15:04.420774+0000","last_became_active":"2023-12-08T08:15:00.401428+0000","last_became_peered":"2023-12-08T08:15:00.401428+0000","last_unstale":"2023-12-08T08:15:04.420774+0000","last_undegraded":"2023-12-08T08:15:04.420774+0000","last_fullsized":"2023-12-08T08:15:04.420774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413854+0000","last_change":"2023-12-08T08:14:59.902626+0000","last_active":"2023-12-08T08:15:04.413854+0000","last_peered":"2023-12-08T08:15:04.413854+0000","last_clean":"2023-12-08T08:15:04.413854+0000","last_became_active":"2023-12-08T08:14:59.902263+0000","last_became_peered":"2023-12-08T08:14:59.902263+0000","last_unstale":"2023-12-08T08:15:04.413854+0000","last_undegraded":"2023-12-08T08:15:04.413854+0000","last_fullsized":"2023-12-08T08:15:04.413854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458744+0000","last_change":"2023-12-08T08:15:04.452488+0000","last_active":"2023-12-08T08:15:05.458744+0000","last_peered":"2023-12-08T08:15:05.458744+0000","last_clean":"2023-12-08T08:15:05.458744+0000","last_became_active":"2023-12-08T08:15:04.451822+0000","last_became_peered":"2023-12-08T08:15:04.451822+0000","last_unstale":"2023-12-08T08:15:05.458744+0000","last_undegraded":"2023-12-08T08:15:05.458744+0000","last_fullsized":"2023-12-08T08:15:05.458744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803994+0000","last_change":"2023-12-08T08:15:04.453801+0000","last_active":"2023-12-08T08:15:05.803994+0000","last_peered":"2023-12-08T08:15:05.803994+0000","last_clean":"2023-12-08T08:15:05.803994+0000","last_became_active":"2023-12-08T08:15:04.453352+0000","last_became_peered":"2023-12-08T08:15:04.453352+0000","last_unstale":"2023-12-08T08:15:05.803994+0000","last_undegraded":"2023-12-08T08:15:05.803994+0000","last_fullsized":"2023-12-08T08:15:05.803994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406035+0000","last_change":"2023-12-08T08:15:00.380909+0000","last_active":"2023-12-08T08:15:04.406035+0000","last_peered":"2023-12-08T08:15:04.406035+0000","last_clean":"2023-12-08T08:15:04.406035+0000","last_became_active":"2023-12-08T08:15:00.379700+0000","last_became_peered":"2023-12-08T08:15:00.379700+0000","last_unstale":"2023-12-08T08:15:04.406035+0000","last_undegraded":"2023-12-08T08:15:04.406035+0000","last_fullsized":"2023-12-08T08:15:04.406035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:04:49.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412365+0000","last_change":"2023-12-08T08:14:59.890675+0000","last_active":"2023-12-08T08:15:04.412365+0000","last_peered":"2023-12-08T08:15:04.412365+0000","last_clean":"2023-12-08T08:15:04.412365+0000","last_became_active":"2023-12-08T08:14:59.890323+0000","last_became_peered":"2023-12-08T08:14:59.890323+0000","last_unstale":"2023-12-08T08:15:04.412365+0000","last_undegraded":"2023-12-08T08:15:04.412365+0000","last_fullsized":"2023-12-08T08:15:04.412365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808921+0000","last_change":"2023-12-08T08:15:04.443203+0000","last_active":"2023-12-08T08:15:05.808921+0000","last_peered":"2023-12-08T08:15:05.808921+0000","last_clean":"2023-12-08T08:15:05.808921+0000","last_became_active":"2023-12-08T08:15:04.442767+0000","last_became_peered":"2023-12-08T08:15:04.442767+0000","last_unstale":"2023-12-08T08:15:05.808921+0000","last_undegraded":"2023-12-08T08:15:05.808921+0000","last_fullsized":"2023-12-08T08:15:05.808921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:28.413841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411249+0000","last_change":"2023-12-08T08:15:00.394844+0000","last_active":"2023-12-08T08:15:04.411249+0000","last_peered":"2023-12-08T08:15:04.411249+0000","last_clean":"2023-12-08T08:15:04.411249+0000","last_became_active":"2023-12-08T08:15:00.394583+0000","last_became_peered":"2023-12-08T08:15:00.394583+0000","last_unstale":"2023-12-08T08:15:04.411249+0000","last_undegraded":"2023-12-08T08:15:04.411249+0000","last_fullsized":"2023-12-08T08:15:04.411249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416997+0000","last_change":"2023-12-08T08:14:59.898905+0000","last_active":"2023-12-08T08:15:04.416997+0000","last_peered":"2023-12-08T08:15:04.416997+0000","last_clean":"2023-12-08T08:15:04.416997+0000","last_became_active":"2023-12-08T08:14:59.897829+0000","last_became_peered":"2023-12-08T08:14:59.897829+0000","last_unstale":"2023-12-08T08:15:04.416997+0000","last_undegraded":"2023-12-08T08:15:04.416997+0000","last_fullsized":"2023-12-08T08:15:04.416997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:45:24.892032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414962+0000","last_change":"2023-12-08T08:14:59.895592+0000","last_active":"2023-12-08T08:15:04.414962+0000","last_peered":"2023-12-08T08:15:04.414962+0000","last_clean":"2023-12-08T08:15:04.414962+0000","last_became_active":"2023-12-08T08:14:59.895295+0000","last_became_peered":"2023-12-08T08:14:59.895295+0000","last_unstale":"2023-12-08T08:15:04.414962+0000","last_undegraded":"2023-12-08T08:15:04.414962+0000","last_fullsized":"2023-12-08T08:15:04.414962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:33.595711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412137+0000","last_change":"2023-12-08T08:15:00.401972+0000","last_active":"2023-12-08T08:15:04.412137+0000","last_peered":"2023-12-08T08:15:04.412137+0000","last_clean":"2023-12-08T08:15:04.412137+0000","last_became_active":"2023-12-08T08:15:00.401768+0000","last_became_peered":"2023-12-08T08:15:00.401768+0000","last_unstale":"2023-12-08T08:15:04.412137+0000","last_undegraded":"2023-12-08T08:15:04.412137+0000","last_fullsized":"2023-12-08T08:15:04.412137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:06.259376+0000","last_change":"2023-12-08T08:15:04.426722+0000","last_active":"2023-12-08T08:15:06.259376+0000","last_peered":"2023-12-08T08:15:06.259376+0000","last_clean":"2023-12-08T08:15:06.259376+0000","last_became_active":"2023-12-08T08:15:04.426302+0000","last_became_peered":"2023-12-08T08:15:04.426302+0000","last_unstale":"2023-12-08T08:15:06.259376+0000","last_undegraded":"2023-12-08T08:15:06.259376+0000","last_fullsized":"2023-12-08T08:15:06.259376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:07.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.419030+0000","last_change":"2023-12-08T08:14:59.898802+0000","last_active":"2023-12-08T08:15:04.419030+0000","last_peered":"2023-12-08T08:15:04.419030+0000","last_clean":"2023-12-08T08:15:04.419030+0000","last_became_active":"2023-12-08T08:14:59.897917+0000","last_became_peered":"2023-12-08T08:14:59.897917+0000","last_unstale":"2023-12-08T08:15:04.419030+0000","last_undegraded":"2023-12-08T08:15:04.419030+0000","last_fullsized":"2023-12-08T08:15:04.419030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.405546+0000","last_change":"2023-12-08T08:15:00.377480+0000","last_active":"2023-12-08T08:15:04.405546+0000","last_peered":"2023-12-08T08:15:04.405546+0000","last_clean":"2023-12-08T08:15:04.405546+0000","last_became_active":"2023-12-08T08:15:00.376692+0000","last_became_peered":"2023-12-08T08:15:00.376692+0000","last_unstale":"2023-12-08T08:15:04.405546+0000","last_undegraded":"2023-12-08T08:15:04.405546+0000","last_fullsized":"2023-12-08T08:15:04.405546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:50.883191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461226+0000","last_change":"2023-12-08T08:15:04.434422+0000","last_active":"2023-12-08T08:15:05.461226+0000","last_peered":"2023-12-08T08:15:05.461226+0000","last_clean":"2023-12-08T08:15:05.461226+0000","last_became_active":"2023-12-08T08:15:04.434025+0000","last_became_peered":"2023-12-08T08:15:04.434025+0000","last_unstale":"2023-12-08T08:15:05.461226+0000","last_undegraded":"2023-12-08T08:15:05.461226+0000","last_fullsized":"2023-12-08T08:15:05.461226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:40.936584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412941+0000","last_change":"2023-12-08T08:15:00.397602+0000","last_active":"2023-12-08T08:15:04.412941+0000","last_peered":"2023-12-08T08:15:04.412941+0000","last_clean":"2023-12-08T08:15:04.412941+0000","last_became_active":"2023-12-08T08:15:00.396793+0000","last_became_peered":"2023-12-08T08:15:00.396793+0000","last_unstale":"2023-12-08T08:15:04.412941+0000","last_undegraded":"2023-12-08T08:15:04.412941+0000","last_fullsized":"2023-12-08T08:15:04.412941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395803+0000","last_change":"2023-12-08T08:15:00.392327+0000","last_active":"2023-12-08T08:15:04.395803+0000","last_peered":"2023-12-08T08:15:04.395803+0000","last_clean":"2023-12-08T08:15:04.395803+0000","last_became_active":"2023-12-08T08:15:00.391791+0000","last_became_peered":"2023-12-08T08:15:00.391791+0000","last_unstale":"2023-12-08T08:15:04.395803+0000","last_undegraded":"2023-12-08T08:15:04.395803+0000","last_fullsized":"2023-12-08T08:15:04.395803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422479+0000","last_change":"2023-12-08T08:15:00.399925+0000","last_active":"2023-12-08T08:15:04.422479+0000","last_peered":"2023-12-08T08:15:04.422479+0000","last_clean":"2023-12-08T08:15:04.422479+0000","last_became_active":"2023-12-08T08:15:00.397718+0000","last_became_peered":"2023-12-08T08:15:00.397718+0000","last_unstale":"2023-12-08T08:15:04.422479+0000","last_undegraded":"2023-12-08T08:15:04.422479+0000","last_fullsized":"2023-12-08T08:15:04.422479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412045+0000","last_change":"2023-12-08T08:15:00.389088+0000","last_active":"2023-12-08T08:15:04.412045+0000","last_peered":"2023-12-08T08:15:04.412045+0000","last_clean":"2023-12-08T08:15:04.412045+0000","last_became_active":"2023-12-08T08:15:00.388531+0000","last_became_peered":"2023-12-08T08:15:00.388531+0000","last_unstale":"2023-12-08T08:15:04.412045+0000","last_undegraded":"2023-12-08T08:15:04.412045+0000","last_fullsized":"2023-12-08T08:15:04.412045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418168+0000","last_change":"2023-12-08T08:15:00.399625+0000","last_active":"2023-12-08T08:15:04.418168+0000","last_peered":"2023-12-08T08:15:04.418168+0000","last_clean":"2023-12-08T08:15:04.418168+0000","last_became_active":"2023-12-08T08:15:00.399405+0000","last_became_peered":"2023-12-08T08:15:00.399405+0000","last_unstale":"2023-12-08T08:15:04.418168+0000","last_undegraded":"2023-12-08T08:15:04.418168+0000","last_fullsized":"2023-12-08T08:15:04.418168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425340+0000","last_change":"2023-12-08T08:15:00.388290+0000","last_active":"2023-12-08T08:15:04.425340+0000","last_peered":"2023-12-08T08:15:04.425340+0000","last_clean":"2023-12-08T08:15:04.425340+0000","last_became_active":"2023-12-08T08:15:00.387996+0000","last_became_peered":"2023-12-08T08:15:00.387996+0000","last_unstale":"2023-12-08T08:15:04.425340+0000","last_undegraded":"2023-12-08T08:15:04.425340+0000","last_fullsized":"2023-12-08T08:15:04.425340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:11.571727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416014+0000","last_change":"2023-12-08T08:15:00.404101+0000","last_active":"2023-12-08T08:15:04.416014+0000","last_peered":"2023-12-08T08:15:04.416014+0000","last_clean":"2023-12-08T08:15:04.416014+0000","last_became_active":"2023-12-08T08:15:00.403349+0000","last_became_peered":"2023-12-08T08:15:00.403349+0000","last_unstale":"2023-12-08T08:15:04.416014+0000","last_undegraded":"2023-12-08T08:15:04.416014+0000","last_fullsized":"2023-12-08T08:15:04.416014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418659+0000","last_change":"2023-12-08T08:15:00.406185+0000","last_active":"2023-12-08T08:15:04.418659+0000","last_peered":"2023-12-08T08:15:04.418659+0000","last_clean":"2023-12-08T08:15:04.418659+0000","last_became_active":"2023-12-08T08:15:00.405860+0000","last_became_peered":"2023-12-08T08:15:00.405860+0000","last_unstale":"2023-12-08T08:15:04.418659+0000","last_undegraded":"2023-12-08T08:15:04.418659+0000","last_fullsized":"2023-12-08T08:15:04.418659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412237+0000","last_change":"2023-12-08T08:15:00.397626+0000","last_active":"2023-12-08T08:15:04.412237+0000","last_peered":"2023-12-08T08:15:04.412237+0000","last_clean":"2023-12-08T08:15:04.412237+0000","last_became_active":"2023-12-08T08:15:00.397097+0000","last_became_peered":"2023-12-08T08:15:00.397097+0000","last_unstale":"2023-12-08T08:15:04.412237+0000","last_undegraded":"2023-12-08T08:15:04.412237+0000","last_fullsized":"2023-12-08T08:15:04.412237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416905+0000","last_change":"2023-12-08T08:15:00.399153+0000","last_active":"2023-12-08T08:15:04.416905+0000","last_peered":"2023-12-08T08:15:04.416905+0000","last_clean":"2023-12-08T08:15:04.416905+0000","last_became_active":"2023-12-08T08:15:00.398929+0000","last_became_peered":"2023-12-08T08:15:00.398929+0000","last_unstale":"2023-12-08T08:15:04.416905+0000","last_undegraded":"2023-12-08T08:15:04.416905+0000","last_fullsized":"2023-12-08T08:15:04.416905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422384+0000","last_change":"2023-12-08T08:15:00.401295+0000","last_active":"2023-12-08T08:15:04.422384+0000","last_peered":"2023-12-08T08:15:04.422384+0000","last_clean":"2023-12-08T08:15:04.422384+0000","last_became_active":"2023-12-08T08:15:00.401003+0000","last_became_peered":"2023-12-08T08:15:00.401003+0000","last_unstale":"2023-12-08T08:15:04.422384+0000","last_undegraded":"2023-12-08T08:15:04.422384+0000","last_fullsized":"2023-12-08T08:15:04.422384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411185+0000","last_change":"2023-12-08T08:15:00.389780+0000","last_active":"2023-12-08T08:15:04.411185+0000","last_peered":"2023-12-08T08:15:04.411185+0000","last_clean":"2023-12-08T08:15:04.411185+0000","last_became_active":"2023-12-08T08:15:00.388834+0000","last_became_peered":"2023-12-08T08:15:00.388834+0000","last_unstale":"2023-12-08T08:15:04.411185+0000","last_undegraded":"2023-12-08T08:15:04.411185+0000","last_fullsized":"2023-12-08T08:15:04.411185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:06.829179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413719+0000","last_change":"2023-12-08T08:15:00.411312+0000","last_active":"2023-12-08T08:15:04.413719+0000","last_peered":"2023-12-08T08:15:04.413719+0000","last_clean":"2023-12-08T08:15:04.413719+0000","last_became_active":"2023-12-08T08:15:00.408772+0000","last_became_peered":"2023-12-08T08:15:00.408772+0000","last_unstale":"2023-12-08T08:15:04.413719+0000","last_undegraded":"2023-12-08T08:15:04.413719+0000","last_fullsized":"2023-12-08T08:15:04.413719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447494+0000","last_change":"2023-12-08T08:15:00.392749+0000","last_active":"2023-12-08T08:15:04.447494+0000","last_peered":"2023-12-08T08:15:04.447494+0000","last_clean":"2023-12-08T08:15:04.447494+0000","last_became_active":"2023-12-08T08:15:00.392113+0000","last_became_peered":"2023-12-08T08:15:00.392113+0000","last_unstale":"2023-12-08T08:15:04.447494+0000","last_undegraded":"2023-12-08T08:15:04.447494+0000","last_fullsized":"2023-12-08T08:15:04.447494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396777+0000","last_change":"2023-12-08T08:15:00.397614+0000","last_active":"2023-12-08T08:15:04.396777+0000","last_peered":"2023-12-08T08:15:04.396777+0000","last_clean":"2023-12-08T08:15:04.396777+0000","last_became_active":"2023-12-08T08:15:00.397110+0000","last_became_peered":"2023-12-08T08:15:00.397110+0000","last_unstale":"2023-12-08T08:15:04.396777+0000","last_undegraded":"2023-12-08T08:15:04.396777+0000","last_fullsized":"2023-12-08T08:15:04.396777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:38.114443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421587+0000","last_change":"2023-12-08T08:15:00.405108+0000","last_active":"2023-12-08T08:15:04.421587+0000","last_peered":"2023-12-08T08:15:04.421587+0000","last_clean":"2023-12-08T08:15:04.421587+0000","last_became_active":"2023-12-08T08:15:00.404650+0000","last_became_peered":"2023-12-08T08:15:00.404650+0000","last_unstale":"2023-12-08T08:15:04.421587+0000","last_undegraded":"2023-12-08T08:15:04.421587+0000","last_fullsized":"2023-12-08T08:15:04.421587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412104+0000","last_change":"2023-12-08T08:15:00.399420+0000","last_active":"2023-12-08T08:15:04.412104+0000","last_peered":"2023-12-08T08:15:04.412104+0000","last_clean":"2023-12-08T08:15:04.412104+0000","last_became_active":"2023-12-08T08:15:00.397884+0000","last_became_peered":"2023-12-08T08:15:00.397884+0000","last_unstale":"2023-12-08T08:15:04.412104+0000","last_undegraded":"2023-12-08T08:15:04.412104+0000","last_fullsized":"2023-12-08T08:15:04.412104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406107+0000","last_change":"2023-12-08T08:15:00.373700+0000","last_active":"2023-12-08T08:15:04.406107+0000","last_peered":"2023-12-08T08:15:04.406107+0000","last_clean":"2023-12-08T08:15:04.406107+0000","last_became_active":"2023-12-08T08:15:00.373315+0000","last_became_peered":"2023-12-08T08:15:00.373315+0000","last_unstale":"2023-12-08T08:15:04.406107+0000","last_undegraded":"2023-12-08T08:15:04.406107+0000","last_fullsized":"2023-12-08T08:15:04.406107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:54.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403529+0000","last_change":"2023-12-08T08:15:00.385175+0000","last_active":"2023-12-08T08:15:04.403529+0000","last_peered":"2023-12-08T08:15:04.403529+0000","last_clean":"2023-12-08T08:15:04.403529+0000","last_became_active":"2023-12-08T08:15:00.384670+0000","last_became_peered":"2023-12-08T08:15:00.384670+0000","last_unstale":"2023-12-08T08:15:04.403529+0000","last_undegraded":"2023-12-08T08:15:04.403529+0000","last_fullsized":"2023-12-08T08:15:04.403529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418851+0000","last_change":"2023-12-08T08:15:00.397339+0000","last_active":"2023-12-08T08:15:04.418851+0000","last_peered":"2023-12-08T08:15:04.418851+0000","last_clean":"2023-12-08T08:15:04.418851+0000","last_became_active":"2023-12-08T08:15:00.396888+0000","last_became_peered":"2023-12-08T08:15:00.396888+0000","last_unstale":"2023-12-08T08:15:04.418851+0000","last_undegraded":"2023-12-08T08:15:04.418851+0000","last_fullsized":"2023-12-08T08:15:04.418851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404753+0000","last_change":"2023-12-08T08:15:00.406207+0000","last_active":"2023-12-08T08:15:04.404753+0000","last_peered":"2023-12-08T08:15:04.404753+0000","last_clean":"2023-12-08T08:15:04.404753+0000","last_became_active":"2023-12-08T08:15:00.405928+0000","last_became_peered":"2023-12-08T08:15:00.405928+0000","last_unstale":"2023-12-08T08:15:04.404753+0000","last_undegraded":"2023-12-08T08:15:04.404753+0000","last_fullsized":"2023-12-08T08:15:04.404753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:12.923902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415948+0000","last_change":"2023-12-08T08:15:00.411990+0000","last_active":"2023-12-08T08:15:04.415948+0000","last_peered":"2023-12-08T08:15:04.415948+0000","last_clean":"2023-12-08T08:15:04.415948+0000","last_became_active":"2023-12-08T08:15:00.411754+0000","last_became_peered":"2023-12-08T08:15:00.411754+0000","last_unstale":"2023-12-08T08:15:04.415948+0000","last_undegraded":"2023-12-08T08:15:04.415948+0000","last_fullsized":"2023-12-08T08:15:04.415948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414100+0000","last_change":"2023-12-08T08:15:00.404296+0000","last_active":"2023-12-08T08:15:04.414100+0000","last_peered":"2023-12-08T08:15:04.414100+0000","last_clean":"2023-12-08T08:15:04.414100+0000","last_became_active":"2023-12-08T08:15:00.403816+0000","last_became_peered":"2023-12-08T08:15:00.403816+0000","last_unstale":"2023-12-08T08:15:04.414100+0000","last_undegraded":"2023-12-08T08:15:04.414100+0000","last_fullsized":"2023-12-08T08:15:04.414100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447876+0000","last_change":"2023-12-08T08:15:00.407698+0000","last_active":"2023-12-08T08:15:04.447876+0000","last_peered":"2023-12-08T08:15:04.447876+0000","last_clean":"2023-12-08T08:15:04.447876+0000","last_became_active":"2023-12-08T08:15:00.407394+0000","last_became_peered":"2023-12-08T08:15:00.407394+0000","last_unstale":"2023-12-08T08:15:04.447876+0000","last_undegraded":"2023-12-08T08:15:04.447876+0000","last_fullsized":"2023-12-08T08:15:04.447876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:11.621846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.410963+0000","last_change":"2023-12-08T08:15:00.400390+0000","last_active":"2023-12-08T08:15:04.410963+0000","last_peered":"2023-12-08T08:15:04.410963+0000","last_clean":"2023-12-08T08:15:04.410963+0000","last_became_active":"2023-12-08T08:15:00.400019+0000","last_became_peered":"2023-12-08T08:15:00.400019+0000","last_unstale":"2023-12-08T08:15:04.410963+0000","last_undegraded":"2023-12-08T08:15:04.410963+0000","last_fullsized":"2023-12-08T08:15:04.410963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447736+0000","last_change":"2023-12-08T08:15:00.396225+0000","last_active":"2023-12-08T08:15:04.447736+0000","last_peered":"2023-12-08T08:15:04.447736+0000","last_clean":"2023-12-08T08:15:04.447736+0000","last_became_active":"2023-12-08T08:15:00.395943+0000","last_became_peered":"2023-12-08T08:15:00.395943+0000","last_unstale":"2023-12-08T08:15:04.447736+0000","last_undegraded":"2023-12-08T08:15:04.447736+0000","last_fullsized":"2023-12-08T08:15:04.447736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422301+0000","last_change":"2023-12-08T08:15:00.401328+0000","last_active":"2023-12-08T08:15:04.422301+0000","last_peered":"2023-12-08T08:15:04.422301+0000","last_clean":"2023-12-08T08:15:04.422301+0000","last_became_active":"2023-12-08T08:15:00.400964+0000","last_became_peered":"2023-12-08T08:15:00.400964+0000","last_unstale":"2023-12-08T08:15:04.422301+0000","last_undegraded":"2023-12-08T08:15:04.422301+0000","last_fullsized":"2023-12-08T08:15:04.422301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447113+0000","last_change":"2023-12-08T08:15:00.386324+0000","last_active":"2023-12-08T08:15:04.447113+0000","last_peered":"2023-12-08T08:15:04.447113+0000","last_clean":"2023-12-08T08:15:04.447113+0000","last_became_active":"2023-12-08T08:15:00.385867+0000","last_became_peered":"2023-12-08T08:15:00.385867+0000","last_unstale":"2023-12-08T08:15:04.447113+0000","last_undegraded":"2023-12-08T08:15:04.447113+0000","last_fullsized":"2023-12-08T08:15:04.447113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420534+0000","last_change":"2023-12-08T08:15:00.405186+0000","last_active":"2023-12-08T08:15:04.420534+0000","last_peered":"2023-12-08T08:15:04.420534+0000","last_clean":"2023-12-08T08:15:04.420534+0000","last_became_active":"2023-12-08T08:15:00.404663+0000","last_became_peered":"2023-12-08T08:15:00.404663+0000","last_unstale":"2023-12-08T08:15:04.420534+0000","last_undegraded":"2023-12-08T08:15:04.420534+0000","last_fullsized":"2023-12-08T08:15:04.420534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411222+0000","last_change":"2023-12-08T08:15:00.390953+0000","last_active":"2023-12-08T08:15:04.411222+0000","last_peered":"2023-12-08T08:15:04.411222+0000","last_clean":"2023-12-08T08:15:04.411222+0000","last_became_active":"2023-12-08T08:15:00.390638+0000","last_became_peered":"2023-12-08T08:15:00.390638+0000","last_unstale":"2023-12-08T08:15:04.411222+0000","last_undegraded":"2023-12-08T08:15:04.411222+0000","last_fullsized":"2023-12-08T08:15:04.411222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425744+0000","last_change":"2023-12-08T08:15:00.394118+0000","last_active":"2023-12-08T08:15:04.425744+0000","last_peered":"2023-12-08T08:15:04.425744+0000","last_clean":"2023-12-08T08:15:04.425744+0000","last_became_active":"2023-12-08T08:15:00.393338+0000","last_became_peered":"2023-12-08T08:15:00.393338+0000","last_unstale":"2023-12-08T08:15:04.425744+0000","last_undegraded":"2023-12-08T08:15:04.425744+0000","last_fullsized":"2023-12-08T08:15:04.425744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:04:34.103680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447849+0000","last_change":"2023-12-08T08:15:00.404323+0000","last_active":"2023-12-08T08:15:04.447849+0000","last_peered":"2023-12-08T08:15:04.447849+0000","last_clean":"2023-12-08T08:15:04.447849+0000","last_became_active":"2023-12-08T08:15:00.403298+0000","last_became_peered":"2023-12-08T08:15:00.403298+0000","last_unstale":"2023-12-08T08:15:04.447849+0000","last_undegraded":"2023-12-08T08:15:04.447849+0000","last_fullsized":"2023-12-08T08:15:04.447849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7310000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.73}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":698764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:15:29.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:15:29.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.584+0000 7f880d66d640 1 Processor -- start 2023-12-08T08:15:29.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.584+0000 7f880d66d640 1 -- start start 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.585+0000 7f880d66d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88080c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.585+0000 7f880d66d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88080c1dc0 0x7f880814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f880d66d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8808155850 con 0x7f88081521b0 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f880d66d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080c0890 con 0x7f88080c1dc0 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f880d66d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c0b70 con 0x7f88080a7910 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f88077fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88080c1dc0 0x7f880814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f880ce6c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f88081521b0 0x7f8808155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51836/0 (socket says 172.21.15.45:51836) 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f880ce6c640 1 -- 172.21.15.45:0/2729968402 learned_addr learned my addr 172.21.15.45:0/2729968402 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f8807fff640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88080c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.586+0000 7f8806ffd640 1 -- 172.21.15.45:0/2729968402 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463556438 0 0) 0x7f8808155850 con 0x7f88081521b0 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.587+0000 7f8806ffd640 1 -- 172.21.15.45:0/2729968402 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f0003520 con 0x7f88081521b0 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.587+0000 7f88077fe640 1 -- 172.21.15.45:0/2729968402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 msgr2=0x7f88080c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.587+0000 7f88077fe640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88080c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.587+0000 7f88077fe640 1 -- 172.21.15.45:0/2729968402 >> v1:172.21.15.45:6789/0 conn(0x7f88081521b0 legacy=0x7f8808155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.587+0000 7f88077fe640 1 -- 172.21.15.45:0/2729968402 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080c0e50 con 0x7f88080c1dc0 2023-12-08T08:15:29.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.588+0000 7f88077fe640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f880814f5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0097a0 tx=0x7f87fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168e5a41dd5635de server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.588+0000 7f8806ffd640 1 -- 172.21.15.45:0/2729968402 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc02e070 con 0x7f88080c1dc0 2023-12-08T08:15:29.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.588+0000 7f8806ffd640 1 -- 172.21.15.45:0/2729968402 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0315a0 con 0x7f88080c1dc0 2023-12-08T08:15:29.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f8806ffd640 1 -- 172.21.15.45:0/2729968402 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc031910 con 0x7f88080c1dc0 2023-12-08T08:15:29.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 -- 172.21.15.45:0/2729968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 msgr2=0x7f880814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f880814f5e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0097a0 tx=0x7f87fc02b840 comp rx=0 tx=0).stop 2023-12-08T08:15:29.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 -- 172.21.15.45:0/2729968402 shutdown_connections 2023-12-08T08:15:29.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f880814f5e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 --2- 172.21.15.45:0/2729968402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88080c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 -- 172.21.15.45:0/2729968402 >> 172.21.15.45:0/2729968402 conn(0x7f88080c5780 msgr2=0x7f88080c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 -- 172.21.15.45:0/2729968402 shutdown_connections 2023-12-08T08:15:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.589+0000 7f880d66d640 1 -- 172.21.15.45:0/2729968402 wait complete. 2023-12-08T08:15:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.591+0000 7f880d66d640 1 Processor -- start 2023-12-08T08:15:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.591+0000 7f880d66d640 1 -- start start 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88081de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 0x7f88081e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081e9630 con 0x7f88080c1dc0 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88081ea500 con 0x7f88081521b0 2023-12-08T08:15:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.592+0000 7f880d66d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88081ed920 con 0x7f88080a7910 2023-12-08T08:15:29.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54790/0 (socket says 172.21.15.45:54790) 2023-12-08T08:15:29.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 -- 172.21.15.45:0/996989367 learned_addr learned my addr 172.21.15.45:0/996989367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f880ce6c640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 0x7f88081e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f8807fff640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88081de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 -- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 msgr2=0x7f88081de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88081de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 -- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 msgr2=0x7f88081e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 0x7f88081e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f88077fe640 1 -- 172.21.15.45:0/996989367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009400 con 0x7f88080c1dc0 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f880ce6c640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 0x7f88081e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.593+0000 7f8807fff640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88081de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f88077fe640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87fc000c00 tx=0x7f87fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc032630 con 0x7f88080c1dc0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc032790 con 0x7f88080c1dc0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080c47f0 con 0x7f88080c1dc0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc032b20 con 0x7f88080c1dc0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.594+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080c4db0 con 0x7f88080c1dc0 2023-12-08T08:15:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.595+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88081e97a0 con 0x7f88080c1dc0 2023-12-08T08:15:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.596+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87fc032c80 con 0x7f88080c1dc0 2023-12-08T08:15:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.598+0000 7f8804ff9640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 0x7f87f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.598+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87fc0ab370 con 0x7f88080c1dc0 2023-12-08T08:15:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.598+0000 7f8807fff640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 0x7f87f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.599+0000 7f8807fff640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 0x7f87f406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009ac0 tx=0x7f87f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.602+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88081e97a0 con 0x7f88080c1dc0 2023-12-08T08:15:29.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.794+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88080a7cf0 con 0x7f87f406ae70 2023-12-08T08:15:29.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.805+0000 7f8804ff9640 1 -- 172.21.15.45:0/996989367 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345078 (secure 0 0 0) 0x7f87f8010910 con 0x7f87f406ae70 2023-12-08T08:15:29.812 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:29.814 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:15:29.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 msgr2=0x7f87f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 0x7f87f406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009ac0 tx=0x7f87f8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 msgr2=0x7f88081e9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f87fc000c00 tx=0x7f87fc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 shutdown_connections 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87f406ae70 0x7f87f406d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88081521b0 0x7f88081e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88080c1dc0 0x7f88081e9a80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 --2- 172.21.15.45:0/996989367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88080a7910 0x7f88081de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.810+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 >> 172.21.15.45:0/996989367 conn(0x7f88080c5780 msgr2=0x7f880814fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.811+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 shutdown_connections 2023-12-08T08:15:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:29.811+0000 7f880d66d640 1 -- 172.21.15.45:0/996989367 wait complete. 2023-12-08T08:15:29.832 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-08T08:15:29.707056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2052074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005510"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415173+0000","last_change":"2023-12-08T08:14:59.898411+0000","last_active":"2023-12-08T08:15:04.415173+0000","last_peered":"2023-12-08T08:15:04.415173+0000","last_clean":"2023-12-08T08:15:04.415173+0000","last_became_active":"2023-12-08T08:14:59.898087+0000","last_became_peered":"2023-12-08T08:14:59.898087+0000","last_unstale":"2023-12-08T08:15:04.415173+0000","last_undegraded":"2023-12-08T08:15:04.415173+0000","last_fullsized":"2023-12-08T08:15:04.415173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418248+0000","last_change":"2023-12-08T08:15:00.400659+0000","last_active":"2023-12-08T08:15:04.418248+0000","last_peered":"2023-12-08T08:15:04.418248+0000","last_clean":"2023-12-08T08:15:04.418248+0000","last_became_active":"2023-12-08T08:15:00.400402+0000","last_became_peered":"2023-12-08T08:15:00.400402+0000","last_unstale":"2023-12-08T08:15:04.418248+0000","last_undegraded":"2023-12-08T08:15:04.418248+0000","last_fullsized":"2023-12-08T08:15:04.418248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458501+0000","last_change":"2023-12-08T08:15:04.453443+0000","last_active":"2023-12-08T08:15:05.458501+0000","last_peered":"2023-12-08T08:15:05.458501+0000","last_clean":"2023-12-08T08:15:05.458501+0000","last_became_active":"2023-12-08T08:15:04.452135+0000","last_became_peered":"2023-12-08T08:15:04.452135+0000","last_unstale":"2023-12-08T08:15:05.458501+0000","last_undegraded":"2023-12-08T08:15:05.458501+0000","last_fullsized":"2023-12-08T08:15:05.458501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418337+0000","last_change":"2023-12-08T08:14:59.893365+0000","last_active":"2023-12-08T08:15:04.418337+0000","last_peered":"2023-12-08T08:15:04.418337+0000","last_clean":"2023-12-08T08:15:04.418337+0000","last_became_active":"2023-12-08T08:14:59.893005+0000","last_became_peered":"2023-12-08T08:14:59.893005+0000","last_unstale":"2023-12-08T08:15:04.418337+0000","last_undegraded":"2023-12-08T08:15:04.418337+0000","last_fullsized":"2023-12-08T08:15:04.418337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414647+0000","last_change":"2023-12-08T08:15:00.406552+0000","last_active":"2023-12-08T08:15:04.414647+0000","last_peered":"2023-12-08T08:15:04.414647+0000","last_clean":"2023-12-08T08:15:04.414647+0000","last_became_active":"2023-12-08T08:15:00.406233+0000","last_became_peered":"2023-12-08T08:15:00.406233+0000","last_unstale":"2023-12-08T08:15:04.414647+0000","last_undegraded":"2023-12-08T08:15:04.414647+0000","last_fullsized":"2023-12-08T08:15:04.414647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459861+0000","last_change":"2023-12-08T08:15:04.424143+0000","last_active":"2023-12-08T08:15:05.459861+0000","last_peered":"2023-12-08T08:15:05.459861+0000","last_clean":"2023-12-08T08:15:05.459861+0000","last_became_active":"2023-12-08T08:15:04.423467+0000","last_became_peered":"2023-12-08T08:15:04.423467+0000","last_unstale":"2023-12-08T08:15:05.459861+0000","last_undegraded":"2023-12-08T08:15:05.459861+0000","last_fullsized":"2023-12-08T08:15:05.459861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:29.771854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447512+0000","last_change":"2023-12-08T08:14:59.904046+0000","last_active":"2023-12-08T08:15:04.447512+0000","last_peered":"2023-12-08T08:15:04.447512+0000","last_clean":"2023-12-08T08:15:04.447512+0000","last_became_active":"2023-12-08T08:14:59.903718+0000","last_became_peered":"2023-12-08T08:14:59.903718+0000","last_unstale":"2023-12-08T08:15:04.447512+0000","last_undegraded":"2023-12-08T08:15:04.447512+0000","last_fullsized":"2023-12-08T08:15:04.447512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420529+0000","last_change":"2023-12-08T08:15:00.406898+0000","last_active":"2023-12-08T08:15:04.420529+0000","last_peered":"2023-12-08T08:15:04.420529+0000","last_clean":"2023-12-08T08:15:04.420529+0000","last_became_active":"2023-12-08T08:15:00.406517+0000","last_became_peered":"2023-12-08T08:15:00.406517+0000","last_unstale":"2023-12-08T08:15:04.420529+0000","last_undegraded":"2023-12-08T08:15:04.420529+0000","last_fullsized":"2023-12-08T08:15:04.420529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459980+0000","last_change":"2023-12-08T08:15:04.428944+0000","last_active":"2023-12-08T08:15:05.459980+0000","last_peered":"2023-12-08T08:15:05.459980+0000","last_clean":"2023-12-08T08:15:05.459980+0000","last_became_active":"2023-12-08T08:15:04.428540+0000","last_became_peered":"2023-12-08T08:15:04.428540+0000","last_unstale":"2023-12-08T08:15:05.459980+0000","last_undegraded":"2023-12-08T08:15:05.459980+0000","last_fullsized":"2023-12-08T08:15:05.459980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:04.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447284+0000","last_change":"2023-12-08T08:14:59.902948+0000","last_active":"2023-12-08T08:15:04.447284+0000","last_peered":"2023-12-08T08:15:04.447284+0000","last_clean":"2023-12-08T08:15:04.447284+0000","last_became_active":"2023-12-08T08:14:59.902634+0000","last_became_peered":"2023-12-08T08:14:59.902634+0000","last_unstale":"2023-12-08T08:15:04.447284+0000","last_undegraded":"2023-12-08T08:15:04.447284+0000","last_fullsized":"2023-12-08T08:15:04.447284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420794+0000","last_change":"2023-12-08T08:15:00.406587+0000","last_active":"2023-12-08T08:15:04.420794+0000","last_peered":"2023-12-08T08:15:04.420794+0000","last_clean":"2023-12-08T08:15:04.420794+0000","last_became_active":"2023-12-08T08:15:00.406175+0000","last_became_peered":"2023-12-08T08:15:00.406175+0000","last_unstale":"2023-12-08T08:15:04.420794+0000","last_undegraded":"2023-12-08T08:15:04.420794+0000","last_fullsized":"2023-12-08T08:15:04.420794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460150+0000","last_change":"2023-12-08T08:15:04.431781+0000","last_active":"2023-12-08T08:15:05.460150+0000","last_peered":"2023-12-08T08:15:05.460150+0000","last_clean":"2023-12-08T08:15:05.460150+0000","last_became_active":"2023-12-08T08:15:04.431019+0000","last_became_peered":"2023-12-08T08:15:04.431019+0000","last_unstale":"2023-12-08T08:15:05.460150+0000","last_undegraded":"2023-12-08T08:15:05.460150+0000","last_fullsized":"2023-12-08T08:15:05.460150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:53.015719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414786+0000","last_change":"2023-12-08T08:15:00.410434+0000","last_active":"2023-12-08T08:15:04.414786+0000","last_peered":"2023-12-08T08:15:04.414786+0000","last_clean":"2023-12-08T08:15:04.414786+0000","last_became_active":"2023-12-08T08:15:00.410133+0000","last_became_peered":"2023-12-08T08:15:00.410133+0000","last_unstale":"2023-12-08T08:15:04.414786+0000","last_undegraded":"2023-12-08T08:15:04.414786+0000","last_fullsized":"2023-12-08T08:15:04.414786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447343+0000","last_change":"2023-12-08T08:14:59.900992+0000","last_active":"2023-12-08T08:15:04.447343+0000","last_peered":"2023-12-08T08:15:04.447343+0000","last_clean":"2023-12-08T08:15:04.447343+0000","last_became_active":"2023-12-08T08:14:59.900704+0000","last_became_peered":"2023-12-08T08:14:59.900704+0000","last_unstale":"2023-12-08T08:15:04.447343+0000","last_undegraded":"2023-12-08T08:15:04.447343+0000","last_fullsized":"2023-12-08T08:15:04.447343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462144+0000","last_change":"2023-12-08T08:15:04.426039+0000","last_active":"2023-12-08T08:15:05.462144+0000","last_peered":"2023-12-08T08:15:05.462144+0000","last_clean":"2023-12-08T08:15:05.462144+0000","last_became_active":"2023-12-08T08:15:04.425634+0000","last_became_peered":"2023-12-08T08:15:04.425634+0000","last_unstale":"2023-12-08T08:15:05.462144+0000","last_undegraded":"2023-12-08T08:15:05.462144+0000","last_fullsized":"2023-12-08T08:15:05.462144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418936+0000","last_change":"2023-12-08T08:15:00.393587+0000","last_active":"2023-12-08T08:15:04.418936+0000","last_peered":"2023-12-08T08:15:04.418936+0000","last_clean":"2023-12-08T08:15:04.418936+0000","last_became_active":"2023-12-08T08:15:00.393295+0000","last_became_peered":"2023-12-08T08:15:00.393295+0000","last_unstale":"2023-12-08T08:15:04.418936+0000","last_undegraded":"2023-12-08T08:15:04.418936+0000","last_fullsized":"2023-12-08T08:15:04.418936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412109+0000","last_change":"2023-12-08T08:14:59.888865+0000","last_active":"2023-12-08T08:15:04.412109+0000","last_peered":"2023-12-08T08:15:04.412109+0000","last_clean":"2023-12-08T08:15:04.412109+0000","last_became_active":"2023-12-08T08:14:59.887707+0000","last_became_peered":"2023-12-08T08:14:59.887707+0000","last_unstale":"2023-12-08T08:15:04.412109+0000","last_undegraded":"2023-12-08T08:15:04.412109+0000","last_fullsized":"2023-12-08T08:15:04.412109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:15.716120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461262+0000","last_change":"2023-12-08T08:15:04.436250+0000","last_active":"2023-12-08T08:15:05.461262+0000","last_peered":"2023-12-08T08:15:05.461262+0000","last_clean":"2023-12-08T08:15:05.461262+0000","last_became_active":"2023-12-08T08:15:04.435842+0000","last_became_peered":"2023-12-08T08:15:04.435842+0000","last_unstale":"2023-12-08T08:15:05.461262+0000","last_undegraded":"2023-12-08T08:15:05.461262+0000","last_fullsized":"2023-12-08T08:15:05.461262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:04.471421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411456+0000","last_change":"2023-12-08T08:15:00.384226+0000","last_active":"2023-12-08T08:15:04.411456+0000","last_peered":"2023-12-08T08:15:04.411456+0000","last_clean":"2023-12-08T08:15:04.411456+0000","last_became_active":"2023-12-08T08:15:00.383033+0000","last_became_peered":"2023-12-08T08:15:00.383033+0000","last_unstale":"2023-12-08T08:15:04.411456+0000","last_undegraded":"2023-12-08T08:15:04.411456+0000","last_fullsized":"2023-12-08T08:15:04.411456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406179+0000","last_change":"2023-12-08T08:14:59.899324+0000","last_active":"2023-12-08T08:15:04.406179+0000","last_peered":"2023-12-08T08:15:04.406179+0000","last_clean":"2023-12-08T08:15:04.406179+0000","last_became_active":"2023-12-08T08:14:59.898940+0000","last_became_peered":"2023-12-08T08:14:59.898940+0000","last_unstale":"2023-12-08T08:15:04.406179+0000","last_undegraded":"2023-12-08T08:15:04.406179+0000","last_fullsized":"2023-12-08T08:15:04.406179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:24:38.577538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101970+0000","last_change":"2023-12-08T08:15:04.455030+0000","last_active":"2023-12-08T08:15:07.101970+0000","last_peered":"2023-12-08T08:15:07.101970+0000","last_clean":"2023-12-08T08:15:07.101970+0000","last_became_active":"2023-12-08T08:15:04.454398+0000","last_became_peered":"2023-12-08T08:15:04.454398+0000","last_unstale":"2023-12-08T08:15:07.101970+0000","last_undegraded":"2023-12-08T08:15:07.101970+0000","last_fullsized":"2023-12-08T08:15:07.101970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:34.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409201+0000","last_change":"2023-12-08T08:15:00.388016+0000","last_active":"2023-12-08T08:15:04.409201+0000","last_peered":"2023-12-08T08:15:04.409201+0000","last_clean":"2023-12-08T08:15:04.409201+0000","last_became_active":"2023-12-08T08:15:00.387713+0000","last_became_peered":"2023-12-08T08:15:00.387713+0000","last_unstale":"2023-12-08T08:15:04.409201+0000","last_undegraded":"2023-12-08T08:15:04.409201+0000","last_fullsized":"2023-12-08T08:15:04.409201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:22.475961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446683+0000","last_change":"2023-12-08T08:14:59.899277+0000","last_active":"2023-12-08T08:15:04.446683+0000","last_peered":"2023-12-08T08:15:04.446683+0000","last_clean":"2023-12-08T08:15:04.446683+0000","last_became_active":"2023-12-08T08:14:59.898967+0000","last_became_peered":"2023-12-08T08:14:59.898967+0000","last_unstale":"2023-12-08T08:15:04.446683+0000","last_undegraded":"2023-12-08T08:15:04.446683+0000","last_fullsized":"2023-12-08T08:15:04.446683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462027+0000","last_change":"2023-12-08T08:15:04.436197+0000","last_active":"2023-12-08T08:15:05.462027+0000","last_peered":"2023-12-08T08:15:05.462027+0000","last_clean":"2023-12-08T08:15:05.462027+0000","last_became_active":"2023-12-08T08:15:04.435697+0000","last_became_peered":"2023-12-08T08:15:04.435697+0000","last_unstale":"2023-12-08T08:15:05.462027+0000","last_undegraded":"2023-12-08T08:15:05.462027+0000","last_fullsized":"2023-12-08T08:15:05.462027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:49.330205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411625+0000","last_change":"2023-12-08T08:15:00.391674+0000","last_active":"2023-12-08T08:15:04.411625+0000","last_peered":"2023-12-08T08:15:04.411625+0000","last_clean":"2023-12-08T08:15:04.411625+0000","last_became_active":"2023-12-08T08:15:00.390682+0000","last_became_peered":"2023-12-08T08:15:00.390682+0000","last_unstale":"2023-12-08T08:15:04.411625+0000","last_undegraded":"2023-12-08T08:15:04.411625+0000","last_fullsized":"2023-12-08T08:15:04.411625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414108+0000","last_change":"2023-12-08T08:14:59.899700+0000","last_active":"2023-12-08T08:15:04.414108+0000","last_peered":"2023-12-08T08:15:04.414108+0000","last_clean":"2023-12-08T08:15:04.414108+0000","last_became_active":"2023-12-08T08:14:59.899369+0000","last_became_peered":"2023-12-08T08:14:59.899369+0000","last_unstale":"2023-12-08T08:15:04.414108+0000","last_undegraded":"2023-12-08T08:15:04.414108+0000","last_fullsized":"2023-12-08T08:15:04.414108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460310+0000","last_change":"2023-12-08T08:15:04.455315+0000","last_active":"2023-12-08T08:15:05.460310+0000","last_peered":"2023-12-08T08:15:05.460310+0000","last_clean":"2023-12-08T08:15:05.460310+0000","last_became_active":"2023-12-08T08:15:04.454254+0000","last_became_peered":"2023-12-08T08:15:04.454254+0000","last_unstale":"2023-12-08T08:15:05.460310+0000","last_undegraded":"2023-12-08T08:15:05.460310+0000","last_fullsized":"2023-12-08T08:15:05.460310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:24.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418747+0000","last_change":"2023-12-08T08:15:00.396084+0000","last_active":"2023-12-08T08:15:04.418747+0000","last_peered":"2023-12-08T08:15:04.418747+0000","last_clean":"2023-12-08T08:15:04.418747+0000","last_became_active":"2023-12-08T08:15:00.395265+0000","last_became_peered":"2023-12-08T08:15:00.395265+0000","last_unstale":"2023-12-08T08:15:04.418747+0000","last_undegraded":"2023-12-08T08:15:04.418747+0000","last_fullsized":"2023-12-08T08:15:04.418747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.426589+0000","last_change":"2023-12-08T08:14:59.895090+0000","last_active":"2023-12-08T08:15:04.426589+0000","last_peered":"2023-12-08T08:15:04.426589+0000","last_clean":"2023-12-08T08:15:04.426589+0000","last_became_active":"2023-12-08T08:14:59.894777+0000","last_became_peered":"2023-12-08T08:14:59.894777+0000","last_unstale":"2023-12-08T08:15:04.426589+0000","last_undegraded":"2023-12-08T08:15:04.426589+0000","last_fullsized":"2023-12-08T08:15:04.426589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:42:30.101863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458217+0000","last_change":"2023-12-08T08:15:04.450602+0000","last_active":"2023-12-08T08:15:05.458217+0000","last_peered":"2023-12-08T08:15:05.458217+0000","last_clean":"2023-12-08T08:15:05.458217+0000","last_became_active":"2023-12-08T08:15:04.450177+0000","last_became_peered":"2023-12-08T08:15:04.450177+0000","last_unstale":"2023-12-08T08:15:05.458217+0000","last_undegraded":"2023-12-08T08:15:05.458217+0000","last_fullsized":"2023-12-08T08:15:05.458217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429732+0000","last_change":"2023-12-08T08:15:00.385032+0000","last_active":"2023-12-08T08:15:04.429732+0000","last_peered":"2023-12-08T08:15:04.429732+0000","last_clean":"2023-12-08T08:15:04.429732+0000","last_became_active":"2023-12-08T08:15:00.384743+0000","last_became_peered":"2023-12-08T08:15:00.384743+0000","last_unstale":"2023-12-08T08:15:04.429732+0000","last_undegraded":"2023-12-08T08:15:04.429732+0000","last_fullsized":"2023-12-08T08:15:04.429732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:35:06.342242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447602+0000","last_change":"2023-12-08T08:14:59.902751+0000","last_active":"2023-12-08T08:15:04.447602+0000","last_peered":"2023-12-08T08:15:04.447602+0000","last_clean":"2023-12-08T08:15:04.447602+0000","last_became_active":"2023-12-08T08:14:59.901168+0000","last_became_peered":"2023-12-08T08:14:59.901168+0000","last_unstale":"2023-12-08T08:15:04.447602+0000","last_undegraded":"2023-12-08T08:15:04.447602+0000","last_fullsized":"2023-12-08T08:15:04.447602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803013+0000","last_change":"2023-12-08T08:15:04.452893+0000","last_active":"2023-12-08T08:15:05.803013+0000","last_peered":"2023-12-08T08:15:05.803013+0000","last_clean":"2023-12-08T08:15:05.803013+0000","last_became_active":"2023-12-08T08:15:04.450264+0000","last_became_peered":"2023-12-08T08:15:04.450264+0000","last_unstale":"2023-12-08T08:15:05.803013+0000","last_undegraded":"2023-12-08T08:15:05.803013+0000","last_fullsized":"2023-12-08T08:15:05.803013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:28.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420877+0000","last_change":"2023-12-08T08:15:00.407555+0000","last_active":"2023-12-08T08:15:04.420877+0000","last_peered":"2023-12-08T08:15:04.420877+0000","last_clean":"2023-12-08T08:15:04.420877+0000","last_became_active":"2023-12-08T08:15:00.405681+0000","last_became_peered":"2023-12-08T08:15:00.405681+0000","last_unstale":"2023-12-08T08:15:04.420877+0000","last_undegraded":"2023-12-08T08:15:04.420877+0000","last_fullsized":"2023-12-08T08:15:04.420877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429823+0000","last_change":"2023-12-08T08:14:59.891702+0000","last_active":"2023-12-08T08:15:04.429823+0000","last_peered":"2023-12-08T08:15:04.429823+0000","last_clean":"2023-12-08T08:15:04.429823+0000","last_became_active":"2023-12-08T08:14:59.891334+0000","last_became_peered":"2023-12-08T08:14:59.891334+0000","last_unstale":"2023-12-08T08:15:04.429823+0000","last_undegraded":"2023-12-08T08:15:04.429823+0000","last_fullsized":"2023-12-08T08:15:04.429823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.998701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101106+0000","last_change":"2023-12-08T08:15:04.437404+0000","last_active":"2023-12-08T08:15:07.101106+0000","last_peered":"2023-12-08T08:15:07.101106+0000","last_clean":"2023-12-08T08:15:07.101106+0000","last_became_active":"2023-12-08T08:15:04.436999+0000","last_became_peered":"2023-12-08T08:15:04.436999+0000","last_unstale":"2023-12-08T08:15:07.101106+0000","last_undegraded":"2023-12-08T08:15:07.101106+0000","last_fullsized":"2023-12-08T08:15:07.101106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:02.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411360+0000","last_change":"2023-12-08T08:15:00.391653+0000","last_active":"2023-12-08T08:15:04.411360+0000","last_peered":"2023-12-08T08:15:04.411360+0000","last_clean":"2023-12-08T08:15:04.411360+0000","last_became_active":"2023-12-08T08:15:00.391313+0000","last_became_peered":"2023-12-08T08:15:00.391313+0000","last_unstale":"2023-12-08T08:15:04.411360+0000","last_undegraded":"2023-12-08T08:15:04.411360+0000","last_fullsized":"2023-12-08T08:15:04.411360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:34.599318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422649+0000","last_change":"2023-12-08T08:14:59.896775+0000","last_active":"2023-12-08T08:15:04.422649+0000","last_peered":"2023-12-08T08:15:04.422649+0000","last_clean":"2023-12-08T08:15:04.422649+0000","last_became_active":"2023-12-08T08:14:59.896211+0000","last_became_peered":"2023-12-08T08:14:59.896211+0000","last_unstale":"2023-12-08T08:15:04.422649+0000","last_undegraded":"2023-12-08T08:15:04.422649+0000","last_fullsized":"2023-12-08T08:15:04.422649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.102468+0000","last_change":"2023-12-08T08:15:04.438749+0000","last_active":"2023-12-08T08:15:07.102468+0000","last_peered":"2023-12-08T08:15:07.102468+0000","last_clean":"2023-12-08T08:15:07.102468+0000","last_became_active":"2023-12-08T08:15:04.436716+0000","last_became_peered":"2023-12-08T08:15:04.436716+0000","last_unstale":"2023-12-08T08:15:07.102468+0000","last_undegraded":"2023-12-08T08:15:07.102468+0000","last_fullsized":"2023-12-08T08:15:07.102468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:34.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406210+0000","last_change":"2023-12-08T08:15:00.376354+0000","last_active":"2023-12-08T08:15:04.406210+0000","last_peered":"2023-12-08T08:15:04.406210+0000","last_clean":"2023-12-08T08:15:04.406210+0000","last_became_active":"2023-12-08T08:15:00.374398+0000","last_became_peered":"2023-12-08T08:15:00.374398+0000","last_unstale":"2023-12-08T08:15:04.406210+0000","last_undegraded":"2023-12-08T08:15:04.406210+0000","last_fullsized":"2023-12-08T08:15:04.406210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:19.043505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395880+0000","last_change":"2023-12-08T08:14:59.884051+0000","last_active":"2023-12-08T08:15:04.395880+0000","last_peered":"2023-12-08T08:15:04.395880+0000","last_clean":"2023-12-08T08:15:04.395880+0000","last_became_active":"2023-12-08T08:14:59.883147+0000","last_became_peered":"2023-12-08T08:14:59.883147+0000","last_unstale":"2023-12-08T08:15:04.395880+0000","last_undegraded":"2023-12-08T08:15:04.395880+0000","last_fullsized":"2023-12-08T08:15:04.395880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101903+0000","last_change":"2023-12-08T08:15:04.440056+0000","last_active":"2023-12-08T08:15:07.101903+0000","last_peered":"2023-12-08T08:15:07.101903+0000","last_clean":"2023-12-08T08:15:07.101903+0000","last_became_active":"2023-12-08T08:15:04.434505+0000","last_became_peered":"2023-12-08T08:15:04.434505+0000","last_unstale":"2023-12-08T08:15:07.101903+0000","last_undegraded":"2023-12-08T08:15:07.101903+0000","last_fullsized":"2023-12-08T08:15:07.101903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:15:37.562984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409609+0000","last_change":"2023-12-08T08:15:00.394588+0000","last_active":"2023-12-08T08:15:04.409609+0000","last_peered":"2023-12-08T08:15:04.409609+0000","last_clean":"2023-12-08T08:15:04.409609+0000","last_became_active":"2023-12-08T08:15:00.394253+0000","last_became_peered":"2023-12-08T08:15:00.394253+0000","last_unstale":"2023-12-08T08:15:04.409609+0000","last_undegraded":"2023-12-08T08:15:04.409609+0000","last_fullsized":"2023-12-08T08:15:04.409609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:56.350634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446691+0000","last_change":"2023-12-08T08:14:59.898943+0000","last_active":"2023-12-08T08:15:04.446691+0000","last_peered":"2023-12-08T08:15:04.446691+0000","last_clean":"2023-12-08T08:15:04.446691+0000","last_became_active":"2023-12-08T08:14:59.898630+0000","last_became_peered":"2023-12-08T08:14:59.898630+0000","last_unstale":"2023-12-08T08:15:04.446691+0000","last_undegraded":"2023-12-08T08:15:04.446691+0000","last_fullsized":"2023-12-08T08:15:04.446691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804702+0000","last_change":"2023-12-08T08:15:04.450619+0000","last_active":"2023-12-08T08:15:05.804702+0000","last_peered":"2023-12-08T08:15:05.804702+0000","last_clean":"2023-12-08T08:15:05.804702+0000","last_became_active":"2023-12-08T08:15:04.450208+0000","last_became_peered":"2023-12-08T08:15:04.450208+0000","last_unstale":"2023-12-08T08:15:05.804702+0000","last_undegraded":"2023-12-08T08:15:05.804702+0000","last_fullsized":"2023-12-08T08:15:05.804702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.417267+0000","last_change":"2023-12-08T08:15:00.403719+0000","last_active":"2023-12-08T08:15:04.417267+0000","last_peered":"2023-12-08T08:15:04.417267+0000","last_clean":"2023-12-08T08:15:04.417267+0000","last_became_active":"2023-12-08T08:15:00.403491+0000","last_became_peered":"2023-12-08T08:15:00.403491+0000","last_unstale":"2023-12-08T08:15:04.417267+0000","last_undegraded":"2023-12-08T08:15:04.417267+0000","last_fullsized":"2023-12-08T08:15:04.417267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420401+0000","last_change":"2023-12-08T08:14:59.902488+0000","last_active":"2023-12-08T08:15:04.420401+0000","last_peered":"2023-12-08T08:15:04.420401+0000","last_clean":"2023-12-08T08:15:04.420401+0000","last_became_active":"2023-12-08T08:14:59.900551+0000","last_became_peered":"2023-12-08T08:14:59.900551+0000","last_unstale":"2023-12-08T08:15:04.420401+0000","last_undegraded":"2023-12-08T08:15:04.420401+0000","last_fullsized":"2023-12-08T08:15:04.420401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:18.269135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446793+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:15:04.446793+0000","last_peered":"2023-12-08T08:15:04.446793+0000","last_clean":"2023-12-08T08:15:04.446793+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:15:04.446793+0000","last_undegraded":"2023-12-08T08:15:04.446793+0000","last_fullsized":"2023-12-08T08:15:04.446793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808886+0000","last_change":"2023-12-08T08:15:04.456732+0000","last_active":"2023-12-08T08:15:05.808886+0000","last_peered":"2023-12-08T08:15:05.808886+0000","last_clean":"2023-12-08T08:15:05.808886+0000","last_became_active":"2023-12-08T08:15:04.454528+0000","last_became_peered":"2023-12-08T08:15:04.454528+0000","last_unstale":"2023-12-08T08:15:05.808886+0000","last_undegraded":"2023-12-08T08:15:05.808886+0000","last_fullsized":"2023-12-08T08:15:05.808886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:47.706869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447305+0000","last_change":"2023-12-08T08:15:00.407924+0000","last_active":"2023-12-08T08:15:04.447305+0000","last_peered":"2023-12-08T08:15:04.447305+0000","last_clean":"2023-12-08T08:15:04.447305+0000","last_became_active":"2023-12-08T08:15:00.407393+0000","last_became_peered":"2023-12-08T08:15:00.407393+0000","last_unstale":"2023-12-08T08:15:04.447305+0000","last_undegraded":"2023-12-08T08:15:04.447305+0000","last_fullsized":"2023-12-08T08:15:04.447305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396937+0000","last_change":"2023-12-08T08:14:59.900649+0000","last_active":"2023-12-08T08:15:04.396937+0000","last_peered":"2023-12-08T08:15:04.396937+0000","last_clean":"2023-12-08T08:15:04.396937+0000","last_became_active":"2023-12-08T08:14:59.900269+0000","last_became_peered":"2023-12-08T08:14:59.900269+0000","last_unstale":"2023-12-08T08:15:04.396937+0000","last_undegraded":"2023-12-08T08:15:04.396937+0000","last_fullsized":"2023-12-08T08:15:04.396937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808319+0000","last_change":"2023-12-08T08:15:04.450623+0000","last_active":"2023-12-08T08:15:05.808319+0000","last_peered":"2023-12-08T08:15:05.808319+0000","last_clean":"2023-12-08T08:15:05.808319+0000","last_became_active":"2023-12-08T08:15:04.450114+0000","last_became_peered":"2023-12-08T08:15:04.450114+0000","last_unstale":"2023-12-08T08:15:05.808319+0000","last_undegraded":"2023-12-08T08:15:05.808319+0000","last_fullsized":"2023-12-08T08:15:05.808319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420632+0000","last_change":"2023-12-08T08:15:00.405005+0000","last_active":"2023-12-08T08:15:04.420632+0000","last_peered":"2023-12-08T08:15:04.420632+0000","last_clean":"2023-12-08T08:15:04.420632+0000","last_became_active":"2023-12-08T08:15:00.399553+0000","last_became_peered":"2023-12-08T08:15:00.399553+0000","last_unstale":"2023-12-08T08:15:04.420632+0000","last_undegraded":"2023-12-08T08:15:04.420632+0000","last_fullsized":"2023-12-08T08:15:04.420632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425547+0000","last_change":"2023-12-08T08:14:59.883073+0000","last_active":"2023-12-08T08:15:04.425547+0000","last_peered":"2023-12-08T08:15:04.425547+0000","last_clean":"2023-12-08T08:15:04.425547+0000","last_became_active":"2023-12-08T08:14:59.882846+0000","last_became_peered":"2023-12-08T08:14:59.882846+0000","last_unstale":"2023-12-08T08:15:04.425547+0000","last_undegraded":"2023-12-08T08:15:04.425547+0000","last_fullsized":"2023-12-08T08:15:04.425547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:19.331838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803008+0000","last_change":"2023-12-08T08:15:04.429843+0000","last_active":"2023-12-08T08:15:05.803008+0000","last_peered":"2023-12-08T08:15:05.803008+0000","last_clean":"2023-12-08T08:15:05.803008+0000","last_became_active":"2023-12-08T08:15:04.429319+0000","last_became_peered":"2023-12-08T08:15:04.429319+0000","last_unstale":"2023-12-08T08:15:05.803008+0000","last_undegraded":"2023-12-08T08:15:05.803008+0000","last_fullsized":"2023-12-08T08:15:05.803008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:37.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447921+0000","last_change":"2023-12-08T08:15:00.410615+0000","last_active":"2023-12-08T08:15:04.447921+0000","last_peered":"2023-12-08T08:15:04.447921+0000","last_clean":"2023-12-08T08:15:04.447921+0000","last_became_active":"2023-12-08T08:15:00.410331+0000","last_became_peered":"2023-12-08T08:15:00.410331+0000","last_unstale":"2023-12-08T08:15:04.447921+0000","last_undegraded":"2023-12-08T08:15:04.447921+0000","last_fullsized":"2023-12-08T08:15:04.447921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:25.467790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396751+0000","last_change":"2023-12-08T08:14:59.886431+0000","last_active":"2023-12-08T08:15:04.396751+0000","last_peered":"2023-12-08T08:15:04.396751+0000","last_clean":"2023-12-08T08:15:04.396751+0000","last_became_active":"2023-12-08T08:14:59.884506+0000","last_became_peered":"2023-12-08T08:14:59.884506+0000","last_unstale":"2023-12-08T08:15:04.396751+0000","last_undegraded":"2023-12-08T08:15:04.396751+0000","last_fullsized":"2023-12-08T08:15:04.396751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:49.879584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.873898+0000","last_change":"2023-12-08T08:15:04.451208+0000","last_active":"2023-12-08T08:15:05.873898+0000","last_peered":"2023-12-08T08:15:05.873898+0000","last_clean":"2023-12-08T08:15:05.873898+0000","last_became_active":"2023-12-08T08:15:04.450428+0000","last_became_peered":"2023-12-08T08:15:04.450428+0000","last_unstale":"2023-12-08T08:15:05.873898+0000","last_undegraded":"2023-12-08T08:15:05.873898+0000","last_fullsized":"2023-12-08T08:15:05.873898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447664+0000","last_change":"2023-12-08T08:15:00.404999+0000","last_active":"2023-12-08T08:15:04.447664+0000","last_peered":"2023-12-08T08:15:04.447664+0000","last_clean":"2023-12-08T08:15:04.447664+0000","last_became_active":"2023-12-08T08:15:00.400794+0000","last_became_peered":"2023-12-08T08:15:00.400794+0000","last_unstale":"2023-12-08T08:15:04.447664+0000","last_undegraded":"2023-12-08T08:15:04.447664+0000","last_fullsized":"2023-12-08T08:15:04.447664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.400585+0000","last_change":"2023-12-08T08:14:59.892750+0000","last_active":"2023-12-08T08:15:04.400585+0000","last_peered":"2023-12-08T08:15:04.400585+0000","last_clean":"2023-12-08T08:15:04.400585+0000","last_became_active":"2023-12-08T08:14:59.892365+0000","last_became_peered":"2023-12-08T08:14:59.892365+0000","last_unstale":"2023-12-08T08:15:04.400585+0000","last_undegraded":"2023-12-08T08:15:04.400585+0000","last_fullsized":"2023-12-08T08:15:04.400585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459457+0000","last_change":"2023-12-08T08:15:04.426203+0000","last_active":"2023-12-08T08:15:05.459457+0000","last_peered":"2023-12-08T08:15:05.459457+0000","last_clean":"2023-12-08T08:15:05.459457+0000","last_became_active":"2023-12-08T08:15:04.425489+0000","last_became_peered":"2023-12-08T08:15:04.425489+0000","last_unstale":"2023-12-08T08:15:05.459457+0000","last_undegraded":"2023-12-08T08:15:05.459457+0000","last_fullsized":"2023-12-08T08:15:05.459457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:21.113790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447843+0000","last_change":"2023-12-08T08:15:00.409331+0000","last_active":"2023-12-08T08:15:04.447843+0000","last_peered":"2023-12-08T08:15:04.447843+0000","last_clean":"2023-12-08T08:15:04.447843+0000","last_became_active":"2023-12-08T08:15:00.408754+0000","last_became_peered":"2023-12-08T08:15:00.408754+0000","last_unstale":"2023-12-08T08:15:04.447843+0000","last_undegraded":"2023-12-08T08:15:04.447843+0000","last_fullsized":"2023-12-08T08:15:04.447843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395799+0000","last_change":"2023-12-08T08:14:59.894408+0000","last_active":"2023-12-08T08:15:04.395799+0000","last_peered":"2023-12-08T08:15:04.395799+0000","last_clean":"2023-12-08T08:15:04.395799+0000","last_became_active":"2023-12-08T08:14:59.893999+0000","last_became_peered":"2023-12-08T08:14:59.893999+0000","last_unstale":"2023-12-08T08:15:04.395799+0000","last_undegraded":"2023-12-08T08:15:04.395799+0000","last_fullsized":"2023-12-08T08:15:04.395799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804517+0000","last_change":"2023-12-08T08:15:04.433419+0000","last_active":"2023-12-08T08:15:05.804517+0000","last_peered":"2023-12-08T08:15:05.804517+0000","last_clean":"2023-12-08T08:15:05.804517+0000","last_became_active":"2023-12-08T08:15:04.432977+0000","last_became_peered":"2023-12-08T08:15:04.432977+0000","last_unstale":"2023-12-08T08:15:05.804517+0000","last_undegraded":"2023-12-08T08:15:05.804517+0000","last_fullsized":"2023-12-08T08:15:05.804517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413084+0000","last_change":"2023-12-08T08:15:00.396829+0000","last_active":"2023-12-08T08:15:04.413084+0000","last_peered":"2023-12-08T08:15:04.413084+0000","last_clean":"2023-12-08T08:15:04.413084+0000","last_became_active":"2023-12-08T08:15:00.396388+0000","last_became_peered":"2023-12-08T08:15:00.396388+0000","last_unstale":"2023-12-08T08:15:04.413084+0000","last_undegraded":"2023-12-08T08:15:04.413084+0000","last_fullsized":"2023-12-08T08:15:04.413084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416151+0000","last_change":"2023-12-08T08:14:59.887882+0000","last_active":"2023-12-08T08:15:04.416151+0000","last_peered":"2023-12-08T08:15:04.416151+0000","last_clean":"2023-12-08T08:15:04.416151+0000","last_became_active":"2023-12-08T08:14:59.887386+0000","last_became_peered":"2023-12-08T08:14:59.887386+0000","last_unstale":"2023-12-08T08:15:04.416151+0000","last_undegraded":"2023-12-08T08:15:04.416151+0000","last_fullsized":"2023-12-08T08:15:04.416151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:02.576945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460992+0000","last_change":"2023-12-08T08:15:04.453192+0000","last_active":"2023-12-08T08:15:05.460992+0000","last_peered":"2023-12-08T08:15:05.460992+0000","last_clean":"2023-12-08T08:15:05.460992+0000","last_became_active":"2023-12-08T08:15:04.451164+0000","last_became_peered":"2023-12-08T08:15:04.451164+0000","last_unstale":"2023-12-08T08:15:05.460992+0000","last_undegraded":"2023-12-08T08:15:05.460992+0000","last_fullsized":"2023-12-08T08:15:05.460992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:43.529090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447335+0000","last_change":"2023-12-08T08:15:00.399582+0000","last_active":"2023-12-08T08:15:04.447335+0000","last_peered":"2023-12-08T08:15:04.447335+0000","last_clean":"2023-12-08T08:15:04.447335+0000","last_became_active":"2023-12-08T08:15:00.399251+0000","last_became_peered":"2023-12-08T08:15:00.399251+0000","last_unstale":"2023-12-08T08:15:04.447335+0000","last_undegraded":"2023-12-08T08:15:04.447335+0000","last_fullsized":"2023-12-08T08:15:04.447335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422568+0000","last_change":"2023-12-08T08:14:59.900340+0000","last_active":"2023-12-08T08:15:04.422568+0000","last_peered":"2023-12-08T08:15:04.422568+0000","last_clean":"2023-12-08T08:15:04.422568+0000","last_became_active":"2023-12-08T08:14:59.900040+0000","last_became_peered":"2023-12-08T08:14:59.900040+0000","last_unstale":"2023-12-08T08:15:04.422568+0000","last_undegraded":"2023-12-08T08:15:04.422568+0000","last_fullsized":"2023-12-08T08:15:04.422568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:12.707626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459907+0000","last_change":"2023-12-08T08:15:04.452930+0000","last_active":"2023-12-08T08:15:05.459907+0000","last_peered":"2023-12-08T08:15:05.459907+0000","last_clean":"2023-12-08T08:15:05.459907+0000","last_became_active":"2023-12-08T08:15:04.451134+0000","last_became_peered":"2023-12-08T08:15:04.451134+0000","last_unstale":"2023-12-08T08:15:05.459907+0000","last_undegraded":"2023-12-08T08:15:05.459907+0000","last_fullsized":"2023-12-08T08:15:05.459907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:41.298759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403685+0000","last_change":"2023-12-08T08:15:00.391149+0000","last_active":"2023-12-08T08:15:04.403685+0000","last_peered":"2023-12-08T08:15:04.403685+0000","last_clean":"2023-12-08T08:15:04.403685+0000","last_became_active":"2023-12-08T08:15:00.390876+0000","last_became_peered":"2023-12-08T08:15:00.390876+0000","last_unstale":"2023-12-08T08:15:04.403685+0000","last_undegraded":"2023-12-08T08:15:04.403685+0000","last_fullsized":"2023-12-08T08:15:04.403685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412304+0000","last_change":"2023-12-08T08:14:59.891130+0000","last_active":"2023-12-08T08:15:04.412304+0000","last_peered":"2023-12-08T08:15:04.412304+0000","last_clean":"2023-12-08T08:15:04.412304+0000","last_became_active":"2023-12-08T08:14:59.890441+0000","last_became_peered":"2023-12-08T08:14:59.890441+0000","last_unstale":"2023-12-08T08:15:04.412304+0000","last_undegraded":"2023-12-08T08:15:04.412304+0000","last_fullsized":"2023-12-08T08:15:04.412304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:37.110835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.875742+0000","last_change":"2023-12-08T08:15:04.451191+0000","last_active":"2023-12-08T08:15:05.875742+0000","last_peered":"2023-12-08T08:15:05.875742+0000","last_clean":"2023-12-08T08:15:05.875742+0000","last_became_active":"2023-12-08T08:15:04.450325+0000","last_became_peered":"2023-12-08T08:15:04.450325+0000","last_unstale":"2023-12-08T08:15:05.875742+0000","last_undegraded":"2023-12-08T08:15:05.875742+0000","last_fullsized":"2023-12-08T08:15:05.875742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447388+0000","last_change":"2023-12-08T08:15:00.398759+0000","last_active":"2023-12-08T08:15:04.447388+0000","last_peered":"2023-12-08T08:15:04.447388+0000","last_clean":"2023-12-08T08:15:04.447388+0000","last_became_active":"2023-12-08T08:15:00.392487+0000","last_became_peered":"2023-12-08T08:15:00.392487+0000","last_unstale":"2023-12-08T08:15:04.447388+0000","last_undegraded":"2023-12-08T08:15:04.447388+0000","last_fullsized":"2023-12-08T08:15:04.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:18.522009+0000","last_change":"2023-12-08T08:14:59.891354+0000","last_active":"2023-12-08T08:15:18.522009+0000","last_peered":"2023-12-08T08:15:18.522009+0000","last_clean":"2023-12-08T08:15:18.522009+0000","last_became_active":"2023-12-08T08:14:59.889600+0000","last_became_peered":"2023-12-08T08:14:59.889600+0000","last_unstale":"2023-12-08T08:15:18.522009+0000","last_undegraded":"2023-12-08T08:15:18.522009+0000","last_fullsized":"2023-12-08T08:15:18.522009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101560+0000","last_change":"2023-12-08T08:15:04.436224+0000","last_active":"2023-12-08T08:15:07.101560+0000","last_peered":"2023-12-08T08:15:07.101560+0000","last_clean":"2023-12-08T08:15:07.101560+0000","last_became_active":"2023-12-08T08:15:04.435773+0000","last_became_peered":"2023-12-08T08:15:04.435773+0000","last_unstale":"2023-12-08T08:15:07.101560+0000","last_undegraded":"2023-12-08T08:15:07.101560+0000","last_fullsized":"2023-12-08T08:15:07.101560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:37.657486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404952+0000","last_change":"2023-12-08T08:15:00.389958+0000","last_active":"2023-12-08T08:15:04.404952+0000","last_peered":"2023-12-08T08:15:04.404952+0000","last_clean":"2023-12-08T08:15:04.404952+0000","last_became_active":"2023-12-08T08:15:00.388877+0000","last_became_peered":"2023-12-08T08:15:00.388877+0000","last_unstale":"2023-12-08T08:15:04.404952+0000","last_undegraded":"2023-12-08T08:15:04.404952+0000","last_fullsized":"2023-12-08T08:15:04.404952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425438+0000","last_change":"2023-12-08T08:14:59.895842+0000","last_active":"2023-12-08T08:15:04.425438+0000","last_peered":"2023-12-08T08:15:04.425438+0000","last_clean":"2023-12-08T08:15:04.425438+0000","last_became_active":"2023-12-08T08:14:59.895535+0000","last_became_peered":"2023-12-08T08:14:59.895535+0000","last_unstale":"2023-12-08T08:15:04.425438+0000","last_undegraded":"2023-12-08T08:15:04.425438+0000","last_fullsized":"2023-12-08T08:15:04.425438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:30.765400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459762+0000","last_change":"2023-12-08T08:15:04.427188+0000","last_active":"2023-12-08T08:15:05.459762+0000","last_peered":"2023-12-08T08:15:05.459762+0000","last_clean":"2023-12-08T08:15:05.459762+0000","last_became_active":"2023-12-08T08:15:04.425996+0000","last_became_peered":"2023-12-08T08:15:04.425996+0000","last_unstale":"2023-12-08T08:15:05.459762+0000","last_undegraded":"2023-12-08T08:15:05.459762+0000","last_fullsized":"2023-12-08T08:15:05.459762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:29.438014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414847+0000","last_change":"2023-12-08T08:15:00.406403+0000","last_active":"2023-12-08T08:15:04.414847+0000","last_peered":"2023-12-08T08:15:04.414847+0000","last_clean":"2023-12-08T08:15:04.414847+0000","last_became_active":"2023-12-08T08:15:00.405993+0000","last_became_peered":"2023-12-08T08:15:00.405993+0000","last_unstale":"2023-12-08T08:15:04.414847+0000","last_undegraded":"2023-12-08T08:15:04.414847+0000","last_fullsized":"2023-12-08T08:15:04.414847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421161+0000","last_change":"2023-12-08T08:14:59.899499+0000","last_active":"2023-12-08T08:15:04.421161+0000","last_peered":"2023-12-08T08:15:04.421161+0000","last_clean":"2023-12-08T08:15:04.421161+0000","last_became_active":"2023-12-08T08:14:59.899208+0000","last_became_peered":"2023-12-08T08:14:59.899208+0000","last_unstale":"2023-12-08T08:15:04.421161+0000","last_undegraded":"2023-12-08T08:15:04.421161+0000","last_fullsized":"2023-12-08T08:15:04.421161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:10.487847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458733+0000","last_change":"2023-12-08T08:15:04.428378+0000","last_active":"2023-12-08T08:15:05.458733+0000","last_peered":"2023-12-08T08:15:05.458733+0000","last_clean":"2023-12-08T08:15:05.458733+0000","last_became_active":"2023-12-08T08:15:04.427710+0000","last_became_peered":"2023-12-08T08:15:04.427710+0000","last_unstale":"2023-12-08T08:15:05.458733+0000","last_undegraded":"2023-12-08T08:15:05.458733+0000","last_fullsized":"2023-12-08T08:15:05.458733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420774+0000","last_change":"2023-12-08T08:15:00.401845+0000","last_active":"2023-12-08T08:15:04.420774+0000","last_peered":"2023-12-08T08:15:04.420774+0000","last_clean":"2023-12-08T08:15:04.420774+0000","last_became_active":"2023-12-08T08:15:00.401428+0000","last_became_peered":"2023-12-08T08:15:00.401428+0000","last_unstale":"2023-12-08T08:15:04.420774+0000","last_undegraded":"2023-12-08T08:15:04.420774+0000","last_fullsized":"2023-12-08T08:15:04.420774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413854+0000","last_change":"2023-12-08T08:14:59.902626+0000","last_active":"2023-12-08T08:15:04.413854+0000","last_peered":"2023-12-08T08:15:04.413854+0000","last_clean":"2023-12-08T08:15:04.413854+0000","last_became_active":"2023-12-08T08:14:59.902263+0000","last_became_peered":"2023-12-08T08:14:59.902263+0000","last_unstale":"2023-12-08T08:15:04.413854+0000","last_undegraded":"2023-12-08T08:15:04.413854+0000","last_fullsized":"2023-12-08T08:15:04.413854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458744+0000","last_change":"2023-12-08T08:15:04.452488+0000","last_active":"2023-12-08T08:15:05.458744+0000","last_peered":"2023-12-08T08:15:05.458744+0000","last_clean":"2023-12-08T08:15:05.458744+0000","last_became_active":"2023-12-08T08:15:04.451822+0000","last_became_peered":"2023-12-08T08:15:04.451822+0000","last_unstale":"2023-12-08T08:15:05.458744+0000","last_undegraded":"2023-12-08T08:15:05.458744+0000","last_fullsized":"2023-12-08T08:15:05.458744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803994+0000","last_change":"2023-12-08T08:15:04.453801+0000","last_active":"2023-12-08T08:15:05.803994+0000","last_peered":"2023-12-08T08:15:05.803994+0000","last_clean":"2023-12-08T08:15:05.803994+0000","last_became_active":"2023-12-08T08:15:04.453352+0000","last_became_peered":"2023-12-08T08:15:04.453352+0000","last_unstale":"2023-12-08T08:15:05.803994+0000","last_undegraded":"2023-12-08T08:15:05.803994+0000","last_fullsized":"2023-12-08T08:15:05.803994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406035+0000","last_change":"2023-12-08T08:15:00.380909+0000","last_active":"2023-12-08T08:15:04.406035+0000","last_peered":"2023-12-08T08:15:04.406035+0000","last_clean":"2023-12-08T08:15:04.406035+0000","last_became_active":"2023-12-08T08:15:00.379700+0000","last_became_peered":"2023-12-08T08:15:00.379700+0000","last_unstale":"2023-12-08T08:15:04.406035+0000","last_undegraded":"2023-12-08T08:15:04.406035+0000","last_fullsized":"2023-12-08T08:15:04.406035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:04:49.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412365+0000","last_change":"2023-12-08T08:14:59.890675+0000","last_active":"2023-12-08T08:15:04.412365+0000","last_peered":"2023-12-08T08:15:04.412365+0000","last_clean":"2023-12-08T08:15:04.412365+0000","last_became_active":"2023-12-08T08:14:59.890323+0000","last_became_peered":"2023-12-08T08:14:59.890323+0000","last_unstale":"2023-12-08T08:15:04.412365+0000","last_undegraded":"2023-12-08T08:15:04.412365+0000","last_fullsized":"2023-12-08T08:15:04.412365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808921+0000","last_change":"2023-12-08T08:15:04.443203+0000","last_active":"2023-12-08T08:15:05.808921+0000","last_peered":"2023-12-08T08:15:05.808921+0000","last_clean":"2023-12-08T08:15:05.808921+0000","last_became_active":"2023-12-08T08:15:04.442767+0000","last_became_peered":"2023-12-08T08:15:04.442767+0000","last_unstale":"2023-12-08T08:15:05.808921+0000","last_undegraded":"2023-12-08T08:15:05.808921+0000","last_fullsized":"2023-12-08T08:15:05.808921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:28.413841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411249+0000","last_change":"2023-12-08T08:15:00.394844+0000","last_active":"2023-12-08T08:15:04.411249+0000","last_peered":"2023-12-08T08:15:04.411249+0000","last_clean":"2023-12-08T08:15:04.411249+0000","last_became_active":"2023-12-08T08:15:00.394583+0000","last_became_peered":"2023-12-08T08:15:00.394583+0000","last_unstale":"2023-12-08T08:15:04.411249+0000","last_undegraded":"2023-12-08T08:15:04.411249+0000","last_fullsized":"2023-12-08T08:15:04.411249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416997+0000","last_change":"2023-12-08T08:14:59.898905+0000","last_active":"2023-12-08T08:15:04.416997+0000","last_peered":"2023-12-08T08:15:04.416997+0000","last_clean":"2023-12-08T08:15:04.416997+0000","last_became_active":"2023-12-08T08:14:59.897829+0000","last_became_peered":"2023-12-08T08:14:59.897829+0000","last_unstale":"2023-12-08T08:15:04.416997+0000","last_undegraded":"2023-12-08T08:15:04.416997+0000","last_fullsized":"2023-12-08T08:15:04.416997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:45:24.892032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414962+0000","last_change":"2023-12-08T08:14:59.895592+0000","last_active":"2023-12-08T08:15:04.414962+0000","last_peered":"2023-12-08T08:15:04.414962+0000","last_clean":"2023-12-08T08:15:04.414962+0000","last_became_active":"2023-12-08T08:14:59.895295+0000","last_became_peered":"2023-12-08T08:14:59.895295+0000","last_unstale":"2023-12-08T08:15:04.414962+0000","last_undegraded":"2023-12-08T08:15:04.414962+0000","last_fullsized":"2023-12-08T08:15:04.414962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:33.595711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412137+0000","last_change":"2023-12-08T08:15:00.401972+0000","last_active":"2023-12-08T08:15:04.412137+0000","last_peered":"2023-12-08T08:15:04.412137+0000","last_clean":"2023-12-08T08:15:04.412137+0000","last_became_active":"2023-12-08T08:15:00.401768+0000","last_became_peered":"2023-12-08T08:15:00.401768+0000","last_unstale":"2023-12-08T08:15:04.412137+0000","last_undegraded":"2023-12-08T08:15:04.412137+0000","last_fullsized":"2023-12-08T08:15:04.412137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:06.259376+0000","last_change":"2023-12-08T08:15:04.426722+0000","last_active":"2023-12-08T08:15:06.259376+0000","last_peered":"2023-12-08T08:15:06.259376+0000","last_clean":"2023-12-08T08:15:06.259376+0000","last_became_active":"2023-12-08T08:15:04.426302+0000","last_became_peered":"2023-12-08T08:15:04.426302+0000","last_unstale":"2023-12-08T08:15:06.259376+0000","last_undegraded":"2023-12-08T08:15:06.259376+0000","last_fullsized":"2023-12-08T08:15:06.259376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:07.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.419030+0000","last_change":"2023-12-08T08:14:59.898802+0000","last_active":"2023-12-08T08:15:04.419030+0000","last_peered":"2023-12-08T08:15:04.419030+0000","last_clean":"2023-12-08T08:15:04.419030+0000","last_became_active":"2023-12-08T08:14:59.897917+0000","last_became_peered":"2023-12-08T08:14:59.897917+0000","last_unstale":"2023-12-08T08:15:04.419030+0000","last_undegraded":"2023-12-08T08:15:04.419030+0000","last_fullsized":"2023-12-08T08:15:04.419030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.405546+0000","last_change":"2023-12-08T08:15:00.377480+0000","last_active":"2023-12-08T08:15:04.405546+0000","last_peered":"2023-12-08T08:15:04.405546+0000","last_clean":"2023-12-08T08:15:04.405546+0000","last_became_active":"2023-12-08T08:15:00.376692+0000","last_became_peered":"2023-12-08T08:15:00.376692+0000","last_unstale":"2023-12-08T08:15:04.405546+0000","last_undegraded":"2023-12-08T08:15:04.405546+0000","last_fullsized":"2023-12-08T08:15:04.405546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:50.883191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461226+0000","last_change":"2023-12-08T08:15:04.434422+0000","last_active":"2023-12-08T08:15:05.461226+0000","last_peered":"2023-12-08T08:15:05.461226+0000","last_clean":"2023-12-08T08:15:05.461226+0000","last_became_active":"2023-12-08T08:15:04.434025+0000","last_became_peered":"2023-12-08T08:15:04.434025+0000","last_unstale":"2023-12-08T08:15:05.461226+0000","last_undegraded":"2023-12-08T08:15:05.461226+0000","last_fullsized":"2023-12-08T08:15:05.461226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:40.936584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412941+0000","last_change":"2023-12-08T08:15:00.397602+0000","last_active":"2023-12-08T08:15:04.412941+0000","last_peered":"2023-12-08T08:15:04.412941+0000","last_clean":"2023-12-08T08:15:04.412941+0000","last_became_active":"2023-12-08T08:15:00.396793+0000","last_became_peered":"2023-12-08T08:15:00.396793+0000","last_unstale":"2023-12-08T08:15:04.412941+0000","last_undegraded":"2023-12-08T08:15:04.412941+0000","last_fullsized":"2023-12-08T08:15:04.412941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395803+0000","last_change":"2023-12-08T08:15:00.392327+0000","last_active":"2023-12-08T08:15:04.395803+0000","last_peered":"2023-12-08T08:15:04.395803+0000","last_clean":"2023-12-08T08:15:04.395803+0000","last_became_active":"2023-12-08T08:15:00.391791+0000","last_became_peered":"2023-12-08T08:15:00.391791+0000","last_unstale":"2023-12-08T08:15:04.395803+0000","last_undegraded":"2023-12-08T08:15:04.395803+0000","last_fullsized":"2023-12-08T08:15:04.395803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422479+0000","last_change":"2023-12-08T08:15:00.399925+0000","last_active":"2023-12-08T08:15:04.422479+0000","last_peered":"2023-12-08T08:15:04.422479+0000","last_clean":"2023-12-08T08:15:04.422479+0000","last_became_active":"2023-12-08T08:15:00.397718+0000","last_became_peered":"2023-12-08T08:15:00.397718+0000","last_unstale":"2023-12-08T08:15:04.422479+0000","last_undegraded":"2023-12-08T08:15:04.422479+0000","last_fullsized":"2023-12-08T08:15:04.422479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412045+0000","last_change":"2023-12-08T08:15:00.389088+0000","last_active":"2023-12-08T08:15:04.412045+0000","last_peered":"2023-12-08T08:15:04.412045+0000","last_clean":"2023-12-08T08:15:04.412045+0000","last_became_active":"2023-12-08T08:15:00.388531+0000","last_became_peered":"2023-12-08T08:15:00.388531+0000","last_unstale":"2023-12-08T08:15:04.412045+0000","last_undegraded":"2023-12-08T08:15:04.412045+0000","last_fullsized":"2023-12-08T08:15:04.412045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418168+0000","last_change":"2023-12-08T08:15:00.399625+0000","last_active":"2023-12-08T08:15:04.418168+0000","last_peered":"2023-12-08T08:15:04.418168+0000","last_clean":"2023-12-08T08:15:04.418168+0000","last_became_active":"2023-12-08T08:15:00.399405+0000","last_became_peered":"2023-12-08T08:15:00.399405+0000","last_unstale":"2023-12-08T08:15:04.418168+0000","last_undegraded":"2023-12-08T08:15:04.418168+0000","last_fullsized":"2023-12-08T08:15:04.418168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425340+0000","last_change":"2023-12-08T08:15:00.388290+0000","last_active":"2023-12-08T08:15:04.425340+0000","last_peered":"2023-12-08T08:15:04.425340+0000","last_clean":"2023-12-08T08:15:04.425340+0000","last_became_active":"2023-12-08T08:15:00.387996+0000","last_became_peered":"2023-12-08T08:15:00.387996+0000","last_unstale":"2023-12-08T08:15:04.425340+0000","last_undegraded":"2023-12-08T08:15:04.425340+0000","last_fullsized":"2023-12-08T08:15:04.425340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:11.571727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416014+0000","last_change":"2023-12-08T08:15:00.404101+0000","last_active":"2023-12-08T08:15:04.416014+0000","last_peered":"2023-12-08T08:15:04.416014+0000","last_clean":"2023-12-08T08:15:04.416014+0000","last_became_active":"2023-12-08T08:15:00.403349+0000","last_became_peered":"2023-12-08T08:15:00.403349+0000","last_unstale":"2023-12-08T08:15:04.416014+0000","last_undegraded":"2023-12-08T08:15:04.416014+0000","last_fullsized":"2023-12-08T08:15:04.416014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418659+0000","last_change":"2023-12-08T08:15:00.406185+0000","last_active":"2023-12-08T08:15:04.418659+0000","last_peered":"2023-12-08T08:15:04.418659+0000","last_clean":"2023-12-08T08:15:04.418659+0000","last_became_active":"2023-12-08T08:15:00.405860+0000","last_became_peered":"2023-12-08T08:15:00.405860+0000","last_unstale":"2023-12-08T08:15:04.418659+0000","last_undegraded":"2023-12-08T08:15:04.418659+0000","last_fullsized":"2023-12-08T08:15:04.418659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412237+0000","last_change":"2023-12-08T08:15:00.397626+0000","last_active":"2023-12-08T08:15:04.412237+0000","last_peered":"2023-12-08T08:15:04.412237+0000","last_clean":"2023-12-08T08:15:04.412237+0000","last_became_active":"2023-12-08T08:15:00.397097+0000","last_became_peered":"2023-12-08T08:15:00.397097+0000","last_unstale":"2023-12-08T08:15:04.412237+0000","last_undegraded":"2023-12-08T08:15:04.412237+0000","last_fullsized":"2023-12-08T08:15:04.412237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416905+0000","last_change":"2023-12-08T08:15:00.399153+0000","last_active":"2023-12-08T08:15:04.416905+0000","last_peered":"2023-12-08T08:15:04.416905+0000","last_clean":"2023-12-08T08:15:04.416905+0000","last_became_active":"2023-12-08T08:15:00.398929+0000","last_became_peered":"2023-12-08T08:15:00.398929+0000","last_unstale":"2023-12-08T08:15:04.416905+0000","last_undegraded":"2023-12-08T08:15:04.416905+0000","last_fullsized":"2023-12-08T08:15:04.416905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422384+0000","last_change":"2023-12-08T08:15:00.401295+0000","last_active":"2023-12-08T08:15:04.422384+0000","last_peered":"2023-12-08T08:15:04.422384+0000","last_clean":"2023-12-08T08:15:04.422384+0000","last_became_active":"2023-12-08T08:15:00.401003+0000","last_became_peered":"2023-12-08T08:15:00.401003+0000","last_unstale":"2023-12-08T08:15:04.422384+0000","last_undegraded":"2023-12-08T08:15:04.422384+0000","last_fullsized":"2023-12-08T08:15:04.422384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411185+0000","last_change":"2023-12-08T08:15:00.389780+0000","last_active":"2023-12-08T08:15:04.411185+0000","last_peered":"2023-12-08T08:15:04.411185+0000","last_clean":"2023-12-08T08:15:04.411185+0000","last_became_active":"2023-12-08T08:15:00.388834+0000","last_became_peered":"2023-12-08T08:15:00.388834+0000","last_unstale":"2023-12-08T08:15:04.411185+0000","last_undegraded":"2023-12-08T08:15:04.411185+0000","last_fullsized":"2023-12-08T08:15:04.411185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:06.829179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413719+0000","last_change":"2023-12-08T08:15:00.411312+0000","last_active":"2023-12-08T08:15:04.413719+0000","last_peered":"2023-12-08T08:15:04.413719+0000","last_clean":"2023-12-08T08:15:04.413719+0000","last_became_active":"2023-12-08T08:15:00.408772+0000","last_became_peered":"2023-12-08T08:15:00.408772+0000","last_unstale":"2023-12-08T08:15:04.413719+0000","last_undegraded":"2023-12-08T08:15:04.413719+0000","last_fullsized":"2023-12-08T08:15:04.413719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447494+0000","last_change":"2023-12-08T08:15:00.392749+0000","last_active":"2023-12-08T08:15:04.447494+0000","last_peered":"2023-12-08T08:15:04.447494+0000","last_clean":"2023-12-08T08:15:04.447494+0000","last_became_active":"2023-12-08T08:15:00.392113+0000","last_became_peered":"2023-12-08T08:15:00.392113+0000","last_unstale":"2023-12-08T08:15:04.447494+0000","last_undegraded":"2023-12-08T08:15:04.447494+0000","last_fullsized":"2023-12-08T08:15:04.447494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396777+0000","last_change":"2023-12-08T08:15:00.397614+0000","last_active":"2023-12-08T08:15:04.396777+0000","last_peered":"2023-12-08T08:15:04.396777+0000","last_clean":"2023-12-08T08:15:04.396777+0000","last_became_active":"2023-12-08T08:15:00.397110+0000","last_became_peered":"2023-12-08T08:15:00.397110+0000","last_unstale":"2023-12-08T08:15:04.396777+0000","last_undegraded":"2023-12-08T08:15:04.396777+0000","last_fullsized":"2023-12-08T08:15:04.396777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:38.114443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421587+0000","last_change":"2023-12-08T08:15:00.405108+0000","last_active":"2023-12-08T08:15:04.421587+0000","last_peered":"2023-12-08T08:15:04.421587+0000","last_clean":"2023-12-08T08:15:04.421587+0000","last_became_active":"2023-12-08T08:15:00.404650+0000","last_became_peered":"2023-12-08T08:15:00.404650+0000","last_unstale":"2023-12-08T08:15:04.421587+0000","last_undegraded":"2023-12-08T08:15:04.421587+0000","last_fullsized":"2023-12-08T08:15:04.421587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412104+0000","last_change":"2023-12-08T08:15:00.399420+0000","last_active":"2023-12-08T08:15:04.412104+0000","last_peered":"2023-12-08T08:15:04.412104+0000","last_clean":"2023-12-08T08:15:04.412104+0000","last_became_active":"2023-12-08T08:15:00.397884+0000","last_became_peered":"2023-12-08T08:15:00.397884+0000","last_unstale":"2023-12-08T08:15:04.412104+0000","last_undegraded":"2023-12-08T08:15:04.412104+0000","last_fullsized":"2023-12-08T08:15:04.412104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406107+0000","last_change":"2023-12-08T08:15:00.373700+0000","last_active":"2023-12-08T08:15:04.406107+0000","last_peered":"2023-12-08T08:15:04.406107+0000","last_clean":"2023-12-08T08:15:04.406107+0000","last_became_active":"2023-12-08T08:15:00.373315+0000","last_became_peered":"2023-12-08T08:15:00.373315+0000","last_unstale":"2023-12-08T08:15:04.406107+0000","last_undegraded":"2023-12-08T08:15:04.406107+0000","last_fullsized":"2023-12-08T08:15:04.406107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:54.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403529+0000","last_change":"2023-12-08T08:15:00.385175+0000","last_active":"2023-12-08T08:15:04.403529+0000","last_peered":"2023-12-08T08:15:04.403529+0000","last_clean":"2023-12-08T08:15:04.403529+0000","last_became_active":"2023-12-08T08:15:00.384670+0000","last_became_peered":"2023-12-08T08:15:00.384670+0000","last_unstale":"2023-12-08T08:15:04.403529+0000","last_undegraded":"2023-12-08T08:15:04.403529+0000","last_fullsized":"2023-12-08T08:15:04.403529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418851+0000","last_change":"2023-12-08T08:15:00.397339+0000","last_active":"2023-12-08T08:15:04.418851+0000","last_peered":"2023-12-08T08:15:04.418851+0000","last_clean":"2023-12-08T08:15:04.418851+0000","last_became_active":"2023-12-08T08:15:00.396888+0000","last_became_peered":"2023-12-08T08:15:00.396888+0000","last_unstale":"2023-12-08T08:15:04.418851+0000","last_undegraded":"2023-12-08T08:15:04.418851+0000","last_fullsized":"2023-12-08T08:15:04.418851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404753+0000","last_change":"2023-12-08T08:15:00.406207+0000","last_active":"2023-12-08T08:15:04.404753+0000","last_peered":"2023-12-08T08:15:04.404753+0000","last_clean":"2023-12-08T08:15:04.404753+0000","last_became_active":"2023-12-08T08:15:00.405928+0000","last_became_peered":"2023-12-08T08:15:00.405928+0000","last_unstale":"2023-12-08T08:15:04.404753+0000","last_undegraded":"2023-12-08T08:15:04.404753+0000","last_fullsized":"2023-12-08T08:15:04.404753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:12.923902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415948+0000","last_change":"2023-12-08T08:15:00.411990+0000","last_active":"2023-12-08T08:15:04.415948+0000","last_peered":"2023-12-08T08:15:04.415948+0000","last_clean":"2023-12-08T08:15:04.415948+0000","last_became_active":"2023-12-08T08:15:00.411754+0000","last_became_peered":"2023-12-08T08:15:00.411754+0000","last_unstale":"2023-12-08T08:15:04.415948+0000","last_undegraded":"2023-12-08T08:15:04.415948+0000","last_fullsized":"2023-12-08T08:15:04.415948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414100+0000","last_change":"2023-12-08T08:15:00.404296+0000","last_active":"2023-12-08T08:15:04.414100+0000","last_peered":"2023-12-08T08:15:04.414100+0000","last_clean":"2023-12-08T08:15:04.414100+0000","last_became_active":"2023-12-08T08:15:00.403816+0000","last_became_peered":"2023-12-08T08:15:00.403816+0000","last_unstale":"2023-12-08T08:15:04.414100+0000","last_undegraded":"2023-12-08T08:15:04.414100+0000","last_fullsized":"2023-12-08T08:15:04.414100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447876+0000","last_change":"2023-12-08T08:15:00.407698+0000","last_active":"2023-12-08T08:15:04.447876+0000","last_peered":"2023-12-08T08:15:04.447876+0000","last_clean":"2023-12-08T08:15:04.447876+0000","last_became_active":"2023-12-08T08:15:00.407394+0000","last_became_peered":"2023-12-08T08:15:00.407394+0000","last_unstale":"2023-12-08T08:15:04.447876+0000","last_undegraded":"2023-12-08T08:15:04.447876+0000","last_fullsized":"2023-12-08T08:15:04.447876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:11.621846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.410963+0000","last_change":"2023-12-08T08:15:00.400390+0000","last_active":"2023-12-08T08:15:04.410963+0000","last_peered":"2023-12-08T08:15:04.410963+0000","last_clean":"2023-12-08T08:15:04.410963+0000","last_became_active":"2023-12-08T08:15:00.400019+0000","last_became_peered":"2023-12-08T08:15:00.400019+0000","last_unstale":"2023-12-08T08:15:04.410963+0000","last_undegraded":"2023-12-08T08:15:04.410963+0000","last_fullsized":"2023-12-08T08:15:04.410963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447736+0000","last_change":"2023-12-08T08:15:00.396225+0000","last_active":"2023-12-08T08:15:04.447736+0000","last_peered":"2023-12-08T08:15:04.447736+0000","last_clean":"2023-12-08T08:15:04.447736+0000","last_became_active":"2023-12-08T08:15:00.395943+0000","last_became_peered":"2023-12-08T08:15:00.395943+0000","last_unstale":"2023-12-08T08:15:04.447736+0000","last_undegraded":"2023-12-08T08:15:04.447736+0000","last_fullsized":"2023-12-08T08:15:04.447736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422301+0000","last_change":"2023-12-08T08:15:00.401328+0000","last_active":"2023-12-08T08:15:04.422301+0000","last_peered":"2023-12-08T08:15:04.422301+0000","last_clean":"2023-12-08T08:15:04.422301+0000","last_became_active":"2023-12-08T08:15:00.400964+0000","last_became_peered":"2023-12-08T08:15:00.400964+0000","last_unstale":"2023-12-08T08:15:04.422301+0000","last_undegraded":"2023-12-08T08:15:04.422301+0000","last_fullsized":"2023-12-08T08:15:04.422301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447113+0000","last_change":"2023-12-08T08:15:00.386324+0000","last_active":"2023-12-08T08:15:04.447113+0000","last_peered":"2023-12-08T08:15:04.447113+0000","last_clean":"2023-12-08T08:15:04.447113+0000","last_became_active":"2023-12-08T08:15:00.385867+0000","last_became_peered":"2023-12-08T08:15:00.385867+0000","last_unstale":"2023-12-08T08:15:04.447113+0000","last_undegraded":"2023-12-08T08:15:04.447113+0000","last_fullsized":"2023-12-08T08:15:04.447113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420534+0000","last_change":"2023-12-08T08:15:00.405186+0000","last_active":"2023-12-08T08:15:04.420534+0000","last_peered":"2023-12-08T08:15:04.420534+0000","last_clean":"2023-12-08T08:15:04.420534+0000","last_became_active":"2023-12-08T08:15:00.404663+0000","last_became_peered":"2023-12-08T08:15:00.404663+0000","last_unstale":"2023-12-08T08:15:04.420534+0000","last_undegraded":"2023-12-08T08:15:04.420534+0000","last_fullsized":"2023-12-08T08:15:04.420534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411222+0000","last_change":"2023-12-08T08:15:00.390953+0000","last_active":"2023-12-08T08:15:04.411222+0000","last_peered":"2023-12-08T08:15:04.411222+0000","last_clean":"2023-12-08T08:15:04.411222+0000","last_became_active":"2023-12-08T08:15:00.390638+0000","last_became_peered":"2023-12-08T08:15:00.390638+0000","last_unstale":"2023-12-08T08:15:04.411222+0000","last_undegraded":"2023-12-08T08:15:04.411222+0000","last_fullsized":"2023-12-08T08:15:04.411222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425744+0000","last_change":"2023-12-08T08:15:00.394118+0000","last_active":"2023-12-08T08:15:04.425744+0000","last_peered":"2023-12-08T08:15:04.425744+0000","last_clean":"2023-12-08T08:15:04.425744+0000","last_became_active":"2023-12-08T08:15:00.393338+0000","last_became_peered":"2023-12-08T08:15:00.393338+0000","last_unstale":"2023-12-08T08:15:04.425744+0000","last_undegraded":"2023-12-08T08:15:04.425744+0000","last_fullsized":"2023-12-08T08:15:04.425744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:04:34.103680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447849+0000","last_change":"2023-12-08T08:15:00.404323+0000","last_active":"2023-12-08T08:15:04.447849+0000","last_peered":"2023-12-08T08:15:04.447849+0000","last_clean":"2023-12-08T08:15:04.447849+0000","last_became_active":"2023-12-08T08:15:00.403298+0000","last_became_peered":"2023-12-08T08:15:00.403298+0000","last_unstale":"2023-12-08T08:15:04.447849+0000","last_undegraded":"2023-12-08T08:15:04.447849+0000","last_fullsized":"2023-12-08T08:15:04.447849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7090000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9970000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9830000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7909999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0099999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":698764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:15:29.837 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:15:29.837 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-08T08:15:29.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-08T08:15:29.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-08T08:15:29.838 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-08T08:15:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.106+0000 7f87d759e640 1 Processor -- start 2023-12-08T08:15:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.107+0000 7f87d759e640 1 -- start start 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87d81519c0 0x7f87d81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87d80c44d0 0x7f87d8154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d81553b0 con 0x7f87d80c7a50 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80c4a00 con 0x7f87d81519c0 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80c4ce0 con 0x7f87d80c44d0 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87d81519c0 0x7f87d81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87d81519c0 0x7f87d81584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54792/0 (socket says 172.21.15.45:54792) 2023-12-08T08:15:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.108+0000 7f87d659c640 1 -- 172.21.15.45:0/2712694855 learned_addr learned my addr 172.21.15.45:0/2712694855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.109+0000 7f87d659c640 1 -- 172.21.15.45:0/2712694855 >> v2:172.21.15.114:3300/0 conn(0x7f87d80c44d0 msgr2=0x7f87d8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.109+0000 7f87d659c640 1 --2- 172.21.15.45:0/2712694855 >> v2:172.21.15.114:3300/0 conn(0x7f87d80c44d0 0x7f87d8154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.109+0000 7f87d659c640 1 -- 172.21.15.45:0/2712694855 >> v1:172.21.15.114:6789/0 conn(0x7f87d80c7a50 legacy=0x7f87d80ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.109+0000 7f87d659c640 1 -- 172.21.15.45:0/2712694855 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d81579e0 con 0x7f87d81519c0 2023-12-08T08:15:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.110+0000 7f87d659c640 1 --2- 172.21.15.45:0/2712694855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d81519c0 0x7f87d81584c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ac250 tx=0x7f87c802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe5f8d87ed48c9a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.110+0000 7f87d559a640 1 -- 172.21.15.45:0/2712694855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c802c960 con 0x7f87d81519c0 2023-12-08T08:15:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d559a640 1 -- 172.21.15.45:0/2712694855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c802cac0 con 0x7f87d81519c0 2023-12-08T08:15:30.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d559a640 1 -- 172.21.15.45:0/2712694855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c802ce50 con 0x7f87d81519c0 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 -- 172.21.15.45:0/2712694855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d81519c0 msgr2=0x7f87d81584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 --2- 172.21.15.45:0/2712694855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d81519c0 0x7f87d81584c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ac250 tx=0x7f87c802bdc0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 -- 172.21.15.45:0/2712694855 shutdown_connections 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 --2- 172.21.15.45:0/2712694855 >> v2:172.21.15.114:3300/0 conn(0x7f87d80c44d0 0x7f87d8154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 --2- 172.21.15.45:0/2712694855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d81519c0 0x7f87d81584c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 -- 172.21.15.45:0/2712694855 >> 172.21.15.45:0/2712694855 conn(0x7f87d80661f0 msgr2=0x7f87d8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 -- 172.21.15.45:0/2712694855 shutdown_connections 2023-12-08T08:15:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.111+0000 7f87d759e640 1 -- 172.21.15.45:0/2712694855 wait complete. 2023-12-08T08:15:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.113+0000 7f87d759e640 1 Processor -- start 2023-12-08T08:15:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.113+0000 7f87d759e640 1 -- start start 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 0x7f87d80aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 0x7f87d81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80aa900 con 0x7f87d80c44d0 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80a9690 con 0x7f87d80c7a50 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80ab2a0 con 0x7f87d81519c0 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54804/0 (socket says 172.21.15.45:54804) 2023-12-08T08:15:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.114+0000 7f87d659c640 1 -- 172.21.15.45:0/520234889 learned_addr learned my addr 172.21.15.45:0/520234889 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d6d9d640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 0x7f87d81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 -- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 msgr2=0x7f87d81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 0x7f87d81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 -- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 msgr2=0x7f87d80aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d5d9b640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 0x7f87d80aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 0x7f87d80aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 -- 172.21.15.45:0/520234889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009b30 con 0x7f87d80c44d0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d6d9d640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 0x7f87d81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d5d9b640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 0x7f87d80aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.115+0000 7f87d659c640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036040 tx=0x7f87c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.116+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c803e450 con 0x7f87d80c44d0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.116+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c803e5b0 con 0x7f87d80c44d0 2023-12-08T08:15:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.116+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c803e960 con 0x7f87d80c44d0 2023-12-08T08:15:30.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.116+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80a98e0 con 0x7f87d80c44d0 2023-12-08T08:15:30.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.116+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80a9ea0 con 0x7f87d80c44d0 2023-12-08T08:15:30.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.117+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d80abd80 con 0x7f87d80c44d0 2023-12-08T08:15:30.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.118+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87c803eac0 con 0x7f87d80c44d0 2023-12-08T08:15:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.119+0000 7f87ceffd640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.119+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87c80ac9d0 con 0x7f87d80c44d0 2023-12-08T08:15:30.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.119+0000 7f87d5d9b640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.120+0000 7f87d5d9b640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 0x7f87b806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006fd0 tx=0x7f87c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.124+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87c80778a0 con 0x7f87d80c44d0 2023-12-08T08:15:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.364+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f87d80743e0 con 0x7f87d80c44d0 2023-12-08T08:15:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.374+0000 7f87ceffd640 1 -- 172.21.15.45:0/520234889 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171032 (secure 0 0 0) 0x7f87c807aec0 con 0x7f87d80c44d0 2023-12-08T08:15:30.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.378+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 msgr2=0x7f87b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.378+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 0x7f87b806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87c0006fd0 tx=0x7f87c0008040 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.378+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 msgr2=0x7f87d80aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.378+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87c8036040 tx=0x7f87c8004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 shutdown_connections 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f87b806ae40 0x7f87b806d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f87d81519c0 0x7f87d81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d80c7a50 0x7f87d80aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 --2- 172.21.15.45:0/520234889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87d80c44d0 0x7f87d80aac50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 >> 172.21.15.45:0/520234889 conn(0x7f87d80661f0 msgr2=0x7f87d80c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 shutdown_connections 2023-12-08T08:15:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.379+0000 7f87d759e640 1 -- 172.21.15.45:0/520234889 wait complete. 2023-12-08T08:15:30.402 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3986782065},{"type":"v1","addr":"172.21.15.45:6833","nonce":3986782065}]},"active_addr":"172.21.15.45:6833/3986782065","active_change":"2023-12-08T08:14:45.671932+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3469565077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1109125539}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":2399225138}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3551925147}]}]} 2023-12-08T08:15:30.405 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-08T08:15:30.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-08T08:15:30.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.630+0000 7f0002602640 1 Processor -- start 2023-12-08T08:15:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.631+0000 7f0002602640 1 -- start start 2023-12-08T08:15:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efffc14c4a0 0x7efffc156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efffc0a4d10 0x7efffc155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0c4730 con 0x7efffc14c4a0 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0c56e0 con 0x7efffc0a4d10 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7f0002602640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0a54f0 con 0x7efffc155ec0 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.632+0000 7efffbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efffc14c4a0 0x7efffc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efffc14c4a0 0x7efffc156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54820/0 (socket says 172.21.15.45:54820) 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 -- 172.21.15.45:0/2854046774 learned_addr learned my addr 172.21.15.45:0/2854046774 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffb7fe640 1 --2- 172.21.15.45:0/2854046774 >> v2:172.21.15.114:3300/0 conn(0x7efffc0a4d10 0x7efffc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7f0000b9f640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 -- 172.21.15.45:0/2854046774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 msgr2=0x7efffc153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 -- 172.21.15.45:0/2854046774 >> v2:172.21.15.114:3300/0 conn(0x7efffc0a4d10 msgr2=0x7efffc155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 --2- 172.21.15.45:0/2854046774 >> v2:172.21.15.114:3300/0 conn(0x7efffc0a4d10 0x7efffc155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.633+0000 7efffbfff640 1 -- 172.21.15.45:0/2854046774 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc14c880 con 0x7efffc14c4a0 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.634+0000 7efffbfff640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc156490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efffc0c3540 tx=0x7effec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1125a087363d750 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.635+0000 7efffaffd640 1 -- 172.21.15.45:0/2854046774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec0317e0 con 0x7efffc14c4a0 2023-12-08T08:15:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.635+0000 7efffaffd640 1 -- 172.21.15.45:0/2854046774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec031940 con 0x7efffc14c4a0 2023-12-08T08:15:30.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.635+0000 7efffaffd640 1 -- 172.21.15.45:0/2854046774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec031cd0 con 0x7efffc14c4a0 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 -- 172.21.15.45:0/2854046774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 msgr2=0x7efffc156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc156490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efffc0c3540 tx=0x7effec02b880 comp rx=0 tx=0).stop 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 -- 172.21.15.45:0/2854046774 shutdown_connections 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 --2- 172.21.15.45:0/2854046774 >> v2:172.21.15.114:3300/0 conn(0x7efffc0a4d10 0x7efffc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 --2- 172.21.15.45:0/2854046774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc156490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 -- 172.21.15.45:0/2854046774 >> 172.21.15.45:0/2854046774 conn(0x7efffc0661f0 msgr2=0x7efffc066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 -- 172.21.15.45:0/2854046774 shutdown_connections 2023-12-08T08:15:30.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.636+0000 7f0002602640 1 -- 172.21.15.45:0/2854046774 wait complete. 2023-12-08T08:15:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.638+0000 7f0002602640 1 Processor -- start 2023-12-08T08:15:30.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.638+0000 7f0002602640 1 -- start start 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efffc0a4d10 0x7efffc0c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0c0340 con 0x7efffc14c4a0 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0c05b0 con 0x7efffc0a4d10 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7f0002602640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0c0890 con 0x7efffc155ec0 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7efffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.639+0000 7efffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54822/0 (socket says 172.21.15.45:54822) 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 -- 172.21.15.45:0/2588885797 learned_addr learned my addr 172.21.15.45:0/2588885797 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7f0000b9f640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffbfff640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efffc0a4d10 0x7efffc0c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 -- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 msgr2=0x7efffc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 -- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efffc0a4d10 msgr2=0x7efffc0c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efffc0a4d10 0x7efffc0c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 -- 172.21.15.45:0/2588885797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0094d0 con 0x7efffc14c4a0 2023-12-08T08:15:30.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.640+0000 7efffb7fe640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efff000e840 tx=0x7efff000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.641+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000c730 con 0x7efffc14c4a0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.641+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000c890 con 0x7efffc14c4a0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.641+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000cc40 con 0x7efffc14c4a0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.641+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc0c0b70 con 0x7efffc14c4a0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.641+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc153030 con 0x7efffc14c4a0 2023-12-08T08:15:30.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.642+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc152e20 con 0x7efffc14c4a0 2023-12-08T08:15:30.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.643+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efff0013470 con 0x7efffc14c4a0 2023-12-08T08:15:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.644+0000 7efff8ff9640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 0x7effe806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.644+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efff00898c0 con 0x7efffc14c4a0 2023-12-08T08:15:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.644+0000 7efffbfff640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 0x7effe806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:30.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.645+0000 7efffbfff640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 0x7effe806d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effec036000 tx=0x7effec03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:30.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.649+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efffc152e20 con 0x7efffc14c4a0 2023-12-08T08:15:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.848+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efffc152e20 con 0x7efffc14c4a0 2023-12-08T08:15:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.850+0000 7efff8ff9640 1 -- 172.21.15.45:0/2588885797 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7efffc152e20 con 0x7efffc14c4a0 2023-12-08T08:15:30.853 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:30.853 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 msgr2=0x7effe806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 0x7effe806d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effec036000 tx=0x7effec03d040 comp rx=0 tx=0).stop 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 msgr2=0x7efffc0aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efff000e840 tx=0x7efff000ed00 comp rx=0 tx=0).stop 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 shutdown_connections 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7effe806ae90 0x7effe806d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efffc155ec0 0x7efffc0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efffc14c4a0 0x7efffc0aa030 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 --2- 172.21.15.45:0/2588885797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efffc0a4d10 0x7efffc0c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 >> 172.21.15.45:0/2588885797 conn(0x7efffc0661f0 msgr2=0x7efffc148250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 shutdown_connections 2023-12-08T08:15:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:30.853+0000 7f0002602640 1 -- 172.21.15.45:0/2588885797 wait complete. 2023-12-08T08:15:30.876 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-08T08:15:30.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.102+0000 7fee6141a640 1 Processor -- start 2023-12-08T08:15:31.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.103+0000 7fee6141a640 1 -- start start 2023-12-08T08:15:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee6141a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee5c0a7910 0x7fee5c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee6141a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c155850 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee6141a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0c0890 con 0x7fee5c1521b0 2023-12-08T08:15:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee6141a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c0c0b70 con 0x7fee5c0a7910 2023-12-08T08:15:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee537fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee5c0c1dc0 0x7fee5c14f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51842/0 (socket says 172.21.15.45:51842) 2023-12-08T08:15:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.104+0000 7fee537fe640 1 -- 172.21.15.45:0/662146695 learned_addr learned my addr 172.21.15.45:0/662146695 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.105+0000 7fee5bfff640 1 --2- 172.21.15.45:0/662146695 >> v2:172.21.15.114:3300/0 conn(0x7fee5c0a7910 0x7fee5c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.105+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969394148 0 0) 0x7fee5c155850 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.105+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee48003520 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.105+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445318972 0 0) 0x7fee48003520 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 >> v2:172.21.15.114:3300/0 conn(0x7fee5c0a7910 msgr2=0x7fee5c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 --2- 172.21.15.45:0/662146695 >> v2:172.21.15.114:3300/0 conn(0x7fee5c0a7910 0x7fee5c0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 >> v1:172.21.15.114:6789/0 conn(0x7fee5c1521b0 legacy=0x7fee5c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0c0e50 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fee44001670 con 0x7fee5c0c1dc0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 >> v1:172.21.15.45:6789/0 conn(0x7fee5c0c1dc0 legacy=0x7fee5c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480039c0 0x7fee48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 0x7fee48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee480051d0 0x7fee4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c0b70 con 0x7fee480047c0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800c120 con 0x7fee480039c0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800c2e0 con 0x7fee480051d0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee537fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 0x7fee48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.106+0000 7fee5bfff640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480039c0 0x7fee48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee537fe640 1 -- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee480051d0 msgr2=0x7fee4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee60c19640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee480051d0 0x7fee4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee537fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee480051d0 0x7fee4800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee537fe640 1 -- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480039c0 msgr2=0x7fee48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee537fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480039c0 0x7fee48003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee537fe640 1 -- 172.21.15.45:0/662146695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48003520 con 0x7fee480047c0 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee60c19640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee480051d0 0x7fee4800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee5bfff640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480039c0 0x7fee48003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.107+0000 7fee60c19640 1 -- 172.21.15.45:0/662146695 reap_dead start 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee537fe640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 0x7fee48004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0c21a0 tx=0x7fee480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9ad49f3d923866 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44005ad0 con 0x7fee480047c0 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44005c50 con 0x7fee480047c0 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee5b7fe640 1 -- 172.21.15.45:0/662146695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44007070 con 0x7fee480047c0 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee6141a640 1 -- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 msgr2=0x7fee48004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.108+0000 7fee6141a640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 0x7fee48004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0c21a0 tx=0x7fee480057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.109+0000 7fee6141a640 1 -- 172.21.15.45:0/662146695 shutdown_connections 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.109+0000 7fee6141a640 1 --2- 172.21.15.45:0/662146695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee480047c0 0x7fee48004c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.109+0000 7fee6141a640 1 -- 172.21.15.45:0/662146695 >> 172.21.15.45:0/662146695 conn(0x7fee5c0c5780 msgr2=0x7fee5c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.109+0000 7fee6141a640 1 -- 172.21.15.45:0/662146695 shutdown_connections 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.109+0000 7fee6141a640 1 -- 172.21.15.45:0/662146695 wait complete. 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.110+0000 7fee6141a640 1 Processor -- start 2023-12-08T08:15:31.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.111+0000 7fee6141a640 1 -- start start 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480047c0 0x7fee5c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0a4fa0 0x7fee5c14dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c14ee30 con 0x7fee5c14e1f0 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1ea280 con 0x7fee480047c0 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee6141a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1ea520 con 0x7fee5c0a4fa0 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54844/0 (socket says 172.21.15.45:54844) 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 -- 172.21.15.45:0/1702765600 learned_addr learned my addr 172.21.15.45:0/1702765600 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee5bfff640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480047c0 0x7fee5c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee537fe640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0a4fa0 0x7fee5c14dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 -- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0a4fa0 msgr2=0x7fee5c14dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0a4fa0 0x7fee5c14dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 -- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480047c0 msgr2=0x7fee5c0c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480047c0 0x7fee5c0c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.112+0000 7fee60c19640 1 -- 172.21.15.45:0/1702765600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0c4580 con 0x7fee5c14e1f0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee60c19640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0c32a0 tx=0x7fee5400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400b070 con 0x7fee5c14e1f0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540054e0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54003830 con 0x7fee5c14e1f0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c14f030 con 0x7fee5c14e1f0 2023-12-08T08:15:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.113+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c0c51e0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.115+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c14e9b0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.116+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee54003990 con 0x7fee5c14e1f0 2023-12-08T08:15:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.117+0000 7fee597fa640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 0x7fee3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.117+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee54088c40 con 0x7fee5c14e1f0 2023-12-08T08:15:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.117+0000 7fee5bfff640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 0x7fee3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.118+0000 7fee5bfff640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 0x7fee3c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ab820 tx=0x7fee4c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.121+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee5c14e9b0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.318+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee5c14e9b0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.321+0000 7fee597fa640 1 -- 172.21.15.45:0/1702765600 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fee5c14e9b0 con 0x7fee5c14e1f0 2023-12-08T08:15:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:31.324 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 msgr2=0x7fee3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 0x7fee3c06d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ab820 tx=0x7fee4c00b040 comp rx=0 tx=0).stop 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 msgr2=0x7fee5c1dad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0c32a0 tx=0x7fee5400d890 comp rx=0 tx=0).stop 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 shutdown_connections 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fee3c06ae70 0x7fee3c06d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fee5c0a4fa0 0x7fee5c14dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee5c14e1f0 0x7fee5c1dad00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 --2- 172.21.15.45:0/1702765600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee480047c0 0x7fee5c0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 >> 172.21.15.45:0/1702765600 conn(0x7fee5c0c5780 msgr2=0x7fee5c14faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 shutdown_connections 2023-12-08T08:15:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.324+0000 7fee6141a640 1 -- 172.21.15.45:0/1702765600 wait complete. 2023-12-08T08:15:31.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-08T08:15:31.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-08T08:15:31.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-08T08:15:31.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-08T08:15:31.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-08T08:15:31.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-08T08:15:31.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-08T08:15:31.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-08T08:15:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.653+0000 7f04affff640 1 Processor -- start 2023-12-08T08:15:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.653+0000 7f04affff640 1 -- start start 2023-12-08T08:15:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04affff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 0x7f04a8006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04affff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a800fcc0 0x7f04a80067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04affff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80d7cd0 con 0x7f04a80d78f0 2023-12-08T08:15:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04affff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a80db220 con 0x7f04a800fcc0 2023-12-08T08:15:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04affff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a804b9d0 con 0x7f04a80506f0 2023-12-08T08:15:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.656+0000 7f04ae7fc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 0x7f04a8006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04ae7fc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 0x7f04a8006290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40814/0 (socket says 172.21.15.45:40814) 2023-12-08T08:15:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04af7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a800fcc0 0x7f04a80067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04af7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a800fcc0 0x7f04a80067d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54848/0 (socket says 172.21.15.45:54848) 2023-12-08T08:15:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04ae7fc640 1 -- 172.21.15.45:0/2242346671 learned_addr learned my addr 172.21.15.45:0/2242346671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04af7fe640 1 -- 172.21.15.45:0/2242346671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 msgr2=0x7f04a8006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.657+0000 7f04af7fe640 1 --2- 172.21.15.45:0/2242346671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 0x7f04a8006290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.658+0000 7f04af7fe640 1 -- 172.21.15.45:0/2242346671 >> v1:172.21.15.114:6789/0 conn(0x7f04a80d78f0 legacy=0x7f04a800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.658+0000 7f04af7fe640 1 -- 172.21.15.45:0/2242346671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a804bcb0 con 0x7f04a800fcc0 2023-12-08T08:15:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.659+0000 7f04af7fe640 1 --2- 172.21.15.45:0/2242346671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a800fcc0 0x7f04a80067d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097a0 tx=0x7f04a002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcf3db59e7f1c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.660+0000 7f04adffb640 1 -- 172.21.15.45:0/2242346671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0031710 con 0x7f04a800fcc0 2023-12-08T08:15:31.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.660+0000 7f04adffb640 1 -- 172.21.15.45:0/2242346671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a002f050 con 0x7f04a800fcc0 2023-12-08T08:15:31.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.660+0000 7f04adffb640 1 -- 172.21.15.45:0/2242346671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0031710 con 0x7f04a800fcc0 2023-12-08T08:15:31.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.662+0000 7f04affff640 1 -- 172.21.15.45:0/2242346671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a800fcc0 msgr2=0x7f04a80067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.662+0000 7f04affff640 1 --2- 172.21.15.45:0/2242346671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a800fcc0 0x7f04a80067d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097a0 tx=0x7f04a002b7b0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f70949a9640 1 Processor -- start 2023-12-08T08:15:31.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 -- 172.21.15.45:0/2242346671 shutdown_connections 2023-12-08T08:15:31.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 --2- 172.21.15.45:0/2242346671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a800fcc0 0x7f04a80067d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 --2- 172.21.15.45:0/2242346671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a80506f0 0x7f04a8006290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 -- 172.21.15.45:0/2242346671 >> 172.21.15.45:0/2242346671 conn(0x7f04a804fbd0 msgr2=0x7f04a804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 -- 172.21.15.45:0/2242346671 shutdown_connections 2023-12-08T08:15:31.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7ff980a94640 1 Processor -- start 2023-12-08T08:15:31.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7f04affff640 1 -- 172.21.15.45:0/2242346671 wait complete. 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7ff7b11a9640 1 Processor -- start 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.663+0000 7ff7b11a9640 1 -- start start 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff7b11a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7ac0c0330 0x7ff7ac164e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff7b11a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac1654b0 con 0x7ff7ac06df90 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff7b11a9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac0c38d0 con 0x7ff7ac0c4690 2023-12-08T08:15:31.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff7b11a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c3bb0 con 0x7ff7ac0c0330 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.664+0000 7ff980a94640 1 -- start start 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff980a94640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff97c151be0 0x7ff97c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff980a94640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff97c0c8910 0x7ff97c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff980a94640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c151fc0 con 0x7ff97c0c4c30 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff980a94640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0c5170 con 0x7ff97c151be0 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7ff980a94640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c154540 con 0x7ff97c0c8910 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.664+0000 7f70949a9640 1 -- start start 2023-12-08T08:15:31.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7090151930 0x7f70900c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70900c7ac0 0x7f70900ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70900ca630 0x7f70900c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7090154570 con 0x7f7090151930 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7090154850 con 0x7f70900c7ac0 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.665+0000 7f70949a9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7090154b30 con 0x7f70900ca630 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.666+0000 7ff7aad9d640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff7ac0c4690 0x7ff7ac0a89e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:60160/0 (socket says 172.21.15.45:60160) 2023-12-08T08:15:31.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.666+0000 7ff7aad9d640 1 -- 172.21.15.45:0/1544806140 learned_addr learned my addr 172.21.15.45:0/1544806140 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.666+0000 7ff7a3fff640 1 --2- 172.21.15.45:0/1544806140 >> v2:172.21.15.45:3300/0 conn(0x7ff7ac0c0330 0x7ff7ac164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.666+0000 7f9d726ea640 1 Processor -- start 2023-12-08T08:15:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7f9d726ea640 1 -- start start 2023-12-08T08:15:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff97a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff97c151be0 0x7ff97c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff97ad9d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff97c0c8910 0x7ff97c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff979d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff97c0c4c30 0x7ff97c0c7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51858/0 (socket says 172.21.15.45:51858) 2023-12-08T08:15:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff979d9b640 1 -- 172.21.15.45:0/1023076403 learned_addr learned my addr 172.21.15.45:0/1023076403 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7f708e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7090151930 0x7f70900c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff7aa59c640 1 -- 172.21.15.45:0/1544806140 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721912873 0 0) 0x7ff7ac0c38d0 con 0x7ff7ac0c4690 2023-12-08T08:15:31.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7ff7aa59c640 1 -- 172.21.15.45:0/1544806140 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff798003520 con 0x7ff7ac0c4690 2023-12-08T08:15:31.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7f708e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7090151930 0x7f70900c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54878/0 (socket says 172.21.15.45:54878) 2023-12-08T08:15:31.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7f708e59c640 1 -- 172.21.15.45:0/3319670883 learned_addr learned my addr 172.21.15.45:0/3319670883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.667+0000 7f708ed9d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70900ca630 0x7f70900c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f9d726ea640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d6c0beef0 0x7f9d6c0bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708dd9b640 1 --2- 172.21.15.45:0/3319670883 >> v2:172.21.15.114:3300/0 conn(0x7f70900c7ac0 0x7f70900ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f9d726ea640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f9d726ea640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0c0250 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f9d726ea640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c0a9e30 con 0x7f9d6c0beef0 2023-12-08T08:15:31.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f9d726ea640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0aa0b0 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708e59c640 1 -- 172.21.15.45:0/3319670883 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70900ca630 msgr2=0x7f70900c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708e59c640 1 --2- 172.21.15.45:0/3319670883 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70900ca630 0x7f70900c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708e59c640 1 -- 172.21.15.45:0/3319670883 >> v2:172.21.15.114:3300/0 conn(0x7f70900c7ac0 msgr2=0x7f70900ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708e59c640 1 --2- 172.21.15.45:0/3319670883 >> v2:172.21.15.114:3300/0 conn(0x7f70900c7ac0 0x7f70900ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7f708e59c640 1 -- 172.21.15.45:0/3319670883 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090154e10 con 0x7f7090151930 2023-12-08T08:15:31.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7ff7a3fff640 1 -- 172.21.15.45:0/1544806140 >> v1:172.21.15.114:6789/0 conn(0x7ff7ac0c4690 legacy=0x7ff7ac0a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7ff7a3fff640 1 -- 172.21.15.45:0/1544806140 >> v1:172.21.15.45:6789/0 conn(0x7ff7ac06df90 legacy=0x7ff7ac0c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.668+0000 7ff7a3fff640 1 -- 172.21.15.45:0/1544806140 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0c3e90 con 0x7ff7ac0c0330 2023-12-08T08:15:31.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7f9d71ee9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7f9d71ee9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40822/0 (socket says 172.21.15.45:40822) 2023-12-08T08:15:31.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7ff7a3fff640 1 --2- 172.21.15.45:0/1544806140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac164e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7940097d0 tx=0x7ff79402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282c7e226168c9fb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7f9d71ee9640 1 -- 172.21.15.45:0/1145887157 learned_addr learned my addr 172.21.15.45:0/1145887157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7f04affff640 1 Processor -- start 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97959a640 1 -- 172.21.15.45:0/1023076403 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205231729 0 0) 0x7ff97c151fc0 con 0x7ff97c0c4c30 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97959a640 1 -- 172.21.15.45:0/1023076403 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff964003520 con 0x7ff97c0c4c30 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1023076403 >> v2:172.21.15.45:3300/0 conn(0x7ff97c151be0 msgr2=0x7ff97c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97ad9d640 1 --2- 172.21.15.45:0/1023076403 >> v2:172.21.15.45:3300/0 conn(0x7ff97c151be0 0x7ff97c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1023076403 >> v1:172.21.15.45:6789/0 conn(0x7ff97c0c4c30 legacy=0x7ff97c0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.669+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1023076403 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c154750 con 0x7ff97c0c8910 2023-12-08T08:15:31.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7f9d716e8640 1 --2- 172.21.15.45:0/1145887157 >> v2:172.21.15.114:3300/0 conn(0x7f9d6c0beef0 0x7f9d6c0bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7ff7aa59c640 1 -- 172.21.15.45:0/1544806140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79402d040 con 0x7ff7ac0c0330 2023-12-08T08:15:31.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7ff7aa59c640 1 -- 172.21.15.45:0/1544806140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794031810 con 0x7ff7ac0c0330 2023-12-08T08:15:31.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7ff7aa59c640 1 -- 172.21.15.45:0/1544806140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794031ba0 con 0x7ff7ac0c0330 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f9d71ee9640 1 -- 172.21.15.45:0/1145887157 >> v2:172.21.15.114:3300/0 conn(0x7f9d6c0beef0 msgr2=0x7f9d6c0bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/1145887157 >> v2:172.21.15.114:3300/0 conn(0x7f9d6c0beef0 0x7f9d6c0bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f9d71ee9640 1 -- 172.21.15.45:0/1145887157 >> v1:172.21.15.114:6789/0 conn(0x7f9d6c0a4fa0 legacy=0x7f9d6c154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f9d71ee9640 1 -- 172.21.15.45:0/1145887157 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c0aa390 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f708e59c640 1 --2- 172.21.15.45:0/3319670883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7090151930 0x7f70900c7fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70900c7710 tx=0x7f7080034150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45f28c5d561e171 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.670+0000 7f04affff640 1 -- start start 2023-12-08T08:15:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7f708d59a640 1 -- 172.21.15.45:0/3319670883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708003c440 con 0x7f7090151930 2023-12-08T08:15:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.671+0000 7ff7b11a9640 1 -- 172.21.15.45:0/1544806140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 msgr2=0x7ff7ac164e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7ff7b11a9640 1 --2- 172.21.15.45:0/1544806140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac164e40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7940097d0 tx=0x7ff79402b8b0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7ff7b11a9640 1 -- 172.21.15.45:0/1544806140 shutdown_connections 2023-12-08T08:15:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7ff7b11a9640 1 --2- 172.21.15.45:0/1544806140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac164e40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7ff7b11a9640 1 -- 172.21.15.45:0/1544806140 >> 172.21.15.45:0/1544806140 conn(0x7ff7ac0c5b10 msgr2=0x7ff7ac0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7ff97ad9d640 1 --2- 172.21.15.45:0/1023076403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c0c8dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0c9c10 tx=0x7ff97002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e088bdf0e0c2da server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7f708d59a640 1 -- 172.21.15.45:0/3319670883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708003c5a0 con 0x7f7090151930 2023-12-08T08:15:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7ff7b11a9640 1 -- 172.21.15.45:0/1544806140 shutdown_connections 2023-12-08T08:15:31.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a800fcc0 0x7f04a80cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a80506f0 0x7f04a80db690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.672+0000 7f708d59a640 1 -- 172.21.15.45:0/3319670883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708003c970 con 0x7f7090151930 2023-12-08T08:15:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7ff97959a640 1 -- 172.21.15.45:0/1023076403 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970031830 con 0x7ff97c0c8910 2023-12-08T08:15:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a80d78f0 0x7f04a8033fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80dd8c0 con 0x7f04a80d78f0 2023-12-08T08:15:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7ff97959a640 1 -- 172.21.15.45:0/1023076403 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970031990 con 0x7ff97c0c8910 2023-12-08T08:15:31.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7ff97959a640 1 -- 172.21.15.45:0/1023076403 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970031d00 con 0x7ff97c0c8910 2023-12-08T08:15:31.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80cd420 con 0x7f04a80506f0 2023-12-08T08:15:31.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04affff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8034dd0 con 0x7f04a800fcc0 2023-12-08T08:15:31.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f70949a9640 1 -- 172.21.15.45:0/3319670883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7090151930 msgr2=0x7f70900c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f70949a9640 1 --2- 172.21.15.45:0/3319670883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7090151930 0x7f70900c7fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70900c7710 tx=0x7f7080034150 comp rx=0 tx=0).stop 2023-12-08T08:15:31.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/1145887157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009870 tx=0x7f9d5c02b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bec50075f43154fb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 -- 172.21.15.45:0/1023076403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 msgr2=0x7ff97c0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 --2- 172.21.15.45:0/1023076403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c0c8dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0c9c10 tx=0x7ff97002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 -- 172.21.15.45:0/1023076403 shutdown_connections 2023-12-08T08:15:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 --2- 172.21.15.45:0/1023076403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c0c8dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 --2- 172.21.15.45:0/1023076403 >> v2:172.21.15.45:3300/0 conn(0x7ff97c151be0 0x7ff97c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7ff980a94640 1 -- 172.21.15.45:0/1023076403 >> 172.21.15.45:0/1023076403 conn(0x7ff97c0ab8e0 msgr2=0x7ff97c0abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f9d63fff640 1 -- 172.21.15.45:0/1145887157 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c031740 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7ff7b11a9640 1 -- 172.21.15.45:0/1544806140 wait complete. 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f9d63fff640 1 -- 172.21.15.45:0/1145887157 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c0318a0 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f9d63fff640 1 -- 172.21.15.45:0/1145887157 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c031c30 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 -- 172.21.15.45:0/3319670883 shutdown_connections 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 --2- 172.21.15.45:0/3319670883 >> v2:172.21.15.114:3300/0 conn(0x7f70900c7ac0 0x7f70900ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 --2- 172.21.15.45:0/3319670883 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f70900ca630 0x7f70900c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 --2- 172.21.15.45:0/3319670883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7090151930 0x7f70900c7fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 -- 172.21.15.45:0/3319670883 >> 172.21.15.45:0/3319670883 conn(0x7f7090066610 msgr2=0x7f7090066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7ff980a94640 1 -- 172.21.15.45:0/1023076403 shutdown_connections 2023-12-08T08:15:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.673+0000 7f04aeffd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a800fcc0 0x7f04a80cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f04aeffd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a800fcc0 0x7f04a80cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40832/0 (socket says 172.21.15.45:40832) 2023-12-08T08:15:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f04aeffd640 1 -- 172.21.15.45:0/650053020 learned_addr learned my addr 172.21.15.45:0/650053020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f04ae7fc640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a80506f0 0x7f04a80db690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.674+0000 7f04af7fe640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a80d78f0 0x7f04a8033fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 -- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a800fcc0 msgr2=0x7f04a80cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04a800fcc0 0x7f04a80cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 -- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a80d78f0 msgr2=0x7f04a8033fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a80d78f0 0x7f04a8033fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009400 con 0x7f04a80506f0 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f04ae7fc640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a80506f0 0x7f04a80db690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04b004fd90 tx=0x7f04b0067ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7ff980a94640 1 -- 172.21.15.45:0/1023076403 wait complete. 2023-12-08T08:15:31.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.675+0000 7f70949a9640 1 -- 172.21.15.45:0/3319670883 shutdown_connections 2023-12-08T08:15:31.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f70949a9640 1 -- 172.21.15.45:0/3319670883 wait complete. 2023-12-08T08:15:31.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 -- 172.21.15.45:0/1145887157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 msgr2=0x7f9d6c0c0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7ff7b11a9640 1 Processor -- start 2023-12-08T08:15:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 --2- 172.21.15.45:0/1145887157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009870 tx=0x7f9d5c02b7e0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 -- 172.21.15.45:0/1145887157 shutdown_connections 2023-12-08T08:15:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 --2- 172.21.15.45:0/1145887157 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c0b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 --2- 172.21.15.45:0/1145887157 >> v2:172.21.15.114:3300/0 conn(0x7f9d6c0beef0 0x7f9d6c0bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f9d726ea640 1 -- 172.21.15.45:0/1145887157 >> 172.21.15.45:0/1145887157 conn(0x7f9d6c0a7600 msgr2=0x7f9d6c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b008f070 con 0x7f04a80506f0 2023-12-08T08:15:31.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a80312f0 con 0x7f04a80506f0 2023-12-08T08:15:31.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b006cdf0 con 0x7f04a80506f0 2023-12-08T08:15:31.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00730c0 con 0x7f04a80506f0 2023-12-08T08:15:31.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a8173b10 con 0x7f04a80506f0 2023-12-08T08:15:31.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.677+0000 7f9d726ea640 1 -- 172.21.15.45:0/1145887157 shutdown_connections 2023-12-08T08:15:31.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.676+0000 7ff7b11a9640 1 -- start start 2023-12-08T08:15:31.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.677+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04a80d6120 con 0x7f04a80506f0 2023-12-08T08:15:31.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.678+0000 7ff980a94640 1 Processor -- start 2023-12-08T08:15:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff980a94640 1 -- start start 2023-12-08T08:15:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7ac06df90 0x7ff7ac070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 0x7ff7ac200670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7f0f96dfb640 1 Processor -- start 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0720a0 con 0x7ff7ac0c0330 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac070b60 con 0x7ff7ac0c4690 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7b11a9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac2001b0 con 0x7ff7ac06df90 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7ab59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 0x7ff7ac200670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7a3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7aad9d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7ac06df90 0x7ff7ac070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7ab59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 0x7ff7ac200670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:35882/0 (socket says 172.21.15.45:35882) 2023-12-08T08:15:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7ff7ab59e640 1 -- 172.21.15.45:0/4030289178 learned_addr learned my addr 172.21.15.45:0/4030289178 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.680+0000 7f0f96dfb640 1 -- start start 2023-12-08T08:15:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.680+0000 7ff7ab59e640 1 -- 172.21.15.45:0/4030289178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7ac06df90 msgr2=0x7ff7ac070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.680+0000 7ff7ab59e640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7ac06df90 0x7ff7ac070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.680+0000 7ff7ab59e640 1 -- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 msgr2=0x7ff7ac071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff980a94640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff97c0c4c30 0x7ff97c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.679+0000 7f70949a9640 1 Processor -- start 2023-12-08T08:15:31.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff7ab59e640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff7ab59e640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009400 con 0x7ff7ac0c4690 2023-12-08T08:15:31.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.678+0000 7f9d726ea640 1 -- 172.21.15.45:0/1145887157 wait complete. 2023-12-08T08:15:31.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7f9d726ea640 1 Processor -- start 2023-12-08T08:15:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7efcba92c640 1 Processor -- start 2023-12-08T08:15:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff7a3fff640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ac0c0330 0x7ff7ac071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff980a94640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7f70949a9640 1 -- start start 2023-12-08T08:15:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7f9d726ea640 1 -- start start 2023-12-08T08:15:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04b0073220 con 0x7f04a80506f0 2023-12-08T08:15:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff7ab59e640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 0x7ff7ac200670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c740 tx=0x7ff7a400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7efcba92c640 1 -- start start 2023-12-08T08:15:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.681+0000 7ff980a94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 0x7ff97c146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 0x7ff97c146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 0x7ff97c146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54912/0 (socket says 172.21.15.45:54912) 2023-12-08T08:15:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1484524717 learned_addr learned my addr 172.21.15.45:0/1484524717 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff980a94640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c157c50 con 0x7ff97c151be0 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff980a94640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0af8c0 con 0x7ff97c0c8910 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff980a94640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c157e60 con 0x7ff97c0c4c30 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff97a59c640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff97c0c4c30 0x7ff97c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4006d50 con 0x7ff7ac0c4690 2023-12-08T08:15:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7f0f96dfb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f900c7e90 0x7f0f900c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400ce50 con 0x7ff7ac0c4690 2023-12-08T08:15:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4003bb0 con 0x7ff7ac0c4690 2023-12-08T08:15:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f04977fe640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f049c06ae70 0x7f049c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f9d726ea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 0x7f9d6c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7efcba92c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcb414ead0 0x7efcb4152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f9d726ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d6c0beef0 0x7f9d6c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f70949a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 0x7f70900aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d726ea640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f0f96dfb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f900c8910 0x7f0f900c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f0f96dfb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f90151fc0 con 0x7f0f90151be0 2023-12-08T08:15:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f0f96dfb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900c5170 con 0x7f0f900c7e90 2023-12-08T08:15:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f0f96dfb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f90154540 con 0x7f0f900c8910 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f0f8ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f900c7e90 0x7f0f900c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f0f8ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f900c7e90 0x7f0f900c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54914/0 (socket says 172.21.15.45:54914) 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f0f8ffff640 1 -- 172.21.15.45:0/3144006715 learned_addr learned my addr 172.21.15.45:0/3144006715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d716e8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 0x7f9d6c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d716e8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 0x7f9d6c14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:35886/0 (socket says 172.21.15.45:35886) 2023-12-08T08:15:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d716e8640 1 -- 172.21.15.45:0/3669040886 learned_addr learned my addr 172.21.15.45:0/3669040886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f70949a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70900ca630 0x7f7090143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14e370 con 0x7f9d6c0beef0 2023-12-08T08:15:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14deb0 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac070230 con 0x7ff7ac0c4690 2023-12-08T08:15:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac0707f0 con 0x7ff7ac0c4690 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c1560d0 con 0x7f9d6c0c06e0 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f70949a9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7090151930 0x7f7090144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.682+0000 7ff979d9b640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff97c0c4c30 msgr2=0x7ff97c1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7ff97ad9d640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff97c0c4c30 0x7ff97c1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 msgr2=0x7ff97c14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7ff97ad9d640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff97c0c8910 0x7ff97c14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970009400 con 0x7ff97c151be0 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f70949a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900c3fb0 con 0x7f70900c7ac0 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7efcba92c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb40c5fc0 0x7efcb40c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7efcba92c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb414eeb0 con 0x7efcb41553b0 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7efcba92c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40726d0 con 0x7efcb414ead0 2023-12-08T08:15:31.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7efcba92c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4151540 con 0x7efcb40c5fc0 2023-12-08T08:15:31.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.683+0000 7f0f94b97640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0f90151be0 0x7f0f900c46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51860/0 (socket says 172.21.15.45:51860) 2023-12-08T08:15:31.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f0f95398640 1 --2- 172.21.15.45:0/3144006715 >> v2:172.21.15.114:3300/0 conn(0x7f0f900c8910 0x7f0f900c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f70949a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901542d0 con 0x7f70900ca630 2023-12-08T08:15:31.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f70949a9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e9800 con 0x7f7090151930 2023-12-08T08:15:31.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f9d70ee7640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d6c0beef0 0x7f9d6c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04b0103270 con 0x7f04a80506f0 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f04aeffd640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f049c06ae70 0x7f049c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f04977fe640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7f049c0744b0 0x7f049c0768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7efcb3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcb414ead0 0x7efcb4152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7efcab7fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efcb41553b0 0x7efcb40c18f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:60172/0 (socket says 172.21.15.45:60172) 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7efcab7fe640 1 -- 172.21.15.45:0/182718251 learned_addr learned my addr 172.21.15.45:0/182718251 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.684+0000 7efcb8ec9640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb40c5fc0 0x7efcb40c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f049c076fc0 con 0x7f049c0744b0 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b0103620 con 0x7f04a80506f0 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f708dd9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70900ca630 0x7f7090143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f708ed9d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7090151930 0x7f7090144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7efcb3fff640 1 -- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb40c5fc0 msgr2=0x7efcb40c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7efcb3fff640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb40c5fc0 0x7efcb40c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7efcb3fff640 1 -- 172.21.15.45:0/182718251 >> v1:172.21.15.114:6789/0 conn(0x7efcb41553b0 legacy=0x7efcb40c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7efcb3fff640 1 -- 172.21.15.45:0/182718251 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4151820 con 0x7efcb414ead0 2023-12-08T08:15:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f0f8ffff640 1 -- 172.21.15.45:0/3144006715 >> v2:172.21.15.114:3300/0 conn(0x7f0f900c8910 msgr2=0x7f0f900c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f0f8ffff640 1 --2- 172.21.15.45:0/3144006715 >> v2:172.21.15.114:3300/0 conn(0x7f0f900c8910 0x7f0f900c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f0f8ffff640 1 -- 172.21.15.45:0/3144006715 >> v1:172.21.15.45:6789/0 conn(0x7f0f90151be0 legacy=0x7f0f900c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7f0f8ffff640 1 -- 172.21.15.45:0/3144006715 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90154750 con 0x7f0f900c7e90 2023-12-08T08:15:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.685+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7ac06e420 con 0x7ff7ac0c4690 2023-12-08T08:15:31.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7f708e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 0x7f70900aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7f708e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 0x7f70900aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54934/0 (socket says 172.21.15.45:54934) 2023-12-08T08:15:31.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7f708e59c640 1 -- 172.21.15.45:0/3477795680 learned_addr learned my addr 172.21.15.45:0/3477795680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7f04aeffd640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f049c06ae70 0x7f049c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04a4006fd0 tx=0x7f04a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 -- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7090151930 msgr2=0x7f7090144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7090151930 0x7f7090144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 -- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70900ca630 msgr2=0x7f7090143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70900ca630 0x7f7090143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800094d0 con 0x7f70900c7ac0 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708ed9d640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7090151930 0x7f7090144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708dd9b640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70900ca630 0x7f7090143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7ff97ad9d640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 0x7ff97c146fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff970009890 tx=0x7ff9700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970032e90 con 0x7ff97c151be0 2023-12-08T08:15:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970048070 con 0x7ff97c151be0 2023-12-08T08:15:31.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.686+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970044a70 con 0x7ff97c151be0 2023-12-08T08:15:31.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f04af7fe640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7f049c0744b0 0x7f049c0768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f0f8ffff640 1 --2- 172.21.15.45:0/3144006715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f900c7e90 0x7f0f900c8310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f900c8850 tx=0x7f0f8802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8eb56e1e1dce7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f9d716e8640 1 -- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 msgr2=0x7f9d6c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7f708e59c640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 0x7f70900aa2e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f70800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7ff980a94640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c156740 con 0x7ff97c151be0 2023-12-08T08:15:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.687+0000 7efcb3fff640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb414ead0 0x7efcb4152020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b850 tx=0x7efc9c02be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87003c5a252339d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f9d716e8640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7ff980a94640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c1583e0 con 0x7ff97c151be0 2023-12-08T08:15:31.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f9d716e8640 1 -- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d6c0beef0 msgr2=0x7f9d6c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f9d716e8640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d6c0beef0 0x7f9d6c06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f0f8f7fe640 1 -- 172.21.15.45:0/3144006715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8802ca80 con 0x7f0f900c7e90 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f0f8f7fe640 1 -- 172.21.15.45:0/3144006715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8802cbe0 con 0x7f0f900c7e90 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f0f8f7fe640 1 -- 172.21.15.45:0/3144006715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880343f0 con 0x7f0f900c7e90 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708003c440 con 0x7f70900c7ac0 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f70949a9640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70901e9ae0 con 0x7f70900c7ac0 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708003ce90 con 0x7f70900c7ac0 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708003ade0 con 0x7f70900c7ac0 2023-12-08T08:15:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f9d716e8640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0094d0 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d6c0c06e0 0x7f9d6c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7f9d70ee7640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d6c0beef0 0x7f9d6c06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff97c154ff0 con 0x7ff97c151be0 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7f0f96dfb640 1 -- 172.21.15.45:0/3144006715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f900c7e90 msgr2=0x7f0f900c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/3144006715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f900c7e90 0x7f0f900c8310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f900c8850 tx=0x7f0f8802bee0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.688+0000 7f70949a9640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70900ac1c0 con 0x7f70900c7ac0 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7efcb37fe640 1 -- 172.21.15.45:0/182718251 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02cc20 con 0x7efcb414ead0 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7efcb37fe640 1 -- 172.21.15.45:0/182718251 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c02cd80 con 0x7efcb414ead0 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7efcb37fe640 1 -- 172.21.15.45:0/182718251 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c034660 con 0x7efcb414ead0 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7f0f96dfb640 1 -- 172.21.15.45:0/3144006715 shutdown_connections 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/3144006715 >> v2:172.21.15.114:3300/0 conn(0x7f0f900c8910 0x7f0f900c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/3144006715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f900c7e90 0x7f0f900c8310 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7f0f96dfb640 1 -- 172.21.15.45:0/3144006715 >> 172.21.15.45:0/3144006715 conn(0x7f0f900ab8e0 msgr2=0x7f0f900abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.689+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7a4003d10 con 0x7ff7ac0c4690 2023-12-08T08:15:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7f9d716e8640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 0x7f9d6c14d4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007e40 tx=0x7f9d6400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f0f96dfb640 1 -- 172.21.15.45:0/3144006715 shutdown_connections 2023-12-08T08:15:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64014620 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400ee90 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640149c0 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7efcba92c640 1 -- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb414ead0 msgr2=0x7efcb4152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f0f96dfb640 1 -- 172.21.15.45:0/3144006715 wait complete. 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7efcba92c640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb414ead0 0x7efcb4152020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b850 tx=0x7efc9c02be70 comp rx=0 tx=0).stop 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.690+0000 7ff7a37fe640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff78c06af10 0x7ff78c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7a408a0c0 con 0x7ff7ac0c4690 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7ff7a37fe640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7ff78c074550 0x7ff78c076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff78c077060 con 0x7ff78c074550 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7a408a470 con 0x7ff7ac0c4690 2023-12-08T08:15:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f04af7fe640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7f049c0744b0 0x7f049c0768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f709014d590 con 0x7f70900c7ac0 2023-12-08T08:15:31.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.692+0000 7ff7a3fff640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7ff78c074550 0x7ff78c076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.691+0000 7f342ab53640 1 Processor -- start 2023-12-08T08:15:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.692+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c155560 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.692+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c14fe90 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7efcba92c640 1 -- 172.21.15.45:0/182718251 shutdown_connections 2023-12-08T08:15:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7ff7aad9d640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff78c06af10 0x7ff78c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff970044bd0 con 0x7ff97c151be0 2023-12-08T08:15:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== osd.0 v2:172.21.15.45:6800/672344515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f049c076fc0 con 0x7f049c0744b0 2023-12-08T08:15:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7080043040 con 0x7f70900c7ac0 2023-12-08T08:15:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7ff7a3fff640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7ff78c074550 0x7ff78c076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7efcba92c640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb40c5fc0 0x7efcb40c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7efcba92c640 1 --2- 172.21.15.45:0/182718251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb414ead0 0x7efcb4152020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.693+0000 7efcba92c640 1 -- 172.21.15.45:0/182718251 >> 172.21.15.45:0/182718251 conn(0x7efcb4066a70 msgr2=0x7efcb40a86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f0f96dfb640 1 Processor -- start 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f0f96dfb640 1 -- start start 2023-12-08T08:15:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7ff7aad9d640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff78c06af10 0x7ff78c06d3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0011e0 tx=0x7ff79c007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.692+0000 7f342ab53640 1 -- start start 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f342ab53640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c52e0 0x7f34240c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f342ab53640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3424159200 0x7f34240c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f342ab53640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3424159670 con 0x7f34240c23c0 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f342ab53640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240c4ad0 con 0x7f3424159200 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f342ab53640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342406ccc0 con 0x7f34240c52e0 2023-12-08T08:15:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7efcba92c640 1 -- 172.21.15.45:0/182718251 shutdown_connections 2023-12-08T08:15:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7efcba92c640 1 -- 172.21.15.45:0/182718251 wait complete. 2023-12-08T08:15:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f34288ef640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f34240c23c0 0x7f34240c3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51872/0 (socket says 172.21.15.45:51872) 2023-12-08T08:15:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f34288ef640 1 -- 172.21.15.45:0/2937114084 learned_addr learned my addr 172.21.15.45:0/2937114084 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.694+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d6c1553e0 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== osd.3 v2:172.21.15.45:6824/1638448391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff78c077060 con 0x7ff78c074550 2023-12-08T08:15:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 0x7f0f9014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f34290f0640 1 --2- 172.21.15.45:0/2937114084 >> v2:172.21.15.114:3300/0 conn(0x7f3424159200 0x7f34240c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f90151be0 0x7f0f900c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f900c33a0 0x7f0f901f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90158620 con 0x7f0f90151be0 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9014b1c0 con 0x7f0f900c33a0 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f0f96dfb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9014b6d0 con 0x7f0f900c8910 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f0f94b97640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 0x7f0f9014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f0f95398640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f900c33a0 0x7f0f901f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f3423fff640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c52e0 0x7f34240c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.695+0000 7f707effd640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f707006ae40 0x7f707006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70800b4520 con 0x7f70900c7ac0 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f707effd640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f7070074480 0x7f70700768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7070076f90 con 0x7f7070074480 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70800b6b40 con 0x7f70900c7ac0 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f0f94b97640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 0x7f0f9014e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40888/0 (socket says 172.21.15.45:40888) 2023-12-08T08:15:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f0f94b97640 1 -- 172.21.15.45:0/2919960063 learned_addr learned my addr 172.21.15.45:0/2919960063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f708ed9d640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f7070074480 0x7f70700768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d64014b20 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7f708ed9d640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f7070074480 0x7f70700768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7f708dd9b640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f707006ae40 0x7f707006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7efcba92c640 1 Processor -- start 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7efcba92c640 1 -- start start 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f0f94b97640 1 -- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f900c33a0 msgr2=0x7f0f901f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f0f94b97640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f900c33a0 0x7f0f901f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f0f94b97640 1 -- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f90151be0 msgr2=0x7f0f900c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f0f94b97640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f90151be0 0x7f0f900c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7f0f94b97640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88009b30 con 0x7f0f900c8910 2023-12-08T08:15:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7f0f94b97640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 0x7f0f9014e3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000b410 tx=0x7f0f8000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.697+0000 7ff96affd640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff95c06ae90 0x7ff95c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff97004a070 con 0x7ff97c151be0 2023-12-08T08:15:31.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7ff96affd640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7ff95c074360 0x7ff95c0767a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff95c076e70 con 0x7ff95c074360 2023-12-08T08:15:31.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.698+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9700b48d0 con 0x7ff97c151be0 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f9d61ffb640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d5006af40 0x7f9d5006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d6408a220 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f9d61ffb640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f9d50074500 0x7f9d50076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d50077010 con 0x7f9d50074500 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80011830 con 0x7f0f900c8910 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80011990 con 0x7f0f900c8910 2023-12-08T08:15:31.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80011d80 con 0x7f0f900c8910 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f34290f0640 1 -- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c52e0 msgr2=0x7f34240c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f34290f0640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c52e0 0x7f34240c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f34237fe640 1 -- 172.21.15.45:0/2937114084 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314596350 0 0) 0x7f3424159670 con 0x7f34240c23c0 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f34290f0640 1 -- 172.21.15.45:0/2937114084 >> v1:172.21.15.45:6789/0 conn(0x7f34240c23c0 legacy=0x7f34240c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.696+0000 7f34290f0640 1 -- 172.21.15.45:0/2937114084 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342406d7f0 con 0x7f3424159200 2023-12-08T08:15:31.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== osd.2 v2:172.21.15.45:6810/1587878241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7070076f90 con 0x7f7070074480 2023-12-08T08:15:31.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7ff979d9b640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7ff95c074360 0x7ff95c0767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.699+0000 7f708dd9b640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f707006ae40 0x7f707006d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70900bcfe0 tx=0x7f7084008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 0x7efcb414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7ff97a59c640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff95c06ae90 0x7ff95c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7ff979d9b640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7ff95c074360 0x7ff95c0767a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f9d50074500 0x7f9d50076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7f9d70ee7640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d5006af40 0x7f9d5006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9014b3f0 con 0x7f0f900c8910 2023-12-08T08:15:31.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900c2940 con 0x7f0f900c8910 2023-12-08T08:15:31.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7f9d71ee9640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f9d50074500 0x7f9d50076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7f34290f0640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f34240c4590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f341c009dc0 tx=0x7f341c02be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29af758655dc38ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d64054fc0 con 0x7f9d6c0a4fa0 2023-12-08T08:15:31.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== osd.1 v2:172.21.15.45:6808/1115540168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff95c076e70 con 0x7ff95c074360 2023-12-08T08:15:31.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7ff97a59c640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff95c06ae90 0x7ff95c06d350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9740073f0 tx=0x7ff97400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb414ead0 0x7efcb4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb41553b0 0x7efcb406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4148ed0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41509f0 con 0x7efcb41553b0 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.700+0000 7efcba92c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4149120 con 0x7efcb414ead0 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 0x7efcb414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 0x7efcb414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54964/0 (socket says 172.21.15.45:54964) 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.701+0000 7efcb3fff640 1 -- 172.21.15.45:0/728627130 learned_addr learned my addr 172.21.15.45:0/728627130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 -- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb414ead0 msgr2=0x7efcb4153b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efcb414ead0 0x7efcb4153b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 -- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb41553b0 msgr2=0x7efcb406d590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb41553b0 0x7efcb406d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c00b4b0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7f34237fe640 1 -- 172.21.15.45:0/2937114084 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c02cbb0 con 0x7f3424159200 2023-12-08T08:15:31.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7f34237fe640 1 -- 172.21.15.45:0/2937114084 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c02cd10 con 0x7f3424159200 2023-12-08T08:15:31.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7f34237fe640 1 -- 172.21.15.45:0/2937114084 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c02cbb0 con 0x7f3424159200 2023-12-08T08:15:31.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.702+0000 7efcb3fff640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 0x7efcb414f330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b850 tx=0x7efc9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7f9d70ee7640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d5006af40 0x7f9d5006d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d68006fd0 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c040450 con 0x7efcb40c5fc0 2023-12-08T08:15:31.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c0405b0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c040940 con 0x7efcb40c5fc0 2023-12-08T08:15:31.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb4149400 con 0x7efcb40c5fc0 2023-12-08T08:15:31.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.703+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40c36b0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f90154ff0 con 0x7f0f900c8910 2023-12-08T08:15:31.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== osd.4 v2:172.21.15.114:6824/257103469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9d50077010 con 0x7f9d50074500 2023-12-08T08:15:31.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcb40a86d0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc9c040aa0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7efcb17fa640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc9406af10 0x7efc9406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f342ab53640 1 -- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 msgr2=0x7f34240c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f342ab53640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f34240c4590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f341c009dc0 tx=0x7f341c02be00 comp rx=0 tx=0).stop 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f342ab53640 1 -- 172.21.15.45:0/2937114084 shutdown_connections 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.704+0000 7f342ab53640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f34240c4590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.705+0000 7f342ab53640 1 --2- 172.21.15.45:0/2937114084 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c52e0 0x7f34240c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.705+0000 7f342ab53640 1 -- 172.21.15.45:0/2937114084 >> 172.21.15.45:0/2937114084 conn(0x7f3424066db0 msgr2=0x7f34240c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.705+0000 7f342ab53640 1 -- 172.21.15.45:0/2937114084 shutdown_connections 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.705+0000 7f342ab53640 1 -- 172.21.15.45:0/2937114084 wait complete. 2023-12-08T08:15:31.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc9c0ac8c0 con 0x7efcb40c5fc0 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7efcb17fa640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7efc94074550 0x7efc94076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc94077060 con 0x7efc94074550 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc9c0acc70 con 0x7efcb40c5fc0 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.705+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f8001a400 con 0x7f0f900c8910 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7f0f8d7fa640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f7006ae40 0x7f0f7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f80089b80 con 0x7f0f900c8910 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7f0f8d7fa640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f0f70074400 0x7f0f70076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f70076f10 con 0x7f0f70074400 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.707+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f8008e2a0 con 0x7f0f900c8910 2023-12-08T08:15:31.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7f0f8ffff640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f7006ae40 0x7f0f7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7efcab7fe640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc9406af10 0x7efc9406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.709+0000 7f0f95398640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f0f70074400 0x7f0f70076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.709+0000 7efcb8ec9640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7efc94074550 0x7efc94076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.708+0000 7f342ab53640 1 Processor -- start 2023-12-08T08:15:31.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.710+0000 7f0f8ffff640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f7006ae40 0x7f0f7006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f88035000 tx=0x7f0f8802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.710+0000 7efcb8ec9640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7efc94074550 0x7efc94076990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.710+0000 7efcab7fe640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc9406af10 0x7efc9406d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcb41543a0 tx=0x7efca4007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.710+0000 7f0f95398640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f0f70074400 0x7f0f70076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.710+0000 7f342ab53640 1 -- start start 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c23c0 0x7f3424153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 0x7f3424152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f3424143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342413e120 con 0x7f34240c52e0 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342413c6d0 con 0x7f3424159200 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f342ab53640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34241540d0 con 0x7f34240c23c0 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f3423fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 0x7f3424152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f3423fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 0x7f3424152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54968/0 (socket says 172.21.15.45:54968) 2023-12-08T08:15:31.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f3423fff640 1 -- 172.21.15.45:0/1020382507 learned_addr learned my addr 172.21.15.45:0/1020382507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:31.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== osd.6 v2:172.21.15.114:6802/345910373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0f70076f10 con 0x7f0f70074400 2023-12-08T08:15:31.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f34290f0640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f3424143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.712+0000 7f34288ef640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c23c0 0x7f3424153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f3423fff640 1 -- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c23c0 msgr2=0x7f3424153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f3423fff640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f34240c23c0 0x7f3424153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f3423fff640 1 -- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 msgr2=0x7f3424143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f3423fff640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3424159200 0x7f3424143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7f3423fff640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009a70 con 0x7f34240c52e0 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.714+0000 7f3423fff640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 0x7f3424152c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f341800c7f0 tx=0x7f341800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.713+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== osd.5 v2:172.21.15.114:6816/1412870860 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efcac01a960 con 0x7efc94074550 2023-12-08T08:15:31.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.714+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418004220 con 0x7f34240c52e0 2023-12-08T08:15:31.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.714+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180043a0 con 0x7f34240c52e0 2023-12-08T08:15:31.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.714+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418007860 con 0x7f34240c52e0 2023-12-08T08:15:31.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.714+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342413c970 con 0x7f34240c52e0 2023-12-08T08:15:31.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.715+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342413e370 con 0x7f34240c52e0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.716+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f342406dd70 con 0x7f34240c52e0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.720+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34180079c0 con 0x7f34240c52e0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.721+0000 7f34217fa640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f341006ae90 0x7f341006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.722+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3418089a40 con 0x7f34240c52e0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.723+0000 7f34217fa640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7f34100744d0 0x7f3410076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.723+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3410076fe0 con 0x7f34100744d0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.723+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3418089ee0 con 0x7f34240c52e0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.723+0000 7f34288ef640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f341006ae90 0x7f341006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.724+0000 7f34288ef640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f341006ae90 0x7f341006d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3414007fd0 tx=0x7f3414007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.725+0000 7f34290f0640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7f34100744d0 0x7f3410076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.726+0000 7f34290f0640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7f34100744d0 0x7f3410076910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:31.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.728+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 --> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04a804c270 con 0x7f049c0744b0 2023-12-08T08:15:31.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.729+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== osd.7 v2:172.21.15.114:6800/1867013460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3410076fe0 con 0x7f34100744d0 2023-12-08T08:15:31.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.730+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 --> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7ac070d10 con 0x7ff78c074550 2023-12-08T08:15:31.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.731+0000 7f04977fe640 1 -- 172.21.15.45:0/650053020 <== osd.0 v2:172.21.15.45:6800/672344515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04a0040b40 con 0x7f049c0744b0 2023-12-08T08:15:31.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.731+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7f049c0744b0 msgr2=0x7f049c0768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.731+0000 7f04affff640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7f049c0744b0 0x7f049c0768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.732+0000 7ff7a37fe640 1 -- 172.21.15.45:0/4030289178 <== osd.3 v2:172.21.15.45:6824/1638448391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7ac070d10 con 0x7ff78c074550 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.732+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7ff78c074550 msgr2=0x7ff78c076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.732+0000 7ff7b11a9640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7ff78c074550 0x7ff78c076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff78c06af10 msgr2=0x7ff78c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff78c06af10 0x7ff78c06d3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0011e0 tx=0x7ff79c007d30 comp rx=0 tx=0).stop 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 msgr2=0x7ff7ac200670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 --2- 172.21.15.45:0/4030289178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7ac0c4690 0x7ff7ac200670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c740 tx=0x7ff7a400cc00 comp rx=0 tx=0).stop 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7ab59e640 1 -- 172.21.15.45:0/4030289178 reap_dead start 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 shutdown_connections 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 >> 172.21.15.45:0/4030289178 conn(0x7ff7ac0c5b10 msgr2=0x7ff7ac164060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.733+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 shutdown_connections 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f049c06ae70 msgr2=0x7f049c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f049c06ae70 0x7f049c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f04a4006fd0 tx=0x7f04a4008040 comp rx=0 tx=0).stop 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a80506f0 msgr2=0x7f04a80db690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 --2- 172.21.15.45:0/650053020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04a80506f0 0x7f04a80db690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f04b004fd90 tx=0x7f04b0067ec0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04af7fe640 1 -- 172.21.15.45:0/650053020 reap_dead start 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 shutdown_connections 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 >> 172.21.15.45:0/650053020 conn(0x7f04a804fbd0 msgr2=0x7f04a804cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7ff7b11a9640 1 -- 172.21.15.45:0/4030289178 wait complete. 2023-12-08T08:15:31.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 shutdown_connections 2023-12-08T08:15:31.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 --> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70901e9970 con 0x7f7070074480 2023-12-08T08:15:31.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.735+0000 7f04affff640 1 -- 172.21.15.45:0/650053020 wait complete. 2023-12-08T08:15:31.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.736+0000 7f707effd640 1 -- 172.21.15.45:0/3477795680 <== osd.2 v2:172.21.15.45:6810/1587878241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70901e9970 con 0x7f7070074480 2023-12-08T08:15:31.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.737+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 --> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff97c154d10 con 0x7ff95c074360 2023-12-08T08:15:31.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.737+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 --> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d6c0bf810 con 0x7f9d50074500 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.737+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f7070074480 msgr2=0x7f70700768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.737+0000 7f707cff9640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f7070074480 0x7f70700768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f707006ae40 msgr2=0x7f707006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7ff96affd640 1 -- 172.21.15.45:0/1484524717 <== osd.1 v2:172.21.15.45:6808/1115540168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff95c076e70 con 0x7ff95c074360 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f707cff9640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f707006ae40 0x7f707006d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70900bcfe0 tx=0x7f7084008040 comp rx=0 tx=0).stop 2023-12-08T08:15:31.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 msgr2=0x7f70900aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f707cff9640 1 --2- 172.21.15.45:0/3477795680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70900c7ac0 0x7f70900aa2e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f70800046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f9d61ffb640 1 -- 172.21.15.45:0/3669040886 <== osd.4 v2:172.21.15.114:6824/257103469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d5c031b90 con 0x7f9d50074500 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.738+0000 7f708ed9d640 1 -- 172.21.15.45:0/3477795680 reap_dead start 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 shutdown_connections 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 >> 172.21.15.45:0/3477795680 conn(0x7f7090066610 msgr2=0x7f7090150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 shutdown_connections 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f707cff9640 1 -- 172.21.15.45:0/3477795680 wait complete. 2023-12-08T08:15:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f9d50074500 msgr2=0x7f9d50076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7f9d726ea640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f9d50074500 0x7f9d50076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7ff95c074360 msgr2=0x7ff95c0767a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.739+0000 7ff968ff9640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7ff95c074360 0x7ff95c0767a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff95c06ae90 msgr2=0x7ff95c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff95c06ae90 0x7ff95c06d350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9740073f0 tx=0x7ff97400b040 comp rx=0 tx=0).stop 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 msgr2=0x7ff97c146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 --2- 172.21.15.45:0/1484524717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff97c151be0 0x7ff97c146fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff970009890 tx=0x7ff9700046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff97ad9d640 1 -- 172.21.15.45:0/1484524717 reap_dead start 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 shutdown_connections 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 >> 172.21.15.45:0/1484524717 conn(0x7ff97c0ab8e0 msgr2=0x7ff97c06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d5006af40 msgr2=0x7f9d5006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d5006af40 0x7f9d5006d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d68006fd0 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 msgr2=0x7f9d6c14d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 --2- 172.21.15.45:0/3669040886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d6c0a4fa0 0x7f9d6c14d4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007e40 tx=0x7f9d6400e4b0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d71ee9640 1 -- 172.21.15.45:0/3669040886 reap_dead start 2023-12-08T08:15:31.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 shutdown_connections 2023-12-08T08:15:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 >> 172.21.15.45:0/3669040886 conn(0x7f9d6c0a7600 msgr2=0x7f9d6c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 shutdown_connections 2023-12-08T08:15:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.740+0000 7f9d726ea640 1 -- 172.21.15.45:0/3669040886 wait complete. 2023-12-08T08:15:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.744+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 shutdown_connections 2023-12-08T08:15:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.745+0000 7ff968ff9640 1 -- 172.21.15.45:0/1484524717 wait complete. 2023-12-08T08:15:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.747+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 --> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcb40c6860 con 0x7efc94074550 2023-12-08T08:15:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.749+0000 7efcb17fa640 1 -- 172.21.15.45:0/728627130 <== osd.5 v2:172.21.15.114:6816/1412870860 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efcb40c6860 con 0x7efc94074550 2023-12-08T08:15:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.749+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 --> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f90154d10 con 0x7f0f70074400 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.749+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7efc94074550 msgr2=0x7efc94076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.749+0000 7efcba92c640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7efc94074550 0x7efc94076990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc9406af10 msgr2=0x7efc9406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc9406af10 0x7efc9406d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcb41543a0 tx=0x7efca4007a40 comp rx=0 tx=0).stop 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 msgr2=0x7efcb414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 --2- 172.21.15.45:0/728627130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcb40c5fc0 0x7efcb414f330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00b850 tx=0x7efc9c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcb8ec9640 1 -- 172.21.15.45:0/728627130 reap_dead start 2023-12-08T08:15:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 shutdown_connections 2023-12-08T08:15:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 >> 172.21.15.45:0/728627130 conn(0x7efcb4066a70 msgr2=0x7efcb40c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.750+0000 7f0f8d7fa640 1 -- 172.21.15.45:0/2919960063 <== osd.6 v2:172.21.15.114:6802/345910373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f78009400 con 0x7f0f70074400 2023-12-08T08:15:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f0f70074400 msgr2=0x7f0f70076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f0f70074400 0x7f0f70076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.751+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 shutdown_connections 2023-12-08T08:15:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.751+0000 7efcba92c640 1 -- 172.21.15.45:0/728627130 wait complete. 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f7006ae40 msgr2=0x7f0f7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f7006ae40 0x7f0f7006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f88035000 tx=0x7f0f8802e000 comp rx=0 tx=0).stop 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 msgr2=0x7f0f9014e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.752+0000 7f0f96dfb640 1 --2- 172.21.15.45:0/2919960063 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f900c8910 0x7f0f9014e3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000b410 tx=0x7f0f8000b8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.753+0000 7f0f95398640 1 -- 172.21.15.45:0/2919960063 reap_dead start 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.753+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 shutdown_connections 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.753+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 >> 172.21.15.45:0/2919960063 conn(0x7f0f900ab8e0 msgr2=0x7f0f90153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.755+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 shutdown_connections 2023-12-08T08:15:31.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.755+0000 7f0f96dfb640 1 -- 172.21.15.45:0/2919960063 wait complete. 2023-12-08T08:15:31.775 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:15:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.766+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 --> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f342406e050 con 0x7f34100744d0 2023-12-08T08:15:31.777 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.777 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:15:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.767+0000 7f34217fa640 1 -- 172.21.15.45:0/1020382507 <== osd.7 v2:172.21.15.114:6800/1867013460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f341c034440 con 0x7f34100744d0 2023-12-08T08:15:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.768+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7f34100744d0 msgr2=0x7f3410076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.768+0000 7f342ab53640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7f34100744d0 0x7f3410076910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.778 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:31.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:15:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.768+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f341006ae90 msgr2=0x7f341006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.768+0000 7f342ab53640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f341006ae90 0x7f341006d350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3414007fd0 tx=0x7f3414007de0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.780 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 msgr2=0x7f3424152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 --2- 172.21.15.45:0/1020382507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34240c52e0 0x7f3424152c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f341800c7f0 tx=0x7f341800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:15:31.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:15:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f34290f0640 1 -- 172.21.15.45:0/1020382507 reap_dead start 2023-12-08T08:15:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 shutdown_connections 2023-12-08T08:15:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 >> 172.21.15.45:0/1020382507 conn(0x7f3424066db0 msgr2=0x7f34240c3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 shutdown_connections 2023-12-08T08:15:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:31.769+0000 7f342ab53640 1 -- 172.21.15.45:0/1020382507 wait complete. 2023-12-08T08:15:31.782 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:15:31.783 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:15:31.785 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:15:31.787 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:31.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:15:32.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.081+0000 7f2891c10640 1 Processor -- start 2023-12-08T08:15:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.081+0000 7f2891c10640 1 -- start start 2023-12-08T08:15:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.083+0000 7f2891c10640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f288c0c45d0 0x7f288c154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.083+0000 7f2891c10640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c0c56c0 con 0x7f288c151c70 2023-12-08T08:15:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.083+0000 7f2891c10640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c0c4bd0 con 0x7f288c0c7d10 2023-12-08T08:15:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.083+0000 7f2891c10640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0c4eb0 con 0x7f288c0c45d0 2023-12-08T08:15:32.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.084+0000 7f288b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f288c151c70 0x7f288c158450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51874/0 (socket says 172.21.15.45:51874) 2023-12-08T08:15:32.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.084+0000 7f288b7fe640 1 -- 172.21.15.45:0/4034002611 learned_addr learned my addr 172.21.15.45:0/4034002611 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:32.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.084+0000 7f288affd640 1 --2- 172.21.15.45:0/4034002611 >> v2:172.21.15.114:3300/0 conn(0x7f288c0c45d0 0x7f288c154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.084+0000 7eff16f16640 1 Processor -- start 2023-12-08T08:15:32.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.085+0000 7eff16f16640 1 -- start start 2023-12-08T08:15:32.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.085+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578708838 0 0) 0x7f2884001490 con 0x7f288c151c70 2023-12-08T08:15:32.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.085+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2874003520 con 0x7f288c151c70 2023-12-08T08:15:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818038298 0 0) 0x7f288c0c4bd0 con 0x7f288c0c7d10 2023-12-08T08:15:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2884001490 con 0x7f288c0c7d10 2023-12-08T08:15:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227844465 0 0) 0x7f2874003520 con 0x7f288c151c70 2023-12-08T08:15:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 >> v2:172.21.15.114:3300/0 conn(0x7f288c0c45d0 msgr2=0x7f288c154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 --2- 172.21.15.45:0/4034002611 >> v2:172.21.15.114:3300/0 conn(0x7f288c0c45d0 0x7f288c154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 >> v1:172.21.15.114:6789/0 conn(0x7f288c0c7d10 legacy=0x7f288c0c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c1547a0 con 0x7f288c151c70 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f2884001b00 con 0x7f288c151c70 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 >> v1:172.21.15.45:6789/0 conn(0x7f288c151c70 legacy=0x7f288c158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2874003b00 0x7f2874003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 0x7f2874014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c4eb0 con 0x7f28740047c0 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2874005950 con 0x7f2874003b00 2023-12-08T08:15:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2874005b10 con 0x7f2874005180 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.086+0000 7eff16f16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff10151b10 0x7eff100c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.087+0000 7eff16f16640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10151ef0 con 0x7eff100c0c30 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.088+0000 7eff0ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff100c0c30 0x7eff100c2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51886/0 (socket says 172.21.15.45:51886) 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.088+0000 7eff0ffff640 1 -- 172.21.15.45:0/3684233801 learned_addr learned my addr 172.21.15.45:0/3684233801 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.088+0000 7eff16f16640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100c4d10 con 0x7eff10154460 2023-12-08T08:15:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.088+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100c4ff0 con 0x7eff10151b10 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.087+0000 7f288bfff640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 0x7f2874014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.088+0000 7f288affd640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7f288bfff640 1 -- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2874003b00 msgr2=0x7f2874003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7f288bfff640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2874003b00 0x7f2874003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7f288bfff640 1 -- 172.21.15.45:0/4034002611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28740047c0 msgr2=0x7f2874004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7f288bfff640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28740047c0 0x7f2874004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7f288bfff640 1 -- 172.21.15.45:0/4034002611 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c1547a0 con 0x7f2874005180 2023-12-08T08:15:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990245768 0 0) 0x7eff100c4d10 con 0x7eff10154460 2023-12-08T08:15:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.089+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8003520 con 0x7eff10154460 2023-12-08T08:15:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.090+0000 7eff14cb2640 1 --2- 172.21.15.45:0/3684233801 >> v2:172.21.15.45:3300/0 conn(0x7eff10151b10 0x7eff100c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067797458 0 0) 0x7eff10151ef0 con 0x7eff100c0c30 2023-12-08T08:15:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff100c4d10 con 0x7eff100c0c30 2023-12-08T08:15:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7f25cd15c640 1 Processor -- start 2023-12-08T08:15:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7f25cd15c640 1 -- start start 2023-12-08T08:15:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7eff14cb2640 1 -- 172.21.15.45:0/3684233801 >> v1:172.21.15.114:6789/0 conn(0x7eff10154460 legacy=0x7eff10154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7eff14cb2640 1 -- 172.21.15.45:0/3684233801 >> v1:172.21.15.45:6789/0 conn(0x7eff100c0c30 legacy=0x7eff100c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.091+0000 7eff14cb2640 1 -- 172.21.15.45:0/3684233801 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100c0410 con 0x7eff10151b10 2023-12-08T08:15:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.090+0000 7f288bfff640 1 -- 172.21.15.45:0/4034002611 reap_dead start 2023-12-08T08:15:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.093+0000 7eff14cb2640 1 --2- 172.21.15.45:0/3684233801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff10151b10 0x7eff100c4520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff000097a0 tx=0x7eff0002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51128535ec7a79 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.093+0000 7f288bfff640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 0x7f2874014190 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2880001910 tx=0x7f28740057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bed05b4846f34d60 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.093+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000317c0 con 0x7eff10151b10 2023-12-08T08:15:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.093+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00031920 con 0x7eff10151b10 2023-12-08T08:15:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.093+0000 7eff0f7fe640 1 -- 172.21.15.45:0/3684233801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00031cf0 con 0x7eff10151b10 2023-12-08T08:15:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff10151b10 msgr2=0x7eff100c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7eff16f16640 1 --2- 172.21.15.45:0/3684233801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff10151b10 0x7eff100c4520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff000097a0 tx=0x7eff0002b860 comp rx=0 tx=0).stop 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7f25cd15c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c0047470 0x7f25c0006e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7f25c77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c0047470 0x7f25c0006e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7f25c77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25c0047470 0x7f25c0006e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54988/0 (socket says 172.21.15.45:54988) 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 shutdown_connections 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7eff16f16640 1 --2- 172.21.15.45:0/3684233801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff10151b10 0x7eff100c4520 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff000097a0 tx=0x7eff0002b860 comp rx=0 tx=0).stop 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.094+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 >> 172.21.15.45:0/3684233801 conn(0x7eff100a79f0 msgr2=0x7eff100a7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 shutdown_connections 2023-12-08T08:15:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7eff16f16640 1 -- 172.21.15.45:0/3684233801 wait complete. 2023-12-08T08:15:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7f25c77fe640 1 -- 172.21.15.45:0/3812022947 learned_addr learned my addr 172.21.15.45:0/3812022947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880005310 con 0x7f2874005180 2023-12-08T08:15:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f288a7fc640 1 -- 172.21.15.45:0/4034002611 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880005470 con 0x7f2874005180 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.095+0000 7f25cd15c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c000a3f0 con 0x7f25c00073b0 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c000bb20 con 0x7f25c00dbcb0 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c0048030 con 0x7f25c0047470 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f25c77fe640 1 -- 172.21.15.45:0/3812022947 >> v1:172.21.15.114:6789/0 conn(0x7f25c00dbcb0 legacy=0x7f25c00df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f25c77fe640 1 -- 172.21.15.45:0/3812022947 >> v1:172.21.15.45:6789/0 conn(0x7f25c00073b0 legacy=0x7f25c000a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f25c77fe640 1 -- 172.21.15.45:0/3812022947 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c000a0c0 con 0x7f25c0047470 2023-12-08T08:15:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7eff16f16640 1 Processor -- start 2023-12-08T08:15:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7f25c77fe640 1 --2- 172.21.15.45:0/3812022947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c0006e70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a26b2b0fca1ef4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f2891c10640 1 -- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 msgr2=0x7f2874014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.096+0000 7f2891c10640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 0x7f2874014190 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2880001910 tx=0x7f28740057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7f2891c10640 1 -- 172.21.15.45:0/4034002611 shutdown_connections 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7f2891c10640 1 --2- 172.21.15.45:0/4034002611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2874005180 0x7f2874014190 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7f2891c10640 1 -- 172.21.15.45:0/4034002611 >> 172.21.15.45:0/4034002611 conn(0x7f288c0ab7c0 msgr2=0x7f288c0abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7f2891c10640 1 -- 172.21.15.45:0/4034002611 shutdown_connections 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.099+0000 7f2891c10640 1 -- 172.21.15.45:0/4034002611 wait complete. 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.099+0000 7f25c6ffd640 1 -- 172.21.15.45:0/3812022947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc031870 con 0x7f25c0047470 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.099+0000 7f25c6ffd640 1 -- 172.21.15.45:0/3812022947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0319d0 con 0x7f25c0047470 2023-12-08T08:15:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.099+0000 7f25c6ffd640 1 -- 172.21.15.45:0/3812022947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc031d60 con 0x7f25c0047470 2023-12-08T08:15:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.099+0000 7fdf8e9be640 1 Processor -- start 2023-12-08T08:15:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 msgr2=0x7f25c0006e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7f25cd15c640 1 --2- 172.21.15.45:0/3812022947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c0006e70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc02b910 comp rx=0 tx=0).stop 2023-12-08T08:15:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7fdf8e9be640 1 -- start start 2023-12-08T08:15:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.098+0000 7eff16f16640 1 -- start start 2023-12-08T08:15:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 0x7eff10153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 0x7eff101ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1014b890 con 0x7eff101449f0 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 shutdown_connections 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7f25cd15c640 1 --2- 172.21.15.45:0/3812022947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c0006e70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 >> 172.21.15.45:0/3812022947 conn(0x7f25c0048220 msgr2=0x7f25c0048630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7f2891c10640 1 Processor -- start 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7f2891c10640 1 -- start start 2023-12-08T08:15:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff101507b0 con 0x7eff10154460 2023-12-08T08:15:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7fdf8e9be640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7fdf8e9be640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf880ca0e0 0x7fdf880ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.100+0000 7eff16f16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff101eaee0 con 0x7eff100c0c30 2023-12-08T08:15:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 shutdown_connections 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7eff154b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7eff154b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55002/0 (socket says 172.21.15.45:55002) 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.101+0000 7eff154b3640 1 -- 172.21.15.45:0/2007421299 learned_addr learned my addr 172.21.15.45:0/2007421299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7eff154b3640 1 -- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 msgr2=0x7eff10153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7eff14cb2640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 0x7eff10153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7eff0ffff640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 0x7eff101ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff154b3640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 0x7eff10153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7fdf8e9be640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88155540 con 0x7fdf881581c0 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7fdf8e9be640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf880c4880 con 0x7fdf880ca0e0 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7fdf8e9be640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c4b60 con 0x7fdf8814e800 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff154b3640 1 -- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 msgr2=0x7eff101ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff154b3640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 0x7eff101ea460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff154b3640 1 -- 172.21.15.45:0/2007421299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009400 con 0x7eff101449f0 2023-12-08T08:15:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7f2891c10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f288c1522c0 0x7f288c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7f2891c10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7f2891c10640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f288c0c8a10 0x7f288c1e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7f2891c10640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c8e90 con 0x7f288c0ab160 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7f2891c10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0a96f0 con 0x7f288c1522c0 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7fdf7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf880ca0e0 0x7fdf880ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7f2891c10640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0a9f90 con 0x7f288c0c8a10 2023-12-08T08:15:32.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff154b3640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff0800cac0 tx=0x7eff0800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.102+0000 7f25cd15c640 1 -- 172.21.15.45:0/3812022947 wait complete. 2023-12-08T08:15:32.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.103+0000 7eff0ffff640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 0x7eff101ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:32.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7eff14cb2640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 0x7eff10153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08003b70 con 0x7eff101449f0 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08003cd0 con 0x7eff101449f0 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08003b70 con 0x7eff101449f0 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7f288b7fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f288c1522c0 0x7f288c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40916/0 (socket says 172.21.15.45:40916) 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7fdf87fff640 1 -- 172.21.15.45:0/378526894 learned_addr learned my addr 172.21.15.45:0/378526894 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff101e9f60 con 0x7eff101449f0 2023-12-08T08:15:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7f25cd15c640 1 Processor -- start 2023-12-08T08:15:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.104+0000 7f288affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7f288affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55026/0 (socket says 172.21.15.45:55026) 2023-12-08T08:15:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7f288affd640 1 -- 172.21.15.45:0/614567852 learned_addr learned my addr 172.21.15.45:0/614567852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1014baa0 con 0x7eff101449f0 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7f25cd15c640 1 -- start start 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288bfff640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f288c0c8a10 0x7f288c1e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288affd640 1 -- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f288c0c8a10 msgr2=0x7f288c1e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288affd640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f288c0c8a10 0x7f288c1e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288affd640 1 -- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f288c1522c0 msgr2=0x7f288c1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288affd640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f288c1522c0 0x7f288c1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.106+0000 7f288affd640 1 -- 172.21.15.45:0/614567852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0c9e50 con 0x7f288c0ab160 2023-12-08T08:15:32.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7f25cd15c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7f25cd15c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7f25cd15c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25c00dbcb0 0x7f25c0174250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/378526894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 msgr2=0x7fdf88155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7fdf7f7fe640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/378526894 >> v1:172.21.15.45:6789/0 conn(0x7fdf881581c0 legacy=0x7fdf880c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.105+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/378526894 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880c4e40 con 0x7fdf880ca0e0 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7fdf87fff640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff10067900 con 0x7eff101449f0 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7fc99fa61640 1 Processor -- start 2023-12-08T08:15:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7fc99fa61640 1 -- start start 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f25cd15c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c002eff0 con 0x7f25c0047470 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f25cd15c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c002e3c0 con 0x7f25c00073b0 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f25cd15c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0177c90 con 0x7f25c00dbcb0 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f25c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f288affd640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f287c011540 tx=0x7f287c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.108+0000 7f25c7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c015930 con 0x7f288c0ab160 2023-12-08T08:15:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c015a90 con 0x7f288c0ab160 2023-12-08T08:15:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c015e20 con 0x7f288c0ab160 2023-12-08T08:15:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c1e35f0 con 0x7f288c0ab160 2023-12-08T08:15:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7fc99fa61640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 0x7fc9980c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f25c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55036/0 (socket says 172.21.15.45:55036) 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f25c77fe640 1 -- 172.21.15.45:0/4280170964 learned_addr learned my addr 172.21.15.45:0/4280170964 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f25c7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:35992/0 (socket says 172.21.15.45:35992) 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7f25cc95b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25c00dbcb0 0x7f25c0174250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.107+0000 7fdf7f7fe640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf880ca0e0 0x7fdf880ca560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a693089d65df9b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7fdf877fe640 1 -- 172.21.15.45:0/378526894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70031740 con 0x7fdf880ca0e0 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7fdf877fe640 1 -- 172.21.15.45:0/378526894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf700318a0 con 0x7fdf880ca0e0 2023-12-08T08:15:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7fdf877fe640 1 -- 172.21.15.45:0/378526894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70031c70 con 0x7fdf880ca0e0 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99d7fd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 0x7fc9980c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99fa61640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9980c9ba0 con 0x7fc9980c71e0 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99fa61640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9980c8ad0 con 0x7fc998158ff0 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99fa61640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980c7640 con 0x7fc998158630 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.109+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff080050d0 con 0x7eff101449f0 2023-12-08T08:15:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f248bb41640 1 Processor -- start 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99cffc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc9980c71e0 0x7fc9980c7f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51920/0 (socket says 172.21.15.45:51920) 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7fc99cffc640 1 -- 172.21.15.45:0/4068678401 learned_addr learned my addr 172.21.15.45:0/4068678401 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c77fe640 1 -- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25c00dbcb0 msgr2=0x7f25c0174250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c77fe640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25c00dbcb0 0x7f25c0174250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c77fe640 1 -- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 msgr2=0x7f25c0178120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c77fe640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c77fe640 1 -- 172.21.15.45:0/4280170964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0094d0 con 0x7f25c0047470 2023-12-08T08:15:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f25c7fff640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc8ffc72640 1 Processor -- start 2023-12-08T08:15:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7f25c77fe640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7eff0d7fa640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 0x7efefc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc98bfff640 1 -- 172.21.15.45:0/4068678401 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803383510 0 0) 0x7fc9980c8ad0 con 0x7fc998158ff0 2023-12-08T08:15:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc98bfff640 1 -- 172.21.15.45:0/4068678401 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc984003520 con 0x7fc998158ff0 2023-12-08T08:15:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc99d7fd640 1 -- 172.21.15.45:0/4068678401 >> v1:172.21.15.114:6789/0 conn(0x7fc998158ff0 legacy=0x7fc998159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc99d7fd640 1 -- 172.21.15.45:0/4068678401 >> v1:172.21.15.45:6789/0 conn(0x7fc9980c71e0 legacy=0x7fc9980c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7fc99d7fd640 1 -- 172.21.15.45:0/4068678401 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980c4930 con 0x7fc998158630 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.110+0000 7f248bb41640 1 -- start start 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f248bb41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f248414e800 0x7f2484155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f248bb41640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f248415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f248bb41640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2484155540 con 0x7f24840ca0e0 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f248bb41640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24840c4880 con 0x7f248414e800 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f248bb41640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c4b60 con 0x7f24840ca560 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.111+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff08089390 con 0x7eff101449f0 2023-12-08T08:15:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7eff14cb2640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 0x7efefc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f248414e800 0x7f2484155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f248414e800 0x7f2484155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55040/0 (socket says 172.21.15.45:55040) 2023-12-08T08:15:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 -- 172.21.15.45:0/1365025433 learned_addr learned my addr 172.21.15.45:0/1365025433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c0a9940 con 0x7f288c0ab160 2023-12-08T08:15:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.112+0000 7fc8ffc72640 1 -- start start 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fdf8e9be640 1 -- 172.21.15.45:0/378526894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf880ca0e0 msgr2=0x7fdf880ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf880ca0e0 0x7fdf880ca560 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002b7e0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 -- 172.21.15.45:0/1365025433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 msgr2=0x7f248415ef00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 --2- 172.21.15.45:0/1365025433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f248415ef00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 -- 172.21.15.45:0/1365025433 >> v1:172.21.15.114:6789/0 conn(0x7f24840ca0e0 legacy=0x7f24841581c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:15:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7f24898dd640 1 -- 172.21.15.45:0/1365025433 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840c4e40 con 0x7f248414e800 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fc8ffc72640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8f8151c40 0x7fc8f80c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fc8ffc72640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8154600 0x7fc8f8157b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fc8ffc72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f8158410 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fc8ffc72640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80c5820 con 0x7fc8f8151c40 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7fc8ffc72640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81586f0 con 0x7fc8f8154600 2023-12-08T08:15:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.113+0000 7eff14cb2640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 0x7efefc06d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff00036000 tx=0x7eff0003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 -- 172.21.15.45:0/378526894 shutdown_connections 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf880ca0e0 0x7fdf880ca560 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/378526894 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf8814e800 0x7fdf88155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 -- 172.21.15.45:0/378526894 >> 172.21.15.45:0/378526894 conn(0x7fdf880663d0 msgr2=0x7fdf880667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 -- 172.21.15.45:0/378526894 shutdown_connections 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fc8fe20f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8f80c6fd0 0x7fc8f80c46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51930/0 (socket says 172.21.15.45:51930) 2023-12-08T08:15:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fc8fe20f640 1 -- 172.21.15.45:0/1496966254 learned_addr learned my addr 172.21.15.45:0/1496966254 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c0aa140 con 0x7f288c0ab160 2023-12-08T08:15:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fc99d7fd640 1 --2- 172.21.15.45:0/4068678401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 0x7fc9980c4f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9900097d0 tx=0x7fc99002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed37fdef3924798c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/1496966254 >> v2:172.21.15.114:3300/0 conn(0x7fc8f8151c40 0x7fc8f80c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fc8fd20d640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8154600 0x7fc8f8157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.114+0000 7fdf8e9be640 1 -- 172.21.15.45:0/378526894 wait complete. 2023-12-08T08:15:32.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc98bfff640 1 -- 172.21.15.45:0/4068678401 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99002d040 con 0x7fc998158630 2023-12-08T08:15:32.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc98bfff640 1 -- 172.21.15.45:0/4068678401 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990031810 con 0x7fc998158630 2023-12-08T08:15:32.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc98bfff640 1 -- 172.21.15.45:0/4068678401 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990031b80 con 0x7fc998158630 2023-12-08T08:15:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc8fda0e640 1 -- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8154600 msgr2=0x7fc8f8157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8154600 0x7fc8f8157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc8fda0e640 1 -- 172.21.15.45:0/1496966254 >> v1:172.21.15.45:6789/0 conn(0x7fc8f80c6fd0 legacy=0x7fc8f80c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7fc8fda0e640 1 -- 172.21.15.45:0/1496966254 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80c67d0 con 0x7fc8f8151c40 2023-12-08T08:15:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.115+0000 7f24898dd640 1 --2- 172.21.15.45:0/1365025433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f248414e800 0x7f2484155000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2474009870 tx=0x7f247402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e50a65c68a5065 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 -- 172.21.15.45:0/4068678401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 msgr2=0x7fc9980c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 --2- 172.21.15.45:0/4068678401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 0x7fc9980c4f70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9900097d0 tx=0x7fc99002b8b0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 -- 172.21.15.45:0/4068678401 shutdown_connections 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 --2- 172.21.15.45:0/4068678401 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc998158630 0x7fc9980c4f70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 -- 172.21.15.45:0/4068678401 >> 172.21.15.45:0/4068678401 conn(0x7fc9980ab9c0 msgr2=0x7fc9980abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 -- 172.21.15.45:0/4068678401 shutdown_connections 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fc99fa61640 1 -- 172.21.15.45:0/4068678401 wait complete. 2023-12-08T08:15:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fdf8e9be640 1 Processor -- start 2023-12-08T08:15:32.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.116+0000 7fdf8e9be640 1 -- start start 2023-12-08T08:15:32.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f8151c40 0x7fc8f80c7e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009d90 tx=0x7fc8f002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c1f60018f36ed7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf880ca0e0 0x7fdf880c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 0x7fdf8814a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881e9bc0 con 0x7fdf8814e800 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c0f50 con 0x7fdf881581c0 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fdf8e9be640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881e9dd0 con 0x7fdf880ca0e0 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.117+0000 7fc8fca0c640 1 -- 172.21.15.45:0/1496966254 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002cbd0 con 0x7fc8f8151c40 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55052/0 (socket says 172.21.15.45:55052) 2023-12-08T08:15:32.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/871847426 learned_addr learned my addr 172.21.15.45:0/871847426 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fc8fca0c640 1 -- 172.21.15.45:0/1496966254 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f002cd30 con 0x7fc8f8151c40 2023-12-08T08:15:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fc8fca0c640 1 -- 172.21.15.45:0/1496966254 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002cea0 con 0x7fc8f8151c40 2023-12-08T08:15:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf87fff640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf880ca0e0 0x7fdf880c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf8cf5b640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 0x7fdf8814a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf880ca0e0 msgr2=0x7fdf880c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf880ca0e0 0x7fdf880c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 msgr2=0x7fdf8814a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 0x7fdf8814a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.118+0000 7fdf7f7fe640 1 -- 172.21.15.45:0/871847426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780094d0 con 0x7fdf8814e800 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 -- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f8151c40 msgr2=0x7fc8f80c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f8151c40 0x7fc8f80c7e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009d90 tx=0x7fc8f002be20 comp rx=0 tx=0).stop 2023-12-08T08:15:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fdf8cf5b640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 0x7fdf8814a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc99fa61640 1 Processor -- start 2023-12-08T08:15:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 -- 172.21.15.45:0/1496966254 shutdown_connections 2023-12-08T08:15:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8154600 0x7fc8f8157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/1496966254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f8151c40 0x7fc8f80c7e40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 -- 172.21.15.45:0/1496966254 >> 172.21.15.45:0/1496966254 conn(0x7fc8f80ab8b0 msgr2=0x7fc8f80abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fdf7f7fe640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf7002bdf0 tx=0x7fdf700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 -- 172.21.15.45:0/1496966254 shutdown_connections 2023-12-08T08:15:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc8ffc72640 1 -- 172.21.15.45:0/1496966254 wait complete. 2023-12-08T08:15:32.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.119+0000 7fc99fa61640 1 -- start start 2023-12-08T08:15:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f480c983640 1 Processor -- start 2023-12-08T08:15:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f480c983640 1 -- start start 2023-12-08T08:15:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc03ada0 con 0x7f25c0047470 2023-12-08T08:15:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f25cd15c640 1 -- 172.21.15.45:0/4280170964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0177960 con 0x7f25c0047470 2023-12-08T08:15:32.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f25cd15c640 1 -- 172.21.15.45:0/4280170964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c002e610 con 0x7f25c0047470 2023-12-08T08:15:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70033bf0 con 0x7fdf8814e800 2023-12-08T08:15:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70009400 con 0x7fdf8814e800 2023-12-08T08:15:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7f24888db640 1 -- 172.21.15.45:0/1365025433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474031750 con 0x7f248414e800 2023-12-08T08:15:32.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf881ea390 con 0x7fdf8814e800 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.120+0000 7fc99fa61640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9980c71e0 0x7fc9981f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc99fa61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc99fa61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815a420 0x7fc9980c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc99fa61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980bec30 con 0x7fc99815a420 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc99fa61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99815a870 con 0x7fc998158ff0 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc99fa61640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99815ceb0 con 0x7fc9980c71e0 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff080541e0 con 0x7eff101449f0 2023-12-08T08:15:32.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.121+0000 7fc8ffc72640 1 Processor -- start 2023-12-08T08:15:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.122+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70033d50 con 0x7fdf8814e800 2023-12-08T08:15:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.122+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70048650 con 0x7fdf8814e800 2023-12-08T08:15:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.122+0000 7f24888db640 1 -- 172.21.15.45:0/1365025433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740318b0 con 0x7f248414e800 2023-12-08T08:15:32.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.122+0000 7f25cd15c640 1 -- 172.21.15.45:0/4280170964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c0177e00 con 0x7f25c0047470 2023-12-08T08:15:32.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.122+0000 7fc8ffc72640 1 -- start start 2023-12-08T08:15:32.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 -- 172.21.15.45:0/1365025433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f248414e800 msgr2=0x7f2484155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f24888db640 1 -- 172.21.15.45:0/1365025433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474031c40 con 0x7f248414e800 2023-12-08T08:15:32.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 --2- 172.21.15.45:0/1365025433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f248414e800 0x7f2484155000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2474009870 tx=0x7f247402b7f0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f287c00f460 con 0x7f288c0ab160 2023-12-08T08:15:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c005250 con 0x7fdf8814e800 2023-12-08T08:15:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 -- 172.21.15.45:0/1365025433 shutdown_connections 2023-12-08T08:15:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 --2- 172.21.15.45:0/1365025433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f248415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 --2- 172.21.15.45:0/1365025433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f248414e800 0x7f2484155000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f248bb41640 1 -- 172.21.15.45:0/1365025433 >> 172.21.15.45:0/1365025433 conn(0x7f24840663d0 msgr2=0x7f24840667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f480c983640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f480814e800 0x7f4808155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.123+0000 7f480c983640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7fc99cffc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f480c983640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4808155540 con 0x7f48081581c0 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f480c983640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48080c4880 con 0x7f480814e800 2023-12-08T08:15:32.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f480c983640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48080c4b60 con 0x7f48080ca0e0 2023-12-08T08:15:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7fc99cffc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:36012/0 (socket says 172.21.15.45:36012) 2023-12-08T08:15:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7fc99cffc640 1 -- 172.21.15.45:0/3495724317 learned_addr learned my addr 172.21.15.45:0/3495724317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f2873fff640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 0x7f287806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f287c08a170 con 0x7f288c0ab160 2023-12-08T08:15:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7fc8ffc72640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f4805d9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f4805d9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40972/0 (socket says 172.21.15.45:40972) 2023-12-08T08:15:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7f4805d9b640 1 -- 172.21.15.45:0/676845817 learned_addr learned my addr 172.21.15.45:0/676845817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.124+0000 7fc8ffc72640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 0x7fc8f80aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8ffc72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8f8154600 0x7fc8f81ee190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc99cffc640 1 -- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9980c71e0 msgr2=0x7fc9981f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc99cffc640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9980c71e0 0x7fc9981f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc99cffc640 1 -- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815a420 msgr2=0x7fc9980c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc99cffc640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815a420 0x7fc9980c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc99cffc640 1 -- 172.21.15.45:0/3495724317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990009400 con 0x7fc998158ff0 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8ffc72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8154450 con 0x7fc8f8154600 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8ffc72640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c14d0 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8ffc72640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c24e0 con 0x7fc8f8151c40 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7f4805d9b640 1 -- 172.21.15.45:0/676845817 >> v2:172.21.15.114:3300/0 conn(0x7f480814e800 msgr2=0x7f4808155000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7f4805d9b640 1 --2- 172.21.15.45:0/676845817 >> v2:172.21.15.114:3300/0 conn(0x7f480814e800 0x7f4808155000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7f4805d9b640 1 -- 172.21.15.45:0/676845817 >> v1:172.21.15.114:6789/0 conn(0x7f48081581c0 legacy=0x7f48080c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7f4805d9b640 1 -- 172.21.15.45:0/676845817 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080c4e40 con 0x7f48080ca0e0 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8fda0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8fda0e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:36024/0 (socket says 172.21.15.45:36024) 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8fda0e640 1 -- 172.21.15.45:0/766873726 learned_addr learned my addr 172.21.15.45:0/766873726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.125+0000 7fc8fd20d640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 0x7fc8f80aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc99cffc640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00cba0 tx=0x7fc98c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fe20f640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8f8154600 0x7fc8f81ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f248bb41640 1 -- 172.21.15.45:0/1365025433 shutdown_connections 2023-12-08T08:15:32.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f248bb41640 1 -- 172.21.15.45:0/1365025433 wait complete. 2023-12-08T08:15:32.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00ad40 con 0x7fc998158ff0 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f4805d9b640 1 --2- 172.21.15.45:0/676845817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009870 tx=0x7f47fc02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb27febc111900b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f480559a640 1 -- 172.21.15.45:0/676845817 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0317e0 con 0x7f48080ca0e0 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fda0e640 1 -- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 msgr2=0x7fc8f80aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 0x7fc8f80aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fda0e640 1 -- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8f8154600 msgr2=0x7fc8f81ee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8f8154600 0x7fc8f81ee190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fda0e640 1 -- 172.21.15.45:0/766873726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009a70 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.126+0000 7fc8fd20d640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 0x7fc8f80aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c012400 con 0x7fc998158ff0 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00aea0 con 0x7fc998158ff0 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f480559a640 1 -- 172.21.15.45:0/676845817 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc031940 con 0x7f48080ca0e0 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f480559a640 1 -- 172.21.15.45:0/676845817 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc031cd0 con 0x7f48080ca0e0 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc04d450 con 0x7f25c0047470 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc04d7c0 con 0x7f25c0047470 2023-12-08T08:15:32.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25bc04d920 con 0x7f25c0047470 2023-12-08T08:15:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f480c983640 1 -- 172.21.15.45:0/676845817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 msgr2=0x7f48080ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f25c4ff9640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 0x7f25b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7f480c983640 1 --2- 172.21.15.45:0/676845817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009870 tx=0x7f47fc02b880 comp rx=0 tx=0).stop 2023-12-08T08:15:32.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f480c983640 1 -- 172.21.15.45:0/676845817 shutdown_connections 2023-12-08T08:15:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f480c983640 1 --2- 172.21.15.45:0/676845817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48080ca0e0 0x7f48080ca560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f25c7fff640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 0x7f25b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f480c983640 1 --2- 172.21.15.45:0/676845817 >> v2:172.21.15.114:3300/0 conn(0x7f480814e800 0x7f4808155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f480c983640 1 -- 172.21.15.45:0/676845817 >> 172.21.15.45:0/676845817 conn(0x7f48080663d0 msgr2=0x7f48080667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99815cbb0 con 0x7fc998158ff0 2023-12-08T08:15:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.128+0000 7fc8fda0e640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0037040 tx=0x7fc8f0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7f480c983640 1 -- 172.21.15.45:0/676845817 shutdown_connections 2023-12-08T08:15:32.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f248bb41640 1 Processor -- start 2023-12-08T08:15:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7f480c983640 1 -- 172.21.15.45:0/676845817 wait complete. 2023-12-08T08:15:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.127+0000 7f288b7fe640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 0x7f287806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.129+0000 7f288b7fe640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 0x7f287806d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f288c155200 tx=0x7f2884007f10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9981f1fc0 con 0x7fc998158ff0 2023-12-08T08:15:32.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7f25c7fff640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 0x7f25b406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25c8064180 tx=0x7f25c8066000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7f248bb41640 1 -- start start 2023-12-08T08:15:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002cea0 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0040650 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f814af40 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.131+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f287c054fa0 con 0x7f288c0ab160 2023-12-08T08:15:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.130+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0040a00 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.132+0000 7f480c983640 1 Processor -- start 2023-12-08T08:15:32.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.131+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9980c94d0 con 0x7fc998158ff0 2023-12-08T08:15:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.132+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25bc02d040 con 0x7f25c0047470 2023-12-08T08:15:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.132+0000 7f248bb41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f248bb41640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f24840c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f248bb41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f248414e800 0x7f24841ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f24898dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f248bb41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c2b50 con 0x7f24840ca0e0 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f248bb41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484147d20 con 0x7f248414e800 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f248bb41640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24841ee120 con 0x7f24840ca560 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f24898dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55082/0 (socket says 172.21.15.45:55082) 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f24898dd640 1 -- 172.21.15.45:0/1802949483 learned_addr learned my addr 172.21.15.45:0/1802949483 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf7003a050 con 0x7fdf8814e800 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f24890dc640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f24840c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f248a0de640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f248414e800 0x7f24841ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f24898dd640 1 -- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 msgr2=0x7f24840c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f24898dd640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f24840c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f24898dd640 1 -- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f248414e800 msgr2=0x7f24841ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f24898dd640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f248414e800 0x7f24841ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7f24898dd640 1 -- 172.21.15.45:0/1802949483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740094d0 con 0x7f24840ca0e0 2023-12-08T08:15:32.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.132+0000 7f480c983640 1 -- start start 2023-12-08T08:15:32.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.135+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc98c007070 con 0x7fc998158ff0 2023-12-08T08:15:32.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.132+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f8157520 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 0x7f48080befb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48081581c0 0x7f4808148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480814a130 con 0x7f480814e800 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808149c40 con 0x7f48080ca0e0 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.133+0000 7f480c983640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48080ac450 con 0x7f48081581c0 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.135+0000 7f480659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.135+0000 7f480659c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:36040/0 (socket says 172.21.15.45:36040) 2023-12-08T08:15:32.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.135+0000 7f480659c640 1 -- 172.21.15.45:0/685019276 learned_addr learned my addr 172.21.15.45:0/685019276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f4805d9b640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 0x7f48080befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f480659c640 1 -- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48081581c0 msgr2=0x7f4808148f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f480659c640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48081581c0 0x7f4808148f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f480659c640 1 -- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 msgr2=0x7f48080befb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f480659c640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 0x7f48080befb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f480659c640 1 -- 172.21.15.45:0/685019276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0094d0 con 0x7f48080ca0e0 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7f4805d9b640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 0x7f48080befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.137+0000 7f480659c640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f800b450 tx=0x7f47f800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.137+0000 7fc989ffb640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 0x7fc97c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.137+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc98c0898d0 con 0x7fc998158ff0 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f8074600 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8f0040b60 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.134+0000 7fdf857fa640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 0x7fdf6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.135+0000 7fdf87fff640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 0x7fdf6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.136+0000 7fdf87fff640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 0x7fdf6806d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf78006ca0 tx=0x7fdf78009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.137+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25bc0771f0 con 0x7f25c0047470 2023-12-08T08:15:32.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.138+0000 7fc99d7fd640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 0x7fc97c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.138+0000 7f24898dd640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2474000c00 tx=0x7f24740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.138+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf7007a6d0 con 0x7fdf8814e800 2023-12-08T08:15:32.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.139+0000 7fc99d7fd640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 0x7fc97c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc990036000 tx=0x7fc990030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.139+0000 7fc8ee7fc640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 0x7fc8dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.140+0000 7fc8fd20d640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 0x7fc8dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.140+0000 7fc8fd20d640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 0x7fc8dc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8071bc0 tx=0x7fc8e8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf70076a10 con 0x7fdf8814e800 2023-12-08T08:15:32.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474033c80 con 0x7f24840ca0e0 2023-12-08T08:15:32.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474033de0 con 0x7f24840ca0e0 2023-12-08T08:15:32.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247403d690 con 0x7f24840ca0e0 2023-12-08T08:15:32.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840bdab0 con 0x7f24840ca0e0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.142+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24841ede40 con 0x7f24840ca0e0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.144+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2484067900 con 0x7f24840ca0e0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.146+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f247403a040 con 0x7f24840ca0e0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.147+0000 7f247a7fc640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 0x7f246806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.148+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24740ab8a0 con 0x7f24840ca0e0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.148+0000 7f24890dc640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 0x7f246806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.149+0000 7f24890dc640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 0x7f246806d350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24841541e0 tx=0x7f248000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.152+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801c440 con 0x7f48080ca0e0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.153+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f801c5c0 con 0x7f48080ca0e0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.153+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801c970 con 0x7f48080ca0e0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.153+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48080ac120 con 0x7f48080ca0e0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.153+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8f007a5e0 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.154+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4808149e50 con 0x7f48080ca0e0 2023-12-08T08:15:32.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.154+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc98c0546a0 con 0x7fc998158ff0 2023-12-08T08:15:32.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.155+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4808158b30 con 0x7f48080ca0e0 2023-12-08T08:15:32.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.156+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2474076780 con 0x7f24840ca0e0 2023-12-08T08:15:32.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.167+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8f0076920 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.170+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47f80253b0 con 0x7f48080ca0e0 2023-12-08T08:15:32.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.171+0000 7f47f6ffd640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 0x7f47e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:32.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.171+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47f8091d70 con 0x7f48080ca0e0 2023-12-08T08:15:32.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.172+0000 7f4805d9b640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 0x7f47e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:32.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.173+0000 7f4805d9b640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 0x7f47e806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47fc036000 tx=0x7f47fc03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.180+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47f805cb10 con 0x7f48080ca0e0 2023-12-08T08:15:32.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.528+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff101ea150 con 0x7eff101449f0 2023-12-08T08:15:32.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.529+0000 7eff0d7fa640 1 -- 172.21.15.45:0/2007421299 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff080017d0 con 0x7eff101449f0 2023-12-08T08:15:32.532 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.533+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 msgr2=0x7efefc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.533+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 0x7efefc06d360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff00036000 tx=0x7eff0003d040 comp rx=0 tx=0).stop 2023-12-08T08:15:32.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 msgr2=0x7eff101ea9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff0800cac0 tx=0x7eff0800cf80 comp rx=0 tx=0).stop 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 shutdown_connections 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efefc06aea0 0x7efefc06d360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff101449f0 0x7eff101ea9a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff10154460 0x7eff101ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 --2- 172.21.15.45:0/2007421299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff100c0c30 0x7eff10153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.534+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 >> 172.21.15.45:0/2007421299 conn(0x7eff100a79f0 msgr2=0x7eff1014e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.535+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 shutdown_connections 2023-12-08T08:15:32.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.535+0000 7eff16f16640 1 -- 172.21.15.45:0/2007421299 wait complete. 2023-12-08T08:15:32.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.543+0000 7f25cd15c640 1 -- 172.21.15.45:0/4280170964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25c0005360 con 0x7f25c0047470 2023-12-08T08:15:32.550 INFO:teuthology.orchestra.run.smithi045.stdout:60129542153 2023-12-08T08:15:32.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.544+0000 7f25c4ff9640 1 -- 172.21.15.45:0/4280170964 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25bc07a810 con 0x7f25c0047470 2023-12-08T08:15:32.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.549+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 msgr2=0x7f25b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.549+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 0x7f25b406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25c8064180 tx=0x7f25c8066000 comp rx=0 tx=0).stop 2023-12-08T08:15:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.549+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 msgr2=0x7f25c00e1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.549+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 shutdown_connections 2023-12-08T08:15:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b406ae40 0x7f25b406d300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25c00dbcb0 0x7f25c0174250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c0047470 0x7f25c00e1ec0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 --2- 172.21.15.45:0/4280170964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25c00073b0 0x7f25c0178120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.550+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 >> 172.21.15.45:0/4280170964 conn(0x7f25c0048220 msgr2=0x7f25c002bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.551+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 shutdown_connections 2023-12-08T08:15:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.551+0000 7f25ae7fc640 1 -- 172.21.15.45:0/4280170964 wait complete. 2023-12-08T08:15:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.555+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f288c0aa100 con 0x7f288c0ab160 2023-12-08T08:15:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.556+0000 7f2873fff640 1 -- 172.21.15.45:0/614567852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f287c0585c0 con 0x7f288c0ab160 2023-12-08T08:15:32.558 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.560+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 msgr2=0x7f287806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.560+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 0x7f287806d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f288c155200 tx=0x7f2884007f10 comp rx=0 tx=0).stop 2023-12-08T08:15:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.560+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 msgr2=0x7f288c0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.560+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f287c011540 tx=0x7f287c011a00 comp rx=0 tx=0).stop 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 shutdown_connections 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f287806af10 0x7f287806d3d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f288c0c8a10 0x7f288c1e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f288c0ab160 0x7f288c0c84d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 --2- 172.21.15.45:0/614567852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f288c1522c0 0x7f288c1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 >> 172.21.15.45:0/614567852 conn(0x7f288c0ab7c0 msgr2=0x7f288c0abba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.561+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 shutdown_connections 2023-12-08T08:15:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.562+0000 7f2891c10640 1 -- 172.21.15.45:0/614567852 wait complete. 2023-12-08T08:15:32.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2023-12-08T08:15:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.565+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf6c0057d0 con 0x7fdf8814e800 2023-12-08T08:15:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.566+0000 7fdf857fa640 1 -- 172.21.15.45:0/871847426 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf7002f090 con 0x7fdf8814e800 2023-12-08T08:15:32.569 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.569+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 msgr2=0x7fdf6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.569+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 0x7fdf6806d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf78006ca0 tx=0x7fdf78009240 comp rx=0 tx=0).stop 2023-12-08T08:15:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 msgr2=0x7fdf880abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdf7002bdf0 tx=0x7fdf700046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 shutdown_connections 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf6806ae40 0x7fdf6806d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf881581c0 0x7fdf8814a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8814e800 0x7fdf880abe80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 --2- 172.21.15.45:0/871847426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf880ca0e0 0x7fdf880c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.570+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 >> 172.21.15.45:0/871847426 conn(0x7fdf880663d0 msgr2=0x7fdf8814b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.571+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 shutdown_connections 2023-12-08T08:15:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.571+0000 7fdf8e9be640 1 -- 172.21.15.45:0/871847426 wait complete. 2023-12-08T08:15:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.575+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24840c2dc0 con 0x7f24840ca0e0 2023-12-08T08:15:32.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.576+0000 7f247a7fc640 1 -- 172.21.15.45:0/1802949483 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2474038090 con 0x7f24840ca0e0 2023-12-08T08:15:32.578 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.578+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 msgr2=0x7f246806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.578+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 0x7f246806d350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f24841541e0 tx=0x7f248000d040 comp rx=0 tx=0).stop 2023-12-08T08:15:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.578+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 msgr2=0x7f24840aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.578+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2474000c00 tx=0x7f24740046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 shutdown_connections 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f246806ae90 0x7f246806d350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24840ca560 0x7f24840c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f248414e800 0x7f24841ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 --2- 172.21.15.45:0/1802949483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24840ca0e0 0x7f24840aae40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 >> 172.21.15.45:0/1802949483 conn(0x7f24840663d0 msgr2=0x7f24840c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 shutdown_connections 2023-12-08T08:15:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.579+0000 7f248bb41640 1 -- 172.21.15.45:0/1802949483 wait complete. 2023-12-08T08:15:32.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.586+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc998074600 con 0x7fc998158ff0 2023-12-08T08:15:32.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.586+0000 7fc989ffb640 1 -- 172.21.15.45:0/3495724317 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc98c057cc0 con 0x7fc998158ff0 2023-12-08T08:15:32.589 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.3 2023-12-08T08:15:32.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 msgr2=0x7fc97c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 0x7fc97c06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc990036000 tx=0x7fc990030000 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 msgr2=0x7fc9980c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00cba0 tx=0x7fc98c00a430 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 shutdown_connections 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc97c06ae70 0x7fc97c06d330 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc990036000 tx=0x7fc990030000 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815a420 0x7fc9980c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc998158ff0 0x7fc9980c35c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 --2- 172.21.15.45:0/3495724317 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc9980c71e0 0x7fc9981f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 >> 172.21.15.45:0/3495724317 conn(0x7fc9980ab9c0 msgr2=0x7fc9980c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 shutdown_connections 2023-12-08T08:15:32.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.589+0000 7fc99fa61640 1 -- 172.21.15.45:0/3495724317 wait complete. 2023-12-08T08:15:32.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.592+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc8f80c7c20 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.593+0000 7fc8ee7fc640 1 -- 172.21.15.45:0/766873726 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8f0044090 con 0x7fc8f80c6fd0 2023-12-08T08:15:32.595 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.594+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48080ac2b0 con 0x7f48080ca0e0 2023-12-08T08:15:32.598 INFO:teuthology.orchestra.run.smithi045.stdout:60129542152 2023-12-08T08:15:32.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.595+0000 7f47f6ffd640 1 -- 172.21.15.45:0/685019276 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48080ac2b0 con 0x7f48080ca0e0 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.595+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 msgr2=0x7fc8dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.595+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 0x7fc8dc06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8071bc0 tx=0x7fc8e8009190 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.595+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 msgr2=0x7fc8f8156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.595+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0037040 tx=0x7fc8f0004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 shutdown_connections 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8dc06ae70 0x7fc8dc06d330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8f8151c40 0x7fc8f80aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8f8154600 0x7fc8f81ee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 --2- 172.21.15.45:0/766873726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f80c6fd0 0x7fc8f8156fe0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0037040 tx=0x7fc8f0004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.596+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 >> 172.21.15.45:0/766873726 conn(0x7fc8f80ab8b0 msgr2=0x7fc8f814fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.597+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 shutdown_connections 2023-12-08T08:15:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.597+0000 7fc8ffc72640 1 -- 172.21.15.45:0/766873726 wait complete. 2023-12-08T08:15:32.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 msgr2=0x7f47e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 0x7f47e806d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f47fc036000 tx=0x7f47fc03d040 comp rx=0 tx=0).stop 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 msgr2=0x7f480814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f800b450 tx=0x7f47f800b910 comp rx=0 tx=0).stop 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 shutdown_connections 2023-12-08T08:15:32.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47e806ae40 0x7f47e806d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f48081581c0 0x7f4808148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f480814e800 0x7f48080befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 --2- 172.21.15.45:0/685019276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48080ca0e0 0x7f480814c290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 >> 172.21.15.45:0/685019276 conn(0x7f48080663d0 msgr2=0x7f4808157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 shutdown_connections 2023-12-08T08:15:32.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:32.598+0000 7f480c983640 1 -- 172.21.15.45:0/685019276 wait complete. 2023-12-08T08:15:32.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.1 2023-12-08T08:15:32.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2023-12-08T08:15:32.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2023-12-08T08:15:32.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-12-08T08:15:33.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:15:33.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:15:33.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:15:33.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:15:33.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:15:33.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:15:33.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:15:33.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:15:33.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.891+0000 7f9eb9aad640 1 Processor -- start 2023-12-08T08:15:33.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.891+0000 7f9eb9aad640 1 -- start start 2023-12-08T08:15:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.893+0000 7f9eb9aad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.893+0000 7f9eb9aad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9eac00fcc0 0x7f9eac0067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb9aad640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0d7cd0 con 0x7f9eac0d78f0 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb9aad640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0db220 con 0x7f9eac00fcc0 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb9aad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac04b9d0 con 0x7f9eac0506f0 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40984/0 (socket says 172.21.15.45:40984) 2023-12-08T08:15:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb3fff640 1 -- 172.21.15.45:0/1152785729 learned_addr learned my addr 172.21.15.45:0/1152785729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.894+0000 7f9eb92ac640 1 --2- 172.21.15.45:0/1152785729 >> v2:172.21.15.114:3300/0 conn(0x7f9eac00fcc0 0x7f9eac0067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.895+0000 7f9eb3fff640 1 -- 172.21.15.45:0/1152785729 >> v2:172.21.15.114:3300/0 conn(0x7f9eac00fcc0 msgr2=0x7f9eac0067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.895+0000 7f9eb3fff640 1 --2- 172.21.15.45:0/1152785729 >> v2:172.21.15.114:3300/0 conn(0x7f9eac00fcc0 0x7f9eac0067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.895+0000 7f9eb3fff640 1 -- 172.21.15.45:0/1152785729 >> v1:172.21.15.114:6789/0 conn(0x7f9eac0d78f0 legacy=0x7f9eac00ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.895+0000 7f9eb3fff640 1 -- 172.21.15.45:0/1152785729 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac04bcb0 con 0x7f9eac0506f0 2023-12-08T08:15:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.897+0000 7f9eb3fff640 1 --2- 172.21.15.45:0/1152785729 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4068e90 tx=0x7f9eb40a5cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465b47de0c2aaef0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.897+0000 7f9eb37fe640 1 -- 172.21.15.45:0/1152785729 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a6b20 con 0x7f9eac0506f0 2023-12-08T08:15:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.897+0000 7f9eb37fe640 1 -- 172.21.15.45:0/1152785729 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40a6c80 con 0x7f9eac0506f0 2023-12-08T08:15:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.897+0000 7f9eb37fe640 1 -- 172.21.15.45:0/1152785729 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40ae660 con 0x7f9eac0506f0 2023-12-08T08:15:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 -- 172.21.15.45:0/1152785729 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 msgr2=0x7f9eac006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/1152785729 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4068e90 tx=0x7f9eb40a5cb0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 -- 172.21.15.45:0/1152785729 shutdown_connections 2023-12-08T08:15:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/1152785729 >> v2:172.21.15.114:3300/0 conn(0x7f9eac00fcc0 0x7f9eac0067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/1152785729 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac0506f0 0x7f9eac006290 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.899+0000 7f9eb9aad640 1 -- 172.21.15.45:0/1152785729 >> 172.21.15.45:0/1152785729 conn(0x7f9eac04fbd0 msgr2=0x7f9eac04ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.900+0000 7f9eb9aad640 1 -- 172.21.15.45:0/1152785729 shutdown_connections 2023-12-08T08:15:33.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.900+0000 7f9eb9aad640 1 -- 172.21.15.45:0/1152785729 wait complete. 2023-12-08T08:15:33.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.902+0000 7f9eb9aad640 1 Processor -- start 2023-12-08T08:15:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.903+0000 7f9eb9aad640 1 -- start start 2023-12-08T08:15:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.904+0000 7f9eb9aad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac00fcc0 0x7f9eac0d8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.904+0000 7f9eb9aad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 0x7f9eac17a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.904+0000 7f9eb9aad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.905+0000 7f9eb92ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb92ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55102/0 (socket says 172.21.15.45:55102) 2023-12-08T08:15:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 0x7f9eac17a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb92ac640 1 -- 172.21.15.45:0/3493586610 learned_addr learned my addr 172.21.15.45:0/3493586610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0de010 con 0x7f9eac0d78f0 2023-12-08T08:15:33.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0da170 con 0x7f9eac0506f0 2023-12-08T08:15:33.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.906+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0d90b0 con 0x7f9eac00fcc0 2023-12-08T08:15:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.907+0000 7f9eb92ac640 1 -- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac00fcc0 msgr2=0x7f9eac0d8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.908+0000 7f9eb92ac640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac00fcc0 0x7f9eac0d8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.908+0000 7f9eb92ac640 1 -- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 msgr2=0x7f9eac17a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.908+0000 7f9eb92ac640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 0x7f9eac17a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.908+0000 7f9eb92ac640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac17a5d0 con 0x7f9eac0d78f0 2023-12-08T08:15:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.908+0000 7f9eb3fff640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 0x7f9eac17a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.909+0000 7f9eb92ac640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800d5d0 tx=0x7f9ea800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.910+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80125f0 con 0x7f9eac0d78f0 2023-12-08T08:15:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.910+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8012750 con 0x7f9eac0d78f0 2023-12-08T08:15:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.910+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac17d380 con 0x7f9eac0d78f0 2023-12-08T08:15:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.910+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac17d5d0 con 0x7f9eac0d78f0 2023-12-08T08:15:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.913+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8012b00 con 0x7f9eac0d78f0 2023-12-08T08:15:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.915+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e94005250 con 0x7f9eac0d78f0 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.919+0000 7f7d0949b640 1 Processor -- start 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.919+0000 7f7d0949b640 1 -- start start 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.921+0000 7f7d0949b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d04155bf0 0x7f7d041560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.921+0000 7f7d0949b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0406d230 con 0x7f7d0415c220 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.921+0000 7f7d0949b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0415cd10 con 0x7f7d04159eb0 2023-12-08T08:15:33.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.921+0000 7f7d0949b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d040c6090 con 0x7f7d04155bf0 2023-12-08T08:15:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.917+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea8012c60 con 0x7f9eac0d78f0 2023-12-08T08:15:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.918+0000 7f9eb17fa640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 0x7f9e9806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.918+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ea8089a60 con 0x7f9eac0d78f0 2023-12-08T08:15:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.919+0000 7f9eb8aab640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 0x7f9e9806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.923+0000 7f7d027fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d04155bf0 0x7f7d041560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.924+0000 7f7d027fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d04155bf0 0x7f7d041560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55110/0 (socket says 172.21.15.45:55110) 2023-12-08T08:15:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.924+0000 7f7d037fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7d04159eb0 0x7f7d0415a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:60238/0 (socket says 172.21.15.45:60238) 2023-12-08T08:15:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.924+0000 7f7d037fe640 1 -- 172.21.15.45:0/3967055354 learned_addr learned my addr 172.21.15.45:0/3967055354 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.925+0000 7f7d027fc640 1 -- 172.21.15.45:0/3967055354 >> v1:172.21.15.114:6789/0 conn(0x7f7d04159eb0 legacy=0x7f7d0415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.925+0000 7f7d027fc640 1 -- 172.21.15.45:0/3967055354 >> v1:172.21.15.45:6789/0 conn(0x7f7d0415c220 legacy=0x7f7d0415c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.925+0000 7f7d027fc640 1 -- 172.21.15.45:0/3967055354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0406d480 con 0x7f7d04155bf0 2023-12-08T08:15:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.927+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ea80548b0 con 0x7f9eac0d78f0 2023-12-08T08:15:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.927+0000 7f7d027fc640 1 --2- 172.21.15.45:0/3967055354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04155bf0 0x7f7d041560a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d90 tx=0x7f7cfc02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830190b1ab80f9bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.928+0000 7f7d01ffb640 1 -- 172.21.15.45:0/3967055354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc02cb40 con 0x7f7d04155bf0 2023-12-08T08:15:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.928+0000 7f9eb8aab640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 0x7f9e9806d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006fd0 tx=0x7f9ea0006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.928+0000 7f7d01ffb640 1 -- 172.21.15.45:0/3967055354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc02cca0 con 0x7f7d04155bf0 2023-12-08T08:15:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.928+0000 7f7d01ffb640 1 -- 172.21.15.45:0/3967055354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc034660 con 0x7f7d04155bf0 2023-12-08T08:15:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.930+0000 7f7d0949b640 1 -- 172.21.15.45:0/3967055354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04155bf0 msgr2=0x7f7d041560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.930+0000 7f7d0949b640 1 --2- 172.21.15.45:0/3967055354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04155bf0 0x7f7d041560a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d90 tx=0x7f7cfc02bd90 comp rx=0 tx=0).stop 2023-12-08T08:15:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.930+0000 7f7d0949b640 1 -- 172.21.15.45:0/3967055354 shutdown_connections 2023-12-08T08:15:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.930+0000 7f7d0949b640 1 --2- 172.21.15.45:0/3967055354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04155bf0 0x7f7d041560a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.931+0000 7f7d0949b640 1 -- 172.21.15.45:0/3967055354 >> 172.21.15.45:0/3967055354 conn(0x7f7d040661f0 msgr2=0x7f7d04066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.931+0000 7f7d0949b640 1 -- 172.21.15.45:0/3967055354 shutdown_connections 2023-12-08T08:15:33.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.931+0000 7f7d0949b640 1 -- 172.21.15.45:0/3967055354 wait complete. 2023-12-08T08:15:33.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.932+0000 7fabff83d640 1 Processor -- start 2023-12-08T08:15:33.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.932+0000 7fabff83d640 1 -- start start 2023-12-08T08:15:33.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.934+0000 7f7d0949b640 1 Processor -- start 2023-12-08T08:15:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.934+0000 7f7d0949b640 1 -- start start 2023-12-08T08:15:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.934+0000 7fabff83d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.934+0000 7fabff83d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabf0050720 0x7fabf00062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.934+0000 7fabff83d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fabf000fcf0 0x7fabf0006800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabff83d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00d7d00 con 0x7fabf0050720 2023-12-08T08:15:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabff83d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00db250 con 0x7fabf000fcf0 2023-12-08T08:15:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabff83d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf004ba00 con 0x7fabf00d7920 2023-12-08T08:15:33.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabfd5d9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabfd5d9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40996/0 (socket says 172.21.15.45:40996) 2023-12-08T08:15:33.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d04155bf0 0x7f7d040a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 0x7f7d04152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabfd5d9640 1 -- 172.21.15.45:0/4164283762 learned_addr learned my addr 172.21.15.45:0/4164283762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.935+0000 7fabfddda640 1 --2- 172.21.15.45:0/4164283762 >> v2:172.21.15.114:3300/0 conn(0x7fabf000fcf0 0x7fabf0006800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041526b0 con 0x7f7d04159eb0 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040a2260 con 0x7f7d04155bf0 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d0949b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041f1f00 con 0x7f7d0415c220 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7f7d027fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 0x7f7d04152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.937+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.937+0000 7f7d037fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40998/0 (socket says 172.21.15.45:40998) 2023-12-08T08:15:33.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.937+0000 7f7d037fe640 1 -- 172.21.15.45:0/1032222520 learned_addr learned my addr 172.21.15.45:0/1032222520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.937+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d04155bf0 0x7f7d040a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7fabfd5d9640 1 -- 172.21.15.45:0/4164283762 >> v2:172.21.15.114:3300/0 conn(0x7fabf000fcf0 msgr2=0x7fabf0006800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7fabfd5d9640 1 --2- 172.21.15.45:0/4164283762 >> v2:172.21.15.114:3300/0 conn(0x7fabf000fcf0 0x7fabf0006800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7fabfd5d9640 1 -- 172.21.15.45:0/4164283762 >> v2:172.21.15.45:3300/0 conn(0x7fabf0050720 msgr2=0x7fabf00062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7fabfd5d9640 1 --2- 172.21.15.45:0/4164283762 >> v2:172.21.15.45:3300/0 conn(0x7fabf0050720 0x7fabf00062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.936+0000 7fabfd5d9640 1 -- 172.21.15.45:0/4164283762 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf004bce0 con 0x7fabf00d7920 2023-12-08T08:15:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d037fe640 1 -- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d04155bf0 msgr2=0x7f7d040a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d037fe640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d04155bf0 0x7f7d040a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7fabfd5d9640 1 --2- 172.21.15.45:0/4164283762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fabf0050ce0 tx=0x7fabe802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6dcfcfbd174c0e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d037fe640 1 -- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 msgr2=0x7f7d04152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d037fe640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 0x7f7d04152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d037fe640 1 -- 172.21.15.45:0/1032222520 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009a70 con 0x7f7d0415c220 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.938+0000 7f7d027fc640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 0x7f7d04152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7f7d037fe640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c3e0 tx=0x7f7cf400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4005ce0 con 0x7f7d0415c220 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4005e40 con 0x7f7d0415c220 2023-12-08T08:15:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4007310 con 0x7f7d0415c220 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7fabeffff640 1 -- 172.21.15.45:0/4164283762 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe802d040 con 0x7fabf00d7920 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7fabeffff640 1 -- 172.21.15.45:0/4164283762 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8031810 con 0x7fabf00d7920 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.939+0000 7fabeffff640 1 -- 172.21.15.45:0/4164283762 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8031be0 con 0x7fabf00d7920 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.941+0000 7fabff83d640 1 -- 172.21.15.45:0/4164283762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 msgr2=0x7fabf000edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.941+0000 7fabff83d640 1 --2- 172.21.15.45:0/4164283762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fabf0050ce0 tx=0x7fabe802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.941+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d041563a0 con 0x7f7d0415c220 2023-12-08T08:15:33.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.941+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0406fe60 con 0x7f7d0415c220 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 -- 172.21.15.45:0/4164283762 shutdown_connections 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 --2- 172.21.15.45:0/4164283762 >> v2:172.21.15.114:3300/0 conn(0x7fabf000fcf0 0x7fabf0006800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 --2- 172.21.15.45:0/4164283762 >> v2:172.21.15.45:3300/0 conn(0x7fabf0050720 0x7fabf00062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 --2- 172.21.15.45:0/4164283762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf00d7920 0x7fabf000edb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 -- 172.21.15.45:0/4164283762 >> 172.21.15.45:0/4164283762 conn(0x7fabf004fc00 msgr2=0x7fabf0050010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7fabff83d640 1 -- 172.21.15.45:0/4164283762 shutdown_connections 2023-12-08T08:15:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.942+0000 7f7336cca640 1 Processor -- start 2023-12-08T08:15:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.943+0000 7f7336cca640 1 -- start start 2023-12-08T08:15:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.943+0000 7fabff83d640 1 -- 172.21.15.45:0/4164283762 wait complete. 2023-12-08T08:15:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.943+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d04074600 con 0x7f7d0415c220 2023-12-08T08:15:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.944+0000 7fe81f0ff640 1 Processor -- start 2023-12-08T08:15:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.944+0000 7fe81f0ff640 1 -- start start 2023-12-08T08:15:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f7336cca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732800fcc0 0x7f73280069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f7336cca640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280d7cd0 con 0x7f73280d78f0 2023-12-08T08:15:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f7336cca640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280db220 con 0x7f73280506f0 2023-12-08T08:15:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f7336cca640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732804b9d0 con 0x7f732800fcc0 2023-12-08T08:15:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f4a132df640 1 Processor -- start 2023-12-08T08:15:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7fdb588ac640 1 Processor -- start 2023-12-08T08:15:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732800fcc0 0x7f73280069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.945+0000 7f4a132df640 1 -- start start 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7cf4007470 con 0x7f7d0415c220 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7fabff83d640 1 Processor -- start 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fabff83d640 1 -- start start 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7fe81f0ff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8180c4440 0x7fe81815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7fe81f0ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81f0ff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81806c6b0 con 0x7fe818155bb0 2023-12-08T08:15:33.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81f0ff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81815a260 con 0x7fe8180c4440 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81f0ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81815bc50 con 0x7fe818159100 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81e0fd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe818155bb0 0x7fe818159b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:60250/0 (socket says 172.21.15.45:60250) 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81e0fd640 1 -- 172.21.15.45:0/919913722 learned_addr learned my addr 172.21.15.45:0/919913722 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732800fcc0 0x7f73280069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55130/0 (socket says 172.21.15.45:55130) 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 -- 172.21.15.45:0/406325687 learned_addr learned my addr 172.21.15.45:0/406325687 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f7335cc8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f73280d78f0 0x7f732800ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51950/0 (socket says 172.21.15.45:51950) 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 -- 172.21.15.45:0/406325687 >> v1:172.21.15.114:6789/0 conn(0x7f73280506f0 legacy=0x7f7328006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 -- 172.21.15.45:0/406325687 >> v1:172.21.15.45:6789/0 conn(0x7f73280d78f0 legacy=0x7f732800ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7f73364c9640 1 -- 172.21.15.45:0/406325687 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732804bcb0 con 0x7f732800fcc0 2023-12-08T08:15:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.946+0000 7fdb588ac640 1 -- start start 2023-12-08T08:15:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.947+0000 7fe81d8fc640 1 --2- 172.21.15.45:0/919913722 >> v2:172.21.15.114:3300/0 conn(0x7fe8180c4440 0x7fe81815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fe81e8fe640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7f73364c9640 1 --2- 172.21.15.45:0/406325687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732800fcc0 0x7f73280069a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f732c009870 tx=0x7f732c034090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b8f989a32d3e12 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 0x7fabf00d9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf0050720 0x7fabf016d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 0x7fabf016dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf016d2f0 con 0x7fabf00d7920 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf016f680 con 0x7fabf000fcf0 2023-12-08T08:15:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fdb588ac640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb4c04dab0 0x7fdb4c04eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fabff83d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf016cc70 con 0x7fabf0050720 2023-12-08T08:15:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fdb588ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c00f9a0 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fdb588ac640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0da480 con 0x7fdb4c0d7ab0 2023-12-08T08:15:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fdb588ac640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c0da760 con 0x7fdb4c04dab0 2023-12-08T08:15:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fe81d8fc640 1 -- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 msgr2=0x7fe8180c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f7334cc6640 1 -- 172.21.15.45:0/406325687 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c034e40 con 0x7f732800fcc0 2023-12-08T08:15:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f7334cc6640 1 -- 172.21.15.45:0/406325687 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c03c440 con 0x7f732800fcc0 2023-12-08T08:15:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f7334cc6640 1 -- 172.21.15.45:0/406325687 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c03c7d0 con 0x7f732800fcc0 2023-12-08T08:15:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f4a132df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 0x7f4a0400ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fdb5259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb4c04dfc0 0x7fdb4c04e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51954/0 (socket says 172.21.15.45:51954) 2023-12-08T08:15:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fdb5259c640 1 -- 172.21.15.45:0/1748968890 learned_addr learned my addr 172.21.15.45:0/1748968890 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fe81d8fc640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f7ceb7fe640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 0x7f7cf006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f4a132df640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a040d7cd0 con 0x7f4a0400fcc0 2023-12-08T08:15:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fe81d8fc640 1 -- 172.21.15.45:0/919913722 >> v1:172.21.15.114:6789/0 conn(0x7fe818155bb0 legacy=0x7fe818159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.948+0000 7fe81d8fc640 1 -- 172.21.15.45:0/919913722 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180c4920 con 0x7fe8180c4440 2023-12-08T08:15:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f4a132df640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a040db220 con 0x7f4a040506f0 2023-12-08T08:15:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7f4a132df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0404b9d0 con 0x7f4a040d78f0 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fabfcdd8640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf0050720 0x7fabf016d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fabfd5d9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 0x7fabf00d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fabfd5d9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 0x7fabf00d9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:36104/0 (socket says 172.21.15.45:36104) 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fabfd5d9640 1 -- 172.21.15.45:0/876855833 learned_addr learned my addr 172.21.15.45:0/876855833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.949+0000 7fabfddda640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 0x7fabf016dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7f4a12ade640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4a0400fcc0 0x7f4a040069a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51964/0 (socket says 172.21.15.45:51964) 2023-12-08T08:15:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7f4a12ade640 1 -- 172.21.15.45:0/1479509415 learned_addr learned my addr 172.21.15.45:0/1479509415 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553656965 0 0) 0x7fdb4c00f9a0 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7f4a122dd640 1 --2- 172.21.15.45:0/1479509415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 0x7f4a0400ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb3c003520 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fabfddda640 1 -- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf0050720 msgr2=0x7fabf016d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fabfddda640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf0050720 0x7fabf016d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fabfddda640 1 -- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 msgr2=0x7fabf00d9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fabfddda640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 0x7fabf00d9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7fabfddda640 1 -- 172.21.15.45:0/876855833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80094d0 con 0x7fabf00d7920 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.950+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7cf4088d20 con 0x7f7d0415c220 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734306242 0 0) 0x7fdb4c0da480 con 0x7fdb4c0d7ab0 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb4c00f9a0 con 0x7fdb4c0d7ab0 2023-12-08T08:15:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7fdb5359e640 1 --2- 172.21.15.45:0/1748968890 >> v2:172.21.15.114:3300/0 conn(0x7fdb4c04dab0 0x7fdb4c04eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7336cca640 1 -- 172.21.15.45:0/406325687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732800fcc0 msgr2=0x7f73280069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7336cca640 1 --2- 172.21.15.45:0/406325687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732800fcc0 0x7f73280069a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f732c009870 tx=0x7f732c034090 comp rx=0 tx=0).stop 2023-12-08T08:15:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 0x7f7cf006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f4a112db640 1 -- 172.21.15.45:0/1479509415 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490875312 0 0) 0x7f4a040d7cd0 con 0x7f4a0400fcc0 2023-12-08T08:15:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f4a112db640 1 -- 172.21.15.45:0/1479509415 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f8003520 con 0x7f4a0400fcc0 2023-12-08T08:15:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7336cca640 1 -- 172.21.15.45:0/406325687 shutdown_connections 2023-12-08T08:15:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7336cca640 1 --2- 172.21.15.45:0/406325687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732800fcc0 0x7f73280069a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7f7336cca640 1 -- 172.21.15.45:0/406325687 >> 172.21.15.45:0/406325687 conn(0x7f732804fbd0 msgr2=0x7f732804ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.951+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2064474773 0 0) 0x7fdb3c003520 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fe81d8fc640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180c4440 0x7fe81815c6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1bf3e14fe1018b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f7336cca640 1 -- 172.21.15.45:0/406325687 shutdown_connections 2023-12-08T08:15:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 >> v2:172.21.15.114:3300/0 conn(0x7fdb4c04dab0 msgr2=0x7fdb4c04eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 --2- 172.21.15.45:0/1748968890 >> v2:172.21.15.114:3300/0 conn(0x7fdb4c04dab0 0x7fdb4c04eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 >> v1:172.21.15.114:6789/0 conn(0x7fdb4c0d7ab0 legacy=0x7fdb4c007180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0daa40 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdb48001670 con 0x7fdb4c04dfc0 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 >> v1:172.21.15.45:6789/0 conn(0x7fdb4c04dfc0 legacy=0x7fdb4c04e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c003b00 0x7fdb3c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 0x7fdb3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c005180 0x7fdb3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f7d02ffd640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 0x7f7cf006d350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80017f0 tx=0x7f7cf8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0da760 con 0x7fdb3c0047c0 2023-12-08T08:15:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c00bfa0 con 0x7fdb3c003b00 2023-12-08T08:15:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fabfddda640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 0x7fabf016dc50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabf804f5f0 tx=0x7fabf8067ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c00c160 con 0x7fdb3c005180 2023-12-08T08:15:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fe81d0fb640 1 -- 172.21.15.45:0/919913722 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808031780 con 0x7fe8180c4440 2023-12-08T08:15:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f4a122dd640 1 -- 172.21.15.45:0/1479509415 >> v1:172.21.15.114:6789/0 conn(0x7f4a040506f0 legacy=0x7f4a04006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f4a122dd640 1 -- 172.21.15.45:0/1479509415 >> v1:172.21.15.45:6789/0 conn(0x7f4a0400fcc0 legacy=0x7f4a040069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f4a122dd640 1 -- 172.21.15.45:0/1479509415 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0404bcb0 con 0x7f4a040d78f0 2023-12-08T08:15:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fe81d0fb640 1 -- 172.21.15.45:0/919913722 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080318e0 con 0x7fe8180c4440 2023-12-08T08:15:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fe81d0fb640 1 -- 172.21.15.45:0/919913722 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808031c70 con 0x7fe8180c4440 2023-12-08T08:15:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8098070 con 0x7fabf00d7920 2023-12-08T08:15:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb52d9d640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c003b00 0x7fdb3c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 0x7fdb3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8072ec0 con 0x7fabf00d7920 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 -- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c005180 msgr2=0x7fdb3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb3c005180 0x7fdb3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 -- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c003b00 msgr2=0x7fdb3c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c003b00 0x7fdb3c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fdb5259c640 1 -- 172.21.15.45:0/1748968890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0daa40 con 0x7fdb3c0047c0 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.954+0000 7fdb5359e640 1 -- 172.21.15.45:0/1748968890 reap_dead start 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8073290 con 0x7fabf00d7920 2023-12-08T08:15:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fabff83d640 1 -- 172.21.15.45:0/876855833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf016f880 con 0x7fabf00d7920 2023-12-08T08:15:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7fe81f0ff640 1 -- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180c4440 msgr2=0x7fe81815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180c4440 0x7fe81815c6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80802b820 comp rx=0 tx=0).stop 2023-12-08T08:15:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.952+0000 7f7336cca640 1 -- 172.21.15.45:0/406325687 wait complete. 2023-12-08T08:15:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7f7336cca640 1 Processor -- start 2023-12-08T08:15:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7f7336cca640 1 -- start start 2023-12-08T08:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.953+0000 7fabff83d640 1 -- 172.21.15.45:0/876855833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf016fb60 con 0x7fabf00d7920 2023-12-08T08:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd4005250 con 0x7fabf00d7920 2023-12-08T08:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7fdb5259c640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 0x7fdb3c004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c02f430 tx=0x7fdb3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0efe842895bb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.955+0000 7f4a122dd640 1 --2- 172.21.15.45:0/1479509415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 0x7f4a0400ed80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000b60 tx=0x7f4a0c0a5c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531a6f408c9385fc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fe81f0ff640 1 -- 172.21.15.45:0/919913722 shutdown_connections 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/919913722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180c4440 0x7fe81815c6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fe81f0ff640 1 -- 172.21.15.45:0/919913722 >> 172.21.15.45:0/919913722 conn(0x7fe8180663d0 msgr2=0x7fe8180667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48005ad0 con 0x7fdb3c0047c0 2023-12-08T08:15:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7f7336cca640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 0x7f732817d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fe81f0ff640 1 -- 172.21.15.45:0/919913722 shutdown_connections 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48005c30 con 0x7fdb3c0047c0 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7336cca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280506f0 0x7f73280d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7336cca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 0x7f73280cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7336cca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328033840 con 0x7f73280d78f0 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7336cca640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328032ec0 con 0x7f73280506f0 2023-12-08T08:15:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7336cca640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280d16b0 con 0x7f732800fcc0 2023-12-08T08:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fdb51d9b640 1 -- 172.21.15.45:0/1748968890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4802c8c0 con 0x7fdb3c0047c0 2023-12-08T08:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 -- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 msgr2=0x7fdb3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 0x7fdb3c004c40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c02f430 tx=0x7fdb3c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fe81f0ff640 1 -- 172.21.15.45:0/919913722 wait complete. 2023-12-08T08:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f73364c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 0x7f73280cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 -- 172.21.15.45:0/1748968890 shutdown_connections 2023-12-08T08:15:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 --2- 172.21.15.45:0/1748968890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb3c0047c0 0x7fdb3c004c40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 -- 172.21.15.45:0/1748968890 >> 172.21.15.45:0/1748968890 conn(0x7fdb4c04c630 msgr2=0x7fdb4c04ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f3a12f90640 1 Processor -- start 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7335cc8640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 0x7f732817d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7335cc8640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 0x7f732817d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:41060/0 (socket says 172.21.15.45:41060) 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f7335cc8640 1 -- 172.21.15.45:0/1806689427 learned_addr learned my addr 172.21.15.45:0/1806689427 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7fdb588ac640 1 -- 172.21.15.45:0/1748968890 shutdown_connections 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.957+0000 7f73354c7640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280506f0 0x7f73280d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.956+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabf80733f0 con 0x7fabf00d7920 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7fabedffb640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 0x7fabdc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fabf810b820 con 0x7fabf00d7920 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f73364c9640 1 -- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 msgr2=0x7f732817d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f73364c9640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 0x7f732817d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f73364c9640 1 -- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280506f0 msgr2=0x7f73280d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f73364c9640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280506f0 0x7f73280d9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f73364c9640 1 -- 172.21.15.45:0/1806689427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0094d0 con 0x7f73280d78f0 2023-12-08T08:15:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.959+0000 7fabfd5d9640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 0x7fabdc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.959+0000 7f73364c9640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 0x7f73280cd440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f732c03b000 tx=0x7f732c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7fdb588ac640 1 -- 172.21.15.45:0/1748968890 wait complete. 2023-12-08T08:15:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.959+0000 7fe81f0ff640 1 Processor -- start 2023-12-08T08:15:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.958+0000 7f3a12f90640 1 -- start start 2023-12-08T08:15:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7fabfd5d9640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 0x7fabdc06d350 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabe802b910 tx=0x7fabe803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a12f90640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a0c14e800 0x7f3a0c155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a12f90640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a12f90640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c155540 con 0x7f3a0c0ca0e0 2023-12-08T08:15:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a12f90640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c0c4880 con 0x7f3a0c14e800 2023-12-08T08:15:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a12f90640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0c4b60 con 0x7f3a0c0ca560 2023-12-08T08:15:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7fe81f0ff640 1 -- start start 2023-12-08T08:15:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7fdb588ac640 1 Processor -- start 2023-12-08T08:15:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a03fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3a0c0ca0e0 0x7f3a0c1581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51980/0 (socket says 172.21.15.45:51980) 2023-12-08T08:15:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a03fff640 1 -- 172.21.15.45:0/3017033217 learned_addr learned my addr 172.21.15.45:0/3017033217 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.960+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3017033217 >> v2:172.21.15.114:3300/0 conn(0x7f3a0c14e800 0x7f3a0c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7f3a1152d640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fdb588ac640 1 -- start start 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 0x7fe8180ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7f3a10d2c640 1 -- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 msgr2=0x7f3a0c15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c15ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7f3a10d2c640 1 -- 172.21.15.45:0/3017033217 >> v1:172.21.15.45:6789/0 conn(0x7f3a0c0ca0e0 legacy=0x7f3a0c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7f3a10d2c640 1 -- 172.21.15.45:0/3017033217 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0c4e40 con 0x7f3a0c14e800 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c0980 con 0x7fe8180c4440 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180c0470 con 0x7fe818155bb0 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.961+0000 7fe81f0ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180beea0 con 0x7fe818159100 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81e0fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c0047c0 0x7fdb4c033a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 0x7fdb4c045c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81d8fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 0x7fe8180ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0347b0 con 0x7fdb4c0cf720 2023-12-08T08:15:33.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c035790 con 0x7fdb3c0047c0 2023-12-08T08:15:33.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb588ac640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c046e20 con 0x7fdb4c046800 2023-12-08T08:15:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81d8fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 0x7fe8180ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:36162/0 (socket says 172.21.15.45:36162) 2023-12-08T08:15:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81d8fc640 1 -- 172.21.15.45:0/1002974999 learned_addr learned my addr 172.21.15.45:0/1002974999 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81e0fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55154/0 (socket says 172.21.15.45:55154) 2023-12-08T08:15:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fe81e8fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.962+0000 7fdb5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb52d9d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c0047c0 0x7fdb4c033a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55162/0 (socket says 172.21.15.45:55162) 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 -- 172.21.15.45:0/126841385 learned_addr learned my addr 172.21.15.45:0/126841385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5359e640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 0x7fdb4c045c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fe81e0fd640 1 -- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 msgr2=0x7fe8180c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fe81e0fd640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c14e800 0x7f3a0c155000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a080097a0 tx=0x7f3a0802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c2c39b9c67c85c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fe81e0fd640 1 -- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 msgr2=0x7fe8180ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fe81e0fd640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 0x7fe8180ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fe81e0fd640 1 -- 172.21.15.45:0/1002974999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009400 con 0x7fe8180c4440 2023-12-08T08:15:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 -- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 msgr2=0x7fdb4c045c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 0x7fdb4c045c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 -- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c0047c0 msgr2=0x7fdb4c033a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c0047c0 0x7fdb4c033a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5259c640 1 -- 172.21.15.45:0/126841385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c047100 con 0x7fdb4c0cf720 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.963+0000 7fdb5359e640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 0x7fdb4c045c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7f3a037fe640 1 -- 172.21.15.45:0/3017033217 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080316f0 con 0x7f3a0c14e800 2023-12-08T08:15:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7f3a037fe640 1 -- 172.21.15.45:0/3017033217 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08031850 con 0x7f3a0c14e800 2023-12-08T08:15:33.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7f3a037fe640 1 -- 172.21.15.45:0/3017033217 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08031be0 con 0x7f3a0c14e800 2023-12-08T08:15:33.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7fe81e0fd640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ca70 tx=0x7fe81000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7f3a12f90640 1 -- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c14e800 msgr2=0x7f3a0c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:33.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c14e800 0x7f3a0c155000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a080097a0 tx=0x7f3a0802b790 comp rx=0 tx=0).stop 2023-12-08T08:15:33.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.964+0000 7fdb5259c640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000fb0 tx=0x7fdb48001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 -- 172.21.15.45:0/3017033217 shutdown_connections 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c15ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3017033217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c14e800 0x7f3a0c155000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 -- 172.21.15.45:0/3017033217 >> 172.21.15.45:0/3017033217 conn(0x7f3a0c0663d0 msgr2=0x7f3a0c0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 -- 172.21.15.45:0/3017033217 shutdown_connections 2023-12-08T08:15:33.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f3a12f90640 1 -- 172.21.15.45:0/3017033217 wait complete. 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c03a4c0 con 0x7f73280d78f0 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c03a620 con 0x7f73280d78f0 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c03a990 con 0x7f73280d78f0 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.965+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000ab10 con 0x7fe8180c4440 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000ac70 con 0x7fe8180c4440 2023-12-08T08:15:33.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328032870 con 0x7f73280d78f0 2023-12-08T08:15:33.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810012620 con 0x7fe8180c4440 2023-12-08T08:15:33.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7328033460 con 0x7f73280d78f0 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4802cd50 con 0x7fdb4c0cf720 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4803a070 con 0x7fdb4c0cf720 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48007270 con 0x7fdb4c0cf720 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180be830 con 0x7fe8180c4440 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8180c2940 con 0x7fe8180c4440 2023-12-08T08:15:33.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabf80d6770 con 0x7fabf00d7920 2023-12-08T08:15:33.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0473e0 con 0x7fdb4c0cf720 2023-12-08T08:15:33.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.966+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c033f70 con 0x7fdb4c0cf720 2023-12-08T08:15:33.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.967+0000 7f3a12f90640 1 Processor -- start 2023-12-08T08:15:33.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.968+0000 7f3a12f90640 1 -- start start 2023-12-08T08:15:33.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.969+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c0057b0 con 0x7fdb4c0cf720 2023-12-08T08:15:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.969+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cf4053d00 con 0x7f7d0415c220 2023-12-08T08:15:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.969+0000 7f4a112db640 1 -- 172.21.15.45:0/1479509415 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a6ad0 con 0x7f4a040d78f0 2023-12-08T08:15:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7f4a112db640 1 -- 172.21.15.45:0/1479509415 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0a6c70 con 0x7f4a040d78f0 2023-12-08T08:15:33.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7f4a112db640 1 -- 172.21.15.45:0/1479509415 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a6ea0 con 0x7f4a040d78f0 2023-12-08T08:15:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.969+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f732c03aaf0 con 0x7f73280d78f0 2023-12-08T08:15:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7f3a12f90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0ca0e0 0x7f3a0c1eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7328005360 con 0x7f73280d78f0 2023-12-08T08:15:33.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8180673e0 con 0x7fe8180c4440 2023-12-08T08:15:33.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7f3a12f90640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c1f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.971+0000 7f3a12f90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.971+0000 7f73267fc640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 0x7f731406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.971+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f732c0ac5e0 con 0x7f73280d78f0 2023-12-08T08:15:33.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a1152d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a1152d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55170/0 (socket says 172.21.15.45:55170) 2023-12-08T08:15:33.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.970+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe810007070 con 0x7fe8180c4440 2023-12-08T08:15:33.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a03fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c1f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a03fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c1f9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:41080/0 (socket says 172.21.15.45:41080) 2023-12-08T08:15:33.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f7335cc8640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 0x7f731406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a1152d640 1 -- 172.21.15.45:0/3635140183 learned_addr learned my addr 172.21.15.45:0/3635140183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:33.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7fe80effd640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 0x7fe7fc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0ca0e0 0x7f3a0c1eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c1f8f30 con 0x7f3a0c14e800 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c1f9dd0 con 0x7f3a0c0ca0e0 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c1f82b0 con 0x7f3a0c0ca560 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe810089660 con 0x7fe8180c4440 2023-12-08T08:15:33.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb48032070 con 0x7fdb4c0cf720 2023-12-08T08:15:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.972+0000 7fe81d8fc640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 0x7fe7fc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f7335cc8640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 0x7f731406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7330068160 tx=0x7f7330066000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a1152d640 1 -- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 msgr2=0x7f3a0c1f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a1152d640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c1f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a1152d640 1 -- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0ca0e0 msgr2=0x7f3a0c1eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a1152d640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0ca0e0 0x7f3a0c1eaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.973+0000 7f3a1152d640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009400 con 0x7f3a0c14e800 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.974+0000 7f3a1152d640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400efc0 tx=0x7f3a0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.974+0000 7f4a132df640 1 -- 172.21.15.45:0/1479509415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 msgr2=0x7f4a0400ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.974+0000 7f4a132df640 1 --2- 172.21.15.45:0/1479509415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 0x7f4a0400ed80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000b60 tx=0x7f4a0c0a5c60 comp rx=0 tx=0).stop 2023-12-08T08:15:34.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.974+0000 7fdb3b7fe640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 0x7fdb4006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.974+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb480ab1a0 con 0x7fdb4c0cf720 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7fe81d8fc640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 0x7fe7fc06d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7f4a132df640 1 -- 172.21.15.45:0/1479509415 shutdown_connections 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7f4a132df640 1 --2- 172.21.15.45:0/1479509415 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040d78f0 0x7f4a0400ed80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7f4a132df640 1 -- 172.21.15.45:0/1479509415 >> 172.21.15.45:0/1479509415 conn(0x7f4a0404fbd0 msgr2=0x7f4a0404ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7fdb52d9d640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 0x7fdb4006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7f4a132df640 1 -- 172.21.15.45:0/1479509415 shutdown_connections 2023-12-08T08:15:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.975+0000 7f4a132df640 1 -- 172.21.15.45:0/1479509415 wait complete. 2023-12-08T08:15:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.976+0000 7fdb52d9d640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 0x7fdb4006d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb54064180 tx=0x7fdb5408c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.978+0000 7f4a132df640 1 Processor -- start 2023-12-08T08:15:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.978+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f732c0774b0 con 0x7f73280d78f0 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.978+0000 7f4a132df640 1 -- start start 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040506f0 0x7f4a04177a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 0x7f4a040d2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a04174f20 con 0x7f4a0400fcc0 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040d96e0 con 0x7f4a040d78f0 2023-12-08T08:15:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a132df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a041753e0 con 0x7f4a040506f0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a122dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a122dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55172/0 (socket says 172.21.15.45:55172) 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a122dd640 1 -- 172.21.15.45:0/3264829378 learned_addr learned my addr 172.21.15.45:0/3264829378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.980+0000 7f4a11adc640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040506f0 0x7f4a04177a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a12ade640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 0x7f4a040d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a122dd640 1 -- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040506f0 msgr2=0x7f4a04177a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a122dd640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040506f0 0x7f4a04177a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a122dd640 1 -- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 msgr2=0x7f4a040d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a122dd640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 0x7f4a040d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a122dd640 1 -- 172.21.15.45:0/3264829378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04175100 con 0x7f4a0400fcc0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.981+0000 7f4a12ade640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 0x7f4a040d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.982+0000 7f4a122dd640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c068af0 tx=0x7f4a0c068540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.984+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0ba650 con 0x7f4a0400fcc0 2023-12-08T08:15:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.984+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040d9b40 con 0x7f4a0400fcc0 2023-12-08T08:15:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.984+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040d82a0 con 0x7f4a0400fcc0 2023-12-08T08:15:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.985+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04014480 con 0x7f3a0c14e800 2023-12-08T08:15:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.985+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb480761a0 con 0x7fdb4c0cf720 2023-12-08T08:15:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.985+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c1f8590 con 0x7f3a0c14e800 2023-12-08T08:15:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.985+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c1f8b50 con 0x7f3a0c14e800 2023-12-08T08:15:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.986+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a040d8ec0 con 0x7f4a0400fcc0 2023-12-08T08:15:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.987+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c1f9070 con 0x7f3a0c14e800 2023-12-08T08:15:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.989+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0ba7b0 con 0x7f4a0400fcc0 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.990+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400f040 con 0x7f3a0c14e800 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.990+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040147e0 con 0x7f3a0c14e800 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.990+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0bab60 con 0x7f4a0400fcc0 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.993+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a04014940 con 0x7f3a0c14e800 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.994+0000 7f3a017fa640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.994+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3a0408ab50 con 0x7f3a0c14e800 2023-12-08T08:15:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.995+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe810054540 con 0x7fe8180c4440 2023-12-08T08:15:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.995+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a0c0bacc0 con 0x7f4a0400fcc0 2023-12-08T08:15:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.997+0000 7f4a02ffd640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 0x7f49f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.997+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a0c125f00 con 0x7f4a0400fcc0 2023-12-08T08:15:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.998+0000 7f4a11adc640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 0x7f49f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.999+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:33.999+0000 7f4a11adc640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 0x7f49f006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a040d4f20 tx=0x7f4a08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.000+0000 7f3a10d2c640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 0x7f39f806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a08008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.001+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a04055980 con 0x7f3a0c14e800 2023-12-08T08:15:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.008+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a0c0f0c90 con 0x7f4a0400fcc0 2023-12-08T08:15:34.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.338+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e94005500 con 0x7f9eac0d78f0 2023-12-08T08:15:34.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.339+0000 7f9eb17fa640 1 -- 172.21.15.45:0/3493586610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ea8057ed0 con 0x7f9eac0d78f0 2023-12-08T08:15:34.344 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.343+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 msgr2=0x7f9e9806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.343+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 0x7f9e9806d3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006fd0 tx=0x7f9ea0006bc0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.343+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 msgr2=0x7f9eac0db8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.343+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800d5d0 tx=0x7f9ea800da90 comp rx=0 tx=0).stop 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 shutdown_connections 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9806af10 0x7f9e9806d3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eac0d78f0 0x7f9eac0db8a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eac0506f0 0x7f9eac17a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 --2- 172.21.15.45:0/3493586610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eac00fcc0 0x7f9eac0d8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.344+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 >> 172.21.15.45:0/3493586610 conn(0x7f9eac04fbd0 msgr2=0x7f9eac0d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.345+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 shutdown_connections 2023-12-08T08:15:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.345+0000 7f9eb9aad640 1 -- 172.21.15.45:0/3493586610 wait complete. 2023-12-08T08:15:34.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.0 2023-12-08T08:15:34.375 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.388+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabd40057d0 con 0x7fabf00d7920 2023-12-08T08:15:34.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.389+0000 7fabedffb640 1 -- 172.21.15.45:0/876855833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabf80a2020 con 0x7fabf00d7920 2023-12-08T08:15:34.393 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 msgr2=0x7fabdc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 0x7fabdc06d350 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabe802b910 tx=0x7fabe803c040 comp rx=0 tx=0).stop 2023-12-08T08:15:34.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 msgr2=0x7fabf016dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 0x7fabf016dc50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabf804f5f0 tx=0x7fabf8067ec0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 shutdown_connections 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fabdc06ae90 0x7fabdc06d350 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fabf0050720 0x7fabf016d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabf00d7920 0x7fabf016dc50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 --2- 172.21.15.45:0/876855833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabf000fcf0 0x7fabf00d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.393+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 >> 172.21.15.45:0/876855833 conn(0x7fabf004fc00 msgr2=0x7fabf0030fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.394+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 shutdown_connections 2023-12-08T08:15:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.394+0000 7fabdb7fe640 1 -- 172.21.15.45:0/876855833 wait complete. 2023-12-08T08:15:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.402+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdb4c0d5500 con 0x7fdb4c0cf720 2023-12-08T08:15:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.402+0000 7fdb3b7fe640 1 -- 172.21.15.45:0/126841385 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb48045020 con 0x7fdb4c0cf720 2023-12-08T08:15:34.405 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.404+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d040c64a0 con 0x7f7d0415c220 2023-12-08T08:15:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 msgr2=0x7fdb4006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 0x7fdb4006d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb54064180 tx=0x7fdb5408c040 comp rx=0 tx=0).stop 2023-12-08T08:15:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 msgr2=0x7fdb4c045700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb48000fb0 tx=0x7fdb48001930 comp rx=0 tx=0).stop 2023-12-08T08:15:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7f7ceb7fe640 1 -- 172.21.15.45:0/1032222520 <== mon.2 v2:172.21.15.114:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cf4017020 con 0x7f7d0415c220 2023-12-08T08:15:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 shutdown_connections 2023-12-08T08:15:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdb4006af10 0x7fdb4006d3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb4c046800 0x7fdb4c045c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb4c0cf720 0x7fdb4c045700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 --2- 172.21.15.45:0/126841385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb3c0047c0 0x7fdb4c033a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 >> 172.21.15.45:0/126841385 conn(0x7fdb4c04c630 msgr2=0x7fdb4c0d6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.405+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 shutdown_connections 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stdout:60129542155 2023-12-08T08:15:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.406+0000 7fdb588ac640 1 -- 172.21.15.45:0/126841385 wait complete. 2023-12-08T08:15:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 msgr2=0x7f7cf006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 0x7f7cf006d350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80017f0 tx=0x7f7cf8009040 comp rx=0 tx=0).stop 2023-12-08T08:15:34.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7328005360 con 0x7f73280d78f0 2023-12-08T08:15:34.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 msgr2=0x7f7d04070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c3e0 tx=0x7f7cf400c8a0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a04005360 con 0x7f4a0400fcc0 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 shutdown_connections 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cf006ae90 0x7f7cf006d350 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d0415c220 0x7f7d04070940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d04159eb0 0x7f7d04152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 --2- 172.21.15.45:0/1032222520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d04155bf0 0x7f7d040a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.409+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 >> 172.21.15.45:0/1032222520 conn(0x7f7d040661f0 msgr2=0x7f7d040665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.410+0000 7f73267fc640 1 -- 172.21.15.45:0/1806689427 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f732c07aad0 con 0x7f73280d78f0 2023-12-08T08:15:34.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.410+0000 7f4a02ffd640 1 -- 172.21.15.45:0/3264829378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a0c0f42b0 con 0x7f4a0400fcc0 2023-12-08T08:15:34.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.410+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 shutdown_connections 2023-12-08T08:15:34.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.410+0000 7f7d0949b640 1 -- 172.21.15.45:0/1032222520 wait complete. 2023-12-08T08:15:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 msgr2=0x7f49f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 0x7f49f006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a040d4f20 tx=0x7f4a08009040 comp rx=0 tx=0).stop 2023-12-08T08:15:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 msgr2=0x7f4a040d91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c068af0 tx=0x7f4a0c068540 comp rx=0 tx=0).stop 2023-12-08T08:15:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 msgr2=0x7f731406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 0x7f731406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7330068160 tx=0x7f7330066000 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 msgr2=0x7f73280cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.413+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 0x7f73280cd440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f732c03b000 tx=0x7f732c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 shutdown_connections 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49f006ae40 0x7f49f006d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4a040506f0 0x7f4a04177a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a040d78f0 0x7f4a040d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 --2- 172.21.15.45:0/3264829378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a0400fcc0 0x7f4a040d91a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 >> 172.21.15.45:0/3264829378 conn(0x7f4a0404fbd0 msgr2=0x7f4a04006290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 shutdown_connections 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f731406ae40 0x7f731406d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73280d78f0 0x7f73280cd440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73280506f0 0x7f73280d9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 --2- 172.21.15.45:0/1806689427 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732800fcc0 0x7f732817d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 >> 172.21.15.45:0/1806689427 conn(0x7f732804fbd0 msgr2=0x7f7328005570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 shutdown_connections 2023-12-08T08:15:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.414+0000 7f7336cca640 1 -- 172.21.15.45:0/1806689427 wait complete. 2023-12-08T08:15:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.416+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 shutdown_connections 2023-12-08T08:15:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.416+0000 7f4a132df640 1 -- 172.21.15.45:0/3264829378 wait complete. 2023-12-08T08:15:34.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.3 2023-12-08T08:15:34.422 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.420+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe8180bec70 con 0x7fe8180c4440 2023-12-08T08:15:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.420+0000 7fe80effd640 1 -- 172.21.15.45:0/1002974999 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe810057b60 con 0x7fe8180c4440 2023-12-08T08:15:34.425 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.423+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 msgr2=0x7fe7fc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.423+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 0x7fe7fc06d380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097a0 tx=0x7fe80803d040 comp rx=0 tx=0).stop 2023-12-08T08:15:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.423+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 msgr2=0x7fe8180adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.423+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe81000ca70 tx=0x7fe81000ce70 comp rx=0 tx=0).stop 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 shutdown_connections 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7fc06aec0 0x7fe7fc06d380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe818159100 0x7fe8180c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818155bb0 0x7fe8180ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 --2- 172.21.15.45:0/1002974999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8180c4440 0x7fe8180adfd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 >> 172.21.15.45:0/1002974999 conn(0x7fe8180663d0 msgr2=0x7fe818159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 shutdown_connections 2023-12-08T08:15:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.424+0000 7fe81f0ff640 1 -- 172.21.15.45:0/1002974999 wait complete. 2023-12-08T08:15:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.425+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3a0c074600 con 0x7f3a0c14e800 2023-12-08T08:15:34.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.426+0000 7f3a017fa640 1 -- 172.21.15.45:0/3635140183 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a04018020 con 0x7f3a0c14e800 2023-12-08T08:15:34.429 INFO:teuthology.orchestra.run.smithi045.stdout:60129542154 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.430+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 msgr2=0x7f39f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.430+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 0x7f39f806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a08008030 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.430+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 msgr2=0x7f3a0c1f9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.430+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400efc0 tx=0x7f3a0400c490 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 shutdown_connections 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a0c0ca560 0x7f3a0c1f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a0c14e800 0x7f3a0c1f9890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 --2- 172.21.15.45:0/3635140183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c0ca0e0 0x7f3a0c1eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 >> 172.21.15.45:0/3635140183 conn(0x7f3a0c0663d0 msgr2=0x7f3a0c14ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 shutdown_connections 2023-12-08T08:15:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.431+0000 7f3a12f90640 1 -- 172.21.15.45:0/3635140183 wait complete. 2023-12-08T08:15:34.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.6 2023-12-08T08:15:34.438 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.2 2023-12-08T08:15:34.441 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.1 2023-12-08T08:15:34.445 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.5 2023-12-08T08:15:34.445 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.4 2023-12-08T08:15:34.449 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.7 2023-12-08T08:15:34.452 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:34.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:15:34.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:15:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.715+0000 7f554bfff640 1 Processor -- start 2023-12-08T08:15:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.715+0000 7f554bfff640 1 -- start start 2023-12-08T08:15:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f554c0a7910 0x7f554c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 0x7f554c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c155850 con 0x7f554c0c1dc0 2023-12-08T08:15:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554bfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0c0890 con 0x7f554c0a7910 2023-12-08T08:15:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c0b70 con 0x7f554c1521b0 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.717+0000 7f554affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f554c0a7910 0x7f554c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f554c0a7910 0x7f554c0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55188/0 (socket says 172.21.15.45:55188) 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 -- 172.21.15.45:0/1058423164 learned_addr learned my addr 172.21.15.45:0/1058423164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554b7fe640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 0x7f554c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 -- 172.21.15.45:0/1058423164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 msgr2=0x7f554c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 0x7f554c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 -- 172.21.15.45:0/1058423164 >> v1:172.21.15.114:6789/0 conn(0x7f554c0c1dc0 legacy=0x7f554c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554affd640 1 -- 172.21.15.45:0/1058423164 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0c0e50 con 0x7f554c0a7910 2023-12-08T08:15:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.718+0000 7f554b7fe640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 0x7f554c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.719+0000 7f554affd640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c0c1880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d956a9722fca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554a7fc640 1 -- 172.21.15.45:0/1058423164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c031640 con 0x7f554c0a7910 2023-12-08T08:15:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554a7fc640 1 -- 172.21.15.45:0/1058423164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0317a0 con 0x7f554c0a7910 2023-12-08T08:15:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554a7fc640 1 -- 172.21.15.45:0/1058423164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c031b30 con 0x7f554c0a7910 2023-12-08T08:15:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 -- 172.21.15.45:0/1058423164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 msgr2=0x7f554c0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c0c1880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 -- 172.21.15.45:0/1058423164 shutdown_connections 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c1521b0 0x7f554c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 --2- 172.21.15.45:0/1058423164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c0c1880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 -- 172.21.15.45:0/1058423164 >> 172.21.15.45:0/1058423164 conn(0x7f554c0c5780 msgr2=0x7f554c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 -- 172.21.15.45:0/1058423164 shutdown_connections 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.720+0000 7f554bfff640 1 -- 172.21.15.45:0/1058423164 wait complete. 2023-12-08T08:15:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.722+0000 7f554bfff640 1 Processor -- start 2023-12-08T08:15:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.722+0000 7f554bfff640 1 -- start start 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c0c1dc0 0x7f554c1df800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c1521b0 0x7f554c14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1de190 con 0x7f554c0a7910 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c34f0 con 0x7f554c1521b0 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1ea690 con 0x7f554c0c1dc0 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55202/0 (socket says 172.21.15.45:55202) 2023-12-08T08:15:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.723+0000 7f554affd640 1 -- 172.21.15.45:0/2211988278 learned_addr learned my addr 172.21.15.45:0/2211988278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 -- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c0c1dc0 msgr2=0x7f554c1df800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c0c1dc0 0x7f554c1df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554b7fe640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c1521b0 0x7f554c14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 -- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c1521b0 msgr2=0x7f554c14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c1521b0 0x7f554c14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 -- 172.21.15.45:0/2211988278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0094d0 con 0x7f554c0a7910 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554affd640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c03ac60 con 0x7f554c0a7910 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c03adc0 con 0x7f554c0a7910 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c0c4e50 con 0x7f554c0a7910 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c044630 con 0x7f554c0a7910 2023-12-08T08:15:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.724+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c1dd4d0 con 0x7f554c0a7910 2023-12-08T08:15:34.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.725+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c150020 con 0x7f554c0a7910 2023-12-08T08:15:34.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.726+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f553c02f050 con 0x7f554c0a7910 2023-12-08T08:15:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.727+0000 7f5548ff9640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 0x7f552c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.727+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f553c0ab980 con 0x7f554c0a7910 2023-12-08T08:15:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.728+0000 7f55427fc640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 0x7f552c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.728+0000 7f55427fc640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 0x7f552c06d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55340012e0 tx=0x7f5534007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:34.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.732+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f553c0767d0 con 0x7f554c0a7910 2023-12-08T08:15:34.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.917+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f554c0a88d0 con 0x7f552c06ae40 2023-12-08T08:15:34.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.929+0000 7f5548ff9640 1 -- 172.21.15.45:0/2211988278 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345108 (secure 0 0 0) 0x7f554c0a88d0 con 0x7f552c06ae40 2023-12-08T08:15:34.936 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:34.938 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:15:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 msgr2=0x7f552c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 0x7f552c06d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55340012e0 tx=0x7f5534007d30 comp rx=0 tx=0).stop 2023-12-08T08:15:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 msgr2=0x7f554c1dcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 shutdown_connections 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f552c06ae40 0x7f552c06d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f554c0c1dc0 0x7f554c1df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c1521b0 0x7f554c14e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 --2- 172.21.15.45:0/2211988278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f554c0a7910 0x7f554c1dcf90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 >> 172.21.15.45:0/2211988278 conn(0x7f554c0c5780 msgr2=0x7f554c150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 shutdown_connections 2023-12-08T08:15:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:34.936+0000 7f554bfff640 1 -- 172.21.15.45:0/2211988278 wait complete. 2023-12-08T08:15:34.956 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-08T08:15:33.712270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2052074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008583"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415173+0000","last_change":"2023-12-08T08:14:59.898411+0000","last_active":"2023-12-08T08:15:04.415173+0000","last_peered":"2023-12-08T08:15:04.415173+0000","last_clean":"2023-12-08T08:15:04.415173+0000","last_became_active":"2023-12-08T08:14:59.898087+0000","last_became_peered":"2023-12-08T08:14:59.898087+0000","last_unstale":"2023-12-08T08:15:04.415173+0000","last_undegraded":"2023-12-08T08:15:04.415173+0000","last_fullsized":"2023-12-08T08:15:04.415173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418248+0000","last_change":"2023-12-08T08:15:00.400659+0000","last_active":"2023-12-08T08:15:04.418248+0000","last_peered":"2023-12-08T08:15:04.418248+0000","last_clean":"2023-12-08T08:15:04.418248+0000","last_became_active":"2023-12-08T08:15:00.400402+0000","last_became_peered":"2023-12-08T08:15:00.400402+0000","last_unstale":"2023-12-08T08:15:04.418248+0000","last_undegraded":"2023-12-08T08:15:04.418248+0000","last_fullsized":"2023-12-08T08:15:04.418248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458501+0000","last_change":"2023-12-08T08:15:04.453443+0000","last_active":"2023-12-08T08:15:05.458501+0000","last_peered":"2023-12-08T08:15:05.458501+0000","last_clean":"2023-12-08T08:15:05.458501+0000","last_became_active":"2023-12-08T08:15:04.452135+0000","last_became_peered":"2023-12-08T08:15:04.452135+0000","last_unstale":"2023-12-08T08:15:05.458501+0000","last_undegraded":"2023-12-08T08:15:05.458501+0000","last_fullsized":"2023-12-08T08:15:05.458501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418337+0000","last_change":"2023-12-08T08:14:59.893365+0000","last_active":"2023-12-08T08:15:04.418337+0000","last_peered":"2023-12-08T08:15:04.418337+0000","last_clean":"2023-12-08T08:15:04.418337+0000","last_became_active":"2023-12-08T08:14:59.893005+0000","last_became_peered":"2023-12-08T08:14:59.893005+0000","last_unstale":"2023-12-08T08:15:04.418337+0000","last_undegraded":"2023-12-08T08:15:04.418337+0000","last_fullsized":"2023-12-08T08:15:04.418337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414647+0000","last_change":"2023-12-08T08:15:00.406552+0000","last_active":"2023-12-08T08:15:04.414647+0000","last_peered":"2023-12-08T08:15:04.414647+0000","last_clean":"2023-12-08T08:15:04.414647+0000","last_became_active":"2023-12-08T08:15:00.406233+0000","last_became_peered":"2023-12-08T08:15:00.406233+0000","last_unstale":"2023-12-08T08:15:04.414647+0000","last_undegraded":"2023-12-08T08:15:04.414647+0000","last_fullsized":"2023-12-08T08:15:04.414647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459861+0000","last_change":"2023-12-08T08:15:04.424143+0000","last_active":"2023-12-08T08:15:05.459861+0000","last_peered":"2023-12-08T08:15:05.459861+0000","last_clean":"2023-12-08T08:15:05.459861+0000","last_became_active":"2023-12-08T08:15:04.423467+0000","last_became_peered":"2023-12-08T08:15:04.423467+0000","last_unstale":"2023-12-08T08:15:05.459861+0000","last_undegraded":"2023-12-08T08:15:05.459861+0000","last_fullsized":"2023-12-08T08:15:05.459861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:29.771854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447512+0000","last_change":"2023-12-08T08:14:59.904046+0000","last_active":"2023-12-08T08:15:04.447512+0000","last_peered":"2023-12-08T08:15:04.447512+0000","last_clean":"2023-12-08T08:15:04.447512+0000","last_became_active":"2023-12-08T08:14:59.903718+0000","last_became_peered":"2023-12-08T08:14:59.903718+0000","last_unstale":"2023-12-08T08:15:04.447512+0000","last_undegraded":"2023-12-08T08:15:04.447512+0000","last_fullsized":"2023-12-08T08:15:04.447512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420529+0000","last_change":"2023-12-08T08:15:00.406898+0000","last_active":"2023-12-08T08:15:04.420529+0000","last_peered":"2023-12-08T08:15:04.420529+0000","last_clean":"2023-12-08T08:15:04.420529+0000","last_became_active":"2023-12-08T08:15:00.406517+0000","last_became_peered":"2023-12-08T08:15:00.406517+0000","last_unstale":"2023-12-08T08:15:04.420529+0000","last_undegraded":"2023-12-08T08:15:04.420529+0000","last_fullsized":"2023-12-08T08:15:04.420529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459980+0000","last_change":"2023-12-08T08:15:04.428944+0000","last_active":"2023-12-08T08:15:05.459980+0000","last_peered":"2023-12-08T08:15:05.459980+0000","last_clean":"2023-12-08T08:15:05.459980+0000","last_became_active":"2023-12-08T08:15:04.428540+0000","last_became_peered":"2023-12-08T08:15:04.428540+0000","last_unstale":"2023-12-08T08:15:05.459980+0000","last_undegraded":"2023-12-08T08:15:05.459980+0000","last_fullsized":"2023-12-08T08:15:05.459980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:04.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447284+0000","last_change":"2023-12-08T08:14:59.902948+0000","last_active":"2023-12-08T08:15:04.447284+0000","last_peered":"2023-12-08T08:15:04.447284+0000","last_clean":"2023-12-08T08:15:04.447284+0000","last_became_active":"2023-12-08T08:14:59.902634+0000","last_became_peered":"2023-12-08T08:14:59.902634+0000","last_unstale":"2023-12-08T08:15:04.447284+0000","last_undegraded":"2023-12-08T08:15:04.447284+0000","last_fullsized":"2023-12-08T08:15:04.447284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420794+0000","last_change":"2023-12-08T08:15:00.406587+0000","last_active":"2023-12-08T08:15:04.420794+0000","last_peered":"2023-12-08T08:15:04.420794+0000","last_clean":"2023-12-08T08:15:04.420794+0000","last_became_active":"2023-12-08T08:15:00.406175+0000","last_became_peered":"2023-12-08T08:15:00.406175+0000","last_unstale":"2023-12-08T08:15:04.420794+0000","last_undegraded":"2023-12-08T08:15:04.420794+0000","last_fullsized":"2023-12-08T08:15:04.420794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460150+0000","last_change":"2023-12-08T08:15:04.431781+0000","last_active":"2023-12-08T08:15:05.460150+0000","last_peered":"2023-12-08T08:15:05.460150+0000","last_clean":"2023-12-08T08:15:05.460150+0000","last_became_active":"2023-12-08T08:15:04.431019+0000","last_became_peered":"2023-12-08T08:15:04.431019+0000","last_unstale":"2023-12-08T08:15:05.460150+0000","last_undegraded":"2023-12-08T08:15:05.460150+0000","last_fullsized":"2023-12-08T08:15:05.460150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:53.015719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414786+0000","last_change":"2023-12-08T08:15:00.410434+0000","last_active":"2023-12-08T08:15:04.414786+0000","last_peered":"2023-12-08T08:15:04.414786+0000","last_clean":"2023-12-08T08:15:04.414786+0000","last_became_active":"2023-12-08T08:15:00.410133+0000","last_became_peered":"2023-12-08T08:15:00.410133+0000","last_unstale":"2023-12-08T08:15:04.414786+0000","last_undegraded":"2023-12-08T08:15:04.414786+0000","last_fullsized":"2023-12-08T08:15:04.414786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447343+0000","last_change":"2023-12-08T08:14:59.900992+0000","last_active":"2023-12-08T08:15:04.447343+0000","last_peered":"2023-12-08T08:15:04.447343+0000","last_clean":"2023-12-08T08:15:04.447343+0000","last_became_active":"2023-12-08T08:14:59.900704+0000","last_became_peered":"2023-12-08T08:14:59.900704+0000","last_unstale":"2023-12-08T08:15:04.447343+0000","last_undegraded":"2023-12-08T08:15:04.447343+0000","last_fullsized":"2023-12-08T08:15:04.447343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462144+0000","last_change":"2023-12-08T08:15:04.426039+0000","last_active":"2023-12-08T08:15:05.462144+0000","last_peered":"2023-12-08T08:15:05.462144+0000","last_clean":"2023-12-08T08:15:05.462144+0000","last_became_active":"2023-12-08T08:15:04.425634+0000","last_became_peered":"2023-12-08T08:15:04.425634+0000","last_unstale":"2023-12-08T08:15:05.462144+0000","last_undegraded":"2023-12-08T08:15:05.462144+0000","last_fullsized":"2023-12-08T08:15:05.462144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418936+0000","last_change":"2023-12-08T08:15:00.393587+0000","last_active":"2023-12-08T08:15:04.418936+0000","last_peered":"2023-12-08T08:15:04.418936+0000","last_clean":"2023-12-08T08:15:04.418936+0000","last_became_active":"2023-12-08T08:15:00.393295+0000","last_became_peered":"2023-12-08T08:15:00.393295+0000","last_unstale":"2023-12-08T08:15:04.418936+0000","last_undegraded":"2023-12-08T08:15:04.418936+0000","last_fullsized":"2023-12-08T08:15:04.418936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412109+0000","last_change":"2023-12-08T08:14:59.888865+0000","last_active":"2023-12-08T08:15:04.412109+0000","last_peered":"2023-12-08T08:15:04.412109+0000","last_clean":"2023-12-08T08:15:04.412109+0000","last_became_active":"2023-12-08T08:14:59.887707+0000","last_became_peered":"2023-12-08T08:14:59.887707+0000","last_unstale":"2023-12-08T08:15:04.412109+0000","last_undegraded":"2023-12-08T08:15:04.412109+0000","last_fullsized":"2023-12-08T08:15:04.412109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:15.716120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461262+0000","last_change":"2023-12-08T08:15:04.436250+0000","last_active":"2023-12-08T08:15:05.461262+0000","last_peered":"2023-12-08T08:15:05.461262+0000","last_clean":"2023-12-08T08:15:05.461262+0000","last_became_active":"2023-12-08T08:15:04.435842+0000","last_became_peered":"2023-12-08T08:15:04.435842+0000","last_unstale":"2023-12-08T08:15:05.461262+0000","last_undegraded":"2023-12-08T08:15:05.461262+0000","last_fullsized":"2023-12-08T08:15:05.461262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:04.471421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411456+0000","last_change":"2023-12-08T08:15:00.384226+0000","last_active":"2023-12-08T08:15:04.411456+0000","last_peered":"2023-12-08T08:15:04.411456+0000","last_clean":"2023-12-08T08:15:04.411456+0000","last_became_active":"2023-12-08T08:15:00.383033+0000","last_became_peered":"2023-12-08T08:15:00.383033+0000","last_unstale":"2023-12-08T08:15:04.411456+0000","last_undegraded":"2023-12-08T08:15:04.411456+0000","last_fullsized":"2023-12-08T08:15:04.411456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406179+0000","last_change":"2023-12-08T08:14:59.899324+0000","last_active":"2023-12-08T08:15:04.406179+0000","last_peered":"2023-12-08T08:15:04.406179+0000","last_clean":"2023-12-08T08:15:04.406179+0000","last_became_active":"2023-12-08T08:14:59.898940+0000","last_became_peered":"2023-12-08T08:14:59.898940+0000","last_unstale":"2023-12-08T08:15:04.406179+0000","last_undegraded":"2023-12-08T08:15:04.406179+0000","last_fullsized":"2023-12-08T08:15:04.406179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:24:38.577538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101970+0000","last_change":"2023-12-08T08:15:04.455030+0000","last_active":"2023-12-08T08:15:07.101970+0000","last_peered":"2023-12-08T08:15:07.101970+0000","last_clean":"2023-12-08T08:15:07.101970+0000","last_became_active":"2023-12-08T08:15:04.454398+0000","last_became_peered":"2023-12-08T08:15:04.454398+0000","last_unstale":"2023-12-08T08:15:07.101970+0000","last_undegraded":"2023-12-08T08:15:07.101970+0000","last_fullsized":"2023-12-08T08:15:07.101970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:34.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409201+0000","last_change":"2023-12-08T08:15:00.388016+0000","last_active":"2023-12-08T08:15:04.409201+0000","last_peered":"2023-12-08T08:15:04.409201+0000","last_clean":"2023-12-08T08:15:04.409201+0000","last_became_active":"2023-12-08T08:15:00.387713+0000","last_became_peered":"2023-12-08T08:15:00.387713+0000","last_unstale":"2023-12-08T08:15:04.409201+0000","last_undegraded":"2023-12-08T08:15:04.409201+0000","last_fullsized":"2023-12-08T08:15:04.409201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:22.475961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446683+0000","last_change":"2023-12-08T08:14:59.899277+0000","last_active":"2023-12-08T08:15:04.446683+0000","last_peered":"2023-12-08T08:15:04.446683+0000","last_clean":"2023-12-08T08:15:04.446683+0000","last_became_active":"2023-12-08T08:14:59.898967+0000","last_became_peered":"2023-12-08T08:14:59.898967+0000","last_unstale":"2023-12-08T08:15:04.446683+0000","last_undegraded":"2023-12-08T08:15:04.446683+0000","last_fullsized":"2023-12-08T08:15:04.446683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462027+0000","last_change":"2023-12-08T08:15:04.436197+0000","last_active":"2023-12-08T08:15:05.462027+0000","last_peered":"2023-12-08T08:15:05.462027+0000","last_clean":"2023-12-08T08:15:05.462027+0000","last_became_active":"2023-12-08T08:15:04.435697+0000","last_became_peered":"2023-12-08T08:15:04.435697+0000","last_unstale":"2023-12-08T08:15:05.462027+0000","last_undegraded":"2023-12-08T08:15:05.462027+0000","last_fullsized":"2023-12-08T08:15:05.462027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:49.330205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411625+0000","last_change":"2023-12-08T08:15:00.391674+0000","last_active":"2023-12-08T08:15:04.411625+0000","last_peered":"2023-12-08T08:15:04.411625+0000","last_clean":"2023-12-08T08:15:04.411625+0000","last_became_active":"2023-12-08T08:15:00.390682+0000","last_became_peered":"2023-12-08T08:15:00.390682+0000","last_unstale":"2023-12-08T08:15:04.411625+0000","last_undegraded":"2023-12-08T08:15:04.411625+0000","last_fullsized":"2023-12-08T08:15:04.411625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414108+0000","last_change":"2023-12-08T08:14:59.899700+0000","last_active":"2023-12-08T08:15:04.414108+0000","last_peered":"2023-12-08T08:15:04.414108+0000","last_clean":"2023-12-08T08:15:04.414108+0000","last_became_active":"2023-12-08T08:14:59.899369+0000","last_became_peered":"2023-12-08T08:14:59.899369+0000","last_unstale":"2023-12-08T08:15:04.414108+0000","last_undegraded":"2023-12-08T08:15:04.414108+0000","last_fullsized":"2023-12-08T08:15:04.414108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460310+0000","last_change":"2023-12-08T08:15:04.455315+0000","last_active":"2023-12-08T08:15:05.460310+0000","last_peered":"2023-12-08T08:15:05.460310+0000","last_clean":"2023-12-08T08:15:05.460310+0000","last_became_active":"2023-12-08T08:15:04.454254+0000","last_became_peered":"2023-12-08T08:15:04.454254+0000","last_unstale":"2023-12-08T08:15:05.460310+0000","last_undegraded":"2023-12-08T08:15:05.460310+0000","last_fullsized":"2023-12-08T08:15:05.460310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:24.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418747+0000","last_change":"2023-12-08T08:15:00.396084+0000","last_active":"2023-12-08T08:15:04.418747+0000","last_peered":"2023-12-08T08:15:04.418747+0000","last_clean":"2023-12-08T08:15:04.418747+0000","last_became_active":"2023-12-08T08:15:00.395265+0000","last_became_peered":"2023-12-08T08:15:00.395265+0000","last_unstale":"2023-12-08T08:15:04.418747+0000","last_undegraded":"2023-12-08T08:15:04.418747+0000","last_fullsized":"2023-12-08T08:15:04.418747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.426589+0000","last_change":"2023-12-08T08:14:59.895090+0000","last_active":"2023-12-08T08:15:04.426589+0000","last_peered":"2023-12-08T08:15:04.426589+0000","last_clean":"2023-12-08T08:15:04.426589+0000","last_became_active":"2023-12-08T08:14:59.894777+0000","last_became_peered":"2023-12-08T08:14:59.894777+0000","last_unstale":"2023-12-08T08:15:04.426589+0000","last_undegraded":"2023-12-08T08:15:04.426589+0000","last_fullsized":"2023-12-08T08:15:04.426589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:42:30.101863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458217+0000","last_change":"2023-12-08T08:15:04.450602+0000","last_active":"2023-12-08T08:15:05.458217+0000","last_peered":"2023-12-08T08:15:05.458217+0000","last_clean":"2023-12-08T08:15:05.458217+0000","last_became_active":"2023-12-08T08:15:04.450177+0000","last_became_peered":"2023-12-08T08:15:04.450177+0000","last_unstale":"2023-12-08T08:15:05.458217+0000","last_undegraded":"2023-12-08T08:15:05.458217+0000","last_fullsized":"2023-12-08T08:15:05.458217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429732+0000","last_change":"2023-12-08T08:15:00.385032+0000","last_active":"2023-12-08T08:15:04.429732+0000","last_peered":"2023-12-08T08:15:04.429732+0000","last_clean":"2023-12-08T08:15:04.429732+0000","last_became_active":"2023-12-08T08:15:00.384743+0000","last_became_peered":"2023-12-08T08:15:00.384743+0000","last_unstale":"2023-12-08T08:15:04.429732+0000","last_undegraded":"2023-12-08T08:15:04.429732+0000","last_fullsized":"2023-12-08T08:15:04.429732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:35:06.342242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447602+0000","last_change":"2023-12-08T08:14:59.902751+0000","last_active":"2023-12-08T08:15:04.447602+0000","last_peered":"2023-12-08T08:15:04.447602+0000","last_clean":"2023-12-08T08:15:04.447602+0000","last_became_active":"2023-12-08T08:14:59.901168+0000","last_became_peered":"2023-12-08T08:14:59.901168+0000","last_unstale":"2023-12-08T08:15:04.447602+0000","last_undegraded":"2023-12-08T08:15:04.447602+0000","last_fullsized":"2023-12-08T08:15:04.447602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803013+0000","last_change":"2023-12-08T08:15:04.452893+0000","last_active":"2023-12-08T08:15:05.803013+0000","last_peered":"2023-12-08T08:15:05.803013+0000","last_clean":"2023-12-08T08:15:05.803013+0000","last_became_active":"2023-12-08T08:15:04.450264+0000","last_became_peered":"2023-12-08T08:15:04.450264+0000","last_unstale":"2023-12-08T08:15:05.803013+0000","last_undegraded":"2023-12-08T08:15:05.803013+0000","last_fullsized":"2023-12-08T08:15:05.803013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:28.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420877+0000","last_change":"2023-12-08T08:15:00.407555+0000","last_active":"2023-12-08T08:15:04.420877+0000","last_peered":"2023-12-08T08:15:04.420877+0000","last_clean":"2023-12-08T08:15:04.420877+0000","last_became_active":"2023-12-08T08:15:00.405681+0000","last_became_peered":"2023-12-08T08:15:00.405681+0000","last_unstale":"2023-12-08T08:15:04.420877+0000","last_undegraded":"2023-12-08T08:15:04.420877+0000","last_fullsized":"2023-12-08T08:15:04.420877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429823+0000","last_change":"2023-12-08T08:14:59.891702+0000","last_active":"2023-12-08T08:15:04.429823+0000","last_peered":"2023-12-08T08:15:04.429823+0000","last_clean":"2023-12-08T08:15:04.429823+0000","last_became_active":"2023-12-08T08:14:59.891334+0000","last_became_peered":"2023-12-08T08:14:59.891334+0000","last_unstale":"2023-12-08T08:15:04.429823+0000","last_undegraded":"2023-12-08T08:15:04.429823+0000","last_fullsized":"2023-12-08T08:15:04.429823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.998701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101106+0000","last_change":"2023-12-08T08:15:04.437404+0000","last_active":"2023-12-08T08:15:07.101106+0000","last_peered":"2023-12-08T08:15:07.101106+0000","last_clean":"2023-12-08T08:15:07.101106+0000","last_became_active":"2023-12-08T08:15:04.436999+0000","last_became_peered":"2023-12-08T08:15:04.436999+0000","last_unstale":"2023-12-08T08:15:07.101106+0000","last_undegraded":"2023-12-08T08:15:07.101106+0000","last_fullsized":"2023-12-08T08:15:07.101106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:02.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411360+0000","last_change":"2023-12-08T08:15:00.391653+0000","last_active":"2023-12-08T08:15:04.411360+0000","last_peered":"2023-12-08T08:15:04.411360+0000","last_clean":"2023-12-08T08:15:04.411360+0000","last_became_active":"2023-12-08T08:15:00.391313+0000","last_became_peered":"2023-12-08T08:15:00.391313+0000","last_unstale":"2023-12-08T08:15:04.411360+0000","last_undegraded":"2023-12-08T08:15:04.411360+0000","last_fullsized":"2023-12-08T08:15:04.411360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:34.599318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422649+0000","last_change":"2023-12-08T08:14:59.896775+0000","last_active":"2023-12-08T08:15:04.422649+0000","last_peered":"2023-12-08T08:15:04.422649+0000","last_clean":"2023-12-08T08:15:04.422649+0000","last_became_active":"2023-12-08T08:14:59.896211+0000","last_became_peered":"2023-12-08T08:14:59.896211+0000","last_unstale":"2023-12-08T08:15:04.422649+0000","last_undegraded":"2023-12-08T08:15:04.422649+0000","last_fullsized":"2023-12-08T08:15:04.422649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.102468+0000","last_change":"2023-12-08T08:15:04.438749+0000","last_active":"2023-12-08T08:15:07.102468+0000","last_peered":"2023-12-08T08:15:07.102468+0000","last_clean":"2023-12-08T08:15:07.102468+0000","last_became_active":"2023-12-08T08:15:04.436716+0000","last_became_peered":"2023-12-08T08:15:04.436716+0000","last_unstale":"2023-12-08T08:15:07.102468+0000","last_undegraded":"2023-12-08T08:15:07.102468+0000","last_fullsized":"2023-12-08T08:15:07.102468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:34.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406210+0000","last_change":"2023-12-08T08:15:00.376354+0000","last_active":"2023-12-08T08:15:04.406210+0000","last_peered":"2023-12-08T08:15:04.406210+0000","last_clean":"2023-12-08T08:15:04.406210+0000","last_became_active":"2023-12-08T08:15:00.374398+0000","last_became_peered":"2023-12-08T08:15:00.374398+0000","last_unstale":"2023-12-08T08:15:04.406210+0000","last_undegraded":"2023-12-08T08:15:04.406210+0000","last_fullsized":"2023-12-08T08:15:04.406210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:19.043505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395880+0000","last_change":"2023-12-08T08:14:59.884051+0000","last_active":"2023-12-08T08:15:04.395880+0000","last_peered":"2023-12-08T08:15:04.395880+0000","last_clean":"2023-12-08T08:15:04.395880+0000","last_became_active":"2023-12-08T08:14:59.883147+0000","last_became_peered":"2023-12-08T08:14:59.883147+0000","last_unstale":"2023-12-08T08:15:04.395880+0000","last_undegraded":"2023-12-08T08:15:04.395880+0000","last_fullsized":"2023-12-08T08:15:04.395880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101903+0000","last_change":"2023-12-08T08:15:04.440056+0000","last_active":"2023-12-08T08:15:07.101903+0000","last_peered":"2023-12-08T08:15:07.101903+0000","last_clean":"2023-12-08T08:15:07.101903+0000","last_became_active":"2023-12-08T08:15:04.434505+0000","last_became_peered":"2023-12-08T08:15:04.434505+0000","last_unstale":"2023-12-08T08:15:07.101903+0000","last_undegraded":"2023-12-08T08:15:07.101903+0000","last_fullsized":"2023-12-08T08:15:07.101903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:15:37.562984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409609+0000","last_change":"2023-12-08T08:15:00.394588+0000","last_active":"2023-12-08T08:15:04.409609+0000","last_peered":"2023-12-08T08:15:04.409609+0000","last_clean":"2023-12-08T08:15:04.409609+0000","last_became_active":"2023-12-08T08:15:00.394253+0000","last_became_peered":"2023-12-08T08:15:00.394253+0000","last_unstale":"2023-12-08T08:15:04.409609+0000","last_undegraded":"2023-12-08T08:15:04.409609+0000","last_fullsized":"2023-12-08T08:15:04.409609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:56.350634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446691+0000","last_change":"2023-12-08T08:14:59.898943+0000","last_active":"2023-12-08T08:15:04.446691+0000","last_peered":"2023-12-08T08:15:04.446691+0000","last_clean":"2023-12-08T08:15:04.446691+0000","last_became_active":"2023-12-08T08:14:59.898630+0000","last_became_peered":"2023-12-08T08:14:59.898630+0000","last_unstale":"2023-12-08T08:15:04.446691+0000","last_undegraded":"2023-12-08T08:15:04.446691+0000","last_fullsized":"2023-12-08T08:15:04.446691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804702+0000","last_change":"2023-12-08T08:15:04.450619+0000","last_active":"2023-12-08T08:15:05.804702+0000","last_peered":"2023-12-08T08:15:05.804702+0000","last_clean":"2023-12-08T08:15:05.804702+0000","last_became_active":"2023-12-08T08:15:04.450208+0000","last_became_peered":"2023-12-08T08:15:04.450208+0000","last_unstale":"2023-12-08T08:15:05.804702+0000","last_undegraded":"2023-12-08T08:15:05.804702+0000","last_fullsized":"2023-12-08T08:15:05.804702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.417267+0000","last_change":"2023-12-08T08:15:00.403719+0000","last_active":"2023-12-08T08:15:04.417267+0000","last_peered":"2023-12-08T08:15:04.417267+0000","last_clean":"2023-12-08T08:15:04.417267+0000","last_became_active":"2023-12-08T08:15:00.403491+0000","last_became_peered":"2023-12-08T08:15:00.403491+0000","last_unstale":"2023-12-08T08:15:04.417267+0000","last_undegraded":"2023-12-08T08:15:04.417267+0000","last_fullsized":"2023-12-08T08:15:04.417267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420401+0000","last_change":"2023-12-08T08:14:59.902488+0000","last_active":"2023-12-08T08:15:04.420401+0000","last_peered":"2023-12-08T08:15:04.420401+0000","last_clean":"2023-12-08T08:15:04.420401+0000","last_became_active":"2023-12-08T08:14:59.900551+0000","last_became_peered":"2023-12-08T08:14:59.900551+0000","last_unstale":"2023-12-08T08:15:04.420401+0000","last_undegraded":"2023-12-08T08:15:04.420401+0000","last_fullsized":"2023-12-08T08:15:04.420401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:18.269135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446793+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:15:04.446793+0000","last_peered":"2023-12-08T08:15:04.446793+0000","last_clean":"2023-12-08T08:15:04.446793+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:15:04.446793+0000","last_undegraded":"2023-12-08T08:15:04.446793+0000","last_fullsized":"2023-12-08T08:15:04.446793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808886+0000","last_change":"2023-12-08T08:15:04.456732+0000","last_active":"2023-12-08T08:15:05.808886+0000","last_peered":"2023-12-08T08:15:05.808886+0000","last_clean":"2023-12-08T08:15:05.808886+0000","last_became_active":"2023-12-08T08:15:04.454528+0000","last_became_peered":"2023-12-08T08:15:04.454528+0000","last_unstale":"2023-12-08T08:15:05.808886+0000","last_undegraded":"2023-12-08T08:15:05.808886+0000","last_fullsized":"2023-12-08T08:15:05.808886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:47.706869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447305+0000","last_change":"2023-12-08T08:15:00.407924+0000","last_active":"2023-12-08T08:15:04.447305+0000","last_peered":"2023-12-08T08:15:04.447305+0000","last_clean":"2023-12-08T08:15:04.447305+0000","last_became_active":"2023-12-08T08:15:00.407393+0000","last_became_peered":"2023-12-08T08:15:00.407393+0000","last_unstale":"2023-12-08T08:15:04.447305+0000","last_undegraded":"2023-12-08T08:15:04.447305+0000","last_fullsized":"2023-12-08T08:15:04.447305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396937+0000","last_change":"2023-12-08T08:14:59.900649+0000","last_active":"2023-12-08T08:15:04.396937+0000","last_peered":"2023-12-08T08:15:04.396937+0000","last_clean":"2023-12-08T08:15:04.396937+0000","last_became_active":"2023-12-08T08:14:59.900269+0000","last_became_peered":"2023-12-08T08:14:59.900269+0000","last_unstale":"2023-12-08T08:15:04.396937+0000","last_undegraded":"2023-12-08T08:15:04.396937+0000","last_fullsized":"2023-12-08T08:15:04.396937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808319+0000","last_change":"2023-12-08T08:15:04.450623+0000","last_active":"2023-12-08T08:15:05.808319+0000","last_peered":"2023-12-08T08:15:05.808319+0000","last_clean":"2023-12-08T08:15:05.808319+0000","last_became_active":"2023-12-08T08:15:04.450114+0000","last_became_peered":"2023-12-08T08:15:04.450114+0000","last_unstale":"2023-12-08T08:15:05.808319+0000","last_undegraded":"2023-12-08T08:15:05.808319+0000","last_fullsized":"2023-12-08T08:15:05.808319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420632+0000","last_change":"2023-12-08T08:15:00.405005+0000","last_active":"2023-12-08T08:15:04.420632+0000","last_peered":"2023-12-08T08:15:04.420632+0000","last_clean":"2023-12-08T08:15:04.420632+0000","last_became_active":"2023-12-08T08:15:00.399553+0000","last_became_peered":"2023-12-08T08:15:00.399553+0000","last_unstale":"2023-12-08T08:15:04.420632+0000","last_undegraded":"2023-12-08T08:15:04.420632+0000","last_fullsized":"2023-12-08T08:15:04.420632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425547+0000","last_change":"2023-12-08T08:14:59.883073+0000","last_active":"2023-12-08T08:15:04.425547+0000","last_peered":"2023-12-08T08:15:04.425547+0000","last_clean":"2023-12-08T08:15:04.425547+0000","last_became_active":"2023-12-08T08:14:59.882846+0000","last_became_peered":"2023-12-08T08:14:59.882846+0000","last_unstale":"2023-12-08T08:15:04.425547+0000","last_undegraded":"2023-12-08T08:15:04.425547+0000","last_fullsized":"2023-12-08T08:15:04.425547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:19.331838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803008+0000","last_change":"2023-12-08T08:15:04.429843+0000","last_active":"2023-12-08T08:15:05.803008+0000","last_peered":"2023-12-08T08:15:05.803008+0000","last_clean":"2023-12-08T08:15:05.803008+0000","last_became_active":"2023-12-08T08:15:04.429319+0000","last_became_peered":"2023-12-08T08:15:04.429319+0000","last_unstale":"2023-12-08T08:15:05.803008+0000","last_undegraded":"2023-12-08T08:15:05.803008+0000","last_fullsized":"2023-12-08T08:15:05.803008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:37.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447921+0000","last_change":"2023-12-08T08:15:00.410615+0000","last_active":"2023-12-08T08:15:04.447921+0000","last_peered":"2023-12-08T08:15:04.447921+0000","last_clean":"2023-12-08T08:15:04.447921+0000","last_became_active":"2023-12-08T08:15:00.410331+0000","last_became_peered":"2023-12-08T08:15:00.410331+0000","last_unstale":"2023-12-08T08:15:04.447921+0000","last_undegraded":"2023-12-08T08:15:04.447921+0000","last_fullsized":"2023-12-08T08:15:04.447921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:25.467790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396751+0000","last_change":"2023-12-08T08:14:59.886431+0000","last_active":"2023-12-08T08:15:04.396751+0000","last_peered":"2023-12-08T08:15:04.396751+0000","last_clean":"2023-12-08T08:15:04.396751+0000","last_became_active":"2023-12-08T08:14:59.884506+0000","last_became_peered":"2023-12-08T08:14:59.884506+0000","last_unstale":"2023-12-08T08:15:04.396751+0000","last_undegraded":"2023-12-08T08:15:04.396751+0000","last_fullsized":"2023-12-08T08:15:04.396751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:49.879584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.873898+0000","last_change":"2023-12-08T08:15:04.451208+0000","last_active":"2023-12-08T08:15:05.873898+0000","last_peered":"2023-12-08T08:15:05.873898+0000","last_clean":"2023-12-08T08:15:05.873898+0000","last_became_active":"2023-12-08T08:15:04.450428+0000","last_became_peered":"2023-12-08T08:15:04.450428+0000","last_unstale":"2023-12-08T08:15:05.873898+0000","last_undegraded":"2023-12-08T08:15:05.873898+0000","last_fullsized":"2023-12-08T08:15:05.873898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447664+0000","last_change":"2023-12-08T08:15:00.404999+0000","last_active":"2023-12-08T08:15:04.447664+0000","last_peered":"2023-12-08T08:15:04.447664+0000","last_clean":"2023-12-08T08:15:04.447664+0000","last_became_active":"2023-12-08T08:15:00.400794+0000","last_became_peered":"2023-12-08T08:15:00.400794+0000","last_unstale":"2023-12-08T08:15:04.447664+0000","last_undegraded":"2023-12-08T08:15:04.447664+0000","last_fullsized":"2023-12-08T08:15:04.447664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.400585+0000","last_change":"2023-12-08T08:14:59.892750+0000","last_active":"2023-12-08T08:15:04.400585+0000","last_peered":"2023-12-08T08:15:04.400585+0000","last_clean":"2023-12-08T08:15:04.400585+0000","last_became_active":"2023-12-08T08:14:59.892365+0000","last_became_peered":"2023-12-08T08:14:59.892365+0000","last_unstale":"2023-12-08T08:15:04.400585+0000","last_undegraded":"2023-12-08T08:15:04.400585+0000","last_fullsized":"2023-12-08T08:15:04.400585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459457+0000","last_change":"2023-12-08T08:15:04.426203+0000","last_active":"2023-12-08T08:15:05.459457+0000","last_peered":"2023-12-08T08:15:05.459457+0000","last_clean":"2023-12-08T08:15:05.459457+0000","last_became_active":"2023-12-08T08:15:04.425489+0000","last_became_peered":"2023-12-08T08:15:04.425489+0000","last_unstale":"2023-12-08T08:15:05.459457+0000","last_undegraded":"2023-12-08T08:15:05.459457+0000","last_fullsized":"2023-12-08T08:15:05.459457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:21.113790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447843+0000","last_change":"2023-12-08T08:15:00.409331+0000","last_active":"2023-12-08T08:15:04.447843+0000","last_peered":"2023-12-08T08:15:04.447843+0000","last_clean":"2023-12-08T08:15:04.447843+0000","last_became_active":"2023-12-08T08:15:00.408754+0000","last_became_peered":"2023-12-08T08:15:00.408754+0000","last_unstale":"2023-12-08T08:15:04.447843+0000","last_undegraded":"2023-12-08T08:15:04.447843+0000","last_fullsized":"2023-12-08T08:15:04.447843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395799+0000","last_change":"2023-12-08T08:14:59.894408+0000","last_active":"2023-12-08T08:15:04.395799+0000","last_peered":"2023-12-08T08:15:04.395799+0000","last_clean":"2023-12-08T08:15:04.395799+0000","last_became_active":"2023-12-08T08:14:59.893999+0000","last_became_peered":"2023-12-08T08:14:59.893999+0000","last_unstale":"2023-12-08T08:15:04.395799+0000","last_undegraded":"2023-12-08T08:15:04.395799+0000","last_fullsized":"2023-12-08T08:15:04.395799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804517+0000","last_change":"2023-12-08T08:15:04.433419+0000","last_active":"2023-12-08T08:15:05.804517+0000","last_peered":"2023-12-08T08:15:05.804517+0000","last_clean":"2023-12-08T08:15:05.804517+0000","last_became_active":"2023-12-08T08:15:04.432977+0000","last_became_peered":"2023-12-08T08:15:04.432977+0000","last_unstale":"2023-12-08T08:15:05.804517+0000","last_undegraded":"2023-12-08T08:15:05.804517+0000","last_fullsized":"2023-12-08T08:15:05.804517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413084+0000","last_change":"2023-12-08T08:15:00.396829+0000","last_active":"2023-12-08T08:15:04.413084+0000","last_peered":"2023-12-08T08:15:04.413084+0000","last_clean":"2023-12-08T08:15:04.413084+0000","last_became_active":"2023-12-08T08:15:00.396388+0000","last_became_peered":"2023-12-08T08:15:00.396388+0000","last_unstale":"2023-12-08T08:15:04.413084+0000","last_undegraded":"2023-12-08T08:15:04.413084+0000","last_fullsized":"2023-12-08T08:15:04.413084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416151+0000","last_change":"2023-12-08T08:14:59.887882+0000","last_active":"2023-12-08T08:15:04.416151+0000","last_peered":"2023-12-08T08:15:04.416151+0000","last_clean":"2023-12-08T08:15:04.416151+0000","last_became_active":"2023-12-08T08:14:59.887386+0000","last_became_peered":"2023-12-08T08:14:59.887386+0000","last_unstale":"2023-12-08T08:15:04.416151+0000","last_undegraded":"2023-12-08T08:15:04.416151+0000","last_fullsized":"2023-12-08T08:15:04.416151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:02.576945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460992+0000","last_change":"2023-12-08T08:15:04.453192+0000","last_active":"2023-12-08T08:15:05.460992+0000","last_peered":"2023-12-08T08:15:05.460992+0000","last_clean":"2023-12-08T08:15:05.460992+0000","last_became_active":"2023-12-08T08:15:04.451164+0000","last_became_peered":"2023-12-08T08:15:04.451164+0000","last_unstale":"2023-12-08T08:15:05.460992+0000","last_undegraded":"2023-12-08T08:15:05.460992+0000","last_fullsized":"2023-12-08T08:15:05.460992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:43.529090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447335+0000","last_change":"2023-12-08T08:15:00.399582+0000","last_active":"2023-12-08T08:15:04.447335+0000","last_peered":"2023-12-08T08:15:04.447335+0000","last_clean":"2023-12-08T08:15:04.447335+0000","last_became_active":"2023-12-08T08:15:00.399251+0000","last_became_peered":"2023-12-08T08:15:00.399251+0000","last_unstale":"2023-12-08T08:15:04.447335+0000","last_undegraded":"2023-12-08T08:15:04.447335+0000","last_fullsized":"2023-12-08T08:15:04.447335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422568+0000","last_change":"2023-12-08T08:14:59.900340+0000","last_active":"2023-12-08T08:15:04.422568+0000","last_peered":"2023-12-08T08:15:04.422568+0000","last_clean":"2023-12-08T08:15:04.422568+0000","last_became_active":"2023-12-08T08:14:59.900040+0000","last_became_peered":"2023-12-08T08:14:59.900040+0000","last_unstale":"2023-12-08T08:15:04.422568+0000","last_undegraded":"2023-12-08T08:15:04.422568+0000","last_fullsized":"2023-12-08T08:15:04.422568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:12.707626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459907+0000","last_change":"2023-12-08T08:15:04.452930+0000","last_active":"2023-12-08T08:15:05.459907+0000","last_peered":"2023-12-08T08:15:05.459907+0000","last_clean":"2023-12-08T08:15:05.459907+0000","last_became_active":"2023-12-08T08:15:04.451134+0000","last_became_peered":"2023-12-08T08:15:04.451134+0000","last_unstale":"2023-12-08T08:15:05.459907+0000","last_undegraded":"2023-12-08T08:15:05.459907+0000","last_fullsized":"2023-12-08T08:15:05.459907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:41.298759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403685+0000","last_change":"2023-12-08T08:15:00.391149+0000","last_active":"2023-12-08T08:15:04.403685+0000","last_peered":"2023-12-08T08:15:04.403685+0000","last_clean":"2023-12-08T08:15:04.403685+0000","last_became_active":"2023-12-08T08:15:00.390876+0000","last_became_peered":"2023-12-08T08:15:00.390876+0000","last_unstale":"2023-12-08T08:15:04.403685+0000","last_undegraded":"2023-12-08T08:15:04.403685+0000","last_fullsized":"2023-12-08T08:15:04.403685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412304+0000","last_change":"2023-12-08T08:14:59.891130+0000","last_active":"2023-12-08T08:15:04.412304+0000","last_peered":"2023-12-08T08:15:04.412304+0000","last_clean":"2023-12-08T08:15:04.412304+0000","last_became_active":"2023-12-08T08:14:59.890441+0000","last_became_peered":"2023-12-08T08:14:59.890441+0000","last_unstale":"2023-12-08T08:15:04.412304+0000","last_undegraded":"2023-12-08T08:15:04.412304+0000","last_fullsized":"2023-12-08T08:15:04.412304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:37.110835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.875742+0000","last_change":"2023-12-08T08:15:04.451191+0000","last_active":"2023-12-08T08:15:05.875742+0000","last_peered":"2023-12-08T08:15:05.875742+0000","last_clean":"2023-12-08T08:15:05.875742+0000","last_became_active":"2023-12-08T08:15:04.450325+0000","last_became_peered":"2023-12-08T08:15:04.450325+0000","last_unstale":"2023-12-08T08:15:05.875742+0000","last_undegraded":"2023-12-08T08:15:05.875742+0000","last_fullsized":"2023-12-08T08:15:05.875742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447388+0000","last_change":"2023-12-08T08:15:00.398759+0000","last_active":"2023-12-08T08:15:04.447388+0000","last_peered":"2023-12-08T08:15:04.447388+0000","last_clean":"2023-12-08T08:15:04.447388+0000","last_became_active":"2023-12-08T08:15:00.392487+0000","last_became_peered":"2023-12-08T08:15:00.392487+0000","last_unstale":"2023-12-08T08:15:04.447388+0000","last_undegraded":"2023-12-08T08:15:04.447388+0000","last_fullsized":"2023-12-08T08:15:04.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:18.522009+0000","last_change":"2023-12-08T08:14:59.891354+0000","last_active":"2023-12-08T08:15:18.522009+0000","last_peered":"2023-12-08T08:15:18.522009+0000","last_clean":"2023-12-08T08:15:18.522009+0000","last_became_active":"2023-12-08T08:14:59.889600+0000","last_became_peered":"2023-12-08T08:14:59.889600+0000","last_unstale":"2023-12-08T08:15:18.522009+0000","last_undegraded":"2023-12-08T08:15:18.522009+0000","last_fullsized":"2023-12-08T08:15:18.522009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101560+0000","last_change":"2023-12-08T08:15:04.436224+0000","last_active":"2023-12-08T08:15:07.101560+0000","last_peered":"2023-12-08T08:15:07.101560+0000","last_clean":"2023-12-08T08:15:07.101560+0000","last_became_active":"2023-12-08T08:15:04.435773+0000","last_became_peered":"2023-12-08T08:15:04.435773+0000","last_unstale":"2023-12-08T08:15:07.101560+0000","last_undegraded":"2023-12-08T08:15:07.101560+0000","last_fullsized":"2023-12-08T08:15:07.101560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:37.657486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404952+0000","last_change":"2023-12-08T08:15:00.389958+0000","last_active":"2023-12-08T08:15:04.404952+0000","last_peered":"2023-12-08T08:15:04.404952+0000","last_clean":"2023-12-08T08:15:04.404952+0000","last_became_active":"2023-12-08T08:15:00.388877+0000","last_became_peered":"2023-12-08T08:15:00.388877+0000","last_unstale":"2023-12-08T08:15:04.404952+0000","last_undegraded":"2023-12-08T08:15:04.404952+0000","last_fullsized":"2023-12-08T08:15:04.404952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425438+0000","last_change":"2023-12-08T08:14:59.895842+0000","last_active":"2023-12-08T08:15:04.425438+0000","last_peered":"2023-12-08T08:15:04.425438+0000","last_clean":"2023-12-08T08:15:04.425438+0000","last_became_active":"2023-12-08T08:14:59.895535+0000","last_became_peered":"2023-12-08T08:14:59.895535+0000","last_unstale":"2023-12-08T08:15:04.425438+0000","last_undegraded":"2023-12-08T08:15:04.425438+0000","last_fullsized":"2023-12-08T08:15:04.425438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:30.765400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459762+0000","last_change":"2023-12-08T08:15:04.427188+0000","last_active":"2023-12-08T08:15:05.459762+0000","last_peered":"2023-12-08T08:15:05.459762+0000","last_clean":"2023-12-08T08:15:05.459762+0000","last_became_active":"2023-12-08T08:15:04.425996+0000","last_became_peered":"2023-12-08T08:15:04.425996+0000","last_unstale":"2023-12-08T08:15:05.459762+0000","last_undegraded":"2023-12-08T08:15:05.459762+0000","last_fullsized":"2023-12-08T08:15:05.459762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:29.438014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414847+0000","last_change":"2023-12-08T08:15:00.406403+0000","last_active":"2023-12-08T08:15:04.414847+0000","last_peered":"2023-12-08T08:15:04.414847+0000","last_clean":"2023-12-08T08:15:04.414847+0000","last_became_active":"2023-12-08T08:15:00.405993+0000","last_became_peered":"2023-12-08T08:15:00.405993+0000","last_unstale":"2023-12-08T08:15:04.414847+0000","last_undegraded":"2023-12-08T08:15:04.414847+0000","last_fullsized":"2023-12-08T08:15:04.414847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421161+0000","last_change":"2023-12-08T08:14:59.899499+0000","last_active":"2023-12-08T08:15:04.421161+0000","last_peered":"2023-12-08T08:15:04.421161+0000","last_clean":"2023-12-08T08:15:04.421161+0000","last_became_active":"2023-12-08T08:14:59.899208+0000","last_became_peered":"2023-12-08T08:14:59.899208+0000","last_unstale":"2023-12-08T08:15:04.421161+0000","last_undegraded":"2023-12-08T08:15:04.421161+0000","last_fullsized":"2023-12-08T08:15:04.421161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:10.487847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458733+0000","last_change":"2023-12-08T08:15:04.428378+0000","last_active":"2023-12-08T08:15:05.458733+0000","last_peered":"2023-12-08T08:15:05.458733+0000","last_clean":"2023-12-08T08:15:05.458733+0000","last_became_active":"2023-12-08T08:15:04.427710+0000","last_became_peered":"2023-12-08T08:15:04.427710+0000","last_unstale":"2023-12-08T08:15:05.458733+0000","last_undegraded":"2023-12-08T08:15:05.458733+0000","last_fullsized":"2023-12-08T08:15:05.458733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420774+0000","last_change":"2023-12-08T08:15:00.401845+0000","last_active":"2023-12-08T08:15:04.420774+0000","last_peered":"2023-12-08T08:15:04.420774+0000","last_clean":"2023-12-08T08:15:04.420774+0000","last_became_active":"2023-12-08T08:15:00.401428+0000","last_became_peered":"2023-12-08T08:15:00.401428+0000","last_unstale":"2023-12-08T08:15:04.420774+0000","last_undegraded":"2023-12-08T08:15:04.420774+0000","last_fullsized":"2023-12-08T08:15:04.420774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413854+0000","last_change":"2023-12-08T08:14:59.902626+0000","last_active":"2023-12-08T08:15:04.413854+0000","last_peered":"2023-12-08T08:15:04.413854+0000","last_clean":"2023-12-08T08:15:04.413854+0000","last_became_active":"2023-12-08T08:14:59.902263+0000","last_became_peered":"2023-12-08T08:14:59.902263+0000","last_unstale":"2023-12-08T08:15:04.413854+0000","last_undegraded":"2023-12-08T08:15:04.413854+0000","last_fullsized":"2023-12-08T08:15:04.413854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458744+0000","last_change":"2023-12-08T08:15:04.452488+0000","last_active":"2023-12-08T08:15:05.458744+0000","last_peered":"2023-12-08T08:15:05.458744+0000","last_clean":"2023-12-08T08:15:05.458744+0000","last_became_active":"2023-12-08T08:15:04.451822+0000","last_became_peered":"2023-12-08T08:15:04.451822+0000","last_unstale":"2023-12-08T08:15:05.458744+0000","last_undegraded":"2023-12-08T08:15:05.458744+0000","last_fullsized":"2023-12-08T08:15:05.458744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803994+0000","last_change":"2023-12-08T08:15:04.453801+0000","last_active":"2023-12-08T08:15:05.803994+0000","last_peered":"2023-12-08T08:15:05.803994+0000","last_clean":"2023-12-08T08:15:05.803994+0000","last_became_active":"2023-12-08T08:15:04.453352+0000","last_became_peered":"2023-12-08T08:15:04.453352+0000","last_unstale":"2023-12-08T08:15:05.803994+0000","last_undegraded":"2023-12-08T08:15:05.803994+0000","last_fullsized":"2023-12-08T08:15:05.803994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406035+0000","last_change":"2023-12-08T08:15:00.380909+0000","last_active":"2023-12-08T08:15:04.406035+0000","last_peered":"2023-12-08T08:15:04.406035+0000","last_clean":"2023-12-08T08:15:04.406035+0000","last_became_active":"2023-12-08T08:15:00.379700+0000","last_became_peered":"2023-12-08T08:15:00.379700+0000","last_unstale":"2023-12-08T08:15:04.406035+0000","last_undegraded":"2023-12-08T08:15:04.406035+0000","last_fullsized":"2023-12-08T08:15:04.406035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:04:49.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412365+0000","last_change":"2023-12-08T08:14:59.890675+0000","last_active":"2023-12-08T08:15:04.412365+0000","last_peered":"2023-12-08T08:15:04.412365+0000","last_clean":"2023-12-08T08:15:04.412365+0000","last_became_active":"2023-12-08T08:14:59.890323+0000","last_became_peered":"2023-12-08T08:14:59.890323+0000","last_unstale":"2023-12-08T08:15:04.412365+0000","last_undegraded":"2023-12-08T08:15:04.412365+0000","last_fullsized":"2023-12-08T08:15:04.412365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808921+0000","last_change":"2023-12-08T08:15:04.443203+0000","last_active":"2023-12-08T08:15:05.808921+0000","last_peered":"2023-12-08T08:15:05.808921+0000","last_clean":"2023-12-08T08:15:05.808921+0000","last_became_active":"2023-12-08T08:15:04.442767+0000","last_became_peered":"2023-12-08T08:15:04.442767+0000","last_unstale":"2023-12-08T08:15:05.808921+0000","last_undegraded":"2023-12-08T08:15:05.808921+0000","last_fullsized":"2023-12-08T08:15:05.808921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:28.413841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411249+0000","last_change":"2023-12-08T08:15:00.394844+0000","last_active":"2023-12-08T08:15:04.411249+0000","last_peered":"2023-12-08T08:15:04.411249+0000","last_clean":"2023-12-08T08:15:04.411249+0000","last_became_active":"2023-12-08T08:15:00.394583+0000","last_became_peered":"2023-12-08T08:15:00.394583+0000","last_unstale":"2023-12-08T08:15:04.411249+0000","last_undegraded":"2023-12-08T08:15:04.411249+0000","last_fullsized":"2023-12-08T08:15:04.411249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416997+0000","last_change":"2023-12-08T08:14:59.898905+0000","last_active":"2023-12-08T08:15:04.416997+0000","last_peered":"2023-12-08T08:15:04.416997+0000","last_clean":"2023-12-08T08:15:04.416997+0000","last_became_active":"2023-12-08T08:14:59.897829+0000","last_became_peered":"2023-12-08T08:14:59.897829+0000","last_unstale":"2023-12-08T08:15:04.416997+0000","last_undegraded":"2023-12-08T08:15:04.416997+0000","last_fullsized":"2023-12-08T08:15:04.416997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:45:24.892032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414962+0000","last_change":"2023-12-08T08:14:59.895592+0000","last_active":"2023-12-08T08:15:04.414962+0000","last_peered":"2023-12-08T08:15:04.414962+0000","last_clean":"2023-12-08T08:15:04.414962+0000","last_became_active":"2023-12-08T08:14:59.895295+0000","last_became_peered":"2023-12-08T08:14:59.895295+0000","last_unstale":"2023-12-08T08:15:04.414962+0000","last_undegraded":"2023-12-08T08:15:04.414962+0000","last_fullsized":"2023-12-08T08:15:04.414962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:33.595711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412137+0000","last_change":"2023-12-08T08:15:00.401972+0000","last_active":"2023-12-08T08:15:04.412137+0000","last_peered":"2023-12-08T08:15:04.412137+0000","last_clean":"2023-12-08T08:15:04.412137+0000","last_became_active":"2023-12-08T08:15:00.401768+0000","last_became_peered":"2023-12-08T08:15:00.401768+0000","last_unstale":"2023-12-08T08:15:04.412137+0000","last_undegraded":"2023-12-08T08:15:04.412137+0000","last_fullsized":"2023-12-08T08:15:04.412137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:06.259376+0000","last_change":"2023-12-08T08:15:04.426722+0000","last_active":"2023-12-08T08:15:06.259376+0000","last_peered":"2023-12-08T08:15:06.259376+0000","last_clean":"2023-12-08T08:15:06.259376+0000","last_became_active":"2023-12-08T08:15:04.426302+0000","last_became_peered":"2023-12-08T08:15:04.426302+0000","last_unstale":"2023-12-08T08:15:06.259376+0000","last_undegraded":"2023-12-08T08:15:06.259376+0000","last_fullsized":"2023-12-08T08:15:06.259376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:07.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.419030+0000","last_change":"2023-12-08T08:14:59.898802+0000","last_active":"2023-12-08T08:15:04.419030+0000","last_peered":"2023-12-08T08:15:04.419030+0000","last_clean":"2023-12-08T08:15:04.419030+0000","last_became_active":"2023-12-08T08:14:59.897917+0000","last_became_peered":"2023-12-08T08:14:59.897917+0000","last_unstale":"2023-12-08T08:15:04.419030+0000","last_undegraded":"2023-12-08T08:15:04.419030+0000","last_fullsized":"2023-12-08T08:15:04.419030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.405546+0000","last_change":"2023-12-08T08:15:00.377480+0000","last_active":"2023-12-08T08:15:04.405546+0000","last_peered":"2023-12-08T08:15:04.405546+0000","last_clean":"2023-12-08T08:15:04.405546+0000","last_became_active":"2023-12-08T08:15:00.376692+0000","last_became_peered":"2023-12-08T08:15:00.376692+0000","last_unstale":"2023-12-08T08:15:04.405546+0000","last_undegraded":"2023-12-08T08:15:04.405546+0000","last_fullsized":"2023-12-08T08:15:04.405546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:50.883191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461226+0000","last_change":"2023-12-08T08:15:04.434422+0000","last_active":"2023-12-08T08:15:05.461226+0000","last_peered":"2023-12-08T08:15:05.461226+0000","last_clean":"2023-12-08T08:15:05.461226+0000","last_became_active":"2023-12-08T08:15:04.434025+0000","last_became_peered":"2023-12-08T08:15:04.434025+0000","last_unstale":"2023-12-08T08:15:05.461226+0000","last_undegraded":"2023-12-08T08:15:05.461226+0000","last_fullsized":"2023-12-08T08:15:05.461226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:40.936584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412941+0000","last_change":"2023-12-08T08:15:00.397602+0000","last_active":"2023-12-08T08:15:04.412941+0000","last_peered":"2023-12-08T08:15:04.412941+0000","last_clean":"2023-12-08T08:15:04.412941+0000","last_became_active":"2023-12-08T08:15:00.396793+0000","last_became_peered":"2023-12-08T08:15:00.396793+0000","last_unstale":"2023-12-08T08:15:04.412941+0000","last_undegraded":"2023-12-08T08:15:04.412941+0000","last_fullsized":"2023-12-08T08:15:04.412941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395803+0000","last_change":"2023-12-08T08:15:00.392327+0000","last_active":"2023-12-08T08:15:04.395803+0000","last_peered":"2023-12-08T08:15:04.395803+0000","last_clean":"2023-12-08T08:15:04.395803+0000","last_became_active":"2023-12-08T08:15:00.391791+0000","last_became_peered":"2023-12-08T08:15:00.391791+0000","last_unstale":"2023-12-08T08:15:04.395803+0000","last_undegraded":"2023-12-08T08:15:04.395803+0000","last_fullsized":"2023-12-08T08:15:04.395803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422479+0000","last_change":"2023-12-08T08:15:00.399925+0000","last_active":"2023-12-08T08:15:04.422479+0000","last_peered":"2023-12-08T08:15:04.422479+0000","last_clean":"2023-12-08T08:15:04.422479+0000","last_became_active":"2023-12-08T08:15:00.397718+0000","last_became_peered":"2023-12-08T08:15:00.397718+0000","last_unstale":"2023-12-08T08:15:04.422479+0000","last_undegraded":"2023-12-08T08:15:04.422479+0000","last_fullsized":"2023-12-08T08:15:04.422479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412045+0000","last_change":"2023-12-08T08:15:00.389088+0000","last_active":"2023-12-08T08:15:04.412045+0000","last_peered":"2023-12-08T08:15:04.412045+0000","last_clean":"2023-12-08T08:15:04.412045+0000","last_became_active":"2023-12-08T08:15:00.388531+0000","last_became_peered":"2023-12-08T08:15:00.388531+0000","last_unstale":"2023-12-08T08:15:04.412045+0000","last_undegraded":"2023-12-08T08:15:04.412045+0000","last_fullsized":"2023-12-08T08:15:04.412045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418168+0000","last_change":"2023-12-08T08:15:00.399625+0000","last_active":"2023-12-08T08:15:04.418168+0000","last_peered":"2023-12-08T08:15:04.418168+0000","last_clean":"2023-12-08T08:15:04.418168+0000","last_became_active":"2023-12-08T08:15:00.399405+0000","last_became_peered":"2023-12-08T08:15:00.399405+0000","last_unstale":"2023-12-08T08:15:04.418168+0000","last_undegraded":"2023-12-08T08:15:04.418168+0000","last_fullsized":"2023-12-08T08:15:04.418168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425340+0000","last_change":"2023-12-08T08:15:00.388290+0000","last_active":"2023-12-08T08:15:04.425340+0000","last_peered":"2023-12-08T08:15:04.425340+0000","last_clean":"2023-12-08T08:15:04.425340+0000","last_became_active":"2023-12-08T08:15:00.387996+0000","last_became_peered":"2023-12-08T08:15:00.387996+0000","last_unstale":"2023-12-08T08:15:04.425340+0000","last_undegraded":"2023-12-08T08:15:04.425340+0000","last_fullsized":"2023-12-08T08:15:04.425340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:11.571727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416014+0000","last_change":"2023-12-08T08:15:00.404101+0000","last_active":"2023-12-08T08:15:04.416014+0000","last_peered":"2023-12-08T08:15:04.416014+0000","last_clean":"2023-12-08T08:15:04.416014+0000","last_became_active":"2023-12-08T08:15:00.403349+0000","last_became_peered":"2023-12-08T08:15:00.403349+0000","last_unstale":"2023-12-08T08:15:04.416014+0000","last_undegraded":"2023-12-08T08:15:04.416014+0000","last_fullsized":"2023-12-08T08:15:04.416014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418659+0000","last_change":"2023-12-08T08:15:00.406185+0000","last_active":"2023-12-08T08:15:04.418659+0000","last_peered":"2023-12-08T08:15:04.418659+0000","last_clean":"2023-12-08T08:15:04.418659+0000","last_became_active":"2023-12-08T08:15:00.405860+0000","last_became_peered":"2023-12-08T08:15:00.405860+0000","last_unstale":"2023-12-08T08:15:04.418659+0000","last_undegraded":"2023-12-08T08:15:04.418659+0000","last_fullsized":"2023-12-08T08:15:04.418659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412237+0000","last_change":"2023-12-08T08:15:00.397626+0000","last_active":"2023-12-08T08:15:04.412237+0000","last_peered":"2023-12-08T08:15:04.412237+0000","last_clean":"2023-12-08T08:15:04.412237+0000","last_became_active":"2023-12-08T08:15:00.397097+0000","last_became_peered":"2023-12-08T08:15:00.397097+0000","last_unstale":"2023-12-08T08:15:04.412237+0000","last_undegraded":"2023-12-08T08:15:04.412237+0000","last_fullsized":"2023-12-08T08:15:04.412237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416905+0000","last_change":"2023-12-08T08:15:00.399153+0000","last_active":"2023-12-08T08:15:04.416905+0000","last_peered":"2023-12-08T08:15:04.416905+0000","last_clean":"2023-12-08T08:15:04.416905+0000","last_became_active":"2023-12-08T08:15:00.398929+0000","last_became_peered":"2023-12-08T08:15:00.398929+0000","last_unstale":"2023-12-08T08:15:04.416905+0000","last_undegraded":"2023-12-08T08:15:04.416905+0000","last_fullsized":"2023-12-08T08:15:04.416905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422384+0000","last_change":"2023-12-08T08:15:00.401295+0000","last_active":"2023-12-08T08:15:04.422384+0000","last_peered":"2023-12-08T08:15:04.422384+0000","last_clean":"2023-12-08T08:15:04.422384+0000","last_became_active":"2023-12-08T08:15:00.401003+0000","last_became_peered":"2023-12-08T08:15:00.401003+0000","last_unstale":"2023-12-08T08:15:04.422384+0000","last_undegraded":"2023-12-08T08:15:04.422384+0000","last_fullsized":"2023-12-08T08:15:04.422384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411185+0000","last_change":"2023-12-08T08:15:00.389780+0000","last_active":"2023-12-08T08:15:04.411185+0000","last_peered":"2023-12-08T08:15:04.411185+0000","last_clean":"2023-12-08T08:15:04.411185+0000","last_became_active":"2023-12-08T08:15:00.388834+0000","last_became_peered":"2023-12-08T08:15:00.388834+0000","last_unstale":"2023-12-08T08:15:04.411185+0000","last_undegraded":"2023-12-08T08:15:04.411185+0000","last_fullsized":"2023-12-08T08:15:04.411185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:06.829179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413719+0000","last_change":"2023-12-08T08:15:00.411312+0000","last_active":"2023-12-08T08:15:04.413719+0000","last_peered":"2023-12-08T08:15:04.413719+0000","last_clean":"2023-12-08T08:15:04.413719+0000","last_became_active":"2023-12-08T08:15:00.408772+0000","last_became_peered":"2023-12-08T08:15:00.408772+0000","last_unstale":"2023-12-08T08:15:04.413719+0000","last_undegraded":"2023-12-08T08:15:04.413719+0000","last_fullsized":"2023-12-08T08:15:04.413719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447494+0000","last_change":"2023-12-08T08:15:00.392749+0000","last_active":"2023-12-08T08:15:04.447494+0000","last_peered":"2023-12-08T08:15:04.447494+0000","last_clean":"2023-12-08T08:15:04.447494+0000","last_became_active":"2023-12-08T08:15:00.392113+0000","last_became_peered":"2023-12-08T08:15:00.392113+0000","last_unstale":"2023-12-08T08:15:04.447494+0000","last_undegraded":"2023-12-08T08:15:04.447494+0000","last_fullsized":"2023-12-08T08:15:04.447494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396777+0000","last_change":"2023-12-08T08:15:00.397614+0000","last_active":"2023-12-08T08:15:04.396777+0000","last_peered":"2023-12-08T08:15:04.396777+0000","last_clean":"2023-12-08T08:15:04.396777+0000","last_became_active":"2023-12-08T08:15:00.397110+0000","last_became_peered":"2023-12-08T08:15:00.397110+0000","last_unstale":"2023-12-08T08:15:04.396777+0000","last_undegraded":"2023-12-08T08:15:04.396777+0000","last_fullsized":"2023-12-08T08:15:04.396777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:38.114443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421587+0000","last_change":"2023-12-08T08:15:00.405108+0000","last_active":"2023-12-08T08:15:04.421587+0000","last_peered":"2023-12-08T08:15:04.421587+0000","last_clean":"2023-12-08T08:15:04.421587+0000","last_became_active":"2023-12-08T08:15:00.404650+0000","last_became_peered":"2023-12-08T08:15:00.404650+0000","last_unstale":"2023-12-08T08:15:04.421587+0000","last_undegraded":"2023-12-08T08:15:04.421587+0000","last_fullsized":"2023-12-08T08:15:04.421587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412104+0000","last_change":"2023-12-08T08:15:00.399420+0000","last_active":"2023-12-08T08:15:04.412104+0000","last_peered":"2023-12-08T08:15:04.412104+0000","last_clean":"2023-12-08T08:15:04.412104+0000","last_became_active":"2023-12-08T08:15:00.397884+0000","last_became_peered":"2023-12-08T08:15:00.397884+0000","last_unstale":"2023-12-08T08:15:04.412104+0000","last_undegraded":"2023-12-08T08:15:04.412104+0000","last_fullsized":"2023-12-08T08:15:04.412104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406107+0000","last_change":"2023-12-08T08:15:00.373700+0000","last_active":"2023-12-08T08:15:04.406107+0000","last_peered":"2023-12-08T08:15:04.406107+0000","last_clean":"2023-12-08T08:15:04.406107+0000","last_became_active":"2023-12-08T08:15:00.373315+0000","last_became_peered":"2023-12-08T08:15:00.373315+0000","last_unstale":"2023-12-08T08:15:04.406107+0000","last_undegraded":"2023-12-08T08:15:04.406107+0000","last_fullsized":"2023-12-08T08:15:04.406107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:54.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403529+0000","last_change":"2023-12-08T08:15:00.385175+0000","last_active":"2023-12-08T08:15:04.403529+0000","last_peered":"2023-12-08T08:15:04.403529+0000","last_clean":"2023-12-08T08:15:04.403529+0000","last_became_active":"2023-12-08T08:15:00.384670+0000","last_became_peered":"2023-12-08T08:15:00.384670+0000","last_unstale":"2023-12-08T08:15:04.403529+0000","last_undegraded":"2023-12-08T08:15:04.403529+0000","last_fullsized":"2023-12-08T08:15:04.403529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418851+0000","last_change":"2023-12-08T08:15:00.397339+0000","last_active":"2023-12-08T08:15:04.418851+0000","last_peered":"2023-12-08T08:15:04.418851+0000","last_clean":"2023-12-08T08:15:04.418851+0000","last_became_active":"2023-12-08T08:15:00.396888+0000","last_became_peered":"2023-12-08T08:15:00.396888+0000","last_unstale":"2023-12-08T08:15:04.418851+0000","last_undegraded":"2023-12-08T08:15:04.418851+0000","last_fullsized":"2023-12-08T08:15:04.418851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404753+0000","last_change":"2023-12-08T08:15:00.406207+0000","last_active":"2023-12-08T08:15:04.404753+0000","last_peered":"2023-12-08T08:15:04.404753+0000","last_clean":"2023-12-08T08:15:04.404753+0000","last_became_active":"2023-12-08T08:15:00.405928+0000","last_became_peered":"2023-12-08T08:15:00.405928+0000","last_unstale":"2023-12-08T08:15:04.404753+0000","last_undegraded":"2023-12-08T08:15:04.404753+0000","last_fullsized":"2023-12-08T08:15:04.404753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:12.923902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415948+0000","last_change":"2023-12-08T08:15:00.411990+0000","last_active":"2023-12-08T08:15:04.415948+0000","last_peered":"2023-12-08T08:15:04.415948+0000","last_clean":"2023-12-08T08:15:04.415948+0000","last_became_active":"2023-12-08T08:15:00.411754+0000","last_became_peered":"2023-12-08T08:15:00.411754+0000","last_unstale":"2023-12-08T08:15:04.415948+0000","last_undegraded":"2023-12-08T08:15:04.415948+0000","last_fullsized":"2023-12-08T08:15:04.415948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414100+0000","last_change":"2023-12-08T08:15:00.404296+0000","last_active":"2023-12-08T08:15:04.414100+0000","last_peered":"2023-12-08T08:15:04.414100+0000","last_clean":"2023-12-08T08:15:04.414100+0000","last_became_active":"2023-12-08T08:15:00.403816+0000","last_became_peered":"2023-12-08T08:15:00.403816+0000","last_unstale":"2023-12-08T08:15:04.414100+0000","last_undegraded":"2023-12-08T08:15:04.414100+0000","last_fullsized":"2023-12-08T08:15:04.414100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447876+0000","last_change":"2023-12-08T08:15:00.407698+0000","last_active":"2023-12-08T08:15:04.447876+0000","last_peered":"2023-12-08T08:15:04.447876+0000","last_clean":"2023-12-08T08:15:04.447876+0000","last_became_active":"2023-12-08T08:15:00.407394+0000","last_became_peered":"2023-12-08T08:15:00.407394+0000","last_unstale":"2023-12-08T08:15:04.447876+0000","last_undegraded":"2023-12-08T08:15:04.447876+0000","last_fullsized":"2023-12-08T08:15:04.447876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:11.621846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.410963+0000","last_change":"2023-12-08T08:15:00.400390+0000","last_active":"2023-12-08T08:15:04.410963+0000","last_peered":"2023-12-08T08:15:04.410963+0000","last_clean":"2023-12-08T08:15:04.410963+0000","last_became_active":"2023-12-08T08:15:00.400019+0000","last_became_peered":"2023-12-08T08:15:00.400019+0000","last_unstale":"2023-12-08T08:15:04.410963+0000","last_undegraded":"2023-12-08T08:15:04.410963+0000","last_fullsized":"2023-12-08T08:15:04.410963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447736+0000","last_change":"2023-12-08T08:15:00.396225+0000","last_active":"2023-12-08T08:15:04.447736+0000","last_peered":"2023-12-08T08:15:04.447736+0000","last_clean":"2023-12-08T08:15:04.447736+0000","last_became_active":"2023-12-08T08:15:00.395943+0000","last_became_peered":"2023-12-08T08:15:00.395943+0000","last_unstale":"2023-12-08T08:15:04.447736+0000","last_undegraded":"2023-12-08T08:15:04.447736+0000","last_fullsized":"2023-12-08T08:15:04.447736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422301+0000","last_change":"2023-12-08T08:15:00.401328+0000","last_active":"2023-12-08T08:15:04.422301+0000","last_peered":"2023-12-08T08:15:04.422301+0000","last_clean":"2023-12-08T08:15:04.422301+0000","last_became_active":"2023-12-08T08:15:00.400964+0000","last_became_peered":"2023-12-08T08:15:00.400964+0000","last_unstale":"2023-12-08T08:15:04.422301+0000","last_undegraded":"2023-12-08T08:15:04.422301+0000","last_fullsized":"2023-12-08T08:15:04.422301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447113+0000","last_change":"2023-12-08T08:15:00.386324+0000","last_active":"2023-12-08T08:15:04.447113+0000","last_peered":"2023-12-08T08:15:04.447113+0000","last_clean":"2023-12-08T08:15:04.447113+0000","last_became_active":"2023-12-08T08:15:00.385867+0000","last_became_peered":"2023-12-08T08:15:00.385867+0000","last_unstale":"2023-12-08T08:15:04.447113+0000","last_undegraded":"2023-12-08T08:15:04.447113+0000","last_fullsized":"2023-12-08T08:15:04.447113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420534+0000","last_change":"2023-12-08T08:15:00.405186+0000","last_active":"2023-12-08T08:15:04.420534+0000","last_peered":"2023-12-08T08:15:04.420534+0000","last_clean":"2023-12-08T08:15:04.420534+0000","last_became_active":"2023-12-08T08:15:00.404663+0000","last_became_peered":"2023-12-08T08:15:00.404663+0000","last_unstale":"2023-12-08T08:15:04.420534+0000","last_undegraded":"2023-12-08T08:15:04.420534+0000","last_fullsized":"2023-12-08T08:15:04.420534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411222+0000","last_change":"2023-12-08T08:15:00.390953+0000","last_active":"2023-12-08T08:15:04.411222+0000","last_peered":"2023-12-08T08:15:04.411222+0000","last_clean":"2023-12-08T08:15:04.411222+0000","last_became_active":"2023-12-08T08:15:00.390638+0000","last_became_peered":"2023-12-08T08:15:00.390638+0000","last_unstale":"2023-12-08T08:15:04.411222+0000","last_undegraded":"2023-12-08T08:15:04.411222+0000","last_fullsized":"2023-12-08T08:15:04.411222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425744+0000","last_change":"2023-12-08T08:15:00.394118+0000","last_active":"2023-12-08T08:15:04.425744+0000","last_peered":"2023-12-08T08:15:04.425744+0000","last_clean":"2023-12-08T08:15:04.425744+0000","last_became_active":"2023-12-08T08:15:00.393338+0000","last_became_peered":"2023-12-08T08:15:00.393338+0000","last_unstale":"2023-12-08T08:15:04.425744+0000","last_undegraded":"2023-12-08T08:15:04.425744+0000","last_fullsized":"2023-12-08T08:15:04.425744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:04:34.103680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447849+0000","last_change":"2023-12-08T08:15:00.404323+0000","last_active":"2023-12-08T08:15:04.447849+0000","last_peered":"2023-12-08T08:15:04.447849+0000","last_clean":"2023-12-08T08:15:04.447849+0000","last_became_active":"2023-12-08T08:15:00.403298+0000","last_became_peered":"2023-12-08T08:15:00.403298+0000","last_unstale":"2023-12-08T08:15:04.447849+0000","last_undegraded":"2023-12-08T08:15:04.447849+0000","last_fullsized":"2023-12-08T08:15:04.447849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":698764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5839999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9029999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5059999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6559999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:15:34.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:15:35.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.219+0000 7f8527fff640 1 Processor -- start 2023-12-08T08:15:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.219+0000 7f8527fff640 1 -- start start 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8527fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f85280c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8527fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f85280c1dc0 0x7f852814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8527fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8528155850 con 0x7f85281521b0 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8527fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85280c0890 con 0x7f85280c1dc0 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8527fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c0b70 con 0x7f85280a7910 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f85277fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85281521b0 0x7f8528155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58446/0 (socket says 172.21.15.45:58446) 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f85277fe640 1 -- 172.21.15.45:0/2703197312 learned_addr learned my addr 172.21.15.45:0/2703197312 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f851ffff640 1 --2- 172.21.15.45:0/2703197312 >> v2:172.21.15.114:3300/0 conn(0x7f85280c1dc0 0x7f852814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.221+0000 7f8526ffd640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f85280c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238309252 0 0) 0x7f8528155850 con 0x7f85281521b0 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8514003520 con 0x7f85281521b0 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178169958 0 0) 0x7f8514003520 con 0x7f85281521b0 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 msgr2=0x7f85280c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f85280c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 >> v2:172.21.15.114:3300/0 conn(0x7f85280c1dc0 msgr2=0x7f852814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 --2- 172.21.15.45:0/2703197312 >> v2:172.21.15.114:3300/0 conn(0x7f85280c1dc0 0x7f852814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280c0e50 con 0x7f85281521b0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f85200019f0 con 0x7f85281521b0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 >> v1:172.21.15.45:6789/0 conn(0x7f85281521b0 legacy=0x7f8528155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f8514003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8514003ef0 0x7f85140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514004d00 0x7f8514005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c0890 con 0x7f8514003ef0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280c0b70 con 0x7f8514004d00 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.222+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851400b9d0 con 0x7f85280a7910 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8514003ef0 0x7f85140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f85277fe640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514004d00 0x7f8514005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f8526ffd640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f8514003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 -- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 msgr2=0x7f8514003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f85280a7910 0x7f8514003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 -- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514004d00 msgr2=0x7f8514005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514004d00 0x7f8514005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.223+0000 7f851ffff640 1 -- 172.21.15.45:0/2703197312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514003520 con 0x7f8514003ef0 2023-12-08T08:15:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.224+0000 7f851ffff640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8514003ef0 0x7f85140047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8510009ac0 tx=0x7f85140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d7a977b6147c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.224+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851002c6b0 con 0x7f8514003ef0 2023-12-08T08:15:35.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.224+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851002c810 con 0x7f8514003ef0 2023-12-08T08:15:35.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.224+0000 7f85267fc640 1 -- 172.21.15.45:0/2703197312 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851002cba0 con 0x7f8514003ef0 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 -- 172.21.15.45:0/2703197312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8514003ef0 msgr2=0x7f85140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 --2- 172.21.15.45:0/2703197312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8514003ef0 0x7f85140047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8510009ac0 tx=0x7f85140057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f85277fe640 1 -- 172.21.15.45:0/2703197312 reap_dead start 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 -- 172.21.15.45:0/2703197312 shutdown_connections 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 -- 172.21.15.45:0/2703197312 >> 172.21.15.45:0/2703197312 conn(0x7f85280c5780 msgr2=0x7f85280c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 -- 172.21.15.45:0/2703197312 shutdown_connections 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.225+0000 7f8527fff640 1 -- 172.21.15.45:0/2703197312 wait complete. 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.227+0000 7f8527fff640 1 Processor -- start 2023-12-08T08:15:35.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.227+0000 7f8527fff640 1 -- start start 2023-12-08T08:15:35.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514003ef0 0x7f852814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8528071ea0 0x7f85281e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280bd2c0 con 0x7f85281ea7d0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281e77f0 con 0x7f8514003ef0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8527fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280728f0 con 0x7f8528071ea0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48502/0 (socket says 172.21.15.45:48502) 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 -- 172.21.15.45:0/2865719299 learned_addr learned my addr 172.21.15.45:0/2865719299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f8526ffd640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514003ef0 0x7f852814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f851ffff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8528071ea0 0x7f85281e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 -- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8528071ea0 msgr2=0x7f85281e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8528071ea0 0x7f85281e7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 -- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514003ef0 msgr2=0x7f852814cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.228+0000 7f85277fe640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514003ef0 0x7f852814cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f85277fe640 1 -- 172.21.15.45:0/2865719299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85281e8150 con 0x7f85281ea7d0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f85277fe640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f852806bad0 tx=0x7f852000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000ebb0 con 0x7f85281ea7d0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000ed10 con 0x7f85281ea7d0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520013660 con 0x7f85281ea7d0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528072330 con 0x7f85281ea7d0 2023-12-08T08:15:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.229+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85281e7410 con 0x7f85281ea7d0 2023-12-08T08:15:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.230+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85281e7930 con 0x7f85281ea7d0 2023-12-08T08:15:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.231+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85200137c0 con 0x7f85281ea7d0 2023-12-08T08:15:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.232+0000 7f8524ff9640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 0x7f850806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.232+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8520089d00 con 0x7f85281ea7d0 2023-12-08T08:15:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.232+0000 7f8526ffd640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 0x7f850806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.233+0000 7f8526ffd640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 0x7f850806d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8528153890 tx=0x7f8518008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.236+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85281e7930 con 0x7f85281ea7d0 2023-12-08T08:15:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.421+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85280a7cf0 con 0x7f850806ae70 2023-12-08T08:15:35.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.440+0000 7f8524ff9640 1 -- 172.21.15.45:0/2865719299 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345108 (secure 0 0 0) 0x7f85180095c0 con 0x7f850806ae70 2023-12-08T08:15:35.447 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 msgr2=0x7f850806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 0x7f850806d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8528153890 tx=0x7f8518008040 comp rx=0 tx=0).stop 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 msgr2=0x7f85280aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f852806bad0 tx=0x7f852000e530 comp rx=0 tx=0).stop 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 shutdown_connections 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f850806ae70 0x7f850806d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8528071ea0 0x7f85281e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85281ea7d0 0x7f85280aad00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 --2- 172.21.15.45:0/2865719299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8514003ef0 0x7f852814cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 >> 172.21.15.45:0/2865719299 conn(0x7f85280c5780 msgr2=0x7f85281518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 shutdown_connections 2023-12-08T08:15:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.446+0000 7f8527fff640 1 -- 172.21.15.45:0/2865719299 wait complete. 2023-12-08T08:15:35.466 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-08T08:15:33.712270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3448832,"data_stored":2052074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008583"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415173+0000","last_change":"2023-12-08T08:14:59.898411+0000","last_active":"2023-12-08T08:15:04.415173+0000","last_peered":"2023-12-08T08:15:04.415173+0000","last_clean":"2023-12-08T08:15:04.415173+0000","last_became_active":"2023-12-08T08:14:59.898087+0000","last_became_peered":"2023-12-08T08:14:59.898087+0000","last_unstale":"2023-12-08T08:15:04.415173+0000","last_undegraded":"2023-12-08T08:15:04.415173+0000","last_fullsized":"2023-12-08T08:15:04.415173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418248+0000","last_change":"2023-12-08T08:15:00.400659+0000","last_active":"2023-12-08T08:15:04.418248+0000","last_peered":"2023-12-08T08:15:04.418248+0000","last_clean":"2023-12-08T08:15:04.418248+0000","last_became_active":"2023-12-08T08:15:00.400402+0000","last_became_peered":"2023-12-08T08:15:00.400402+0000","last_unstale":"2023-12-08T08:15:04.418248+0000","last_undegraded":"2023-12-08T08:15:04.418248+0000","last_fullsized":"2023-12-08T08:15:04.418248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458501+0000","last_change":"2023-12-08T08:15:04.453443+0000","last_active":"2023-12-08T08:15:05.458501+0000","last_peered":"2023-12-08T08:15:05.458501+0000","last_clean":"2023-12-08T08:15:05.458501+0000","last_became_active":"2023-12-08T08:15:04.452135+0000","last_became_peered":"2023-12-08T08:15:04.452135+0000","last_unstale":"2023-12-08T08:15:05.458501+0000","last_undegraded":"2023-12-08T08:15:05.458501+0000","last_fullsized":"2023-12-08T08:15:05.458501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418337+0000","last_change":"2023-12-08T08:14:59.893365+0000","last_active":"2023-12-08T08:15:04.418337+0000","last_peered":"2023-12-08T08:15:04.418337+0000","last_clean":"2023-12-08T08:15:04.418337+0000","last_became_active":"2023-12-08T08:14:59.893005+0000","last_became_peered":"2023-12-08T08:14:59.893005+0000","last_unstale":"2023-12-08T08:15:04.418337+0000","last_undegraded":"2023-12-08T08:15:04.418337+0000","last_fullsized":"2023-12-08T08:15:04.418337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414647+0000","last_change":"2023-12-08T08:15:00.406552+0000","last_active":"2023-12-08T08:15:04.414647+0000","last_peered":"2023-12-08T08:15:04.414647+0000","last_clean":"2023-12-08T08:15:04.414647+0000","last_became_active":"2023-12-08T08:15:00.406233+0000","last_became_peered":"2023-12-08T08:15:00.406233+0000","last_unstale":"2023-12-08T08:15:04.414647+0000","last_undegraded":"2023-12-08T08:15:04.414647+0000","last_fullsized":"2023-12-08T08:15:04.414647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459861+0000","last_change":"2023-12-08T08:15:04.424143+0000","last_active":"2023-12-08T08:15:05.459861+0000","last_peered":"2023-12-08T08:15:05.459861+0000","last_clean":"2023-12-08T08:15:05.459861+0000","last_became_active":"2023-12-08T08:15:04.423467+0000","last_became_peered":"2023-12-08T08:15:04.423467+0000","last_unstale":"2023-12-08T08:15:05.459861+0000","last_undegraded":"2023-12-08T08:15:05.459861+0000","last_fullsized":"2023-12-08T08:15:05.459861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:29.771854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447512+0000","last_change":"2023-12-08T08:14:59.904046+0000","last_active":"2023-12-08T08:15:04.447512+0000","last_peered":"2023-12-08T08:15:04.447512+0000","last_clean":"2023-12-08T08:15:04.447512+0000","last_became_active":"2023-12-08T08:14:59.903718+0000","last_became_peered":"2023-12-08T08:14:59.903718+0000","last_unstale":"2023-12-08T08:15:04.447512+0000","last_undegraded":"2023-12-08T08:15:04.447512+0000","last_fullsized":"2023-12-08T08:15:04.447512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420529+0000","last_change":"2023-12-08T08:15:00.406898+0000","last_active":"2023-12-08T08:15:04.420529+0000","last_peered":"2023-12-08T08:15:04.420529+0000","last_clean":"2023-12-08T08:15:04.420529+0000","last_became_active":"2023-12-08T08:15:00.406517+0000","last_became_peered":"2023-12-08T08:15:00.406517+0000","last_unstale":"2023-12-08T08:15:04.420529+0000","last_undegraded":"2023-12-08T08:15:04.420529+0000","last_fullsized":"2023-12-08T08:15:04.420529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459980+0000","last_change":"2023-12-08T08:15:04.428944+0000","last_active":"2023-12-08T08:15:05.459980+0000","last_peered":"2023-12-08T08:15:05.459980+0000","last_clean":"2023-12-08T08:15:05.459980+0000","last_became_active":"2023-12-08T08:15:04.428540+0000","last_became_peered":"2023-12-08T08:15:04.428540+0000","last_unstale":"2023-12-08T08:15:05.459980+0000","last_undegraded":"2023-12-08T08:15:05.459980+0000","last_fullsized":"2023-12-08T08:15:05.459980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:04.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447284+0000","last_change":"2023-12-08T08:14:59.902948+0000","last_active":"2023-12-08T08:15:04.447284+0000","last_peered":"2023-12-08T08:15:04.447284+0000","last_clean":"2023-12-08T08:15:04.447284+0000","last_became_active":"2023-12-08T08:14:59.902634+0000","last_became_peered":"2023-12-08T08:14:59.902634+0000","last_unstale":"2023-12-08T08:15:04.447284+0000","last_undegraded":"2023-12-08T08:15:04.447284+0000","last_fullsized":"2023-12-08T08:15:04.447284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420794+0000","last_change":"2023-12-08T08:15:00.406587+0000","last_active":"2023-12-08T08:15:04.420794+0000","last_peered":"2023-12-08T08:15:04.420794+0000","last_clean":"2023-12-08T08:15:04.420794+0000","last_became_active":"2023-12-08T08:15:00.406175+0000","last_became_peered":"2023-12-08T08:15:00.406175+0000","last_unstale":"2023-12-08T08:15:04.420794+0000","last_undegraded":"2023-12-08T08:15:04.420794+0000","last_fullsized":"2023-12-08T08:15:04.420794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460150+0000","last_change":"2023-12-08T08:15:04.431781+0000","last_active":"2023-12-08T08:15:05.460150+0000","last_peered":"2023-12-08T08:15:05.460150+0000","last_clean":"2023-12-08T08:15:05.460150+0000","last_became_active":"2023-12-08T08:15:04.431019+0000","last_became_peered":"2023-12-08T08:15:04.431019+0000","last_unstale":"2023-12-08T08:15:05.460150+0000","last_undegraded":"2023-12-08T08:15:05.460150+0000","last_fullsized":"2023-12-08T08:15:05.460150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:53.015719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414786+0000","last_change":"2023-12-08T08:15:00.410434+0000","last_active":"2023-12-08T08:15:04.414786+0000","last_peered":"2023-12-08T08:15:04.414786+0000","last_clean":"2023-12-08T08:15:04.414786+0000","last_became_active":"2023-12-08T08:15:00.410133+0000","last_became_peered":"2023-12-08T08:15:00.410133+0000","last_unstale":"2023-12-08T08:15:04.414786+0000","last_undegraded":"2023-12-08T08:15:04.414786+0000","last_fullsized":"2023-12-08T08:15:04.414786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447343+0000","last_change":"2023-12-08T08:14:59.900992+0000","last_active":"2023-12-08T08:15:04.447343+0000","last_peered":"2023-12-08T08:15:04.447343+0000","last_clean":"2023-12-08T08:15:04.447343+0000","last_became_active":"2023-12-08T08:14:59.900704+0000","last_became_peered":"2023-12-08T08:14:59.900704+0000","last_unstale":"2023-12-08T08:15:04.447343+0000","last_undegraded":"2023-12-08T08:15:04.447343+0000","last_fullsized":"2023-12-08T08:15:04.447343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462144+0000","last_change":"2023-12-08T08:15:04.426039+0000","last_active":"2023-12-08T08:15:05.462144+0000","last_peered":"2023-12-08T08:15:05.462144+0000","last_clean":"2023-12-08T08:15:05.462144+0000","last_became_active":"2023-12-08T08:15:04.425634+0000","last_became_peered":"2023-12-08T08:15:04.425634+0000","last_unstale":"2023-12-08T08:15:05.462144+0000","last_undegraded":"2023-12-08T08:15:05.462144+0000","last_fullsized":"2023-12-08T08:15:05.462144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418936+0000","last_change":"2023-12-08T08:15:00.393587+0000","last_active":"2023-12-08T08:15:04.418936+0000","last_peered":"2023-12-08T08:15:04.418936+0000","last_clean":"2023-12-08T08:15:04.418936+0000","last_became_active":"2023-12-08T08:15:00.393295+0000","last_became_peered":"2023-12-08T08:15:00.393295+0000","last_unstale":"2023-12-08T08:15:04.418936+0000","last_undegraded":"2023-12-08T08:15:04.418936+0000","last_fullsized":"2023-12-08T08:15:04.418936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412109+0000","last_change":"2023-12-08T08:14:59.888865+0000","last_active":"2023-12-08T08:15:04.412109+0000","last_peered":"2023-12-08T08:15:04.412109+0000","last_clean":"2023-12-08T08:15:04.412109+0000","last_became_active":"2023-12-08T08:14:59.887707+0000","last_became_peered":"2023-12-08T08:14:59.887707+0000","last_unstale":"2023-12-08T08:15:04.412109+0000","last_undegraded":"2023-12-08T08:15:04.412109+0000","last_fullsized":"2023-12-08T08:15:04.412109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:15.716120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461262+0000","last_change":"2023-12-08T08:15:04.436250+0000","last_active":"2023-12-08T08:15:05.461262+0000","last_peered":"2023-12-08T08:15:05.461262+0000","last_clean":"2023-12-08T08:15:05.461262+0000","last_became_active":"2023-12-08T08:15:04.435842+0000","last_became_peered":"2023-12-08T08:15:04.435842+0000","last_unstale":"2023-12-08T08:15:05.461262+0000","last_undegraded":"2023-12-08T08:15:05.461262+0000","last_fullsized":"2023-12-08T08:15:05.461262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:04.471421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411456+0000","last_change":"2023-12-08T08:15:00.384226+0000","last_active":"2023-12-08T08:15:04.411456+0000","last_peered":"2023-12-08T08:15:04.411456+0000","last_clean":"2023-12-08T08:15:04.411456+0000","last_became_active":"2023-12-08T08:15:00.383033+0000","last_became_peered":"2023-12-08T08:15:00.383033+0000","last_unstale":"2023-12-08T08:15:04.411456+0000","last_undegraded":"2023-12-08T08:15:04.411456+0000","last_fullsized":"2023-12-08T08:15:04.411456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406179+0000","last_change":"2023-12-08T08:14:59.899324+0000","last_active":"2023-12-08T08:15:04.406179+0000","last_peered":"2023-12-08T08:15:04.406179+0000","last_clean":"2023-12-08T08:15:04.406179+0000","last_became_active":"2023-12-08T08:14:59.898940+0000","last_became_peered":"2023-12-08T08:14:59.898940+0000","last_unstale":"2023-12-08T08:15:04.406179+0000","last_undegraded":"2023-12-08T08:15:04.406179+0000","last_fullsized":"2023-12-08T08:15:04.406179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:24:38.577538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101970+0000","last_change":"2023-12-08T08:15:04.455030+0000","last_active":"2023-12-08T08:15:07.101970+0000","last_peered":"2023-12-08T08:15:07.101970+0000","last_clean":"2023-12-08T08:15:07.101970+0000","last_became_active":"2023-12-08T08:15:04.454398+0000","last_became_peered":"2023-12-08T08:15:04.454398+0000","last_unstale":"2023-12-08T08:15:07.101970+0000","last_undegraded":"2023-12-08T08:15:07.101970+0000","last_fullsized":"2023-12-08T08:15:07.101970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:34.549050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409201+0000","last_change":"2023-12-08T08:15:00.388016+0000","last_active":"2023-12-08T08:15:04.409201+0000","last_peered":"2023-12-08T08:15:04.409201+0000","last_clean":"2023-12-08T08:15:04.409201+0000","last_became_active":"2023-12-08T08:15:00.387713+0000","last_became_peered":"2023-12-08T08:15:00.387713+0000","last_unstale":"2023-12-08T08:15:04.409201+0000","last_undegraded":"2023-12-08T08:15:04.409201+0000","last_fullsized":"2023-12-08T08:15:04.409201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:22.475961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446683+0000","last_change":"2023-12-08T08:14:59.899277+0000","last_active":"2023-12-08T08:15:04.446683+0000","last_peered":"2023-12-08T08:15:04.446683+0000","last_clean":"2023-12-08T08:15:04.446683+0000","last_became_active":"2023-12-08T08:14:59.898967+0000","last_became_peered":"2023-12-08T08:14:59.898967+0000","last_unstale":"2023-12-08T08:15:04.446683+0000","last_undegraded":"2023-12-08T08:15:04.446683+0000","last_fullsized":"2023-12-08T08:15:04.446683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.462027+0000","last_change":"2023-12-08T08:15:04.436197+0000","last_active":"2023-12-08T08:15:05.462027+0000","last_peered":"2023-12-08T08:15:05.462027+0000","last_clean":"2023-12-08T08:15:05.462027+0000","last_became_active":"2023-12-08T08:15:04.435697+0000","last_became_peered":"2023-12-08T08:15:04.435697+0000","last_unstale":"2023-12-08T08:15:05.462027+0000","last_undegraded":"2023-12-08T08:15:05.462027+0000","last_fullsized":"2023-12-08T08:15:05.462027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:49.330205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411625+0000","last_change":"2023-12-08T08:15:00.391674+0000","last_active":"2023-12-08T08:15:04.411625+0000","last_peered":"2023-12-08T08:15:04.411625+0000","last_clean":"2023-12-08T08:15:04.411625+0000","last_became_active":"2023-12-08T08:15:00.390682+0000","last_became_peered":"2023-12-08T08:15:00.390682+0000","last_unstale":"2023-12-08T08:15:04.411625+0000","last_undegraded":"2023-12-08T08:15:04.411625+0000","last_fullsized":"2023-12-08T08:15:04.411625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414108+0000","last_change":"2023-12-08T08:14:59.899700+0000","last_active":"2023-12-08T08:15:04.414108+0000","last_peered":"2023-12-08T08:15:04.414108+0000","last_clean":"2023-12-08T08:15:04.414108+0000","last_became_active":"2023-12-08T08:14:59.899369+0000","last_became_peered":"2023-12-08T08:14:59.899369+0000","last_unstale":"2023-12-08T08:15:04.414108+0000","last_undegraded":"2023-12-08T08:15:04.414108+0000","last_fullsized":"2023-12-08T08:15:04.414108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460310+0000","last_change":"2023-12-08T08:15:04.455315+0000","last_active":"2023-12-08T08:15:05.460310+0000","last_peered":"2023-12-08T08:15:05.460310+0000","last_clean":"2023-12-08T08:15:05.460310+0000","last_became_active":"2023-12-08T08:15:04.454254+0000","last_became_peered":"2023-12-08T08:15:04.454254+0000","last_unstale":"2023-12-08T08:15:05.460310+0000","last_undegraded":"2023-12-08T08:15:05.460310+0000","last_fullsized":"2023-12-08T08:15:05.460310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:24.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418747+0000","last_change":"2023-12-08T08:15:00.396084+0000","last_active":"2023-12-08T08:15:04.418747+0000","last_peered":"2023-12-08T08:15:04.418747+0000","last_clean":"2023-12-08T08:15:04.418747+0000","last_became_active":"2023-12-08T08:15:00.395265+0000","last_became_peered":"2023-12-08T08:15:00.395265+0000","last_unstale":"2023-12-08T08:15:04.418747+0000","last_undegraded":"2023-12-08T08:15:04.418747+0000","last_fullsized":"2023-12-08T08:15:04.418747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.426589+0000","last_change":"2023-12-08T08:14:59.895090+0000","last_active":"2023-12-08T08:15:04.426589+0000","last_peered":"2023-12-08T08:15:04.426589+0000","last_clean":"2023-12-08T08:15:04.426589+0000","last_became_active":"2023-12-08T08:14:59.894777+0000","last_became_peered":"2023-12-08T08:14:59.894777+0000","last_unstale":"2023-12-08T08:15:04.426589+0000","last_undegraded":"2023-12-08T08:15:04.426589+0000","last_fullsized":"2023-12-08T08:15:04.426589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:42:30.101863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458217+0000","last_change":"2023-12-08T08:15:04.450602+0000","last_active":"2023-12-08T08:15:05.458217+0000","last_peered":"2023-12-08T08:15:05.458217+0000","last_clean":"2023-12-08T08:15:05.458217+0000","last_became_active":"2023-12-08T08:15:04.450177+0000","last_became_peered":"2023-12-08T08:15:04.450177+0000","last_unstale":"2023-12-08T08:15:05.458217+0000","last_undegraded":"2023-12-08T08:15:05.458217+0000","last_fullsized":"2023-12-08T08:15:05.458217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429732+0000","last_change":"2023-12-08T08:15:00.385032+0000","last_active":"2023-12-08T08:15:04.429732+0000","last_peered":"2023-12-08T08:15:04.429732+0000","last_clean":"2023-12-08T08:15:04.429732+0000","last_became_active":"2023-12-08T08:15:00.384743+0000","last_became_peered":"2023-12-08T08:15:00.384743+0000","last_unstale":"2023-12-08T08:15:04.429732+0000","last_undegraded":"2023-12-08T08:15:04.429732+0000","last_fullsized":"2023-12-08T08:15:04.429732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:35:06.342242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447602+0000","last_change":"2023-12-08T08:14:59.902751+0000","last_active":"2023-12-08T08:15:04.447602+0000","last_peered":"2023-12-08T08:15:04.447602+0000","last_clean":"2023-12-08T08:15:04.447602+0000","last_became_active":"2023-12-08T08:14:59.901168+0000","last_became_peered":"2023-12-08T08:14:59.901168+0000","last_unstale":"2023-12-08T08:15:04.447602+0000","last_undegraded":"2023-12-08T08:15:04.447602+0000","last_fullsized":"2023-12-08T08:15:04.447602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803013+0000","last_change":"2023-12-08T08:15:04.452893+0000","last_active":"2023-12-08T08:15:05.803013+0000","last_peered":"2023-12-08T08:15:05.803013+0000","last_clean":"2023-12-08T08:15:05.803013+0000","last_became_active":"2023-12-08T08:15:04.450264+0000","last_became_peered":"2023-12-08T08:15:04.450264+0000","last_unstale":"2023-12-08T08:15:05.803013+0000","last_undegraded":"2023-12-08T08:15:05.803013+0000","last_fullsized":"2023-12-08T08:15:05.803013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:28.999202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420877+0000","last_change":"2023-12-08T08:15:00.407555+0000","last_active":"2023-12-08T08:15:04.420877+0000","last_peered":"2023-12-08T08:15:04.420877+0000","last_clean":"2023-12-08T08:15:04.420877+0000","last_became_active":"2023-12-08T08:15:00.405681+0000","last_became_peered":"2023-12-08T08:15:00.405681+0000","last_unstale":"2023-12-08T08:15:04.420877+0000","last_undegraded":"2023-12-08T08:15:04.420877+0000","last_fullsized":"2023-12-08T08:15:04.420877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.429823+0000","last_change":"2023-12-08T08:14:59.891702+0000","last_active":"2023-12-08T08:15:04.429823+0000","last_peered":"2023-12-08T08:15:04.429823+0000","last_clean":"2023-12-08T08:15:04.429823+0000","last_became_active":"2023-12-08T08:14:59.891334+0000","last_became_peered":"2023-12-08T08:14:59.891334+0000","last_unstale":"2023-12-08T08:15:04.429823+0000","last_undegraded":"2023-12-08T08:15:04.429823+0000","last_fullsized":"2023-12-08T08:15:04.429823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:47:39.998701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101106+0000","last_change":"2023-12-08T08:15:04.437404+0000","last_active":"2023-12-08T08:15:07.101106+0000","last_peered":"2023-12-08T08:15:07.101106+0000","last_clean":"2023-12-08T08:15:07.101106+0000","last_became_active":"2023-12-08T08:15:04.436999+0000","last_became_peered":"2023-12-08T08:15:04.436999+0000","last_unstale":"2023-12-08T08:15:07.101106+0000","last_undegraded":"2023-12-08T08:15:07.101106+0000","last_fullsized":"2023-12-08T08:15:07.101106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:02.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411360+0000","last_change":"2023-12-08T08:15:00.391653+0000","last_active":"2023-12-08T08:15:04.411360+0000","last_peered":"2023-12-08T08:15:04.411360+0000","last_clean":"2023-12-08T08:15:04.411360+0000","last_became_active":"2023-12-08T08:15:00.391313+0000","last_became_peered":"2023-12-08T08:15:00.391313+0000","last_unstale":"2023-12-08T08:15:04.411360+0000","last_undegraded":"2023-12-08T08:15:04.411360+0000","last_fullsized":"2023-12-08T08:15:04.411360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:34.599318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422649+0000","last_change":"2023-12-08T08:14:59.896775+0000","last_active":"2023-12-08T08:15:04.422649+0000","last_peered":"2023-12-08T08:15:04.422649+0000","last_clean":"2023-12-08T08:15:04.422649+0000","last_became_active":"2023-12-08T08:14:59.896211+0000","last_became_peered":"2023-12-08T08:14:59.896211+0000","last_unstale":"2023-12-08T08:15:04.422649+0000","last_undegraded":"2023-12-08T08:15:04.422649+0000","last_fullsized":"2023-12-08T08:15:04.422649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:32.461982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.102468+0000","last_change":"2023-12-08T08:15:04.438749+0000","last_active":"2023-12-08T08:15:07.102468+0000","last_peered":"2023-12-08T08:15:07.102468+0000","last_clean":"2023-12-08T08:15:07.102468+0000","last_became_active":"2023-12-08T08:15:04.436716+0000","last_became_peered":"2023-12-08T08:15:04.436716+0000","last_unstale":"2023-12-08T08:15:07.102468+0000","last_undegraded":"2023-12-08T08:15:07.102468+0000","last_fullsized":"2023-12-08T08:15:07.102468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:34.456252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406210+0000","last_change":"2023-12-08T08:15:00.376354+0000","last_active":"2023-12-08T08:15:04.406210+0000","last_peered":"2023-12-08T08:15:04.406210+0000","last_clean":"2023-12-08T08:15:04.406210+0000","last_became_active":"2023-12-08T08:15:00.374398+0000","last_became_peered":"2023-12-08T08:15:00.374398+0000","last_unstale":"2023-12-08T08:15:04.406210+0000","last_undegraded":"2023-12-08T08:15:04.406210+0000","last_fullsized":"2023-12-08T08:15:04.406210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:19.043505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395880+0000","last_change":"2023-12-08T08:14:59.884051+0000","last_active":"2023-12-08T08:15:04.395880+0000","last_peered":"2023-12-08T08:15:04.395880+0000","last_clean":"2023-12-08T08:15:04.395880+0000","last_became_active":"2023-12-08T08:14:59.883147+0000","last_became_peered":"2023-12-08T08:14:59.883147+0000","last_unstale":"2023-12-08T08:15:04.395880+0000","last_undegraded":"2023-12-08T08:15:04.395880+0000","last_fullsized":"2023-12-08T08:15:04.395880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:11.920295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101903+0000","last_change":"2023-12-08T08:15:04.440056+0000","last_active":"2023-12-08T08:15:07.101903+0000","last_peered":"2023-12-08T08:15:07.101903+0000","last_clean":"2023-12-08T08:15:07.101903+0000","last_became_active":"2023-12-08T08:15:04.434505+0000","last_became_peered":"2023-12-08T08:15:04.434505+0000","last_unstale":"2023-12-08T08:15:07.101903+0000","last_undegraded":"2023-12-08T08:15:07.101903+0000","last_fullsized":"2023-12-08T08:15:07.101903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:15:37.562984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.409609+0000","last_change":"2023-12-08T08:15:00.394588+0000","last_active":"2023-12-08T08:15:04.409609+0000","last_peered":"2023-12-08T08:15:04.409609+0000","last_clean":"2023-12-08T08:15:04.409609+0000","last_became_active":"2023-12-08T08:15:00.394253+0000","last_became_peered":"2023-12-08T08:15:00.394253+0000","last_unstale":"2023-12-08T08:15:04.409609+0000","last_undegraded":"2023-12-08T08:15:04.409609+0000","last_fullsized":"2023-12-08T08:15:04.409609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:56.350634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446691+0000","last_change":"2023-12-08T08:14:59.898943+0000","last_active":"2023-12-08T08:15:04.446691+0000","last_peered":"2023-12-08T08:15:04.446691+0000","last_clean":"2023-12-08T08:15:04.446691+0000","last_became_active":"2023-12-08T08:14:59.898630+0000","last_became_peered":"2023-12-08T08:14:59.898630+0000","last_unstale":"2023-12-08T08:15:04.446691+0000","last_undegraded":"2023-12-08T08:15:04.446691+0000","last_fullsized":"2023-12-08T08:15:04.446691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804702+0000","last_change":"2023-12-08T08:15:04.450619+0000","last_active":"2023-12-08T08:15:05.804702+0000","last_peered":"2023-12-08T08:15:05.804702+0000","last_clean":"2023-12-08T08:15:05.804702+0000","last_became_active":"2023-12-08T08:15:04.450208+0000","last_became_peered":"2023-12-08T08:15:04.450208+0000","last_unstale":"2023-12-08T08:15:05.804702+0000","last_undegraded":"2023-12-08T08:15:05.804702+0000","last_fullsized":"2023-12-08T08:15:05.804702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.417267+0000","last_change":"2023-12-08T08:15:00.403719+0000","last_active":"2023-12-08T08:15:04.417267+0000","last_peered":"2023-12-08T08:15:04.417267+0000","last_clean":"2023-12-08T08:15:04.417267+0000","last_became_active":"2023-12-08T08:15:00.403491+0000","last_became_peered":"2023-12-08T08:15:00.403491+0000","last_unstale":"2023-12-08T08:15:04.417267+0000","last_undegraded":"2023-12-08T08:15:04.417267+0000","last_fullsized":"2023-12-08T08:15:04.417267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420401+0000","last_change":"2023-12-08T08:14:59.902488+0000","last_active":"2023-12-08T08:15:04.420401+0000","last_peered":"2023-12-08T08:15:04.420401+0000","last_clean":"2023-12-08T08:15:04.420401+0000","last_became_active":"2023-12-08T08:14:59.900551+0000","last_became_peered":"2023-12-08T08:14:59.900551+0000","last_unstale":"2023-12-08T08:15:04.420401+0000","last_undegraded":"2023-12-08T08:15:04.420401+0000","last_fullsized":"2023-12-08T08:15:04.420401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:18.269135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.446793+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:15:04.446793+0000","last_peered":"2023-12-08T08:15:04.446793+0000","last_clean":"2023-12-08T08:15:04.446793+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:15:04.446793+0000","last_undegraded":"2023-12-08T08:15:04.446793+0000","last_fullsized":"2023-12-08T08:15:04.446793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808886+0000","last_change":"2023-12-08T08:15:04.456732+0000","last_active":"2023-12-08T08:15:05.808886+0000","last_peered":"2023-12-08T08:15:05.808886+0000","last_clean":"2023-12-08T08:15:05.808886+0000","last_became_active":"2023-12-08T08:15:04.454528+0000","last_became_peered":"2023-12-08T08:15:04.454528+0000","last_unstale":"2023-12-08T08:15:05.808886+0000","last_undegraded":"2023-12-08T08:15:05.808886+0000","last_fullsized":"2023-12-08T08:15:05.808886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:47.706869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447305+0000","last_change":"2023-12-08T08:15:00.407924+0000","last_active":"2023-12-08T08:15:04.447305+0000","last_peered":"2023-12-08T08:15:04.447305+0000","last_clean":"2023-12-08T08:15:04.447305+0000","last_became_active":"2023-12-08T08:15:00.407393+0000","last_became_peered":"2023-12-08T08:15:00.407393+0000","last_unstale":"2023-12-08T08:15:04.447305+0000","last_undegraded":"2023-12-08T08:15:04.447305+0000","last_fullsized":"2023-12-08T08:15:04.447305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:23.811782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396937+0000","last_change":"2023-12-08T08:14:59.900649+0000","last_active":"2023-12-08T08:15:04.396937+0000","last_peered":"2023-12-08T08:15:04.396937+0000","last_clean":"2023-12-08T08:15:04.396937+0000","last_became_active":"2023-12-08T08:14:59.900269+0000","last_became_peered":"2023-12-08T08:14:59.900269+0000","last_unstale":"2023-12-08T08:15:04.396937+0000","last_undegraded":"2023-12-08T08:15:04.396937+0000","last_fullsized":"2023-12-08T08:15:04.396937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:18:21.472353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808319+0000","last_change":"2023-12-08T08:15:04.450623+0000","last_active":"2023-12-08T08:15:05.808319+0000","last_peered":"2023-12-08T08:15:05.808319+0000","last_clean":"2023-12-08T08:15:05.808319+0000","last_became_active":"2023-12-08T08:15:04.450114+0000","last_became_peered":"2023-12-08T08:15:04.450114+0000","last_unstale":"2023-12-08T08:15:05.808319+0000","last_undegraded":"2023-12-08T08:15:05.808319+0000","last_fullsized":"2023-12-08T08:15:05.808319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:27.343194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420632+0000","last_change":"2023-12-08T08:15:00.405005+0000","last_active":"2023-12-08T08:15:04.420632+0000","last_peered":"2023-12-08T08:15:04.420632+0000","last_clean":"2023-12-08T08:15:04.420632+0000","last_became_active":"2023-12-08T08:15:00.399553+0000","last_became_peered":"2023-12-08T08:15:00.399553+0000","last_unstale":"2023-12-08T08:15:04.420632+0000","last_undegraded":"2023-12-08T08:15:04.420632+0000","last_fullsized":"2023-12-08T08:15:04.420632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425547+0000","last_change":"2023-12-08T08:14:59.883073+0000","last_active":"2023-12-08T08:15:04.425547+0000","last_peered":"2023-12-08T08:15:04.425547+0000","last_clean":"2023-12-08T08:15:04.425547+0000","last_became_active":"2023-12-08T08:14:59.882846+0000","last_became_peered":"2023-12-08T08:14:59.882846+0000","last_unstale":"2023-12-08T08:15:04.425547+0000","last_undegraded":"2023-12-08T08:15:04.425547+0000","last_fullsized":"2023-12-08T08:15:04.425547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:19.331838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803008+0000","last_change":"2023-12-08T08:15:04.429843+0000","last_active":"2023-12-08T08:15:05.803008+0000","last_peered":"2023-12-08T08:15:05.803008+0000","last_clean":"2023-12-08T08:15:05.803008+0000","last_became_active":"2023-12-08T08:15:04.429319+0000","last_became_peered":"2023-12-08T08:15:04.429319+0000","last_unstale":"2023-12-08T08:15:05.803008+0000","last_undegraded":"2023-12-08T08:15:05.803008+0000","last_fullsized":"2023-12-08T08:15:05.803008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:37.027343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447921+0000","last_change":"2023-12-08T08:15:00.410615+0000","last_active":"2023-12-08T08:15:04.447921+0000","last_peered":"2023-12-08T08:15:04.447921+0000","last_clean":"2023-12-08T08:15:04.447921+0000","last_became_active":"2023-12-08T08:15:00.410331+0000","last_became_peered":"2023-12-08T08:15:00.410331+0000","last_unstale":"2023-12-08T08:15:04.447921+0000","last_undegraded":"2023-12-08T08:15:04.447921+0000","last_fullsized":"2023-12-08T08:15:04.447921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:25.467790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396751+0000","last_change":"2023-12-08T08:14:59.886431+0000","last_active":"2023-12-08T08:15:04.396751+0000","last_peered":"2023-12-08T08:15:04.396751+0000","last_clean":"2023-12-08T08:15:04.396751+0000","last_became_active":"2023-12-08T08:14:59.884506+0000","last_became_peered":"2023-12-08T08:14:59.884506+0000","last_unstale":"2023-12-08T08:15:04.396751+0000","last_undegraded":"2023-12-08T08:15:04.396751+0000","last_fullsized":"2023-12-08T08:15:04.396751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:49.879584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.873898+0000","last_change":"2023-12-08T08:15:04.451208+0000","last_active":"2023-12-08T08:15:05.873898+0000","last_peered":"2023-12-08T08:15:05.873898+0000","last_clean":"2023-12-08T08:15:05.873898+0000","last_became_active":"2023-12-08T08:15:04.450428+0000","last_became_peered":"2023-12-08T08:15:04.450428+0000","last_unstale":"2023-12-08T08:15:05.873898+0000","last_undegraded":"2023-12-08T08:15:05.873898+0000","last_fullsized":"2023-12-08T08:15:05.873898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447664+0000","last_change":"2023-12-08T08:15:00.404999+0000","last_active":"2023-12-08T08:15:04.447664+0000","last_peered":"2023-12-08T08:15:04.447664+0000","last_clean":"2023-12-08T08:15:04.447664+0000","last_became_active":"2023-12-08T08:15:00.400794+0000","last_became_peered":"2023-12-08T08:15:00.400794+0000","last_unstale":"2023-12-08T08:15:04.447664+0000","last_undegraded":"2023-12-08T08:15:04.447664+0000","last_fullsized":"2023-12-08T08:15:04.447664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:44.175457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.400585+0000","last_change":"2023-12-08T08:14:59.892750+0000","last_active":"2023-12-08T08:15:04.400585+0000","last_peered":"2023-12-08T08:15:04.400585+0000","last_clean":"2023-12-08T08:15:04.400585+0000","last_became_active":"2023-12-08T08:14:59.892365+0000","last_became_peered":"2023-12-08T08:14:59.892365+0000","last_unstale":"2023-12-08T08:15:04.400585+0000","last_undegraded":"2023-12-08T08:15:04.400585+0000","last_fullsized":"2023-12-08T08:15:04.400585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459457+0000","last_change":"2023-12-08T08:15:04.426203+0000","last_active":"2023-12-08T08:15:05.459457+0000","last_peered":"2023-12-08T08:15:05.459457+0000","last_clean":"2023-12-08T08:15:05.459457+0000","last_became_active":"2023-12-08T08:15:04.425489+0000","last_became_peered":"2023-12-08T08:15:04.425489+0000","last_unstale":"2023-12-08T08:15:05.459457+0000","last_undegraded":"2023-12-08T08:15:05.459457+0000","last_fullsized":"2023-12-08T08:15:05.459457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:21.113790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447843+0000","last_change":"2023-12-08T08:15:00.409331+0000","last_active":"2023-12-08T08:15:04.447843+0000","last_peered":"2023-12-08T08:15:04.447843+0000","last_clean":"2023-12-08T08:15:04.447843+0000","last_became_active":"2023-12-08T08:15:00.408754+0000","last_became_peered":"2023-12-08T08:15:00.408754+0000","last_unstale":"2023-12-08T08:15:04.447843+0000","last_undegraded":"2023-12-08T08:15:04.447843+0000","last_fullsized":"2023-12-08T08:15:04.447843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395799+0000","last_change":"2023-12-08T08:14:59.894408+0000","last_active":"2023-12-08T08:15:04.395799+0000","last_peered":"2023-12-08T08:15:04.395799+0000","last_clean":"2023-12-08T08:15:04.395799+0000","last_became_active":"2023-12-08T08:14:59.893999+0000","last_became_peered":"2023-12-08T08:14:59.893999+0000","last_unstale":"2023-12-08T08:15:04.395799+0000","last_undegraded":"2023-12-08T08:15:04.395799+0000","last_fullsized":"2023-12-08T08:15:04.395799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:50.749484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.804517+0000","last_change":"2023-12-08T08:15:04.433419+0000","last_active":"2023-12-08T08:15:05.804517+0000","last_peered":"2023-12-08T08:15:05.804517+0000","last_clean":"2023-12-08T08:15:05.804517+0000","last_became_active":"2023-12-08T08:15:04.432977+0000","last_became_peered":"2023-12-08T08:15:04.432977+0000","last_unstale":"2023-12-08T08:15:05.804517+0000","last_undegraded":"2023-12-08T08:15:05.804517+0000","last_fullsized":"2023-12-08T08:15:05.804517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:28.224459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413084+0000","last_change":"2023-12-08T08:15:00.396829+0000","last_active":"2023-12-08T08:15:04.413084+0000","last_peered":"2023-12-08T08:15:04.413084+0000","last_clean":"2023-12-08T08:15:04.413084+0000","last_became_active":"2023-12-08T08:15:00.396388+0000","last_became_peered":"2023-12-08T08:15:00.396388+0000","last_unstale":"2023-12-08T08:15:04.413084+0000","last_undegraded":"2023-12-08T08:15:04.413084+0000","last_fullsized":"2023-12-08T08:15:04.413084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416151+0000","last_change":"2023-12-08T08:14:59.887882+0000","last_active":"2023-12-08T08:15:04.416151+0000","last_peered":"2023-12-08T08:15:04.416151+0000","last_clean":"2023-12-08T08:15:04.416151+0000","last_became_active":"2023-12-08T08:14:59.887386+0000","last_became_peered":"2023-12-08T08:14:59.887386+0000","last_unstale":"2023-12-08T08:15:04.416151+0000","last_undegraded":"2023-12-08T08:15:04.416151+0000","last_fullsized":"2023-12-08T08:15:04.416151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:02.576945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.460992+0000","last_change":"2023-12-08T08:15:04.453192+0000","last_active":"2023-12-08T08:15:05.460992+0000","last_peered":"2023-12-08T08:15:05.460992+0000","last_clean":"2023-12-08T08:15:05.460992+0000","last_became_active":"2023-12-08T08:15:04.451164+0000","last_became_peered":"2023-12-08T08:15:04.451164+0000","last_unstale":"2023-12-08T08:15:05.460992+0000","last_undegraded":"2023-12-08T08:15:05.460992+0000","last_fullsized":"2023-12-08T08:15:05.460992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:43.529090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447335+0000","last_change":"2023-12-08T08:15:00.399582+0000","last_active":"2023-12-08T08:15:04.447335+0000","last_peered":"2023-12-08T08:15:04.447335+0000","last_clean":"2023-12-08T08:15:04.447335+0000","last_became_active":"2023-12-08T08:15:00.399251+0000","last_became_peered":"2023-12-08T08:15:00.399251+0000","last_unstale":"2023-12-08T08:15:04.447335+0000","last_undegraded":"2023-12-08T08:15:04.447335+0000","last_fullsized":"2023-12-08T08:15:04.447335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:57:00.940009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422568+0000","last_change":"2023-12-08T08:14:59.900340+0000","last_active":"2023-12-08T08:15:04.422568+0000","last_peered":"2023-12-08T08:15:04.422568+0000","last_clean":"2023-12-08T08:15:04.422568+0000","last_became_active":"2023-12-08T08:14:59.900040+0000","last_became_peered":"2023-12-08T08:14:59.900040+0000","last_unstale":"2023-12-08T08:15:04.422568+0000","last_undegraded":"2023-12-08T08:15:04.422568+0000","last_fullsized":"2023-12-08T08:15:04.422568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:12.707626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459907+0000","last_change":"2023-12-08T08:15:04.452930+0000","last_active":"2023-12-08T08:15:05.459907+0000","last_peered":"2023-12-08T08:15:05.459907+0000","last_clean":"2023-12-08T08:15:05.459907+0000","last_became_active":"2023-12-08T08:15:04.451134+0000","last_became_peered":"2023-12-08T08:15:04.451134+0000","last_unstale":"2023-12-08T08:15:05.459907+0000","last_undegraded":"2023-12-08T08:15:05.459907+0000","last_fullsized":"2023-12-08T08:15:05.459907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:41.298759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403685+0000","last_change":"2023-12-08T08:15:00.391149+0000","last_active":"2023-12-08T08:15:04.403685+0000","last_peered":"2023-12-08T08:15:04.403685+0000","last_clean":"2023-12-08T08:15:04.403685+0000","last_became_active":"2023-12-08T08:15:00.390876+0000","last_became_peered":"2023-12-08T08:15:00.390876+0000","last_unstale":"2023-12-08T08:15:04.403685+0000","last_undegraded":"2023-12-08T08:15:04.403685+0000","last_fullsized":"2023-12-08T08:15:04.403685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412304+0000","last_change":"2023-12-08T08:14:59.891130+0000","last_active":"2023-12-08T08:15:04.412304+0000","last_peered":"2023-12-08T08:15:04.412304+0000","last_clean":"2023-12-08T08:15:04.412304+0000","last_became_active":"2023-12-08T08:14:59.890441+0000","last_became_peered":"2023-12-08T08:14:59.890441+0000","last_unstale":"2023-12-08T08:15:04.412304+0000","last_undegraded":"2023-12-08T08:15:04.412304+0000","last_fullsized":"2023-12-08T08:15:04.412304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:37.110835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.875742+0000","last_change":"2023-12-08T08:15:04.451191+0000","last_active":"2023-12-08T08:15:05.875742+0000","last_peered":"2023-12-08T08:15:05.875742+0000","last_clean":"2023-12-08T08:15:05.875742+0000","last_became_active":"2023-12-08T08:15:04.450325+0000","last_became_peered":"2023-12-08T08:15:04.450325+0000","last_unstale":"2023-12-08T08:15:05.875742+0000","last_undegraded":"2023-12-08T08:15:05.875742+0000","last_fullsized":"2023-12-08T08:15:05.875742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447388+0000","last_change":"2023-12-08T08:15:00.398759+0000","last_active":"2023-12-08T08:15:04.447388+0000","last_peered":"2023-12-08T08:15:04.447388+0000","last_clean":"2023-12-08T08:15:04.447388+0000","last_became_active":"2023-12-08T08:15:00.392487+0000","last_became_peered":"2023-12-08T08:15:00.392487+0000","last_unstale":"2023-12-08T08:15:04.447388+0000","last_undegraded":"2023-12-08T08:15:04.447388+0000","last_fullsized":"2023-12-08T08:15:04.447388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:45.798792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:18.522009+0000","last_change":"2023-12-08T08:14:59.891354+0000","last_active":"2023-12-08T08:15:18.522009+0000","last_peered":"2023-12-08T08:15:18.522009+0000","last_clean":"2023-12-08T08:15:18.522009+0000","last_became_active":"2023-12-08T08:14:59.889600+0000","last_became_peered":"2023-12-08T08:14:59.889600+0000","last_unstale":"2023-12-08T08:15:18.522009+0000","last_undegraded":"2023-12-08T08:15:18.522009+0000","last_fullsized":"2023-12-08T08:15:18.522009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:55.347027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:07.101560+0000","last_change":"2023-12-08T08:15:04.436224+0000","last_active":"2023-12-08T08:15:07.101560+0000","last_peered":"2023-12-08T08:15:07.101560+0000","last_clean":"2023-12-08T08:15:07.101560+0000","last_became_active":"2023-12-08T08:15:04.435773+0000","last_became_peered":"2023-12-08T08:15:04.435773+0000","last_unstale":"2023-12-08T08:15:07.101560+0000","last_undegraded":"2023-12-08T08:15:07.101560+0000","last_fullsized":"2023-12-08T08:15:07.101560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:37.657486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404952+0000","last_change":"2023-12-08T08:15:00.389958+0000","last_active":"2023-12-08T08:15:04.404952+0000","last_peered":"2023-12-08T08:15:04.404952+0000","last_clean":"2023-12-08T08:15:04.404952+0000","last_became_active":"2023-12-08T08:15:00.388877+0000","last_became_peered":"2023-12-08T08:15:00.388877+0000","last_unstale":"2023-12-08T08:15:04.404952+0000","last_undegraded":"2023-12-08T08:15:04.404952+0000","last_fullsized":"2023-12-08T08:15:04.404952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425438+0000","last_change":"2023-12-08T08:14:59.895842+0000","last_active":"2023-12-08T08:15:04.425438+0000","last_peered":"2023-12-08T08:15:04.425438+0000","last_clean":"2023-12-08T08:15:04.425438+0000","last_became_active":"2023-12-08T08:14:59.895535+0000","last_became_peered":"2023-12-08T08:14:59.895535+0000","last_unstale":"2023-12-08T08:15:04.425438+0000","last_undegraded":"2023-12-08T08:15:04.425438+0000","last_fullsized":"2023-12-08T08:15:04.425438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:30.765400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.459762+0000","last_change":"2023-12-08T08:15:04.427188+0000","last_active":"2023-12-08T08:15:05.459762+0000","last_peered":"2023-12-08T08:15:05.459762+0000","last_clean":"2023-12-08T08:15:05.459762+0000","last_became_active":"2023-12-08T08:15:04.425996+0000","last_became_peered":"2023-12-08T08:15:04.425996+0000","last_unstale":"2023-12-08T08:15:05.459762+0000","last_undegraded":"2023-12-08T08:15:05.459762+0000","last_fullsized":"2023-12-08T08:15:05.459762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:29.438014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414847+0000","last_change":"2023-12-08T08:15:00.406403+0000","last_active":"2023-12-08T08:15:04.414847+0000","last_peered":"2023-12-08T08:15:04.414847+0000","last_clean":"2023-12-08T08:15:04.414847+0000","last_became_active":"2023-12-08T08:15:00.405993+0000","last_became_peered":"2023-12-08T08:15:00.405993+0000","last_unstale":"2023-12-08T08:15:04.414847+0000","last_undegraded":"2023-12-08T08:15:04.414847+0000","last_fullsized":"2023-12-08T08:15:04.414847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421161+0000","last_change":"2023-12-08T08:14:59.899499+0000","last_active":"2023-12-08T08:15:04.421161+0000","last_peered":"2023-12-08T08:15:04.421161+0000","last_clean":"2023-12-08T08:15:04.421161+0000","last_became_active":"2023-12-08T08:14:59.899208+0000","last_became_peered":"2023-12-08T08:14:59.899208+0000","last_unstale":"2023-12-08T08:15:04.421161+0000","last_undegraded":"2023-12-08T08:15:04.421161+0000","last_fullsized":"2023-12-08T08:15:04.421161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:10.487847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458733+0000","last_change":"2023-12-08T08:15:04.428378+0000","last_active":"2023-12-08T08:15:05.458733+0000","last_peered":"2023-12-08T08:15:05.458733+0000","last_clean":"2023-12-08T08:15:05.458733+0000","last_became_active":"2023-12-08T08:15:04.427710+0000","last_became_peered":"2023-12-08T08:15:04.427710+0000","last_unstale":"2023-12-08T08:15:05.458733+0000","last_undegraded":"2023-12-08T08:15:05.458733+0000","last_fullsized":"2023-12-08T08:15:05.458733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:52:06.186868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420774+0000","last_change":"2023-12-08T08:15:00.401845+0000","last_active":"2023-12-08T08:15:04.420774+0000","last_peered":"2023-12-08T08:15:04.420774+0000","last_clean":"2023-12-08T08:15:04.420774+0000","last_became_active":"2023-12-08T08:15:00.401428+0000","last_became_peered":"2023-12-08T08:15:00.401428+0000","last_unstale":"2023-12-08T08:15:04.420774+0000","last_undegraded":"2023-12-08T08:15:04.420774+0000","last_fullsized":"2023-12-08T08:15:04.420774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413854+0000","last_change":"2023-12-08T08:14:59.902626+0000","last_active":"2023-12-08T08:15:04.413854+0000","last_peered":"2023-12-08T08:15:04.413854+0000","last_clean":"2023-12-08T08:15:04.413854+0000","last_became_active":"2023-12-08T08:14:59.902263+0000","last_became_peered":"2023-12-08T08:14:59.902263+0000","last_unstale":"2023-12-08T08:15:04.413854+0000","last_undegraded":"2023-12-08T08:15:04.413854+0000","last_fullsized":"2023-12-08T08:15:04.413854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:50.043091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.458744+0000","last_change":"2023-12-08T08:15:04.452488+0000","last_active":"2023-12-08T08:15:05.458744+0000","last_peered":"2023-12-08T08:15:05.458744+0000","last_clean":"2023-12-08T08:15:05.458744+0000","last_became_active":"2023-12-08T08:15:04.451822+0000","last_became_peered":"2023-12-08T08:15:04.451822+0000","last_unstale":"2023-12-08T08:15:05.458744+0000","last_undegraded":"2023-12-08T08:15:05.458744+0000","last_fullsized":"2023-12-08T08:15:05.458744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:20.902711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.803994+0000","last_change":"2023-12-08T08:15:04.453801+0000","last_active":"2023-12-08T08:15:05.803994+0000","last_peered":"2023-12-08T08:15:05.803994+0000","last_clean":"2023-12-08T08:15:05.803994+0000","last_became_active":"2023-12-08T08:15:04.453352+0000","last_became_peered":"2023-12-08T08:15:04.453352+0000","last_unstale":"2023-12-08T08:15:05.803994+0000","last_undegraded":"2023-12-08T08:15:05.803994+0000","last_fullsized":"2023-12-08T08:15:05.803994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:15.153258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406035+0000","last_change":"2023-12-08T08:15:00.380909+0000","last_active":"2023-12-08T08:15:04.406035+0000","last_peered":"2023-12-08T08:15:04.406035+0000","last_clean":"2023-12-08T08:15:04.406035+0000","last_became_active":"2023-12-08T08:15:00.379700+0000","last_became_peered":"2023-12-08T08:15:00.379700+0000","last_unstale":"2023-12-08T08:15:04.406035+0000","last_undegraded":"2023-12-08T08:15:04.406035+0000","last_fullsized":"2023-12-08T08:15:04.406035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:04:49.106500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412365+0000","last_change":"2023-12-08T08:14:59.890675+0000","last_active":"2023-12-08T08:15:04.412365+0000","last_peered":"2023-12-08T08:15:04.412365+0000","last_clean":"2023-12-08T08:15:04.412365+0000","last_became_active":"2023-12-08T08:14:59.890323+0000","last_became_peered":"2023-12-08T08:14:59.890323+0000","last_unstale":"2023-12-08T08:15:04.412365+0000","last_undegraded":"2023-12-08T08:15:04.412365+0000","last_fullsized":"2023-12-08T08:15:04.412365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:33.086579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.808921+0000","last_change":"2023-12-08T08:15:04.443203+0000","last_active":"2023-12-08T08:15:05.808921+0000","last_peered":"2023-12-08T08:15:05.808921+0000","last_clean":"2023-12-08T08:15:05.808921+0000","last_became_active":"2023-12-08T08:15:04.442767+0000","last_became_peered":"2023-12-08T08:15:04.442767+0000","last_unstale":"2023-12-08T08:15:05.808921+0000","last_undegraded":"2023-12-08T08:15:05.808921+0000","last_fullsized":"2023-12-08T08:15:05.808921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:28.413841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411249+0000","last_change":"2023-12-08T08:15:00.394844+0000","last_active":"2023-12-08T08:15:04.411249+0000","last_peered":"2023-12-08T08:15:04.411249+0000","last_clean":"2023-12-08T08:15:04.411249+0000","last_became_active":"2023-12-08T08:15:00.394583+0000","last_became_peered":"2023-12-08T08:15:00.394583+0000","last_unstale":"2023-12-08T08:15:04.411249+0000","last_undegraded":"2023-12-08T08:15:04.411249+0000","last_fullsized":"2023-12-08T08:15:04.411249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:55:19.272742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416997+0000","last_change":"2023-12-08T08:14:59.898905+0000","last_active":"2023-12-08T08:15:04.416997+0000","last_peered":"2023-12-08T08:15:04.416997+0000","last_clean":"2023-12-08T08:15:04.416997+0000","last_became_active":"2023-12-08T08:14:59.897829+0000","last_became_peered":"2023-12-08T08:14:59.897829+0000","last_unstale":"2023-12-08T08:15:04.416997+0000","last_undegraded":"2023-12-08T08:15:04.416997+0000","last_fullsized":"2023-12-08T08:15:04.416997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:45:24.892032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414962+0000","last_change":"2023-12-08T08:14:59.895592+0000","last_active":"2023-12-08T08:15:04.414962+0000","last_peered":"2023-12-08T08:15:04.414962+0000","last_clean":"2023-12-08T08:15:04.414962+0000","last_became_active":"2023-12-08T08:14:59.895295+0000","last_became_peered":"2023-12-08T08:14:59.895295+0000","last_unstale":"2023-12-08T08:15:04.414962+0000","last_undegraded":"2023-12-08T08:15:04.414962+0000","last_fullsized":"2023-12-08T08:15:04.414962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:33.595711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412137+0000","last_change":"2023-12-08T08:15:00.401972+0000","last_active":"2023-12-08T08:15:04.412137+0000","last_peered":"2023-12-08T08:15:04.412137+0000","last_clean":"2023-12-08T08:15:04.412137+0000","last_became_active":"2023-12-08T08:15:00.401768+0000","last_became_peered":"2023-12-08T08:15:00.401768+0000","last_unstale":"2023-12-08T08:15:04.412137+0000","last_undegraded":"2023-12-08T08:15:04.412137+0000","last_fullsized":"2023-12-08T08:15:04.412137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:47:34.090187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:06.259376+0000","last_change":"2023-12-08T08:15:04.426722+0000","last_active":"2023-12-08T08:15:06.259376+0000","last_peered":"2023-12-08T08:15:06.259376+0000","last_clean":"2023-12-08T08:15:06.259376+0000","last_became_active":"2023-12-08T08:15:04.426302+0000","last_became_peered":"2023-12-08T08:15:04.426302+0000","last_unstale":"2023-12-08T08:15:06.259376+0000","last_undegraded":"2023-12-08T08:15:06.259376+0000","last_fullsized":"2023-12-08T08:15:06.259376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:07.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.419030+0000","last_change":"2023-12-08T08:14:59.898802+0000","last_active":"2023-12-08T08:15:04.419030+0000","last_peered":"2023-12-08T08:15:04.419030+0000","last_clean":"2023-12-08T08:15:04.419030+0000","last_became_active":"2023-12-08T08:14:59.897917+0000","last_became_peered":"2023-12-08T08:14:59.897917+0000","last_unstale":"2023-12-08T08:15:04.419030+0000","last_undegraded":"2023-12-08T08:15:04.419030+0000","last_fullsized":"2023-12-08T08:15:04.419030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:58.845975+0000","last_clean_scrub_stamp":"2023-12-08T08:14:58.845975+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:05.825571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.405546+0000","last_change":"2023-12-08T08:15:00.377480+0000","last_active":"2023-12-08T08:15:04.405546+0000","last_peered":"2023-12-08T08:15:04.405546+0000","last_clean":"2023-12-08T08:15:04.405546+0000","last_became_active":"2023-12-08T08:15:00.376692+0000","last_became_peered":"2023-12-08T08:15:00.376692+0000","last_unstale":"2023-12-08T08:15:04.405546+0000","last_undegraded":"2023-12-08T08:15:04.405546+0000","last_fullsized":"2023-12-08T08:15:04.405546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:08:50.883191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-08T08:15:05.461226+0000","last_change":"2023-12-08T08:15:04.434422+0000","last_active":"2023-12-08T08:15:05.461226+0000","last_peered":"2023-12-08T08:15:05.461226+0000","last_clean":"2023-12-08T08:15:05.461226+0000","last_became_active":"2023-12-08T08:15:04.434025+0000","last_became_peered":"2023-12-08T08:15:04.434025+0000","last_unstale":"2023-12-08T08:15:05.461226+0000","last_undegraded":"2023-12-08T08:15:05.461226+0000","last_fullsized":"2023-12-08T08:15:05.461226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:15:03.380994+0000","last_clean_scrub_stamp":"2023-12-08T08:15:03.380994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:40.936584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412941+0000","last_change":"2023-12-08T08:15:00.397602+0000","last_active":"2023-12-08T08:15:04.412941+0000","last_peered":"2023-12-08T08:15:04.412941+0000","last_clean":"2023-12-08T08:15:04.412941+0000","last_became_active":"2023-12-08T08:15:00.396793+0000","last_became_peered":"2023-12-08T08:15:00.396793+0000","last_unstale":"2023-12-08T08:15:04.412941+0000","last_undegraded":"2023-12-08T08:15:04.412941+0000","last_fullsized":"2023-12-08T08:15:04.412941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.395803+0000","last_change":"2023-12-08T08:15:00.392327+0000","last_active":"2023-12-08T08:15:04.395803+0000","last_peered":"2023-12-08T08:15:04.395803+0000","last_clean":"2023-12-08T08:15:04.395803+0000","last_became_active":"2023-12-08T08:15:00.391791+0000","last_became_peered":"2023-12-08T08:15:00.391791+0000","last_unstale":"2023-12-08T08:15:04.395803+0000","last_undegraded":"2023-12-08T08:15:04.395803+0000","last_fullsized":"2023-12-08T08:15:04.395803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:54.809477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422479+0000","last_change":"2023-12-08T08:15:00.399925+0000","last_active":"2023-12-08T08:15:04.422479+0000","last_peered":"2023-12-08T08:15:04.422479+0000","last_clean":"2023-12-08T08:15:04.422479+0000","last_became_active":"2023-12-08T08:15:00.397718+0000","last_became_peered":"2023-12-08T08:15:00.397718+0000","last_unstale":"2023-12-08T08:15:04.422479+0000","last_undegraded":"2023-12-08T08:15:04.422479+0000","last_fullsized":"2023-12-08T08:15:04.422479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412045+0000","last_change":"2023-12-08T08:15:00.389088+0000","last_active":"2023-12-08T08:15:04.412045+0000","last_peered":"2023-12-08T08:15:04.412045+0000","last_clean":"2023-12-08T08:15:04.412045+0000","last_became_active":"2023-12-08T08:15:00.388531+0000","last_became_peered":"2023-12-08T08:15:00.388531+0000","last_unstale":"2023-12-08T08:15:04.412045+0000","last_undegraded":"2023-12-08T08:15:04.412045+0000","last_fullsized":"2023-12-08T08:15:04.412045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:13.711233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418168+0000","last_change":"2023-12-08T08:15:00.399625+0000","last_active":"2023-12-08T08:15:04.418168+0000","last_peered":"2023-12-08T08:15:04.418168+0000","last_clean":"2023-12-08T08:15:04.418168+0000","last_became_active":"2023-12-08T08:15:00.399405+0000","last_became_peered":"2023-12-08T08:15:00.399405+0000","last_unstale":"2023-12-08T08:15:04.418168+0000","last_undegraded":"2023-12-08T08:15:04.418168+0000","last_fullsized":"2023-12-08T08:15:04.418168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425340+0000","last_change":"2023-12-08T08:15:00.388290+0000","last_active":"2023-12-08T08:15:04.425340+0000","last_peered":"2023-12-08T08:15:04.425340+0000","last_clean":"2023-12-08T08:15:04.425340+0000","last_became_active":"2023-12-08T08:15:00.387996+0000","last_became_peered":"2023-12-08T08:15:00.387996+0000","last_unstale":"2023-12-08T08:15:04.425340+0000","last_undegraded":"2023-12-08T08:15:04.425340+0000","last_fullsized":"2023-12-08T08:15:04.425340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:11.571727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416014+0000","last_change":"2023-12-08T08:15:00.404101+0000","last_active":"2023-12-08T08:15:04.416014+0000","last_peered":"2023-12-08T08:15:04.416014+0000","last_clean":"2023-12-08T08:15:04.416014+0000","last_became_active":"2023-12-08T08:15:00.403349+0000","last_became_peered":"2023-12-08T08:15:00.403349+0000","last_unstale":"2023-12-08T08:15:04.416014+0000","last_undegraded":"2023-12-08T08:15:04.416014+0000","last_fullsized":"2023-12-08T08:15:04.416014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418659+0000","last_change":"2023-12-08T08:15:00.406185+0000","last_active":"2023-12-08T08:15:04.418659+0000","last_peered":"2023-12-08T08:15:04.418659+0000","last_clean":"2023-12-08T08:15:04.418659+0000","last_became_active":"2023-12-08T08:15:00.405860+0000","last_became_peered":"2023-12-08T08:15:00.405860+0000","last_unstale":"2023-12-08T08:15:04.418659+0000","last_undegraded":"2023-12-08T08:15:04.418659+0000","last_fullsized":"2023-12-08T08:15:04.418659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412237+0000","last_change":"2023-12-08T08:15:00.397626+0000","last_active":"2023-12-08T08:15:04.412237+0000","last_peered":"2023-12-08T08:15:04.412237+0000","last_clean":"2023-12-08T08:15:04.412237+0000","last_became_active":"2023-12-08T08:15:00.397097+0000","last_became_peered":"2023-12-08T08:15:00.397097+0000","last_unstale":"2023-12-08T08:15:04.412237+0000","last_undegraded":"2023-12-08T08:15:04.412237+0000","last_fullsized":"2023-12-08T08:15:04.412237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.416905+0000","last_change":"2023-12-08T08:15:00.399153+0000","last_active":"2023-12-08T08:15:04.416905+0000","last_peered":"2023-12-08T08:15:04.416905+0000","last_clean":"2023-12-08T08:15:04.416905+0000","last_became_active":"2023-12-08T08:15:00.398929+0000","last_became_peered":"2023-12-08T08:15:00.398929+0000","last_unstale":"2023-12-08T08:15:04.416905+0000","last_undegraded":"2023-12-08T08:15:04.416905+0000","last_fullsized":"2023-12-08T08:15:04.416905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:29:49.484306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422384+0000","last_change":"2023-12-08T08:15:00.401295+0000","last_active":"2023-12-08T08:15:04.422384+0000","last_peered":"2023-12-08T08:15:04.422384+0000","last_clean":"2023-12-08T08:15:04.422384+0000","last_became_active":"2023-12-08T08:15:00.401003+0000","last_became_peered":"2023-12-08T08:15:00.401003+0000","last_unstale":"2023-12-08T08:15:04.422384+0000","last_undegraded":"2023-12-08T08:15:04.422384+0000","last_fullsized":"2023-12-08T08:15:04.422384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411185+0000","last_change":"2023-12-08T08:15:00.389780+0000","last_active":"2023-12-08T08:15:04.411185+0000","last_peered":"2023-12-08T08:15:04.411185+0000","last_clean":"2023-12-08T08:15:04.411185+0000","last_became_active":"2023-12-08T08:15:00.388834+0000","last_became_peered":"2023-12-08T08:15:00.388834+0000","last_unstale":"2023-12-08T08:15:04.411185+0000","last_undegraded":"2023-12-08T08:15:04.411185+0000","last_fullsized":"2023-12-08T08:15:04.411185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:06.829179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.413719+0000","last_change":"2023-12-08T08:15:00.411312+0000","last_active":"2023-12-08T08:15:04.413719+0000","last_peered":"2023-12-08T08:15:04.413719+0000","last_clean":"2023-12-08T08:15:04.413719+0000","last_became_active":"2023-12-08T08:15:00.408772+0000","last_became_peered":"2023-12-08T08:15:00.408772+0000","last_unstale":"2023-12-08T08:15:04.413719+0000","last_undegraded":"2023-12-08T08:15:04.413719+0000","last_fullsized":"2023-12-08T08:15:04.413719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447494+0000","last_change":"2023-12-08T08:15:00.392749+0000","last_active":"2023-12-08T08:15:04.447494+0000","last_peered":"2023-12-08T08:15:04.447494+0000","last_clean":"2023-12-08T08:15:04.447494+0000","last_became_active":"2023-12-08T08:15:00.392113+0000","last_became_peered":"2023-12-08T08:15:00.392113+0000","last_unstale":"2023-12-08T08:15:04.447494+0000","last_undegraded":"2023-12-08T08:15:04.447494+0000","last_fullsized":"2023-12-08T08:15:04.447494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.396777+0000","last_change":"2023-12-08T08:15:00.397614+0000","last_active":"2023-12-08T08:15:04.396777+0000","last_peered":"2023-12-08T08:15:04.396777+0000","last_clean":"2023-12-08T08:15:04.396777+0000","last_became_active":"2023-12-08T08:15:00.397110+0000","last_became_peered":"2023-12-08T08:15:00.397110+0000","last_unstale":"2023-12-08T08:15:04.396777+0000","last_undegraded":"2023-12-08T08:15:04.396777+0000","last_fullsized":"2023-12-08T08:15:04.396777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:46:38.114443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.421587+0000","last_change":"2023-12-08T08:15:00.405108+0000","last_active":"2023-12-08T08:15:04.421587+0000","last_peered":"2023-12-08T08:15:04.421587+0000","last_clean":"2023-12-08T08:15:04.421587+0000","last_became_active":"2023-12-08T08:15:00.404650+0000","last_became_peered":"2023-12-08T08:15:00.404650+0000","last_unstale":"2023-12-08T08:15:04.421587+0000","last_undegraded":"2023-12-08T08:15:04.421587+0000","last_fullsized":"2023-12-08T08:15:04.421587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:53:33.495930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.412104+0000","last_change":"2023-12-08T08:15:00.399420+0000","last_active":"2023-12-08T08:15:04.412104+0000","last_peered":"2023-12-08T08:15:04.412104+0000","last_clean":"2023-12-08T08:15:04.412104+0000","last_became_active":"2023-12-08T08:15:00.397884+0000","last_became_peered":"2023-12-08T08:15:00.397884+0000","last_unstale":"2023-12-08T08:15:04.412104+0000","last_undegraded":"2023-12-08T08:15:04.412104+0000","last_fullsized":"2023-12-08T08:15:04.412104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:17.582377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.406107+0000","last_change":"2023-12-08T08:15:00.373700+0000","last_active":"2023-12-08T08:15:04.406107+0000","last_peered":"2023-12-08T08:15:04.406107+0000","last_clean":"2023-12-08T08:15:04.406107+0000","last_became_active":"2023-12-08T08:15:00.373315+0000","last_became_peered":"2023-12-08T08:15:00.373315+0000","last_unstale":"2023-12-08T08:15:04.406107+0000","last_undegraded":"2023-12-08T08:15:04.406107+0000","last_fullsized":"2023-12-08T08:15:04.406107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:03:54.536240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.403529+0000","last_change":"2023-12-08T08:15:00.385175+0000","last_active":"2023-12-08T08:15:04.403529+0000","last_peered":"2023-12-08T08:15:04.403529+0000","last_clean":"2023-12-08T08:15:04.403529+0000","last_became_active":"2023-12-08T08:15:00.384670+0000","last_became_peered":"2023-12-08T08:15:00.384670+0000","last_unstale":"2023-12-08T08:15:04.403529+0000","last_undegraded":"2023-12-08T08:15:04.403529+0000","last_fullsized":"2023-12-08T08:15:04.403529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.418851+0000","last_change":"2023-12-08T08:15:00.397339+0000","last_active":"2023-12-08T08:15:04.418851+0000","last_peered":"2023-12-08T08:15:04.418851+0000","last_clean":"2023-12-08T08:15:04.418851+0000","last_became_active":"2023-12-08T08:15:00.396888+0000","last_became_peered":"2023-12-08T08:15:00.396888+0000","last_unstale":"2023-12-08T08:15:04.418851+0000","last_undegraded":"2023-12-08T08:15:04.418851+0000","last_fullsized":"2023-12-08T08:15:04.418851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.404753+0000","last_change":"2023-12-08T08:15:00.406207+0000","last_active":"2023-12-08T08:15:04.404753+0000","last_peered":"2023-12-08T08:15:04.404753+0000","last_clean":"2023-12-08T08:15:04.404753+0000","last_became_active":"2023-12-08T08:15:00.405928+0000","last_became_peered":"2023-12-08T08:15:00.405928+0000","last_unstale":"2023-12-08T08:15:04.404753+0000","last_undegraded":"2023-12-08T08:15:04.404753+0000","last_fullsized":"2023-12-08T08:15:04.404753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:12.923902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.415948+0000","last_change":"2023-12-08T08:15:00.411990+0000","last_active":"2023-12-08T08:15:04.415948+0000","last_peered":"2023-12-08T08:15:04.415948+0000","last_clean":"2023-12-08T08:15:04.415948+0000","last_became_active":"2023-12-08T08:15:00.411754+0000","last_became_peered":"2023-12-08T08:15:00.411754+0000","last_unstale":"2023-12-08T08:15:04.415948+0000","last_undegraded":"2023-12-08T08:15:04.415948+0000","last_fullsized":"2023-12-08T08:15:04.415948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:04:11.491454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.414100+0000","last_change":"2023-12-08T08:15:00.404296+0000","last_active":"2023-12-08T08:15:04.414100+0000","last_peered":"2023-12-08T08:15:04.414100+0000","last_clean":"2023-12-08T08:15:04.414100+0000","last_became_active":"2023-12-08T08:15:00.403816+0000","last_became_peered":"2023-12-08T08:15:00.403816+0000","last_unstale":"2023-12-08T08:15:04.414100+0000","last_undegraded":"2023-12-08T08:15:04.414100+0000","last_fullsized":"2023-12-08T08:15:04.414100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.906602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447876+0000","last_change":"2023-12-08T08:15:00.407698+0000","last_active":"2023-12-08T08:15:04.447876+0000","last_peered":"2023-12-08T08:15:04.447876+0000","last_clean":"2023-12-08T08:15:04.447876+0000","last_became_active":"2023-12-08T08:15:00.407394+0000","last_became_peered":"2023-12-08T08:15:00.407394+0000","last_unstale":"2023-12-08T08:15:04.447876+0000","last_undegraded":"2023-12-08T08:15:04.447876+0000","last_fullsized":"2023-12-08T08:15:04.447876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:11.621846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.410963+0000","last_change":"2023-12-08T08:15:00.400390+0000","last_active":"2023-12-08T08:15:04.410963+0000","last_peered":"2023-12-08T08:15:04.410963+0000","last_clean":"2023-12-08T08:15:04.410963+0000","last_became_active":"2023-12-08T08:15:00.400019+0000","last_became_peered":"2023-12-08T08:15:00.400019+0000","last_unstale":"2023-12-08T08:15:04.410963+0000","last_undegraded":"2023-12-08T08:15:04.410963+0000","last_fullsized":"2023-12-08T08:15:04.410963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.580553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447736+0000","last_change":"2023-12-08T08:15:00.396225+0000","last_active":"2023-12-08T08:15:04.447736+0000","last_peered":"2023-12-08T08:15:04.447736+0000","last_clean":"2023-12-08T08:15:04.447736+0000","last_became_active":"2023-12-08T08:15:00.395943+0000","last_became_peered":"2023-12-08T08:15:00.395943+0000","last_unstale":"2023-12-08T08:15:04.447736+0000","last_undegraded":"2023-12-08T08:15:04.447736+0000","last_fullsized":"2023-12-08T08:15:04.447736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:01.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.422301+0000","last_change":"2023-12-08T08:15:00.401328+0000","last_active":"2023-12-08T08:15:04.422301+0000","last_peered":"2023-12-08T08:15:04.422301+0000","last_clean":"2023-12-08T08:15:04.422301+0000","last_became_active":"2023-12-08T08:15:00.400964+0000","last_became_peered":"2023-12-08T08:15:00.400964+0000","last_unstale":"2023-12-08T08:15:04.422301+0000","last_undegraded":"2023-12-08T08:15:04.422301+0000","last_fullsized":"2023-12-08T08:15:04.422301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:25:26.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447113+0000","last_change":"2023-12-08T08:15:00.386324+0000","last_active":"2023-12-08T08:15:04.447113+0000","last_peered":"2023-12-08T08:15:04.447113+0000","last_clean":"2023-12-08T08:15:04.447113+0000","last_became_active":"2023-12-08T08:15:00.385867+0000","last_became_peered":"2023-12-08T08:15:00.385867+0000","last_unstale":"2023-12-08T08:15:04.447113+0000","last_undegraded":"2023-12-08T08:15:04.447113+0000","last_fullsized":"2023-12-08T08:15:04.447113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.420534+0000","last_change":"2023-12-08T08:15:00.405186+0000","last_active":"2023-12-08T08:15:04.420534+0000","last_peered":"2023-12-08T08:15:04.420534+0000","last_clean":"2023-12-08T08:15:04.420534+0000","last_became_active":"2023-12-08T08:15:00.404663+0000","last_became_peered":"2023-12-08T08:15:00.404663+0000","last_unstale":"2023-12-08T08:15:04.420534+0000","last_undegraded":"2023-12-08T08:15:04.420534+0000","last_fullsized":"2023-12-08T08:15:04.420534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:43:20.519107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.411222+0000","last_change":"2023-12-08T08:15:00.390953+0000","last_active":"2023-12-08T08:15:04.411222+0000","last_peered":"2023-12-08T08:15:04.411222+0000","last_clean":"2023-12-08T08:15:04.411222+0000","last_became_active":"2023-12-08T08:15:00.390638+0000","last_became_peered":"2023-12-08T08:15:00.390638+0000","last_unstale":"2023-12-08T08:15:04.411222+0000","last_undegraded":"2023-12-08T08:15:04.411222+0000","last_fullsized":"2023-12-08T08:15:04.411222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:29:33.465589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.425744+0000","last_change":"2023-12-08T08:15:00.394118+0000","last_active":"2023-12-08T08:15:04.425744+0000","last_peered":"2023-12-08T08:15:04.425744+0000","last_clean":"2023-12-08T08:15:04.425744+0000","last_became_active":"2023-12-08T08:15:00.393338+0000","last_became_peered":"2023-12-08T08:15:00.393338+0000","last_unstale":"2023-12-08T08:15:04.425744+0000","last_undegraded":"2023-12-08T08:15:04.425744+0000","last_fullsized":"2023-12-08T08:15:04.425744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:04:34.103680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-08T08:15:04.447849+0000","last_change":"2023-12-08T08:15:00.404323+0000","last_active":"2023-12-08T08:15:04.447849+0000","last_peered":"2023-12-08T08:15:04.447849+0000","last_clean":"2023-12-08T08:15:04.447849+0000","last_became_active":"2023-12-08T08:15:00.403298+0000","last_became_peered":"2023-12-08T08:15:00.403298+0000","last_unstale":"2023-12-08T08:15:04.447849+0000","last_undegraded":"2023-12-08T08:15:04.447849+0000","last_fullsized":"2023-12-08T08:15:04.447849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:59.849582+0000","last_clean_scrub_stamp":"2023-12-08T08:14:59.849582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:24.882429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":698708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":107884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":111597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":274432,"data_stored":107758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":107918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":698764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5839999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9029999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5059999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6559999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:15:35.471 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:15:35.471 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-08T08:15:35.471 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-08T08:15:35.471 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-08T08:15:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.724+0000 7f5d7efc9640 1 Processor -- start 2023-12-08T08:15:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.724+0000 7f5d7efc9640 1 -- start start 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.725+0000 7f5d7efc9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d78154190 0x7f5d780aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.725+0000 7f5d7efc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5d780a4f30 0x7f5d780c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7efc9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780c63b0 con 0x7f5d780c4800 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7efc9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780a9f20 con 0x7f5d78154190 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7efc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780c4c20 con 0x7f5d780a4f30 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7cd65640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d78154190 0x7f5d780aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7cd65640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d78154190 0x7f5d780aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48506/0 (socket says 172.21.15.45:48506) 2023-12-08T08:15:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d7cd65640 1 -- 172.21.15.45:0/594445125 learned_addr learned my addr 172.21.15.45:0/594445125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.726+0000 7f5d77fff640 1 --2- 172.21.15.45:0/594445125 >> v2:172.21.15.114:3300/0 conn(0x7f5d780a4f30 0x7f5d780c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.727+0000 7f5d7cd65640 1 -- 172.21.15.45:0/594445125 >> v2:172.21.15.114:3300/0 conn(0x7f5d780a4f30 msgr2=0x7f5d780c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.727+0000 7f5d7cd65640 1 --2- 172.21.15.45:0/594445125 >> v2:172.21.15.114:3300/0 conn(0x7f5d780a4f30 0x7f5d780c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.727+0000 7f5d7cd65640 1 -- 172.21.15.45:0/594445125 >> v1:172.21.15.114:6789/0 conn(0x7f5d780c4800 legacy=0x7f5d78154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.727+0000 7f5d7cd65640 1 -- 172.21.15.45:0/594445125 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780a53c0 con 0x7f5d78154190 2023-12-08T08:15:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.728+0000 7f5d7cd65640 1 --2- 172.21.15.45:0/594445125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d780aa2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806e0d0 tx=0x7f5d6802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9309556ec76ce174 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.728+0000 7f5d777fe640 1 -- 172.21.15.45:0/594445125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6802c9f0 con 0x7f5d78154190 2023-12-08T08:15:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.728+0000 7f5d777fe640 1 -- 172.21.15.45:0/594445125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6802cb50 con 0x7f5d78154190 2023-12-08T08:15:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.728+0000 7f5d777fe640 1 -- 172.21.15.45:0/594445125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680343f0 con 0x7f5d78154190 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 -- 172.21.15.45:0/594445125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 msgr2=0x7f5d780aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/594445125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d780aa2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806e0d0 tx=0x7f5d6802be50 comp rx=0 tx=0).stop 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 -- 172.21.15.45:0/594445125 shutdown_connections 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/594445125 >> v2:172.21.15.114:3300/0 conn(0x7f5d780a4f30 0x7f5d780c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/594445125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d780aa2b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 -- 172.21.15.45:0/594445125 >> 172.21.15.45:0/594445125 conn(0x7f5d780661f0 msgr2=0x7f5d78066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 -- 172.21.15.45:0/594445125 shutdown_connections 2023-12-08T08:15:35.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.729+0000 7f5d7efc9640 1 -- 172.21.15.45:0/594445125 wait complete. 2023-12-08T08:15:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.731+0000 7f5d7efc9640 1 Processor -- start 2023-12-08T08:15:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.731+0000 7f5d7efc9640 1 -- start start 2023-12-08T08:15:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d780a4f30 0x7f5d78150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d780c4800 0x7f5d7814af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7814c250 con 0x7f5d78154190 2023-12-08T08:15:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7814d170 con 0x7f5d780c4800 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7efc9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7814c4a0 con 0x7f5d780a4f30 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48508/0 (socket says 172.21.15.45:48508) 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 -- 172.21.15.45:0/816092353 learned_addr learned my addr 172.21.15.45:0/816092353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d77fff640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d780c4800 0x7f5d7814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7cd65640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d780a4f30 0x7f5d78150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 -- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d780a4f30 msgr2=0x7f5d78150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d780a4f30 0x7f5d78150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 -- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d780c4800 msgr2=0x7f5d7814af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.732+0000 7f5d7d566640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d780c4800 0x7f5d7814af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d7d566640 1 -- 172.21.15.45:0/816092353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009b30 con 0x7f5d78154190 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d7d566640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c410 tx=0x7f5d7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011790 con 0x7f5d78154190 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d700118f0 con 0x7f5d78154190 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7814ce00 con 0x7f5d78154190 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011ce0 con 0x7f5d78154190 2023-12-08T08:15:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.733+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7814bb40 con 0x7f5d78154190 2023-12-08T08:15:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.734+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7814cc60 con 0x7f5d78154190 2023-12-08T08:15:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.735+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d7001c460 con 0x7f5d78154190 2023-12-08T08:15:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.736+0000 7f5d757fa640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 0x7f5d6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.736+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d700894c0 con 0x7f5d78154190 2023-12-08T08:15:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.737+0000 7f5d7cd65640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 0x7f5d6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:35.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.738+0000 7f5d7cd65640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 0x7f5d6406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d68035000 tx=0x7f5d68030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.741+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d7814cc60 con 0x7f5d78154190 2023-12-08T08:15:35.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.968+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5d7814cc60 con 0x7f5d78154190 2023-12-08T08:15:35.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.969+0000 7f5d757fa640 1 -- 172.21.15.45:0/816092353 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5d7814cc60 con 0x7f5d78154190 2023-12-08T08:15:35.972 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:35.972 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-08T08:15:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 msgr2=0x7f5d6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 0x7f5d6406d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d68035000 tx=0x7f5d68030000 comp rx=0 tx=0).stop 2023-12-08T08:15:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 msgr2=0x7f5d7814b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c410 tx=0x7f5d7000c8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 shutdown_connections 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5d6406ae70 0x7f5d6406d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d78154190 0x7f5d7814b4d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d780c4800 0x7f5d7814af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 --2- 172.21.15.45:0/816092353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5d780a4f30 0x7f5d78150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 >> 172.21.15.45:0/816092353 conn(0x7f5d780661f0 msgr2=0x7f5d780665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.971+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 shutdown_connections 2023-12-08T08:15:35.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:35.972+0000 7f5d7efc9640 1 -- 172.21.15.45:0/816092353 wait complete. 2023-12-08T08:15:35.991 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-08T08:15:35.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.186+0000 7fd6cf71d640 1 Processor -- start 2023-12-08T08:15:36.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.187+0000 7fd6cf71d640 1 -- start start 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.188+0000 7fd6cf71d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c8155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.188+0000 7fd6cf71d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd6c80ca0e0 0x7fd6c80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.188+0000 7fd6cf71d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6c81581c0 0x7fd6c8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.188+0000 7fd6cf71d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c8155540 con 0x7fd6c81581c0 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cf71d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80c4880 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cf71d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80c4b60 con 0x7fd6c814e800 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6c81581c0 0x7fd6c8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6c81581c0 0x7fd6c8158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48520/0 (socket says 172.21.15.45:48520) 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 -- 172.21.15.45:0/206146745 learned_addr learned my addr 172.21.15.45:0/206146745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cccb8640 1 --2- 172.21.15.45:0/206146745 >> v2:172.21.15.114:3300/0 conn(0x7fd6c80ca0e0 0x7fd6c80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cd4b9640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c8155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 -- 172.21.15.45:0/206146745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 msgr2=0x7fd6c8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c8155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 -- 172.21.15.45:0/206146745 >> v2:172.21.15.114:3300/0 conn(0x7fd6c80ca0e0 msgr2=0x7fd6c80ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.189+0000 7fd6cdcba640 1 --2- 172.21.15.45:0/206146745 >> v2:172.21.15.114:3300/0 conn(0x7fd6c80ca0e0 0x7fd6c80ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.190+0000 7fd6cdcba640 1 -- 172.21.15.45:0/206146745 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80c4e40 con 0x7fd6c81581c0 2023-12-08T08:15:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.191+0000 7fd6cdcba640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c81581c0 0x7fd6c8158650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80ac940 tx=0x7fd6c002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bbdadea74e7105 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.191+0000 7fd6bffff640 1 -- 172.21.15.45:0/206146745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c002c950 con 0x7fd6c81581c0 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.191+0000 7fd6bffff640 1 -- 172.21.15.45:0/206146745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c002cab0 con 0x7fd6c81581c0 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.191+0000 7fd6bffff640 1 -- 172.21.15.45:0/206146745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c002ce40 con 0x7fd6c81581c0 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 -- 172.21.15.45:0/206146745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c81581c0 msgr2=0x7fd6c8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c81581c0 0x7fd6c8158650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80ac940 tx=0x7fd6c002bdb0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 -- 172.21.15.45:0/206146745 shutdown_connections 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/206146745 >> v2:172.21.15.114:3300/0 conn(0x7fd6c80ca0e0 0x7fd6c80ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c81581c0 0x7fd6c8158650 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/206146745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 -- 172.21.15.45:0/206146745 >> 172.21.15.45:0/206146745 conn(0x7fd6c80663d0 msgr2=0x7fd6c80667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 -- 172.21.15.45:0/206146745 shutdown_connections 2023-12-08T08:15:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.192+0000 7fd6cf71d640 1 -- 172.21.15.45:0/206146745 wait complete. 2023-12-08T08:15:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.194+0000 7fd6cf71d640 1 Processor -- start 2023-12-08T08:15:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.194+0000 7fd6cf71d640 1 -- start start 2023-12-08T08:15:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c81581c0 0x7fd6c80c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80c3550 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c81eaf80 con 0x7fd6c81581c0 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cf71d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80a9a20 con 0x7fd6c814e800 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48536/0 (socket says 172.21.15.45:48536) 2023-12-08T08:15:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 -- 172.21.15.45:0/3237306985 learned_addr learned my addr 172.21.15.45:0/3237306985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cccb8640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cdcba640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c81581c0 0x7fd6c80c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 -- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 msgr2=0x7fd6c81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c81541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 -- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c81581c0 msgr2=0x7fd6c80c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c81581c0 0x7fd6c80c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.195+0000 7fd6cd4b9640 1 -- 172.21.15.45:0/3237306985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0009b30 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6cd4b9640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400d5f0 tx=0x7fd6c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40125f0 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c4012750 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c80a9d00 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4012b00 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.196+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c80c3c80 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.197+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c80a9ef0 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.198+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6c4012c60 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.199+0000 7fd6bdffb640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 0x7fd6ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.199+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6c4089de0 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.199+0000 7fd6cccb8640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 0x7fd6ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.200+0000 7fd6cccb8640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 0x7fd6ac06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8006fd0 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.204+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6c4054b90 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.394+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6c80c7e50 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.397+0000 7fd6bdffb640 1 -- 172.21.15.45:0/3237306985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fd6c40581b0 con 0x7fd6c80ca0e0 2023-12-08T08:15:36.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:36.400 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 msgr2=0x7fd6ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 0x7fd6ac06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8006fd0 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 msgr2=0x7fd6c8153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400d5f0 tx=0x7fd6c400dab0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 shutdown_connections 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd6ac06ae40 0x7fd6ac06d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd6c814e800 0x7fd6c81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6c81581c0 0x7fd6c80c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 --2- 172.21.15.45:0/3237306985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c80ca0e0 0x7fd6c8153c90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.399+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 >> 172.21.15.45:0/3237306985 conn(0x7fd6c80663d0 msgr2=0x7fd6c80667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.400+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 shutdown_connections 2023-12-08T08:15:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.400+0000 7fd6cf71d640 1 -- 172.21.15.45:0/3237306985 wait complete. 2023-12-08T08:15:36.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:36.421 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.626+0000 7f3a2f59e640 1 Processor -- start 2023-12-08T08:15:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.626+0000 7f3a2f59e640 1 -- start start 2023-12-08T08:15:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a3006e740 0x7f3a30070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a300c0aa0 0x7f3a300c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2f59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a30151b10 con 0x7f3a30072070 2023-12-08T08:15:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300ab050 con 0x7f3a3006e740 2023-12-08T08:15:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a30151df0 con 0x7f3a300c0aa0 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a3006e740 0x7f3a30070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a3006e740 0x7f3a30070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48548/0 (socket says 172.21.15.45:48548) 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a2e59c640 1 -- 172.21.15.45:0/4023528754 learned_addr learned my addr 172.21.15.45:0/4023528754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.628+0000 7f3a27fff640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a300c0aa0 0x7f3a300c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.629+0000 7f3a2e59c640 1 -- 172.21.15.45:0/4023528754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a300c0aa0 msgr2=0x7f3a300c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.629+0000 7f3a2e59c640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a300c0aa0 0x7f3a300c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.629+0000 7f3a2e59c640 1 -- 172.21.15.45:0/4023528754 >> v1:172.21.15.114:6789/0 conn(0x7f3a30072070 legacy=0x7f3a300c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.629+0000 7f3a2e59c640 1 -- 172.21.15.45:0/4023528754 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300ab260 con 0x7f3a3006e740 2023-12-08T08:15:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.630+0000 7f3a2e59c640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a30070200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009870 tx=0x7f3a2002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f3a90750098fc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.630+0000 7f3a2dd9b640 1 -- 172.21.15.45:0/4023528754 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20030840 con 0x7f3a3006e740 2023-12-08T08:15:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.630+0000 7f3a2dd9b640 1 -- 172.21.15.45:0/4023528754 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a200309a0 con 0x7f3a3006e740 2023-12-08T08:15:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.630+0000 7f3a2dd9b640 1 -- 172.21.15.45:0/4023528754 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20030d30 con 0x7f3a3006e740 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 -- 172.21.15.45:0/4023528754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 msgr2=0x7f3a30070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a30070200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009870 tx=0x7f3a2002b980 comp rx=0 tx=0).stop 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 -- 172.21.15.45:0/4023528754 shutdown_connections 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a300c0aa0 0x7f3a300c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/4023528754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a30070200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 -- 172.21.15.45:0/4023528754 >> 172.21.15.45:0/4023528754 conn(0x7f3a300c60a0 msgr2=0x7f3a300c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 -- 172.21.15.45:0/4023528754 shutdown_connections 2023-12-08T08:15:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.631+0000 7f3a2f59e640 1 -- 172.21.15.45:0/4023528754 wait complete. 2023-12-08T08:15:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.633+0000 7f3a2f59e640 1 Processor -- start 2023-12-08T08:15:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.633+0000 7f3a2f59e640 1 -- start start 2023-12-08T08:15:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a30072070 0x7f3a30145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a300c0aa0 0x7f3a30145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301eb620 con 0x7f3a3006e740 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301ec1a0 con 0x7f3a300c0aa0 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301464f0 con 0x7f3a30072070 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48552/0 (socket says 172.21.15.45:48552) 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.634+0000 7f3a2e59c640 1 -- 172.21.15.45:0/2181714421 learned_addr learned my addr 172.21.15.45:0/2181714421 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a27fff640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a30072070 0x7f3a30145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2ed9d640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a300c0aa0 0x7f3a30145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 -- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a30072070 msgr2=0x7f3a30145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a30072070 0x7f3a30145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 -- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a300c0aa0 msgr2=0x7f3a30145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a300c0aa0 0x7f3a30145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 -- 172.21.15.45:0/2181714421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200094d0 con 0x7f3a3006e740 2023-12-08T08:15:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2e59c640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000c00 tx=0x7f3a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20039a90 con 0x7f3a3006e740 2023-12-08T08:15:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20039bf0 con 0x7f3a3006e740 2023-12-08T08:15:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20043410 con 0x7f3a3006e740 2023-12-08T08:15:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.635+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a301eb870 con 0x7f3a3006e740 2023-12-08T08:15:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.636+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a301ebe30 con 0x7f3a3006e740 2023-12-08T08:15:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.637+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a30067c50 con 0x7f3a3006e740 2023-12-08T08:15:36.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.638+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a2002f390 con 0x7f3a3006e740 2023-12-08T08:15:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.639+0000 7f3a26ffd640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 0x7f3a1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.639+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3a200abac0 con 0x7f3a3006e740 2023-12-08T08:15:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.639+0000 7f3a27fff640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 0x7f3a1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.640+0000 7f3a27fff640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 0x7f3a1006d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a30150550 tx=0x7f3a18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.643+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a20076870 con 0x7f3a3006e740 2023-12-08T08:15:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.834+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a300aab20 con 0x7f3a3006e740 2023-12-08T08:15:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.835+0000 7f3a26ffd640 1 -- 172.21.15.45:0/2181714421 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a20048020 con 0x7f3a3006e740 2023-12-08T08:15:36.838 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 msgr2=0x7f3a1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 0x7f3a1006d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a30150550 tx=0x7f3a18008040 comp rx=0 tx=0).stop 2023-12-08T08:15:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 msgr2=0x7f3a300c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000c00 tx=0x7f3a20004730 comp rx=0 tx=0).stop 2023-12-08T08:15:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 shutdown_connections 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3a1006ae40 0x7f3a1006d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3a30072070 0x7f3a30145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a300c0aa0 0x7f3a30145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 --2- 172.21.15.45:0/2181714421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3006e740 0x7f3a300c2fa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 >> 172.21.15.45:0/2181714421 conn(0x7f3a300c60a0 msgr2=0x7f3a30073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 shutdown_connections 2023-12-08T08:15:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:36.837+0000 7f3a2f59e640 1 -- 172.21.15.45:0/2181714421 wait complete. 2023-12-08T08:15:36.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:37.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.060+0000 7f33a3fff640 1 Processor -- start 2023-12-08T08:15:37.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.061+0000 7f33a3fff640 1 -- start start 2023-12-08T08:15:37.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c4460 0x7f33a40c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a3fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a40c92e0 con 0x7f33a40c8740 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a3fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a41542f0 con 0x7f33a41518e0 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a3fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40c80f0 con 0x7f33a40c4460 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a2ffd640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f33a41518e0 0x7f33a40c79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:52876/0 (socket says 172.21.15.45:52876) 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2113850016 learned_addr learned my addr 172.21.15.45:0/2113850016 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:37.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.063+0000 7f339bfff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c4460 0x7f33a40c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564434323 0 0) 0x7f33a40c92e0 con 0x7f33a40c8740 2023-12-08T08:15:37.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3390003520 con 0x7f33a40c8740 2023-12-08T08:15:37.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927546719 0 0) 0x7f33a41542f0 con 0x7f33a41518e0 2023-12-08T08:15:37.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a40c92e0 con 0x7f33a41518e0 2023-12-08T08:15:37.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068719297 0 0) 0x7f3390003520 con 0x7f33a40c8740 2023-12-08T08:15:37.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c4460 msgr2=0x7f33a40c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.064+0000 7f33a27fc640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c4460 0x7f33a40c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 >> v1:172.21.15.114:6789/0 conn(0x7f33a41518e0 legacy=0x7f33a40c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4154570 con 0x7f33a40c8740 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f339c0019f0 con 0x7f33a40c8740 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 >> v1:172.21.15.45:6789/0 conn(0x7f33a40c8740 legacy=0x7f33a40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3390003b30 0x7f3390003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33900047c0 0x7f3390004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3390005180 0x7f339000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339000c050 con 0x7f33900047c0 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339000c190 con 0x7f3390005180 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339000c350 con 0x7f3390003b30 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f339bfff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33900047c0 0x7f3390004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a37fe640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3390005180 0x7f339000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.065+0000 7f33a2ffd640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3390003b30 0x7f3390003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.066+0000 7f339bfff640 1 -- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3390003b30 msgr2=0x7f3390003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.066+0000 7f339bfff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3390003b30 0x7f3390003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.066+0000 7f339bfff640 1 -- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3390005180 msgr2=0x7f339000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.066+0000 7f339bfff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3390005180 0x7f339000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.066+0000 7f339bfff640 1 -- 172.21.15.45:0/2113850016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390003520 con 0x7f33900047c0 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.067+0000 7f339bfff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33900047c0 0x7f3390004c40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f33a40c5a80 tx=0x7f33900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38b6bc1de748380 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.067+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c02c580 con 0x7f33900047c0 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.067+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c02c6e0 con 0x7f33900047c0 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.067+0000 7f33a27fc640 1 -- 172.21.15.45:0/2113850016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c02ca50 con 0x7f33900047c0 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 -- 172.21.15.45:0/2113850016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33900047c0 msgr2=0x7f3390004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 --2- 172.21.15.45:0/2113850016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33900047c0 0x7f3390004c40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f33a40c5a80 tx=0x7f33900057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a37fe640 1 -- 172.21.15.45:0/2113850016 reap_dead start 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 -- 172.21.15.45:0/2113850016 shutdown_connections 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 -- 172.21.15.45:0/2113850016 >> 172.21.15.45:0/2113850016 conn(0x7f33a40ab6d0 msgr2=0x7f33a40abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 -- 172.21.15.45:0/2113850016 shutdown_connections 2023-12-08T08:15:37.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.068+0000 7f33a3fff640 1 -- 172.21.15.45:0/2113850016 wait complete. 2023-12-08T08:15:37.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.070+0000 7f33a3fff640 1 Processor -- start 2023-12-08T08:15:37.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.070+0000 7f33a3fff640 1 -- start start 2023-12-08T08:15:37.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33900047c0 0x7f33a4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a4157710 0x7f33a40aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40bfa20 con 0x7f33a40bd8f0 2023-12-08T08:15:37.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40ab4b0 con 0x7f33a4157710 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a3fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41ea420 con 0x7f33900047c0 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48580/0 (socket says 172.21.15.45:48580) 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a37fe640 1 -- 172.21.15.45:0/1885542645 learned_addr learned my addr 172.21.15.45:0/1885542645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f339bfff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a4157710 0x7f33a40aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a2ffd640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33900047c0 0x7f33a4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.071+0000 7f33a37fe640 1 -- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33900047c0 msgr2=0x7f33a4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33900047c0 0x7f33a4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a37fe640 1 -- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a4157710 msgr2=0x7f33a40aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a4157710 0x7f33a40aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a37fe640 1 -- 172.21.15.45:0/1885542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a41ea700 con 0x7f33a40bd8f0 2023-12-08T08:15:37.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f33a406c170 tx=0x7f339c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c00db10 con 0x7f33a40bd8f0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c00dc90 con 0x7f33a40bd8f0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c003970 con 0x7f33a40bd8f0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a40bd0d0 con 0x7f33a40bd8f0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.072+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a40aacb0 con 0x7f33a40bd8f0 2023-12-08T08:15:37.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.074+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40743e0 con 0x7f33a40bd8f0 2023-12-08T08:15:37.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.075+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f339c003ad0 con 0x7f33a40bd8f0 2023-12-08T08:15:37.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.075+0000 7f339b7fe640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 0x7f338406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.076+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f339c089af0 con 0x7f33a40bd8f0 2023-12-08T08:15:37.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.076+0000 7f33a2ffd640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 0x7f338406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.076+0000 7f33a2ffd640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 0x7f338406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3394000f60 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.080+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f339c054940 con 0x7f33a40bd8f0 2023-12-08T08:15:37.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.273+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33a406c440 con 0x7f33a40bd8f0 2023-12-08T08:15:37.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.274+0000 7f339b7fe640 1 -- 172.21.15.45:0/1885542645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f339c057f60 con 0x7f33a40bd8f0 2023-12-08T08:15:37.277 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 msgr2=0x7f338406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 0x7f338406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3394000f60 tx=0x7f3394009040 comp rx=0 tx=0).stop 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 msgr2=0x7f33a41e6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f33a406c170 tx=0x7f339c0021f0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 shutdown_connections 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae70 0x7f338406d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40bd8f0 0x7f33a41e6c10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a4157710 0x7f33a40aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1885542645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33900047c0 0x7f33a4156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 >> 172.21.15.45:0/1885542645 conn(0x7f33a40ab6d0 msgr2=0x7f33a4150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:37.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 shutdown_connections 2023-12-08T08:15:37.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.277+0000 7f33a3fff640 1 -- 172.21.15.45:0/1885542645 wait complete. 2023-12-08T08:15:37.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:37.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.516+0000 7f468759e640 1 Processor -- start 2023-12-08T08:15:37.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.516+0000 7f468759e640 1 -- start start 2023-12-08T08:15:37.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46880c4970 0x7f46880a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4688155790 0x7f4688155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880c60c0 con 0x7f468814c280 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4688152dc0 con 0x7f46880c4970 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46881521d0 con 0x7f4688155790 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f467ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46880c4970 0x7f46880a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f467ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46880c4970 0x7f46880a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48586/0 (socket says 172.21.15.45:48586) 2023-12-08T08:15:37.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f467ffff640 1 -- 172.21.15.45:0/1630680378 learned_addr learned my addr 172.21.15.45:0/1630680378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.518+0000 7f468659c640 1 --1- 172.21.15.45:0/1630680378 >> v1:172.21.15.45:6789/0 conn(0x7f468814c280 0x7f468806cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58460/0 (socket says 172.21.15.45:58460) 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.519+0000 7f4686d9d640 1 --2- 172.21.15.45:0/1630680378 >> v2:172.21.15.114:3300/0 conn(0x7f4688155790 0x7f4688155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.519+0000 7f467ffff640 1 -- 172.21.15.45:0/1630680378 >> v2:172.21.15.114:3300/0 conn(0x7f4688155790 msgr2=0x7f4688155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.519+0000 7f467ffff640 1 --2- 172.21.15.45:0/1630680378 >> v2:172.21.15.114:3300/0 conn(0x7f4688155790 0x7f4688155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.519+0000 7f467ffff640 1 -- 172.21.15.45:0/1630680378 >> v1:172.21.15.45:6789/0 conn(0x7f468814c280 legacy=0x7f468806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.519+0000 7f467ffff640 1 -- 172.21.15.45:0/1630680378 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468814c660 con 0x7f46880c4970 2023-12-08T08:15:37.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.520+0000 7f467ffff640 1 --2- 172.21.15.45:0/1630680378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46880c4970 0x7f46880a4d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f468806dbe0 tx=0x7f467002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee4f120d59360f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.520+0000 7f4685d9b640 1 -- 172.21.15.45:0/1630680378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670031870 con 0x7f46880c4970 2023-12-08T08:15:37.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.520+0000 7f4685d9b640 1 -- 172.21.15.45:0/1630680378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700319d0 con 0x7f46880c4970 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.520+0000 7f4685d9b640 1 -- 172.21.15.45:0/1630680378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670031d60 con 0x7f46880c4970 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 -- 172.21.15.45:0/1630680378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46880c4970 msgr2=0x7f46880a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 --2- 172.21.15.45:0/1630680378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46880c4970 0x7f46880a4d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f468806dbe0 tx=0x7f467002b910 comp rx=0 tx=0).stop 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 -- 172.21.15.45:0/1630680378 shutdown_connections 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 --2- 172.21.15.45:0/1630680378 >> v2:172.21.15.114:3300/0 conn(0x7f4688155790 0x7f4688155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 --2- 172.21.15.45:0/1630680378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46880c4970 0x7f46880a4d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 -- 172.21.15.45:0/1630680378 >> 172.21.15.45:0/1630680378 conn(0x7f4688066ce0 msgr2=0x7f46880a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 -- 172.21.15.45:0/1630680378 shutdown_connections 2023-12-08T08:15:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.521+0000 7f468759e640 1 -- 172.21.15.45:0/1630680378 wait complete. 2023-12-08T08:15:37.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.523+0000 7f468759e640 1 Processor -- start 2023-12-08T08:15:37.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.523+0000 7f468759e640 1 -- start start 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46880c4970 0x7f46880a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 0x7f46881ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468814fd00 con 0x7f468814c280 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880aa640 con 0x7f46880c4970 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a9790 con 0x7f4688155790 2023-12-08T08:15:37.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48594/0 (socket says 172.21.15.45:48594) 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 -- 172.21.15.45:0/2725662414 learned_addr learned my addr 172.21.15.45:0/2725662414 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f468659c640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46880c4970 0x7f46880a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f4686d9d640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 0x7f46881ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 -- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 msgr2=0x7f46881ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 0x7f46881ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 -- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46880c4970 msgr2=0x7f46880a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.524+0000 7f467ffff640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46880c4970 0x7f46880a9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f467ffff640 1 -- 172.21.15.45:0/2725662414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700094d0 con 0x7f468814c280 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f4686d9d640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 0x7f46881ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:37.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f467ffff640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4670000c00 tx=0x7f46700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467003ad30 con 0x7f468814c280 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700443f0 con 0x7f468814c280 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700447a0 con 0x7f468814c280 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46880aa360 con 0x7f468814c280 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.525+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688154a60 con 0x7f468814c280 2023-12-08T08:15:37.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.526+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46881545c0 con 0x7f468814c280 2023-12-08T08:15:37.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.527+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4670044900 con 0x7f468814c280 2023-12-08T08:15:37.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.529+0000 7f467effd640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 0x7f466806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.529+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f467002d040 con 0x7f468814c280 2023-12-08T08:15:37.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.529+0000 7f468659c640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 0x7f466806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.529+0000 7f468659c640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 0x7f466806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4678000f60 tx=0x7f4678007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.533+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4670076e50 con 0x7f468814c280 2023-12-08T08:15:37.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.719+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46880678c0 con 0x7f468814c280 2023-12-08T08:15:37.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.720+0000 7f467effd640 1 -- 172.21.15.45:0/2725662414 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4670035070 con 0x7f468814c280 2023-12-08T08:15:37.723 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.723+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 msgr2=0x7f466806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.723+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 0x7f466806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4678000f60 tx=0x7f4678007c80 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.723+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 msgr2=0x7f46880bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.723+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4670000c00 tx=0x7f46700046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 shutdown_connections 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f466806ae40 0x7f466806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4688155790 0x7f46881ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468814c280 0x7f46880bee80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 --2- 172.21.15.45:0/2725662414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46880c4970 0x7f46880a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 >> 172.21.15.45:0/2725662414 conn(0x7f4688066ce0 msgr2=0x7f4688146690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 shutdown_connections 2023-12-08T08:15:37.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.724+0000 7f468759e640 1 -- 172.21.15.45:0/2725662414 wait complete. 2023-12-08T08:15:37.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:37.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.961+0000 7ffbe1af1640 1 Processor -- start 2023-12-08T08:15:37.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.961+0000 7ffbe1af1640 1 -- start start 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbe1af1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbe1af1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbdc06e720 0x7ffbdc152010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbe1af1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0c7170 con 0x7ffbdc152550 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbe1af1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc06d1b0 con 0x7ffbdc06e720 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbe1af1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc14fa60 con 0x7ffbdc14f680 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.962+0000 7ffbd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbdc06e720 0x7ffbdc152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbdc06e720 0x7ffbdc152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48610/0 (socket says 172.21.15.45:48610) 2023-12-08T08:15:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 -- 172.21.15.45:0/2580036235 learned_addr learned my addr 172.21.15.45:0/2580036235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:37.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 -- 172.21.15.45:0/2580036235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 msgr2=0x7ffbdc1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbe0aef640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 -- 172.21.15.45:0/2580036235 >> v1:172.21.15.114:6789/0 conn(0x7ffbdc152550 legacy=0x7ffbdc06a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:37.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.963+0000 7ffbd3fff640 1 -- 172.21.15.45:0/2580036235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0c76a0 con 0x7ffbdc06e720 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.964+0000 7ffbd3fff640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc06e720 0x7ffbdc152010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e0c3b6e5229ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.964+0000 7ffbd37fe640 1 -- 172.21.15.45:0/2580036235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031740 con 0x7ffbdc06e720 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbd37fe640 1 -- 172.21.15.45:0/2580036235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0318a0 con 0x7ffbdc06e720 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbd37fe640 1 -- 172.21.15.45:0/2580036235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031c30 con 0x7ffbdc06e720 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 -- 172.21.15.45:0/2580036235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc06e720 msgr2=0x7ffbdc152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc06e720 0x7ffbdc152010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02b7e0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 -- 172.21.15.45:0/2580036235 shutdown_connections 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc06e720 0x7ffbdc152010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/2580036235 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 -- 172.21.15.45:0/2580036235 >> 172.21.15.45:0/2580036235 conn(0x7ffbdc0a85a0 msgr2=0x7ffbdc0a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 -- 172.21.15.45:0/2580036235 shutdown_connections 2023-12-08T08:15:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.965+0000 7ffbe1af1640 1 -- 172.21.15.45:0/2580036235 wait complete. 2023-12-08T08:15:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.967+0000 7ffbe1af1640 1 Processor -- start 2023-12-08T08:15:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.967+0000 7ffbe1af1640 1 -- start start 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc06e720 0x7ffbdc151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0aa180 con 0x7ffbdc152550 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1523a0 con 0x7ffbdc06e720 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe1af1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1ec310 con 0x7ffbdc14f680 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe12f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe12f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48618/0 (socket says 172.21.15.45:48618) 2023-12-08T08:15:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.968+0000 7ffbe12f0640 1 -- 172.21.15.45:0/3467914564 learned_addr learned my addr 172.21.15.45:0/3467914564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbd3fff640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe0aef640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc06e720 0x7ffbdc151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 -- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 msgr2=0x7ffbdc0c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc0c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 -- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc06e720 msgr2=0x7ffbdc151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc06e720 0x7ffbdc151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 -- 172.21.15.45:0/3467914564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0094d0 con 0x7ffbdc152550 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.969+0000 7ffbe12f0640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400c730 tx=0x7ffbd400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.970+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400aa50 con 0x7ffbdc152550 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.970+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd400abb0 con 0x7ffbdc152550 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.970+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400ce40 con 0x7ffbdc152550 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.970+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc1eb550 con 0x7ffbdc152550 2023-12-08T08:15:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.970+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc1ebb10 con 0x7ffbdc152550 2023-12-08T08:15:37.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.971+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc0c60c0 con 0x7ffbdc152550 2023-12-08T08:15:37.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.972+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbd4012420 con 0x7ffbdc152550 2023-12-08T08:15:37.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.973+0000 7ffbd17fa640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 0x7ffbc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:37.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.973+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffbd4089ad0 con 0x7ffbdc152550 2023-12-08T08:15:37.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.973+0000 7ffbe0aef640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 0x7ffbc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:37.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.974+0000 7ffbe0aef640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 0x7ffbc806d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800a970 tx=0x7ffbd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:37.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:37.977+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbd4054880 con 0x7ffbdc152550 2023-12-08T08:15:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.163+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffbdc0673e0 con 0x7ffbdc152550 2023-12-08T08:15:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.164+0000 7ffbd17fa640 1 -- 172.21.15.45:0/3467914564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffbd4016020 con 0x7ffbdc152550 2023-12-08T08:15:38.167 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 msgr2=0x7ffbc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 0x7ffbc806d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800a970 tx=0x7ffbd8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 msgr2=0x7ffbdc14c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400c730 tx=0x7ffbd400cbf0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 shutdown_connections 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbc806ae70 0x7ffbc806d330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbdc14f680 0x7ffbdc0c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbdc152550 0x7ffbdc14c430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 --2- 172.21.15.45:0/3467914564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc06e720 0x7ffbdc151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 >> 172.21.15.45:0/3467914564 conn(0x7ffbdc0a85a0 msgr2=0x7ffbdc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 shutdown_connections 2023-12-08T08:15:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.167+0000 7ffbe1af1640 1 -- 172.21.15.45:0/3467914564 wait complete. 2023-12-08T08:15:38.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.403+0000 7f35f24d1640 1 Processor -- start 2023-12-08T08:15:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.403+0000 7f35f24d1640 1 -- start start 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f24d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35ec0c1210 0x7f35ec0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f24d1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f24d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec154850 con 0x7f35ec14e840 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f24d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec14ec20 con 0x7f35ec0c1210 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f24d1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec154b30 con 0x7f35ec0a9e80 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f14cf640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f35ec14e840 0x7f35ec151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58474/0 (socket says 172.21.15.45:58474) 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f14cf640 1 -- 172.21.15.45:0/2007608934 learned_addr learned my addr 172.21.15.45:0/2007608934 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f0cce640 1 --2- 172.21.15.45:0/2007608934 >> v2:172.21.15.45:3300/0 conn(0x7f35ec0c1210 0x7f35ec0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35e3fff640 1 -- 172.21.15.45:0/2007608934 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476786476 0 0) 0x7f35ec154850 con 0x7f35ec14e840 2023-12-08T08:15:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.405+0000 7f35f1cd0640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.406+0000 7f35e3fff640 1 -- 172.21.15.45:0/2007608934 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d8005730 con 0x7f35ec14e840 2023-12-08T08:15:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.406+0000 7f35f0cce640 1 -- 172.21.15.45:0/2007608934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 msgr2=0x7f35ec0aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.406+0000 7f35f0cce640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.406+0000 7f35f0cce640 1 -- 172.21.15.45:0/2007608934 >> v1:172.21.15.45:6789/0 conn(0x7f35ec14e840 legacy=0x7f35ec151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.406+0000 7f35f0cce640 1 -- 172.21.15.45:0/2007608934 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec154e10 con 0x7f35ec0c1210 2023-12-08T08:15:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.407+0000 7f35f0cce640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec0c16a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097a0 tx=0x7f35dc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53867b90761c058b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.408+0000 7f35e3fff640 1 -- 172.21.15.45:0/2007608934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc031780 con 0x7f35ec0c1210 2023-12-08T08:15:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.408+0000 7f35e3fff640 1 -- 172.21.15.45:0/2007608934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0318e0 con 0x7f35ec0c1210 2023-12-08T08:15:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.408+0000 7f35e3fff640 1 -- 172.21.15.45:0/2007608934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc031c70 con 0x7f35ec0c1210 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.408+0000 7f35f24d1640 1 -- 172.21.15.45:0/2007608934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 msgr2=0x7f35ec0c16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.408+0000 7f35f24d1640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec0c16a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097a0 tx=0x7f35dc02b820 comp rx=0 tx=0).stop 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 -- 172.21.15.45:0/2007608934 shutdown_connections 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 --2- 172.21.15.45:0/2007608934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec0c16a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 -- 172.21.15.45:0/2007608934 >> 172.21.15.45:0/2007608934 conn(0x7f35ec0c5780 msgr2=0x7f35ec0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 -- 172.21.15.45:0/2007608934 shutdown_connections 2023-12-08T08:15:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.409+0000 7f35f24d1640 1 -- 172.21.15.45:0/2007608934 wait complete. 2023-12-08T08:15:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.410+0000 7f35f24d1640 1 Processor -- start 2023-12-08T08:15:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.411+0000 7f35f24d1640 1 -- start start 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec14e840 0x7f35ec0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c3f50 con 0x7f35ec0c1210 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0bf3c0 con 0x7f35ec14e840 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f24d1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c2e30 con 0x7f35ec0a9e80 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48638/0 (socket says 172.21.15.45:48638) 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 -- 172.21.15.45:0/321867493 learned_addr learned my addr 172.21.15.45:0/321867493 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f14cf640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 -- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 msgr2=0x7f35ec0c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 -- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec14e840 msgr2=0x7f35ec0c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f1cd0640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec14e840 0x7f35ec0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec14e840 0x7f35ec0c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.412+0000 7f35f0cce640 1 -- 172.21.15.45:0/321867493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009400 con 0x7f35ec0c1210 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35f0cce640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35dc034040 tx=0x7f35dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc032820 con 0x7f35ec0c1210 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc032980 con 0x7f35ec0c1210 2023-12-08T08:15:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc032d30 con 0x7f35ec0c1210 2023-12-08T08:15:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0bf5d0 con 0x7f35ec0c1210 2023-12-08T08:15:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.413+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec0a7c80 con 0x7f35ec0c1210 2023-12-08T08:15:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.414+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec0743e0 con 0x7f35ec0c1210 2023-12-08T08:15:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.416+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35dc04e440 con 0x7f35ec0c1210 2023-12-08T08:15:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.417+0000 7f35e1ffb640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 0x7f35d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.417+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35dc0ab9d0 con 0x7f35ec0c1210 2023-12-08T08:15:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.417+0000 7f35f14cf640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 0x7f35d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.418+0000 7f35f14cf640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 0x7f35d006d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35e80011e0 tx=0x7f35e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.422+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35dc076830 con 0x7f35ec0c1210 2023-12-08T08:15:38.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.643+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35ec1516e0 con 0x7f35ec0c1210 2023-12-08T08:15:38.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.644+0000 7f35e1ffb640 1 -- 172.21.15.45:0/321867493 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f35dc079e50 con 0x7f35ec0c1210 2023-12-08T08:15:38.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:38.646 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:15:38.647 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:15:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 msgr2=0x7f35d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 0x7f35d006d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35e80011e0 tx=0x7f35e8009040 comp rx=0 tx=0).stop 2023-12-08T08:15:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 msgr2=0x7f35ec1e7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35dc034040 tx=0x7f35dc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 shutdown_connections 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35d006ae70 0x7f35d006d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec14e840 0x7f35ec0c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ec0c1210 0x7f35ec1e7a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 --2- 172.21.15.45:0/321867493 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f35ec0a9e80 0x7f35ec0c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 >> 172.21.15.45:0/321867493 conn(0x7f35ec0c5780 msgr2=0x7f35ec14f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.646+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 shutdown_connections 2023-12-08T08:15:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.647+0000 7f35f24d1640 1 -- 172.21.15.45:0/321867493 wait complete. 2023-12-08T08:15:38.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:38.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.878+0000 7f22b4778640 1 Processor -- start 2023-12-08T08:15:38.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.878+0000 7f22b4778640 1 -- start start 2023-12-08T08:15:38.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b4778640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f22ac155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b4778640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22ac0ca0e0 0x7f22ac0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b4778640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac155540 con 0x7f22ac1581c0 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b4778640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c4880 con 0x7f22ac0ca0e0 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b4778640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c4b60 con 0x7f22ac14e800 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b2d15640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f22ac1581c0 0x7f22ac0c6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58488/0 (socket says 172.21.15.45:58488) 2023-12-08T08:15:38.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b2d15640 1 -- 172.21.15.45:0/431594147 learned_addr learned my addr 172.21.15.45:0/431594147 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:38.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b2514640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f22ac155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.880+0000 7f22b1d13640 1 --2- 172.21.15.45:0/431594147 >> v2:172.21.15.114:3300/0 conn(0x7f22ac0ca0e0 0x7f22ac0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603697878 0 0) 0x7f22ac155540 con 0x7f22ac1581c0 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2298003520 con 0x7f22ac1581c0 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926169524 0 0) 0x7f2298003520 con 0x7f22ac1581c0 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 msgr2=0x7f22ac155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f22ac155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 >> v2:172.21.15.114:3300/0 conn(0x7f22ac0ca0e0 msgr2=0x7f22ac0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 --2- 172.21.15.45:0/431594147 >> v2:172.21.15.114:3300/0 conn(0x7f22ac0ca0e0 0x7f22ac0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0c4e40 con 0x7f22ac1581c0 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f22a40019f0 con 0x7f22ac1581c0 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 >> v1:172.21.15.45:6789/0 conn(0x7f22ac1581c0 legacy=0x7f22ac0c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f2298003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2298003f40 0x7f22980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2298004d00 0x7f2298005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c4880 con 0x7f2298003f40 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c4b60 con 0x7f2298004d00 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.881+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229800bab0 con 0x7f22ac14e800 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2298003f40 0x7f22980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b2514640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f2298003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b2d15640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2298004d00 0x7f2298005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 -- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 msgr2=0x7f2298003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22ac14e800 0x7f2298003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 -- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2298004d00 msgr2=0x7f2298005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2298004d00 0x7f2298005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.882+0000 7f22b1d13640 1 -- 172.21.15.45:0/431594147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298003520 con 0x7f2298003f40 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.883+0000 7f22b1d13640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2298003f40 0x7f22980047c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f229c009ac0 tx=0x7f22980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b3dcf8d013b014 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.883+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c02c710 con 0x7f2298003f40 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.883+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c02c870 con 0x7f2298003f40 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.883+0000 7f22b1512640 1 -- 172.21.15.45:0/431594147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c02cc00 con 0x7f2298003f40 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 -- 172.21.15.45:0/431594147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2298003f40 msgr2=0x7f22980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 --2- 172.21.15.45:0/431594147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2298003f40 0x7f22980047c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f229c009ac0 tx=0x7f22980057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b2d15640 1 -- 172.21.15.45:0/431594147 reap_dead start 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 -- 172.21.15.45:0/431594147 shutdown_connections 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 -- 172.21.15.45:0/431594147 >> 172.21.15.45:0/431594147 conn(0x7f22ac0663d0 msgr2=0x7f22ac0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 -- 172.21.15.45:0/431594147 shutdown_connections 2023-12-08T08:15:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.884+0000 7f22b4778640 1 -- 172.21.15.45:0/431594147 wait complete. 2023-12-08T08:15:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.886+0000 7f22b4778640 1 Processor -- start 2023-12-08T08:15:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.886+0000 7f22b4778640 1 -- start start 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2298003f40 0x7f22ac0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac14f8f0 0x7f22ac14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1ea0f0 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c2c40 con 0x7f22ac14f8f0 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b4778640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0abe20 con 0x7f2298003f40 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b1d13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b1d13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48656/0 (socket says 172.21.15.45:48656) 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.887+0000 7f22b1d13640 1 -- 172.21.15.45:0/4129505879 learned_addr learned my addr 172.21.15.45:0/4129505879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b2514640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2298003f40 0x7f22ac0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b2d15640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac14f8f0 0x7f22ac14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 -- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2298003f40 msgr2=0x7f22ac0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2298003f40 0x7f22ac0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 -- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac14f8f0 msgr2=0x7f22ac14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac14f8f0 0x7f22ac14ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 -- 172.21.15.45:0/4129505879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0ac100 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22b1d13640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f229c037040 tx=0x7f229c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c003810 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c02de90 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.888+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c003b70 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.889+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0ac3e0 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.889+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac1eaac0 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.890+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac074600 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.891+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f229c003cd0 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.892+0000 7f22a2ffd640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 0x7f229006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.892+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f229c0ab930 con 0x7f22ac0ab8b0 2023-12-08T08:15:38.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.892+0000 7f22b2514640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 0x7f229006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:38.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.892+0000 7f22b2514640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 0x7f229006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009930 tx=0x7f22a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:38.896+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f229c076700 con 0x7f22ac0ab8b0 2023-12-08T08:15:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.091+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ac066cd0 con 0x7f22ac0ab8b0 2023-12-08T08:15:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.093+0000 7f22a2ffd640 1 -- 172.21.15.45:0/4129505879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f229c079d20 con 0x7f22ac0ab8b0 2023-12-08T08:15:39.096 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:39.096 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 msgr2=0x7f229006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 0x7f229006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009930 tx=0x7f22a8008040 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 msgr2=0x7f22ac1ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f229c037040 tx=0x7f229c004730 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 shutdown_connections 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f229006ae70 0x7f229006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac14f8f0 0x7f22ac14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0ab8b0 0x7f22ac1ea580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.095+0000 7f22b4778640 1 --2- 172.21.15.45:0/4129505879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2298003f40 0x7f22ac0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.096+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 >> 172.21.15.45:0/4129505879 conn(0x7f22ac0663d0 msgr2=0x7f22ac1540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.096+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 shutdown_connections 2023-12-08T08:15:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.096+0000 7f22b4778640 1 -- 172.21.15.45:0/4129505879 wait complete. 2023-12-08T08:15:39.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:39.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.341+0000 7fb42591d640 1 Processor -- start 2023-12-08T08:15:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.341+0000 7fb42591d640 1 -- start start 2023-12-08T08:15:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.342+0000 7fb42591d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb420147bb0 0x7fb4200c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.342+0000 7fb42591d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4200c0d40 con 0x7fb4200c51d0 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb42591d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4201555c0 con 0x7fb4200c1ff0 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb42591d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4200a4d10 con 0x7fb420147bb0 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb420147bb0 0x7fb4200c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb4200c51d0 0x7fb42015bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58492/0 (socket says 172.21.15.45:58492) 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb420147bb0 0x7fb4200c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48670/0 (socket says 172.21.15.45:48670) 2023-12-08T08:15:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41f7fe640 1 -- 172.21.15.45:0/3175723189 learned_addr learned my addr 172.21.15.45:0/3175723189 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41dffb640 1 -- 172.21.15.45:0/3175723189 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991345574 0 0) 0x7fb4200c0d40 con 0x7fb4200c51d0 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41dffb640 1 -- 172.21.15.45:0/3175723189 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb40c005730 con 0x7fb4200c51d0 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.343+0000 7fb41effd640 1 -- 172.21.15.45:0/3175723189 >> v1:172.21.15.114:6789/0 conn(0x7fb4200c1ff0 legacy=0x7fb420154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.344+0000 7fb41effd640 1 -- 172.21.15.45:0/3175723189 >> v1:172.21.15.45:6789/0 conn(0x7fb4200c51d0 legacy=0x7fb42015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.344+0000 7fb41effd640 1 -- 172.21.15.45:0/3175723189 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4200a4ff0 con 0x7fb420147bb0 2023-12-08T08:15:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.345+0000 7fb41effd640 1 --2- 172.21.15.45:0/3175723189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb4200c11d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb410009d90 tx=0x7fb41002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5ce187c446e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.345+0000 7fb41dffb640 1 -- 172.21.15.45:0/3175723189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41002cd00 con 0x7fb420147bb0 2023-12-08T08:15:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.345+0000 7fb41dffb640 1 -- 172.21.15.45:0/3175723189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41002ce60 con 0x7fb420147bb0 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.345+0000 7fb41dffb640 1 -- 172.21.15.45:0/3175723189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410034660 con 0x7fb420147bb0 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 -- 172.21.15.45:0/3175723189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 msgr2=0x7fb4200c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 --2- 172.21.15.45:0/3175723189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb4200c11d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb410009d90 tx=0x7fb41002bf50 comp rx=0 tx=0).stop 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 -- 172.21.15.45:0/3175723189 shutdown_connections 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 --2- 172.21.15.45:0/3175723189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb4200c11d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 -- 172.21.15.45:0/3175723189 >> 172.21.15.45:0/3175723189 conn(0x7fb4200c2430 msgr2=0x7fb4200c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 -- 172.21.15.45:0/3175723189 shutdown_connections 2023-12-08T08:15:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.346+0000 7fb42591d640 1 -- 172.21.15.45:0/3175723189 wait complete. 2023-12-08T08:15:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.348+0000 7fb42591d640 1 Processor -- start 2023-12-08T08:15:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.348+0000 7fb42591d640 1 -- start start 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 0x7fb42006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4201472c0 0x7fb420072520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42014bfa0 con 0x7fb420147bb0 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42014d590 con 0x7fb4200c51d0 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb42591d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb420072a60 con 0x7fb4201472c0 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48674/0 (socket says 172.21.15.45:48674) 2023-12-08T08:15:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41e7fc640 1 -- 172.21.15.45:0/343097961 learned_addr learned my addr 172.21.15.45:0/343097961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41f7fe640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4201472c0 0x7fb420072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41effd640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 0x7fb42006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41e7fc640 1 -- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4201472c0 msgr2=0x7fb420072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.349+0000 7fb41e7fc640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4201472c0 0x7fb420072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb41e7fc640 1 -- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 msgr2=0x7fb42006fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb41e7fc640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 0x7fb42006fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb41e7fc640 1 -- 172.21.15.45:0/343097961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009a70 con 0x7fb420147bb0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb41effd640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 0x7fb42006fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb41e7fc640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb40800c480 tx=0x7fb40800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080052d0 con 0x7fb420147bb0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408005430 con 0x7fb420147bb0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408012870 con 0x7fb420147bb0 2023-12-08T08:15:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.350+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420151960 con 0x7fb420147bb0 2023-12-08T08:15:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.351+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb420151680 con 0x7fb420147bb0 2023-12-08T08:15:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.352+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb420074670 con 0x7fb420147bb0 2023-12-08T08:15:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.353+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4080129d0 con 0x7fb420147bb0 2023-12-08T08:15:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.353+0000 7fb417fff640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 0x7fb40006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.354+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb408089430 con 0x7fb420147bb0 2023-12-08T08:15:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.354+0000 7fb41effd640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 0x7fb40006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.354+0000 7fb41effd640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 0x7fb40006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb410036000 tx=0x7fb410030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.358+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb408054280 con 0x7fb420147bb0 2023-12-08T08:15:39.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.550+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4200ab4d0 con 0x7fb420147bb0 2023-12-08T08:15:39.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.551+0000 7fb417fff640 1 -- 172.21.15.45:0/343097961 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4080578a0 con 0x7fb420147bb0 2023-12-08T08:15:39.554 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:39.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 msgr2=0x7fb40006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 0x7fb40006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb410036000 tx=0x7fb410030000 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 msgr2=0x7fb420071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb40800c480 tx=0x7fb40800c940 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 shutdown_connections 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb40006ae70 0x7fb40006d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4201472c0 0x7fb420072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb420147bb0 0x7fb420071fe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 --2- 172.21.15.45:0/343097961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4200c51d0 0x7fb42006fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 >> 172.21.15.45:0/343097961 conn(0x7fb4200c2430 msgr2=0x7fb42006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.553+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 shutdown_connections 2023-12-08T08:15:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.554+0000 7fb42591d640 1 -- 172.21.15.45:0/343097961 wait complete. 2023-12-08T08:15:39.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.800+0000 7fe5bc9a9640 1 Processor -- start 2023-12-08T08:15:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.801+0000 7fe5bc9a9640 1 -- start start 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.802+0000 7fe5bc9a9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5b8147bb0 0x7fe5b80c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.802+0000 7fe5bc9a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5b80c51d0 0x7fe5b8154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.802+0000 7fe5bc9a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80c0d40 con 0x7fe5b80c1ff0 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.802+0000 7fe5bc9a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b81555c0 con 0x7fe5b80c51d0 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.802+0000 7fe5bc9a9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80a4d10 con 0x7fe5b8147bb0 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5b80c51d0 0x7fe5b8154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b5d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe5b80c1ff0 0x7fe5b8154840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58506/0 (socket says 172.21.15.45:58506) 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5b80c51d0 0x7fe5b8154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48684/0 (socket says 172.21.15.45:48684) 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b5d9b640 1 -- 172.21.15.45:0/2933743412 learned_addr learned my addr 172.21.15.45:0/2933743412 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b659c640 1 --2- 172.21.15.45:0/2933743412 >> v2:172.21.15.114:3300/0 conn(0x7fe5b8147bb0 0x7fe5b80c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 -- 172.21.15.45:0/2933743412 >> v2:172.21.15.114:3300/0 conn(0x7fe5b8147bb0 msgr2=0x7fe5b80c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 --2- 172.21.15.45:0/2933743412 >> v2:172.21.15.114:3300/0 conn(0x7fe5b8147bb0 0x7fe5b80c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 -- 172.21.15.45:0/2933743412 >> v1:172.21.15.45:6789/0 conn(0x7fe5b80c1ff0 legacy=0x7fe5b8154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b6d9d640 1 -- 172.21.15.45:0/2933743412 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80a4ff0 con 0x7fe5b80c51d0 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.803+0000 7fe5b559a640 1 -- 172.21.15.45:0/2933743412 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273424043 0 0) 0x7fe5b80c0d40 con 0x7fe5b80c1ff0 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.804+0000 7fe5b6d9d640 1 --2- 172.21.15.45:0/2933743412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b80c51d0 0x7fe5b8154f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80c1f80 tx=0x7fe5b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ef00a67a6e1a00 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5b559a640 1 -- 172.21.15.45:0/2933743412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b002e070 con 0x7fe5b80c51d0 2023-12-08T08:15:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5b559a640 1 -- 172.21.15.45:0/2933743412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00315a0 con 0x7fe5b80c51d0 2023-12-08T08:15:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5b559a640 1 -- 172.21.15.45:0/2933743412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0031930 con 0x7fe5b80c51d0 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/2933743412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b80c51d0 msgr2=0x7fe5b8154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/2933743412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b80c51d0 0x7fe5b8154f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80c1f80 tx=0x7fe5b002b840 comp rx=0 tx=0).stop 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/2933743412 shutdown_connections 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/2933743412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b80c51d0 0x7fe5b8154f50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.805+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/2933743412 >> v2:172.21.15.114:3300/0 conn(0x7fe5b8147bb0 0x7fe5b80c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.806+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/2933743412 >> 172.21.15.45:0/2933743412 conn(0x7fe5b80c2430 msgr2=0x7fe5b80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.806+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/2933743412 shutdown_connections 2023-12-08T08:15:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.806+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/2933743412 wait complete. 2023-12-08T08:15:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.807+0000 7fe5bc9a9640 1 Processor -- start 2023-12-08T08:15:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.807+0000 7fe5bc9a9640 1 -- start start 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b80c51d0 0x7fe5b80aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5b81e8040 0x7fe5b81e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b814b370 con 0x7fe5b8147bb0 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81e7b40 con 0x7fe5b80c51d0 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.808+0000 7fe5bc9a9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81516f0 con 0x7fe5b81e8040 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48686/0 (socket says 172.21.15.45:48686) 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 -- 172.21.15.45:0/779784775 learned_addr learned my addr 172.21.15.45:0/779784775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 -- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5b81e8040 msgr2=0x7fe5b81e84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5b81e8040 0x7fe5b81e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 -- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b80c51d0 msgr2=0x7fe5b80aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b80c51d0 0x7fe5b80aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 -- 172.21.15.45:0/779784775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009400 con 0x7fe5b8147bb0 2023-12-08T08:15:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.809+0000 7fe5b5d9b640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c430 tx=0x7fe5a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.810+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00074e0 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.810+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0007660 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.810+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0004a20 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.810+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b814aa40 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.810+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b814b000 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.811+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b81e7cb0 con 0x7fe5b8147bb0 2023-12-08T08:15:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.812+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a0004b80 con 0x7fe5b8147bb0 2023-12-08T08:15:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.813+0000 7fe5aeffd640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.813+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5a00897c0 con 0x7fe5b8147bb0 2023-12-08T08:15:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.813+0000 7fe5b659c640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.814+0000 7fe5b659c640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 0x7fe59806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80070b0 tx=0x7fe5a8007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:39.817+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5a00544e0 con 0x7fe5b8147bb0 2023-12-08T08:15:40.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.016+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe5b814b4b0 con 0x7fe5b8147bb0 2023-12-08T08:15:40.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.017+0000 7fe5aeffd640 1 -- 172.21.15.45:0/779784775 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5a0057b00 con 0x7fe5b8147bb0 2023-12-08T08:15:40.019 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 msgr2=0x7fe59806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 0x7fe59806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80070b0 tx=0x7fe5a8007040 comp rx=0 tx=0).stop 2023-12-08T08:15:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 msgr2=0x7fe5b80723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c430 tx=0x7fe5a000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 shutdown_connections 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe59806ae70 0x7fe59806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5b81e8040 0x7fe5b81e84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5b8147bb0 0x7fe5b80723b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 --2- 172.21.15.45:0/779784775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b80c51d0 0x7fe5b80aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.019+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 >> 172.21.15.45:0/779784775 conn(0x7fe5b80c2430 msgr2=0x7fe5b80c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.020+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 shutdown_connections 2023-12-08T08:15:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.020+0000 7fe5bc9a9640 1 -- 172.21.15.45:0/779784775 wait complete. 2023-12-08T08:15:40.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.273+0000 7f7617a2b640 1 Processor -- start 2023-12-08T08:15:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.273+0000 7f7617a2b640 1 -- start start 2023-12-08T08:15:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7617a2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76100c7340 0x7f76100702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7617a2b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610155e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7617a2b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76100a7140 con 0x7f761014f8c0 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7617a2b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761006dce0 con 0x7f76100c7340 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7617a2b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761006df80 con 0x7f76101559a0 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7614fc6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76100c7340 0x7f76100702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7614fc6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76100c7340 0x7f76100702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48702/0 (socket says 172.21.15.45:48702) 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7614fc6640 1 -- 172.21.15.45:0/1695864109 learned_addr learned my addr 172.21.15.45:0/1695864109 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f76157c7640 1 --1- 172.21.15.45:0/1695864109 >> v1:172.21.15.45:6789/0 conn(0x7f761014f8c0 0x7f76100c4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58516/0 (socket says 172.21.15.45:58516) 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.275+0000 7f7615fc8640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.276+0000 7f7614fc6640 1 -- 172.21.15.45:0/1695864109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 msgr2=0x7f7610155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.276+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.276+0000 7f7614fc6640 1 -- 172.21.15.45:0/1695864109 >> v1:172.21.15.45:6789/0 conn(0x7f761014f8c0 legacy=0x7f76100c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.276+0000 7f7614fc6640 1 -- 172.21.15.45:0/1695864109 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100a6dd0 con 0x7f76100c7340 2023-12-08T08:15:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.276+0000 7f7607fff640 1 -- 172.21.15.45:0/1695864109 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813919395 0 0) 0x7f76100a7140 con 0x7f761014f8c0 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.277+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100702b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7600009870 tx=0x7f760002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa385de1ac599c21 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.277+0000 7f7607fff640 1 -- 172.21.15.45:0/1695864109 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600030840 con 0x7f76100c7340 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.277+0000 7f7607fff640 1 -- 172.21.15.45:0/1695864109 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000309a0 con 0x7f76100c7340 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.277+0000 7f7607fff640 1 -- 172.21.15.45:0/1695864109 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600030d30 con 0x7f76100c7340 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 -- 172.21.15.45:0/1695864109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 msgr2=0x7f76100702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100702b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7600009870 tx=0x7f760002b980 comp rx=0 tx=0).stop 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 -- 172.21.15.45:0/1695864109 shutdown_connections 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1695864109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100702b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 -- 172.21.15.45:0/1695864109 >> 172.21.15.45:0/1695864109 conn(0x7f76100a9770 msgr2=0x7f76100a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 -- 172.21.15.45:0/1695864109 shutdown_connections 2023-12-08T08:15:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.278+0000 7f7617a2b640 1 -- 172.21.15.45:0/1695864109 wait complete. 2023-12-08T08:15:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.280+0000 7f7617a2b640 1 Processor -- start 2023-12-08T08:15:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.280+0000 7f7617a2b640 1 -- start start 2023-12-08T08:15:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 0x7f7610146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100ab7c0 con 0x7f76100c7340 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761006d520 con 0x7f761014f8c0 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f7617a2b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76101edff0 con 0x7f76101559a0 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f76157c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f76157c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48710/0 (socket says 172.21.15.45:48710) 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.281+0000 7f76157c7640 1 -- 172.21.15.45:0/1935878004 learned_addr learned my addr 172.21.15.45:0/1935878004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7615fc8640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 0x7f7610146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 -- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 msgr2=0x7f7610147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 -- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 msgr2=0x7f7610146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 0x7f7610146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 -- 172.21.15.45:0/1935878004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000094d0 con 0x7f76100c7340 2023-12-08T08:15:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 0x7f7610146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f76157c7640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f760c00c890 tx=0x7f760c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00a640 con 0x7f76100c7340 2023-12-08T08:15:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00a7c0 con 0x7f76100c7340 2023-12-08T08:15:40.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100abf30 con 0x7f76100c7340 2023-12-08T08:15:40.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00ab70 con 0x7f76100c7340 2023-12-08T08:15:40.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.282+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100aba10 con 0x7f76100c7340 2023-12-08T08:15:40.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.283+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610074670 con 0x7f76100c7340 2023-12-08T08:15:40.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.284+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f760c00acd0 con 0x7f76100c7340 2023-12-08T08:15:40.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.285+0000 7f7605ffb640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 0x7f75f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.286+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f760c0892f0 con 0x7f76100c7340 2023-12-08T08:15:40.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.286+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 0x7f75f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.287+0000 7f7614fc6640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 0x7f75f406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7600036000 tx=0x7f760003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.290+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f760c054010 con 0x7f76100c7340 2023-12-08T08:15:40.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.489+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7610155780 con 0x7f76100c7340 2023-12-08T08:15:40.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.491+0000 7f7605ffb640 1 -- 172.21.15.45:0/1935878004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f760c057630 con 0x7f76100c7340 2023-12-08T08:15:40.493 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:40.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 msgr2=0x7f75f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 0x7f75f406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7600036000 tx=0x7f760003b040 comp rx=0 tx=0).stop 2023-12-08T08:15:40.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 msgr2=0x7f76100a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f760c00c890 tx=0x7f760c00cd50 comp rx=0 tx=0).stop 2023-12-08T08:15:40.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 shutdown_connections 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f75f406ae40 0x7f75f406d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f76101559a0 0x7f7610147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f761014f8c0 0x7f7610146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 --2- 172.21.15.45:0/1935878004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76100c7340 0x7f76100a89c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.493+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 >> 172.21.15.45:0/1935878004 conn(0x7f76100a9770 msgr2=0x7f76100c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.494+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 shutdown_connections 2023-12-08T08:15:40.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.494+0000 7f7617a2b640 1 -- 172.21.15.45:0/1935878004 wait complete. 2023-12-08T08:15:40.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.742+0000 7fd7b2aff640 1 Processor -- start 2023-12-08T08:15:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.742+0000 7fd7b2aff640 1 -- start start 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b2aff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac0c4970 0x7fd7ac0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b2aff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7ac155790 0x7fd7ac155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b2aff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac0c60c0 con 0x7fd7ac14c280 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b2aff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac152dc0 con 0x7fd7ac155790 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b2aff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1521d0 con 0x7fd7ac0c4970 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b22fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7ac155790 0x7fd7ac155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b22fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7ac155790 0x7fd7ac155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48712/0 (socket says 172.21.15.45:48712) 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b22fe640 1 -- 172.21.15.45:0/1899814969 learned_addr learned my addr 172.21.15.45:0/1899814969 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b1afd640 1 --1- 172.21.15.45:0/1899814969 >> v1:172.21.15.45:6789/0 conn(0x7fd7ac14c280 0x7fd7ac06cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58526/0 (socket says 172.21.15.45:58526) 2023-12-08T08:15:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.744+0000 7fd7b12fc640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac0c4970 0x7fd7ac0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.745+0000 7fd7b22fe640 1 -- 172.21.15.45:0/1899814969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac0c4970 msgr2=0x7fd7ac0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.745+0000 7fd7b22fe640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac0c4970 0x7fd7ac0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.745+0000 7fd7b22fe640 1 -- 172.21.15.45:0/1899814969 >> v1:172.21.15.45:6789/0 conn(0x7fd7ac14c280 legacy=0x7fd7ac06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.745+0000 7fd7b22fe640 1 -- 172.21.15.45:0/1899814969 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac14c660 con 0x7fd7ac155790 2023-12-08T08:15:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.746+0000 7fd7b22fe640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac155790 0x7fd7ac155c00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aef4114977ecf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.746+0000 7fd7b0afb640 1 -- 172.21.15.45:0/1899814969 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4031640 con 0x7fd7ac155790 2023-12-08T08:15:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.746+0000 7fd7b0afb640 1 -- 172.21.15.45:0/1899814969 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a40317a0 con 0x7fd7ac155790 2023-12-08T08:15:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.746+0000 7fd7b0afb640 1 -- 172.21.15.45:0/1899814969 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4031b30 con 0x7fd7ac155790 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 -- 172.21.15.45:0/1899814969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac155790 msgr2=0x7fd7ac155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac155790 0x7fd7ac155c00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 -- 172.21.15.45:0/1899814969 shutdown_connections 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac155790 0x7fd7ac155c00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/1899814969 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac0c4970 0x7fd7ac0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 -- 172.21.15.45:0/1899814969 >> 172.21.15.45:0/1899814969 conn(0x7fd7ac066ce0 msgr2=0x7fd7ac0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 -- 172.21.15.45:0/1899814969 shutdown_connections 2023-12-08T08:15:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.747+0000 7fd7b2aff640 1 -- 172.21.15.45:0/1899814969 wait complete. 2023-12-08T08:15:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.749+0000 7fd7b2aff640 1 Processor -- start 2023-12-08T08:15:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.749+0000 7fd7b2aff640 1 -- start start 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 0x7fd7ac0a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 0x7fd7ac1e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1eb2c0 con 0x7fd7ac14c280 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0a7a90 con 0x7fd7ac0c4970 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b2aff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1eb510 con 0x7fd7ac155790 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b12fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b12fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48728/0 (socket says 172.21.15.45:48728) 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b12fc640 1 -- 172.21.15.45:0/442679791 learned_addr learned my addr 172.21.15.45:0/442679791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.750+0000 7fd7b22fe640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 0x7fd7ac1e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b1afd640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 0x7fd7ac0a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 -- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 msgr2=0x7fd7ac1e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 0x7fd7ac1e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 -- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 msgr2=0x7fd7ac0a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 0x7fd7ac0a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 -- 172.21.15.45:0/442679791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40094d0 con 0x7fd7ac14c280 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b22fe640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 0x7fd7ac1e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b1afd640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 0x7fd7ac0a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b12fc640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00d5f0 tx=0x7fd79c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c0125f0 con 0x7fd7ac14c280 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c012750 con 0x7fd7ac14c280 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79c012b00 con 0x7fd7ac14c280 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac1eb7f0 con 0x7fd7ac14c280 2023-12-08T08:15:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.751+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac1ebdb0 con 0x7fd7ac14c280 2023-12-08T08:15:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.753+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac0678c0 con 0x7fd7ac14c280 2023-12-08T08:15:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.754+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd79c012c60 con 0x7fd7ac14c280 2023-12-08T08:15:40.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.755+0000 7fd7a27fc640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 0x7fd79006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:40.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.755+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd79c089de0 con 0x7fd7ac14c280 2023-12-08T08:15:40.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.755+0000 7fd7b1afd640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 0x7fd79006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:40.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.756+0000 7fd7b1afd640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 0x7fd79006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007fd0 tx=0x7fd7a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:40.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.760+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd79c054b90 con 0x7fd7ac14c280 2023-12-08T08:15:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.953+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7ac0bfef0 con 0x7fd7ac14c280 2023-12-08T08:15:41.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.954+0000 7fd7a27fc640 1 -- 172.21.15.45:0/442679791 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd79c0581b0 con 0x7fd7ac14c280 2023-12-08T08:15:41.124 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:41.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 msgr2=0x7fd79006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 0x7fd79006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007fd0 tx=0x7fd7a8009040 comp rx=0 tx=0).stop 2023-12-08T08:15:41.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 msgr2=0x7fd7ac1e7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00d5f0 tx=0x7fd79c00dab0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 shutdown_connections 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd79006ae40 0x7fd79006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7ac155790 0x7fd7ac1e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7ac14c280 0x7fd7ac1e7fc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 --2- 172.21.15.45:0/442679791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7ac0c4970 0x7fd7ac0a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 >> 172.21.15.45:0/442679791 conn(0x7fd7ac066ce0 msgr2=0x7fd7ac0c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.956+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 shutdown_connections 2023-12-08T08:15:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:40.957+0000 7fd7b2aff640 1 -- 172.21.15.45:0/442679791 wait complete. 2023-12-08T08:15:41.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.371+0000 7fe920852640 1 Processor -- start 2023-12-08T08:15:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.372+0000 7fe920852640 1 -- start start 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe91c0c1210 0x7fe91c0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe91c0a9e80 0x7fe91c0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c14ec20 con 0x7fe91c0c1210 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c151ea0 con 0x7fe91c0a9e80 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe920852640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c154850 con 0x7fe91c14e840 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe913fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe91c0c1210 0x7fe91c0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe913fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe91c0c1210 0x7fe91c0c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48738/0 (socket says 172.21.15.45:48738) 2023-12-08T08:15:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe913fff640 1 -- 172.21.15.45:0/2471925779 learned_addr learned my addr 172.21.15.45:0/2471925779 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.373+0000 7fe91b7fe640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe913fff640 1 -- 172.21.15.45:0/2471925779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 msgr2=0x7fe91c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe91bfff640 1 --2- 172.21.15.45:0/2471925779 >> v2:172.21.15.114:3300/0 conn(0x7fe91c0a9e80 0x7fe91c0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe913fff640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe913fff640 1 -- 172.21.15.45:0/2471925779 >> v2:172.21.15.114:3300/0 conn(0x7fe91c0a9e80 msgr2=0x7fe91c0aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe913fff640 1 --2- 172.21.15.45:0/2471925779 >> v2:172.21.15.114:3300/0 conn(0x7fe91c0a9e80 0x7fe91c0aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe913fff640 1 -- 172.21.15.45:0/2471925779 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c154b30 con 0x7fe91c0c1210 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.374+0000 7fe91b7fe640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.375+0000 7fe913fff640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1210 0x7fe91c0c1670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c1ff0 tx=0x7fe90402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694527bcd175fc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.375+0000 7fe91affd640 1 -- 172.21.15.45:0/2471925779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040317f0 con 0x7fe91c0c1210 2023-12-08T08:15:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.375+0000 7fe91affd640 1 -- 172.21.15.45:0/2471925779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904031950 con 0x7fe91c0c1210 2023-12-08T08:15:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.375+0000 7fe91affd640 1 -- 172.21.15.45:0/2471925779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904031ce0 con 0x7fe91c0c1210 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 -- 172.21.15.45:0/2471925779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1210 msgr2=0x7fe91c0c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1210 0x7fe91c0c1670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0c1ff0 tx=0x7fe90402b890 comp rx=0 tx=0).stop 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 -- 172.21.15.45:0/2471925779 shutdown_connections 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 --2- 172.21.15.45:0/2471925779 >> v2:172.21.15.114:3300/0 conn(0x7fe91c0a9e80 0x7fe91c0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1210 0x7fe91c0c1670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 --2- 172.21.15.45:0/2471925779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 -- 172.21.15.45:0/2471925779 >> 172.21.15.45:0/2471925779 conn(0x7fe91c0c5780 msgr2=0x7fe91c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 -- 172.21.15.45:0/2471925779 shutdown_connections 2023-12-08T08:15:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.376+0000 7fe920852640 1 -- 172.21.15.45:0/2471925779 wait complete. 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.378+0000 7fe920852640 1 Processor -- start 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.378+0000 7fe920852640 1 -- start start 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe91c0c1210 0x7fe91c14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c0a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c14b140 con 0x7fe91c0a9e80 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1ea6c0 con 0x7fe91c0c1210 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe920852640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c06ff40 con 0x7fe91c14e840 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe91b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe91b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48752/0 (socket says 172.21.15.45:48752) 2023-12-08T08:15:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe91b7fe640 1 -- 172.21.15.45:0/2469330389 learned_addr learned my addr 172.21.15.45:0/2469330389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe91bfff640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c0a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.379+0000 7fe913fff640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe91c0c1210 0x7fe91c14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 -- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 msgr2=0x7fe91c0a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c0a75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 -- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe91c0c1210 msgr2=0x7fe91c14ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe91c0c1210 0x7fe91c14ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 -- 172.21.15.45:0/2469330389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9040094d0 con 0x7fe91c0a9e80 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe91b7fe640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c7f0 tx=0x7fe90c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007820 con 0x7fe91c0a9e80 2023-12-08T08:15:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c007980 con 0x7fe91c0a9e80 2023-12-08T08:15:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007cf0 con 0x7fe91c0a9e80 2023-12-08T08:15:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.380+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c06fc60 con 0x7fe91c0a9e80 2023-12-08T08:15:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.381+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c14b350 con 0x7fe91c0a9e80 2023-12-08T08:15:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.382+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c0c5580 con 0x7fe91c0a9e80 2023-12-08T08:15:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.382+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe90c0113f0 con 0x7fe91c0a9e80 2023-12-08T08:15:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.383+0000 7fe918ff9640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 0x7fe8fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.383+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe90c089c50 con 0x7fe91c0a9e80 2023-12-08T08:15:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.384+0000 7fe913fff640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 0x7fe8fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.384+0000 7fe913fff640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 0x7fe8fc06d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe904036000 tx=0x7fe90403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.388+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe90c054a00 con 0x7fe91c0a9e80 2023-12-08T08:15:41.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.621+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91c0743e0 con 0x7fe91c0a9e80 2023-12-08T08:15:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.622+0000 7fe918ff9640 1 -- 172.21.15.45:0/2469330389 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe90c01f090 con 0x7fe91c0a9e80 2023-12-08T08:15:41.625 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:41.625 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:15:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:15:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 msgr2=0x7fe8fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 0x7fe8fc06d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe904036000 tx=0x7fe90403d040 comp rx=0 tx=0).stop 2023-12-08T08:15:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 msgr2=0x7fe91c14a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c7f0 tx=0x7fe90c00ccb0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 shutdown_connections 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8fc06ae40 0x7fe8fc06d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.625+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe91c14e840 0x7fe91c0a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.626+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe91c0c1210 0x7fe91c14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.626+0000 7fe920852640 1 --2- 172.21.15.45:0/2469330389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0a9e80 0x7fe91c14a290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.626+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 >> 172.21.15.45:0/2469330389 conn(0x7fe91c0c5780 msgr2=0x7fe91c0c1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.626+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 shutdown_connections 2023-12-08T08:15:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.626+0000 7fe920852640 1 -- 172.21.15.45:0/2469330389 wait complete. 2023-12-08T08:15:41.646 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.873+0000 7f3e8d259640 1 Processor -- start 2023-12-08T08:15:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.874+0000 7f3e8d259640 1 -- start start 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.875+0000 7f3e8d259640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e88154df0 0x7f3e880c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.875+0000 7f3e8d259640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e8806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.875+0000 7f3e8d259640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8806d410 con 0x7f3e880a4f80 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.875+0000 7f3e8d259640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e88157a00 con 0x7f3e88154df0 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.875+0000 7f3e8d259640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e88157ca0 con 0x7f3e8806ca50 2023-12-08T08:15:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e88154df0 0x7f3e880c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e88154df0 0x7f3e880c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48758/0 (socket says 172.21.15.45:48758) 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 -- 172.21.15.45:0/2265598787 learned_addr learned my addr 172.21.15.45:0/2265598787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 -- 172.21.15.45:0/2265598787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 msgr2=0x7f3e8806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 --2- 172.21.15.45:0/2265598787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e8806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 -- 172.21.15.45:0/2265598787 >> v1:172.21.15.114:6789/0 conn(0x7f3e880a4f80 legacy=0x7f3e88151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.876+0000 7f3e877fe640 1 -- 172.21.15.45:0/2265598787 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88157f80 con 0x7f3e88154df0 2023-12-08T08:15:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.877+0000 7f3e877fe640 1 --2- 172.21.15.45:0/2265598787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e880c40f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009870 tx=0x7f3e7c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee431a7635f3cea4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e86ffd640 1 -- 172.21.15.45:0/2265598787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c031640 con 0x7f3e88154df0 2023-12-08T08:15:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e86ffd640 1 -- 172.21.15.45:0/2265598787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0317a0 con 0x7f3e88154df0 2023-12-08T08:15:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e86ffd640 1 -- 172.21.15.45:0/2265598787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c031b30 con 0x7f3e88154df0 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 -- 172.21.15.45:0/2265598787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 msgr2=0x7f3e880c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 --2- 172.21.15.45:0/2265598787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e880c40f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009870 tx=0x7f3e7c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 -- 172.21.15.45:0/2265598787 shutdown_connections 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 --2- 172.21.15.45:0/2265598787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e8806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 --2- 172.21.15.45:0/2265598787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e880c40f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 -- 172.21.15.45:0/2265598787 >> 172.21.15.45:0/2265598787 conn(0x7f3e880a7880 msgr2=0x7f3e880a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.878+0000 7f3e8d259640 1 -- 172.21.15.45:0/2265598787 shutdown_connections 2023-12-08T08:15:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.879+0000 7f3e8d259640 1 -- 172.21.15.45:0/2265598787 wait complete. 2023-12-08T08:15:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.880+0000 7f3e8d259640 1 Processor -- start 2023-12-08T08:15:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.880+0000 7f3e8d259640 1 -- start start 2023-12-08T08:15:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e880a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e880a4f80 0x7f3e881ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e881eabc0 con 0x7f3e88154df0 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880a5a50 con 0x7f3e880a4f80 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.881+0000 7f3e8d259640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e880a7190 con 0x7f3e8806ca50 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48770/0 (socket says 172.21.15.45:48770) 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 -- 172.21.15.45:0/1942615454 learned_addr learned my addr 172.21.15.45:0/1942615454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e877fe640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e880a4f80 0x7f3e881ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e87fff640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e880a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 -- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 msgr2=0x7f3e880a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e880a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 -- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e880a4f80 msgr2=0x7f3e881ea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e880a4f80 0x7f3e881ea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 -- 172.21.15.45:0/1942615454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0094d0 con 0x7f3e88154df0 2023-12-08T08:15:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.882+0000 7f3e8ca58640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009fd0 tx=0x7f3e8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.883+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80011830 con 0x7f3e88154df0 2023-12-08T08:15:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.883+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e80011990 con 0x7f3e88154df0 2023-12-08T08:15:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.883+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80011d20 con 0x7f3e88154df0 2023-12-08T08:15:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.883+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e880a7470 con 0x7f3e88154df0 2023-12-08T08:15:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.883+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e880a56e0 con 0x7f3e88154df0 2023-12-08T08:15:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.884+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e880743e0 con 0x7f3e88154df0 2023-12-08T08:15:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.885+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e8001b460 con 0x7f3e88154df0 2023-12-08T08:15:41.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.886+0000 7f3e84ff9640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 0x7f3e7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:41.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.886+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e80089770 con 0x7f3e88154df0 2023-12-08T08:15:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.886+0000 7f3e87fff640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 0x7f3e7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.887+0000 7f3e87fff640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 0x7f3e7406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e780012e0 tx=0x7f3e78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:41.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:41.890+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e80057fc0 con 0x7f3e88154df0 2023-12-08T08:15:42.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.087+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e880a5b90 con 0x7f3e88154df0 2023-12-08T08:15:42.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.090+0000 7f3e84ff9640 1 -- 172.21.15.45:0/1942615454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f3e80057b50 con 0x7f3e88154df0 2023-12-08T08:15:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:42.094 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:04.877348+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 msgr2=0x7f3e7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 0x7f3e7406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e780012e0 tx=0x7f3e78009040 comp rx=0 tx=0).stop 2023-12-08T08:15:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 msgr2=0x7f3e88156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009fd0 tx=0x7f3e8000b8e0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 shutdown_connections 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e7406ae40 0x7f3e7406d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e88154df0 0x7f3e88156a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e880a4f80 0x7f3e881ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 --2- 172.21.15.45:0/1942615454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e8806ca50 0x7f3e880a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 >> 172.21.15.45:0/1942615454 conn(0x7f3e880a7880 msgr2=0x7f3e880c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.093+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 shutdown_connections 2023-12-08T08:15:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.094+0000 7f3e8d259640 1 -- 172.21.15.45:0/1942615454 wait complete. 2023-12-08T08:15:42.117 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:15:42.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.329+0000 7f241ffff640 1 Processor -- start 2023-12-08T08:15:42.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.329+0000 7f241ffff640 1 -- start start 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24200a7910 0x7f24200c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200c1dc0 0x7f242014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2420155850 con 0x7f24201521b0 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241ffff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24200c0890 con 0x7f24200a7910 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200c0b70 con 0x7f24200c1dc0 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24200a7910 0x7f24200c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24200a7910 0x7f24200c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48778/0 (socket says 172.21.15.45:48778) 2023-12-08T08:15:42.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241effd640 1 -- 172.21.15.45:0/1440539823 learned_addr learned my addr 172.21.15.45:0/1440539823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:42.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.331+0000 7f241e7fc640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200c1dc0 0x7f242014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.332+0000 7f241effd640 1 -- 172.21.15.45:0/1440539823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200c1dc0 msgr2=0x7f242014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:42.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.332+0000 7f241effd640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200c1dc0 0x7f242014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.332+0000 7f241effd640 1 -- 172.21.15.45:0/1440539823 >> v1:172.21.15.45:6789/0 conn(0x7f24201521b0 legacy=0x7f2420155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.332+0000 7f241effd640 1 -- 172.21.15.45:0/1440539823 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200c0e50 con 0x7f24200a7910 2023-12-08T08:15:42.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.333+0000 7f241effd640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24200a7910 0x7f24200c1880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2410009870 tx=0x7f241002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5635e0427d7effe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:42.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.333+0000 7f241dffb640 1 -- 172.21.15.45:0/1440539823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031640 con 0x7f24200a7910 2023-12-08T08:15:42.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.333+0000 7f241dffb640 1 -- 172.21.15.45:0/1440539823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100317a0 con 0x7f24200a7910 2023-12-08T08:15:42.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.333+0000 7f241dffb640 1 -- 172.21.15.45:0/1440539823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031b30 con 0x7f24200a7910 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 -- 172.21.15.45:0/1440539823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24200a7910 msgr2=0x7f24200c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24200a7910 0x7f24200c1880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2410009870 tx=0x7f241002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 -- 172.21.15.45:0/1440539823 shutdown_connections 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200c1dc0 0x7f242014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 --2- 172.21.15.45:0/1440539823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24200a7910 0x7f24200c1880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 -- 172.21.15.45:0/1440539823 >> 172.21.15.45:0/1440539823 conn(0x7f24200c5780 msgr2=0x7f24200c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 -- 172.21.15.45:0/1440539823 shutdown_connections 2023-12-08T08:15:42.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.334+0000 7f241ffff640 1 -- 172.21.15.45:0/1440539823 wait complete. 2023-12-08T08:15:42.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.336+0000 7f241ffff640 1 Processor -- start 2023-12-08T08:15:42.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.336+0000 7f241ffff640 1 -- start start 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200a7910 0x7f24200bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24200c1dc0 0x7f24200c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200bf6e0 con 0x7f24201521b0 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24200bb4f0 con 0x7f24200c1dc0 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24200a8f70 con 0x7f24200a7910 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48782/0 (socket says 172.21.15.45:48782) 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.337+0000 7f241f7fe640 1 -- 172.21.15.45:0/1773553425 learned_addr learned my addr 172.21.15.45:0/1773553425 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241effd640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200a7910 0x7f24200bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241e7fc640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24200c1dc0 0x7f24200c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 -- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200a7910 msgr2=0x7f24200bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200a7910 0x7f24200bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 -- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24200c1dc0 msgr2=0x7f24200c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24200c1dc0 0x7f24200c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 -- 172.21.15.45:0/1773553425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24100094d0 con 0x7f24201521b0 2023-12-08T08:15:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.338+0000 7f241f7fe640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f241800c730 tx=0x7f241800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.339+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418003b70 con 0x7f24201521b0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.339+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418003cd0 con 0x7f24201521b0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.339+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418005310 con 0x7f24201521b0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.339+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24200bbbe0 con 0x7f24201521b0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.339+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24201eb090 con 0x7f24201521b0 2023-12-08T08:15:42.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.340+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24201eaef0 con 0x7f24201521b0 2023-12-08T08:15:42.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.341+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2418005680 con 0x7f24201521b0 2023-12-08T08:15:42.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.342+0000 7f24077fe640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 0x7f240c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:42.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.342+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2418089860 con 0x7f24201521b0 2023-12-08T08:15:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.342+0000 7f241effd640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 0x7f240c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.343+0000 7f241effd640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 0x7f240c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2410036000 tx=0x7f241003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:42.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.346+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24201eaef0 con 0x7f24201521b0 2023-12-08T08:15:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.580+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24201eaef0 con 0x7f24201521b0 2023-12-08T08:15:42.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.581+0000 7f24077fe640 1 -- 172.21.15.45:0/1773553425 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f24201eaef0 con 0x7f24201521b0 2023-12-08T08:15:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:42.584 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:15:42.584 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.583+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 msgr2=0x7f240c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.583+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 0x7f240c06d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2410036000 tx=0x7f241003c040 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 msgr2=0x7f24201eb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f241800c730 tx=0x7f241800cbf0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 shutdown_connections 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f240c06ae40 0x7f240c06d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24201521b0 0x7f24201eb890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24200c1dc0 0x7f24200c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 --2- 172.21.15.45:0/1773553425 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f24200a7910 0x7f24200bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 >> 172.21.15.45:0/1773553425 conn(0x7f24200c5780 msgr2=0x7f242014f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 shutdown_connections 2023-12-08T08:15:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:42.584+0000 7f241ffff640 1 -- 172.21.15.45:0/1773553425 wait complete. 2023-12-08T08:15:43.008 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:15:00.337648+0000', 'modified': '2023-12-08T08:15:27.275642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1952493586', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 1952493586}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1952493586}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:15:43.008 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:15:43.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-08T08:15:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.245+0000 7f04d6199640 1 Processor -- start 2023-12-08T08:15:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.245+0000 7f04d6199640 1 -- start start 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d6199640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04d01518c0 0x7f04d00c1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d6199640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d015ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d6199640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d0151ca0 con 0x7f04d00738e0 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d6199640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00c0470 con 0x7f04d01518c0 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d6199640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00726a0 con 0x7f04d00c3900 2023-12-08T08:15:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.247+0000 7f04d5197640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04d01518c0 0x7f04d00c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04d01518c0 0x7f04d00c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48784/0 (socket says 172.21.15.45:48784) 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 -- 172.21.15.45:0/3792860333 learned_addr learned my addr 172.21.15.45:0/3792860333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5998640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d015ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 -- 172.21.15.45:0/3792860333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 msgr2=0x7f04d015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d015ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 -- 172.21.15.45:0/3792860333 >> v1:172.21.15.114:6789/0 conn(0x7f04d00738e0 legacy=0x7f04d00c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.248+0000 7f04d5197640 1 -- 172.21.15.45:0/3792860333 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00c0190 con 0x7f04d01518c0 2023-12-08T08:15:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.249+0000 7f04d5197640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d00c1570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d63eb79e0624189 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04c7fff640 1 -- 172.21.15.45:0/3792860333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc031640 con 0x7f04d01518c0 2023-12-08T08:15:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04c7fff640 1 -- 172.21.15.45:0/3792860333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc0317a0 con 0x7f04d01518c0 2023-12-08T08:15:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04c7fff640 1 -- 172.21.15.45:0/3792860333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc031b30 con 0x7f04d01518c0 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 -- 172.21.15.45:0/3792860333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 msgr2=0x7f04d00c1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d00c1570 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 -- 172.21.15.45:0/3792860333 shutdown_connections 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d015ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 --2- 172.21.15.45:0/3792860333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d00c1570 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 -- 172.21.15.45:0/3792860333 >> 172.21.15.45:0/3792860333 conn(0x7f04d006a4c0 msgr2=0x7f04d006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 -- 172.21.15.45:0/3792860333 shutdown_connections 2023-12-08T08:15:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.250+0000 7f04d6199640 1 -- 172.21.15.45:0/3792860333 wait complete. 2023-12-08T08:15:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.252+0000 7f04d6199640 1 Processor -- start 2023-12-08T08:15:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.252+0000 7f04d6199640 1 -- start start 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00738e0 0x7f04d014c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d0143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d01540f0 con 0x7f04d01518c0 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00718a0 con 0x7f04d00738e0 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d6199640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0143ed0 con 0x7f04d00c3900 2023-12-08T08:15:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.253+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48796/0 (socket says 172.21.15.45:48796) 2023-12-08T08:15:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 -- 172.21.15.45:0/4106812170 learned_addr learned my addr 172.21.15.45:0/4106812170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5197640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00738e0 0x7f04d014c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d4996640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d0143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 -- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 msgr2=0x7f04d0143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d0143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 -- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00738e0 msgr2=0x7f04d014c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00738e0 0x7f04d014c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 -- 172.21.15.45:0/4106812170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0094d0 con 0x7f04d01518c0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.254+0000 7f04d5998640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007e30 tx=0x7f04c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.255+0000 7f04c5ffb640 1 -- 172.21.15.45:0/4106812170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8014620 con 0x7f04d01518c0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.255+0000 7f04c5ffb640 1 -- 172.21.15.45:0/4106812170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c800ee90 con 0x7f04d01518c0 2023-12-08T08:15:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.255+0000 7f04c5ffb640 1 -- 172.21.15.45:0/4106812170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c80149c0 con 0x7f04d01518c0 2023-12-08T08:15:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.255+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d0154300 con 0x7f04d01518c0 2023-12-08T08:15:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.255+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00aa6b0 con 0x7f04d01518c0 2023-12-08T08:15:43.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.257+0000 7f04c5ffb640 1 -- 172.21.15.45:0/4106812170 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04c8014b20 con 0x7f04d01518c0 2023-12-08T08:15:43.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.258+0000 7f04c5ffb640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 0x7f04b406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.258+0000 7f04c5ffb640 1 -- 172.21.15.45:0/4106812170 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04c808a1e0 con 0x7f04d01518c0 2023-12-08T08:15:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.258+0000 7f04d5197640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 0x7f04b406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.259+0000 7f04d9f8d740 1 Processor -- start 2023-12-08T08:15:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.259+0000 7f04d9f8d740 1 -- start start 2023-12-08T08:15:43.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.259+0000 7f04d5197640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 0x7f04b406d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04cc036000 tx=0x7f04cc03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb826f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb829e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb74a880 con 0x55edeb82a340 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb759ae0 con 0x55edeb7ed880 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edeb7571d0 con 0x55edeb826b30 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48808/0 (socket says 172.21.15.45:48808) 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d5998640 1 -- 172.21.15.45:0/303657694 learned_addr learned my addr 172.21.15.45:0/303657694 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d4996640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb829e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.260+0000 7f04d5197640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb826f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 -- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 msgr2=0x55edeb826f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb826f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 -- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 msgr2=0x55edeb829e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb829e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 -- 172.21.15.45:0/303657694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edeb71a860 con 0x55edeb82a340 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d4996640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb829e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04d5998640 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f04c80551d0 tx=0x7f04c80113a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9409d939d79080 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04b2ffd640 1 -- 172.21.15.45:0/303657694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8058d50 con 0x55edeb82a340 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04b2ffd640 1 -- 172.21.15.45:0/303657694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c805ce20 con 0x55edeb82a340 2023-12-08T08:15:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.261+0000 7f04b2ffd640 1 -- 172.21.15.45:0/303657694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8060fd0 con 0x55edeb82a340 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 -- 172.21.15.45:0/303657694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 msgr2=0x55edeb7e6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f04c80551d0 tx=0x7f04c80113a0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 -- 172.21.15.45:0/303657694 shutdown_connections 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb7e6d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb829e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/303657694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb826f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 -- 172.21.15.45:0/303657694 >> 172.21.15.45:0/303657694 conn(0x55edeb7adc70 msgr2=0x55edeb80d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 -- 172.21.15.45:0/303657694 shutdown_connections 2023-12-08T08:15:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.262+0000 7f04d9f8d740 1 -- 172.21.15.45:0/303657694 wait complete. 2023-12-08T08:15:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.263+0000 7f04d9f8d740 1 -- start start 2023-12-08T08:15:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.263+0000 7f04d9f8d740 1 Processor -- start 2023-12-08T08:15:43.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb81fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb82a340 0x55edeb80a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb752ac0 con 0x55edeb826b30 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb6ef2f0 con 0x55edeb7ed880 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edeb70cc70 con 0x55edeb82a340 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d9f8d740 10 client.0 _ll_register_callbacks cb 0x55edeb7113b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d4996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d4996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48816/0 (socket says 172.21.15.45:48816) 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.264+0000 7f04d4996640 1 -- 172.21.15.45:0/334615727 learned_addr learned my addr 172.21.15.45:0/334615727 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d5197640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb81fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d5998640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb82a340 0x55edeb80a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 -- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb82a340 msgr2=0x55edeb80a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb82a340 0x55edeb80a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 -- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 msgr2=0x55edeb81fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb81fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 -- 172.21.15.45:0/334615727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00aa6b0 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d4996640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000f60 tx=0x7f04c0003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e71b1b15af613f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04abfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0001a60 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04c0001bc0 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.265+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edeb74baa0 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c0001d80 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 10 client.4827 fetch_fsmap learned FSMap version 9 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55edeb751140 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55edeb74baa0 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f04c001c350 con 0x55edeb826b30 2023-12-08T08:15:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 10 client.4827 fetch_fsmap finished waiting for FSMap version 9 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 10 client.4827 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 20 client.4827 populate_metadata read hostname 'smithi045' 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb82d040 0x55edeb82d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 4 client.4827 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.266+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 --> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edeb74b7c0 con 0x55edeb82d040 2023-12-08T08:15:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.267+0000 7f04d5197640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb82d040 0x55edeb82d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.268+0000 7f04d5197640 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb82d040 0x55edeb82d420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77374337bd60d8b8 server_cookie=c80864811dde6df6 in_seq=0 out_seq=0 2023-12-08T08:15:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.268+0000 7f04abfff640 10 client.4827 ms_handle_connect on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04abfff640 1 -- 172.21.15.45:0/334615727 <== mds.0 v2:172.21.15.114:6833/1952493586 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55edeb74b7c0 con 0x55edeb82d040 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04abfff640 10 client.4827 handle_command_reply: tid=0 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 client.4827 shutdown 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 msgr2=0x55edeb83bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000f60 tx=0x7f04c0003f80 comp rx=0 tx=0).stop 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 shutdown_connections 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb82d040 0x55edeb82d420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb82a340 0x55edeb80a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb826b30 0x55edeb83bca0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/334615727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb7ed880 0x55edeb81fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04abfff640 0 client.4827 ms_handle_reset on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 >> 172.21.15.45:0/334615727 conn(0x55edeb7adc70 msgr2=0x55edeb7e5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 shutdown_connections 2023-12-08T08:15:43.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 1 -- 172.21.15.45:0/334615727 wait complete. 2023-12-08T08:15:43.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.270+0000 7f04d9f8d740 20 client.4827 trim_cache size 0 max 16384 2023-12-08T08:15:43.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.288+0000 7f04d9f8d740 1 Processor -- start 2023-12-08T08:15:43.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.288+0000 7f04d9f8d740 1 -- start start 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb825540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb82a340 0x55edeb8356e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb4b5f20 con 0x55edeb7ed880 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb81fbe0 con 0x55edeb82a340 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edeb82b9b0 con 0x55edeb826b30 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48828/0 (socket says 172.21.15.45:48828) 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 -- 172.21.15.45:0/3029911265 learned_addr learned my addr 172.21.15.45:0/3029911265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d4996640 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb825540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 -- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 msgr2=0x55edeb825540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5998640 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb82a340 0x55edeb8356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb825540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 -- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb82a340 msgr2=0x55edeb8356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb82a340 0x55edeb8356e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.289+0000 7f04d5197640 1 -- 172.21.15.45:0/3029911265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edeb6eeb80 con 0x55edeb7ed880 2023-12-08T08:15:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d5197640 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f04cc02bf00 tx=0x7f04cc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e5cfbe4dbfa267 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04b37fe640 1 -- 172.21.15.45:0/3029911265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc04a040 con 0x55edeb7ed880 2023-12-08T08:15:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04b37fe640 1 -- 172.21.15.45:0/3029911265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc04b040 con 0x55edeb7ed880 2023-12-08T08:15:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04b37fe640 1 -- 172.21.15.45:0/3029911265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0518f0 con 0x55edeb7ed880 2023-12-08T08:15:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 -- 172.21.15.45:0/3029911265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 msgr2=0x55edeb84b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f04cc02bf00 tx=0x7f04cc030000 comp rx=0 tx=0).stop 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 -- 172.21.15.45:0/3029911265 shutdown_connections 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb826b30 0x55edeb825540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb82a340 0x55edeb8356e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.290+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/3029911265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb7ed880 0x55edeb84b200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.291+0000 7f04d9f8d740 1 -- 172.21.15.45:0/3029911265 >> 172.21.15.45:0/3029911265 conn(0x55edeb7adc70 msgr2=0x55edeb80a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.291+0000 7f04d9f8d740 1 -- 172.21.15.45:0/3029911265 shutdown_connections 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.291+0000 7f04d9f8d740 1 -- 172.21.15.45:0/3029911265 wait complete. 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.291+0000 7f04d9f8d740 1 -- start start 2023-12-08T08:15:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.291+0000 7f04d9f8d740 1 Processor -- start 2023-12-08T08:15:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 0x55edeb835ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 0x55edeb7e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb7e7900 con 0x55edeb82a340 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edeb896f40 con 0x55edeb826b30 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edeb828620 con 0x55edeb7ed880 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.292+0000 7f04d9f8d740 10 client.0 _ll_register_callbacks cb 0x7f04c0007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48834/0 (socket says 172.21.15.45:48834) 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 -- 172.21.15.45:0/2890233254 learned_addr learned my addr 172.21.15.45:0/2890233254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5197640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 0x55edeb835ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d4996640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 0x55edeb7e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 -- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 msgr2=0x55edeb835ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 0x55edeb835ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 -- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 msgr2=0x55edeb7e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 0x55edeb7e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 -- 172.21.15.45:0/2890233254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00c0190 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5197640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 0x55edeb835ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d4996640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 0x55edeb7e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04d5998640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04c8055180 tx=0x7f04c808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8967e5a5e2c653 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.293+0000 7f04abfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8060fd0 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04c8058cd0 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edeb7ecd90 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c8088170 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 10 client.4833 fetch_fsmap learned FSMap version 9 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55edeb714170 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c8080080 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f04c8060b40 con 0x55edeb82a340 2023-12-08T08:15:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 20 client.4833 populate_metadata read hostname 'smithi045' 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb825b40 0x55edeb890c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 4 client.4833 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.294+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 --> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f04c805ce20 con 0x55edeb825b40 2023-12-08T08:15:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.295+0000 7f04d5197640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb825b40 0x55edeb890c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.296+0000 7f04d5197640 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb825b40 0x55edeb890c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615175e6d0e2b432 server_cookie=1456fd70e4d66c2e in_seq=0 out_seq=0 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.296+0000 7f04abfff640 10 client.4833 ms_handle_connect on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04abfff640 1 -- 172.21.15.45:0/2890233254 <== mds.0 v2:172.21.15.114:6833/1952493586 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f04c805ce20 con 0x55edeb825b40 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04abfff640 10 client.4833 handle_command_reply: tid=0 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 client.4833 shutdown 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 msgr2=0x55edeb8906e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04c8055180 tx=0x7f04c808a040 comp rx=0 tx=0).stop 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 shutdown_connections 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:6833/1952493586,v1:172.21.15.114:6835/1952493586] conn(0x55edeb825b40 0x55edeb890c20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55edeb82a340 0x55edeb8906e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55edeb826b30 0x55edeb7e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 --2- 172.21.15.45:0/2890233254 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55edeb7ed880 0x55edeb835ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04abfff640 0 client.4833 ms_handle_reset on v2:172.21.15.114:6833/1952493586 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 >> 172.21.15.45:0/2890233254 conn(0x55edeb7adc70 msgr2=0x55edeb84b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 shutdown_connections 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 1 -- 172.21.15.45:0/2890233254 wait complete. 2023-12-08T08:15:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.297+0000 7f04d9f8d740 20 client.4833 trim_cache size 0 max 16384 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2", 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4273, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 42.436027183999997, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 9, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 26, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 26, 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 50.221637221000002 2023-12-08T08:15:43.303 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:15:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 msgr2=0x7f04b406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 0x7f04b406d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04cc036000 tx=0x7f04cc03c040 comp rx=0 tx=0).stop 2023-12-08T08:15:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 msgr2=0x7f04d0143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f04c8007e30 tx=0x7f04c800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 shutdown_connections 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f04b406ae90 0x7f04b406d350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f04d00c3900 0x7f04d0143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04d01518c0 0x7f04d0143540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 --2- 172.21.15.45:0/4106812170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04d00738e0 0x7f04d014c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 >> 172.21.15.45:0/4106812170 conn(0x7f04d006a4c0 msgr2=0x7f04d0156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 shutdown_connections 2023-12-08T08:15:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:43.298+0000 7f04d6199640 1 -- 172.21.15.45:0/4106812170 wait complete. 2023-12-08T08:15:43.317 INFO:teuthology.run_tasks:Running task kclient... 2023-12-08T08:15:43.330 INFO:tasks.kclient:Mounting kernel clients... 2023-12-08T08:15:43.330 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-08T08:15:43.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:43.330 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:15:43.384 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-08T08:15:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:43.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:15:43.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:43.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-08T08:15:43.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:43.621 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:15:43.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:43.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-12-08T08:15:43.783 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-12-08T08:15:43.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:15:43.788 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-08T08:15:43.788 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:15:43.788 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:15:43.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:15:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.018+0000 7f450e43d640 1 Processor -- start 2023-12-08T08:15:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.018+0000 7f450e43d640 1 -- start start 2023-12-08T08:15:44.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.019+0000 7f450e43d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f450814c4a0 0x7f4508156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450e43d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45080a4d10 0x7f4508155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450e43d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450814c880 con 0x7f4508155ec0 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450e43d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080c4730 con 0x7f45080a4d10 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450e43d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080c56e0 con 0x7f450814c4a0 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f44fffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45080a4d10 0x7f4508155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450c9da640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4508155ec0 0x7f4508153880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58544/0 (socket says 172.21.15.45:58544) 2023-12-08T08:15:44.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f450c9da640 1 -- 172.21.15.45:0/2068241755 learned_addr learned my addr 172.21.15.45:0/2068241755 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.020+0000 7f4507fff640 1 --2- 172.21.15.45:0/2068241755 >> v2:172.21.15.114:3300/0 conn(0x7f450814c4a0 0x7f4508156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.021+0000 7f44fffff640 1 -- 172.21.15.45:0/2068241755 >> v2:172.21.15.114:3300/0 conn(0x7f450814c4a0 msgr2=0x7f4508156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.021+0000 7f44fffff640 1 --2- 172.21.15.45:0/2068241755 >> v2:172.21.15.114:3300/0 conn(0x7f450814c4a0 0x7f4508156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.021+0000 7f44fffff640 1 -- 172.21.15.45:0/2068241755 >> v1:172.21.15.45:6789/0 conn(0x7f4508155ec0 legacy=0x7f4508153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.021+0000 7f44fffff640 1 -- 172.21.15.45:0/2068241755 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080c63b0 con 0x7f45080a4d10 2023-12-08T08:15:44.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.021+0000 7f45077fe640 1 -- 172.21.15.45:0/2068241755 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014143717 0 0) 0x7f450814c880 con 0x7f4508155ec0 2023-12-08T08:15:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.022+0000 7f44fffff640 1 --2- 172.21.15.45:0/2068241755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f4508155980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45080aae70 tx=0x7f44f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17cc6f047e1a855 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.022+0000 7f45077fe640 1 -- 172.21.15.45:0/2068241755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f002e070 con 0x7f45080a4d10 2023-12-08T08:15:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.022+0000 7f45077fe640 1 -- 172.21.15.45:0/2068241755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00315a0 con 0x7f45080a4d10 2023-12-08T08:15:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.022+0000 7f45077fe640 1 -- 172.21.15.45:0/2068241755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0031930 con 0x7f45080a4d10 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 -- 172.21.15.45:0/2068241755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 msgr2=0x7f4508155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 --2- 172.21.15.45:0/2068241755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f4508155980 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45080aae70 tx=0x7f44f002b840 comp rx=0 tx=0).stop 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 -- 172.21.15.45:0/2068241755 shutdown_connections 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 --2- 172.21.15.45:0/2068241755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f4508155980 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 --2- 172.21.15.45:0/2068241755 >> v2:172.21.15.114:3300/0 conn(0x7f450814c4a0 0x7f4508156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 -- 172.21.15.45:0/2068241755 >> 172.21.15.45:0/2068241755 conn(0x7f45080661f0 msgr2=0x7f4508066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 -- 172.21.15.45:0/2068241755 shutdown_connections 2023-12-08T08:15:44.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.023+0000 7f450e43d640 1 -- 172.21.15.45:0/2068241755 wait complete. 2023-12-08T08:15:44.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.025+0000 7f450e43d640 1 Processor -- start 2023-12-08T08:15:44.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.025+0000 7f450e43d640 1 -- start start 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f450814c4a0 0x7f45080c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 0x7f45080c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081e4410 con 0x7f45080a4d10 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c29b0 con 0x7f4508155ec0 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f450e43d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45081eae80 con 0x7f450814c4a0 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f4507fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f4507fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48854/0 (socket says 172.21.15.45:48854) 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.026+0000 7f4507fff640 1 -- 172.21.15.45:0/852937581 learned_addr learned my addr 172.21.15.45:0/852937581 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f44fffff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f450814c4a0 0x7f45080c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f450c9da640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 0x7f45080c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 -- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f450814c4a0 msgr2=0x7f45080c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f450814c4a0 0x7f45080c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 -- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 msgr2=0x7f45080c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 0x7f45080c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 -- 172.21.15.45:0/852937581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009400 con 0x7f45080a4d10 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f450c9da640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 0x7f45080c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f4507fff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44f800d800 tx=0x7f44f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800b6c0 con 0x7f45080a4d10 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.027+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800b820 con 0x7f45080a4d10 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.028+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450806fae0 con 0x7f45080a4d10 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.028+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800bbb0 con 0x7f45080a4d10 2023-12-08T08:15:44.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.028+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508072630 con 0x7f45080a4d10 2023-12-08T08:15:44.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.029+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4508074600 con 0x7f45080a4d10 2023-12-08T08:15:44.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.030+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44f800bd10 con 0x7f45080a4d10 2023-12-08T08:15:44.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.031+0000 7f45057fa640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 0x7f44e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:44.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.031+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44f8089eb0 con 0x7f45080a4d10 2023-12-08T08:15:44.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.031+0000 7f44fffff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 0x7f44e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:44.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.032+0000 7f44fffff640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 0x7f44e806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:44.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.035+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44f8054c60 con 0x7f45080a4d10 2023-12-08T08:15:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.269+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45080a7470 con 0x7f45080a4d10 2023-12-08T08:15:44.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.270+0000 7f45057fa640 1 -- 172.21.15.45:0/852937581 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f44f8058280 con 0x7f45080a4d10 2023-12-08T08:15:44.273 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 msgr2=0x7f44e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 0x7f44e806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44f0036000 tx=0x7f44f0008030 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 msgr2=0x7f45080c0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44f800d800 tx=0x7f44f800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 shutdown_connections 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f44e806ae40 0x7f44e806d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f450814c4a0 0x7f45080c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4508155ec0 0x7f45080c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 --2- 172.21.15.45:0/852937581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45080a4d10 0x7f45080c0510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 >> 172.21.15.45:0/852937581 conn(0x7f45080661f0 msgr2=0x7f4508145020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 shutdown_connections 2023-12-08T08:15:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:44.273+0000 7f450e43d640 1 -- 172.21.15.45:0/852937581 wait complete. 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:15:44.296 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:15:44.297 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:15:44.297 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:15:44.297 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:15:44.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.297 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:44.353 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42088sec preferred_lft 42088sec 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:44.354 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:15:44.355 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:15:44.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:15:44.356 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:44.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.603 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:15:44.682 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:15:44.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.687 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:15:44.742 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:15:44.742 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:15:44.743 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:15:44.743 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:15:44.743 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:15:44.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:15:44.743 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:44.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.936 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:15:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:44.991 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-08T08:15:45.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:45.044 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:45.045 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:45.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:15:45.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-08T08:15:45.045 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:45.192 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-08T08:15:45.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:45.192 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-08T08:15:45.193 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:45.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:45.461 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:15:45.461 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:15:45.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:15:45.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:15:45.462 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:15:45.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:45.635 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:15:45.690 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:15:45.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:45.690 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:15:45.740 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:15:45.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:45.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:15:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:15:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:15:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:15:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:15:46.341 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-08T08:15:46.342 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:15:46.342 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:15:46.342 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:15:46.342 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:15:46.346 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:15:46.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:46.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:15:46.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:46.438 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:46.496 INFO:teuthology.orchestra.run.smithi045.stdout:client4845 2023-12-08T08:15:46.497 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:15:46.497 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:15:46.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:46.550 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:46.608 INFO:teuthology.orchestra.run.smithi045.stdout:client4845 2023-12-08T08:15:46.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:46.608 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:46.674 INFO:teuthology.orchestra.run.smithi045.stdout:client4845 2023-12-08T08:15:46.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:46.675 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.client4845/status') 2023-12-08T08:15:46.762 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4845 (3)192.168.0.1:0/1885567637 2023-12-08T08:15:46.762 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-12-08T08:15:46.762 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-12-08T08:15:46.762 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-12-08T08:15:46.763 INFO:teuthology.orchestra.run.smithi045.stderr:69 bytes copied, 6.7566e-05 s, 1.0 MB/s 2023-12-08T08:15:46.769 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-08T08:15:46.770 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:15:46.770 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:15:46.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:15:46.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.982+0000 7feff91f4640 1 Processor -- start 2023-12-08T08:15:46.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.982+0000 7feff91f4640 1 -- start start 2023-12-08T08:15:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.984+0000 7feff91f4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feff40c0100 0x7feff415a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.984+0000 7feff91f4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff40c0870 con 0x7feff41587e0 2023-12-08T08:15:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.984+0000 7feff91f4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff40c0b50 con 0x7feff415b580 2023-12-08T08:15:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.984+0000 7feff91f4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40a79d0 con 0x7feff40c0100 2023-12-08T08:15:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.985+0000 7feff37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feff41587e0 0x7feff4159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57564/0 (socket says 172.21.15.45:57564) 2023-12-08T08:15:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.985+0000 7feff37fe640 1 -- 172.21.15.45:0/777407097 learned_addr learned my addr 172.21.15.45:0/777407097 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.985+0000 7feff89f3640 1 --2- 172.21.15.45:0/777407097 >> v2:172.21.15.114:3300/0 conn(0x7feff40c0100 0x7feff415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.985+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419220147 0 0) 0x7feff40c0870 con 0x7feff41587e0 2023-12-08T08:15:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.985+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefdc003520 con 0x7feff41587e0 2023-12-08T08:15:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103972978 0 0) 0x7fefdc003520 con 0x7feff41587e0 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 >> v2:172.21.15.114:3300/0 conn(0x7feff40c0100 msgr2=0x7feff415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 --2- 172.21.15.45:0/777407097 >> v2:172.21.15.114:3300/0 conn(0x7feff40c0100 0x7feff415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 >> v1:172.21.15.114:6789/0 conn(0x7feff415b580 legacy=0x7feff406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40c0e30 con 0x7feff41587e0 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fefe8001670 con 0x7feff41587e0 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 >> v1:172.21.15.45:6789/0 conn(0x7feff41587e0 legacy=0x7feff4159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefdc003970 0x7fefdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc0047c0 0x7fefdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 0x7fefdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00c0f0 con 0x7fefdc005180 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00c260 con 0x7fefdc003970 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00c420 con 0x7fefdc0047c0 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff89f3640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 0x7fefdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff3fff640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefdc003970 0x7fefdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff37fe640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc0047c0 0x7fefdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff89f3640 1 -- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc0047c0 msgr2=0x7fefdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff89f3640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc0047c0 0x7fefdc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.986+0000 7feff89f3640 1 -- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefdc003970 msgr2=0x7fefdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.987+0000 7feff89f3640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefdc003970 0x7fefdc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.987+0000 7feff89f3640 1 -- 172.21.15.45:0/777407097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc003520 con 0x7fefdc005180 2023-12-08T08:15:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.987+0000 7feff3fff640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefdc003970 0x7fefdc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.987+0000 7feff89f3640 1 -- 172.21.15.45:0/777407097 reap_dead start 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff89f3640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 0x7fefdc00b980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fc0 tx=0x7fefdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07cae21b1282bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec02cc60 con 0x7fefdc005180 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec00f040 con 0x7fefdc005180 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff2ffd640 1 -- 172.21.15.45:0/777407097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec003990 con 0x7fefdc005180 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff91f4640 1 -- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 msgr2=0x7fefdc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.988+0000 7feff91f4640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 0x7fefdc00b980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fefec009fc0 tx=0x7fefdc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.989+0000 7feff91f4640 1 -- 172.21.15.45:0/777407097 shutdown_connections 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.989+0000 7feff91f4640 1 --2- 172.21.15.45:0/777407097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefdc005180 0x7fefdc00b980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.989+0000 7feff91f4640 1 -- 172.21.15.45:0/777407097 >> 172.21.15.45:0/777407097 conn(0x7feff40c5780 msgr2=0x7feff40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.989+0000 7feff91f4640 1 -- 172.21.15.45:0/777407097 shutdown_connections 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.989+0000 7feff91f4640 1 -- 172.21.15.45:0/777407097 wait complete. 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.990+0000 7feff91f4640 1 Processor -- start 2023-12-08T08:15:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.991+0000 7feff91f4640 1 -- start start 2023-12-08T08:15:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.991+0000 7feff91f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc005180 0x7feff40ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff91f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff91f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feff414e050 0x7feff41f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff91f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40ab830 con 0x7feff4154b90 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff91f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff414e500 con 0x7feff414e050 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff91f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff40a6d30 con 0x7fefdc005180 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38416/0 (socket says 172.21.15.45:38416) 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 -- 172.21.15.45:0/2894313598 learned_addr learned my addr 172.21.15.45:0/2894313598 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff3fff640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc005180 0x7feff40ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff89f3640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feff414e050 0x7feff41f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 -- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc005180 msgr2=0x7feff40ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc005180 0x7feff40ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 -- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feff414e050 msgr2=0x7feff41f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feff414e050 0x7feff41f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.992+0000 7feff37fe640 1 -- 172.21.15.45:0/2894313598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40a72b0 con 0x7feff4154b90 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff37fe640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d750 tx=0x7fefe800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80074e0 con 0x7feff4154b90 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8007640 con 0x7feff4154b90 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80049e0 con 0x7feff4154b90 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff40a6fd0 con 0x7feff4154b90 2023-12-08T08:15:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.993+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff40a8bc0 con 0x7feff4154b90 2023-12-08T08:15:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.994+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff40743e0 con 0x7feff4154b90 2023-12-08T08:15:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.996+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefe8004b40 con 0x7feff4154b90 2023-12-08T08:15:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.996+0000 7feff0ff9640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 0x7fefe006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.997+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fefe80892b0 con 0x7feff4154b90 2023-12-08T08:15:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.997+0000 7feff3fff640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 0x7fefe006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:46.998+0000 7feff3fff640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 0x7fefe006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feff40c0000 tx=0x7fefe4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:47.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.001+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fefe8053f90 con 0x7feff4154b90 2023-12-08T08:15:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.235+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feff4157250 con 0x7feff4154b90 2023-12-08T08:15:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.236+0000 7feff0ff9640 1 -- 172.21.15.45:0/2894313598 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fefe800de60 con 0x7feff4154b90 2023-12-08T08:15:47.238 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:15:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.238+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 msgr2=0x7fefe006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.238+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 0x7fefe006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feff40c0000 tx=0x7fefe4009040 comp rx=0 tx=0).stop 2023-12-08T08:15:47.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.238+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 msgr2=0x7feff414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.238+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fefe800d750 tx=0x7fefe800dc10 comp rx=0 tx=0).stop 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 shutdown_connections 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefe006ae70 0x7fefe006d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feff414e050 0x7feff41f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feff4154b90 0x7feff414db10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 --2- 172.21.15.45:0/2894313598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefdc005180 0x7feff40ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 >> 172.21.15.45:0/2894313598 conn(0x7feff40c5780 msgr2=0x7feff4156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 shutdown_connections 2023-12-08T08:15:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:47.239+0000 7feff91f4640 1 -- 172.21.15.45:0/2894313598 wait complete. 2023-12-08T08:15:47.261 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:15:47.261 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:15:47.262 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:15:47.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:47.262 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:47.323 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42068sec preferred_lft 42068sec 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:15:47.324 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:15:47.325 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:15:47.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:15:47.326 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:15:47.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:47.801 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:15:47.878 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:15:47.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:47.882 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:15:47.940 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:15:47.940 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:15:47.940 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:15:47.940 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:15:47.940 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:15:47.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:15:47.941 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:15:48.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:48.711 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:15:48.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:48.768 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-12-08T08:15:48.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:48.821 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:15:48.821 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:15:48.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:15:48.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-08T08:15:48.822 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:15:48.962 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-08T08:15:48.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:48.962 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-08T08:15:48.963 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:15:49.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:15:49.265 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:15:49.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:49.430 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:15:49.473 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:15:49.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:15:49.473 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:15:49.569 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:15:49.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:49.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:49.715 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:49.715 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:15:50.169 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:15:50.170 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:15:50.170 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:15:50.170 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:15:50.170 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:15:50.175 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:15:50.175 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:15:50.175 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:15:50.175 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:15:50.175 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:15:50.180 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:15:50.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:50.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:15:50.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:50.278 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:50.334 INFO:teuthology.orchestra.run.smithi114.stdout:client4854 2023-12-08T08:15:50.335 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:15:50.335 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:15:50.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:50.386 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:50.490 INFO:teuthology.orchestra.run.smithi114.stdout:client4854 2023-12-08T08:15:50.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:50.491 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:15:50.551 INFO:teuthology.orchestra.run.smithi114.stdout:client4854 2023-12-08T08:15:50.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:15:50.551 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.client4854/status') 2023-12-08T08:15:50.640 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4854 (3)172.21.15.114:0/2424206524 2023-12-08T08:15:50.640 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2023-12-08T08:15:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2023-12-08T08:15:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2023-12-08T08:15:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 7.2404e-05 s, 981 kB/s 2023-12-08T08:15:50.644 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-08T08:15:50.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:50.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.889+0000 7f4575575640 1 Processor -- start 2023-12-08T08:15:50.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.889+0000 7f4575575640 1 -- start start 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f4575575640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45700beb30 0x7f45701542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f4575575640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700a7300 con 0x7f457014e260 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f4575575640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700bf010 con 0x7f45700a7770 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f4575575640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45700bfb90 con 0x7f45700beb30 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f456ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f457014e260 0x7f457006c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57578/0 (socket says 172.21.15.45:57578) 2023-12-08T08:15:50.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.891+0000 7f456ffff640 1 -- 172.21.15.45:0/1137039079 learned_addr learned my addr 172.21.15.45:0/1137039079 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225581104 0 0) 0x7f45700a7300 con 0x7f457014e260 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c003520 con 0x7f457014e260 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f4567fff640 1 --2- 172.21.15.45:0/1137039079 >> v2:172.21.15.114:3300/0 conn(0x7f45700beb30 0x7f45701542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2246859415 0 0) 0x7f455c003520 con 0x7f457014e260 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 >> v2:172.21.15.114:3300/0 conn(0x7f45700beb30 msgr2=0x7f45701542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 --2- 172.21.15.45:0/1137039079 >> v2:172.21.15.114:3300/0 conn(0x7f45700beb30 0x7f45701542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 >> v1:172.21.15.114:6789/0 conn(0x7f45700a7770 legacy=0x7f45700a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700bf2f0 con 0x7f457014e260 2023-12-08T08:15:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f4560001670 con 0x7f457014e260 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 >> v1:172.21.15.45:6789/0 conn(0x7f457014e260 legacy=0x7f457006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c003970 0x7f455c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 0x7f455c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f455c005180 0x7f455c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700bfb90 con 0x7f455c0047c0 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c00c0d0 con 0x7f455c005180 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.892+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c00c290 con 0x7f455c003970 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 0x7f455c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 -- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c003970 msgr2=0x7f455c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c003970 0x7f455c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 -- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f455c005180 msgr2=0x7f455c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4574d74640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f455c005180 0x7f455c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f455c005180 0x7f455c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4567fff640 1 -- 172.21.15.45:0/1137039079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c003520 con 0x7f455c0047c0 2023-12-08T08:15:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4574d74640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f455c005180 0x7f455c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.893+0000 7f4574d74640 1 -- 172.21.15.45:0/1137039079 reap_dead start 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.894+0000 7f4567fff640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 0x7f455c004c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f455800ba00 tx=0x7f455c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce0d7d9a774bb5b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.895+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558032620 con 0x7f455c0047c0 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.895+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558032780 con 0x7f455c0047c0 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.895+0000 7f456f7fe640 1 -- 172.21.15.45:0/1137039079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558032b10 con 0x7f455c0047c0 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.895+0000 7f4575575640 1 -- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 msgr2=0x7f455c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.895+0000 7f4575575640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 0x7f455c004c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f455800ba00 tx=0x7f455c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.896+0000 7f4575575640 1 -- 172.21.15.45:0/1137039079 shutdown_connections 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.896+0000 7f4575575640 1 --2- 172.21.15.45:0/1137039079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455c0047c0 0x7f455c004c40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.896+0000 7f4575575640 1 -- 172.21.15.45:0/1137039079 >> 172.21.15.45:0/1137039079 conn(0x7f45700c5780 msgr2=0x7f45700c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.896+0000 7f4575575640 1 -- 172.21.15.45:0/1137039079 shutdown_connections 2023-12-08T08:15:50.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.896+0000 7f4575575640 1 -- 172.21.15.45:0/1137039079 wait complete. 2023-12-08T08:15:50.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.897+0000 7f4575575640 1 Processor -- start 2023-12-08T08:15:50.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.898+0000 7f4575575640 1 -- start start 2023-12-08T08:15:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c0047c0 0x7f45701e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4570155530 0x7f45701e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4570154310 con 0x7f45700702f0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45701e7640 con 0x7f4570155530 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4575575640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4570153d50 con 0x7f455c0047c0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4574d74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4574d74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38436/0 (socket says 172.21.15.45:38436) 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4574d74640 1 -- 172.21.15.45:0/2271316863 learned_addr learned my addr 172.21.15.45:0/2271316863 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4567fff640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4570155530 0x7f45701e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f456ffff640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c0047c0 0x7f45701e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4574d74640 1 -- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c0047c0 msgr2=0x7f45701e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.899+0000 7f4574d74640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c0047c0 0x7f45701e6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4574d74640 1 -- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4570155530 msgr2=0x7f45701e7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4574d74640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4570155530 0x7f45701e7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4574d74640 1 -- 172.21.15.45:0/2271316863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45701ea6d0 con 0x7f45700702f0 2023-12-08T08:15:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4574d74640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4570155410 tx=0x7f456800d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456800b070 con 0x7f45700702f0 2023-12-08T08:15:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568003e60 con 0x7f45700702f0 2023-12-08T08:15:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4568005310 con 0x7f45700702f0 2023-12-08T08:15:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45701ea9b0 con 0x7f45700702f0 2023-12-08T08:15:50.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.900+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4570070cb0 con 0x7f45700702f0 2023-12-08T08:15:50.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.902+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45700714d0 con 0x7f45700702f0 2023-12-08T08:15:50.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.903+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4568005470 con 0x7f45700702f0 2023-12-08T08:15:50.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.904+0000 7f456d7fa640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 0x7f455006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:50.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.904+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4568088d20 con 0x7f45700702f0 2023-12-08T08:15:50.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.904+0000 7f456ffff640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 0x7f455006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:50.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.905+0000 7f456ffff640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 0x7f455006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45700a5d40 tx=0x7f45600016e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:50.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:50.908+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45700714d0 con 0x7f45700702f0 2023-12-08T08:15:51.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.101+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45700714d0 con 0x7f45700702f0 2023-12-08T08:15:51.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.104+0000 7f456d7fa640 1 -- 172.21.15.45:0/2271316863 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f45700714d0 con 0x7f45700702f0 2023-12-08T08:15:51.108 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:51.108 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 msgr2=0x7f455006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 0x7f455006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45700a5d40 tx=0x7f45600016e0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 msgr2=0x7f4570070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4570155410 tx=0x7f456800d920 comp rx=0 tx=0).stop 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 shutdown_connections 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f455006ae70 0x7f455006d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45700702f0 0x7f4570070770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4570155530 0x7f45701e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 --2- 172.21.15.45:0/2271316863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f455c0047c0 0x7f45701e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 >> 172.21.15.45:0/2271316863 conn(0x7f45700c5780 msgr2=0x7f4570148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:51.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 shutdown_connections 2023-12-08T08:15:51.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.107+0000 7f4575575640 1 -- 172.21.15.45:0/2271316863 wait complete. 2023-12-08T08:15:51.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:51.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:51.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.362+0000 7f46df1bc640 1 Processor -- start 2023-12-08T08:15:51.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.363+0000 7f46df1bc640 1 -- start start 2023-12-08T08:15:51.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46df1bc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46d806f860 0x7f46d80c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46df1bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d80c6170 con 0x7f46d8152130 2023-12-08T08:15:51.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46df1bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d80c5c40 con 0x7f46d80c4930 2023-12-08T08:15:51.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46df1bc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80c5eb0 con 0x7f46d806f860 2023-12-08T08:15:51.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46dd9b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46d8152130 0x7f46d806ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57588/0 (socket says 172.21.15.45:57588) 2023-12-08T08:15:51.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.364+0000 7f46dd9b9640 1 -- 172.21.15.45:0/2132189942 learned_addr learned my addr 172.21.15.45:0/2132189942 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46de9bb640 1 --2- 172.21.15.45:0/2132189942 >> v2:172.21.15.114:3300/0 conn(0x7f46d806f860 0x7f46d80c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406712637 0 0) 0x7f46d80c6170 con 0x7f46d8152130 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c4003520 con 0x7f46d8152130 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776750297 0 0) 0x7f46c4003520 con 0x7f46d8152130 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 >> v2:172.21.15.114:3300/0 conn(0x7f46d806f860 msgr2=0x7f46d80c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 --2- 172.21.15.45:0/2132189942 >> v2:172.21.15.114:3300/0 conn(0x7f46d806f860 0x7f46d80c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 >> v1:172.21.15.114:6789/0 conn(0x7f46d80c4930 legacy=0x7f46d8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d80c5960 con 0x7f46d8152130 2023-12-08T08:15:51.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f46c8001670 con 0x7f46d8152130 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 >> v1:172.21.15.45:6789/0 conn(0x7f46d8152130 legacy=0x7f46d806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46c4003970 0x7f46c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46c40052a0 0x7f46c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80c5eb0 con 0x7f46c40047c0 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c400c170 con 0x7f46c4003970 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.365+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c400c330 con 0x7f46c40052a0 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46de9bb640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46c40052a0 0x7f46c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 -- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46c40052a0 msgr2=0x7f46c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46c40052a0 0x7f46c400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 -- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46c4003970 msgr2=0x7f46c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46c4003970 0x7f46c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46dd9b9640 1 -- 172.21.15.45:0/2132189942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4003520 con 0x7f46c40047c0 2023-12-08T08:15:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.366+0000 7f46de9bb640 1 -- 172.21.15.45:0/2132189942 reap_dead start 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.367+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46c4004c40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46d8152580 tx=0x7f46c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7aa0f2ffcf0ad0c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.367+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8005ad0 con 0x7f46c40047c0 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.367+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8005c30 con 0x7f46c40047c0 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.367+0000 7f46dd1b8640 1 -- 172.21.15.45:0/2132189942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c80072b0 con 0x7f46c40047c0 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 -- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 msgr2=0x7f46c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46c4004c40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46d8152580 tx=0x7f46c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 -- 172.21.15.45:0/2132189942 shutdown_connections 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2132189942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46c4004c40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 -- 172.21.15.45:0/2132189942 >> 172.21.15.45:0/2132189942 conn(0x7f46d80a9620 msgr2=0x7f46d80a9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 -- 172.21.15.45:0/2132189942 shutdown_connections 2023-12-08T08:15:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.368+0000 7f46df1bc640 1 -- 172.21.15.45:0/2132189942 wait complete. 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.370+0000 7f46df1bc640 1 Processor -- start 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.370+0000 7f46df1bc640 1 -- start start 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46d81e9e10 0x7f46d81ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 0x7f46d81df620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d806bb60 con 0x7f46c40047c0 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d806cea0 con 0x7f46d81e0f70 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46df1bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d81ed870 con 0x7f46d81e9e10 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46de1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46de1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38468/0 (socket says 172.21.15.45:38468) 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.371+0000 7f46de1ba640 1 -- 172.21.15.45:0/2245934528 learned_addr learned my addr 172.21.15.45:0/2245934528 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46d81e9e10 0x7f46d81ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de9bb640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 0x7f46d81df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 -- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46d81e9e10 msgr2=0x7f46d81ed330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46d81e9e10 0x7f46d81ed330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 -- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 msgr2=0x7f46d81df620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 0x7f46d81df620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 -- 172.21.15.45:0/2245934528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d81ecea0 con 0x7f46c40047c0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de9bb640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 0x7f46d81df620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46de1ba640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c3c0 tx=0x7f46d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d40052d0 con 0x7f46c40047c0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4005430 con 0x7f46c40047c0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007260 con 0x7f46c40047c0 2023-12-08T08:15:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.372+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d806d090 con 0x7f46c40047c0 2023-12-08T08:15:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.373+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d81ecb30 con 0x7f46c40047c0 2023-12-08T08:15:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.374+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d81eccf0 con 0x7f46c40047c0 2023-12-08T08:15:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.375+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46d40073c0 con 0x7f46c40047c0 2023-12-08T08:15:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.375+0000 7f46ceffd640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 0x7f46bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.376+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46d4088db0 con 0x7f46c40047c0 2023-12-08T08:15:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.376+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 0x7f46bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.377+0000 7f46dd9b9640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 0x7f46bc06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46c8034000 tx=0x7f46c8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.380+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46d4053aa0 con 0x7f46c40047c0 2023-12-08T08:15:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.573+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46d806d5b0 con 0x7f46c40047c0 2023-12-08T08:15:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.574+0000 7f46ceffd640 1 -- 172.21.15.45:0/2245934528 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46d806d5b0 con 0x7f46c40047c0 2023-12-08T08:15:51.577 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 msgr2=0x7f46bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 0x7f46bc06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46c8034000 tx=0x7f46c8009030 comp rx=0 tx=0).stop 2023-12-08T08:15:51.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 msgr2=0x7f46d806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c3c0 tx=0x7f46d400c880 comp rx=0 tx=0).stop 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 shutdown_connections 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f46bc06ae70 0x7f46bc06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46d81e9e10 0x7f46d81ed330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46d81e0f70 0x7f46d81df620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 --2- 172.21.15.45:0/2245934528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46c40047c0 0x7f46d806c960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.577+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 >> 172.21.15.45:0/2245934528 conn(0x7f46d80a9620 msgr2=0x7f46d80a9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.578+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 shutdown_connections 2023-12-08T08:15:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.578+0000 7f46df1bc640 1 -- 172.21.15.45:0/2245934528 wait complete. 2023-12-08T08:15:51.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.831+0000 7f4f553ed640 1 Processor -- start 2023-12-08T08:15:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.832+0000 7f4f553ed640 1 -- start start 2023-12-08T08:15:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.833+0000 7f4f553ed640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f50154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.833+0000 7f4f553ed640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f5006c230 0x7f4f50154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.833+0000 7f4f553ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f50151eb0 con 0x7f4f50151ad0 2023-12-08T08:15:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.833+0000 7f4f553ed640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f500c56a0 con 0x7f4f5006c230 2023-12-08T08:15:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.833+0000 7f4f553ed640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500c80d0 con 0x7f4f50157a20 2023-12-08T08:15:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f4ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f50151ad0 0x7f4f500ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57592/0 (socket says 172.21.15.45:57592) 2023-12-08T08:15:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f4ffff640 1 -- 172.21.15.45:0/1295052134 learned_addr learned my addr 172.21.15.45:0/1295052134 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f4f7fe640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f50154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f54bec640 1 --2- 172.21.15.45:0/1295052134 >> v2:172.21.15.114:3300/0 conn(0x7f4f5006c230 0x7f4f50154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551020771 0 0) 0x7f4f50151eb0 con 0x7f4f50151ad0 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.834+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f3c003520 con 0x7f4f50151ad0 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2000536292 0 0) 0x7f4f3c003520 con 0x7f4f50151ad0 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 msgr2=0x7f4f50154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f50154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 >> v2:172.21.15.114:3300/0 conn(0x7f4f5006c230 msgr2=0x7f4f50154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 --2- 172.21.15.45:0/1295052134 >> v2:172.21.15.114:3300/0 conn(0x7f4f5006c230 0x7f4f50154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50154430 con 0x7f4f50151ad0 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f4f40001670 con 0x7f4f50151ad0 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 >> v1:172.21.15.45:6789/0 conn(0x7f4f50151ad0 legacy=0x7f4f500ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f3c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c003f40 0x7f4f3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c004d00 0x7f4f3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500c80d0 con 0x7f4f3c004d00 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c00b980 con 0x7f4f3c003f40 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c00bac0 con 0x7f4f50157a20 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f54bec640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c004d00 0x7f4f3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.835+0000 7f4f4f7fe640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c003f40 0x7f4f3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f3c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f54bec640 1 -- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 msgr2=0x7f4f3c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f54bec640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f3c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f54bec640 1 -- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c003f40 msgr2=0x7f4f3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:51.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f54bec640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c003f40 0x7f4f3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f54bec640 1 -- 172.21.15.45:0/1295052134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c003520 con 0x7f4f3c004d00 2023-12-08T08:15:51.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.836+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f50157a20 0x7f4f3c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.837+0000 7f4f54bec640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c004d00 0x7f4f3c005180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009af0 tx=0x7f4f3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c929f9a6a0e5bc76 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.837+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4802c710 con 0x7f4f3c004d00 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.837+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4802c870 con 0x7f4f3c004d00 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.837+0000 7f4f4effd640 1 -- 172.21.15.45:0/1295052134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4802cc00 con 0x7f4f3c004d00 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 -- 172.21.15.45:0/1295052134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c004d00 msgr2=0x7f4f3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 --2- 172.21.15.45:0/1295052134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f3c004d00 0x7f4f3c005180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009af0 tx=0x7f4f3c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f54bec640 1 -- 172.21.15.45:0/1295052134 reap_dead start 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 -- 172.21.15.45:0/1295052134 shutdown_connections 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 -- 172.21.15.45:0/1295052134 >> 172.21.15.45:0/1295052134 conn(0x7f4f50066610 msgr2=0x7f4f50066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 -- 172.21.15.45:0/1295052134 shutdown_connections 2023-12-08T08:15:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.838+0000 7f4f553ed640 1 -- 172.21.15.45:0/1295052134 wait complete. 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.840+0000 7f4f553ed640 1 Processor -- start 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.840+0000 7f4f553ed640 1 -- start start 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 0x7f4f500a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f500ac300 0x7f4f500aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5014f150 con 0x7f4f50149420 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500c36d0 con 0x7f4f3c004d00 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f553ed640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500ab260 con 0x7f4f500ac300 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f54bec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f54bec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38478/0 (socket says 172.21.15.45:38478) 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.841+0000 7f4f54bec640 1 -- 172.21.15.45:0/3610345408 learned_addr learned my addr 172.21.15.45:0/3610345408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 0x7f4f500a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 -- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f500ac300 msgr2=0x7f4f500aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f500ac300 0x7f4f500aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 -- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 msgr2=0x7f4f500a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 0x7f4f500a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 -- 172.21.15.45:0/3610345408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5014ec20 con 0x7f4f50149420 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 0x7f4f500a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f54bec640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f48037040 tx=0x7f4f48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48004450 con 0x7f4f50149420 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48003610 con 0x7f4f50149420 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48003980 con 0x7f4f50149420 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f500abe70 con 0x7f4f50149420 2023-12-08T08:15:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.842+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f501eda00 con 0x7f4f50149420 2023-12-08T08:15:51.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.843+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f501584a0 con 0x7f4f50149420 2023-12-08T08:15:51.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.844+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f48003ae0 con 0x7f4f50149420 2023-12-08T08:15:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.845+0000 7f4f4cff9640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 0x7f4f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.845+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f480ab4a0 con 0x7f4f50149420 2023-12-08T08:15:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.846+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 0x7f4f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.846+0000 7f4f4ffff640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 0x7f4f3006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f400017a0 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:51.849+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f501584a0 con 0x7f4f50149420 2023-12-08T08:15:52.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.045+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f501584a0 con 0x7f4f50149420 2023-12-08T08:15:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.045+0000 7f4f4cff9640 1 -- 172.21.15.45:0/3610345408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f501584a0 con 0x7f4f50149420 2023-12-08T08:15:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.048+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 msgr2=0x7f4f3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.048+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 0x7f4f3006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f400017a0 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2023-12-08T08:15:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.048+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 msgr2=0x7f4f501ece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.048+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f48037040 tx=0x7f4f48004730 comp rx=0 tx=0).stop 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 shutdown_connections 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f3006ae70 0x7f4f3006d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f500ac300 0x7f4f500aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f50149420 0x7f4f501ece50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 --2- 172.21.15.45:0/3610345408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f3c004d00 0x7f4f500a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 >> 172.21.15.45:0/3610345408 conn(0x7f4f50066610 msgr2=0x7f4f500c0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 shutdown_connections 2023-12-08T08:15:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.049+0000 7f4f553ed640 1 -- 172.21.15.45:0/3610345408 wait complete. 2023-12-08T08:15:52.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.283+0000 7fc061583640 1 Processor -- start 2023-12-08T08:15:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.283+0000 7fc061583640 1 -- start start 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.284+0000 7fc061583640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc05c0a4d10 0x7fc05c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.284+0000 7fc061583640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0c60c0 con 0x7fc05c14c280 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.284+0000 7fc061583640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c152dc0 con 0x7fc05c0c4970 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.284+0000 7fc061583640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c1563e0 con 0x7fc05c0a4d10 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.285+0000 7fc05bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc05c14c280 0x7fc05c06cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57600/0 (socket says 172.21.15.45:57600) 2023-12-08T08:15:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.285+0000 7fc05bfff640 1 -- 172.21.15.45:0/1980597557 learned_addr learned my addr 172.21.15.45:0/1980597557 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.285+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693610058 0 0) 0x7fc04c001110 con 0x7fc05c14c280 2023-12-08T08:15:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.285+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc044003520 con 0x7fc05c14c280 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.285+0000 7fc060d82640 1 --2- 172.21.15.45:0/1980597557 >> v2:172.21.15.114:3300/0 conn(0x7fc05c0a4d10 0x7fc05c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979232000 0 0) 0x7fc044003520 con 0x7fc05c14c280 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 >> v2:172.21.15.114:3300/0 conn(0x7fc05c0a4d10 msgr2=0x7fc05c155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 --2- 172.21.15.45:0/1980597557 >> v2:172.21.15.114:3300/0 conn(0x7fc05c0a4d10 0x7fc05c155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 >> v1:172.21.15.114:6789/0 conn(0x7fc05c0c4970 legacy=0x7fc05c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c1521d0 con 0x7fc05c14c280 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fc04c001800 con 0x7fc05c14c280 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 >> v1:172.21.15.45:6789/0 conn(0x7fc05c14c280 legacy=0x7fc05c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c1563e0 con 0x7fc0440047c0 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c170 con 0x7fc044003970 2023-12-08T08:15:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04400c330 con 0x7fc0440052a0 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc05bfff640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.286+0000 7fc060d82640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05b7fe640 1 -- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0440052a0 msgr2=0x7fc04400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0440052a0 0x7fc04400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05b7fe640 1 -- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc044003970 msgr2=0x7fc044003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05b7fe640 1 -- 172.21.15.45:0/1980597557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044003520 con 0x7fc0440047c0 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc05bfff640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc044003970 0x7fc044003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.287+0000 7fc060d82640 1 -- 172.21.15.45:0/1980597557 reap_dead start 2023-12-08T08:15:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.288+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc050001720 tx=0x7fc0440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770431e38cc5c03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.288+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0500052d0 con 0x7fc0440047c0 2023-12-08T08:15:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.288+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05002e050 con 0x7fc0440047c0 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.288+0000 7fc05affd640 1 -- 172.21.15.45:0/1980597557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050003830 con 0x7fc0440047c0 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 -- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 msgr2=0x7fc044004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc050001720 tx=0x7fc0440057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 -- 172.21.15.45:0/1980597557 shutdown_connections 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 --2- 172.21.15.45:0/1980597557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc044004c40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 -- 172.21.15.45:0/1980597557 >> 172.21.15.45:0/1980597557 conn(0x7fc05c066ce0 msgr2=0x7fc05c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 -- 172.21.15.45:0/1980597557 shutdown_connections 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.289+0000 7fc061583640 1 -- 172.21.15.45:0/1980597557 wait complete. 2023-12-08T08:15:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.291+0000 7fc061583640 1 Processor -- start 2023-12-08T08:15:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.291+0000 7fc061583640 1 -- start start 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 0x7fc05c072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 0x7fc05c145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c2060 con 0x7fc0440047c0 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0a5540 con 0x7fc05c0a8a70 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc061583640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0a5820 con 0x7fc05c145f20 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc05bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc05bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38500/0 (socket says 172.21.15.45:38500) 2023-12-08T08:15:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.292+0000 7fc05bfff640 1 -- 172.21.15.45:0/1946572458 learned_addr learned my addr 172.21.15.45:0/1946572458 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc060d82640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 0x7fc05c145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 0x7fc05c072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 -- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 msgr2=0x7fc05c145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 0x7fc05c145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 -- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 msgr2=0x7fc05c072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 0x7fc05c072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 -- 172.21.15.45:0/1946572458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0a5b00 con 0x7fc0440047c0 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 0x7fc05c072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc060d82640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 0x7fc05c145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.293+0000 7fc05bfff640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc04c000ff0 tx=0x7fc04c007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.294+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00e710 con 0x7fc0440047c0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.294+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00e870 con 0x7fc0440047c0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.294+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c072020 con 0x7fc0440047c0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.294+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ebe0 con 0x7fc0440047c0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.294+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c072a80 con 0x7fc0440047c0 2023-12-08T08:15:52.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.295+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c0678c0 con 0x7fc0440047c0 2023-12-08T08:15:52.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.296+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc04c00ed40 con 0x7fc0440047c0 2023-12-08T08:15:52.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.297+0000 7fc058ff9640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 0x7fc04806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.297+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc04c089930 con 0x7fc0440047c0 2023-12-08T08:15:52.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.297+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 0x7fc04806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.298+0000 7fc05b7fe640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 0x7fc04806d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc050033000 tx=0x7fc050009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.301+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc04c054580 con 0x7fc0440047c0 2023-12-08T08:15:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.503+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc05c0c60c0 con 0x7fc0440047c0 2023-12-08T08:15:52.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.504+0000 7fc058ff9640 1 -- 172.21.15.45:0/1946572458 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc05c0c60c0 con 0x7fc0440047c0 2023-12-08T08:15:52.506 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:52.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.506+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 msgr2=0x7fc04806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.506+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 0x7fc04806d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc050033000 tx=0x7fc050009030 comp rx=0 tx=0).stop 2023-12-08T08:15:52.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.506+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 msgr2=0x7fc05c1ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.506+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc04c000ff0 tx=0x7fc04c007790 comp rx=0 tx=0).stop 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 shutdown_connections 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc04806ae70 0x7fc04806d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc05c145f20 0x7fc05c145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc05c0a8a70 0x7fc05c072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 --2- 172.21.15.45:0/1946572458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0440047c0 0x7fc05c1ea060 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 >> 172.21.15.45:0/1946572458 conn(0x7fc05c066ce0 msgr2=0x7fc05c148790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 shutdown_connections 2023-12-08T08:15:52.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.507+0000 7fc061583640 1 -- 172.21.15.45:0/1946572458 wait complete. 2023-12-08T08:15:52.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.755+0000 7fae73163640 1 Processor -- start 2023-12-08T08:15:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.755+0000 7fae73163640 1 -- start start 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.756+0000 7fae73163640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6c0c59e0 0x7fae6c158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.756+0000 7fae73163640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c0c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.756+0000 7fae73163640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c0c51f0 con 0x7fae6c06bdd0 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.756+0000 7fae73163640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0c1ce0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.756+0000 7fae73163640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0c54d0 con 0x7fae6c06d1d0 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6c0c59e0 0x7fae6c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6c0c59e0 0x7fae6c158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38510/0 (socket says 172.21.15.45:38510) 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 -- 172.21.15.45:0/3085876250 learned_addr learned my addr 172.21.15.45:0/3085876250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae71960640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c0c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 -- 172.21.15.45:0/3085876250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 msgr2=0x7fae6c0c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c0c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 -- 172.21.15.45:0/3085876250 >> v1:172.21.15.114:6789/0 conn(0x7fae6c06bdd0 legacy=0x7fae6c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae72161640 1 -- 172.21.15.45:0/3085876250 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c157ba0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.757+0000 7fae71960640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c0c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.758+0000 7fae72161640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c158680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf1bda17dede641 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae7115f640 1 -- 172.21.15.45:0/3085876250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802cb00 con 0x7fae6c0c59e0 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae7115f640 1 -- 172.21.15.45:0/3085876250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6802cc60 con 0x7fae6c0c59e0 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae7115f640 1 -- 172.21.15.45:0/3085876250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680343f0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 -- 172.21.15.45:0/3085876250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 msgr2=0x7fae6c158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c158680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae68009e50 tx=0x7fae6802bf60 comp rx=0 tx=0).stop 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 -- 172.21.15.45:0/3085876250 shutdown_connections 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c0c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 --2- 172.21.15.45:0/3085876250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c158680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 -- 172.21.15.45:0/3085876250 >> 172.21.15.45:0/3085876250 conn(0x7fae6c066ce0 msgr2=0x7fae6c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.759+0000 7fae73163640 1 -- 172.21.15.45:0/3085876250 shutdown_connections 2023-12-08T08:15:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.760+0000 7fae73163640 1 -- 172.21.15.45:0/3085876250 wait complete. 2023-12-08T08:15:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.761+0000 7fae73163640 1 Processor -- start 2023-12-08T08:15:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.761+0000 7fae73163640 1 -- start start 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06bdd0 0x7fae6c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c1ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c148450 con 0x7fae6c0c59e0 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c14dbf0 con 0x7fae6c06bdd0 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.762+0000 7fae73163640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0a56e0 con 0x7fae6c06d1d0 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38526/0 (socket says 172.21.15.45:38526) 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 -- 172.21.15.45:0/2389783406 learned_addr learned my addr 172.21.15.45:0/2389783406 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72161640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06bdd0 0x7fae6c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae71960640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c1ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 -- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 msgr2=0x7fae6c1ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c1ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 -- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06bdd0 msgr2=0x7fae6c14d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06bdd0 0x7fae6c14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 -- 172.21.15.45:0/2389783406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68009b30 con 0x7fae6c0c59e0 2023-12-08T08:15:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae71960640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c1ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.763+0000 7fae72962640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c410 tx=0x7fae6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.764+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64011790 con 0x7fae6c0c59e0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.764+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640118f0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.764+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0a5400 con 0x7fae6c0c59e0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.764+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64011ce0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.764+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c1571a0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.765+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c0678c0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.767+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae6401c460 con 0x7fae6c0c59e0 2023-12-08T08:15:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.767+0000 7fae62ffd640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 0x7fae5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.768+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fae640896d0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.768+0000 7fae72161640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 0x7fae5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.769+0000 7fae72161640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 0x7fae5006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae68035000 tx=0x7fae68030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:52.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.772+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae640543b0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.965+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fae6c0743e0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.966+0000 7fae62ffd640 1 -- 172.21.15.45:0/2389783406 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fae640579d0 con 0x7fae6c0c59e0 2023-12-08T08:15:52.969 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 msgr2=0x7fae5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 0x7fae5006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae68035000 tx=0x7fae68030000 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 msgr2=0x7fae6c1ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c410 tx=0x7fae6400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 shutdown_connections 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fae5006ae40 0x7fae5006d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fae6c06d1d0 0x7fae6c1ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6c0c59e0 0x7fae6c1ed420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 --2- 172.21.15.45:0/2389783406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c06bdd0 0x7fae6c14d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 >> 172.21.15.45:0/2389783406 conn(0x7fae6c066ce0 msgr2=0x7fae6c0bf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 shutdown_connections 2023-12-08T08:15:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:52.969+0000 7fae73163640 1 -- 172.21.15.45:0/2389783406 wait complete. 2023-12-08T08:15:52.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:53.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.206+0000 7f8bc359e640 1 Processor -- start 2023-12-08T08:15:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.207+0000 7f8bc359e640 1 -- start start 2023-12-08T08:15:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.208+0000 7f8bc359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bc40a7910 0x7f8bc40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.208+0000 7f8bc359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc4155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.208+0000 7f8bc359e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc4155850 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.208+0000 7f8bc359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40c0890 con 0x7f8bc40a7910 2023-12-08T08:15:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.208+0000 7f8bc359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40c0b70 con 0x7f8bc41521b0 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bc40a7910 0x7f8bc40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bc40a7910 0x7f8bc40c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38528/0 (socket says 172.21.15.45:38528) 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 -- 172.21.15.45:0/2497621392 learned_addr learned my addr 172.21.15.45:0/2497621392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc2d9d640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc4155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 -- 172.21.15.45:0/2497621392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 msgr2=0x7f8bc4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc4155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 -- 172.21.15.45:0/2497621392 >> v1:172.21.15.114:6789/0 conn(0x7f8bc40c1dc0 legacy=0x7f8bc414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.209+0000 7f8bc259c640 1 -- 172.21.15.45:0/2497621392 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40c0e50 con 0x7f8bc40a7910 2023-12-08T08:15:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.211+0000 7f8bc259c640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40a7910 0x7f8bc40c1880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009870 tx=0x7f8bb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60526444015ebcb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.212+0000 7f8bc1d9b640 1 -- 172.21.15.45:0/2497621392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4031640 con 0x7f8bc40a7910 2023-12-08T08:15:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.212+0000 7f8bc1d9b640 1 -- 172.21.15.45:0/2497621392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb40317a0 con 0x7f8bc40a7910 2023-12-08T08:15:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.212+0000 7f8bc1d9b640 1 -- 172.21.15.45:0/2497621392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4031b30 con 0x7f8bc40a7910 2023-12-08T08:15:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.212+0000 7f8bc359e640 1 -- 172.21.15.45:0/2497621392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40a7910 msgr2=0x7f8bc40c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.212+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40a7910 0x7f8bc40c1880 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009870 tx=0x7f8bb402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 -- 172.21.15.45:0/2497621392 shutdown_connections 2023-12-08T08:15:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc4155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2497621392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40a7910 0x7f8bc40c1880 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 -- 172.21.15.45:0/2497621392 >> 172.21.15.45:0/2497621392 conn(0x7f8bc40c5780 msgr2=0x7f8bc40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 -- 172.21.15.45:0/2497621392 shutdown_connections 2023-12-08T08:15:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.213+0000 7f8bc359e640 1 -- 172.21.15.45:0/2497621392 wait complete. 2023-12-08T08:15:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.214+0000 7f8bc359e640 1 Processor -- start 2023-12-08T08:15:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.215+0000 7f8bc359e640 1 -- start start 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc40a7910 0x7f8bc4071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc41e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40be450 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40ba850 con 0x7f8bc40a7910 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40bab30 con 0x7f8bc41521b0 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38538/0 (socket says 172.21.15.45:38538) 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bbbfff640 1 -- 172.21.15.45:0/2340189072 learned_addr learned my addr 172.21.15.45:0/2340189072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc2d9d640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc41e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.216+0000 7f8bc259c640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc40a7910 0x7f8bc4071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 -- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 msgr2=0x7f8bc41e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc41e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 -- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc40a7910 msgr2=0x7f8bc4071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc40a7910 0x7f8bc4071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 -- 172.21.15.45:0/2340189072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40094d0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbbfff640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c400 tx=0x7f8bac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0052d0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac005430 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc40bae10 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac003830 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.217+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc40bb3d0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.219+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc40743e0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.219+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8bac003990 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.220+0000 7f8bbaffd640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 0x7f8ba406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.220+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8bac0890a0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.221+0000 7f8bc259c640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 0x7f8ba406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.221+0000 7f8bc259c640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 0x7f8ba406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4036000 tx=0x7f8bb403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.225+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8bac053cf0 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.421+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bc40bb590 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.423+0000 7f8bbaffd640 1 -- 172.21.15.45:0/2340189072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f8bac057310 con 0x7f8bc40c1dc0 2023-12-08T08:15:53.427 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:53.427 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 msgr2=0x7f8ba406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 0x7f8ba406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4036000 tx=0x7f8bb403c040 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 msgr2=0x7f8bc41e8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c400 tx=0x7f8bac00c8c0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 shutdown_connections 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8ba406ae40 0x7f8ba406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8bc41521b0 0x7f8bc41e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc40c1dc0 0x7f8bc41e8cf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 --2- 172.21.15.45:0/2340189072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc40a7910 0x7f8bc4071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.426+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 >> 172.21.15.45:0/2340189072 conn(0x7f8bc40c5780 msgr2=0x7f8bc40c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.427+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 shutdown_connections 2023-12-08T08:15:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.427+0000 7f8bc359e640 1 -- 172.21.15.45:0/2340189072 wait complete. 2023-12-08T08:15:53.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:53.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:53.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.670+0000 7f43df459640 1 Processor -- start 2023-12-08T08:15:53.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.670+0000 7f43df459640 1 -- start start 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.671+0000 7f43df459640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43d8151ad0 0x7f43d80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.671+0000 7f43df459640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d8155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.671+0000 7f43df459640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d8151eb0 con 0x7f43d8157a20 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.671+0000 7f43df459640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d80c56a0 con 0x7f43d8151ad0 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.672+0000 7f43df459640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80c80d0 con 0x7f43d80ca610 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.672+0000 7f43ddc56640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f43d8157a20 0x7f43d8154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57616/0 (socket says 172.21.15.45:57616) 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.672+0000 7f43ddc56640 1 -- 172.21.15.45:0/884476449 learned_addr learned my addr 172.21.15.45:0/884476449 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.672+0000 7f43dec58640 1 --2- 172.21.15.45:0/884476449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.672+0000 7f43de457640 1 --2- 172.21.15.45:0/884476449 >> v2:172.21.15.114:3300/0 conn(0x7f43d8151ad0 0x7f43d80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599437761 0 0) 0x7f43d8151eb0 con 0x7f43d8157a20 2023-12-08T08:15:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c0003520 con 0x7f43d8157a20 2023-12-08T08:15:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336896335 0 0) 0x7f43c0003520 con 0x7f43d8157a20 2023-12-08T08:15:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dec58640 1 -- 172.21.15.45:0/884476449 >> v2:172.21.15.114:3300/0 conn(0x7f43d8151ad0 msgr2=0x7f43d80ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dec58640 1 --2- 172.21.15.45:0/884476449 >> v2:172.21.15.114:3300/0 conn(0x7f43d8151ad0 0x7f43d80ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dec58640 1 -- 172.21.15.45:0/884476449 >> v1:172.21.15.45:6789/0 conn(0x7f43d8157a20 legacy=0x7f43d8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.673+0000 7f43dec58640 1 -- 172.21.15.45:0/884476449 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d8154430 con 0x7f43d80ca610 2023-12-08T08:15:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.674+0000 7f43dec58640 1 --2- 172.21.15.45:0/884476449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d8155040 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43d8154620 tx=0x7f43d002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d271dbd4186a6fa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.675+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc001670 con 0x7f43d80ca610 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.675+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d002e050 con 0x7f43d80ca610 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.675+0000 7f43dd455640 1 -- 172.21.15.45:0/884476449 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0030730 con 0x7f43d80ca610 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 -- 172.21.15.45:0/884476449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 msgr2=0x7f43d8155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 --2- 172.21.15.45:0/884476449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d8155040 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43d8154620 tx=0x7f43d002b770 comp rx=0 tx=0).stop 2023-12-08T08:15:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 -- 172.21.15.45:0/884476449 shutdown_connections 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 --2- 172.21.15.45:0/884476449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d8155040 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 --2- 172.21.15.45:0/884476449 >> v2:172.21.15.114:3300/0 conn(0x7f43d8151ad0 0x7f43d80ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 -- 172.21.15.45:0/884476449 >> 172.21.15.45:0/884476449 conn(0x7f43d8066610 msgr2=0x7f43d8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 -- 172.21.15.45:0/884476449 shutdown_connections 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.676+0000 7f43df459640 1 -- 172.21.15.45:0/884476449 wait complete. 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.678+0000 7f43df459640 1 Processor -- start 2023-12-08T08:15:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.678+0000 7f43df459640 1 -- start start 2023-12-08T08:15:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d80a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d8151ad0 0x7f43d81e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80c0270 con 0x7f43d8157a20 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80c12c0 con 0x7f43d8151ad0 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43df459640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d81ea9a0 con 0x7f43d80ca610 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43dec58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43dec58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38540/0 (socket says 172.21.15.45:38540) 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.679+0000 7f43dec58640 1 -- 172.21.15.45:0/998490897 learned_addr learned my addr 172.21.15.45:0/998490897 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43de457640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d80a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43ddc56640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d8151ad0 0x7f43d81e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 -- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 msgr2=0x7f43d80a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d80a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 -- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d8151ad0 msgr2=0x7f43d81e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d8151ad0 0x7f43d81e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 -- 172.21.15.45:0/998490897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0009400 con 0x7f43d8157a20 2023-12-08T08:15:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43dec58640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009890 tx=0x7f43d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d003c820 con 0x7f43d8157a20 2023-12-08T08:15:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d003c9a0 con 0x7f43d8157a20 2023-12-08T08:15:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d003cd50 con 0x7f43d8157a20 2023-12-08T08:15:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.680+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d80c0d40 con 0x7f43d8157a20 2023-12-08T08:15:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.681+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d80c0960 con 0x7f43d8157a20 2023-12-08T08:15:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.682+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d80c0640 con 0x7f43d8157a20 2023-12-08T08:15:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.683+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43d0039070 con 0x7f43d8157a20 2023-12-08T08:15:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.684+0000 7f43d6ffd640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 0x7f43c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.684+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43d00ab340 con 0x7f43d8157a20 2023-12-08T08:15:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.685+0000 7f43de457640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 0x7f43c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.685+0000 7f43de457640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 0x7f43c406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43d80c39d0 tx=0x7f43c800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:53.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.689+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43d0076020 con 0x7f43d8157a20 2023-12-08T08:15:53.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.886+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43d80743e0 con 0x7f43d8157a20 2023-12-08T08:15:53.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.887+0000 7f43d6ffd640 1 -- 172.21.15.45:0/998490897 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43d0079640 con 0x7f43d8157a20 2023-12-08T08:15:53.890 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 msgr2=0x7f43c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 0x7f43c406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43d80c39d0 tx=0x7f43c800b040 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 msgr2=0x7f43d81e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009890 tx=0x7f43d00046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 shutdown_connections 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43c406ae40 0x7f43c406d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d8157a20 0x7f43d81e7290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d8151ad0 0x7f43d81e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 --2- 172.21.15.45:0/998490897 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d80ca610 0x7f43d80a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:53.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 >> 172.21.15.45:0/998490897 conn(0x7f43d8066610 msgr2=0x7f43d80c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:53.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 shutdown_connections 2023-12-08T08:15:53.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:53.890+0000 7f43df459640 1 -- 172.21.15.45:0/998490897 wait complete. 2023-12-08T08:15:53.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.128+0000 7feb81127640 1 Processor -- start 2023-12-08T08:15:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.128+0000 7feb81127640 1 -- start start 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb81127640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb7c0aa2d0 0x7feb7c06c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb81127640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0c16b0 con 0x7feb7c151ec0 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb81127640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c0c65d0 con 0x7feb7c0c1d60 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb81127640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c0a8b30 con 0x7feb7c0aa2d0 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb7bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb7c151ec0 0x7feb7c0c47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57622/0 (socket says 172.21.15.45:57622) 2023-12-08T08:15:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.130+0000 7feb7bfff640 1 -- 172.21.15.45:0/826071760 learned_addr learned my addr 172.21.15.45:0/826071760 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb80926640 1 --2- 172.21.15.45:0/826071760 >> v2:172.21.15.114:3300/0 conn(0x7feb7c0aa2d0 0x7feb7c06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377132708 0 0) 0x7feb7c0c16b0 con 0x7feb7c151ec0 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb64003520 con 0x7feb7c151ec0 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289271244 0 0) 0x7feb64003520 con 0x7feb7c151ec0 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 >> v2:172.21.15.114:3300/0 conn(0x7feb7c0aa2d0 msgr2=0x7feb7c06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 --2- 172.21.15.45:0/826071760 >> v2:172.21.15.114:3300/0 conn(0x7feb7c0aa2d0 0x7feb7c06c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 >> v1:172.21.15.114:6789/0 conn(0x7feb7c0c1d60 legacy=0x7feb7c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0c5810 con 0x7feb7c151ec0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7feb6c001670 con 0x7feb7c151ec0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 >> v1:172.21.15.45:6789/0 conn(0x7feb7c151ec0 legacy=0x7feb7c0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb640039c0 0x7feb64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.131+0000 7feb7affd640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 0x7feb64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7affd640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640051d0 0x7feb6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0a8b30 con 0x7feb640047c0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6400c120 con 0x7feb640039c0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6400c2e0 con 0x7feb640051d0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 0x7feb64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7bfff640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb640039c0 0x7feb64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb80926640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640051d0 0x7feb6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 -- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640051d0 msgr2=0x7feb6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640051d0 0x7feb6400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 -- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb640039c0 msgr2=0x7feb64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb640039c0 0x7feb64003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7b7fe640 1 -- 172.21.15.45:0/826071760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64003520 con 0x7feb640047c0 2023-12-08T08:15:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb7bfff640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb640039c0 0x7feb64003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.132+0000 7feb80926640 1 -- 172.21.15.45:0/826071760 reap_dead start 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 0x7feb64004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb70001720 tx=0x7feb640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597528784f94beb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700052d0 con 0x7feb640047c0 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7002e050 con 0x7feb640047c0 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb7affd640 1 -- 172.21.15.45:0/826071760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70003830 con 0x7feb640047c0 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb81127640 1 -- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 msgr2=0x7feb64004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.134+0000 7feb81127640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 0x7feb64004c40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb70001720 tx=0x7feb640057f0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.135+0000 7feb81127640 1 -- 172.21.15.45:0/826071760 shutdown_connections 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.135+0000 7feb81127640 1 --2- 172.21.15.45:0/826071760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb640047c0 0x7feb64004c40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.135+0000 7feb81127640 1 -- 172.21.15.45:0/826071760 >> 172.21.15.45:0/826071760 conn(0x7feb7c066ce0 msgr2=0x7feb7c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.135+0000 7feb81127640 1 -- 172.21.15.45:0/826071760 shutdown_connections 2023-12-08T08:15:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.135+0000 7feb81127640 1 -- 172.21.15.45:0/826071760 wait complete. 2023-12-08T08:15:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.136+0000 7feb81127640 1 Processor -- start 2023-12-08T08:15:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 -- start start 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640047c0 0x7feb7c0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 0x7feb7c13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c070670 con 0x7feb7c1554e0 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1e9f60 con 0x7feb7c146230 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.137+0000 7feb81127640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1ea240 con 0x7feb640047c0 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38554/0 (socket says 172.21.15.45:38554) 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 -- 172.21.15.45:0/3993906240 learned_addr learned my addr 172.21.15.45:0/3993906240 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7bfff640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640047c0 0x7feb7c0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb80926640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 0x7feb7c13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 -- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640047c0 msgr2=0x7feb7c0bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640047c0 0x7feb7c0bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 -- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 msgr2=0x7feb7c13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 0x7feb7c13e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb7b7fe640 1 -- 172.21.15.45:0/3993906240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c1ea520 con 0x7feb7c1554e0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.138+0000 7feb80926640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 0x7feb7c13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb7b7fe640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb70001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700076c0 con 0x7feb7c1554e0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70007a30 con 0x7feb7c1554e0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c1ea800 con 0x7feb7c1554e0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70006be0 con 0x7feb7c1554e0 2023-12-08T08:15:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.139+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c1ead20 con 0x7feb7c1554e0 2023-12-08T08:15:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.140+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c0678c0 con 0x7feb7c1554e0 2023-12-08T08:15:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.141+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb70006d40 con 0x7feb7c1554e0 2023-12-08T08:15:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.142+0000 7feb78ff9640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 0x7feb6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.142+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb700ab710 con 0x7feb7c1554e0 2023-12-08T08:15:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.142+0000 7feb7bfff640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 0x7feb6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.143+0000 7feb7bfff640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 0x7feb6806d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb6c001eb0 tx=0x7feb6c001a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.146+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb70076510 con 0x7feb7c1554e0 2023-12-08T08:15:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.343+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb7c0743e0 con 0x7feb7c1554e0 2023-12-08T08:15:54.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.343+0000 7feb78ff9640 1 -- 172.21.15.45:0/3993906240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb70079b30 con 0x7feb7c1554e0 2023-12-08T08:15:54.346 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 msgr2=0x7feb6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 0x7feb6806d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb6c001eb0 tx=0x7feb6c001a50 comp rx=0 tx=0).stop 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 msgr2=0x7feb7c13dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feb70000c00 tx=0x7feb70001120 comp rx=0 tx=0).stop 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 shutdown_connections 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb6806ae70 0x7feb6806d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb7c146230 0x7feb7c13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb7c1554e0 0x7feb7c13dea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 --2- 172.21.15.45:0/3993906240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb640047c0 0x7feb7c0bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 >> 172.21.15.45:0/3993906240 conn(0x7feb7c066ce0 msgr2=0x7feb7c148b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:54.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 shutdown_connections 2023-12-08T08:15:54.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.346+0000 7feb81127640 1 -- 172.21.15.45:0/3993906240 wait complete. 2023-12-08T08:15:54.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.593+0000 7fa694a0f640 1 Processor -- start 2023-12-08T08:15:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.593+0000 7fa694a0f640 1 -- start start 2023-12-08T08:15:54.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.594+0000 7fa694a0f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa690158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.594+0000 7fa694a0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6900c0bf0 0x7fa690154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.594+0000 7fa694a0f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6900c51f0 con 0x7fa69006d1d0 2023-12-08T08:15:54.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.594+0000 7fa694a0f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900c1ce0 con 0x7fa6900c0bf0 2023-12-08T08:15:54.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.595+0000 7fa694a0f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900c54d0 con 0x7fa6900c59e0 2023-12-08T08:15:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.595+0000 7fa687fff640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa69006d1d0 0x7fa69006bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:39794/0 (socket says 172.21.15.45:39794) 2023-12-08T08:15:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.595+0000 7fa68f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6900c0bf0 0x7fa690154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.595+0000 7fa687fff640 1 -- 172.21.15.45:0/10800059 learned_addr learned my addr 172.21.15.45:0/10800059 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.595+0000 7fa68ed9d640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa690158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.596+0000 7fa68f59e640 1 -- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 msgr2=0x7fa690158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.596+0000 7fa68f59e640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa690158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.596+0000 7fa68f59e640 1 -- 172.21.15.45:0/10800059 >> v1:172.21.15.114:6789/0 conn(0x7fa69006d1d0 legacy=0x7fa69006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.596+0000 7fa68f59e640 1 -- 172.21.15.45:0/10800059 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690157ba0 con 0x7fa6900c0bf0 2023-12-08T08:15:54.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.598+0000 7fa68f59e640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa690154bc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa688009d90 tx=0x7fa68802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a41ec9dd35c06f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa68e59c640 1 -- 172.21.15.45:0/10800059 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68802cce0 con 0x7fa6900c0bf0 2023-12-08T08:15:54.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa68e59c640 1 -- 172.21.15.45:0/10800059 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68802ce40 con 0x7fa6900c0bf0 2023-12-08T08:15:54.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa68e59c640 1 -- 172.21.15.45:0/10800059 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688034660 con 0x7fa6900c0bf0 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 -- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 msgr2=0x7fa690154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa690154bc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa688009d90 tx=0x7fa68802bf30 comp rx=0 tx=0).stop 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 -- 172.21.15.45:0/10800059 shutdown_connections 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa690154bc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 --2- 172.21.15.45:0/10800059 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa690158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 -- 172.21.15.45:0/10800059 >> 172.21.15.45:0/10800059 conn(0x7fa690066ce0 msgr2=0x7fa6900a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 -- 172.21.15.45:0/10800059 shutdown_connections 2023-12-08T08:15:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.599+0000 7fa694a0f640 1 -- 172.21.15.45:0/10800059 wait complete. 2023-12-08T08:15:54.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.601+0000 7fa694a0f640 1 Processor -- start 2023-12-08T08:15:54.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.601+0000 7fa694a0f640 1 -- start start 2023-12-08T08:15:54.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa6900a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa6900a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900728a0 con 0x7fa69006d1d0 2023-12-08T08:15:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690070170 con 0x7fa6900c0bf0 2023-12-08T08:15:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.602+0000 7fa694a0f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900c4b20 con 0x7fa6900c59e0 2023-12-08T08:15:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38566/0 (socket says 172.21.15.45:38566) 2023-12-08T08:15:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 -- 172.21.15.45:0/3230603852 learned_addr learned my addr 172.21.15.45:0/3230603852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 -- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 msgr2=0x7fa6900a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa6900a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 -- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 msgr2=0x7fa6900a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa6900a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.603+0000 7fa68ed9d640 1 -- 172.21.15.45:0/3230603852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688009a70 con 0x7fa69006d1d0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa68ed9d640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa68000e870 tx=0x7fa68000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6800094f0 con 0x7fa69006d1d0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000c8c0 con 0x7fa69006d1d0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000cc70 con 0x7fa69006d1d0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69006fe90 con 0x7fa69006d1d0 2023-12-08T08:15:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.604+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa690070360 con 0x7fa69006d1d0 2023-12-08T08:15:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.605+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6900678c0 con 0x7fa69006d1d0 2023-12-08T08:15:54.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.606+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa680013470 con 0x7fa69006d1d0 2023-12-08T08:15:54.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.607+0000 7fa6877fe640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 0x7fa67006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:54.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.607+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6800899b0 con 0x7fa69006d1d0 2023-12-08T08:15:54.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.608+0000 7fa687fff640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 0x7fa67006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:54.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.608+0000 7fa687fff640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 0x7fa67006d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa678005880 tx=0x7fa678007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.611+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa680054710 con 0x7fa69006d1d0 2023-12-08T08:15:54.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.811+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa690152e20 con 0x7fa69006d1d0 2023-12-08T08:15:54.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.812+0000 7fa6877fe640 1 -- 172.21.15.45:0/3230603852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa680057d30 con 0x7fa69006d1d0 2023-12-08T08:15:54.815 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 msgr2=0x7fa67006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 0x7fa67006d380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa678005880 tx=0x7fa678007aa0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 msgr2=0x7fa690071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa68000e870 tx=0x7fa68000ed30 comp rx=0 tx=0).stop 2023-12-08T08:15:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 shutdown_connections 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa67006aec0 0x7fa67006d380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa6900c59e0 0x7fa6900a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6900c0bf0 0x7fa6900a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 --2- 172.21.15.45:0/3230603852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa69006d1d0 0x7fa690071db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 >> 172.21.15.45:0/3230603852 conn(0x7fa690066ce0 msgr2=0x7fa6900c2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 shutdown_connections 2023-12-08T08:15:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:54.815+0000 7fa694a0f640 1 -- 172.21.15.45:0/3230603852 wait complete. 2023-12-08T08:15:54.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.062+0000 7feceb1db640 1 Processor -- start 2023-12-08T08:15:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.062+0000 7feceb1db640 1 -- start start 2023-12-08T08:15:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.063+0000 7feceb1db640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fece40c4520 0x7fece40c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.063+0000 7feceb1db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fece40c8800 0x7fece40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.063+0000 7feceb1db640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece4155050 con 0x7fece414ae10 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.063+0000 7feceb1db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece4154460 con 0x7fece40c8800 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.063+0000 7feceb1db640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece4154720 con 0x7fece40c4520 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fece40c8800 0x7fece40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fece40c8800 0x7fece40c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34514/0 (socket says 172.21.15.45:34514) 2023-12-08T08:15:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 -- 172.21.15.45:0/550900822 learned_addr learned my addr 172.21.15.45:0/550900822 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fece99d8640 1 --2- 172.21.15.45:0/550900822 >> v2:172.21.15.114:3300/0 conn(0x7fece40c4520 0x7fece40c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 -- 172.21.15.45:0/550900822 >> v2:172.21.15.114:3300/0 conn(0x7fece40c4520 msgr2=0x7fece40c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 --2- 172.21.15.45:0/550900822 >> v2:172.21.15.114:3300/0 conn(0x7fece40c4520 0x7fece40c4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 -- 172.21.15.45:0/550900822 >> v1:172.21.15.114:6789/0 conn(0x7fece414ae10 legacy=0x7fece40c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.064+0000 7fecea9da640 1 -- 172.21.15.45:0/550900822 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4154a00 con 0x7fece40c8800 2023-12-08T08:15:55.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.066+0000 7fecea9da640 1 --2- 172.21.15.45:0/550900822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece40c8800 0x7fece40c8c90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fece4071fd0 tx=0x7fecdc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364e60adce21b74d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.066+0000 7fece91d7640 1 -- 172.21.15.45:0/550900822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc02c9f0 con 0x7fece40c8800 2023-12-08T08:15:55.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.066+0000 7fece91d7640 1 -- 172.21.15.45:0/550900822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc02cb50 con 0x7fece40c8800 2023-12-08T08:15:55.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.066+0000 7fece91d7640 1 -- 172.21.15.45:0/550900822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0343f0 con 0x7fece40c8800 2023-12-08T08:15:55.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 -- 172.21.15.45:0/550900822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece40c8800 msgr2=0x7fece40c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 --2- 172.21.15.45:0/550900822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece40c8800 0x7fece40c8c90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fece4071fd0 tx=0x7fecdc02be50 comp rx=0 tx=0).stop 2023-12-08T08:15:55.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 -- 172.21.15.45:0/550900822 shutdown_connections 2023-12-08T08:15:55.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 --2- 172.21.15.45:0/550900822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece40c8800 0x7fece40c8c90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 --2- 172.21.15.45:0/550900822 >> v2:172.21.15.114:3300/0 conn(0x7fece40c4520 0x7fece40c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 -- 172.21.15.45:0/550900822 >> 172.21.15.45:0/550900822 conn(0x7fece40ab730 msgr2=0x7fece40abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:55.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 -- 172.21.15.45:0/550900822 shutdown_connections 2023-12-08T08:15:55.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.067+0000 7feceb1db640 1 -- 172.21.15.45:0/550900822 wait complete. 2023-12-08T08:15:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.069+0000 7feceb1db640 1 Processor -- start 2023-12-08T08:15:55.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.069+0000 7feceb1db640 1 -- start start 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 0x7fece41ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40c8800 0x7fece4144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece41577d0 con 0x7fece414ae10 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4158300 con 0x7fece40c8800 2023-12-08T08:15:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.070+0000 7feceb1db640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece41447a0 con 0x7fece40c4520 2023-12-08T08:15:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.071+0000 7fecea9da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.071+0000 7fecea9da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34526/0 (socket says 172.21.15.45:34526) 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.071+0000 7fecea9da640 1 -- 172.21.15.45:0/2801114857 learned_addr learned my addr 172.21.15.45:0/2801114857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.071+0000 7fecea1d9640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 0x7fece41ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.071+0000 7fece99d8640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40c8800 0x7fece4144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 -- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 msgr2=0x7fece41ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 0x7fece41ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 -- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40c8800 msgr2=0x7fece4144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40c8800 0x7fece4144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 -- 172.21.15.45:0/2801114857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009b30 con 0x7fece414ae10 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea1d9640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 0x7fece41ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecea9da640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fecdc036040 tx=0x7fecdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03e450 con 0x7fece414ae10 2023-12-08T08:15:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc03e5d0 con 0x7fece414ae10 2023-12-08T08:15:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4158510 con 0x7fece414ae10 2023-12-08T08:15:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.072+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03e980 con 0x7fece414ae10 2023-12-08T08:15:55.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.073+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece41e9e90 con 0x7fece414ae10 2023-12-08T08:15:55.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.074+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece406ab10 con 0x7fece414ae10 2023-12-08T08:15:55.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.076+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecdc03eae0 con 0x7fece414ae10 2023-12-08T08:15:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.078+0000 7fecdaffd640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 0x7fecc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.078+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fecdc0ac800 con 0x7fece414ae10 2023-12-08T08:15:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.078+0000 7fecea1d9640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 0x7fecc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.079+0000 7fecea1d9640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 0x7fecc806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fece0006fd0 tx=0x7fece0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.086+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecdc0774e0 con 0x7fece414ae10 2023-12-08T08:15:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.282+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fece40673e0 con 0x7fece414ae10 2023-12-08T08:15:55.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.283+0000 7fecdaffd640 1 -- 172.21.15.45:0/2801114857 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fecdc07ab00 con 0x7fece414ae10 2023-12-08T08:15:55.286 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 msgr2=0x7fecc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 0x7fecc806d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fece0006fd0 tx=0x7fece0008040 comp rx=0 tx=0).stop 2023-12-08T08:15:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 msgr2=0x7fece41ed0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fecdc036040 tx=0x7fecdc004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 shutdown_connections 2023-12-08T08:15:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecc806ae40 0x7fecc806d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece414ae10 0x7fece41ed0f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fece40c8800 0x7fece4144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 --2- 172.21.15.45:0/2801114857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fece40c4520 0x7fece41ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 >> 172.21.15.45:0/2801114857 conn(0x7fece40ab730 msgr2=0x7fece40a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.286+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 shutdown_connections 2023-12-08T08:15:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.287+0000 7feceb1db640 1 -- 172.21.15.45:0/2801114857 wait complete. 2023-12-08T08:15:55.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.529+0000 7f2ab1554640 1 Processor -- start 2023-12-08T08:15:55.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.529+0000 7f2ab1554640 1 -- start start 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab1554640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2aac14e840 0x7f2aac151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab1554640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2aac0c16a0 0x7f2aac0aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab1554640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac151ea0 con 0x7f2aac0c1210 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab1554640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac14ec20 con 0x7f2aac0c16a0 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab1554640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac154850 con 0x7f2aac14e840 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2ab0d53640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2aac0c16a0 0x7f2aac0aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2aab7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2aac0c1210 0x7f2aac0a9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44772/0 (socket says 172.21.15.45:44772) 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2aab7fe640 1 -- 172.21.15.45:0/1779092540 learned_addr learned my addr 172.21.15.45:0/1779092540 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:55.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.531+0000 7f2aabfff640 1 --2- 172.21.15.45:0/1779092540 >> v2:172.21.15.114:3300/0 conn(0x7f2aac14e840 0x7f2aac151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.532+0000 7f2ab0d53640 1 -- 172.21.15.45:0/1779092540 >> v2:172.21.15.114:3300/0 conn(0x7f2aac14e840 msgr2=0x7f2aac151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:55.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.532+0000 7f2ab0d53640 1 --2- 172.21.15.45:0/1779092540 >> v2:172.21.15.114:3300/0 conn(0x7f2aac14e840 0x7f2aac151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.532+0000 7f2ab0d53640 1 -- 172.21.15.45:0/1779092540 >> v1:172.21.15.45:6789/0 conn(0x7f2aac0c1210 legacy=0x7f2aac0a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.532+0000 7f2ab0d53640 1 -- 172.21.15.45:0/1779092540 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac154b30 con 0x7f2aac0c16a0 2023-12-08T08:15:55.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.533+0000 7f2ab0d53640 1 --2- 172.21.15.45:0/1779092540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac0c16a0 0x7f2aac0aa590 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2aac06ac30 tx=0x7f2aa402da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b67da15f0a4c15 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.533+0000 7f2aaaffd640 1 -- 172.21.15.45:0/1779092540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4031870 con 0x7f2aac0c16a0 2023-12-08T08:15:55.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.533+0000 7f2aaaffd640 1 -- 172.21.15.45:0/1779092540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40319d0 con 0x7f2aac0c16a0 2023-12-08T08:15:55.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.533+0000 7f2aaaffd640 1 -- 172.21.15.45:0/1779092540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4031d60 con 0x7f2aac0c16a0 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 -- 172.21.15.45:0/1779092540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac0c16a0 msgr2=0x7f2aac0aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 --2- 172.21.15.45:0/1779092540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac0c16a0 0x7f2aac0aa590 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2aac06ac30 tx=0x7f2aa402da50 comp rx=0 tx=0).stop 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 -- 172.21.15.45:0/1779092540 shutdown_connections 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 --2- 172.21.15.45:0/1779092540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac0c16a0 0x7f2aac0aa590 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 --2- 172.21.15.45:0/1779092540 >> v2:172.21.15.114:3300/0 conn(0x7f2aac14e840 0x7f2aac151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 -- 172.21.15.45:0/1779092540 >> 172.21.15.45:0/1779092540 conn(0x7f2aac0c5780 msgr2=0x7f2aac0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 -- 172.21.15.45:0/1779092540 shutdown_connections 2023-12-08T08:15:55.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.534+0000 7f2ab1554640 1 -- 172.21.15.45:0/1779092540 wait complete. 2023-12-08T08:15:55.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.536+0000 7f2ab1554640 1 Processor -- start 2023-12-08T08:15:55.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.536+0000 7f2ab1554640 1 -- start start 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 0x7f2aac150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 0x7f2aac148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac14d660 con 0x7f2aac14e840 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac14daf0 con 0x7f2aac0c1210 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.537+0000 7f2ab1554640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac149d20 con 0x7f2aac0c16a0 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34542/0 (socket says 172.21.15.45:34542) 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 -- 172.21.15.45:0/3161284074 learned_addr learned my addr 172.21.15.45:0/3161284074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:55.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2aabfff640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 0x7f2aac150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2aab7fe640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 0x7f2aac148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 -- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 msgr2=0x7f2aac148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 0x7f2aac148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 -- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 msgr2=0x7f2aac150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 0x7f2aac150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 -- 172.21.15.45:0/3161284074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4009400 con 0x7f2aac14e840 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2aabfff640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 0x7f2aac150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2aab7fe640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 0x7f2aac148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:55.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.538+0000 7f2ab0d53640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009890 tx=0x7f2aa4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.539+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa403e040 con 0x7f2aac14e840 2023-12-08T08:15:55.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.539+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4039bc0 con 0x7f2aac14e840 2023-12-08T08:15:55.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.539+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa402f400 con 0x7f2aac14e840 2023-12-08T08:15:55.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.539+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac149800 con 0x7f2aac14e840 2023-12-08T08:15:55.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.539+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac1e5fc0 con 0x7f2aac14e840 2023-12-08T08:15:55.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.540+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac0c3350 con 0x7f2aac14e840 2023-12-08T08:15:55.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.541+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2aa402f560 con 0x7f2aac14e840 2023-12-08T08:15:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.542+0000 7f2aa8ff9640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.542+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2aa40adff0 con 0x7f2aac14e840 2023-12-08T08:15:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.542+0000 7f2aabfff640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.543+0000 7f2aabfff640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 0x7f2a9806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2aac1525d0 tx=0x7f2a9c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:55.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.547+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2aa4078ca0 con 0x7f2aac14e840 2023-12-08T08:15:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.747+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aac0743e0 con 0x7f2aac14e840 2023-12-08T08:15:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.749+0000 7f2aa8ff9640 1 -- 172.21.15.45:0/3161284074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f2aa4049090 con 0x7f2aac14e840 2023-12-08T08:15:55.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:55.752 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.751+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 msgr2=0x7f2a9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.751+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 0x7f2a9806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2aac1525d0 tx=0x7f2a9c00b040 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.751+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 msgr2=0x7f2aac1492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.751+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009890 tx=0x7f2aa4004730 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 shutdown_connections 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2a9806ae40 0x7f2a9806d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2aac0c16a0 0x7f2aac148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2aac14e840 0x7f2aac1492c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 --2- 172.21.15.45:0/3161284074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2aac0c1210 0x7f2aac150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 >> 172.21.15.45:0/3161284074 conn(0x7f2aac0c5780 msgr2=0x7f2aac0a7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 shutdown_connections 2023-12-08T08:15:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:55.752+0000 7f2ab1554640 1 -- 172.21.15.45:0/3161284074 wait complete. 2023-12-08T08:15:55.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:55.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.004+0000 7fb27243d640 1 Processor -- start 2023-12-08T08:15:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.004+0000 7fb27243d640 1 -- start start 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb27243d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb26c0aaf60 0x7fb26c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb27243d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb27243d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c152660 con 0x7fb26c06d960 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb27243d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c0a4d10 con 0x7fb26c0aaf60 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb27243d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c153200 con 0x7fb26c0c1930 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb263fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb26c06d960 0x7fb26c152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44776/0 (socket says 172.21.15.45:44776) 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb263fff640 1 -- 172.21.15.45:0/1904611922 learned_addr learned my addr 172.21.15.45:0/1904611922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.006+0000 7fb26bfff640 1 --2- 172.21.15.45:0/1904611922 >> v2:172.21.15.45:3300/0 conn(0x7fb26c0aaf60 0x7fb26c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb2709da640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26b7fe640 1 -- 172.21.15.45:0/1904611922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418603735 0 0) 0x7fb26c152660 con 0x7fb26c06d960 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26b7fe640 1 -- 172.21.15.45:0/1904611922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003520 con 0x7fb26c06d960 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26bfff640 1 -- 172.21.15.45:0/1904611922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 msgr2=0x7fb26c0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26bfff640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c0c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26bfff640 1 -- 172.21.15.45:0/1904611922 >> v1:172.21.15.45:6789/0 conn(0x7fb26c06d960 legacy=0x7fb26c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.007+0000 7fb26bfff640 1 -- 172.21.15.45:0/1904611922 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0c3310 con 0x7fb26c0aaf60 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.008+0000 7fb26bfff640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0c3830 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0097a0 tx=0x7fb25c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80394a046171c039 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb26b7fe640 1 -- 172.21.15.45:0/1904611922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c02e070 con 0x7fb26c0aaf60 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb26b7fe640 1 -- 172.21.15.45:0/1904611922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0315a0 con 0x7fb26c0aaf60 2023-12-08T08:15:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb26b7fe640 1 -- 172.21.15.45:0/1904611922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c031930 con 0x7fb26c0aaf60 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 -- 172.21.15.45:0/1904611922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c0aaf60 msgr2=0x7fb26c0c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0c3830 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0097a0 tx=0x7fb25c02b840 comp rx=0 tx=0).stop 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 -- 172.21.15.45:0/1904611922 shutdown_connections 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c0c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 --2- 172.21.15.45:0/1904611922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0c3830 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 -- 172.21.15.45:0/1904611922 >> 172.21.15.45:0/1904611922 conn(0x7fb26c0c2430 msgr2=0x7fb26c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 -- 172.21.15.45:0/1904611922 shutdown_connections 2023-12-08T08:15:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.009+0000 7fb27243d640 1 -- 172.21.15.45:0/1904611922 wait complete. 2023-12-08T08:15:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.011+0000 7fb27243d640 1 Processor -- start 2023-12-08T08:15:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.012+0000 7fb27243d640 1 -- start start 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c14f660 con 0x7fb26c06d960 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0baf20 con 0x7fb26c0aaf60 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb27243d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c14c8f0 con 0x7fb26c0c1930 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34562/0 (socket says 172.21.15.45:34562) 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb26bfff640 1 -- 172.21.15.45:0/3056423872 learned_addr learned my addr 172.21.15.45:0/3056423872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb2709da640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.013+0000 7fb263fff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 -- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 msgr2=0x7fb26c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 -- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 msgr2=0x7fb26c0bc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0bc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 -- 172.21.15.45:0/3056423872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c009400 con 0x7fb26c06d960 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb263fff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb2709da640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb26bfff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb25c034040 tx=0x7fb25c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c032840 con 0x7fb26c06d960 2023-12-08T08:15:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c031f00 con 0x7fb26c06d960 2023-12-08T08:15:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c032c00 con 0x7fb26c06d960 2023-12-08T08:15:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.014+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c14ee50 con 0x7fb26c06d960 2023-12-08T08:15:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.015+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c14f380 con 0x7fb26c06d960 2023-12-08T08:15:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.016+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c06cb00 con 0x7fb26c06d960 2023-12-08T08:15:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.017+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb25c04e430 con 0x7fb26c06d960 2023-12-08T08:15:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.018+0000 7fb2697fa640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 0x7fb24c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.018+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb25c0ab870 con 0x7fb26c06d960 2023-12-08T08:15:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.018+0000 7fb263fff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 0x7fb24c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.019+0000 7fb263fff640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 0x7fb24c06d350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0c51e0 tx=0x7fb254009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.023+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb25c076680 con 0x7fb26c06d960 2023-12-08T08:15:56.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.218+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb26c0bac80 con 0x7fb26c06d960 2023-12-08T08:15:56.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.219+0000 7fb2697fa640 1 -- 172.21.15.45:0/3056423872 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb26c0bac80 con 0x7fb26c06d960 2023-12-08T08:15:56.222 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 msgr2=0x7fb24c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 0x7fb24c06d350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0c51e0 tx=0x7fb254009040 comp rx=0 tx=0).stop 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 msgr2=0x7fb26c1e7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb25c034040 tx=0x7fb25c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 shutdown_connections 2023-12-08T08:15:56.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb24c06ae90 0x7fb24c06d350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb26c0c1930 0x7fb26c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb26c0aaf60 0x7fb26c0bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 --2- 172.21.15.45:0/3056423872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb26c06d960 0x7fb26c1e7d40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.221+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 >> 172.21.15.45:0/3056423872 conn(0x7fb26c0c2430 msgr2=0x7fb26c0730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.222+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 shutdown_connections 2023-12-08T08:15:56.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.222+0000 7fb27243d640 1 -- 172.21.15.45:0/3056423872 wait complete. 2023-12-08T08:15:56.245 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.482+0000 7f301086e640 1 Processor -- start 2023-12-08T08:15:56.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.483+0000 7f301086e640 1 -- start start 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.484+0000 7f301086e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f300c151ec0 0x7f300c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.484+0000 7f301086e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f300c0c4d30 0x7f300c06c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.484+0000 7f301086e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300c0c16b0 con 0x7f300c0c1d60 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.484+0000 7f301086e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c0a8b30 con 0x7f300c151ec0 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.484+0000 7f301086e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c0c65d0 con 0x7f300c0c4d30 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f300c0c1d60 0x7f300c06ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44782/0 (socket says 172.21.15.45:44782) 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f300c151ec0 0x7f300c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300affd640 1 -- 172.21.15.45:0/1444507743 learned_addr learned my addr 172.21.15.45:0/1444507743 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300bfff640 1 --2- 172.21.15.45:0/1444507743 >> v2:172.21.15.114:3300/0 conn(0x7f300c0c4d30 0x7f300c06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300b7fe640 1 -- 172.21.15.45:0/1444507743 >> v2:172.21.15.114:3300/0 conn(0x7f300c0c4d30 msgr2=0x7f300c06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300b7fe640 1 --2- 172.21.15.45:0/1444507743 >> v2:172.21.15.114:3300/0 conn(0x7f300c0c4d30 0x7f300c06c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300b7fe640 1 -- 172.21.15.45:0/1444507743 >> v1:172.21.15.45:6789/0 conn(0x7f300c0c1d60 legacy=0x7f300c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.485+0000 7f300b7fe640 1 -- 172.21.15.45:0/1444507743 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c0c5810 con 0x7f300c151ec0 2023-12-08T08:15:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.486+0000 7f300b7fe640 1 --2- 172.21.15.45:0/1444507743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c151ec0 0x7f300c0c47f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f300c06d720 tx=0x7f2ffc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d085928c209d66d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f300a7fc640 1 -- 172.21.15.45:0/1444507743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc02cbf0 con 0x7f300c151ec0 2023-12-08T08:15:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f300a7fc640 1 -- 172.21.15.45:0/1444507743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc02cd50 con 0x7f300c151ec0 2023-12-08T08:15:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f300a7fc640 1 -- 172.21.15.45:0/1444507743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc034660 con 0x7f300c151ec0 2023-12-08T08:15:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 -- 172.21.15.45:0/1444507743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c151ec0 msgr2=0x7f300c0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 --2- 172.21.15.45:0/1444507743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c151ec0 0x7f300c0c47f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f300c06d720 tx=0x7f2ffc02be40 comp rx=0 tx=0).stop 2023-12-08T08:15:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 -- 172.21.15.45:0/1444507743 shutdown_connections 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 --2- 172.21.15.45:0/1444507743 >> v2:172.21.15.114:3300/0 conn(0x7f300c0c4d30 0x7f300c06c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 --2- 172.21.15.45:0/1444507743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c151ec0 0x7f300c0c47f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 -- 172.21.15.45:0/1444507743 >> 172.21.15.45:0/1444507743 conn(0x7f300c066ce0 msgr2=0x7f300c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 -- 172.21.15.45:0/1444507743 shutdown_connections 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.487+0000 7f301086e640 1 -- 172.21.15.45:0/1444507743 wait complete. 2023-12-08T08:15:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.489+0000 7f301086e640 1 Processor -- start 2023-12-08T08:15:56.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.489+0000 7f301086e640 1 -- start start 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f300c0c1d60 0x7f300c1e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300c151ec0 0x7f300c0bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c0bf580 con 0x7f300c0c4d30 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c072100 con 0x7f300c151ec0 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f301086e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c070360 con 0x7f300c0c1d60 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f300affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f300affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34594/0 (socket says 172.21.15.45:34594) 2023-12-08T08:15:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.490+0000 7f300affd640 1 -- 172.21.15.45:0/2161833209 learned_addr learned my addr 172.21.15.45:0/2161833209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 -- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f300c0c1d60 msgr2=0x7f300c1e8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f300c0c1d60 0x7f300c1e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300bfff640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300c151ec0 0x7f300c0bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 -- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300c151ec0 msgr2=0x7f300c0bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300c151ec0 0x7f300c0bf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 -- 172.21.15.45:0/2161833209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009a70 con 0x7f300c0c4d30 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f300affd640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c4a0 tx=0x7f2ff400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4005ce0 con 0x7f300c0c4d30 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff4005e40 con 0x7f300c0c4d30 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.491+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4007270 con 0x7f300c0c4d30 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.492+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c1e9770 con 0x7f300c0c4d30 2023-12-08T08:15:56.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.492+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c072630 con 0x7f300c0c4d30 2023-12-08T08:15:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.493+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c070510 con 0x7f300c0c4d30 2023-12-08T08:15:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.494+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ff40073d0 con 0x7f300c0c4d30 2023-12-08T08:15:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.495+0000 7f3003fff640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 0x7f2fec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.495+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2ff4088da0 con 0x7f300c0c4d30 2023-12-08T08:15:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.495+0000 7f300b7fe640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 0x7f2fec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.496+0000 7f300b7fe640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 0x7f2fec06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc036000 tx=0x7f2ffc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.499+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f300c070510 con 0x7f300c0c4d30 2023-12-08T08:15:56.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.694+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f300c0678c0 con 0x7f300c0c4d30 2023-12-08T08:15:56.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.695+0000 7f3003fff640 1 -- 172.21.15.45:0/2161833209 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ff40170a0 con 0x7f300c0c4d30 2023-12-08T08:15:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 msgr2=0x7f2fec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 0x7f2fec06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc036000 tx=0x7f2ffc02e000 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 msgr2=0x7f300c0beb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400c4a0 tx=0x7f2ff400c960 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 shutdown_connections 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2fec06ae70 0x7f2fec06d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300c151ec0 0x7f300c0bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300c0c4d30 0x7f300c0beb00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 --2- 172.21.15.45:0/2161833209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f300c0c1d60 0x7f300c1e8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 >> 172.21.15.45:0/2161833209 conn(0x7f300c066ce0 msgr2=0x7f300c0c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 shutdown_connections 2023-12-08T08:15:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.698+0000 7f301086e640 1 -- 172.21.15.45:0/2161833209 wait complete. 2023-12-08T08:15:56.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.935+0000 7fa386dfc640 1 Processor -- start 2023-12-08T08:15:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.935+0000 7fa386dfc640 1 -- start start 2023-12-08T08:15:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa386dfc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa386dfc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3800c1930 0x7fa3800c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa386dfc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380152660 con 0x7fa38006d960 2023-12-08T08:15:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa386dfc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800a4d10 con 0x7fa3800c1930 2023-12-08T08:15:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa386dfc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa380153200 con 0x7fa3800aaf60 2023-12-08T08:15:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.937+0000 7fa384b98640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:33026/0 (socket says 172.21.15.45:33026) 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 -- 172.21.15.45:0/3085519348 learned_addr learned my addr 172.21.15.45:0/3085519348 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa385399640 1 --2- 172.21.15.45:0/3085519348 >> v2:172.21.15.114:3300/0 conn(0x7fa3800c1930 0x7fa3800c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 -- 172.21.15.45:0/3085519348 >> v2:172.21.15.114:3300/0 conn(0x7fa3800c1930 msgr2=0x7fa3800c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 --2- 172.21.15.45:0/3085519348 >> v2:172.21.15.114:3300/0 conn(0x7fa3800c1930 0x7fa3800c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 -- 172.21.15.45:0/3085519348 >> v1:172.21.15.114:6789/0 conn(0x7fa38006d960 legacy=0x7fa380152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.938+0000 7fa384b98640 1 -- 172.21.15.45:0/3085519348 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800c3310 con 0x7fa3800aaf60 2023-12-08T08:15:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.940+0000 7fa384b98640 1 --2- 172.21.15.45:0/3085519348 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa374009870 tx=0x7fa37402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6cf67c97a13ec0c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa37f7fe640 1 -- 172.21.15.45:0/3085519348 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374031640 con 0x7fa3800aaf60 2023-12-08T08:15:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa37f7fe640 1 -- 172.21.15.45:0/3085519348 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3740317a0 con 0x7fa3800aaf60 2023-12-08T08:15:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa37f7fe640 1 -- 172.21.15.45:0/3085519348 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374031b30 con 0x7fa3800aaf60 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 -- 172.21.15.45:0/3085519348 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 msgr2=0x7fa3800c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3085519348 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa374009870 tx=0x7fa37402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 -- 172.21.15.45:0/3085519348 shutdown_connections 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3085519348 >> v2:172.21.15.114:3300/0 conn(0x7fa3800c1930 0x7fa3800c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3085519348 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa3800c3830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 -- 172.21.15.45:0/3085519348 >> 172.21.15.45:0/3085519348 conn(0x7fa3800c2430 msgr2=0x7fa3800c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 -- 172.21.15.45:0/3085519348 shutdown_connections 2023-12-08T08:15:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.941+0000 7fa386dfc640 1 -- 172.21.15.45:0/3085519348 wait complete. 2023-12-08T08:15:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.943+0000 7fa386dfc640 1 Processor -- start 2023-12-08T08:15:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.943+0000 7fa386dfc640 1 -- start start 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa38014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 0x7fa380071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800bff40 con 0x7fa38006d960 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c0fe0 con 0x7fa3800c1930 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.944+0000 7fa386dfc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801e5170 con 0x7fa3800aaf60 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34602/0 (socket says 172.21.15.45:34602) 2023-12-08T08:15:56.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 -- 172.21.15.45:0/3282419377 learned_addr learned my addr 172.21.15.45:0/3282419377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa37ffff640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa38014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa385399640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 0x7fa380071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 -- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 msgr2=0x7fa38014a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa38014a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 -- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 msgr2=0x7fa380071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 0x7fa380071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 -- 172.21.15.45:0/3282419377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740094d0 con 0x7fa38006d960 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa385399640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 0x7fa380071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.945+0000 7fa384b98640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa3740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.946+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37403a930 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.946+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37403aa90 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.946+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37403ae40 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.946+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3801e5430 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.946+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3801e59f0 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.947+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38006cb00 con 0x7fa38006d960 2023-12-08T08:15:56.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.948+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa37402f050 con 0x7fa38006d960 2023-12-08T08:15:56.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.949+0000 7fa37d7fa640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 0x7fa36406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:56.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.949+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3740ab810 con 0x7fa38006d960 2023-12-08T08:15:56.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.950+0000 7fa37ffff640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 0x7fa36406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:56.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.950+0000 7fa37ffff640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 0x7fa36406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c2330 tx=0x7fa36c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:56.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:56.954+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3740764f0 con 0x7fa38006d960 2023-12-08T08:15:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.147+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa380074670 con 0x7fa38006d960 2023-12-08T08:15:57.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.148+0000 7fa37d7fa640 1 -- 172.21.15.45:0/3282419377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa374079b10 con 0x7fa38006d960 2023-12-08T08:15:57.151 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:57.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 msgr2=0x7fa36406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 0x7fa36406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c2330 tx=0x7fa36c009040 comp rx=0 tx=0).stop 2023-12-08T08:15:57.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 msgr2=0x7fa3800c0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa374000c00 tx=0x7fa3740046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 shutdown_connections 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.151+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa36406ae40 0x7fa36406d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3800aaf60 0x7fa38014a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800c1930 0x7fa380071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 --2- 172.21.15.45:0/3282419377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa38006d960 0x7fa3800c0aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 >> 172.21.15.45:0/3282419377 conn(0x7fa3800c2430 msgr2=0x7fa380152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 shutdown_connections 2023-12-08T08:15:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.152+0000 7fa386dfc640 1 -- 172.21.15.45:0/3282419377 wait complete. 2023-12-08T08:15:57.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:57.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.397+0000 7fd5909cd640 1 Processor -- start 2023-12-08T08:15:57.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.397+0000 7fd5909cd640 1 -- start start 2023-12-08T08:15:57.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.397+0000 7fd5909cd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 0x7fd58c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.397+0000 7fd5909cd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd58c155790 0x7fd58c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.397+0000 7fd5909cd640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0c60c0 con 0x7fd58c14c280 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd5909cd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c152dc0 con 0x7fd58c155790 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd5909cd640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1521d0 con 0x7fd58c0c4970 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd58b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd58c155790 0x7fd58c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd58b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd58c155790 0x7fd58c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34608/0 (socket says 172.21.15.45:34608) 2023-12-08T08:15:57.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd58b59e640 1 -- 172.21.15.45:0/2085294794 learned_addr learned my addr 172.21.15.45:0/2085294794 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.398+0000 7fd58a59c640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 0x7fd58c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.399+0000 7fd58b59e640 1 -- 172.21.15.45:0/2085294794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 msgr2=0x7fd58c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.399+0000 7fd58b59e640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 0x7fd58c0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.399+0000 7fd58b59e640 1 -- 172.21.15.45:0/2085294794 >> v1:172.21.15.114:6789/0 conn(0x7fd58c14c280 legacy=0x7fd58c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.399+0000 7fd58b59e640 1 -- 172.21.15.45:0/2085294794 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c14c660 con 0x7fd58c155790 2023-12-08T08:15:57.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.399+0000 7fd58a59c640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 0x7fd58c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:57.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.400+0000 7fd58b59e640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c155790 0x7fd58c155c00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd584009e50 tx=0x7fd58402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f4d828036441eb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd589d9b640 1 -- 172.21.15.45:0/2085294794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58402ca70 con 0x7fd58c155790 2023-12-08T08:15:57.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd589d9b640 1 -- 172.21.15.45:0/2085294794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58402cbd0 con 0x7fd58c155790 2023-12-08T08:15:57.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd589d9b640 1 -- 172.21.15.45:0/2085294794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840343f0 con 0x7fd58c155790 2023-12-08T08:15:57.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 -- 172.21.15.45:0/2085294794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c155790 msgr2=0x7fd58c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c155790 0x7fd58c155c00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd584009e50 tx=0x7fd58402bed0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 -- 172.21.15.45:0/2085294794 shutdown_connections 2023-12-08T08:15:57.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c155790 0x7fd58c155c00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 --2- 172.21.15.45:0/2085294794 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c0c4970 0x7fd58c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.401+0000 7fd5909cd640 1 -- 172.21.15.45:0/2085294794 >> 172.21.15.45:0/2085294794 conn(0x7fd58c066ce0 msgr2=0x7fd58c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:57.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.402+0000 7fd5909cd640 1 -- 172.21.15.45:0/2085294794 shutdown_connections 2023-12-08T08:15:57.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.402+0000 7fd5909cd640 1 -- 172.21.15.45:0/2085294794 wait complete. 2023-12-08T08:15:57.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.403+0000 7fd5909cd640 1 Processor -- start 2023-12-08T08:15:57.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.404+0000 7fd5909cd640 1 -- start start 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c14c280 0x7fd58c0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 0x7fd58c0a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c144fd0 con 0x7fd58c0c4970 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c14a060 con 0x7fd58c155790 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd5909cd640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1517f0 con 0x7fd58c14c280 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd58ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd58ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34622/0 (socket says 172.21.15.45:34622) 2023-12-08T08:15:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd58ad9d640 1 -- 172.21.15.45:0/243784343 learned_addr learned my addr 172.21.15.45:0/243784343 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.405+0000 7fd58a59c640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c14c280 0x7fd58c0a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58b59e640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 0x7fd58c0a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 -- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c14c280 msgr2=0x7fd58c0a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c14c280 0x7fd58c0a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 -- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 msgr2=0x7fd58c0a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 0x7fd58c0a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 -- 172.21.15.45:0/243784343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584009b30 con 0x7fd58c0c4970 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58b59e640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 0x7fd58c0a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd58ad9d640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c430 tx=0x7fd57c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0052d0 con 0x7fd58c0c4970 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c005430 con 0x7fd58c0c4970 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c003830 con 0x7fd58c0c4970 2023-12-08T08:15:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.406+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c144cf0 con 0x7fd58c0c4970 2023-12-08T08:15:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.407+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c1eb140 con 0x7fd58c0c4970 2023-12-08T08:15:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.408+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c0678c0 con 0x7fd58c0c4970 2023-12-08T08:15:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.409+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd57c003990 con 0x7fd58c0c4970 2023-12-08T08:15:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.410+0000 7fd5737fe640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 0x7fd57806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.410+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd57c088d40 con 0x7fd58c0c4970 2023-12-08T08:15:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.411+0000 7fd58a59c640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 0x7fd57806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.411+0000 7fd58a59c640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 0x7fd57806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd58c072bf0 tx=0x7fd580008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.415+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd57c053ac0 con 0x7fd58c0c4970 2023-12-08T08:15:57.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.612+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd58c0c60c0 con 0x7fd58c0c4970 2023-12-08T08:15:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.613+0000 7fd5737fe640 1 -- 172.21.15.45:0/243784343 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd58c0c60c0 con 0x7fd58c0c4970 2023-12-08T08:15:57.616 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 msgr2=0x7fd57806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 0x7fd57806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd58c072bf0 tx=0x7fd580008040 comp rx=0 tx=0).stop 2023-12-08T08:15:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 msgr2=0x7fd58c150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c430 tx=0x7fd57c00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 shutdown_connections 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd57806ae40 0x7fd57806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd58c14c280 0x7fd58c0a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd58c155790 0x7fd58c0a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 --2- 172.21.15.45:0/243784343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd58c0c4970 0x7fd58c150bc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 >> 172.21.15.45:0/243784343 conn(0x7fd58c066ce0 msgr2=0x7fd58c1471e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 shutdown_connections 2023-12-08T08:15:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.616+0000 7fd5909cd640 1 -- 172.21.15.45:0/243784343 wait complete. 2023-12-08T08:15:57.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:15:57.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.862+0000 7fb62db9e640 1 Processor -- start 2023-12-08T08:15:57.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.862+0000 7fb62db9e640 1 -- start start 2023-12-08T08:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.863+0000 7fb62db9e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb6281521b0 0x7fb62814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.863+0000 7fb62db9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb62814fb20 0x7fb628155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.863+0000 7fb62db9e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb628155850 con 0x7fb6280a7910 2023-12-08T08:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.863+0000 7fb62db9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280c0890 con 0x7fb62814fb20 2023-12-08T08:15:57.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.863+0000 7fb62db9e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280c0b70 con 0x7fb6281521b0 2023-12-08T08:15:57.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb62814fb20 0x7fb628155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb62814fb20 0x7fb628155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34630/0 (socket says 172.21.15.45:34630) 2023-12-08T08:15:57.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 -- 172.21.15.45:0/3308168980 learned_addr learned my addr 172.21.15.45:0/3308168980 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:57.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb627fff640 1 --2- 172.21.15.45:0/3308168980 >> v2:172.21.15.114:3300/0 conn(0x7fb6281521b0 0x7fb62814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 -- 172.21.15.45:0/3308168980 >> v2:172.21.15.114:3300/0 conn(0x7fb6281521b0 msgr2=0x7fb62814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 --2- 172.21.15.45:0/3308168980 >> v2:172.21.15.114:3300/0 conn(0x7fb6281521b0 0x7fb62814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 -- 172.21.15.45:0/3308168980 >> v1:172.21.15.114:6789/0 conn(0x7fb6280a7910 legacy=0x7fb6280c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.864+0000 7fb62d39d640 1 -- 172.21.15.45:0/3308168980 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280c0e50 con 0x7fb62814fb20 2023-12-08T08:15:57.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.866+0000 7fb62d39d640 1 --2- 172.21.15.45:0/3308168980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62814fb20 0x7fb628155ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6280c6560 tx=0x7fb62002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f483968e041a4ae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.866+0000 7fb6277fe640 1 -- 172.21.15.45:0/3308168980 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620031870 con 0x7fb62814fb20 2023-12-08T08:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.866+0000 7fb6277fe640 1 -- 172.21.15.45:0/3308168980 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6200319d0 con 0x7fb62814fb20 2023-12-08T08:15:57.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.866+0000 7fb6277fe640 1 -- 172.21.15.45:0/3308168980 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620031d60 con 0x7fb62814fb20 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 -- 172.21.15.45:0/3308168980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62814fb20 msgr2=0x7fb628155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3308168980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62814fb20 0x7fb628155ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6280c6560 tx=0x7fb62002b910 comp rx=0 tx=0).stop 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 -- 172.21.15.45:0/3308168980 shutdown_connections 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3308168980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62814fb20 0x7fb628155ce0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3308168980 >> v2:172.21.15.114:3300/0 conn(0x7fb6281521b0 0x7fb62814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 -- 172.21.15.45:0/3308168980 >> 172.21.15.45:0/3308168980 conn(0x7fb6280c5780 msgr2=0x7fb6280c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 -- 172.21.15.45:0/3308168980 shutdown_connections 2023-12-08T08:15:57.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.867+0000 7fb62db9e640 1 -- 172.21.15.45:0/3308168980 wait complete. 2023-12-08T08:15:57.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.869+0000 7fb62db9e640 1 Processor -- start 2023-12-08T08:15:57.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.869+0000 7fb62db9e640 1 -- start start 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6280a7910 0x7fb6281dce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb62814fb20 0x7fb6280beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281dba30 con 0x7fb6281521b0 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281ecc90 con 0x7fb6280a7910 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62db9e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281ecf70 con 0x7fb62814fb20 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62d39d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62d39d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34640/0 (socket says 172.21.15.45:34640) 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.870+0000 7fb62d39d640 1 -- 172.21.15.45:0/3643970279 learned_addr learned my addr 172.21.15.45:0/3643970279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb627fff640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb62814fb20 0x7fb6280beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62cb9c640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6280a7910 0x7fb6281dce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 -- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb62814fb20 msgr2=0x7fb6280beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb62814fb20 0x7fb6280beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 -- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6280a7910 msgr2=0x7fb6281dce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6280a7910 0x7fb6281dce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 -- 172.21.15.45:0/3643970279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200094d0 con 0x7fb6281521b0 2023-12-08T08:15:57.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.871+0000 7fb62d39d640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6200090b0 tx=0x7fb6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.872+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62003ac60 con 0x7fb6281521b0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.872+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62003adc0 con 0x7fb6281521b0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.872+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6281ed250 con 0x7fb6281521b0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.872+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620044630 con 0x7fb6281521b0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.872+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6280bf2e0 con 0x7fb6281521b0 2023-12-08T08:15:57.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.873+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6281ed770 con 0x7fb6281521b0 2023-12-08T08:15:57.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.875+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb62004d450 con 0x7fb6281521b0 2023-12-08T08:15:57.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.875+0000 7fb6257fa640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 0x7fb60806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:57.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.876+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb62002d040 con 0x7fb6281521b0 2023-12-08T08:15:57.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.876+0000 7fb62cb9c640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 0x7fb60806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:57.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.876+0000 7fb62cb9c640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 0x7fb60806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6180012e0 tx=0x7fb618009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:57.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:57.882+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6281ed770 con 0x7fb6281521b0 2023-12-08T08:15:58.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:15:58.049 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:15:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.079+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6281ed770 con 0x7fb6281521b0 2023-12-08T08:15:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.080+0000 7fb6257fa640 1 -- 172.21.15.45:0/3643970279 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7fb6281ed770 con 0x7fb6281521b0 2023-12-08T08:15:58.084 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:15:58.084 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 msgr2=0x7fb60806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 0x7fb60806d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb6180012e0 tx=0x7fb618009040 comp rx=0 tx=0).stop 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 msgr2=0x7fb62814bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6200090b0 tx=0x7fb6200046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 shutdown_connections 2023-12-08T08:15:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb60806ae40 0x7fb60806d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb62814fb20 0x7fb6280beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6281521b0 0x7fb62814bb20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 --2- 172.21.15.45:0/3643970279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6280a7910 0x7fb6281dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 >> 172.21.15.45:0/3643970279 conn(0x7fb6280c5780 msgr2=0x7fb62806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 shutdown_connections 2023-12-08T08:15:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.083+0000 7fb62db9e640 1 -- 172.21.15.45:0/3643970279 wait complete. 2023-12-08T08:15:58.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:15:58.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:15:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.358+0000 7f21eac6d640 1 Processor -- start 2023-12-08T08:15:58.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.358+0000 7f21eac6d640 1 -- start start 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 0x7f21e4158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406d1d0 0x7f21e40c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21e406bdd0 0x7f21e406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e40c1ce0 con 0x7f21e406bdd0 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e40c51f0 con 0x7f21e40c59e0 2023-12-08T08:15:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21eac6d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40c54d0 con 0x7f21e406d1d0 2023-12-08T08:15:58.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21ea46c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21e406bdd0 0x7f21e406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21ea46c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21e406bdd0 0x7f21e406c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34656/0 (socket says 172.21.15.45:34656) 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21ea46c640 1 -- 172.21.15.45:0/1427857762 learned_addr learned my addr 172.21.15.45:0/1427857762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21e946a640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406d1d0 0x7f21e40c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21e9c6b640 1 --2- 172.21.15.45:0/1427857762 >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 0x7f21e4158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.360+0000 7f21ea46c640 1 -- 172.21.15.45:0/1427857762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406d1d0 msgr2=0x7f21e40c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.361+0000 7f21ea46c640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406d1d0 0x7f21e40c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.361+0000 7f21ea46c640 1 -- 172.21.15.45:0/1427857762 >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 msgr2=0x7f21e4158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.361+0000 7f21ea46c640 1 --2- 172.21.15.45:0/1427857762 >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 0x7f21e4158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.361+0000 7f21ea46c640 1 -- 172.21.15.45:0/1427857762 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4157ba0 con 0x7f21e406bdd0 2023-12-08T08:15:58.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.361+0000 7f21e9c6b640 1 --2- 172.21.15.45:0/1427857762 >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 0x7f21e4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.362+0000 7f21ea46c640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e406bdd0 0x7f21e406c260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21e406df30 tx=0x7f21dc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91903d3363056c3e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.362+0000 7f21e8c69640 1 -- 172.21.15.45:0/1427857762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc02cb00 con 0x7f21e406bdd0 2023-12-08T08:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.362+0000 7f21e8c69640 1 -- 172.21.15.45:0/1427857762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc02cc60 con 0x7f21e406bdd0 2023-12-08T08:15:58.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.362+0000 7f21e8c69640 1 -- 172.21.15.45:0/1427857762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0343f0 con 0x7f21e406bdd0 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 -- 172.21.15.45:0/1427857762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e406bdd0 msgr2=0x7f21e406c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e406bdd0 0x7f21e406c260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21e406df30 tx=0x7f21dc02bf60 comp rx=0 tx=0).stop 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 -- 172.21.15.45:0/1427857762 shutdown_connections 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e406bdd0 0x7f21e406c260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 --2- 172.21.15.45:0/1427857762 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406d1d0 0x7f21e40c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 --2- 172.21.15.45:0/1427857762 >> v2:172.21.15.114:3300/0 conn(0x7f21e40c59e0 0x7f21e4158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 -- 172.21.15.45:0/1427857762 >> 172.21.15.45:0/1427857762 conn(0x7f21e4066ce0 msgr2=0x7f21e40a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:58.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 -- 172.21.15.45:0/1427857762 shutdown_connections 2023-12-08T08:15:58.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.363+0000 7f21eac6d640 1 -- 172.21.15.45:0/1427857762 wait complete. 2023-12-08T08:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.365+0000 7f21eac6d640 1 Processor -- start 2023-12-08T08:15:58.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.365+0000 7f21eac6d640 1 -- start start 2023-12-08T08:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406bdd0 0x7f21e41ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21e406d1d0 0x7f21e406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4071430 con 0x7f21e40c59e0 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40aa610 con 0x7f21e406d1d0 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21eac6d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40aa8f0 con 0x7f21e406bdd0 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.366+0000 7f21ea46c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21e9c6b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406bdd0 0x7f21e41ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34670/0 (socket says 172.21.15.45:34670) 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 -- 172.21.15.45:0/2180666171 learned_addr learned my addr 172.21.15.45:0/2180666171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:58.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21e946a640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21e406d1d0 0x7f21e406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 -- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406bdd0 msgr2=0x7f21e41ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406bdd0 0x7f21e41ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 -- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21e406d1d0 msgr2=0x7f21e406fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21e406d1d0 0x7f21e406fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 -- 172.21.15.45:0/2180666171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009b30 con 0x7f21e40c59e0 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.367+0000 7f21ea46c640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21dc036040 tx=0x7f21dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.368+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc009510 con 0x7f21e40c59e0 2023-12-08T08:15:58.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.368+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc03e450 con 0x7f21e40c59e0 2023-12-08T08:15:58.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.368+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc03e800 con 0x7f21e40c59e0 2023-12-08T08:15:58.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.368+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e41e98c0 con 0x7f21e40c59e0 2023-12-08T08:15:58.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.368+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e40aabd0 con 0x7f21e40c59e0 2023-12-08T08:15:58.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.369+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40678c0 con 0x7f21e40c59e0 2023-12-08T08:15:58.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.370+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21dc03e960 con 0x7f21e40c59e0 2023-12-08T08:15:58.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.371+0000 7f21da7fc640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 0x7f21c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.372+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21dc0ac580 con 0x7f21e40c59e0 2023-12-08T08:15:58.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.372+0000 7f21e9c6b640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 0x7f21c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.372+0000 7f21e9c6b640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 0x7f21c806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21e40a4da0 tx=0x7f21e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.376+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21dc077310 con 0x7f21e40c59e0 2023-12-08T08:15:58.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.569+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21e40743e0 con 0x7f21e40c59e0 2023-12-08T08:15:58.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.570+0000 7f21da7fc640 1 -- 172.21.15.45:0/2180666171 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21dc07a930 con 0x7f21e40c59e0 2023-12-08T08:15:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:15:58.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 msgr2=0x7f21c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 0x7f21c806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21e40a4da0 tx=0x7f21e0008040 comp rx=0 tx=0).stop 2023-12-08T08:15:58.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 msgr2=0x7f21e41e9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21dc036040 tx=0x7f21dc004a40 comp rx=0 tx=0).stop 2023-12-08T08:15:58.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 shutdown_connections 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f21c806ae70 0x7f21c806d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21e40c59e0 0x7f21e41e9de0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21e406d1d0 0x7f21e406fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 --2- 172.21.15.45:0/2180666171 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f21e406bdd0 0x7f21e41ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.573+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 >> 172.21.15.45:0/2180666171 conn(0x7f21e4066ce0 msgr2=0x7f21e40bf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.574+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 shutdown_connections 2023-12-08T08:15:58.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.574+0000 7f21eac6d640 1 -- 172.21.15.45:0/2180666171 wait complete. 2023-12-08T08:15:58.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:15:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.826+0000 7f91a6fbc640 1 Processor -- start 2023-12-08T08:15:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.826+0000 7f91a6fbc640 1 -- start start 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91a0151ce0 0x7f91a00c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a00c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f91a00bf9b0 0x7f91a00c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a01544d0 con 0x7f91a0151ce0 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00bec80 con 0x7f91a00bf9b0 2023-12-08T08:15:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a6fbc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00bf520 con 0x7f91a006d8a0 2023-12-08T08:15:58.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a5fba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91a0151ce0 0x7f91a00c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a5fba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91a0151ce0 0x7f91a00c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34680/0 (socket says 172.21.15.45:34680) 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a5fba640 1 -- 172.21.15.45:0/3824033121 learned_addr learned my addr 172.21.15.45:0/3824033121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a57b9640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a00c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.828+0000 7f91a67bb640 1 --2- 172.21.15.45:0/3824033121 >> v2:172.21.15.114:3300/0 conn(0x7f91a00bf9b0 0x7f91a00c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.829+0000 7f91a5fba640 1 -- 172.21.15.45:0/3824033121 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 msgr2=0x7f91a00c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.829+0000 7f91a5fba640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a00c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.829+0000 7f91a5fba640 1 -- 172.21.15.45:0/3824033121 >> v2:172.21.15.114:3300/0 conn(0x7f91a00bf9b0 msgr2=0x7f91a00c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.829+0000 7f91a5fba640 1 --2- 172.21.15.45:0/3824033121 >> v2:172.21.15.114:3300/0 conn(0x7f91a00bf9b0 0x7f91a00c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.829+0000 7f91a5fba640 1 -- 172.21.15.45:0/3824033121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a01546e0 con 0x7f91a0151ce0 2023-12-08T08:15:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a5fba640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a0151ce0 0x7f91a00c22e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91a006ccc0 tx=0x7f919c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4921c0bbe9633bf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a4fb8640 1 -- 172.21.15.45:0/3824033121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c0317e0 con 0x7f91a0151ce0 2023-12-08T08:15:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a4fb8640 1 -- 172.21.15.45:0/3824033121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c031940 con 0x7f91a0151ce0 2023-12-08T08:15:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a4fb8640 1 -- 172.21.15.45:0/3824033121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c031cd0 con 0x7f91a0151ce0 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 -- 172.21.15.45:0/3824033121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a0151ce0 msgr2=0x7f91a00c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a0151ce0 0x7f91a00c22e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91a006ccc0 tx=0x7f919c02b880 comp rx=0 tx=0).stop 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 -- 172.21.15.45:0/3824033121 shutdown_connections 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/3824033121 >> v2:172.21.15.114:3300/0 conn(0x7f91a00bf9b0 0x7f91a00c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a00c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/3824033121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a0151ce0 0x7f91a00c22e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 -- 172.21.15.45:0/3824033121 >> 172.21.15.45:0/3824033121 conn(0x7f91a00661f0 msgr2=0x7f91a00665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 -- 172.21.15.45:0/3824033121 shutdown_connections 2023-12-08T08:15:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.831+0000 7f91a6fbc640 1 -- 172.21.15.45:0/3824033121 wait complete. 2023-12-08T08:15:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.833+0000 7f91a6fbc640 1 Processor -- start 2023-12-08T08:15:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.833+0000 7f91a6fbc640 1 -- start start 2023-12-08T08:15:58.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91a0151ce0 0x7f91a01ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01ede10 con 0x7f91a00bf9b0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0149da0 con 0x7f91a0151ce0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a6fbc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0149ff0 con 0x7f91a006d8a0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a57b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a57b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34688/0 (socket says 172.21.15.45:34688) 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.834+0000 7f91a57b9640 1 -- 172.21.15.45:0/977668127 learned_addr learned my addr 172.21.15.45:0/977668127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a5fba640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a67bb640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91a0151ce0 0x7f91a01ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 -- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 msgr2=0x7f91a014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a014eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 -- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91a0151ce0 msgr2=0x7f91a01ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91a0151ce0 0x7f91a01ed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 -- 172.21.15.45:0/977668127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0094d0 con 0x7f91a00bf9b0 2023-12-08T08:15:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91a57b9640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f919000e890 tx=0x7f919000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.835+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000c940 con 0x7f91a00bf9b0 2023-12-08T08:15:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.836+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000caa0 con 0x7f91a00bf9b0 2023-12-08T08:15:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.836+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000ce30 con 0x7f91a00bf9b0 2023-12-08T08:15:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.836+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a0157e40 con 0x7f91a00bf9b0 2023-12-08T08:15:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.836+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a0155840 con 0x7f91a00bf9b0 2023-12-08T08:15:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.837+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a00743e0 con 0x7f91a00bf9b0 2023-12-08T08:15:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.838+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9190013470 con 0x7f91a00bf9b0 2023-12-08T08:15:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.839+0000 7f91967fc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 0x7f918406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.839+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9190089bb0 con 0x7f91a00bf9b0 2023-12-08T08:15:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.839+0000 7f91a5fba640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 0x7f918406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.840+0000 7f91a5fba640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 0x7f918406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f919c036000 tx=0x7f919c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:58.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:58.843+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9190054890 con 0x7f91a00bf9b0 2023-12-08T08:15:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.045+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91a0072af0 con 0x7f91a00bf9b0 2023-12-08T08:15:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.046+0000 7f91967fc640 1 -- 172.21.15.45:0/977668127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9190017020 con 0x7f91a00bf9b0 2023-12-08T08:15:59.049 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:59.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 msgr2=0x7f918406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 0x7f918406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f919c036000 tx=0x7f919c03d040 comp rx=0 tx=0).stop 2023-12-08T08:15:59.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 msgr2=0x7f91a01ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f919000e890 tx=0x7f919000ed50 comp rx=0 tx=0).stop 2023-12-08T08:15:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 shutdown_connections 2023-12-08T08:15:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f918406ae70 0x7f918406d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91a0151ce0 0x7f91a01ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a00bf9b0 0x7f91a01ed390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 --2- 172.21.15.45:0/977668127 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f91a006d8a0 0x7f91a014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 >> 172.21.15.45:0/977668127 conn(0x7f91a00661f0 msgr2=0x7f91a014f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:59.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 shutdown_connections 2023-12-08T08:15:59.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.049+0000 7f91a6fbc640 1 -- 172.21.15.45:0/977668127 wait complete. 2023-12-08T08:15:59.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:15:59.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.303+0000 7f55030f1640 1 Processor -- start 2023-12-08T08:15:59.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.303+0000 7f55030f1640 1 -- start start 2023-12-08T08:15:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54fc151ad0 0x7f54fc0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 0x7f54fc154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc0ca610 0x7f54fc154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0c56a0 con 0x7f54fc151ad0 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc151eb0 con 0x7f54fc157a20 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.304+0000 7f55030f1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0c80d0 con 0x7f54fc0ca610 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54fc151ad0 0x7f54fc0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54fc151ad0 0x7f54fc0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34690/0 (socket says 172.21.15.45:34690) 2023-12-08T08:15:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 -- 172.21.15.45:0/50953342 learned_addr learned my addr 172.21.15.45:0/50953342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55028f0640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc0ca610 0x7f54fc154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55018ee640 1 --2- 172.21.15.45:0/50953342 >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 0x7f54fc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 -- 172.21.15.45:0/50953342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc0ca610 msgr2=0x7f54fc154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc0ca610 0x7f54fc154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 -- 172.21.15.45:0/50953342 >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 msgr2=0x7f54fc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 --2- 172.21.15.45:0/50953342 >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 0x7f54fc154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55020ef640 1 -- 172.21.15.45:0/50953342 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc154430 con 0x7f54fc151ad0 2023-12-08T08:15:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.305+0000 7f55018ee640 1 --2- 172.21.15.45:0/50953342 >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 0x7f54fc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.307+0000 7f55020ef640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc151ad0 0x7f54fc0ca0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0c7e90 tx=0x7f54f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60806440186b65bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.307+0000 7f55010ed640 1 -- 172.21.15.45:0/50953342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8031870 con 0x7f54fc151ad0 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.307+0000 7f55010ed640 1 -- 172.21.15.45:0/50953342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80319d0 con 0x7f54fc151ad0 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.307+0000 7f55010ed640 1 -- 172.21.15.45:0/50953342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8031d60 con 0x7f54fc151ad0 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 -- 172.21.15.45:0/50953342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc151ad0 msgr2=0x7f54fc0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc151ad0 0x7f54fc0ca0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0c7e90 tx=0x7f54f802b910 comp rx=0 tx=0).stop 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 -- 172.21.15.45:0/50953342 shutdown_connections 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 --2- 172.21.15.45:0/50953342 >> v2:172.21.15.114:3300/0 conn(0x7f54fc157a20 0x7f54fc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc0ca610 0x7f54fc154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 --2- 172.21.15.45:0/50953342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc151ad0 0x7f54fc0ca0d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 -- 172.21.15.45:0/50953342 >> 172.21.15.45:0/50953342 conn(0x7f54fc066610 msgr2=0x7f54fc066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 -- 172.21.15.45:0/50953342 shutdown_connections 2023-12-08T08:15:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.308+0000 7f55030f1640 1 -- 172.21.15.45:0/50953342 wait complete. 2023-12-08T08:15:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.310+0000 7f55030f1640 1 Processor -- start 2023-12-08T08:15:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.310+0000 7f55030f1640 1 -- start start 2023-12-08T08:15:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc151ad0 0x7f54fc146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 0x7f54fc147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0aade0 con 0x7f54fc0ca610 2023-12-08T08:15:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc14ce00 con 0x7f54fc157a20 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55030f1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1477a0 con 0x7f54fc151ad0 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55020ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55020ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34704/0 (socket says 172.21.15.45:34704) 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55020ef640 1 -- 172.21.15.45:0/3909170164 learned_addr learned my addr 172.21.15.45:0/3909170164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55018ee640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc151ad0 0x7f54fc146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.311+0000 7f55028f0640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 0x7f54fc147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 -- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc151ad0 msgr2=0x7f54fc146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc151ad0 0x7f54fc146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 -- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 msgr2=0x7f54fc147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 0x7f54fc147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 -- 172.21.15.45:0/3909170164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80094d0 con 0x7f54fc0ca610 2023-12-08T08:15:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55028f0640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 0x7f54fc147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:15:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55020ef640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097c0 tx=0x7f54f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8031820 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80443f0 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80447a0 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc14d610 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.312+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0c8ec0 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.313+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc150930 con 0x7f54fc0ca610 2023-12-08T08:15:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.314+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54f804d450 con 0x7f54fc0ca610 2023-12-08T08:15:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.315+0000 7f54f2ffd640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 0x7f54e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.316+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54f802d040 con 0x7f54fc0ca610 2023-12-08T08:15:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.316+0000 7f55018ee640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 0x7f54e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.316+0000 7f55018ee640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 0x7f54e006d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54fc157920 tx=0x7f54ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.320+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54f8076e00 con 0x7f54fc0ca610 2023-12-08T08:15:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.515+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54fc0c7a40 con 0x7f54fc0ca610 2023-12-08T08:15:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.516+0000 7f54f2ffd640 1 -- 172.21.15.45:0/3909170164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54f80350a0 con 0x7f54fc0ca610 2023-12-08T08:15:59.518 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:15:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 msgr2=0x7f54e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 0x7f54e006d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54fc157920 tx=0x7f54ec008040 comp rx=0 tx=0).stop 2023-12-08T08:15:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 msgr2=0x7f54fc0a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097c0 tx=0x7f54f80046c0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 shutdown_connections 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f54e006ae40 0x7f54e006d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f54fc151ad0 0x7f54fc146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54fc157a20 0x7f54fc147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 --2- 172.21.15.45:0/3909170164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54fc0ca610 0x7f54fc0a9fe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 >> 172.21.15.45:0/3909170164 conn(0x7f54fc066610 msgr2=0x7f54fc149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 shutdown_connections 2023-12-08T08:15:59.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.519+0000 7f55030f1640 1 -- 172.21.15.45:0/3909170164 wait complete. 2023-12-08T08:15:59.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:15:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.763+0000 7fe012153640 1 Processor -- start 2023-12-08T08:15:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.763+0000 7fe012153640 1 -- start start 2023-12-08T08:15:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.764+0000 7fe012153640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.764+0000 7fe012153640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe00c06d960 0x7fe00c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe012153640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c152660 con 0x7fe00c0c1930 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe012153640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0a4d10 con 0x7fe00c06d960 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe012153640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c3310 con 0x7fe00c0aaf60 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe00bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe00c0c1930 0x7fe00c1558b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44788/0 (socket says 172.21.15.45:44788) 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe00bfff640 1 -- 172.21.15.45:0/4174996303 learned_addr learned my addr 172.21.15.45:0/4174996303 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:15:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe00affd640 1 --2- 172.21.15.45:0/4174996303 >> v2:172.21.15.45:3300/0 conn(0x7fe00c06d960 0x7fe00c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.765+0000 7fe00b7fe640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.766+0000 7fe00affd640 1 -- 172.21.15.45:0/4174996303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 msgr2=0x7fe00c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.766+0000 7fe00affd640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c0c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.766+0000 7fe00affd640 1 -- 172.21.15.45:0/4174996303 >> v1:172.21.15.45:6789/0 conn(0x7fe00c0c1930 legacy=0x7fe00c1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.766+0000 7fe00affd640 1 -- 172.21.15.45:0/4174996303 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0a4ef0 con 0x7fe00c06d960 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.766+0000 7fe00a7fc640 1 -- 172.21.15.45:0/4174996303 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694926416 0 0) 0x7fe00c152660 con 0x7fe00c0c1930 2023-12-08T08:15:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.767+0000 7fe00affd640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c06d960 0x7fe00c152af0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe00002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e505efe63d811d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.767+0000 7fe00a7fc640 1 -- 172.21.15.45:0/4174996303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00002e070 con 0x7fe00c06d960 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.767+0000 7fe00a7fc640 1 -- 172.21.15.45:0/4174996303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000315a0 con 0x7fe00c06d960 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.767+0000 7fe00a7fc640 1 -- 172.21.15.45:0/4174996303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000031930 con 0x7fe00c06d960 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 -- 172.21.15.45:0/4174996303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c06d960 msgr2=0x7fe00c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c06d960 0x7fe00c152af0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe00002b840 comp rx=0 tx=0).stop 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 -- 172.21.15.45:0/4174996303 shutdown_connections 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c06d960 0x7fe00c152af0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 --2- 172.21.15.45:0/4174996303 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 -- 172.21.15.45:0/4174996303 >> 172.21.15.45:0/4174996303 conn(0x7fe00c0c2430 msgr2=0x7fe00c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 -- 172.21.15.45:0/4174996303 shutdown_connections 2023-12-08T08:15:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.768+0000 7fe012153640 1 -- 172.21.15.45:0/4174996303 wait complete. 2023-12-08T08:15:59.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.770+0000 7fe012153640 1 Processor -- start 2023-12-08T08:15:59.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.770+0000 7fe012153640 1 -- start start 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c06d960 0x7fe00c1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c1f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c14dd80 con 0x7fe00c0c1930 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c68a0 con 0x7fe00c06d960 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe012153640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0a2c70 con 0x7fe00c0aaf60 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe00bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34714/0 (socket says 172.21.15.45:34714) 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.771+0000 7fe00bfff640 1 -- 172.21.15.45:0/2055202138 learned_addr learned my addr 172.21.15.45:0/2055202138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:15:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00affd640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c1f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00b7fe640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c06d960 0x7fe00c1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 -- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 msgr2=0x7fe00c1f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c1f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 -- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c06d960 msgr2=0x7fe00c1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c06d960 0x7fe00c1f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 -- 172.21.15.45:0/2055202138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000009400 con 0x7fe00c0c1930 2023-12-08T08:15:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fe00bfff640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c410 tx=0x7fe00400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040074e0 con 0x7fe00c0c1930 2023-12-08T08:15:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004007640 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.772+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004004a20 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.773+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c14e020 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.773+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0a2ec0 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.774+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c06cb00 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.775+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe004004b80 con 0x7fe00c0c1930 2023-12-08T08:15:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.776+0000 7fdff3fff640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 0x7fdff806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:15:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.776+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe004089750 con 0x7fe00c0c1930 2023-12-08T08:15:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.776+0000 7fe00b7fe640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 0x7fdff806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:15:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.777+0000 7fe00b7fe640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 0x7fdff806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009a60 tx=0x7fdffc003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:15:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.780+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe004054430 con 0x7fe00c0c1930 2023-12-08T08:15:59.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.975+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe00c14e1b0 con 0x7fe00c0c1930 2023-12-08T08:15:59.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.976+0000 7fdff3fff640 1 -- 172.21.15.45:0/2055202138 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe004001060 con 0x7fe00c0c1930 2023-12-08T08:15:59.978 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:15:59.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 msgr2=0x7fdff806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 0x7fdff806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009a60 tx=0x7fdffc003990 comp rx=0 tx=0).stop 2023-12-08T08:15:59.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 msgr2=0x7fe00c14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:15:59.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c410 tx=0x7fe00400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 shutdown_connections 2023-12-08T08:15:59.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdff806ae40 0x7fdff806d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe00c0aaf60 0x7fe00c1f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe00c0c1930 0x7fe00c14e4b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 --2- 172.21.15.45:0/2055202138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00c06d960 0x7fe00c1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:15:59.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 >> 172.21.15.45:0/2055202138 conn(0x7fe00c0c2430 msgr2=0x7fe00c06ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:15:59.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 shutdown_connections 2023-12-08T08:15:59.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:15:59.979+0000 7fe012153640 1 -- 172.21.15.45:0/2055202138 wait complete. 2023-12-08T08:16:00.039 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-08T08:16:00.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.271+0000 7f456f1c1640 1 Processor -- start 2023-12-08T08:16:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.272+0000 7f456f1c1640 1 -- start start 2023-12-08T08:16:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.273+0000 7f456f1c1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45680a7910 0x7f45680c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.273+0000 7f456f1c1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45680c1dc0 0x7f456814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.273+0000 7f456f1c1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4568155850 con 0x7f45681521b0 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.273+0000 7f456f1c1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680c0890 con 0x7f45680a7910 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.273+0000 7f456f1c1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680c0b70 con 0x7f45680c1dc0 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e9c0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45681521b0 0x7f4568155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44794/0 (socket says 172.21.15.45:44794) 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e9c0640 1 -- 172.21.15.45:0/284277070 learned_addr learned my addr 172.21.15.45:0/284277070 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e1bf640 1 --2- 172.21.15.45:0/284277070 >> v2:172.21.15.45:3300/0 conn(0x7f45680a7910 0x7f45680c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456d9be640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45680c1dc0 0x7f456814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456d1bd640 1 -- 172.21.15.45:0/284277070 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006564628 0 0) 0x7f4568155850 con 0x7f45681521b0 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e1bf640 1 -- 172.21.15.45:0/284277070 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45680c1dc0 msgr2=0x7f456814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e1bf640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45680c1dc0 0x7f456814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e1bf640 1 -- 172.21.15.45:0/284277070 >> v1:172.21.15.45:6789/0 conn(0x7f45681521b0 legacy=0x7f4568155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.274+0000 7f456e1bf640 1 -- 172.21.15.45:0/284277070 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680c0e50 con 0x7f45680a7910 2023-12-08T08:16:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.275+0000 7f456e1bf640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f45680c1880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45640097a0 tx=0x7f456402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0902384abdee4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456d1bd640 1 -- 172.21.15.45:0/284277070 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456402e070 con 0x7f45680a7910 2023-12-08T08:16:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456d1bd640 1 -- 172.21.15.45:0/284277070 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45640315a0 con 0x7f45680a7910 2023-12-08T08:16:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456d1bd640 1 -- 172.21.15.45:0/284277070 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564031930 con 0x7f45680a7910 2023-12-08T08:16:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 -- 172.21.15.45:0/284277070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 msgr2=0x7f45680c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f45680c1880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45640097a0 tx=0x7f456402b840 comp rx=0 tx=0).stop 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 -- 172.21.15.45:0/284277070 shutdown_connections 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45680c1dc0 0x7f456814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 --2- 172.21.15.45:0/284277070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f45680c1880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.276+0000 7f456f1c1640 1 -- 172.21.15.45:0/284277070 >> 172.21.15.45:0/284277070 conn(0x7f45680c5780 msgr2=0x7f45680c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.277+0000 7f456f1c1640 1 -- 172.21.15.45:0/284277070 shutdown_connections 2023-12-08T08:16:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.277+0000 7f456f1c1640 1 -- 172.21.15.45:0/284277070 wait complete. 2023-12-08T08:16:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.278+0000 7f456f1c1640 1 Processor -- start 2023-12-08T08:16:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.279+0000 7f456f1c1640 1 -- start start 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.279+0000 7f456f1c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.279+0000 7f456f1c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45680c1dc0 0x7f45681dcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456f1c1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45681521b0 0x7f456814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456f1c1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680a4e80 con 0x7f45680a7910 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456f1c1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680a6e30 con 0x7f45680c1dc0 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456f1c1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456814e970 con 0x7f45681521b0 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34738/0 (socket says 172.21.15.45:34738) 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 -- 172.21.15.45:0/675178948 learned_addr learned my addr 172.21.15.45:0/675178948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 -- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45681521b0 msgr2=0x7f456814dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45681521b0 0x7f456814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 -- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45680c1dc0 msgr2=0x7f45681dcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45680c1dc0 0x7f45681dcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.280+0000 7f456e1bf640 1 -- 172.21.15.45:0/675178948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564009400 con 0x7f45680a7910 2023-12-08T08:16:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f456e1bf640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4564000c00 tx=0x7f45640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564032900 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564032a80 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680a5090 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564032e30 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.281+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45681dd530 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.282+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45680a72c0 con 0x7f45680a7910 2023-12-08T08:16:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.283+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f456404d3f0 con 0x7f45680a7910 2023-12-08T08:16:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.285+0000 7f455effd640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 0x7f454c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.285+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f45640ab5f0 con 0x7f45680a7910 2023-12-08T08:16:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.285+0000 7f456d9be640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 0x7f454c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.286+0000 7f456d9be640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 0x7f454c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45680a5700 tx=0x7f4558008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.289+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45680a72c0 con 0x7f45680a7910 2023-12-08T08:16:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.491+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45680a72c0 con 0x7f45680a7910 2023-12-08T08:16:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.494+0000 7f455effd640 1 -- 172.21.15.45:0/675178948 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f45680a72c0 con 0x7f45680a7910 2023-12-08T08:16:00.496 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:00.496 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 msgr2=0x7f454c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 0x7f454c06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f45680a5700 tx=0x7f4558008040 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 msgr2=0x7f456814ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4564000c00 tx=0x7f45640046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 shutdown_connections 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f454c06ae70 0x7f454c06d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45681521b0 0x7f456814dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45680c1dc0 0x7f45681dcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 --2- 172.21.15.45:0/675178948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45680a7910 0x7f456814ec50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 >> 172.21.15.45:0/675178948 conn(0x7f45680c5780 msgr2=0x7f4568150530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 shutdown_connections 2023-12-08T08:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.497+0000 7f456f1c1640 1 -- 172.21.15.45:0/675178948 wait complete. 2023-12-08T08:16:00.519 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:16:00.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.745+0000 7f0838ce6640 1 Processor -- start 2023-12-08T08:16:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.745+0000 7f0838ce6640 1 -- start start 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0838ce6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f083414c280 0x7f08340a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0838ce6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f083406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0838ce6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08340c60c0 con 0x7f083406d3e0 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0838ce6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0834152dc0 con 0x7f083414c280 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0838ce6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08341521d0 con 0x7f08340c4970 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0833fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f083406d3e0 0x7f0834155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44798/0 (socket says 172.21.15.45:44798) 2023-12-08T08:16:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0833fff640 1 -- 172.21.15.45:0/2414282676 learned_addr learned my addr 172.21.15.45:0/2414282676 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f0832ffd640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f083406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.747+0000 7f08337fe640 1 --2- 172.21.15.45:0/2414282676 >> v2:172.21.15.114:3300/0 conn(0x7f083414c280 0x7f08340a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079000196 0 0) 0x7f082c001110 con 0x7f083406d3e0 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0820003520 con 0x7f083406d3e0 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992453681 0 0) 0x7f0820003520 con 0x7f083406d3e0 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 msgr2=0x7f083406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f083406cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 >> v2:172.21.15.114:3300/0 conn(0x7f083414c280 msgr2=0x7f08340a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 --2- 172.21.15.45:0/2414282676 >> v2:172.21.15.114:3300/0 conn(0x7f083414c280 0x7f08340a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083414c660 con 0x7f083406d3e0 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f082c001800 con 0x7f083406d3e0 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 >> v1:172.21.15.45:6789/0 conn(0x7f083406d3e0 legacy=0x7f0834155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0820003970 0x7f0820003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f08200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f0820005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834152dc0 con 0x7f0820004d00 2023-12-08T08:16:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08341521d0 con 0x7f0820003970 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.748+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082000b980 con 0x7f08340c4970 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f0820005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f08337fe640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0820003970 0x7f0820003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0832ffd640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f08200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 -- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 msgr2=0x7f08200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f08200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 -- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0820003970 msgr2=0x7f0820003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0820003970 0x7f0820003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0833fff640 1 -- 172.21.15.45:0/2414282676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820003520 con 0x7f0820004d00 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f08337fe640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0820003970 0x7f0820003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.749+0000 7f0832ffd640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08340c4970 0x7f08200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.750+0000 7f0833fff640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f0820005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c210 tx=0x7f08200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8b820897e9891 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c005ad0 con 0x7f0820004d00 2023-12-08T08:16:00.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c005c30 con 0x7f0820004d00 2023-12-08T08:16:00.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f08327fc640 1 -- 172.21.15.45:0/2414282676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c02c8d0 con 0x7f0820004d00 2023-12-08T08:16:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 -- 172.21.15.45:0/2414282676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 msgr2=0x7f0820005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 --2- 172.21.15.45:0/2414282676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f0820005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f082c00c210 tx=0x7f08200057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0833fff640 1 -- 172.21.15.45:0/2414282676 reap_dead start 2023-12-08T08:16:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 -- 172.21.15.45:0/2414282676 shutdown_connections 2023-12-08T08:16:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 -- 172.21.15.45:0/2414282676 >> 172.21.15.45:0/2414282676 conn(0x7f0834066ce0 msgr2=0x7f08340a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 -- 172.21.15.45:0/2414282676 shutdown_connections 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.751+0000 7f0838ce6640 1 -- 172.21.15.45:0/2414282676 wait complete. 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.753+0000 7f0838ce6640 1 Processor -- start 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.753+0000 7f0838ce6640 1 -- start start 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f083414b3a0 0x7f08340a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08341eabd0 0x7f08340a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340a71a0 con 0x7f0820004d00 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0834149aa0 con 0x7f08341eabd0 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.754+0000 7f0838ce6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083414cdf0 con 0x7f083414b3a0 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34756/0 (socket says 172.21.15.45:34756) 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 -- 172.21.15.45:0/1482606624 learned_addr learned my addr 172.21.15.45:0/1482606624 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 -- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f083414b3a0 msgr2=0x7f08340a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f083414b3a0 0x7f08340a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 -- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08341eabd0 msgr2=0x7f08340a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08341eabd0 0x7f08340a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.755+0000 7f08337fe640 1 -- 172.21.15.45:0/1482606624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08341eb150 con 0x7f0820004d00 2023-12-08T08:16:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.756+0000 7f08337fe640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0824007f30 tx=0x7f0824010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.758+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082400e050 con 0x7f0820004d00 2023-12-08T08:16:00.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.758+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082400f040 con 0x7f0820004d00 2023-12-08T08:16:00.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.758+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0824003bb0 con 0x7f0820004d00 2023-12-08T08:16:00.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.758+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08341eb410 con 0x7f0820004d00 2023-12-08T08:16:00.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.758+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08341eb9d0 con 0x7f0820004d00 2023-12-08T08:16:00.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.760+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08340678c0 con 0x7f0820004d00 2023-12-08T08:16:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.760+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0824003d10 con 0x7f0820004d00 2023-12-08T08:16:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.761+0000 7f082bfff640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 0x7f081406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.761+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f082408a660 con 0x7f0820004d00 2023-12-08T08:16:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.762+0000 7f0832ffd640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 0x7f081406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.763+0000 7f0832ffd640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 0x7f081406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08341538c0 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.766+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08240553e0 con 0x7f0820004d00 2023-12-08T08:16:00.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.959+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08340743e0 con 0x7f0820004d00 2023-12-08T08:16:00.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.961+0000 7f082bfff640 1 -- 172.21.15.45:0/1482606624 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0824058a00 con 0x7f0820004d00 2023-12-08T08:16:00.962 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 msgr2=0x7f081406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 0x7f081406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08341538c0 tx=0x7f081c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 msgr2=0x7f083414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0824007f30 tx=0x7f0824010650 comp rx=0 tx=0).stop 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 shutdown_connections 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f081406ae40 0x7f081406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f083414b3a0 0x7f08340a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.963+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08341eabd0 0x7f08340a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.964+0000 7f0838ce6640 1 --2- 172.21.15.45:0/1482606624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0820004d00 0x7f083414ae60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.964+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 >> 172.21.15.45:0/1482606624 conn(0x7f0834066ce0 msgr2=0x7f0834148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.964+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 shutdown_connections 2023-12-08T08:16:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:00.964+0000 7f0838ce6640 1 -- 172.21.15.45:0/1482606624 wait complete. 2023-12-08T08:16:00.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.205+0000 7f1404de6640 1 Processor -- start 2023-12-08T08:16:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.205+0000 7f1404de6640 1 -- start start 2023-12-08T08:16:01.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f1404de6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f1404de6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1400155790 0x7f1400155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f1404de6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14000c60c0 con 0x7f140014c280 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f1404de6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1400152dc0 con 0x7f1400155790 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f1404de6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14001521d0 con 0x7f14000c4970 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f13ff7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f140014c280 0x7f140006cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44808/0 (socket says 172.21.15.45:44808) 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f13ff7fe640 1 -- 172.21.15.45:0/2863525972 learned_addr learned my addr 172.21.15.45:0/2863525972 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.207+0000 7f13fffff640 1 --2- 172.21.15.45:0/2863525972 >> v2:172.21.15.45:3300/0 conn(0x7f1400155790 0x7f1400155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13f6ffd640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13feffd640 1 -- 172.21.15.45:0/2863525972 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678056108 0 0) 0x7f13f0001490 con 0x7f140014c280 2023-12-08T08:16:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13feffd640 1 -- 172.21.15.45:0/2863525972 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13ec003520 con 0x7f140014c280 2023-12-08T08:16:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13fffff640 1 -- 172.21.15.45:0/2863525972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 msgr2=0x7f14000a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13fffff640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13fffff640 1 -- 172.21.15.45:0/2863525972 >> v1:172.21.15.45:6789/0 conn(0x7f140014c280 legacy=0x7f140006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.208+0000 7f13fffff640 1 -- 172.21.15.45:0/2863525972 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140014c660 con 0x7f1400155790 2023-12-08T08:16:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.209+0000 7f13fffff640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1400155790 0x7f1400155c00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097a0 tx=0x7f13f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1190834f86f7f726 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f13feffd640 1 -- 172.21.15.45:0/2863525972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f802e070 con 0x7f1400155790 2023-12-08T08:16:01.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f13feffd640 1 -- 172.21.15.45:0/2863525972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f80315a0 con 0x7f1400155790 2023-12-08T08:16:01.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f13feffd640 1 -- 172.21.15.45:0/2863525972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8031930 con 0x7f1400155790 2023-12-08T08:16:01.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 -- 172.21.15.45:0/2863525972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1400155790 msgr2=0x7f1400155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1400155790 0x7f1400155c00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097a0 tx=0x7f13f802b840 comp rx=0 tx=0).stop 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 -- 172.21.15.45:0/2863525972 shutdown_connections 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1400155790 0x7f1400155c00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 --2- 172.21.15.45:0/2863525972 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.210+0000 7f1404de6640 1 -- 172.21.15.45:0/2863525972 >> 172.21.15.45:0/2863525972 conn(0x7f1400066ce0 msgr2=0x7f14000a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.211+0000 7f1404de6640 1 -- 172.21.15.45:0/2863525972 shutdown_connections 2023-12-08T08:16:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.211+0000 7f1404de6640 1 -- 172.21.15.45:0/2863525972 wait complete. 2023-12-08T08:16:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.212+0000 7f1404de6640 1 Processor -- start 2023-12-08T08:16:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.213+0000 7f1404de6640 1 -- start start 2023-12-08T08:16:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 0x7f1400071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a5bd0 con 0x7f140014c280 2023-12-08T08:16:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000704a0 con 0x7f1400155790 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f1404de6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a59e0 con 0x7f14000c4970 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13f6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13f6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34778/0 (socket says 172.21.15.45:34778) 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13f6ffd640 1 -- 172.21.15.45:0/3430005002 learned_addr learned my addr 172.21.15.45:0/3430005002 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13ff7fe640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13fffff640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 0x7f1400071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.214+0000 7f13f6ffd640 1 -- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 msgr2=0x7f14000a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13f6ffd640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13f6ffd640 1 -- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 msgr2=0x7f1400071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13f6ffd640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 0x7f1400071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13f6ffd640 1 -- 172.21.15.45:0/3430005002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8009400 con 0x7f140014c280 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13ff7fe640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13fffff640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 0x7f1400071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13f6ffd640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f13e800d5f0 tx=0x7f13e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e80125f0 con 0x7f140014c280 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e8012750 con 0x7f140014c280 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8012b00 con 0x7f140014c280 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140014ba00 con 0x7f140014c280 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.215+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140006f950 con 0x7f140014c280 2023-12-08T08:16:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.217+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1400072030 con 0x7f140014c280 2023-12-08T08:16:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.217+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13e8012c60 con 0x7f140014c280 2023-12-08T08:16:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.218+0000 7f13fcff9640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 0x7f13e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.218+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f13e8089de0 con 0x7f140014c280 2023-12-08T08:16:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.219+0000 7f13ff7fe640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 0x7f13e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.219+0000 7f13ff7fe640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 0x7f13e006d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13f00016f0 tx=0x7f13f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.223+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13e8054b60 con 0x7f140014c280 2023-12-08T08:16:01.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.420+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14000678c0 con 0x7f140014c280 2023-12-08T08:16:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.421+0000 7f13fcff9640 1 -- 172.21.15.45:0/3430005002 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13e8058180 con 0x7f140014c280 2023-12-08T08:16:01.423 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 msgr2=0x7f13e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 0x7f13e006d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13f00016f0 tx=0x7f13f0009040 comp rx=0 tx=0).stop 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 msgr2=0x7f14000715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f13e800d5f0 tx=0x7f13e800dab0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 shutdown_connections 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f13e006ae40 0x7f13e006d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1400155790 0x7f1400071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f140014c280 0x7f14000715b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 --2- 172.21.15.45:0/3430005002 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14000c4970 0x7f14000a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 >> 172.21.15.45:0/3430005002 conn(0x7f1400066ce0 msgr2=0x7f14000c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 shutdown_connections 2023-12-08T08:16:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.424+0000 7f1404de6640 1 -- 172.21.15.45:0/3430005002 wait complete. 2023-12-08T08:16:01.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:01.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.668+0000 7fac366da640 1 Processor -- start 2023-12-08T08:16:01.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.668+0000 7fac366da640 1 -- start start 2023-12-08T08:16:01.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac30151c20 0x7fac300c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac300c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 0x7fac30154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac301589d0 con 0x7fac30151c20 2023-12-08T08:16:01.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300c50e0 con 0x7fac300c4c50 2023-12-08T08:16:01.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.669+0000 7fac366da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300c71b0 con 0x7fac300c81d0 2023-12-08T08:16:01.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac30151c20 0x7fac300c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac30151c20 0x7fac300c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34794/0 (socket says 172.21.15.45:34794) 2023-12-08T08:16:01.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 -- 172.21.15.45:0/2597925123 learned_addr learned my addr 172.21.15.45:0/2597925123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac34c77640 1 --2- 172.21.15.45:0/2597925123 >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 0x7fac30154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac300c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 -- 172.21.15.45:0/2597925123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 msgr2=0x7fac300c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac300c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 -- 172.21.15.45:0/2597925123 >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 msgr2=0x7fac30154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.670+0000 7fac2ffff640 1 --2- 172.21.15.45:0/2597925123 >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 0x7fac30154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.671+0000 7fac2ffff640 1 -- 172.21.15.45:0/2597925123 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30157dc0 con 0x7fac30151c20 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.671+0000 7fac34c77640 1 --2- 172.21.15.45:0/2597925123 >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 0x7fac30154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.671+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac300c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:01.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.672+0000 7fac2ffff640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac300c7c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac300c4190 tx=0x7fac2002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d0e5ad01ecad91 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.672+0000 7fac2effd640 1 -- 172.21.15.45:0/2597925123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200317d0 con 0x7fac30151c20 2023-12-08T08:16:01.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.672+0000 7fac2effd640 1 -- 172.21.15.45:0/2597925123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20031930 con 0x7fac30151c20 2023-12-08T08:16:01.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.672+0000 7fac2effd640 1 -- 172.21.15.45:0/2597925123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20031cc0 con 0x7fac30151c20 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 -- 172.21.15.45:0/2597925123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 msgr2=0x7fac300c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac300c7c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac300c4190 tx=0x7fac2002b870 comp rx=0 tx=0).stop 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 -- 172.21.15.45:0/2597925123 shutdown_connections 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 --2- 172.21.15.45:0/2597925123 >> v2:172.21.15.114:3300/0 conn(0x7fac300c4c50 0x7fac30154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac300c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 --2- 172.21.15.45:0/2597925123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac300c7c90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 -- 172.21.15.45:0/2597925123 >> 172.21.15.45:0/2597925123 conn(0x7fac300ab920 msgr2=0x7fac300abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 -- 172.21.15.45:0/2597925123 shutdown_connections 2023-12-08T08:16:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.673+0000 7fac366da640 1 -- 172.21.15.45:0/2597925123 wait complete. 2023-12-08T08:16:01.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.675+0000 7fac366da640 1 Processor -- start 2023-12-08T08:16:01.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.675+0000 7fac366da640 1 -- start start 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 0x7fac300c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac30154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3014c720 con 0x7fac30151c20 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3014c3f0 con 0x7fac300c4c50 2023-12-08T08:16:01.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.676+0000 7fac366da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac30155ad0 con 0x7fac300c81d0 2023-12-08T08:16:01.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34810/0 (socket says 172.21.15.45:34810) 2023-12-08T08:16:01.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 -- 172.21.15.45:0/673771010 learned_addr learned my addr 172.21.15.45:0/673771010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac30154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac2ffff640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 0x7fac300c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 -- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 msgr2=0x7fac30154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac30154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 -- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 msgr2=0x7fac300c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 0x7fac300c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac34c77640 1 -- 172.21.15.45:0/673771010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200094d0 con 0x7fac30151c20 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.677+0000 7fac2ffff640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 0x7fac300c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac34c77640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac2800cef0 tx=0x7fac2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800d840 con 0x7fac30151c20 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800d9a0 con 0x7fac30151c20 2023-12-08T08:16:01.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800dd50 con 0x7fac30151c20 2023-12-08T08:16:01.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac30153050 con 0x7fac30151c20 2023-12-08T08:16:01.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.678+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30155460 con 0x7fac30151c20 2023-12-08T08:16:01.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.679+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac30074670 con 0x7fac30151c20 2023-12-08T08:16:01.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.680+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac2801e3b0 con 0x7fac30151c20 2023-12-08T08:16:01.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.681+0000 7fac2cff9640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 0x7fac1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:01.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.681+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac2808a430 con 0x7fac30151c20 2023-12-08T08:16:01.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.682+0000 7fac2ffff640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 0x7fac1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:01.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.682+0000 7fac2ffff640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 0x7fac1c06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac20036000 tx=0x7fac2003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:01.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.686+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac28055110 con 0x7fac30151c20 2023-12-08T08:16:01.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.882+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac30152380 con 0x7fac30151c20 2023-12-08T08:16:01.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.882+0000 7fac2cff9640 1 -- 172.21.15.45:0/673771010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac28058730 con 0x7fac30151c20 2023-12-08T08:16:01.884 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 msgr2=0x7fac1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 0x7fac1c06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac20036000 tx=0x7fac2003d040 comp rx=0 tx=0).stop 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 msgr2=0x7fac3014cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac2800cef0 tx=0x7fac2800a710 comp rx=0 tx=0).stop 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 shutdown_connections 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fac1c06ae40 0x7fac1c06d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fac300c81d0 0x7fac30154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30151c20 0x7fac3014cbb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 --2- 172.21.15.45:0/673771010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac300c4c50 0x7fac300c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:01.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 >> 172.21.15.45:0/673771010 conn(0x7fac300ab920 msgr2=0x7fac300c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:01.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 shutdown_connections 2023-12-08T08:16:01.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:01.885+0000 7fac366da640 1 -- 172.21.15.45:0/673771010 wait complete. 2023-12-08T08:16:01.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:16:02.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.132+0000 7f162759e640 1 Processor -- start 2023-12-08T08:16:02.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.132+0000 7f162759e640 1 -- start start 2023-12-08T08:16:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.133+0000 7f162759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f162814c280 0x7f16280a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.133+0000 7f162759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c60c0 con 0x7f16280c4970 2023-12-08T08:16:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.134+0000 7f162759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1628152dc0 con 0x7f1628155790 2023-12-08T08:16:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.134+0000 7f162759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16281521d0 con 0x7f162814c280 2023-12-08T08:16:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.134+0000 7f161ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16280c4970 0x7f162806cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44818/0 (socket says 172.21.15.45:44818) 2023-12-08T08:16:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.134+0000 7f161ffff640 1 -- 172.21.15.45:0/2787655170 learned_addr learned my addr 172.21.15.45:0/2787655170 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.134+0000 7f162659c640 1 --2- 172.21.15.45:0/2787655170 >> v2:172.21.15.45:3300/0 conn(0x7f162814c280 0x7f16280a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.135+0000 7f1625d9b640 1 -- 172.21.15.45:0/2787655170 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102167493 0 0) 0x7f1610001110 con 0x7f16280c4970 2023-12-08T08:16:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.135+0000 7f1625d9b640 1 -- 172.21.15.45:0/2787655170 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1614003520 con 0x7f16280c4970 2023-12-08T08:16:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.135+0000 7f162659c640 1 -- 172.21.15.45:0/2787655170 >> v1:172.21.15.114:6789/0 conn(0x7f1628155790 legacy=0x7f1628155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.135+0000 7f162659c640 1 -- 172.21.15.45:0/2787655170 >> v1:172.21.15.45:6789/0 conn(0x7f16280c4970 legacy=0x7f162806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.135+0000 7f162659c640 1 -- 172.21.15.45:0/2787655170 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162814c660 con 0x7f162814c280 2023-12-08T08:16:02.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.136+0000 7f162659c640 1 --2- 172.21.15.45:0/2787655170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f162814c280 0x7f16280a4d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f16180097a0 tx=0x7f161802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea932a4b1d4dcdd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.136+0000 7f1625d9b640 1 -- 172.21.15.45:0/2787655170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031830 con 0x7f162814c280 2023-12-08T08:16:02.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.136+0000 7f1625d9b640 1 -- 172.21.15.45:0/2787655170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618031990 con 0x7f162814c280 2023-12-08T08:16:02.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.136+0000 7f1625d9b640 1 -- 172.21.15.45:0/2787655170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031d20 con 0x7f162814c280 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 -- 172.21.15.45:0/2787655170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f162814c280 msgr2=0x7f16280a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 --2- 172.21.15.45:0/2787655170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f162814c280 0x7f16280a4d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f16180097a0 tx=0x7f161802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 -- 172.21.15.45:0/2787655170 shutdown_connections 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 --2- 172.21.15.45:0/2787655170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f162814c280 0x7f16280a4d10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 -- 172.21.15.45:0/2787655170 >> 172.21.15.45:0/2787655170 conn(0x7f1628066ce0 msgr2=0x7f16280a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 -- 172.21.15.45:0/2787655170 shutdown_connections 2023-12-08T08:16:02.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.137+0000 7f162759e640 1 -- 172.21.15.45:0/2787655170 wait complete. 2023-12-08T08:16:02.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.139+0000 7f162759e640 1 Processor -- start 2023-12-08T08:16:02.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.139+0000 7f162759e640 1 -- start start 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162814c280 0x7f1628154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1628155790 0x7f16280a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280a63c0 con 0x7f16280c4970 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162814ad40 con 0x7f162814c280 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162814b020 con 0x7f1628155790 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34826/0 (socket says 172.21.15.45:34826) 2023-12-08T08:16:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.140+0000 7f162659c640 1 -- 172.21.15.45:0/827402858 learned_addr learned my addr 172.21.15.45:0/827402858 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:02.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 -- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1628155790 msgr2=0x7f16280a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1628155790 0x7f16280a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 -- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162814c280 msgr2=0x7f1628154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162814c280 0x7f1628154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 -- 172.21.15.45:0/827402858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009400 con 0x7f16280c4970 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162659c640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1618034040 tx=0x7f16180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161803a8f0 con 0x7f16280c4970 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161803aa70 con 0x7f16280c4970 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161803ae20 con 0x7f16280c4970 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.141+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162814b300 con 0x7f16280c4970 2023-12-08T08:16:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.142+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628155000 con 0x7f16280c4970 2023-12-08T08:16:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.143+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280678c0 con 0x7f16280c4970 2023-12-08T08:16:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.144+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f161804d440 con 0x7f16280c4970 2023-12-08T08:16:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.145+0000 7f161effd640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 0x7f160806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.145+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16180abb00 con 0x7f16280c4970 2023-12-08T08:16:02.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.145+0000 7f161ffff640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 0x7f160806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.146+0000 7f161ffff640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 0x7f160806d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1610005880 tx=0x7f1610001150 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.149+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16180ade60 con 0x7f16280c4970 2023-12-08T08:16:02.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.342+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f16280743e0 con 0x7f16280c4970 2023-12-08T08:16:02.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.343+0000 7f161effd640 1 -- 172.21.15.45:0/827402858 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1618035020 con 0x7f16280c4970 2023-12-08T08:16:02.345 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 msgr2=0x7f160806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 0x7f160806d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1610005880 tx=0x7f1610001150 comp rx=0 tx=0).stop 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 msgr2=0x7f16281eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1618034040 tx=0x7f16180046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 shutdown_connections 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f160806aec0 0x7f160806d380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1628155790 0x7f16280a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162814c280 0x7f1628154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 --2- 172.21.15.45:0/827402858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16280c4970 0x7f16281eda10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 >> 172.21.15.45:0/827402858 conn(0x7f1628066ce0 msgr2=0x7f16280bf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:02.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 shutdown_connections 2023-12-08T08:16:02.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.346+0000 7f162759e640 1 -- 172.21.15.45:0/827402858 wait complete. 2023-12-08T08:16:02.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-08T08:16:02.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.593+0000 7feb99a02640 1 Processor -- start 2023-12-08T08:16:02.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.593+0000 7feb99a02640 1 -- start start 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb99a02640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb941519c0 0x7feb941584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb99a02640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 0x7feb940ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb99a02640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940c4a00 con 0x7feb940c44d0 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb99a02640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940c4ce0 con 0x7feb941519c0 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb99a02640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941579e0 con 0x7feb940c7a50 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb98a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb941519c0 0x7feb941584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb93fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb940c44d0 0x7feb94154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44828/0 (socket says 172.21.15.45:44828) 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.595+0000 7feb93fff640 1 -- 172.21.15.45:0/729665945 learned_addr learned my addr 172.21.15.45:0/729665945 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb99201640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 0x7feb940ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb98a00640 1 -- 172.21.15.45:0/729665945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 msgr2=0x7feb940ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:02.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb98a00640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 0x7feb940ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb98a00640 1 -- 172.21.15.45:0/729665945 >> v1:172.21.15.45:6789/0 conn(0x7feb940c44d0 legacy=0x7feb94154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb98a00640 1 -- 172.21.15.45:0/729665945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94157cc0 con 0x7feb941519c0 2023-12-08T08:16:02.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.596+0000 7feb99201640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 0x7feb940ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:02.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.597+0000 7feb98a00640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb941519c0 0x7feb941584c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb880097a0 tx=0x7feb8802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6552b4f11c8150d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.597+0000 7feb937fe640 1 -- 172.21.15.45:0/729665945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88031780 con 0x7feb941519c0 2023-12-08T08:16:02.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.597+0000 7feb937fe640 1 -- 172.21.15.45:0/729665945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880318e0 con 0x7feb941519c0 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.597+0000 7feb937fe640 1 -- 172.21.15.45:0/729665945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88031c70 con 0x7feb941519c0 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 -- 172.21.15.45:0/729665945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb941519c0 msgr2=0x7feb941584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb941519c0 0x7feb941584c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feb880097a0 tx=0x7feb8802b820 comp rx=0 tx=0).stop 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 -- 172.21.15.45:0/729665945 shutdown_connections 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c7a50 0x7feb940ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 --2- 172.21.15.45:0/729665945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb941519c0 0x7feb941584c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 -- 172.21.15.45:0/729665945 >> 172.21.15.45:0/729665945 conn(0x7feb940661f0 msgr2=0x7feb94066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 -- 172.21.15.45:0/729665945 shutdown_connections 2023-12-08T08:16:02.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.598+0000 7feb99a02640 1 -- 172.21.15.45:0/729665945 wait complete. 2023-12-08T08:16:02.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.600+0000 7feb99a02640 1 Processor -- start 2023-12-08T08:16:02.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.600+0000 7feb99a02640 1 -- start start 2023-12-08T08:16:02.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c44d0 0x7feb941eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 0x7feb9414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414bc60 con 0x7feb940c7a50 2023-12-08T08:16:02.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb941edfa0 con 0x7feb941519c0 2023-12-08T08:16:02.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb99a02640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414e570 con 0x7feb940c44d0 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb93fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb93fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34840/0 (socket says 172.21.15.45:34840) 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb93fff640 1 -- 172.21.15.45:0/1955101696 learned_addr learned my addr 172.21.15.45:0/1955101696 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.601+0000 7feb98a00640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c44d0 0x7feb941eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb99201640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 0x7feb9414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 -- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c44d0 msgr2=0x7feb941eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c44d0 0x7feb941eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 -- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 msgr2=0x7feb9414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 0x7feb9414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 -- 172.21.15.45:0/1955101696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009400 con 0x7feb940c7a50 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb99201640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 0x7feb9414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb93fff640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c480 tx=0x7feb8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80005ce0 con 0x7feb940c7a50 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80005e40 con 0x7feb940c7a50 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800072f0 con 0x7feb940c7a50 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb940aade0 con 0x7feb940c7a50 2023-12-08T08:16:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.602+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9414beb0 con 0x7feb940c7a50 2023-12-08T08:16:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.604+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb940743e0 con 0x7feb940c7a50 2023-12-08T08:16:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.605+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb80007510 con 0x7feb940c7a50 2023-12-08T08:16:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.606+0000 7feb917fa640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 0x7feb7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.606+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb80088e30 con 0x7feb940c7a50 2023-12-08T08:16:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.606+0000 7feb98a00640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 0x7feb7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.607+0000 7feb98a00640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 0x7feb7806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb88036000 tx=0x7feb8803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:02.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.610+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb80053c60 con 0x7feb940c7a50 2023-12-08T08:16:02.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:02.878+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7feb940c7190 con 0x7feb940c7a50 2023-12-08T08:16:03.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.771+0000 7feb917fa640 1 -- 172.21.15.45:0/1955101696 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v75) v1 ==== 162+0+0 (secure 0 0 0) 0x7feb80017020 con 0x7feb940c7a50 2023-12-08T08:16:03.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.774+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 msgr2=0x7feb7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:03.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.774+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 0x7feb7806d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb88036000 tx=0x7feb8803d040 comp rx=0 tx=0).stop 2023-12-08T08:16:03.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.774+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 msgr2=0x7feb9414da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.774+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c480 tx=0x7feb8000c940 comp rx=0 tx=0).stop 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 shutdown_connections 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feb7806ae40 0x7feb7806d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb941519c0 0x7feb9414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb940c7a50 0x7feb9414da10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 --2- 172.21.15.45:0/1955101696 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feb940c44d0 0x7feb941eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 >> 172.21.15.45:0/1955101696 conn(0x7feb940661f0 msgr2=0x7feb94154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 shutdown_connections 2023-12-08T08:16:03.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:03.775+0000 7feb99a02640 1 -- 172.21.15.45:0/1955101696 wait complete. 2023-12-08T08:16:03.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:16:04.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.030+0000 7fd98294c640 1 Processor -- start 2023-12-08T08:16:04.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.030+0000 7fd98294c640 1 -- start start 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.031+0000 7fd98294c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd97c0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.031+0000 7fd98294c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c0c76e0 con 0x7fd97c154600 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.031+0000 7fd98294c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c158410 con 0x7fd97c151c40 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.031+0000 7fd98294c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0c5820 con 0x7fd97c0c7e40 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd97c154600 0x7fd97c0c6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44832/0 (socket says 172.21.15.45:44832) 2023-12-08T08:16:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97b7fe640 1 -- 172.21.15.45:0/1432954110 learned_addr learned my addr 172.21.15.45:0/1432954110 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd97c0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157651437 0 0) 0x7fd97c0c76e0 con 0x7fd97c154600 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd964003520 con 0x7fd97c154600 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834660097 0 0) 0x7fd964003520 con 0x7fd97c154600 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 msgr2=0x7fd97c0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd97c0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 >> v1:172.21.15.114:6789/0 conn(0x7fd97c151c40 legacy=0x7fd97c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c1586f0 con 0x7fd97c154600 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd970001670 con 0x7fd97c154600 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.032+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd97c0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 >> v1:172.21.15.45:6789/0 conn(0x7fd97c154600 legacy=0x7fd97c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd9640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd964003f90 0x7fd9640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd964005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0c5820 con 0x7fd964004d00 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96400bb70 con 0x7fd964003f90 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96400bd30 con 0x7fd97c0c7e40 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd964005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97bfff640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd9640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd97b7fe640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd964003f90 0x7fd9640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 -- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 msgr2=0x7fd9640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c0c7e40 0x7fd9640039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 -- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd964003f90 msgr2=0x7fd9640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd964003f90 0x7fd9640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.033+0000 7fd980ee9640 1 -- 172.21.15.45:0/1432954110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964003520 con 0x7fd964004d00 2023-12-08T08:16:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd964005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd9740073e0 tx=0x7fd9640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fd2c5a3ce3eb94 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97402cd30 con 0x7fd964004d00 2023-12-08T08:16:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97402ce90 con 0x7fd964004d00 2023-12-08T08:16:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd97affd640 1 -- 172.21.15.45:0/1432954110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974034640 con 0x7fd964004d00 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd98294c640 1 -- 172.21.15.45:0/1432954110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 msgr2=0x7fd964005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd98294c640 1 --2- 172.21.15.45:0/1432954110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd964005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd9740073e0 tx=0x7fd9640057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.035+0000 7fd980ee9640 1 -- 172.21.15.45:0/1432954110 reap_dead start 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.036+0000 7fd98294c640 1 -- 172.21.15.45:0/1432954110 shutdown_connections 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.036+0000 7fd98294c640 1 -- 172.21.15.45:0/1432954110 >> 172.21.15.45:0/1432954110 conn(0x7fd97c0ab8b0 msgr2=0x7fd97c0abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.036+0000 7fd98294c640 1 -- 172.21.15.45:0/1432954110 shutdown_connections 2023-12-08T08:16:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.036+0000 7fd98294c640 1 -- 172.21.15.45:0/1432954110 wait complete. 2023-12-08T08:16:04.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.038+0000 7fd98294c640 1 Processor -- start 2023-12-08T08:16:04.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.038+0000 7fd98294c640 1 -- start start 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c1ea7a0 0x7fd97c156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd97c0a9fb0 0x7fd97c1e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0a9b20 con 0x7fd964004d00 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0ab590 con 0x7fd97c0a9fb0 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd98294c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c1eac20 con 0x7fd97c1ea7a0 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34856/0 (socket says 172.21.15.45:34856) 2023-12-08T08:16:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 -- 172.21.15.45:0/1477489859 learned_addr learned my addr 172.21.15.45:0/1477489859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97b7fe640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c1ea7a0 0x7fd97c156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 -- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c1ea7a0 msgr2=0x7fd97c156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd980ee9640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd97c0a9fb0 0x7fd97c1e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c1ea7a0 0x7fd97c156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 -- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd97c0a9fb0 msgr2=0x7fd97c1e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd97c0a9fb0 0x7fd97c1e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.039+0000 7fd97bfff640 1 -- 172.21.15.45:0/1477489859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c0aacf0 con 0x7fd964004d00 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd97bfff640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00e550 tx=0x7fd96c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0052e0 con 0x7fd964004d00 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c005440 con 0x7fd964004d00 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c003810 con 0x7fd964004d00 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c0aafd0 con 0x7fd964004d00 2023-12-08T08:16:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.040+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c0a97b0 con 0x7fd964004d00 2023-12-08T08:16:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.042+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c0a9970 con 0x7fd964004d00 2023-12-08T08:16:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.042+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd96c003970 con 0x7fd964004d00 2023-12-08T08:16:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.043+0000 7fd978ff9640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.043+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd96c089620 con 0x7fd964004d00 2023-12-08T08:16:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.044+0000 7fd97b7fe640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.044+0000 7fd97b7fe640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 0x7fd96806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd970001200 tx=0x7fd970001150 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.047+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd96c0543a0 con 0x7fd964004d00 2023-12-08T08:16:04.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.241+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd97c074600 con 0x7fd964004d00 2023-12-08T08:16:04.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.247+0000 7fd978ff9640 1 -- 172.21.15.45:0/1477489859 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd96c0579c0 con 0x7fd964004d00 2023-12-08T08:16:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 msgr2=0x7fd96806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 0x7fd96806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd970001200 tx=0x7fd970001150 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 msgr2=0x7fd97c1eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00e550 tx=0x7fd96c00ea10 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 shutdown_connections 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd97c1ea7a0 0x7fd97c156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd97c0a9fb0 0x7fd97c1e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 --2- 172.21.15.45:0/1477489859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd964004d00 0x7fd97c1eb190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.249+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 >> 172.21.15.45:0/1477489859 conn(0x7fd97c0ab8b0 msgr2=0x7fd97c150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.250+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 shutdown_connections 2023-12-08T08:16:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.250+0000 7fd98294c640 1 -- 172.21.15.45:0/1477489859 wait complete. 2023-12-08T08:16:04.269 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:16:04.269 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:16:04.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:16:04.498 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:16:04.498 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:04.498 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:04.563 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:04.564 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:04.622 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:04.622 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:04.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.915+0000 7f67daa85640 1 Processor -- start 2023-12-08T08:16:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.916+0000 7f67daa85640 1 -- start start 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67daa85640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67d4156490 0x7f67d40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67daa85640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40c6890 con 0x7f67d40c5bd0 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67daa85640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40c2770 con 0x7f67d40c6b70 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67daa85640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40c3c30 con 0x7f67d4156490 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67d9282640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f67d40c5bd0 0x7f67d406e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44836/0 (socket says 172.21.15.45:44836) 2023-12-08T08:16:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.917+0000 7f67d9282640 1 -- 172.21.15.45:0/1850677198 learned_addr learned my addr 172.21.15.45:0/1850677198 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125682319 0 0) 0x7f67d40c6890 con 0x7f67d40c5bd0 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67bc003520 con 0x7f67d40c5bd0 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d9a83640 1 --2- 172.21.15.45:0/1850677198 >> v2:172.21.15.114:3300/0 conn(0x7f67d4156490 0x7f67d40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910785430 0 0) 0x7f67bc003520 con 0x7f67d40c5bd0 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 >> v2:172.21.15.114:3300/0 conn(0x7f67d4156490 msgr2=0x7f67d40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 --2- 172.21.15.45:0/1850677198 >> v2:172.21.15.114:3300/0 conn(0x7f67d4156490 0x7f67d40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 >> v1:172.21.15.114:6789/0 conn(0x7f67d40c6b70 legacy=0x7f67d415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40c2a50 con 0x7f67d40c5bd0 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f67c8001670 con 0x7f67d40c5bd0 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 >> v1:172.21.15.45:6789/0 conn(0x7f67d40c5bd0 legacy=0x7f67d406e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 0x7f67bc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc0047c0 0x7f67bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc005180 0x7f67bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc00c080 con 0x7f67bc003970 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc00c1f0 con 0x7f67bc005180 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.918+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc00c3b0 con 0x7f67bc0047c0 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 0x7f67bc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 -- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc0047c0 msgr2=0x7f67bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc0047c0 0x7f67bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 -- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc005180 msgr2=0x7f67bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67bc005180 0x7f67bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67d9a83640 1 -- 172.21.15.45:0/1850677198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc003520 con 0x7f67bc003970 2023-12-08T08:16:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.919+0000 7f67da284640 1 -- 172.21.15.45:0/1850677198 reap_dead start 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.920+0000 7f67d9a83640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 0x7f67bc003d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67c4007330 tx=0x7f67bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f029989cb55753 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c402ccd0 con 0x7f67bc003970 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c402ce30 con 0x7f67bc003970 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67d8a81640 1 -- 172.21.15.45:0/1850677198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4034660 con 0x7f67bc003970 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 -- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 msgr2=0x7f67bc003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 0x7f67bc003d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67c4007330 tx=0x7f67bc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 -- 172.21.15.45:0/1850677198 shutdown_connections 2023-12-08T08:16:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 --2- 172.21.15.45:0/1850677198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc003970 0x7f67bc003d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 -- 172.21.15.45:0/1850677198 >> 172.21.15.45:0/1850677198 conn(0x7f67d40a9770 msgr2=0x7f67d40a9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 -- 172.21.15.45:0/1850677198 shutdown_connections 2023-12-08T08:16:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.921+0000 7f67daa85640 1 -- 172.21.15.45:0/1850677198 wait complete. 2023-12-08T08:16:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.923+0000 7f67daa85640 1 Processor -- start 2023-12-08T08:16:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.923+0000 7f67daa85640 1 -- start start 2023-12-08T08:16:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc003970 0x7f67d40a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 0x7f67d414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41dc1c0 con 0x7f67d41db840 2023-12-08T08:16:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41ed4e0 con 0x7f67d40accf0 2023-12-08T08:16:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.924+0000 7f67daa85640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41ed7c0 con 0x7f67bc003970 2023-12-08T08:16:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34870/0 (socket says 172.21.15.45:34870) 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 -- 172.21.15.45:0/2543810448 learned_addr learned my addr 172.21.15.45:0/2543810448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67d9a83640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc003970 0x7f67d40a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67d9282640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 0x7f67d414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 -- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc003970 msgr2=0x7f67d40a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc003970 0x7f67d40a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 -- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 msgr2=0x7f67d414fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 0x7f67d414fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 -- 172.21.15.45:0/2543810448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d41dc410 con 0x7f67d41db840 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67d9282640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 0x7f67d414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.925+0000 7f67da284640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67d40c3ea0 tx=0x7f67cc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.926+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0074e0 con 0x7f67d41db840 2023-12-08T08:16:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.926+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc007660 con 0x7f67d41db840 2023-12-08T08:16:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.926+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0059e0 con 0x7f67d41db840 2023-12-08T08:16:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.926+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d41dc6f0 con 0x7f67d41db840 2023-12-08T08:16:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.926+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d40a9090 con 0x7f67d41db840 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.927+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d40ab0c0 con 0x7f67d41db840 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.928+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67cc005b40 con 0x7f67d41db840 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.929+0000 7f67d27fc640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 0x7f67c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.929+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f67cc088ac0 con 0x7f67d41db840 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.929+0000 7f67d9a83640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 0x7f67c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.930+0000 7f67d9a83640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 0x7f67c006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67c4036000 tx=0x7f67c4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:04.934+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67d40ab0c0 con 0x7f67d41db840 2023-12-08T08:16:05.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.133+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67d40743e0 con 0x7f67d41db840 2023-12-08T08:16:05.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.135+0000 7f67d27fc640 1 -- 172.21.15.45:0/2543810448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f67cc088e60 con 0x7f67d41db840 2023-12-08T08:16:05.137 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:05.137 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 msgr2=0x7f67c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 0x7f67c006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67c4036000 tx=0x7f67c4030000 comp rx=0 tx=0).stop 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 msgr2=0x7f67d41502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67d40c3ea0 tx=0x7f67cc00c820 comp rx=0 tx=0).stop 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 shutdown_connections 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f67c006ae70 0x7f67c006d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d41db840 0x7f67d41502d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67d40accf0 0x7f67d414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 --2- 172.21.15.45:0/2543810448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67bc003970 0x7f67d40a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 >> 172.21.15.45:0/2543810448 conn(0x7f67d40a9770 msgr2=0x7f67d40c1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.138+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 shutdown_connections 2023-12-08T08:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.139+0000 7f67daa85640 1 -- 172.21.15.45:0/2543810448 wait complete. 2023-12-08T08:16:05.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:16:05.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:05.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.390+0000 7fdc1603d640 1 Processor -- start 2023-12-08T08:16:05.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.390+0000 7fdc1603d640 1 -- start start 2023-12-08T08:16:05.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc1603d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc10154730 0x7fdc10154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc1603d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc101589d0 con 0x7fdc100c4710 2023-12-08T08:16:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc1603d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100c71b0 con 0x7fdc10151c20 2023-12-08T08:16:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc1603d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc10157dc0 con 0x7fdc10154730 2023-12-08T08:16:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc0effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdc100c4710 0x7fdc100c4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45024/0 (socket says 172.21.15.45:45024) 2023-12-08T08:16:05.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.392+0000 7fdc0effd640 1 -- 172.21.15.45:0/1850277501 learned_addr learned my addr 172.21.15.45:0/1850277501 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/1850277501 >> v2:172.21.15.114:3300/0 conn(0x7fdc10154730 0x7fdc10154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549036586 0 0) 0x7fdc101589d0 con 0x7fdc100c4710 2023-12-08T08:16:05.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf8003520 con 0x7fdc100c4710 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340240849 0 0) 0x7fdbf8003520 con 0x7fdc100c4710 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 >> v2:172.21.15.114:3300/0 conn(0x7fdc10154730 msgr2=0x7fdc10154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/1850277501 >> v2:172.21.15.114:3300/0 conn(0x7fdc10154730 0x7fdc10154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 >> v1:172.21.15.114:6789/0 conn(0x7fdc10151c20 legacy=0x7fdc100c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc101580a0 con 0x7fdc100c4710 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdc04001670 con 0x7fdc100c4710 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 >> v1:172.21.15.45:6789/0 conn(0x7fdc100c4710 legacy=0x7fdc100c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbf8003970 0x7fdbf8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf80047c0 0x7fdbf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 0x7fdbf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10157dc0 con 0x7fdbf8005180 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf800c120 con 0x7fdbf8003970 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.393+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf800c2e0 con 0x7fdbf80047c0 2023-12-08T08:16:05.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 0x7fdbf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 -- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf80047c0 msgr2=0x7fdbf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbf8003970 0x7fdbf8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0effd640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf80047c0 0x7fdbf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf80047c0 0x7fdbf8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 -- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbf8003970 msgr2=0x7fdbf8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbf8003970 0x7fdbf8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0ffff640 1 -- 172.21.15.45:0/1850277501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8003520 con 0x7fdbf8005180 2023-12-08T08:16:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.394+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbf8003970 0x7fdbf8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.395+0000 7fdc0ffff640 1 -- 172.21.15.45:0/1850277501 reap_dead start 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.395+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 0x7fdbf800b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009fc0 tx=0x7fdbf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ab1285040a78f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0802cc60 con 0x7fdbf8005180 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0800f040 con 0x7fdbf8005180 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/1850277501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08003990 con 0x7fdbf8005180 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 -- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 msgr2=0x7fdbf800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 0x7fdbf800b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009fc0 tx=0x7fdbf80057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 -- 172.21.15.45:0/1850277501 shutdown_connections 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 --2- 172.21.15.45:0/1850277501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbf8005180 0x7fdbf800b980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 -- 172.21.15.45:0/1850277501 >> 172.21.15.45:0/1850277501 conn(0x7fdc100ab920 msgr2=0x7fdc100abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 -- 172.21.15.45:0/1850277501 shutdown_connections 2023-12-08T08:16:05.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.396+0000 7fdc1603d640 1 -- 172.21.15.45:0/1850277501 wait complete. 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.398+0000 7fdc1603d640 1 Processor -- start 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.398+0000 7fdc1603d640 1 -- start start 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf8005180 0x7fdc101edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc1014ed50 0x7fdc100c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101e9cb0 con 0x7fdc100c1320 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101ee100 con 0x7fdc1014ed50 2023-12-08T08:16:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc1603d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10150780 con 0x7fdbf8005180 2023-12-08T08:16:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.399+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43016/0 (socket says 172.21.15.45:43016) 2023-12-08T08:16:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 -- 172.21.15.45:0/4255598282 learned_addr learned my addr 172.21.15.45:0/4255598282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 -- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf8005180 msgr2=0x7fdc101edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf8005180 0x7fdc101edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 -- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc1014ed50 msgr2=0x7fdc100c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc1014ed50 0x7fdc100c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 -- 172.21.15.45:0/4255598282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10150a60 con 0x7fdc100c1320 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdc0ffff640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802c6d0 tx=0x7fdc08009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.400+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08003da0 con 0x7fdc100c1320 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.401+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08035950 con 0x7fdc100c1320 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.401+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08035d40 con 0x7fdc100c1320 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.401+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc10150d40 con 0x7fdc100c1320 2023-12-08T08:16:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.401+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc100c9350 con 0x7fdc100c1320 2023-12-08T08:16:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.402+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc101ea100 con 0x7fdc100c1320 2023-12-08T08:16:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.403+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc08004030 con 0x7fdc100c1320 2023-12-08T08:16:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.404+0000 7fdbf7fff640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 0x7fdbfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.404+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc080ac760 con 0x7fdc100c1320 2023-12-08T08:16:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.404+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 0x7fdbfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.405+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 0x7fdbfc06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc00000f60 tx=0x7fdc00009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.408+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc101ea100 con 0x7fdc100c1320 2023-12-08T08:16:05.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.602+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc101ea100 con 0x7fdc100c1320 2023-12-08T08:16:05.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.603+0000 7fdbf7fff640 1 -- 172.21.15.45:0/4255598282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc101ea100 con 0x7fdc100c1320 2023-12-08T08:16:05.605 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 msgr2=0x7fdbfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 0x7fdbfc06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdc00000f60 tx=0x7fdc00009040 comp rx=0 tx=0).stop 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 msgr2=0x7fdc101ea3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdc0802c6d0 tx=0x7fdc08009750 comp rx=0 tx=0).stop 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 shutdown_connections 2023-12-08T08:16:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdbfc06ae40 0x7fdbfc06d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c1320 0x7fdc101ea3e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc1014ed50 0x7fdc100c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 --2- 172.21.15.45:0/4255598282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdbf8005180 0x7fdc101edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 >> 172.21.15.45:0/4255598282 conn(0x7fdc100ab920 msgr2=0x7fdc10154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.606+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 shutdown_connections 2023-12-08T08:16:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.607+0000 7fdc1603d640 1 -- 172.21.15.45:0/4255598282 wait complete. 2023-12-08T08:16:05.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.864+0000 7f4e5f59e640 1 Processor -- start 2023-12-08T08:16:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.864+0000 7f4e5f59e640 1 -- start start 2023-12-08T08:16:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e600c4970 0x7f4e600a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e60155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5f59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600c60c0 con 0x7f4e6014c280 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e60152dc0 con 0x7f4e600c4970 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601521d0 con 0x7f4e60155790 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e600c4970 0x7f4e600a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e6014c280 0x7f4e6006cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45026/0 (socket says 172.21.15.45:45026) 2023-12-08T08:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5e59c640 1 -- 172.21.15.45:0/4171838861 learned_addr learned my addr 172.21.15.45:0/4171838861 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5ed9d640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e60155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/4171838861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 msgr2=0x7f4e60155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5dd9b640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e60155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/4171838861 >> v1:172.21.15.45:6789/0 conn(0x7f4e6014c280 legacy=0x7f4e6006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.866+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/4171838861 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6014c660 con 0x7f4e600c4970 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5dd9b640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e600c4970 0x7f4e600a4d10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e540097a0 tx=0x7f4e5402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b736d5f585594296 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5d59a640 1 -- 172.21.15.45:0/4171838861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54031780 con 0x7f4e600c4970 2023-12-08T08:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5d59a640 1 -- 172.21.15.45:0/4171838861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e540318e0 con 0x7f4e600c4970 2023-12-08T08:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5d59a640 1 -- 172.21.15.45:0/4171838861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54031c70 con 0x7f4e600c4970 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5f59e640 1 -- 172.21.15.45:0/4171838861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e600c4970 msgr2=0x7f4e600a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.868+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e600c4970 0x7f4e600a4d10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e540097a0 tx=0x7f4e5402b820 comp rx=0 tx=0).stop 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 -- 172.21.15.45:0/4171838861 shutdown_connections 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e60155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/4171838861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e600c4970 0x7f4e600a4d10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 -- 172.21.15.45:0/4171838861 >> 172.21.15.45:0/4171838861 conn(0x7f4e60066ce0 msgr2=0x7f4e600a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 -- 172.21.15.45:0/4171838861 shutdown_connections 2023-12-08T08:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.869+0000 7f4e5f59e640 1 -- 172.21.15.45:0/4171838861 wait complete. 2023-12-08T08:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.871+0000 7f4e5f59e640 1 Processor -- start 2023-12-08T08:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.871+0000 7f4e5f59e640 1 -- start start 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e600c4970 0x7f4e600c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e6014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60153780 con 0x7f4e6014c280 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e601495f0 con 0x7f4e600c4970 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60153250 con 0x7f4e60155790 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43032/0 (socket says 172.21.15.45:43032) 2023-12-08T08:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.872+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/2958342562 learned_addr learned my addr 172.21.15.45:0/2958342562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5e59c640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e600c4970 0x7f4e600c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5ed9d640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e6014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 msgr2=0x7f4e6014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e6014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e600c4970 msgr2=0x7f4e600c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e600c4970 0x7f4e600c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 -- 172.21.15.45:0/2958342562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54009400 con 0x7f4e6014c280 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e5dd9b640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098c0 tx=0x7f4e540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.873+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54032960 con 0x7f4e6014c280 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.874+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54032ac0 con 0x7f4e6014c280 2023-12-08T08:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.874+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54032e70 con 0x7f4e6014c280 2023-12-08T08:16:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.874+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6014b560 con 0x7f4e6014c280 2023-12-08T08:16:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.874+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e60149310 con 0x7f4e6014c280 2023-12-08T08:16:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.875+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e600678c0 con 0x7f4e6014c280 2023-12-08T08:16:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.876+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e5403b3f0 con 0x7f4e6014c280 2023-12-08T08:16:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.877+0000 7f4e4effd640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 0x7f4e4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.877+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e540abf80 con 0x7f4e6014c280 2023-12-08T08:16:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.877+0000 7f4e5e59c640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 0x7f4e4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.878+0000 7f4e5e59c640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 0x7f4e4006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e50005880 tx=0x7f4e50009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:05.882+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e54076b40 con 0x7f4e6014c280 2023-12-08T08:16:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.080+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e600743e0 con 0x7f4e6014c280 2023-12-08T08:16:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.080+0000 7f4e4effd640 1 -- 172.21.15.45:0/2958342562 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e5407a160 con 0x7f4e6014c280 2023-12-08T08:16:06.082 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:06.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 msgr2=0x7f4e4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 0x7f4e4006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e50005880 tx=0x7f4e50009040 comp rx=0 tx=0).stop 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 msgr2=0x7f4e6014aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4e540098c0 tx=0x7f4e540046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 shutdown_connections 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4e4006ae40 0x7f4e4006d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4e60155790 0x7f4e6014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6014c280 0x7f4e6014aae0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 --2- 172.21.15.45:0/2958342562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e600c4970 0x7f4e600c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.083+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 >> 172.21.15.45:0/2958342562 conn(0x7f4e60066ce0 msgr2=0x7f4e601475f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.084+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 shutdown_connections 2023-12-08T08:16:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.084+0000 7f4e5f59e640 1 -- 172.21.15.45:0/2958342562 wait complete. 2023-12-08T08:16:06.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:06.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.337+0000 7faa70ff4640 1 Processor -- start 2023-12-08T08:16:06.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.337+0000 7faa70ff4640 1 -- start start 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.338+0000 7faa70ff4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.338+0000 7faa70ff4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa6c1543e0 0x7faa6c158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.338+0000 7faa70ff4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c0c2e60 con 0x7faa6c0c1050 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.338+0000 7faa70ff4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c0c0360 con 0x7faa6c1543e0 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.338+0000 7faa70ff4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c30c0 con 0x7faa6c0c1810 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa6c1543e0 0x7faa6c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa6c1543e0 0x7faa6c158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43042/0 (socket says 172.21.15.45:43042) 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 -- 172.21.15.45:0/1050872954 learned_addr learned my addr 172.21.15.45:0/1050872954 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6b7fe640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 -- 172.21.15.45:0/1050872954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 msgr2=0x7faa6c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c0c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 -- 172.21.15.45:0/1050872954 >> v1:172.21.15.114:6789/0 conn(0x7faa6c0c1050 legacy=0x7faa6c151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:06.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6affd640 1 -- 172.21.15.45:0/1050872954 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0c33a0 con 0x7faa6c1543e0 2023-12-08T08:16:06.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.339+0000 7faa6b7fe640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:06.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.340+0000 7faa6affd640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c1543e0 0x7faa6c158090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faa54009e50 tx=0x7faa5402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af85b30aa746e1c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa6a7fc640 1 -- 172.21.15.45:0/1050872954 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5402c9e0 con 0x7faa6c1543e0 2023-12-08T08:16:06.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa6a7fc640 1 -- 172.21.15.45:0/1050872954 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5402cb40 con 0x7faa6c1543e0 2023-12-08T08:16:06.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa6a7fc640 1 -- 172.21.15.45:0/1050872954 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa540343f0 con 0x7faa6c1543e0 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 -- 172.21.15.45:0/1050872954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c1543e0 msgr2=0x7faa6c158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c1543e0 0x7faa6c158090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faa54009e50 tx=0x7faa5402be40 comp rx=0 tx=0).stop 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 -- 172.21.15.45:0/1050872954 shutdown_connections 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c1543e0 0x7faa6c158090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 --2- 172.21.15.45:0/1050872954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c0c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 -- 172.21.15.45:0/1050872954 >> 172.21.15.45:0/1050872954 conn(0x7faa6c06a4c0 msgr2=0x7faa6c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.341+0000 7faa70ff4640 1 -- 172.21.15.45:0/1050872954 shutdown_connections 2023-12-08T08:16:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.342+0000 7faa70ff4640 1 -- 172.21.15.45:0/1050872954 wait complete. 2023-12-08T08:16:06.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.343+0000 7faa70ff4640 1 Processor -- start 2023-12-08T08:16:06.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.343+0000 7faa70ff4640 1 -- start start 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa6c1543e0 0x7faa6c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0ab490 con 0x7faa6c0c1050 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c147330 con 0x7faa6c1543e0 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.344+0000 7faa70ff4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1ed480 con 0x7faa6c0c1810 2023-12-08T08:16:06.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43046/0 (socket says 172.21.15.45:43046) 2023-12-08T08:16:06.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 -- 172.21.15.45:0/890651280 learned_addr learned my addr 172.21.15.45:0/890651280 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 -- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 msgr2=0x7faa6c14e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6affd640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c14e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6bfff640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa6c1543e0 0x7faa6c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 -- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa6c1543e0 msgr2=0x7faa6c14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa6c1543e0 0x7faa6c14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 -- 172.21.15.45:0/890651280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009b30 con 0x7faa6c0c1050 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.345+0000 7faa6b7fe640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00c820 tx=0x7faa5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.346+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c007a30 con 0x7faa6c0c1050 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.346+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c007b90 con 0x7faa6c0c1050 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.346+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c1ed910 con 0x7faa6c0c1050 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.346+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ce70 con 0x7faa6c0c1050 2023-12-08T08:16:06.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.346+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c1ecb50 con 0x7faa6c0c1050 2023-12-08T08:16:06.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.347+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c0743e0 con 0x7faa6c0c1050 2023-12-08T08:16:06.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.348+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa5c0113f0 con 0x7faa6c0c1050 2023-12-08T08:16:06.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.349+0000 7faa63fff640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 0x7faa4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.349+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa5c089c10 con 0x7faa6c0c1050 2023-12-08T08:16:06.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.349+0000 7faa6affd640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 0x7faa4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.350+0000 7faa6affd640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 0x7faa4c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa54035000 tx=0x7faa54030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.353+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa5c054860 con 0x7faa6c0c1050 2023-12-08T08:16:06.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.544+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa6c073a90 con 0x7faa6c0c1050 2023-12-08T08:16:06.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.545+0000 7faa63fff640 1 -- 172.21.15.45:0/890651280 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa5c01f0a0 con 0x7faa6c0c1050 2023-12-08T08:16:06.547 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 msgr2=0x7faa4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 0x7faa4c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa54035000 tx=0x7faa54030000 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 msgr2=0x7faa6c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00c820 tx=0x7faa5c00cc20 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 shutdown_connections 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa4c06ae40 0x7faa4c06d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faa6c0c1810 0x7faa6c14e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faa6c1543e0 0x7faa6c14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 --2- 172.21.15.45:0/890651280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0c1050 0x7faa6c156a90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 >> 172.21.15.45:0/890651280 conn(0x7faa6c06a4c0 msgr2=0x7faa6c157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:06.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 shutdown_connections 2023-12-08T08:16:06.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.548+0000 7faa70ff4640 1 -- 172.21.15.45:0/890651280 wait complete. 2023-12-08T08:16:06.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:16:06.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.796+0000 7fe8ee1b6640 1 Processor -- start 2023-12-08T08:16:06.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.796+0000 7fe8ee1b6640 1 -- start start 2023-12-08T08:16:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8ee1b6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8e8151d70 0x7fe8e8155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8ee1b6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e80c4a60 0x7fe8e8158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8ee1b6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80c5670 con 0x7fe8e806ca50 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8ee1b6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e8158120 con 0x7fe8e8151d70 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8ee1b6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8158a80 con 0x7fe8e80c4a60 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8e77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8e8151d70 0x7fe8e8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8e7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8e806ca50 0x7fe8e80bed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45042/0 (socket says 172.21.15.45:45042) 2023-12-08T08:16:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8e7fff640 1 -- 172.21.15.45:0/1302825007 learned_addr learned my addr 172.21.15.45:0/1302825007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8e6ffd640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e80c4a60 0x7fe8e8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.798+0000 7fe8e67fc640 1 -- 172.21.15.45:0/1302825007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273093593 0 0) 0x7fe8e80c5670 con 0x7fe8e806ca50 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.799+0000 7fe8e67fc640 1 -- 172.21.15.45:0/1302825007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003520 con 0x7fe8e806ca50 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.799+0000 7fe8e77fe640 1 -- 172.21.15.45:0/1302825007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e80c4a60 msgr2=0x7fe8e8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.799+0000 7fe8e77fe640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e80c4a60 0x7fe8e8158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.799+0000 7fe8e77fe640 1 -- 172.21.15.45:0/1302825007 >> v1:172.21.15.45:6789/0 conn(0x7fe8e806ca50 legacy=0x7fe8e80bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.799+0000 7fe8e77fe640 1 -- 172.21.15.45:0/1302825007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80a4f60 con 0x7fe8e8151d70 2023-12-08T08:16:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.800+0000 7fe8e77fe640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e8151d70 0x7fe8e8155050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097a0 tx=0x7fe8d802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb89082d34e36a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.800+0000 7fe8e67fc640 1 -- 172.21.15.45:0/1302825007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d802f050 con 0x7fe8e8151d70 2023-12-08T08:16:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.800+0000 7fe8e67fc640 1 -- 172.21.15.45:0/1302825007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8031700 con 0x7fe8e8151d70 2023-12-08T08:16:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.800+0000 7fe8e67fc640 1 -- 172.21.15.45:0/1302825007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8031a90 con 0x7fe8e8151d70 2023-12-08T08:16:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/1302825007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e8151d70 msgr2=0x7fe8e8155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e8151d70 0x7fe8e8155050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097a0 tx=0x7fe8d802b7a0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/1302825007 shutdown_connections 2023-12-08T08:16:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e80c4a60 0x7fe8e8158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/1302825007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e8151d70 0x7fe8e8155050 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/1302825007 >> 172.21.15.45:0/1302825007 conn(0x7fe8e80c2430 msgr2=0x7fe8e80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/1302825007 shutdown_connections 2023-12-08T08:16:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.801+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/1302825007 wait complete. 2023-12-08T08:16:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.803+0000 7fe8ee1b6640 1 Processor -- start 2023-12-08T08:16:06.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.803+0000 7fe8ee1b6640 1 -- start start 2023-12-08T08:16:06.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e806ca50 0x7fe8e806f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e8151d70 0x7fe8e8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8071170 con 0x7fe8e80c4a60 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81eab50 con 0x7fe8e8151d70 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8ee1b6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e81567d0 con 0x7fe8e806ca50 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43056/0 (socket says 172.21.15.45:43056) 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.804+0000 7fe8e6ffd640 1 -- 172.21.15.45:0/3054529412 learned_addr learned my addr 172.21.15.45:0/3054529412 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 -- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e806ca50 msgr2=0x7fe8e806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e806ca50 0x7fe8e806f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 -- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e8151d70 msgr2=0x7fe8e8070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:06.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e8151d70 0x7fe8e8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:06.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 -- 172.21.15.45:0/3054529412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009400 con 0x7fe8e80c4a60 2023-12-08T08:16:06.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8e6ffd640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0007e40 tx=0x7fe8d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0014620 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.805+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000ee90 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.806+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00149c0 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.806+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e8156ab0 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.806+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e8157b00 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.807+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e8157cc0 con 0x7fe8e80c4a60 2023-12-08T08:16:06.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.808+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8d0014b20 con 0x7fe8e80c4a60 2023-12-08T08:16:06.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.809+0000 7fe8dffff640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 0x7fe8c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:06.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.809+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe8d008a3a0 con 0x7fe8e80c4a60 2023-12-08T08:16:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.809+0000 7fe8e77fe640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 0x7fe8c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.810+0000 7fe8e77fe640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 0x7fe8c806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8035000 tx=0x7fe8d8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:06.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:06.813+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8d0054ff0 con 0x7fe8e80c4a60 2023-12-08T08:16:07.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.006+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe8e8074670 con 0x7fe8e80c4a60 2023-12-08T08:16:07.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.007+0000 7fe8dffff640 1 -- 172.21.15.45:0/3054529412 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe8d0058610 con 0x7fe8e80c4a60 2023-12-08T08:16:07.009 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:07.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.009+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 msgr2=0x7fe8c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.009+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 0x7fe8c806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8035000 tx=0x7fe8d8030000 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.009+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 msgr2=0x7fe8e80a91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.009+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0007e40 tx=0x7fe8d000e4b0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 shutdown_connections 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8c806ae40 0x7fe8c806d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8e8151d70 0x7fe8e8070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8e80c4a60 0x7fe8e80a91a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 --2- 172.21.15.45:0/3054529412 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8e806ca50 0x7fe8e806f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 >> 172.21.15.45:0/3054529412 conn(0x7fe8e80c2430 msgr2=0x7fe8e8154c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 shutdown_connections 2023-12-08T08:16:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.010+0000 7fe8ee1b6640 1 -- 172.21.15.45:0/3054529412 wait complete. 2023-12-08T08:16:07.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:16:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.248+0000 7f77c2e09640 1 Processor -- start 2023-12-08T08:16:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.249+0000 7f77c2e09640 1 -- start start 2023-12-08T08:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.250+0000 7f77c2e09640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c2e09640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 0x7f77bc0c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c2e09640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc14c7a0 con 0x7f77bc0c3330 2023-12-08T08:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c2e09640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc0c3e10 con 0x7f77bc073b00 2023-12-08T08:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c2e09640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c38e0 con 0x7f77bc14c3c0 2023-12-08T08:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c0ba5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c0ba5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:47726/0 (socket says 172.21.15.45:47726) 2023-12-08T08:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.251+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3679755985 learned_addr learned my addr 172.21.15.45:0/3679755985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3679755985 >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 0x7f77bc0c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3679755985 >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 msgr2=0x7f77bc0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77c0ba5640 1 --2- 172.21.15.45:0/3679755985 >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 0x7f77bc0c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3679755985 >> v1:172.21.15.114:6789/0 conn(0x7f77bc0c3330 legacy=0x7f77bc152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3679755985 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0ac540 con 0x7f77bc14c3c0 2023-12-08T08:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.252+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3679755985 >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 0x7f77bc0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:07.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.254+0000 7f77c0ba5640 1 --2- 172.21.15.45:0/3679755985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009870 tx=0x7f77ac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e216379d38e5246d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.254+0000 7f77bb7fe640 1 -- 172.21.15.45:0/3679755985 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac031640 con 0x7f77bc14c3c0 2023-12-08T08:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77bb7fe640 1 -- 172.21.15.45:0/3679755985 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0317a0 con 0x7f77bc14c3c0 2023-12-08T08:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77bb7fe640 1 -- 172.21.15.45:0/3679755985 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac031b30 con 0x7f77bc14c3c0 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 -- 172.21.15.45:0/3679755985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 msgr2=0x7f77bc0a9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3679755985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009870 tx=0x7f77ac02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 -- 172.21.15.45:0/3679755985 shutdown_connections 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3679755985 >> v2:172.21.15.114:3300/0 conn(0x7f77bc073b00 0x7f77bc0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3679755985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc0a9440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.255+0000 7f77c2e09640 1 -- 172.21.15.45:0/3679755985 >> 172.21.15.45:0/3679755985 conn(0x7f77bc0a8ae0 msgr2=0x7f77bc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.256+0000 7f77c2e09640 1 -- 172.21.15.45:0/3679755985 shutdown_connections 2023-12-08T08:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.256+0000 7f77c2e09640 1 -- 172.21.15.45:0/3679755985 wait complete. 2023-12-08T08:16:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.257+0000 7f77c2e09640 1 Processor -- start 2023-12-08T08:16:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.257+0000 7f77c2e09640 1 -- start start 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 0x7f77bc155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1540c0 con 0x7f77bc073b00 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1556b0 con 0x7f77bc0c3330 2023-12-08T08:16:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.258+0000 7f77c2e09640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc153660 con 0x7f77bc14c3c0 2023-12-08T08:16:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43064/0 (socket says 172.21.15.45:43064) 2023-12-08T08:16:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3195105716 learned_addr learned my addr 172.21.15.45:0/3195105716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c13a6640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 0x7f77bc155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 msgr2=0x7f77bc156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 msgr2=0x7f77bc155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 0x7f77bc155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c0ba5640 1 -- 172.21.15.45:0/3195105716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0094d0 con 0x7f77bc073b00 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77c13a6640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.259+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 0x7f77bc155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77c0ba5640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac03ac60 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac03adc0 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac044630 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc153870 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.260+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc148730 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.261+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc155920 con 0x7f77bc073b00 2023-12-08T08:16:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.262+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77ac02f050 con 0x7f77bc073b00 2023-12-08T08:16:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.263+0000 7f77b97fa640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 0x7f779c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:07.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.263+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77ac0ab840 con 0x7f77bc073b00 2023-12-08T08:16:07.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.264+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 0x7f779c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.264+0000 7f77bbfff640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 0x7f779c06d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0c2250 tx=0x7f77a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:07.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.267+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77ac076520 con 0x7f77bc073b00 2023-12-08T08:16:07.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.473+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f77bc074600 con 0x7f77bc073b00 2023-12-08T08:16:07.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.474+0000 7f77b97fa640 1 -- 172.21.15.45:0/3195105716 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77ac031e60 con 0x7f77bc073b00 2023-12-08T08:16:07.475 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 msgr2=0x7f779c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 0x7f779c06d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0c2250 tx=0x7f77a4008040 comp rx=0 tx=0).stop 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 msgr2=0x7f77bc1e84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 shutdown_connections 2023-12-08T08:16:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f779c06ae40 0x7f779c06d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f77bc14c3c0 0x7f77bc156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc0c3330 0x7f77bc155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 --2- 172.21.15.45:0/3195105716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc073b00 0x7f77bc1e84c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 >> 172.21.15.45:0/3195105716 conn(0x7f77bc0a8ae0 msgr2=0x7f77bc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.476+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 shutdown_connections 2023-12-08T08:16:07.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:07.477+0000 7f77c2e09640 1 -- 172.21.15.45:0/3195105716 wait complete. 2023-12-08T08:16:07.496 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:16:07.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:07.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-08T08:16:07.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:16:07.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:07.603 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:16:07.656 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:07.656 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:07.716 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:07.716 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:07.770 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:07.770 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:07.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.055+0000 7f8def002640 1 Processor -- start 2023-12-08T08:16:08.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.056+0000 7f8def002640 1 -- start start 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8def002640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8def002640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8de80c7a50 0x7f8de80ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8def002640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de80c4a00 con 0x7f8de81519c0 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8def002640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80c4ce0 con 0x7f8de80c7a50 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8def002640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81579e0 con 0x7f8de80c44d0 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8dee000640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8de81519c0 0x7f8de8154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45048/0 (socket says 172.21.15.45:45048) 2023-12-08T08:16:08.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.057+0000 7f8dee000640 1 -- 172.21.15.45:0/3666143006 learned_addr learned my addr 172.21.15.45:0/3666143006 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8dee801640 1 --2- 172.21.15.45:0/3666143006 >> v2:172.21.15.45:3300/0 conn(0x7f8de80c7a50 0x7f8de80ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8ded7ff640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8decffe640 1 -- 172.21.15.45:0/3666143006 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256310892 0 0) 0x7f8de80c4a00 con 0x7f8de81519c0 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8decffe640 1 -- 172.21.15.45:0/3666143006 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd4003520 con 0x7f8de81519c0 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8dee801640 1 -- 172.21.15.45:0/3666143006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 msgr2=0x7f8de81584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8dee801640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de81584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8dee801640 1 -- 172.21.15.45:0/3666143006 >> v1:172.21.15.45:6789/0 conn(0x7f8de81519c0 legacy=0x7f8de8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.058+0000 7f8dee801640 1 -- 172.21.15.45:0/3666143006 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8157cc0 con 0x7f8de80c7a50 2023-12-08T08:16:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8dee801640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de80c7a50 0x7f8de80ab6b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009d90 tx=0x7f8de002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3d25f9321eca0a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8decffe640 1 -- 172.21.15.45:0/3666143006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de002cbc0 con 0x7f8de80c7a50 2023-12-08T08:16:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8decffe640 1 -- 172.21.15.45:0/3666143006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de002cd20 con 0x7f8de80c7a50 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8decffe640 1 -- 172.21.15.45:0/3666143006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0034660 con 0x7f8de80c7a50 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 -- 172.21.15.45:0/3666143006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de80c7a50 msgr2=0x7f8de80ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de80c7a50 0x7f8de80ab6b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009d90 tx=0x7f8de002be10 comp rx=0 tx=0).stop 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 -- 172.21.15.45:0/3666143006 shutdown_connections 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de80c7a50 0x7f8de80ab6b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 --2- 172.21.15.45:0/3666143006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de81584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.060+0000 7f8def002640 1 -- 172.21.15.45:0/3666143006 >> 172.21.15.45:0/3666143006 conn(0x7f8de80661f0 msgr2=0x7f8de8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.061+0000 7f8def002640 1 -- 172.21.15.45:0/3666143006 shutdown_connections 2023-12-08T08:16:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.061+0000 7f8def002640 1 -- 172.21.15.45:0/3666143006 wait complete. 2023-12-08T08:16:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.062+0000 7f8def002640 1 Processor -- start 2023-12-08T08:16:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.062+0000 7f8def002640 1 -- start start 2023-12-08T08:16:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de80c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de80c7a50 0x7f8de8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81e98a0 con 0x7f8de81519c0 2023-12-08T08:16:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81ea680 con 0x7f8de80c7a50 2023-12-08T08:16:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.063+0000 7f8def002640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de814e4f0 con 0x7f8de80c44d0 2023-12-08T08:16:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43086/0 (socket says 172.21.15.45:43086) 2023-12-08T08:16:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 -- 172.21.15.45:0/2136492125 learned_addr learned my addr 172.21.15.45:0/2136492125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee000640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de80c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 -- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 msgr2=0x7f8de80c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8ded7ff640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de80c7a50 0x7f8de8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de80c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 -- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de80c7a50 msgr2=0x7f8de8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de80c7a50 0x7f8de8156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee801640 1 -- 172.21.15.45:0/2136492125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0009a70 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.064+0000 7f8dee000640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8dee801640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009eb0 tx=0x7f8de0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de003e610 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de002ce90 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de003e9b0 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de81e9ab0 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.065+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de81ea030 con 0x7f8de81519c0 2023-12-08T08:16:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.067+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de80743e0 con 0x7f8de81519c0 2023-12-08T08:16:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.067+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8de003b050 con 0x7f8de81519c0 2023-12-08T08:16:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.069+0000 7f8dde7fc640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 0x7f8dcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.069+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8de00ac050 con 0x7f8de81519c0 2023-12-08T08:16:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.069+0000 7f8dee000640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 0x7f8dcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.070+0000 7f8dee000640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 0x7f8dcc06d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005880 tx=0x7f8de4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.073+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8de0076dd0 con 0x7f8de81519c0 2023-12-08T08:16:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.266+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8de81ea7c0 con 0x7f8de81519c0 2023-12-08T08:16:08.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.269+0000 7f8dde7fc640 1 -- 172.21.15.45:0/2136492125 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f8de00a98f0 con 0x7f8de81519c0 2023-12-08T08:16:08.271 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:08.271 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 msgr2=0x7f8dcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 0x7f8dcc06d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005880 tx=0x7f8de4009040 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 msgr2=0x7f8de81ecf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009eb0 tx=0x7f8de0004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 shutdown_connections 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8dcc06ae40 0x7f8dcc06d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8de81519c0 0x7f8de81ecf90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8de80c7a50 0x7f8de8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 --2- 172.21.15.45:0/2136492125 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8de80c44d0 0x7f8de80c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 >> 172.21.15.45:0/2136492125 conn(0x7f8de80661f0 msgr2=0x7f8de80665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 shutdown_connections 2023-12-08T08:16:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.272+0000 7f8def002640 1 -- 172.21.15.45:0/2136492125 wait complete. 2023-12-08T08:16:08.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:16:08.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:08.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.522+0000 7fe3881e5640 1 Processor -- start 2023-12-08T08:16:08.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.523+0000 7fe3881e5640 1 -- start start 2023-12-08T08:16:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.524+0000 7fe3881e5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3800c4a60 0x7fe380155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.524+0000 7fe3881e5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800c5670 con 0x7fe380151d70 2023-12-08T08:16:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.524+0000 7fe3881e5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800a4f60 con 0x7fe38006ca50 2023-12-08T08:16:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.524+0000 7fe3881e5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe380158120 con 0x7fe3800c4a60 2023-12-08T08:16:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.525+0000 7fe385f81640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe380151d70 0x7fe380158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45062/0 (socket says 172.21.15.45:45062) 2023-12-08T08:16:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.525+0000 7fe385f81640 1 -- 172.21.15.45:0/1981017922 learned_addr learned my addr 172.21.15.45:0/1981017922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.525+0000 7fe385780640 1 --2- 172.21.15.45:0/1981017922 >> v2:172.21.15.114:3300/0 conn(0x7fe3800c4a60 0x7fe380155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.525+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542837854 0 0) 0x7fe3800c5670 con 0x7fe380151d70 2023-12-08T08:16:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.525+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe36c003520 con 0x7fe380151d70 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719565006 0 0) 0x7fe36c003520 con 0x7fe380151d70 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 >> v2:172.21.15.114:3300/0 conn(0x7fe3800c4a60 msgr2=0x7fe380155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 --2- 172.21.15.45:0/1981017922 >> v2:172.21.15.114:3300/0 conn(0x7fe3800c4a60 0x7fe380155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 >> v1:172.21.15.114:6789/0 conn(0x7fe38006ca50 legacy=0x7fe3800bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800a5240 con 0x7fe380151d70 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe37c001670 con 0x7fe380151d70 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 >> v1:172.21.15.45:6789/0 conn(0x7fe380151d70 legacy=0x7fe380158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe36c003970 0x7fe36c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe36c0047c0 0x7fe36c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe36c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380158120 con 0x7fe36c0052a0 2023-12-08T08:16:08.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c00c170 con 0x7fe36c0047c0 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c00c330 con 0x7fe36c003970 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.526+0000 7fe386782640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe36c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe385780640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe36c0047c0 0x7fe36c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe385f81640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe36c003970 0x7fe36c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe386782640 1 -- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe36c003970 msgr2=0x7fe36c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe386782640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe36c003970 0x7fe36c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe386782640 1 -- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe36c0047c0 msgr2=0x7fe36c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe386782640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe36c0047c0 0x7fe36c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe386782640 1 -- 172.21.15.45:0/1981017922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c003520 con 0x7fe36c0052a0 2023-12-08T08:16:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.527+0000 7fe385f81640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe36c003970 0x7fe36c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:08.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.528+0000 7fe386782640 1 -- 172.21.15.45:0/1981017922 reap_dead start 2023-12-08T08:16:08.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.528+0000 7fe386782640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe36c00b980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe378001e20 tx=0x7fe36c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be850e1128c3af8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.528+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378003b70 con 0x7fe36c0052a0 2023-12-08T08:16:08.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.528+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378003cd0 con 0x7fe36c0052a0 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.528+0000 7fe384f7f640 1 -- 172.21.15.45:0/1981017922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378005310 con 0x7fe36c0052a0 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 -- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 msgr2=0x7fe36c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe36c00b980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe378001e20 tx=0x7fe36c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 -- 172.21.15.45:0/1981017922 shutdown_connections 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 --2- 172.21.15.45:0/1981017922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe36c00b980 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 -- 172.21.15.45:0/1981017922 >> 172.21.15.45:0/1981017922 conn(0x7fe3800c2430 msgr2=0x7fe3800c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 -- 172.21.15.45:0/1981017922 shutdown_connections 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.529+0000 7fe3881e5640 1 -- 172.21.15.45:0/1981017922 wait complete. 2023-12-08T08:16:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.531+0000 7fe3881e5640 1 Processor -- start 2023-12-08T08:16:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.531+0000 7fe3881e5640 1 -- start start 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe380142020 0x7fe3801ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800a6150 0x7fe3800a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801559a0 con 0x7fe36c0052a0 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380141e60 con 0x7fe3800a6150 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe3881e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380155c40 con 0x7fe380142020 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe385f81640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe385f81640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43092/0 (socket says 172.21.15.45:43092) 2023-12-08T08:16:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.532+0000 7fe385f81640 1 -- 172.21.15.45:0/4209345488 learned_addr learned my addr 172.21.15.45:0/4209345488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe386782640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800a6150 0x7fe3800a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385780640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe380142020 0x7fe3801ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 -- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe380142020 msgr2=0x7fe3801ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe380142020 0x7fe3801ed0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 -- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800a6150 msgr2=0x7fe3800a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800a6150 0x7fe3800a65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 -- 172.21.15.45:0/4209345488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3801e77e0 con 0x7fe36c0052a0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe385f81640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00d7f0 tx=0x7fe37c00dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00dea0 con 0x7fe36c0052a0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c0074e0 con 0x7fe36c0052a0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c0049e0 con 0x7fe36c0052a0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3801ed5e0 con 0x7fe36c0052a0 2023-12-08T08:16:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.533+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3801edb60 con 0x7fe36c0052a0 2023-12-08T08:16:08.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.535+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380074670 con 0x7fe36c0052a0 2023-12-08T08:16:08.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.536+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe37c004b40 con 0x7fe36c0052a0 2023-12-08T08:16:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.537+0000 7fe3767fc640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.538+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe37c089270 con 0x7fe36c0052a0 2023-12-08T08:16:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.538+0000 7fe385780640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.539+0000 7fe385780640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 0x7fe36406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe380158890 tx=0x7fe370008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.543+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe37c0579e0 con 0x7fe36c0052a0 2023-12-08T08:16:08.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.736+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3800bfc70 con 0x7fe36c0052a0 2023-12-08T08:16:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.737+0000 7fe3767fc640 1 -- 172.21.15.45:0/4209345488 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe37c057570 con 0x7fe36c0052a0 2023-12-08T08:16:08.739 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.739+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 msgr2=0x7fe36406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 0x7fe36406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe380158890 tx=0x7fe370008040 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 msgr2=0x7fe380141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00d7f0 tx=0x7fe37c00dcb0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 shutdown_connections 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe380142020 0x7fe3801ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3800a6150 0x7fe3800a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 --2- 172.21.15.45:0/4209345488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe36c0052a0 0x7fe380141920 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 >> 172.21.15.45:0/4209345488 conn(0x7fe3800c2430 msgr2=0x7fe3800c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 shutdown_connections 2023-12-08T08:16:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.740+0000 7fe3881e5640 1 -- 172.21.15.45:0/4209345488 wait complete. 2023-12-08T08:16:08.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:08.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.981+0000 7fe04ce71640 1 Processor -- start 2023-12-08T08:16:08.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.981+0000 7fe04ce71640 1 -- start start 2023-12-08T08:16:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe04814c280 0x7fe0480a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0480c4970 0x7fe04806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04806d3e0 0x7fe048155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480c60c0 con 0x7fe04814c280 2023-12-08T08:16:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe048152dc0 con 0x7fe0480c4970 2023-12-08T08:16:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.982+0000 7fe04ce71640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0481521d0 con 0x7fe04806d3e0 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe04814c280 0x7fe0480a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe04814c280 0x7fe0480a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43102/0 (socket says 172.21.15.45:43102) 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 -- 172.21.15.45:0/2134980249 learned_addr learned my addr 172.21.15.45:0/2134980249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe03ffff640 1 --2- 172.21.15.45:0/2134980249 >> v2:172.21.15.114:3300/0 conn(0x7fe0480c4970 0x7fe04806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe047fff640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04806d3e0 0x7fe048155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 -- 172.21.15.45:0/2134980249 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04806d3e0 msgr2=0x7fe048155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04806d3e0 0x7fe048155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 -- 172.21.15.45:0/2134980249 >> v2:172.21.15.114:3300/0 conn(0x7fe0480c4970 msgr2=0x7fe04806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 --2- 172.21.15.45:0/2134980249 >> v2:172.21.15.114:3300/0 conn(0x7fe0480c4970 0x7fe04806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.983+0000 7fe0477fe640 1 -- 172.21.15.45:0/2134980249 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04814c660 con 0x7fe04814c280 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.985+0000 7fe0477fe640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04814c280 0x7fe0480a4d10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0480aad50 tx=0x7fe03802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360b38d35d53625f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.985+0000 7fe046ffd640 1 -- 172.21.15.45:0/2134980249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0380317e0 con 0x7fe04814c280 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.985+0000 7fe046ffd640 1 -- 172.21.15.45:0/2134980249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038031940 con 0x7fe04814c280 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.985+0000 7fe046ffd640 1 -- 172.21.15.45:0/2134980249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038031cd0 con 0x7fe04814c280 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 -- 172.21.15.45:0/2134980249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04814c280 msgr2=0x7fe0480a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04814c280 0x7fe0480a4d10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0480aad50 tx=0x7fe03802b880 comp rx=0 tx=0).stop 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 -- 172.21.15.45:0/2134980249 shutdown_connections 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 --2- 172.21.15.45:0/2134980249 >> v2:172.21.15.114:3300/0 conn(0x7fe0480c4970 0x7fe04806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04806d3e0 0x7fe048155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 --2- 172.21.15.45:0/2134980249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe04814c280 0x7fe0480a4d10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 -- 172.21.15.45:0/2134980249 >> 172.21.15.45:0/2134980249 conn(0x7fe048066ce0 msgr2=0x7fe0480a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 -- 172.21.15.45:0/2134980249 shutdown_connections 2023-12-08T08:16:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.986+0000 7fe04ce71640 1 -- 172.21.15.45:0/2134980249 wait complete. 2023-12-08T08:16:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.988+0000 7fe04ce71640 1 Processor -- start 2023-12-08T08:16:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.988+0000 7fe04ce71640 1 -- start start 2023-12-08T08:16:08.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe04806d3e0 0x7fe0480c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04814c280 0x7fe048145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480a65a0 con 0x7fe0480c4970 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480a67d0 con 0x7fe04806d3e0 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe04ce71640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480a6ab0 con 0x7fe04814c280 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe03ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe03ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43108/0 (socket says 172.21.15.45:43108) 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.989+0000 7fe03ffff640 1 -- 172.21.15.45:0/3135121048 learned_addr learned my addr 172.21.15.45:0/3135121048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe0477fe640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe04806d3e0 0x7fe0480c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe047fff640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04814c280 0x7fe048145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 -- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04814c280 msgr2=0x7fe048145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04814c280 0x7fe048145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 -- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe04806d3e0 msgr2=0x7fe0480c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe04806d3e0 0x7fe0480c1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 -- 172.21.15.45:0/3135121048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380094d0 con 0x7fe0480c4970 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.990+0000 7fe03ffff640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.991+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000b6c0 con 0x7fe0480c4970 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.991+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03000b820 con 0x7fe0480c4970 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.991+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000bbb0 con 0x7fe0480c4970 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.991+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0480a6d90 con 0x7fe0480c4970 2023-12-08T08:16:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.991+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0480c16d0 con 0x7fe0480c4970 2023-12-08T08:16:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.992+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480678c0 con 0x7fe0480c4970 2023-12-08T08:16:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.993+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe03000bd10 con 0x7fe0480c4970 2023-12-08T08:16:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.994+0000 7fe044ff9640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 0x7fe02806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.994+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe030089ff0 con 0x7fe0480c4970 2023-12-08T08:16:08.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.994+0000 7fe0477fe640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 0x7fe02806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:08.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.995+0000 7fe0477fe640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 0x7fe02806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe038036000 tx=0x7fe03803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:08.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:08.998+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe030054c40 con 0x7fe0480c4970 2023-12-08T08:16:09.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.192+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0480743e0 con 0x7fe0480c4970 2023-12-08T08:16:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.193+0000 7fe044ff9640 1 -- 172.21.15.45:0/3135121048 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe030058260 con 0x7fe0480c4970 2023-12-08T08:16:09.195 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 msgr2=0x7fe02806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 0x7fe02806d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe038036000 tx=0x7fe03803d040 comp rx=0 tx=0).stop 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 msgr2=0x7fe0481507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 shutdown_connections 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe02806ae40 0x7fe02806d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe04814c280 0x7fe048145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0480c4970 0x7fe0481507c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 --2- 172.21.15.45:0/3135121048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe04806d3e0 0x7fe0480c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 >> 172.21.15.45:0/3135121048 conn(0x7fe048066ce0 msgr2=0x7fe048146ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 shutdown_connections 2023-12-08T08:16:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.196+0000 7fe04ce71640 1 -- 172.21.15.45:0/3135121048 wait complete. 2023-12-08T08:16:09.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:09.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.443+0000 7fe2e717a640 1 Processor -- start 2023-12-08T08:16:09.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.443+0000 7fe2e717a640 1 -- start start 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e0158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2e006d1d0 0x7fe2e00c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2e006bdd0 0x7fe2e006c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e00c1ce0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e00c51f0 con 0x7fe2e006d1d0 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e717a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00c54d0 con 0x7fe2e00c59e0 2023-12-08T08:16:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.445+0000 7fe2e6979640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2e006bdd0 0x7fe2e006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2e006bdd0 0x7fe2e006c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43124/0 (socket says 172.21.15.45:43124) 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 -- 172.21.15.45:0/2463850422 learned_addr learned my addr 172.21.15.45:0/2463850422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6178640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e5977640 1 --2- 172.21.15.45:0/2463850422 >> v2:172.21.15.114:3300/0 conn(0x7fe2e006d1d0 0x7fe2e00c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 -- 172.21.15.45:0/2463850422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 msgr2=0x7fe2e0158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e0158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 -- 172.21.15.45:0/2463850422 >> v2:172.21.15.114:3300/0 conn(0x7fe2e006d1d0 msgr2=0x7fe2e00c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 --2- 172.21.15.45:0/2463850422 >> v2:172.21.15.114:3300/0 conn(0x7fe2e006d1d0 0x7fe2e00c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.446+0000 7fe2e6979640 1 -- 172.21.15.45:0/2463850422 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0157ba0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.447+0000 7fe2e6979640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e006c260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe2e006dee0 tx=0x7fe2d802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2866e7e657cac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.448+0000 7fe2e5176640 1 -- 172.21.15.45:0/2463850422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d802cb00 con 0x7fe2e006bdd0 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.448+0000 7fe2e5176640 1 -- 172.21.15.45:0/2463850422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d802cc60 con 0x7fe2e006bdd0 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.448+0000 7fe2e5176640 1 -- 172.21.15.45:0/2463850422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80343f0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.448+0000 7fe2e717a640 1 -- 172.21.15.45:0/2463850422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 msgr2=0x7fe2e006c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.448+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e006c260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe2e006dee0 tx=0x7fe2d802bf60 comp rx=0 tx=0).stop 2023-12-08T08:16:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 -- 172.21.15.45:0/2463850422 shutdown_connections 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2463850422 >> v2:172.21.15.114:3300/0 conn(0x7fe2e006d1d0 0x7fe2e00c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e006c260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2463850422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 -- 172.21.15.45:0/2463850422 >> 172.21.15.45:0/2463850422 conn(0x7fe2e0066ce0 msgr2=0x7fe2e00a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 -- 172.21.15.45:0/2463850422 shutdown_connections 2023-12-08T08:16:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.449+0000 7fe2e717a640 1 -- 172.21.15.45:0/2463850422 wait complete. 2023-12-08T08:16:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.451+0000 7fe2e717a640 1 Processor -- start 2023-12-08T08:16:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.451+0000 7fe2e717a640 1 -- start start 2023-12-08T08:16:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 0x7fe2e00a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e00aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00a67f0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00aa820 con 0x7fe2e006d1d0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e717a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00a6c40 con 0x7fe2e00c59e0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43128/0 (socket says 172.21.15.45:43128) 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 -- 172.21.15.45:0/2004154780 learned_addr learned my addr 172.21.15.45:0/2004154780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e5977640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 0x7fe2e00a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 -- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 msgr2=0x7fe2e00aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e00aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 -- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 msgr2=0x7fe2e00a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.453+0000 7fe2e6178640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 0x7fe2e00a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2e6178640 1 -- 172.21.15.45:0/2004154780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8009b30 con 0x7fe2e006bdd0 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2e5977640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 0x7fe2e00a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2e6178640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00d5f0 tx=0x7fe2dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0125f0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc012750 con 0x7fe2e006bdd0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc012b00 con 0x7fe2e006bdd0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e014d950 con 0x7fe2e006bdd0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.454+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e01f20a0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.455+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e00678c0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.456+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2dc012c60 con 0x7fe2e006bdd0 2023-12-08T08:16:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.457+0000 7fe2d6ffd640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.457+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2dc089e70 con 0x7fe2e006bdd0 2023-12-08T08:16:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.458+0000 7fe2e5977640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.458+0000 7fe2e5977640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 0x7fe2c406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00bebe0 tx=0x7fe2d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.462+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2dc054b50 con 0x7fe2e006bdd0 2023-12-08T08:16:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.653+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2e00743e0 con 0x7fe2e006bdd0 2023-12-08T08:16:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.655+0000 7fe2d6ffd640 1 -- 172.21.15.45:0/2004154780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2dc058170 con 0x7fe2e006bdd0 2023-12-08T08:16:09.656 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 msgr2=0x7fe2c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 0x7fe2c406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00bebe0 tx=0x7fe2d0008040 comp rx=0 tx=0).stop 2023-12-08T08:16:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 msgr2=0x7fe2e00c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00d5f0 tx=0x7fe2dc00dab0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 shutdown_connections 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2c406ae70 0x7fe2c406d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e00c59e0 0x7fe2e00aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e006d1d0 0x7fe2e00a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 --2- 172.21.15.45:0/2004154780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e006bdd0 0x7fe2e00c2270 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.657+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 >> 172.21.15.45:0/2004154780 conn(0x7fe2e0066ce0 msgr2=0x7fe2e0154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.658+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 shutdown_connections 2023-12-08T08:16:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.658+0000 7fe2e717a640 1 -- 172.21.15.45:0/2004154780 wait complete. 2023-12-08T08:16:09.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:16:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.911+0000 7f8a87948640 1 Processor -- start 2023-12-08T08:16:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.911+0000 7f8a87948640 1 -- start start 2023-12-08T08:16:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a87948640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a800c1ff0 0x7f8a80154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a87948640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a800c51d0 0x7f8a80154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a87948640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a800c0d40 con 0x7f8a80147bb0 2023-12-08T08:16:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a87948640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a801555c0 con 0x7f8a800c1ff0 2023-12-08T08:16:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a87948640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800a4d10 con 0x7f8a800c51d0 2023-12-08T08:16:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a84ee3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a800c1ff0 0x7f8a80154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a84ee3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a800c1ff0 0x7f8a80154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43142/0 (socket says 172.21.15.45:43142) 2023-12-08T08:16:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a84ee3640 1 -- 172.21.15.45:0/3790148409 learned_addr learned my addr 172.21.15.45:0/3790148409 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.913+0000 7f8a85ee5640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a800c51d0 0x7f8a80154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.914+0000 7f8a84ee3640 1 -- 172.21.15.45:0/3790148409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a800c51d0 msgr2=0x7f8a80154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.914+0000 7f8a84ee3640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a800c51d0 0x7f8a80154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.914+0000 7f8a84ee3640 1 -- 172.21.15.45:0/3790148409 >> v1:172.21.15.114:6789/0 conn(0x7f8a80147bb0 legacy=0x7f8a800c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.914+0000 7f8a84ee3640 1 -- 172.21.15.45:0/3790148409 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800a4ff0 con 0x7f8a800c1ff0 2023-12-08T08:16:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.915+0000 7f8a84ee3640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800c1ff0 0x7f8a80154840 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c86053014ee2c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.915+0000 7f8a77fff640 1 -- 172.21.15.45:0/3790148409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70030840 con 0x7f8a800c1ff0 2023-12-08T08:16:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.915+0000 7f8a77fff640 1 -- 172.21.15.45:0/3790148409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a700309a0 con 0x7f8a800c1ff0 2023-12-08T08:16:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.915+0000 7f8a77fff640 1 -- 172.21.15.45:0/3790148409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70030d30 con 0x7f8a800c1ff0 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 -- 172.21.15.45:0/3790148409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800c1ff0 msgr2=0x7f8a80154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800c1ff0 0x7f8a80154840 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002b980 comp rx=0 tx=0).stop 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 -- 172.21.15.45:0/3790148409 shutdown_connections 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a800c51d0 0x7f8a80154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 --2- 172.21.15.45:0/3790148409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a800c1ff0 0x7f8a80154840 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 -- 172.21.15.45:0/3790148409 >> 172.21.15.45:0/3790148409 conn(0x7f8a800c2430 msgr2=0x7f8a800c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 -- 172.21.15.45:0/3790148409 shutdown_connections 2023-12-08T08:16:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.916+0000 7f8a87948640 1 -- 172.21.15.45:0/3790148409 wait complete. 2023-12-08T08:16:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.918+0000 7f8a87948640 1 Processor -- start 2023-12-08T08:16:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.918+0000 7f8a87948640 1 -- start start 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a800c51d0 0x7f8a801eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a80147bb0 0x7f8a80143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800a73f0 con 0x7f8a8014b2f0 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a801ee230 con 0x7f8a800c51d0 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.919+0000 7f8a87948640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8014d300 con 0x7f8a80147bb0 2023-12-08T08:16:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43156/0 (socket says 172.21.15.45:43156) 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 -- 172.21.15.45:0/891973961 learned_addr learned my addr 172.21.15.45:0/891973961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a856e4640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a800c51d0 0x7f8a801eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a84ee3640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a80147bb0 0x7f8a80143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 -- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a80147bb0 msgr2=0x7f8a80143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a80147bb0 0x7f8a80143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 -- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a800c51d0 msgr2=0x7f8a801eb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a800c51d0 0x7f8a801eb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.920+0000 7f8a85ee5640 1 -- 172.21.15.45:0/891973961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700094d0 con 0x7f8a8014b2f0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a85ee5640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007e40 tx=0x7f8a7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78014620 con 0x7f8a8014b2f0 2023-12-08T08:16:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7800ee90 con 0x7f8a8014b2f0 2023-12-08T08:16:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a801edf50 con 0x7f8a8014b2f0 2023-12-08T08:16:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780149e0 con 0x7f8a8014b2f0 2023-12-08T08:16:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.921+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8014d880 con 0x7f8a8014b2f0 2023-12-08T08:16:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.922+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a800a5ec0 con 0x7f8a8014b2f0 2023-12-08T08:16:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.923+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a78014b40 con 0x7f8a8014b2f0 2023-12-08T08:16:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.925+0000 7f8a75ffb640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.925+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a7808a350 con 0x7f8a8014b2f0 2023-12-08T08:16:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.925+0000 7f8a856e4640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.926+0000 7f8a856e4640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000f60 tx=0x7f8a7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:09.929+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a78055030 con 0x7f8a8014b2f0 2023-12-08T08:16:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.123+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8a80074670 con 0x7f8a8014b2f0 2023-12-08T08:16:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.124+0000 7f8a75ffb640 1 -- 172.21.15.45:0/891973961 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8a78058650 con 0x7f8a8014b2f0 2023-12-08T08:16:10.126 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 msgr2=0x7f8a6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 0x7f8a6406d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000f60 tx=0x7f8a7c009040 comp rx=0 tx=0).stop 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 msgr2=0x7f8a8014dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007e40 tx=0x7f8a7800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 shutdown_connections 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8a6406ae70 0x7f8a6406d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8a80147bb0 0x7f8a80143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a8014b2f0 0x7f8a8014dda0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 --2- 172.21.15.45:0/891973961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a800c51d0 0x7f8a801eb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 >> 172.21.15.45:0/891973961 conn(0x7f8a800c2430 msgr2=0x7f8a800a5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 shutdown_connections 2023-12-08T08:16:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.127+0000 7f8a87948640 1 -- 172.21.15.45:0/891973961 wait complete. 2023-12-08T08:16:10.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:16:10.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.375+0000 7f49bd754640 1 Processor -- start 2023-12-08T08:16:10.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.375+0000 7f49bd754640 1 -- start start 2023-12-08T08:16:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bd754640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bd754640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b80c7ec0 con 0x7f49b806b960 2023-12-08T08:16:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bd754640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b80c6b30 con 0x7f49b80c7a40 2023-12-08T08:16:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bd754640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c6e10 con 0x7f49b814e310 2023-12-08T08:16:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bcf53640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f49b806b960 0x7f49b80c44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45064/0 (socket says 172.21.15.45:45064) 2023-12-08T08:16:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49bcf53640 1 -- 172.21.15.45:0/3400963094 learned_addr learned my addr 172.21.15.45:0/3400963094 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.377+0000 7f49b7fff640 1 --2- 172.21.15.45:0/3400963094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.378+0000 7f49b77fe640 1 -- 172.21.15.45:0/3400963094 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419848090 0 0) 0x7f49b80c7ec0 con 0x7f49b806b960 2023-12-08T08:16:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.378+0000 7f49b77fe640 1 -- 172.21.15.45:0/3400963094 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a4003520 con 0x7f49b806b960 2023-12-08T08:16:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.378+0000 7f49b7fff640 1 -- 172.21.15.45:0/3400963094 >> v1:172.21.15.114:6789/0 conn(0x7f49b80c7a40 legacy=0x7f49b8154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.378+0000 7f49b7fff640 1 -- 172.21.15.45:0/3400963094 >> v1:172.21.15.45:6789/0 conn(0x7f49b806b960 legacy=0x7f49b80c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.378+0000 7f49b7fff640 1 -- 172.21.15.45:0/3400963094 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b806ae80 con 0x7f49b814e310 2023-12-08T08:16:10.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.380+0000 7f49b7fff640 1 --2- 172.21.15.45:0/3400963094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c6550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009dc0 tx=0x7f49a802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e865551f07ef6d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.380+0000 7f49b77fe640 1 -- 172.21.15.45:0/3400963094 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a802cc40 con 0x7f49b814e310 2023-12-08T08:16:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.380+0000 7f49b77fe640 1 -- 172.21.15.45:0/3400963094 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a802cda0 con 0x7f49b814e310 2023-12-08T08:16:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.380+0000 7f49b77fe640 1 -- 172.21.15.45:0/3400963094 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8034660 con 0x7f49b814e310 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 -- 172.21.15.45:0/3400963094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 msgr2=0x7f49b80c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 --2- 172.21.15.45:0/3400963094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c6550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009dc0 tx=0x7f49a802be90 comp rx=0 tx=0).stop 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 -- 172.21.15.45:0/3400963094 shutdown_connections 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 --2- 172.21.15.45:0/3400963094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c6550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 -- 172.21.15.45:0/3400963094 >> 172.21.15.45:0/3400963094 conn(0x7f49b80ab710 msgr2=0x7f49b80abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 -- 172.21.15.45:0/3400963094 shutdown_connections 2023-12-08T08:16:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.381+0000 7f49bd754640 1 -- 172.21.15.45:0/3400963094 wait complete. 2023-12-08T08:16:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.383+0000 7f49bd754640 1 Processor -- start 2023-12-08T08:16:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.383+0000 7f49bd754640 1 -- start start 2023-12-08T08:16:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b806b960 0x7f49b80acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81e77f0 con 0x7f49b80c7a40 2023-12-08T08:16:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c0d40 con 0x7f49b806b960 2023-12-08T08:16:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49bd754640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c1020 con 0x7f49b814e310 2023-12-08T08:16:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43172/0 (socket says 172.21.15.45:43172) 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.384+0000 7f49af7fe640 1 -- 172.21.15.45:0/318839293 learned_addr learned my addr 172.21.15.45:0/318839293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49b7fff640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b806b960 0x7f49b80acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49bcf53640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 -- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 msgr2=0x7f49b80c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 -- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b806b960 msgr2=0x7f49b80acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b806b960 0x7f49b80acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 -- 172.21.15.45:0/318839293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009a70 con 0x7f49b80c7a40 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.385+0000 7f49af7fe640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c450 tx=0x7f49a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.386+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a00052d0 con 0x7f49b80c7a40 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.386+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0005430 con 0x7f49b80c7a40 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.386+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0012870 con 0x7f49b80c7a40 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.386+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b80c1300 con 0x7f49b80c7a40 2023-12-08T08:16:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.386+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b80c18c0 con 0x7f49b80c7a40 2023-12-08T08:16:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.387+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b80c1ae0 con 0x7f49b80c7a40 2023-12-08T08:16:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.388+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49a00129d0 con 0x7f49b80c7a40 2023-12-08T08:16:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.389+0000 7f49b57fa640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 0x7f499806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.389+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f49a0089480 con 0x7f49b80c7a40 2023-12-08T08:16:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.389+0000 7f49b7fff640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 0x7f499806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.390+0000 7f49b7fff640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 0x7f499806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49a8036000 tx=0x7f49a8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.393+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49a0054160 con 0x7f49b80c7a40 2023-12-08T08:16:10.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.602+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49b80721b0 con 0x7f49b80c7a40 2023-12-08T08:16:10.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.603+0000 7f49b57fa640 1 -- 172.21.15.45:0/318839293 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49a0057780 con 0x7f49b80c7a40 2023-12-08T08:16:10.604 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.605+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 msgr2=0x7f499806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.605+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 0x7f499806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f49a8036000 tx=0x7f49a8030000 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.605+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 msgr2=0x7f49b80af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.605+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c450 tx=0x7f49a000c910 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 shutdown_connections 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499806ae40 0x7f499806d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b814e310 0x7f49b80c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80c7a40 0x7f49b80af520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 --2- 172.21.15.45:0/318839293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b806b960 0x7f49b80acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 >> 172.21.15.45:0/318839293 conn(0x7f49b80ab710 msgr2=0x7f49b80a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 shutdown_connections 2023-12-08T08:16:10.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:10.606+0000 7f49bd754640 1 -- 172.21.15.45:0/318839293 wait complete. 2023-12-08T08:16:10.628 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:16:10.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:10.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-08T08:16:10.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:16:10.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:10.740 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:16:10.804 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:16:10.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.034+0000 7f52689ff640 1 Processor -- start 2023-12-08T08:16:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.034+0000 7f52689ff640 1 -- start start 2023-12-08T08:16:11.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.035+0000 7f52689ff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f526415b580 0x7f52641587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f52689ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52640c0100 0x7f526406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f52689ff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f526406ce20 0x7f5264159e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f52689ff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640a79d0 con 0x7f526415b580 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f52689ff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640c0870 con 0x7f526406ce20 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f52689ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c0b50 con 0x7f52640c0100 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f526415b580 0x7f52641587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f526415b580 0x7f52641587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43174/0 (socket says 172.21.15.45:43174) 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 -- 172.21.15.45:0/688855886 learned_addr learned my addr 172.21.15.45:0/688855886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:11.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 -- 172.21.15.45:0/688855886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52640c0100 msgr2=0x7f526406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 --2- 172.21.15.45:0/688855886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52640c0100 0x7f526406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 -- 172.21.15.45:0/688855886 >> v2:172.21.15.114:3300/0 conn(0x7f526406ce20 msgr2=0x7f5264159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 --2- 172.21.15.45:0/688855886 >> v2:172.21.15.114:3300/0 conn(0x7f526406ce20 0x7f5264159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.036+0000 7f5262d9d640 1 -- 172.21.15.45:0/688855886 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640c0e30 con 0x7f526415b580 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.038+0000 7f5262d9d640 1 --2- 172.21.15.45:0/688855886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526415b580 0x7f52641587e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f526406ba90 tx=0x7f525402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbd497f4b55fa16 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.038+0000 7f526259c640 1 -- 172.21.15.45:0/688855886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540317d0 con 0x7f526415b580 2023-12-08T08:16:11.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.038+0000 7f526259c640 1 -- 172.21.15.45:0/688855886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254031930 con 0x7f526415b580 2023-12-08T08:16:11.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.038+0000 7f526259c640 1 -- 172.21.15.45:0/688855886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254031cc0 con 0x7f526415b580 2023-12-08T08:16:11.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 -- 172.21.15.45:0/688855886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526415b580 msgr2=0x7f52641587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 --2- 172.21.15.45:0/688855886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526415b580 0x7f52641587e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f526406ba90 tx=0x7f525402b870 comp rx=0 tx=0).stop 2023-12-08T08:16:11.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 -- 172.21.15.45:0/688855886 shutdown_connections 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 --2- 172.21.15.45:0/688855886 >> v2:172.21.15.114:3300/0 conn(0x7f526406ce20 0x7f5264159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 --2- 172.21.15.45:0/688855886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52640c0100 0x7f526406c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 --2- 172.21.15.45:0/688855886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526415b580 0x7f52641587e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 -- 172.21.15.45:0/688855886 >> 172.21.15.45:0/688855886 conn(0x7f52640c5780 msgr2=0x7f52640c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 -- 172.21.15.45:0/688855886 shutdown_connections 2023-12-08T08:16:11.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.039+0000 7f52689ff640 1 -- 172.21.15.45:0/688855886 wait complete. 2023-12-08T08:16:11.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.041+0000 7f52689ff640 1 Processor -- start 2023-12-08T08:16:11.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.041+0000 7f52689ff640 1 -- start start 2023-12-08T08:16:11.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52640c0100 0x7f52640a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 0x7f526414a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640a5590 con 0x7f526406ce20 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52641f27d0 con 0x7f52640c0100 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f52689ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52641f1c50 con 0x7f526415b580 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43186/0 (socket says 172.21.15.45:43186) 2023-12-08T08:16:11.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 -- 172.21.15.45:0/789895199 learned_addr learned my addr 172.21.15.45:0/789895199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:11.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f525bfff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52640c0100 0x7f52640a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f526359e640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 0x7f526414a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 -- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 msgr2=0x7f526414a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 0x7f526414a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 -- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52640c0100 msgr2=0x7f52640a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52640c0100 0x7f52640a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.042+0000 7f5262d9d640 1 -- 172.21.15.45:0/789895199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540094d0 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f526359e640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 0x7f526414a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f5262d9d640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f525402b8b0 tx=0x7f52540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540329b0 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254032b30 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540453f0 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52641f1f30 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.043+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52641f24f0 con 0x7f526406ce20 2023-12-08T08:16:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.045+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52640743e0 con 0x7f526406ce20 2023-12-08T08:16:11.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.046+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5254030070 con 0x7f526406ce20 2023-12-08T08:16:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.046+0000 7f525b7fe640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 0x7f524406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.047+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52540ab4f0 con 0x7f526406ce20 2023-12-08T08:16:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.047+0000 7f525bfff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 0x7f524406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.047+0000 7f525bfff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 0x7f524406d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f526414eba0 tx=0x7f524c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.051+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5254076400 con 0x7f526406ce20 2023-12-08T08:16:11.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.287+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52640718f0 con 0x7f526406ce20 2023-12-08T08:16:11.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.288+0000 7f525b7fe640 1 -- 172.21.15.45:0/789895199 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f5254079a20 con 0x7f526406ce20 2023-12-08T08:16:11.290 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:11.290 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:16:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 msgr2=0x7f524406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 0x7f524406d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f526414eba0 tx=0x7f524c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 msgr2=0x7f52641ee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f525402b8b0 tx=0x7f52540046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 shutdown_connections 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f524406ae90 0x7f524406d350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f526415b580 0x7f526414a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52640c0100 0x7f52640a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 --2- 172.21.15.45:0/789895199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f526406ce20 0x7f52641ee280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 >> 172.21.15.45:0/789895199 conn(0x7f52640c5780 msgr2=0x7f52640a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 shutdown_connections 2023-12-08T08:16:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.291+0000 7f52689ff640 1 -- 172.21.15.45:0/789895199 wait complete. 2023-12-08T08:16:11.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.536+0000 7ff9ca154640 1 Processor -- start 2023-12-08T08:16:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.536+0000 7ff9ca154640 1 -- start start 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9ca154640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c41521b0 0x7ff9c414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9ca154640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c4155850 con 0x7ff9c40a7910 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9ca154640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40c0890 con 0x7ff9c414fb20 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9ca154640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c40c0b70 con 0x7ff9c41521b0 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9c8951640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c41521b0 0x7ff9c414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9c8951640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c41521b0 0x7ff9c414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43188/0 (socket says 172.21.15.45:43188) 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9c8951640 1 -- 172.21.15.45:0/650596661 learned_addr learned my addr 172.21.15.45:0/650596661 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.538+0000 7ff9c9152640 1 --1- 172.21.15.45:0/650596661 >> v1:172.21.15.45:6789/0 conn(0x7ff9c40a7910 0x7ff9c40c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45070/0 (socket says 172.21.15.45:45070) 2023-12-08T08:16:11.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.539+0000 7ff9c8951640 1 -- 172.21.15.45:0/650596661 >> v1:172.21.15.114:6789/0 conn(0x7ff9c414fb20 legacy=0x7ff9c4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:11.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.539+0000 7ff9c8951640 1 -- 172.21.15.45:0/650596661 >> v1:172.21.15.45:6789/0 conn(0x7ff9c40a7910 legacy=0x7ff9c40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.539+0000 7ff9c8951640 1 -- 172.21.15.45:0/650596661 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40c0e50 con 0x7ff9c41521b0 2023-12-08T08:16:11.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.540+0000 7ff9c8951640 1 --2- 172.21.15.45:0/650596661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414f5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009870 tx=0x7ff9b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b03185184576b7a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.540+0000 7ff9bbfff640 1 -- 172.21.15.45:0/650596661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4031870 con 0x7ff9c41521b0 2023-12-08T08:16:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.540+0000 7ff9bbfff640 1 -- 172.21.15.45:0/650596661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40319d0 con 0x7ff9c41521b0 2023-12-08T08:16:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.540+0000 7ff9bbfff640 1 -- 172.21.15.45:0/650596661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4031d60 con 0x7ff9c41521b0 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 -- 172.21.15.45:0/650596661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 msgr2=0x7ff9c414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 --2- 172.21.15.45:0/650596661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414f5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009870 tx=0x7ff9b402b910 comp rx=0 tx=0).stop 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 -- 172.21.15.45:0/650596661 shutdown_connections 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 --2- 172.21.15.45:0/650596661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414f5e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 -- 172.21.15.45:0/650596661 >> 172.21.15.45:0/650596661 conn(0x7ff9c40c5780 msgr2=0x7ff9c40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 -- 172.21.15.45:0/650596661 shutdown_connections 2023-12-08T08:16:11.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.541+0000 7ff9ca154640 1 -- 172.21.15.45:0/650596661 wait complete. 2023-12-08T08:16:11.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.543+0000 7ff9ca154640 1 Processor -- start 2023-12-08T08:16:11.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.543+0000 7ff9ca154640 1 -- start start 2023-12-08T08:16:11.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 0x7ff9c4151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 0x7ff9c414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c3b90 con 0x7ff9c41521b0 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4155000 con 0x7ff9c414fb20 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9ca154640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c38b0 con 0x7ff9c40a7910 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9c9953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9c9953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43198/0 (socket says 172.21.15.45:43198) 2023-12-08T08:16:11.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9c9953640 1 -- 172.21.15.45:0/1784663330 learned_addr learned my addr 172.21.15.45:0/1784663330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:11.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9c9152640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 0x7ff9c4151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.544+0000 7ff9c8951640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 0x7ff9c414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 -- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 msgr2=0x7ff9c4151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 0x7ff9c4151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 -- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 msgr2=0x7ff9c414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 0x7ff9c414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 -- 172.21.15.45:0/1784663330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40094d0 con 0x7ff9c41521b0 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9152640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 0x7ff9c4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c8951640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 0x7ff9c414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9c9953640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c7b0 tx=0x7ff9bc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc004b60 con 0x7ff9c41521b0 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc004cc0 con 0x7ff9c41521b0 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00aa90 con 0x7ff9c41521b0 2023-12-08T08:16:11.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40a6fd0 con 0x7ff9c41521b0 2023-12-08T08:16:11.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.545+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c414c370 con 0x7ff9c41521b0 2023-12-08T08:16:11.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.546+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c40aa4c0 con 0x7ff9c41521b0 2023-12-08T08:16:11.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.547+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9bc00abf0 con 0x7ff9c41521b0 2023-12-08T08:16:11.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.548+0000 7ff9b9ffb640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 0x7ff9a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:11.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.548+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9bc089ab0 con 0x7ff9c41521b0 2023-12-08T08:16:11.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.549+0000 7ff9c9152640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 0x7ff9a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:11.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.549+0000 7ff9c9152640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 0x7ff9a806d350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000f60 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.553+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9bc054810 con 0x7ff9c41521b0 2023-12-08T08:16:11.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.750+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c40743e0 con 0x7ff9c41521b0 2023-12-08T08:16:11.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.752+0000 7ff9b9ffb640 1 -- 172.21.15.45:0/1784663330 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7ff9bc057e30 con 0x7ff9c41521b0 2023-12-08T08:16:11.755 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:11.755 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:11.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.754+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 msgr2=0x7ff9a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.754+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 0x7ff9a806d350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000f60 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.754+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 msgr2=0x7ff9c414be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.754+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c7b0 tx=0x7ff9bc00cc70 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 shutdown_connections 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff9a806ae90 0x7ff9a806d350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c41521b0 0x7ff9c414be30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9c414fb20 0x7ff9c414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 --2- 172.21.15.45:0/1784663330 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff9c40a7910 0x7ff9c4151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 >> 172.21.15.45:0/1784663330 conn(0x7ff9c40c5780 msgr2=0x7ff9c40a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 shutdown_connections 2023-12-08T08:16:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:11.755+0000 7ff9ca154640 1 -- 172.21.15.45:0/1784663330 wait complete. 2023-12-08T08:16:11.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:14:58.230465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:14:59.351442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:15:02.441893+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:16:11.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.007+0000 7fc09f59e640 1 Processor -- start 2023-12-08T08:16:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.007+0000 7fc09f59e640 1 -- start start 2023-12-08T08:16:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0a00c1d60 0x7fc0a006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00aa2d0 0x7fc0a006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09f59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a00c16b0 con 0x7fc0a0151ec0 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00a8b30 con 0x7fc0a00c1d60 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00c65d0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.008+0000 7fc09dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0a00c1d60 0x7fc0a006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0a00c1d60 0x7fc0a006ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43210/0 (socket says 172.21.15.45:43210) 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 -- 172.21.15.45:0/192812324 learned_addr learned my addr 172.21.15.45:0/192812324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 -- 172.21.15.45:0/192812324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00aa2d0 msgr2=0x7fc0a006bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 --2- 172.21.15.45:0/192812324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00aa2d0 0x7fc0a006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 -- 172.21.15.45:0/192812324 >> v1:172.21.15.114:6789/0 conn(0x7fc0a0151ec0 legacy=0x7fc0a00c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.009+0000 7fc09dd9b640 1 -- 172.21.15.45:0/192812324 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a006c490 con 0x7fc0a00c1d60 2023-12-08T08:16:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.010+0000 7fc09dd9b640 1 --2- 172.21.15.45:0/192812324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00c1d60 0x7fc0a006ba10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc088009870 tx=0x7fc08802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9af5ecc4a4d58f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.010+0000 7fc09d59a640 1 -- 172.21.15.45:0/192812324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088033620 con 0x7fc0a00c1d60 2023-12-08T08:16:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.010+0000 7fc09d59a640 1 -- 172.21.15.45:0/192812324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088033780 con 0x7fc0a00c1d60 2023-12-08T08:16:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.010+0000 7fc09d59a640 1 -- 172.21.15.45:0/192812324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088033b10 con 0x7fc0a00c1d60 2023-12-08T08:16:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 -- 172.21.15.45:0/192812324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00c1d60 msgr2=0x7fc0a006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 --2- 172.21.15.45:0/192812324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00c1d60 0x7fc0a006ba10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc088009870 tx=0x7fc08802b7d0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 -- 172.21.15.45:0/192812324 shutdown_connections 2023-12-08T08:16:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 --2- 172.21.15.45:0/192812324 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00aa2d0 0x7fc0a006bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 --2- 172.21.15.45:0/192812324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00c1d60 0x7fc0a006ba10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 -- 172.21.15.45:0/192812324 >> 172.21.15.45:0/192812324 conn(0x7fc0a0066ce0 msgr2=0x7fc0a00a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 -- 172.21.15.45:0/192812324 shutdown_connections 2023-12-08T08:16:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.011+0000 7fc09f59e640 1 -- 172.21.15.45:0/192812324 wait complete. 2023-12-08T08:16:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.013+0000 7fc09f59e640 1 Processor -- start 2023-12-08T08:16:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.013+0000 7fc09f59e640 1 -- start start 2023-12-08T08:16:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00c1d60 0x7fc0a0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a0151ec0 0x7fc0a01ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00707a0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0070a80 con 0x7fc0a0151ec0 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00724b0 con 0x7fc0a00c1d60 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43220/0 (socket says 172.21.15.45:43220) 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.014+0000 7fc09e59c640 1 -- 172.21.15.45:0/3475543218 learned_addr learned my addr 172.21.15.45:0/3475543218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09dd9b640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00c1d60 0x7fc0a0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 -- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00c1d60 msgr2=0x7fc0a0150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00c1d60 0x7fc0a0150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09ed9d640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a0151ec0 0x7fc0a01ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 -- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a0151ec0 msgr2=0x7fc0a01ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a0151ec0 0x7fc0a01ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 -- 172.21.15.45:0/3475543218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880094d0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc09e59c640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc09000ba50 tx=0x7fc09000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.015+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000cbe0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.016+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000cd80 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.016+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090014680 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.016+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0072790 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.016+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a014cb90 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.017+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0072320 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.018+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0900147e0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.019+0000 7fc096ffd640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 0x7fc08006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.019+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0900897b0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.019+0000 7fc09dd9b640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 0x7fc08006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.020+0000 7fc09dd9b640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 0x7fc08006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc088035000 tx=0x7fc088008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.023+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0900545e0 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.217+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0a00a5f60 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.218+0000 7fc096ffd640 1 -- 172.21.15.45:0/3475543218 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc090019020 con 0x7fc0a00aa2d0 2023-12-08T08:16:12.221 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 msgr2=0x7fc08006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 0x7fc08006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc088035000 tx=0x7fc088008030 comp rx=0 tx=0).stop 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 msgr2=0x7fc0a0150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc09000ba50 tx=0x7fc09000bf10 comp rx=0 tx=0).stop 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 shutdown_connections 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc08006ae70 0x7fc08006d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0a00c1d60 0x7fc0a0150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a0151ec0 0x7fc0a01ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 --2- 172.21.15.45:0/3475543218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0a00aa2d0 0x7fc0a0150740 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 >> 172.21.15.45:0/3475543218 conn(0x7fc0a0066ce0 msgr2=0x7fc0a00bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:12.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 shutdown_connections 2023-12-08T08:16:12.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.221+0000 7fc09f59e640 1 -- 172.21.15.45:0/3475543218 wait complete. 2023-12-08T08:16:12.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:12.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.477+0000 7f7bd09a4640 1 Processor -- start 2023-12-08T08:16:12.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.477+0000 7f7bd09a4640 1 -- start start 2023-12-08T08:16:12.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bd09a4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7bcc0c7ac0 0x7f7bcc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bd09a4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7bcc06aea0 0x7f7bcc06b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bd09a4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc06c690 con 0x7f7bcc151a50 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bd09a4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc158430 con 0x7f7bcc06aea0 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bd09a4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc151e30 con 0x7f7bcc0c7ac0 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bcad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7bcc151a50 0x7f7bcc0c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45074/0 (socket says 172.21.15.45:45074) 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.478+0000 7f7bcad9d640 1 -- 172.21.15.45:0/635754635 learned_addr learned my addr 172.21.15.45:0/635754635 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bc259c640 1 --2- 172.21.15.45:0/635754635 >> v2:172.21.15.114:3300/0 conn(0x7f7bcc0c7ac0 0x7f7bcc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534409916 0 0) 0x7f7bcc06c690 con 0x7f7bcc151a50 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb8003520 con 0x7f7bcc151a50 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> v2:172.21.15.45:3300/0 conn(0x7f7bcc06aea0 0x7f7bcc06b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181569088 0 0) 0x7f7bb8003520 con 0x7f7bcc151a50 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 >> v2:172.21.15.114:3300/0 conn(0x7f7bcc0c7ac0 msgr2=0x7f7bcc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 --2- 172.21.15.45:0/635754635 >> v2:172.21.15.114:3300/0 conn(0x7f7bcc0c7ac0 0x7f7bcc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 >> v2:172.21.15.45:3300/0 conn(0x7f7bcc06aea0 msgr2=0x7f7bcc06b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 --2- 172.21.15.45:0/635754635 >> v2:172.21.15.45:3300/0 conn(0x7f7bcc06aea0 0x7f7bcc06b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc157a90 con 0x7f7bcc151a50 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f7bbc001670 con 0x7f7bcc151a50 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> v2:172.21.15.45:3300/0 conn(0x7f7bcc06aea0 0x7f7bcc06b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.479+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 >> v1:172.21.15.45:6789/0 conn(0x7f7bcc151a50 legacy=0x7f7bcc0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bb80039c0 0x7f7bb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb80047c0 0x7f7bb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc158430 con 0x7f7bb8005180 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb800bfa0 con 0x7f7bb80047c0 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb800c160 con 0x7f7bb80039c0 2023-12-08T08:16:12.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bcad9d640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bb80039c0 0x7f7bb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.480+0000 7f7bc259c640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb80047c0 0x7f7bb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcb59e640 1 -- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bb80039c0 msgr2=0x7f7bb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bb80039c0 0x7f7bb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcb59e640 1 -- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb80047c0 msgr2=0x7f7bb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb80047c0 0x7f7bb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcb59e640 1 -- 172.21.15.45:0/635754635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8003520 con 0x7f7bb8005180 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.481+0000 7f7bcad9d640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bb80039c0 0x7f7bb8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.483+0000 7f7bcb59e640 1 -- 172.21.15.45:0/635754635 reap_dead start 2023-12-08T08:16:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.483+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bb800b980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40073e0 tx=0x7f7bb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132894f04df27453 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.483+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc402cdc0 con 0x7f7bb8005180 2023-12-08T08:16:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.483+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4034440 con 0x7f7bb8005180 2023-12-08T08:16:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.483+0000 7f7bca59c640 1 -- 172.21.15.45:0/635754635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40347f0 con 0x7f7bb8005180 2023-12-08T08:16:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 -- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 msgr2=0x7f7bb800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bb800b980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40073e0 tx=0x7f7bb80057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 -- 172.21.15.45:0/635754635 shutdown_connections 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/635754635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bb800b980 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 -- 172.21.15.45:0/635754635 >> 172.21.15.45:0/635754635 conn(0x7f7bcc0ab730 msgr2=0x7f7bcc0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 -- 172.21.15.45:0/635754635 shutdown_connections 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.484+0000 7f7bd09a4640 1 -- 172.21.15.45:0/635754635 wait complete. 2023-12-08T08:16:12.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.486+0000 7f7bd09a4640 1 Processor -- start 2023-12-08T08:16:12.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.486+0000 7f7bd09a4640 1 -- start start 2023-12-08T08:16:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bcc1524d0 0x7f7bcc14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bcc14d5e0 0x7f7bcc1ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c26b0 con 0x7f7bb8005180 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc1edc00 con 0x7f7bcc1524d0 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bd09a4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc14c290 con 0x7f7bcc14d5e0 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bcad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bcad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43246/0 (socket says 172.21.15.45:43246) 2023-12-08T08:16:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.487+0000 7f7bcad9d640 1 -- 172.21.15.45:0/2706060308 learned_addr learned my addr 172.21.15.45:0/2706060308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcb59e640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bcc14d5e0 0x7f7bcc1ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bc259c640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bcc1524d0 0x7f7bcc14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 -- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bcc14d5e0 msgr2=0x7f7bcc1ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bcc14d5e0 0x7f7bcc1ecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 -- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bcc1524d0 msgr2=0x7f7bcc14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bcc1524d0 0x7f7bcc14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 -- 172.21.15.45:0/2706060308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc149830 con 0x7f7bb8005180 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bcad9d640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e7f0 tx=0x7f7bbc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00eea0 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00c870 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc0c2890 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.488+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00cc20 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.489+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc0c2e50 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.490+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc0743e0 con 0x7f7bb8005180 2023-12-08T08:16:12.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.491+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bbc013420 con 0x7f7bb8005180 2023-12-08T08:16:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.492+0000 7f7bc3fff640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 0x7f7bac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.492+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7bbc0894f0 con 0x7f7bb8005180 2023-12-08T08:16:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.492+0000 7f7bc259c640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 0x7f7bac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.493+0000 7f7bc259c640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 0x7f7bac06d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc14bc90 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.497+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7bbc057c60 con 0x7f7bb8005180 2023-12-08T08:16:12.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.692+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bcc149830 con 0x7f7bb8005180 2023-12-08T08:16:12.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.692+0000 7f7bc3fff640 1 -- 172.21.15.45:0/2706060308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bcc149830 con 0x7f7bb8005180 2023-12-08T08:16:12.695 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.695+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 msgr2=0x7f7bac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.695+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 0x7f7bac06d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc14bc90 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.695+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 msgr2=0x7f7bcc1492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.695+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e7f0 tx=0x7f7bbc00ecb0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 shutdown_connections 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7bac06ae70 0x7f7bac06d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7bcc14d5e0 0x7f7bcc1ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bcc1524d0 0x7f7bcc14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 --2- 172.21.15.45:0/2706060308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bb8005180 0x7f7bcc1492f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 >> 172.21.15.45:0/2706060308 conn(0x7f7bcc0ab730 msgr2=0x7f7bcc0aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:12.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 shutdown_connections 2023-12-08T08:16:12.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.696+0000 7f7bd09a4640 1 -- 172.21.15.45:0/2706060308 wait complete. 2023-12-08T08:16:12.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.948+0000 7f984da25640 1 Processor -- start 2023-12-08T08:16:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.949+0000 7f984da25640 1 -- start start 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f984814ae10 0x7f98480c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98480c8200 0x7f98480c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 0x7f98480c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9848155050 con 0x7f98480c8200 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9848154460 con 0x7f98480c4a60 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.950+0000 7f984da25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9848154720 con 0x7f984814ae10 2023-12-08T08:16:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98480c8200 0x7f98480c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98480c8200 0x7f98480c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43260/0 (socket says 172.21.15.45:43260) 2023-12-08T08:16:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 -- 172.21.15.45:0/3834310846 learned_addr learned my addr 172.21.15.45:0/3834310846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f984ca23640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f984814ae10 0x7f98480c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f984d224640 1 --2- 172.21.15.45:0/3834310846 >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 0x7f98480c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 -- 172.21.15.45:0/3834310846 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f984814ae10 msgr2=0x7f98480c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f984814ae10 0x7f98480c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 -- 172.21.15.45:0/3834310846 >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 msgr2=0x7f98480c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 --2- 172.21.15.45:0/3834310846 >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 0x7f98480c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f9847fff640 1 -- 172.21.15.45:0/3834310846 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848154a00 con 0x7f98480c8200 2023-12-08T08:16:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.951+0000 7f984d224640 1 --2- 172.21.15.45:0/3834310846 >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 0x7f98480c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.952+0000 7f9847fff640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98480c8200 0x7f98480c4520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98480bd390 tx=0x7f983c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74ce4a7353f4caa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.953+0000 7f98477fe640 1 -- 172.21.15.45:0/3834310846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c004030 con 0x7f98480c8200 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.953+0000 7f98477fe640 1 -- 172.21.15.45:0/3834310846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c004190 con 0x7f98480c8200 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.953+0000 7f98477fe640 1 -- 172.21.15.45:0/3834310846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c003610 con 0x7f98480c8200 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.953+0000 7f984da25640 1 -- 172.21.15.45:0/3834310846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98480c8200 msgr2=0x7f98480c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.953+0000 7f984da25640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98480c8200 0x7f98480c4520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98480bd390 tx=0x7f983c02b7c0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 -- 172.21.15.45:0/3834310846 shutdown_connections 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 --2- 172.21.15.45:0/3834310846 >> v2:172.21.15.114:3300/0 conn(0x7f98480c4a60 0x7f98480c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98480c8200 0x7f98480c4520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 --2- 172.21.15.45:0/3834310846 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f984814ae10 0x7f98480c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 -- 172.21.15.45:0/3834310846 >> 172.21.15.45:0/3834310846 conn(0x7f98480ab730 msgr2=0x7f98480abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 -- 172.21.15.45:0/3834310846 shutdown_connections 2023-12-08T08:16:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.954+0000 7f984da25640 1 -- 172.21.15.45:0/3834310846 wait complete. 2023-12-08T08:16:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.956+0000 7f984da25640 1 Processor -- start 2023-12-08T08:16:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.956+0000 7f984da25640 1 -- start start 2023-12-08T08:16:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98480c4a60 0x7f984814b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98480c8200 0x7f98481514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984814cb90 con 0x7f984814ae10 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984814fd30 con 0x7f98480c8200 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984da25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480c21d0 con 0x7f98480c4a60 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984d224640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984d224640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43262/0 (socket says 172.21.15.45:43262) 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.957+0000 7f984d224640 1 -- 172.21.15.45:0/355020167 learned_addr learned my addr 172.21.15.45:0/355020167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984ca23640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98480c4a60 0x7f984814b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f9847fff640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98480c8200 0x7f98481514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 -- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98480c4a60 msgr2=0x7f984814b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98480c4a60 0x7f984814b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 -- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98480c8200 msgr2=0x7f98481514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98480c8200 0x7f98481514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 -- 172.21.15.45:0/355020167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c009460 con 0x7f984814ae10 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984d224640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f984000c7f0 tx=0x7f984000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840007820 con 0x7f984814ae10 2023-12-08T08:16:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840007980 con 0x7f984814ae10 2023-12-08T08:16:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840007d30 con 0x7f984814ae10 2023-12-08T08:16:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.958+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98481ea660 con 0x7f984814ae10 2023-12-08T08:16:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.959+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984814d0c0 con 0x7f984814ae10 2023-12-08T08:16:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.960+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98480673e0 con 0x7f984814ae10 2023-12-08T08:16:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.961+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98400113f0 con 0x7f984814ae10 2023-12-08T08:16:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.962+0000 7f98457fa640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 0x7f983406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.962+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9840089cd0 con 0x7f984814ae10 2023-12-08T08:16:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.962+0000 7f984ca23640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 0x7f983406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.963+0000 7f984ca23640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 0x7f983406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98380099c0 tx=0x7f9838003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:12.966+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9840054b10 con 0x7f984814ae10 2023-12-08T08:16:13.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.164+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98480ca4a0 con 0x7f984814ae10 2023-12-08T08:16:13.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.165+0000 7f98457fa640 1 -- 172.21.15.45:0/355020167 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f984001f0a0 con 0x7f984814ae10 2023-12-08T08:16:13.168 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:13.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.167+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 msgr2=0x7f983406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.167+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 0x7f983406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98380099c0 tx=0x7f9838003990 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.167+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 msgr2=0x7f984814d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f984000c7f0 tx=0x7f984000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 shutdown_connections 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f983406ae40 0x7f983406d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f984814ae10 0x7f984814d8c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98480c8200 0x7f98481514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 --2- 172.21.15.45:0/355020167 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98480c4a60 0x7f984814b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 >> 172.21.15.45:0/355020167 conn(0x7f98480ab730 msgr2=0x7f98480a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 shutdown_connections 2023-12-08T08:16:13.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.168+0000 7f984da25640 1 -- 172.21.15.45:0/355020167 wait complete. 2023-12-08T08:16:13.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:16:13.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.418+0000 7fa4671a0640 1 Processor -- start 2023-12-08T08:16:13.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.419+0000 7fa4671a0640 1 -- start start 2023-12-08T08:16:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.420+0000 7fa4671a0640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 0x7fa4600a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.420+0000 7fa4671a0640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa460155790 0x7fa460155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.420+0000 7fa4671a0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600c60c0 con 0x7fa46014c280 2023-12-08T08:16:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.420+0000 7fa4671a0640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa460152dc0 con 0x7fa460155790 2023-12-08T08:16:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.420+0000 7fa4671a0640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601521d0 con 0x7fa4600c4970 2023-12-08T08:16:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46619e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa46014c280 0x7fa46006cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45088/0 (socket says 172.21.15.45:45088) 2023-12-08T08:16:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46619e640 1 -- 172.21.15.45:0/4195144310 learned_addr learned my addr 172.21.15.45:0/4195144310 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46599d640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 0x7fa4600a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674538655 0 0) 0x7fa45c001110 con 0x7fa46014c280 2023-12-08T08:16:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46699f640 1 --2- 172.21.15.45:0/4195144310 >> v2:172.21.15.114:3300/0 conn(0x7fa460155790 0x7fa460155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.421+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa44c003520 con 0x7fa46014c280 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883684817 0 0) 0x7fa44c003520 con 0x7fa46014c280 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 msgr2=0x7fa4600a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 0x7fa4600a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 >> v2:172.21.15.114:3300/0 conn(0x7fa460155790 msgr2=0x7fa460155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 --2- 172.21.15.45:0/4195144310 >> v2:172.21.15.114:3300/0 conn(0x7fa460155790 0x7fa460155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46014c660 con 0x7fa46014c280 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fa45c001800 con 0x7fa46014c280 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 >> v1:172.21.15.45:6789/0 conn(0x7fa46014c280 legacy=0x7fa46006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa44c003970 0x7fa44c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 0x7fa44c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c004d00 0x7fa44c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460152dc0 con 0x7fa44c003970 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601521d0 con 0x7fa44c004d00 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c00b9b0 con 0x7fa4600c4970 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.422+0000 7fa46619e640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa44c003970 0x7fa44c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.423+0000 7fa46619e640 1 -- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 msgr2=0x7fa44c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.423+0000 7fa46619e640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4600c4970 0x7fa44c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.423+0000 7fa46619e640 1 -- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c004d00 msgr2=0x7fa44c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.423+0000 7fa46619e640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa44c004d00 0x7fa44c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.423+0000 7fa46619e640 1 -- 172.21.15.45:0/4195144310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c003520 con 0x7fa44c003970 2023-12-08T08:16:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa46619e640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa44c003970 0x7fa44c003d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c110 tx=0x7fa44c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dce38258490a92 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c005ad0 con 0x7fa44c003970 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c005c30 con 0x7fa44c003970 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa46519c640 1 -- 172.21.15.45:0/4195144310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c02c810 con 0x7fa44c003970 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa4671a0640 1 -- 172.21.15.45:0/4195144310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa44c003970 msgr2=0x7fa44c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.424+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4195144310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa44c003970 0x7fa44c003d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c110 tx=0x7fa44c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.425+0000 7fa46699f640 1 -- 172.21.15.45:0/4195144310 reap_dead start 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.425+0000 7fa4671a0640 1 -- 172.21.15.45:0/4195144310 shutdown_connections 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.425+0000 7fa4671a0640 1 -- 172.21.15.45:0/4195144310 >> 172.21.15.45:0/4195144310 conn(0x7fa460066ce0 msgr2=0x7fa4600a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.425+0000 7fa4671a0640 1 -- 172.21.15.45:0/4195144310 shutdown_connections 2023-12-08T08:16:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.425+0000 7fa4671a0640 1 -- 172.21.15.45:0/4195144310 wait complete. 2023-12-08T08:16:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.426+0000 7fa4671a0640 1 Processor -- start 2023-12-08T08:16:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.427+0000 7fa4671a0640 1 -- start start 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c003970 0x7fa4600bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 0x7fa4601edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600a5f60 con 0x7fa460153250 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601ed270 con 0x7fa4600a54a0 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa4671a0640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600aa3c0 con 0x7fa44c003970 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46599d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46599d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43282/0 (socket says 172.21.15.45:43282) 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46599d640 1 -- 172.21.15.45:0/4128591440 learned_addr learned my addr 172.21.15.45:0/4128591440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46619e640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c003970 0x7fa4600bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46699f640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 0x7fa4601edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.428+0000 7fa46599d640 1 -- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c003970 msgr2=0x7fa4600bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46599d640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c003970 0x7fa4600bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46599d640 1 -- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 msgr2=0x7fa4601edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46599d640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 0x7fa4601edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46599d640 1 -- 172.21.15.45:0/4128591440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4601ee180 con 0x7fa460153250 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46699f640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 0x7fa4601edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa46599d640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e7f0 tx=0x7fa45000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000c8e0 con 0x7fa460153250 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000ca40 con 0x7fa460153250 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000cdd0 con 0x7fa460153250 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa460146140 con 0x7fa460153250 2023-12-08T08:16:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.429+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa460153e50 con 0x7fa460153250 2023-12-08T08:16:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.431+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4601ed400 con 0x7fa460153250 2023-12-08T08:16:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.432+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa450013470 con 0x7fa460153250 2023-12-08T08:16:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.432+0000 7fa456ffd640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 0x7fa44406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.433+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa450089a50 con 0x7fa460153250 2023-12-08T08:16:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.433+0000 7fa46619e640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 0x7fa44406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.433+0000 7fa46619e640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 0x7fa44406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa45c034000 tx=0x7fa45c007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.437+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa450054740 con 0x7fa460153250 2023-12-08T08:16:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.629+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4600678c0 con 0x7fa460153250 2023-12-08T08:16:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.630+0000 7fa456ffd640 1 -- 172.21.15.45:0/4128591440 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa450057d60 con 0x7fa460153250 2023-12-08T08:16:13.633 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 msgr2=0x7fa44406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 0x7fa44406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa45c034000 tx=0x7fa45c007000 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 msgr2=0x7fa4601ed700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e7f0 tx=0x7fa45000ecb0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 shutdown_connections 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44406ae40 0x7fa44406d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4600a54a0 0x7fa4601edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460153250 0x7fa4601ed700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 --2- 172.21.15.45:0/4128591440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa44c003970 0x7fa4600bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 >> 172.21.15.45:0/4128591440 conn(0x7fa460066ce0 msgr2=0x7fa4600c56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 shutdown_connections 2023-12-08T08:16:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.633+0000 7fa4671a0640 1 -- 172.21.15.45:0/4128591440 wait complete. 2023-12-08T08:16:13.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.884+0000 7f1d391bc640 1 Processor -- start 2023-12-08T08:16:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.885+0000 7f1d391bc640 1 -- start start 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d391bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d341584c0 0x7f1d340ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d391bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d341588d0 con 0x7f1d341519c0 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d391bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340c4a00 con 0x7f1d340c44d0 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d391bc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340c8160 con 0x7f1d341584c0 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d33fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d341519c0 0x7f1d34154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45102/0 (socket says 172.21.15.45:45102) 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d33fff640 1 -- 172.21.15.45:0/4072195892 learned_addr learned my addr 172.21.15.45:0/4072195892 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.886+0000 7f1d389bb640 1 --2- 172.21.15.45:0/4072195892 >> v2:172.21.15.45:3300/0 conn(0x7f1d341584c0 0x7f1d340ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.887+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4072195892 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916069838 0 0) 0x7f1d341588d0 con 0x7f1d341519c0 2023-12-08T08:16:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.887+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4072195892 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d1c003520 con 0x7f1d341519c0 2023-12-08T08:16:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.887+0000 7f1d389bb640 1 -- 172.21.15.45:0/4072195892 >> v1:172.21.15.114:6789/0 conn(0x7f1d340c44d0 legacy=0x7f1d340c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.887+0000 7f1d389bb640 1 -- 172.21.15.45:0/4072195892 >> v1:172.21.15.45:6789/0 conn(0x7f1d341519c0 legacy=0x7f1d34154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.887+0000 7f1d389bb640 1 -- 172.21.15.45:0/4072195892 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340c4ce0 con 0x7f1d341584c0 2023-12-08T08:16:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.888+0000 7f1d389bb640 1 --2- 172.21.15.45:0/4072195892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341584c0 0x7f1d340ab6b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009d90 tx=0x7f1d2c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a438b4427ccb915 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.889+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4072195892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c02cbd0 con 0x7f1d341584c0 2023-12-08T08:16:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.889+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4072195892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c02cd30 con 0x7f1d341584c0 2023-12-08T08:16:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.889+0000 7f1d32ffd640 1 -- 172.21.15.45:0/4072195892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c02cea0 con 0x7f1d341584c0 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.889+0000 7f1d391bc640 1 -- 172.21.15.45:0/4072195892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341584c0 msgr2=0x7f1d340ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.889+0000 7f1d391bc640 1 --2- 172.21.15.45:0/4072195892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341584c0 0x7f1d340ab6b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009d90 tx=0x7f1d2c02be20 comp rx=0 tx=0).stop 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.890+0000 7f1d391bc640 1 -- 172.21.15.45:0/4072195892 shutdown_connections 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.890+0000 7f1d391bc640 1 --2- 172.21.15.45:0/4072195892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341584c0 0x7f1d340ab6b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.890+0000 7f1d391bc640 1 -- 172.21.15.45:0/4072195892 >> 172.21.15.45:0/4072195892 conn(0x7f1d340661f0 msgr2=0x7f1d34066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.890+0000 7f1d391bc640 1 -- 172.21.15.45:0/4072195892 shutdown_connections 2023-12-08T08:16:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.890+0000 7f1d391bc640 1 -- 172.21.15.45:0/4072195892 wait complete. 2023-12-08T08:16:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.891+0000 7f1d391bc640 1 Processor -- start 2023-12-08T08:16:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 -- start start 2023-12-08T08:16:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 0x7f1d34153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d341584c0 0x7f1d341ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340afa60 con 0x7f1d341519c0 2023-12-08T08:16:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341edf40 con 0x7f1d341584c0 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.892+0000 7f1d391bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341ed330 con 0x7f1d340c44d0 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43298/0 (socket says 172.21.15.45:43298) 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 -- 172.21.15.45:0/3611790265 learned_addr learned my addr 172.21.15.45:0/3611790265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d389bb640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d341584c0 0x7f1d341ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d33fff640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 0x7f1d34153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 -- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 msgr2=0x7f1d34153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 0x7f1d34153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 -- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d341584c0 msgr2=0x7f1d341ea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d341584c0 0x7f1d341ea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d337fe640 1 -- 172.21.15.45:0/3611790265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009a70 con 0x7f1d341519c0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.893+0000 7f1d33fff640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 0x7f1d34153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d337fe640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c480 tx=0x7f1d2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280052d0 con 0x7f1d341519c0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28005430 con 0x7f1d341519c0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d341ed610 con 0x7f1d341519c0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28012870 con 0x7f1d341519c0 2023-12-08T08:16:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.894+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d341edbd0 con 0x7f1d341519c0 2023-12-08T08:16:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.895+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d340743e0 con 0x7f1d341519c0 2023-12-08T08:16:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.896+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d280129d0 con 0x7f1d341519c0 2023-12-08T08:16:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.897+0000 7f1d30ff9640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 0x7f1d2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.897+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d28089580 con 0x7f1d341519c0 2023-12-08T08:16:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.898+0000 7f1d33fff640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 0x7f1d2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.898+0000 7f1d33fff640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 0x7f1d2006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1d240011e0 tx=0x7f1d24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:13.902+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d28054260 con 0x7f1d341519c0 2023-12-08T08:16:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.134+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d3414ed70 con 0x7f1d341519c0 2023-12-08T08:16:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.135+0000 7f1d30ff9640 1 -- 172.21.15.45:0/3611790265 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f1d28057880 con 0x7f1d341519c0 2023-12-08T08:16:14.138 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:14.138 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:16:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:16:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.137+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 msgr2=0x7f1d2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.137+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 0x7f1d2006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1d240011e0 tx=0x7f1d24009040 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.137+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 msgr2=0x7f1d341e9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.137+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c480 tx=0x7f1d2800c940 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 shutdown_connections 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1d2006ae70 0x7f1d2006d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d341584c0 0x7f1d341ea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d341519c0 0x7f1d341e9e20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 --2- 172.21.15.45:0/3611790265 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1d340c44d0 0x7f1d34153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 >> 172.21.15.45:0/3611790265 conn(0x7f1d340661f0 msgr2=0x7f1d3414d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 shutdown_connections 2023-12-08T08:16:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.138+0000 7f1d391bc640 1 -- 172.21.15.45:0/3611790265 wait complete. 2023-12-08T08:16:14.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.387+0000 7f4b3637c640 1 Processor -- start 2023-12-08T08:16:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.387+0000 7f4b3637c640 1 -- start start 2023-12-08T08:16:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b3637c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b300a7910 0x7f4b300c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b3637c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 0x7f4b30155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b3637c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b30155850 con 0x7f4b300c1dc0 2023-12-08T08:16:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b3637c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b300c0890 con 0x7f4b300a7910 2023-12-08T08:16:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b3637c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c0b70 con 0x7f4b301521b0 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.388+0000 7f4b34b79640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b300c1dc0 0x7f4b3014f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45106/0 (socket says 172.21.15.45:45106) 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b34b79640 1 -- 172.21.15.45:0/1440341065 learned_addr learned my addr 172.21.15.45:0/1440341065 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b3537a640 1 --2- 172.21.15.45:0/1440341065 >> v2:172.21.15.114:3300/0 conn(0x7f4b300a7910 0x7f4b300c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b35b7b640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 0x7f4b30155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625644919 0 0) 0x7f4b30155850 con 0x7f4b300c1dc0 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c003520 con 0x7f4b300c1dc0 2023-12-08T08:16:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948506177 0 0) 0x7f4b1c003520 con 0x7f4b300c1dc0 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 msgr2=0x7f4b30155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 0x7f4b30155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 >> v2:172.21.15.114:3300/0 conn(0x7f4b300a7910 msgr2=0x7f4b300c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1440341065 >> v2:172.21.15.114:3300/0 conn(0x7f4b300a7910 0x7f4b300c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300c0e50 con 0x7f4b300c1dc0 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f4b20001670 con 0x7f4b300c1dc0 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.389+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 >> v1:172.21.15.45:6789/0 conn(0x7f4b300c1dc0 legacy=0x7f4b3014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 0x7f4b1c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c003ef0 0x7f4b1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c004d00 0x7f4b1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c0890 con 0x7f4b1c003ef0 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c0b70 con 0x7f4b1c004d00 2023-12-08T08:16:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00b9d0 con 0x7f4b301521b0 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c003ef0 0x7f4b1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 -- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 msgr2=0x7f4b1c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b301521b0 0x7f4b1c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b35b7b640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c004d00 0x7f4b1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 -- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c004d00 msgr2=0x7f4b1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c004d00 0x7f4b1c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.390+0000 7f4b34b79640 1 -- 172.21.15.45:0/1440341065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c003520 con 0x7f4b1c003ef0 2023-12-08T08:16:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b34b79640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c003ef0 0x7f4b1c0047c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c210 tx=0x7f4b1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45a9941fea0dfdc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20005ad0 con 0x7f4b1c003ef0 2023-12-08T08:16:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005c30 con 0x7f4b1c003ef0 2023-12-08T08:16:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b27fff640 1 -- 172.21.15.45:0/1440341065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002cac0 con 0x7f4b1c003ef0 2023-12-08T08:16:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b3637c640 1 -- 172.21.15.45:0/1440341065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c003ef0 msgr2=0x7f4b1c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b3637c640 1 --2- 172.21.15.45:0/1440341065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c003ef0 0x7f4b1c0047c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c210 tx=0x7f4b1c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.392+0000 7f4b35b7b640 1 -- 172.21.15.45:0/1440341065 reap_dead start 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.393+0000 7f4b3637c640 1 -- 172.21.15.45:0/1440341065 shutdown_connections 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.393+0000 7f4b3637c640 1 -- 172.21.15.45:0/1440341065 >> 172.21.15.45:0/1440341065 conn(0x7f4b300c5780 msgr2=0x7f4b300c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.393+0000 7f4b3637c640 1 -- 172.21.15.45:0/1440341065 shutdown_connections 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.393+0000 7f4b3637c640 1 -- 172.21.15.45:0/1440341065 wait complete. 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.394+0000 7f4b3637c640 1 Processor -- start 2023-12-08T08:16:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 -- start start 2023-12-08T08:16:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c003ef0 0x7f4b300befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014efb0 0x7f4b3014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301e94e0 con 0x7f4b3014e860 2023-12-08T08:16:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301db710 con 0x7f4b1c003ef0 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.395+0000 7f4b3637c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301daa60 con 0x7f4b3014efb0 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43310/0 (socket says 172.21.15.45:43310) 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 -- 172.21.15.45:0/4249551569 learned_addr learned my addr 172.21.15.45:0/4249551569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b3537a640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c003ef0 0x7f4b300befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b34b79640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014efb0 0x7f4b3014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 -- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014efb0 msgr2=0x7f4b3014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014efb0 0x7f4b3014e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 -- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c003ef0 msgr2=0x7f4b300befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c003ef0 0x7f4b300befd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.396+0000 7f4b35b7b640 1 -- 172.21.15.45:0/4249551569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b301dacb0 con 0x7f4b3014e860 2023-12-08T08:16:14.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b35b7b640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006bad0 tx=0x7f4b2800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2800fe60 con 0x7f4b3014e860 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28011040 con 0x7f4b3014e860 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28003bd0 con 0x7f4b3014e860 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b301ed720 con 0x7f4b3014e860 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.397+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b300bf510 con 0x7f4b3014e860 2023-12-08T08:16:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.398+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b301e9650 con 0x7f4b3014e860 2023-12-08T08:16:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.399+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b28017400 con 0x7f4b3014e860 2023-12-08T08:16:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.400+0000 7f4b25ffb640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 0x7f4b1406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.401+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b28089ae0 con 0x7f4b3014e860 2023-12-08T08:16:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.401+0000 7f4b3537a640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 0x7f4b1406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.402+0000 7f4b3537a640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 0x7f4b1406d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0047b0 tx=0x7f4b2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.405+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b301e9650 con 0x7f4b3014e860 2023-12-08T08:16:14.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.600+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b301e9620 con 0x7f4b3014e860 2023-12-08T08:16:14.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.603+0000 7f4b25ffb640 1 -- 172.21.15.45:0/4249551569 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f4b28054940 con 0x7f4b3014e860 2023-12-08T08:16:14.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:14.606 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 msgr2=0x7f4b1406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 0x7f4b1406d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0047b0 tx=0x7f4b2c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 msgr2=0x7f4b301e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006bad0 tx=0x7f4b2800f4a0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 shutdown_connections 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1406aec0 0x7f4b1406d380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014efb0 0x7f4b3014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b3014e860 0x7f4b301e9930 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 --2- 172.21.15.45:0/4249551569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c003ef0 0x7f4b300befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 >> 172.21.15.45:0/4249551569 conn(0x7f4b300c5780 msgr2=0x7f4b30151800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:14.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 shutdown_connections 2023-12-08T08:16:14.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.606+0000 7f4b3637c640 1 -- 172.21.15.45:0/4249551569 wait complete. 2023-12-08T08:16:14.630 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:16:14.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.855+0000 7f51a9953640 1 Processor -- start 2023-12-08T08:16:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.856+0000 7f51a9953640 1 -- start start 2023-12-08T08:16:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.857+0000 7f51a9953640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51a40aa2b0 0x7f51a40a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.857+0000 7f51a9953640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51a4154a20 0x7f51a4154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.857+0000 7f51a9953640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a40c63b0 con 0x7f51a4154190 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.857+0000 7f51a9953640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40a9f20 con 0x7f51a40aa2b0 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.857+0000 7f51a9953640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a40a9580 con 0x7f51a4154a20 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51a40aa2b0 0x7f51a40a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51a40aa2b0 0x7f51a40a4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43312/0 (socket says 172.21.15.45:43312) 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 -- 172.21.15.45:0/2848161103 learned_addr learned my addr 172.21.15.45:0/2848161103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 -- 172.21.15.45:0/2848161103 >> v2:172.21.15.114:3300/0 conn(0x7f51a4154a20 msgr2=0x7f51a4154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 --2- 172.21.15.45:0/2848161103 >> v2:172.21.15.114:3300/0 conn(0x7f51a4154a20 0x7f51a4154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 -- 172.21.15.45:0/2848161103 >> v1:172.21.15.114:6789/0 conn(0x7f51a4154190 legacy=0x7f51a40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.858+0000 7f51a27fc640 1 -- 172.21.15.45:0/2848161103 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a40a9860 con 0x7f51a40aa2b0 2023-12-08T08:16:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.859+0000 7f51a27fc640 1 --2- 172.21.15.45:0/2848161103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a40aa2b0 0x7f51a40a4f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f51a40a8ec0 tx=0x7f519802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03799fcc3e16a05 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.860+0000 7f51a1ffb640 1 -- 172.21.15.45:0/2848161103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519802ee00 con 0x7f51a40aa2b0 2023-12-08T08:16:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.860+0000 7f51a1ffb640 1 -- 172.21.15.45:0/2848161103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198036440 con 0x7f51a40aa2b0 2023-12-08T08:16:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.860+0000 7f51a1ffb640 1 -- 172.21.15.45:0/2848161103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980367d0 con 0x7f51a40aa2b0 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.860+0000 7f51a9953640 1 -- 172.21.15.45:0/2848161103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a40aa2b0 msgr2=0x7f51a40a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.860+0000 7f51a9953640 1 --2- 172.21.15.45:0/2848161103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a40aa2b0 0x7f51a40a4f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f51a40a8ec0 tx=0x7f519802e050 comp rx=0 tx=0).stop 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 -- 172.21.15.45:0/2848161103 shutdown_connections 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 --2- 172.21.15.45:0/2848161103 >> v2:172.21.15.114:3300/0 conn(0x7f51a4154a20 0x7f51a4154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 --2- 172.21.15.45:0/2848161103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a40aa2b0 0x7f51a40a4f30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 -- 172.21.15.45:0/2848161103 >> 172.21.15.45:0/2848161103 conn(0x7f51a40661f0 msgr2=0x7f51a4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 -- 172.21.15.45:0/2848161103 shutdown_connections 2023-12-08T08:16:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.861+0000 7f51a9953640 1 -- 172.21.15.45:0/2848161103 wait complete. 2023-12-08T08:16:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.863+0000 7f51a9953640 1 Processor -- start 2023-12-08T08:16:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.864+0000 7f51a9953640 1 -- start start 2023-12-08T08:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 0x7f51a41ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 0x7f51a41eced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4099a50 con 0x7f51a4154190 2023-12-08T08:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41e9960 con 0x7f51a40aa2b0 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a9953640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4099ca0 con 0x7f51a4154a20 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43324/0 (socket says 172.21.15.45:43324) 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.865+0000 7f51a27fc640 1 -- 172.21.15.45:0/1302317755 learned_addr learned my addr 172.21.15.45:0/1302317755 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a2ffd640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 0x7f51a41ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 -- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 msgr2=0x7f51a41eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a37fe640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 0x7f51a41eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 0x7f51a41eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 -- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 msgr2=0x7f51a41ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 0x7f51a41ea420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 -- 172.21.15.45:0/1302317755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519800b770 con 0x7f51a4154190 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a2ffd640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 0x7f51a41ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a37fe640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 0x7f51a41eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f51a27fc640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f519802e090 tx=0x7f5198004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198034b80 con 0x7f51a4154190 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198034d00 con 0x7f51a4154190 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.866+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51980416c0 con 0x7f51a4154190 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.867+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a4099f80 con 0x7f51a4154190 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.867+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a41e9f00 con 0x7f51a4154190 2023-12-08T08:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.868+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a41ea0f0 con 0x7f51a4154190 2023-12-08T08:16:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.869+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5198041820 con 0x7f51a4154190 2023-12-08T08:16:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.870+0000 7f518bfff640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 0x7f519006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.871+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f51980acc60 con 0x7f51a4154190 2023-12-08T08:16:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.871+0000 7f51a2ffd640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 0x7f519006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.871+0000 7f51a2ffd640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 0x7f519006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5194001dc0 tx=0x7f5194009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:14.875+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51980779e0 con 0x7f51a4154190 2023-12-08T08:16:15.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.107+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51a41ea0f0 con 0x7f51a4154190 2023-12-08T08:16:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.109+0000 7f518bfff640 1 -- 172.21.15.45:0/1302317755 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f519803b090 con 0x7f51a4154190 2023-12-08T08:16:15.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:15.112 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:16:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 msgr2=0x7f519006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 0x7f519006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5194001dc0 tx=0x7f5194009040 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 msgr2=0x7f51a4072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f519802e090 tx=0x7f5198004730 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 shutdown_connections 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f519006ae40 0x7f519006d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a4154a20 0x7f51a41eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a4154190 0x7f51a4072180 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 --2- 172.21.15.45:0/1302317755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a40aa2b0 0x7f51a41ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 >> 172.21.15.45:0/1302317755 conn(0x7f51a40661f0 msgr2=0x7f51a40a5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 shutdown_connections 2023-12-08T08:16:15.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.112+0000 7f51a9953640 1 -- 172.21.15.45:0/1302317755 wait complete. 2023-12-08T08:16:15.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:15.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.345+0000 7f5f6bfff640 1 Processor -- start 2023-12-08T08:16:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.345+0000 7f5f6bfff640 1 -- start start 2023-12-08T08:16:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.346+0000 7f5f6bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f6c0a7910 0x7f5f6c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.346+0000 7f5f6bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c155850 con 0x7f5f6c1521b0 2023-12-08T08:16:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.346+0000 7f5f6bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0c0890 con 0x7f5f6c0c1dc0 2023-12-08T08:16:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.346+0000 7f5f6bfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c0b70 con 0x7f5f6c0a7910 2023-12-08T08:16:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.347+0000 7f5f6b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5f6c1521b0 0x7f5f6c155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52244/0 (socket says 172.21.15.45:52244) 2023-12-08T08:16:15.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.347+0000 7f5f6b7fe640 1 -- 172.21.15.45:0/2984947258 learned_addr learned my addr 172.21.15.45:0/2984947258 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:15.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.347+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786145591 0 0) 0x7f5f6c155850 con 0x7f5f6c1521b0 2023-12-08T08:16:15.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.347+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f58003520 con 0x7f5f6c1521b0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.347+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2984947258 >> v2:172.21.15.114:3300/0 conn(0x7f5f6c0a7910 0x7f5f6c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492841442 0 0) 0x7f5f58003520 con 0x7f5f6c1521b0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 >> v2:172.21.15.114:3300/0 conn(0x7f5f6c0a7910 msgr2=0x7f5f6c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 --2- 172.21.15.45:0/2984947258 >> v2:172.21.15.114:3300/0 conn(0x7f5f6c0a7910 0x7f5f6c0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 >> v1:172.21.15.114:6789/0 conn(0x7f5f6c0c1dc0 legacy=0x7f5f6c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0c0e50 con 0x7f5f6c1521b0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5f64001670 con 0x7f5f6c1521b0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 >> v1:172.21.15.45:6789/0 conn(0x7f5f6c1521b0 legacy=0x7f5f6c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 0x7f5f58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580052a0 0x7f5f5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c0b70 con 0x7f5f580039c0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800c1c0 con 0x7f5f580047c0 2023-12-08T08:16:15.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800c380 con 0x7f5f580052a0 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 0x7f5f58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.348+0000 7f5f6a7fc640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6b7fe640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580052a0 0x7f5f5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6affd640 1 -- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580052a0 msgr2=0x7f5f5800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580052a0 0x7f5f5800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6affd640 1 -- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f580047c0 msgr2=0x7f5f58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6affd640 1 -- 172.21.15.45:0/2984947258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58003520 con 0x7f5f580039c0 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6b7fe640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580052a0 0x7f5f5800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.349+0000 7f5f6b7fe640 1 -- 172.21.15.45:0/2984947258 reap_dead start 2023-12-08T08:16:15.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.350+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 0x7f5f58003de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007360 tx=0x7f5f580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a939544340d9d67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.350+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c02ccb0 con 0x7f5f580039c0 2023-12-08T08:16:15.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.350+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c02ce10 con 0x7f5f580039c0 2023-12-08T08:16:15.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.350+0000 7f5f69ffb640 1 -- 172.21.15.45:0/2984947258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c034660 con 0x7f5f580039c0 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 msgr2=0x7f5f58003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 0x7f5f58003de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007360 tx=0x7f5f580057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2984947258 shutdown_connections 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2984947258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580039c0 0x7f5f58003de0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2984947258 >> 172.21.15.45:0/2984947258 conn(0x7f5f6c0c5780 msgr2=0x7f5f6c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2984947258 shutdown_connections 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.351+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2984947258 wait complete. 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.353+0000 7f5f6bfff640 1 Processor -- start 2023-12-08T08:16:15.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.353+0000 7f5f6bfff640 1 -- start start 2023-12-08T08:16:15.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580039c0 0x7f5f6c071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c0c5130 0x7f5f6c1db3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c3b00 con 0x7f5f6c0c3350 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c153cd0 con 0x7f5f6c0c5130 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c153730 con 0x7f5f580039c0 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52060/0 (socket says 172.21.15.45:52060) 2023-12-08T08:16:15.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6a7fc640 1 -- 172.21.15.45:0/2228650933 learned_addr learned my addr 172.21.15.45:0/2228650933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:15.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580039c0 0x7f5f6c071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.354+0000 7f5f6b7fe640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c0c5130 0x7f5f6c1db3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 -- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580039c0 msgr2=0x7f5f6c071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580039c0 0x7f5f6c071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 -- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c0c5130 msgr2=0x7f5f6c1db3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c0c5130 0x7f5f6c1db3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 -- 172.21.15.45:0/2228650933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c1eaba0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6a7fc640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400e580 tx=0x7f5f5400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540052e0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54005440 con 0x7f5f6c0c3350 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54003810 con 0x7f5f6c0c3350 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c1539f0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.355+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c072410 con 0x7f5f6c0c3350 2023-12-08T08:16:15.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.356+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c1dace0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.357+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f54003970 con 0x7f5f6c0c3350 2023-12-08T08:16:15.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.358+0000 7f5f637fe640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.358+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f54089880 con 0x7f5f6c0c3350 2023-12-08T08:16:15.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.359+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.359+0000 7f5f6affd640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 0x7f5f4c06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.363+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f6c1dace0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.594+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f6c1dace0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.595+0000 7f5f637fe640 1 -- 172.21.15.45:0/2228650933 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f5f6c1dace0 con 0x7f5f6c0c3350 2023-12-08T08:16:15.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:15.598 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3093745679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3093745679},{"type":"v1","addr":"172.21.15.45:6835","nonce":3093745679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3801748712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3801748712},{"type":"v1","addr":"172.21.15.45:6837","nonce":3801748712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/307151954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":307151954},{"type":"v1","addr":"172.21.15.114:6834","nonce":307151954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:15:00.337648+0000","modified":"2023-12-08T08:15:27.275642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1952493586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1952493586},{"type":"v1","addr":"172.21.15.114:6835","nonce":1952493586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:16:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2023-12-08T08:16:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.597+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 msgr2=0x7f5f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.597+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 0x7f5f4c06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c036000 tx=0x7f5f5c030000 comp rx=0 tx=0).stop 2023-12-08T08:16:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.597+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 msgr2=0x7f5f6c0c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.597+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400e580 tx=0x7f5f5400ea40 comp rx=0 tx=0).stop 2023-12-08T08:16:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 shutdown_connections 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f6c0c5130 0x7f5f6c1db3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f6c0c3350 0x7f5f6c0c4bf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 --2- 172.21.15.45:0/2228650933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f580039c0 0x7f5f6c071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 >> 172.21.15.45:0/2228650933 conn(0x7f5f6c0c5780 msgr2=0x7f5f6c151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 shutdown_connections 2023-12-08T08:16:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.598+0000 7f5f6bfff640 1 -- 172.21.15.45:0/2228650933 wait complete. 2023-12-08T08:16:15.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.837+0000 7f913359e640 1 Processor -- start 2023-12-08T08:16:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.837+0000 7f913359e640 1 -- start start 2023-12-08T08:16:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.839+0000 7f913359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913406b1f0 0x7f9134155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.839+0000 7f913359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9134155d80 0x7f913415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.839+0000 7f913359e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340a93e0 con 0x7f913414fa30 2023-12-08T08:16:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.839+0000 7f913359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340c20e0 con 0x7f913406b1f0 2023-12-08T08:16:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.839+0000 7f913359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340c26f0 con 0x7f9134155d80 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913406b1f0 0x7f9134155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913406b1f0 0x7f9134155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52074/0 (socket says 172.21.15.45:52074) 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 -- 172.21.15.45:0/1122565187 learned_addr learned my addr 172.21.15.45:0/1122565187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f9132d9d640 1 --2- 172.21.15.45:0/1122565187 >> v2:172.21.15.114:3300/0 conn(0x7f9134155d80 0x7f913415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 -- 172.21.15.45:0/1122565187 >> v2:172.21.15.114:3300/0 conn(0x7f9134155d80 msgr2=0x7f913415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 --2- 172.21.15.45:0/1122565187 >> v2:172.21.15.114:3300/0 conn(0x7f9134155d80 0x7f913415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 -- 172.21.15.45:0/1122565187 >> v1:172.21.15.114:6789/0 conn(0x7f913414fa30 legacy=0x7f913406a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.840+0000 7f912bfff640 1 -- 172.21.15.45:0/1122565187 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340ab140 con 0x7f913406b1f0 2023-12-08T08:16:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.841+0000 7f912bfff640 1 --2- 172.21.15.45:0/1122565187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913406b1f0 0x7f9134155840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91340a9570 tx=0x7f911c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd57920dcb45a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f9131d9b640 1 -- 172.21.15.45:0/1122565187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0317e0 con 0x7f913406b1f0 2023-12-08T08:16:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f9131d9b640 1 -- 172.21.15.45:0/1122565187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c031940 con 0x7f913406b1f0 2023-12-08T08:16:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f9131d9b640 1 -- 172.21.15.45:0/1122565187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c031cd0 con 0x7f913406b1f0 2023-12-08T08:16:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f913359e640 1 -- 172.21.15.45:0/1122565187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913406b1f0 msgr2=0x7f9134155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f913359e640 1 --2- 172.21.15.45:0/1122565187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913406b1f0 0x7f9134155840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91340a9570 tx=0x7f911c02b880 comp rx=0 tx=0).stop 2023-12-08T08:16:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f913359e640 1 -- 172.21.15.45:0/1122565187 shutdown_connections 2023-12-08T08:16:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f913359e640 1 --2- 172.21.15.45:0/1122565187 >> v2:172.21.15.114:3300/0 conn(0x7f9134155d80 0x7f913415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.842+0000 7f913359e640 1 --2- 172.21.15.45:0/1122565187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913406b1f0 0x7f9134155840 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.843+0000 7f913359e640 1 -- 172.21.15.45:0/1122565187 >> 172.21.15.45:0/1122565187 conn(0x7f91340c60a0 msgr2=0x7f91340c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.843+0000 7f913359e640 1 -- 172.21.15.45:0/1122565187 shutdown_connections 2023-12-08T08:16:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.843+0000 7f913359e640 1 -- 172.21.15.45:0/1122565187 wait complete. 2023-12-08T08:16:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.844+0000 7f913359e640 1 Processor -- start 2023-12-08T08:16:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 -- start start 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f913406b1f0 0x7f91341ea980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 0x7f913414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341ea560 con 0x7f913414fa30 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341e9ec0 con 0x7f9134155d80 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.845+0000 7f913359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340c5550 con 0x7f913406b1f0 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52090/0 (socket says 172.21.15.45:52090) 2023-12-08T08:16:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 -- 172.21.15.45:0/16352718 learned_addr learned my addr 172.21.15.45:0/16352718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f9132d9d640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 0x7f913414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 -- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f913406b1f0 msgr2=0x7f91341ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f913259c640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f913406b1f0 0x7f91341ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f913406b1f0 0x7f91341ea980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 -- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 msgr2=0x7f913414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 0x7f913414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f912bfff640 1 -- 172.21.15.45:0/16352718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0094d0 con 0x7f913414fa30 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.846+0000 7f9132d9d640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 0x7f913414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f912bfff640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f911c02b8c0 tx=0x7f911c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c032880 con 0x7f913414fa30 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0329e0 con 0x7f913414fa30 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c032d90 con 0x7f913414fa30 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91341edee0 con 0x7f913414fa30 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.847+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91341ea180 con 0x7f913414fa30 2023-12-08T08:16:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.848+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91341ea6a0 con 0x7f913414fa30 2023-12-08T08:16:15.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.849+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f911c04e450 con 0x7f913414fa30 2023-12-08T08:16:15.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.850+0000 7f912affd640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 0x7f911406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:15.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.850+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f911c0abab0 con 0x7f913414fa30 2023-12-08T08:16:15.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.850+0000 7f913259c640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 0x7f911406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:15.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.851+0000 7f913259c640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 0x7f911406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91341ede10 tx=0x7f9124009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:15.855+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91341ea6a0 con 0x7f913414fa30 2023-12-08T08:16:16.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.051+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91341ea6a0 con 0x7f913414fa30 2023-12-08T08:16:16.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.053+0000 7f912affd640 1 -- 172.21.15.45:0/16352718 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18651 (secure 0 0 0) 0x7f91341ea6a0 con 0x7f913414fa30 2023-12-08T08:16:16.057 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:16.057 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:15:47.661417+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:14:58.230465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:14:59.351442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:15:02.441893+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 msgr2=0x7f911406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 0x7f911406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91341ede10 tx=0x7f9124009040 comp rx=0 tx=0).stop 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 msgr2=0x7f913414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f911c02b8c0 tx=0x7f911c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 shutdown_connections 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f911406ae70 0x7f911406d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9134155d80 0x7f913414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913414fa30 0x7f913414b090 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 --2- 172.21.15.45:0/16352718 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f913406b1f0 0x7f91341ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 >> 172.21.15.45:0/16352718 conn(0x7f91340c60a0 msgr2=0x7f913406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:16.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.056+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 shutdown_connections 2023-12-08T08:16:16.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.057+0000 7f913359e640 1 -- 172.21.15.45:0/16352718 wait complete. 2023-12-08T08:16:16.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.299+0000 7f94260ad640 1 Processor -- start 2023-12-08T08:16:16.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.300+0000 7f94260ad640 1 -- start start 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94260ad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c5600 0x7f942006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94260ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94200c50b0 0x7f94200c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94260ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94201521e0 con 0x7f942006b7b0 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94260ad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9420152b80 con 0x7f94200c50b0 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94260ad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94201524c0 con 0x7f94200c5600 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94258ac640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f942006b7b0 0x7f94201556c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52258/0 (socket says 172.21.15.45:52258) 2023-12-08T08:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.301+0000 7f94258ac640 1 -- 172.21.15.45:0/3928890067 learned_addr learned my addr 172.21.15.45:0/3928890067 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:16.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94248aa640 1 --2- 172.21.15.45:0/3928890067 >> v2:172.21.15.45:3300/0 conn(0x7f94200c50b0 0x7f94200c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94250ab640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c5600 0x7f942006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f9417fff640 1 -- 172.21.15.45:0/3928890067 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194038957 0 0) 0x7f94201521e0 con 0x7f942006b7b0 2023-12-08T08:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f9417fff640 1 -- 172.21.15.45:0/3928890067 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f940c003520 con 0x7f942006b7b0 2023-12-08T08:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94248aa640 1 -- 172.21.15.45:0/3928890067 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c5600 msgr2=0x7f942006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94248aa640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c5600 0x7f942006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94248aa640 1 -- 172.21.15.45:0/3928890067 >> v1:172.21.15.45:6789/0 conn(0x7f942006b7b0 legacy=0x7f94201556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.302+0000 7f94248aa640 1 -- 172.21.15.45:0/3928890067 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94201527a0 con 0x7f94200c50b0 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.304+0000 7f94248aa640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c50b0 0x7f94200c59e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f94100097a0 tx=0x7f941002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66960125e9f47875 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.304+0000 7f9417fff640 1 -- 172.21.15.45:0/3928890067 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410031780 con 0x7f94200c50b0 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.304+0000 7f9417fff640 1 -- 172.21.15.45:0/3928890067 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94100318e0 con 0x7f94200c50b0 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.304+0000 7f9417fff640 1 -- 172.21.15.45:0/3928890067 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410031c50 con 0x7f94200c50b0 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 -- 172.21.15.45:0/3928890067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c50b0 msgr2=0x7f94200c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c50b0 0x7f94200c59e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f94100097a0 tx=0x7f941002b820 comp rx=0 tx=0).stop 2023-12-08T08:16:16.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 -- 172.21.15.45:0/3928890067 shutdown_connections 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c50b0 0x7f94200c59e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 --2- 172.21.15.45:0/3928890067 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c5600 0x7f942006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 -- 172.21.15.45:0/3928890067 >> 172.21.15.45:0/3928890067 conn(0x7f94200a7600 msgr2=0x7f94200a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 -- 172.21.15.45:0/3928890067 shutdown_connections 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.305+0000 7f94260ad640 1 -- 172.21.15.45:0/3928890067 wait complete. 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.307+0000 7f94260ad640 1 Processor -- start 2023-12-08T08:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.307+0000 7f94260ad640 1 -- start start 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 0x7f94201dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c50b0 0x7f94200c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94201e7c80 con 0x7f94200c5600 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942006f930 con 0x7f942006b7b0 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94260ad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942006fc10 con 0x7f94200c50b0 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94258ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94258ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52118/0 (socket says 172.21.15.45:52118) 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.308+0000 7f94258ac640 1 -- 172.21.15.45:0/1979935675 learned_addr learned my addr 172.21.15.45:0/1979935675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94250ab640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 0x7f94201dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94248aa640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c50b0 0x7f94200c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 -- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c50b0 msgr2=0x7f94200c0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c50b0 0x7f94200c0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 -- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 msgr2=0x7f94201dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 0x7f94201dbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 -- 172.21.15.45:0/1979935675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410009400 con 0x7f94200c5600 2023-12-08T08:16:16.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94250ab640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 0x7f94201dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:16.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.309+0000 7f94258ac640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f941800cb40 tx=0x7f941800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.310+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800aca0 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.310+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941800ae00 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.310+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418012620 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.310+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942006fef0 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.310+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94201e8170 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.311+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94200c6760 con 0x7f94200c5600 2023-12-08T08:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.312+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9418007070 con 0x7f94200c5600 2023-12-08T08:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.313+0000 7f9415ffb640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 0x7f940406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.313+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9418089990 con 0x7f94200c5600 2023-12-08T08:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.313+0000 7f94250ab640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 0x7f940406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.314+0000 7f94250ab640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 0x7f940406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f94201e5ac0 tx=0x7f941c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.318+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9418054710 con 0x7f94200c5600 2023-12-08T08:16:16.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.558+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f94200c4e90 con 0x7f94200c5600 2023-12-08T08:16:16.562 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:16:16.559+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:16:16.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.562+0000 7f9415ffb640 1 -- 172.21.15.45:0/1979935675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9418017090 con 0x7f94200c5600 2023-12-08T08:16:16.565 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.566+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 msgr2=0x7f940406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.566+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 0x7f940406d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f94201e5ac0 tx=0x7f941c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.566+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 msgr2=0x7f94200c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.566+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f941800cb40 tx=0x7f941800a060 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 shutdown_connections 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f940406ae40 0x7f940406d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94200c50b0 0x7f94200c0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200c5600 0x7f94200c12a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 --2- 172.21.15.45:0/1979935675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942006b7b0 0x7f94201dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 >> 172.21.15.45:0/1979935675 conn(0x7f94200a7600 msgr2=0x7f94200a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 shutdown_connections 2023-12-08T08:16:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.567+0000 7f94260ad640 1 -- 172.21.15.45:0/1979935675 wait complete. 2023-12-08T08:16:16.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:16:16.596 INFO:tasks.ceph.mds.d.smithi114.stderr: -4163> 2023-12-08T08:15:04.074+0000 7f213f55a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:16:16.675 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:16:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.815+0000 7f695701a640 1 Processor -- start 2023-12-08T08:16:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.815+0000 7f695701a640 1 -- start start 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f695701a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69500c4970 0x7f69500a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f695701a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 0x7f6950155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f695701a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500c60c0 con 0x7f695014c280 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f695701a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6950152dc0 con 0x7f69500c4970 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f695701a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69501521d0 con 0x7f6950155790 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f6955817640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69500c4970 0x7f69500a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f6955817640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69500c4970 0x7f69500a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52122/0 (socket says 172.21.15.45:52122) 2023-12-08T08:16:16.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.817+0000 7f6955817640 1 -- 172.21.15.45:0/1752864120 learned_addr learned my addr 172.21.15.45:0/1752864120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6955817640 1 -- 172.21.15.45:0/1752864120 >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 msgr2=0x7f6950155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6956819640 1 --2- 172.21.15.45:0/1752864120 >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 0x7f6950155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6955817640 1 --2- 172.21.15.45:0/1752864120 >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 0x7f6950155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6955817640 1 -- 172.21.15.45:0/1752864120 >> v1:172.21.15.45:6789/0 conn(0x7f695014c280 legacy=0x7f695006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6955817640 1 -- 172.21.15.45:0/1752864120 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695014c660 con 0x7f69500c4970 2023-12-08T08:16:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.818+0000 7f6956819640 1 --2- 172.21.15.45:0/1752864120 >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 0x7f6950155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.819+0000 7f6955817640 1 --2- 172.21.15.45:0/1752864120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69500c4970 0x7f69500a4d10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f695006dbe0 tx=0x7f694002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8f18afb902569f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.819+0000 7f6955016640 1 -- 172.21.15.45:0/1752864120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940031870 con 0x7f69500c4970 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.819+0000 7f6955016640 1 -- 172.21.15.45:0/1752864120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69400319d0 con 0x7f69500c4970 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.819+0000 7f6955016640 1 -- 172.21.15.45:0/1752864120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940031d60 con 0x7f69500c4970 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 -- 172.21.15.45:0/1752864120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69500c4970 msgr2=0x7f69500a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 --2- 172.21.15.45:0/1752864120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69500c4970 0x7f69500a4d10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f695006dbe0 tx=0x7f694002b910 comp rx=0 tx=0).stop 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 -- 172.21.15.45:0/1752864120 shutdown_connections 2023-12-08T08:16:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 --2- 172.21.15.45:0/1752864120 >> v2:172.21.15.114:3300/0 conn(0x7f6950155790 0x7f6950155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 --2- 172.21.15.45:0/1752864120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69500c4970 0x7f69500a4d10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 -- 172.21.15.45:0/1752864120 >> 172.21.15.45:0/1752864120 conn(0x7f6950066ce0 msgr2=0x7f69500a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 -- 172.21.15.45:0/1752864120 shutdown_connections 2023-12-08T08:16:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.820+0000 7f695701a640 1 -- 172.21.15.45:0/1752864120 wait complete. 2023-12-08T08:16:16.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.823+0000 7f695701a640 1 Processor -- start 2023-12-08T08:16:16.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.823+0000 7f695701a640 1 -- start start 2023-12-08T08:16:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500c4970 0x7f69500a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f695014c280 0x7f69500a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500a9c30 con 0x7f6950155790 2023-12-08T08:16:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6950149850 con 0x7f69500c4970 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.824+0000 7f695701a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6950149d80 con 0x7f695014c280 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52134/0 (socket says 172.21.15.45:52134) 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 -- 172.21.15.45:0/1766592105 learned_addr learned my addr 172.21.15.45:0/1766592105 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956018640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500c4970 0x7f69500a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6955817640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f695014c280 0x7f69500a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 -- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f695014c280 msgr2=0x7f69500a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f695014c280 0x7f69500a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 -- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500c4970 msgr2=0x7f69500a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500c4970 0x7f69500a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.825+0000 7f6956819640 1 -- 172.21.15.45:0/1766592105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400094d0 con 0x7f6950155790 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f6956819640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f694800cd50 tx=0x7f694800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800f680 con 0x7f6950155790 2023-12-08T08:16:16.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800f800 con 0x7f6950155790 2023-12-08T08:16:16.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800fbb0 con 0x7f6950155790 2023-12-08T08:16:16.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69501ea4a0 con 0x7f6950155790 2023-12-08T08:16:16.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.826+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6950149aa0 con 0x7f6950155790 2023-12-08T08:16:16.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.828+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69500678c0 con 0x7f6950155790 2023-12-08T08:16:16.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.828+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f694800b040 con 0x7f6950155790 2023-12-08T08:16:16.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.829+0000 7f6946ffd640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 0x7f693406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:16.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.829+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f694808a330 con 0x7f6950155790 2023-12-08T08:16:16.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.830+0000 7f6956018640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 0x7f693406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:16.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.830+0000 7f6956018640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 0x7f693406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f69500aa6d0 tx=0x7f694c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:16.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:16.833+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6948055060 con 0x7f6950155790 2023-12-08T08:16:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.070+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f69500743e0 con 0x7f6950155790 2023-12-08T08:16:17.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.660+0000 7f6946ffd640 1 -- 172.21.15.45:0/1766592105 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6948058680 con 0x7f6950155790 2023-12-08T08:16:17.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 msgr2=0x7f693406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 0x7f693406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f69500aa6d0 tx=0x7f694c009040 comp rx=0 tx=0).stop 2023-12-08T08:16:17.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 msgr2=0x7f69500c13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f694800cd50 tx=0x7f694800a650 comp rx=0 tx=0).stop 2023-12-08T08:16:17.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 shutdown_connections 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f693406ae40 0x7f693406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f695014c280 0x7f69500a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6950155790 0x7f69500c13a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 --2- 172.21.15.45:0/1766592105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69500c4970 0x7f69500a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.664+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 >> 172.21.15.45:0/1766592105 conn(0x7f6950066ce0 msgr2=0x7f6950149140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.665+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 shutdown_connections 2023-12-08T08:16:17.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.665+0000 7f695701a640 1 -- 172.21.15.45:0/1766592105 wait complete. 2023-12-08T08:16:17.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:16:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.921+0000 7f711b59e640 1 Processor -- start 2023-12-08T08:16:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.921+0000 7f711b59e640 1 -- start start 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f711c14faf0 0x7f711c156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0a4da0 0x7f711c0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c06db60 con 0x7f711c0ab150 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c06c3f0 con 0x7f711c14faf0 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c06d330 con 0x7f711c0a4da0 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f711c14faf0 0x7f711c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f711c14faf0 0x7f711c156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52146/0 (socket says 172.21.15.45:52146) 2023-12-08T08:16:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.923+0000 7f711a59c640 1 -- 172.21.15.45:0/747069581 learned_addr learned my addr 172.21.15.45:0/747069581 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.924+0000 7f7113fff640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0a4da0 0x7f711c0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.924+0000 7f711a59c640 1 -- 172.21.15.45:0/747069581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0a4da0 msgr2=0x7f711c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.924+0000 7f711a59c640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0a4da0 0x7f711c0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.924+0000 7f711a59c640 1 -- 172.21.15.45:0/747069581 >> v1:172.21.15.114:6789/0 conn(0x7f711c0ab150 legacy=0x7f711c0c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.924+0000 7f711a59c640 1 -- 172.21.15.45:0/747069581 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c156890 con 0x7f711c14faf0 2023-12-08T08:16:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.925+0000 7f711a59c640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c156350 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f710c009870 tx=0x7f710c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7181935c1e1bb34 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f7119d9b640 1 -- 172.21.15.45:0/747069581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0317c0 con 0x7f711c14faf0 2023-12-08T08:16:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f7119d9b640 1 -- 172.21.15.45:0/747069581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c031920 con 0x7f711c14faf0 2023-12-08T08:16:17.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f7119d9b640 1 -- 172.21.15.45:0/747069581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c031cb0 con 0x7f711c14faf0 2023-12-08T08:16:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 -- 172.21.15.45:0/747069581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 msgr2=0x7f711c156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c156350 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f710c009870 tx=0x7f710c02b860 comp rx=0 tx=0).stop 2023-12-08T08:16:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 -- 172.21.15.45:0/747069581 shutdown_connections 2023-12-08T08:16:17.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0a4da0 0x7f711c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 --2- 172.21.15.45:0/747069581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c156350 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 -- 172.21.15.45:0/747069581 >> 172.21.15.45:0/747069581 conn(0x7f711c0c6010 msgr2=0x7f711c0a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:17.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.926+0000 7f711b59e640 1 -- 172.21.15.45:0/747069581 shutdown_connections 2023-12-08T08:16:17.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.927+0000 7f711b59e640 1 -- 172.21.15.45:0/747069581 wait complete. 2023-12-08T08:16:17.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.928+0000 7f711b59e640 1 Processor -- start 2023-12-08T08:16:17.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.928+0000 7f711b59e640 1 -- start start 2023-12-08T08:16:17.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711c0a4da0 0x7f711c0a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 0x7f711c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c152fa0 con 0x7f711c14faf0 2023-12-08T08:16:17.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c070cc0 con 0x7f711c0a4da0 2023-12-08T08:16:17.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.929+0000 7f711b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c150cb0 con 0x7f711c0ab150 2023-12-08T08:16:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52162/0 (socket says 172.21.15.45:52162) 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 -- 172.21.15.45:0/4171278318 learned_addr learned my addr 172.21.15.45:0/4171278318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711a59c640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711c0a4da0 0x7f711c0a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f7113fff640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 0x7f711c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 -- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 msgr2=0x7f711c14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 0x7f711c14d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 -- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711c0a4da0 msgr2=0x7f711c0a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711c0a4da0 0x7f711c0a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f711ad9d640 1 -- 172.21.15.45:0/4171278318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0094d0 con 0x7f711c14faf0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.930+0000 7f7113fff640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 0x7f711c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f711ad9d640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f711400c7a0 tx=0x7f711400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114003b70 con 0x7f711c14faf0 2023-12-08T08:16:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114003cf0 con 0x7f711c14faf0 2023-12-08T08:16:17.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114003ea0 con 0x7f711c14faf0 2023-12-08T08:16:17.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c1ed9d0 con 0x7f711c14faf0 2023-12-08T08:16:17.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.931+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c072670 con 0x7f711c14faf0 2023-12-08T08:16:17.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.933+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c070e00 con 0x7f711c14faf0 2023-12-08T08:16:17.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.934+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f711400aa90 con 0x7f711c14faf0 2023-12-08T08:16:17.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.935+0000 7f7112ffd640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 0x7f70fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:17.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.935+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f71140897b0 con 0x7f711c14faf0 2023-12-08T08:16:17.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.935+0000 7f711a59c640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 0x7f70fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:17.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.936+0000 7f711a59c640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 0x7f70fc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f710c036000 tx=0x7f710c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:17.940+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f711c070e00 con 0x7f711c14faf0 2023-12-08T08:16:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.132+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f711c070e00 con 0x7f711c14faf0 2023-12-08T08:16:18.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.850+0000 7f7112ffd640 1 -- 172.21.15.45:0/4171278318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f711c070e00 con 0x7f711c14faf0 2023-12-08T08:16:18.854 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.855+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 msgr2=0x7f70fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.855+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 0x7f70fc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f710c036000 tx=0x7f710c03d040 comp rx=0 tx=0).stop 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.855+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 msgr2=0x7f711c14dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.855+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f711400c7a0 tx=0x7f711400cc60 comp rx=0 tx=0).stop 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 shutdown_connections 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f70fc06ae40 0x7f70fc06d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f711c0ab150 0x7f711c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:18.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f711c14faf0 0x7f711c14dec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 --2- 172.21.15.45:0/4171278318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f711c0a4da0 0x7f711c0a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 >> 172.21.15.45:0/4171278318 conn(0x7f711c0c6010 msgr2=0x7f711c0bec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 shutdown_connections 2023-12-08T08:16:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:18.856+0000 7f711b59e640 1 -- 172.21.15.45:0/4171278318 wait complete. 2023-12-08T08:16:18.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:16:19.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.097+0000 7f9ff62c3640 1 Processor -- start 2023-12-08T08:16:19.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.097+0000 7f9ff62c3640 1 -- start start 2023-12-08T08:16:19.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff62c3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 0x7f9ff0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff62c3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ff00c8240 0x7f9ff0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff62c3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff00c4630 con 0x7f9ff0151a50 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff62c3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00c6f60 con 0x7f9ff00c8240 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff62c3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00c86f0 con 0x7f9ff00c7b10 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff5ac2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ff00c8240 0x7f9ff0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff52c1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ff0151a50 0x7f9ff00c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52272/0 (socket says 172.21.15.45:52272) 2023-12-08T08:16:19.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.099+0000 7f9ff52c1640 1 -- 172.21.15.45:0/2335574693 learned_addr learned my addr 172.21.15.45:0/2335574693 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff4ac0640 1 --2- 172.21.15.45:0/2335574693 >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 0x7f9ff0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/2335574693 >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 msgr2=0x7f9ff0151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff5ac2640 1 --2- 172.21.15.45:0/2335574693 >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 0x7f9ff0151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/2335574693 >> v1:172.21.15.45:6789/0 conn(0x7f9ff0151a50 legacy=0x7f9ff00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/2335574693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00c7160 con 0x7f9ff00c8240 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9feffff640 1 -- 172.21.15.45:0/2335574693 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420212928 0 0) 0x7f9ff00c4630 con 0x7f9ff0151a50 2023-12-08T08:16:19.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.100+0000 7f9ff4ac0640 1 --2- 172.21.15.45:0/2335574693 >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 0x7f9ff0151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:19.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.101+0000 7f9ff5ac2640 1 --2- 172.21.15.45:0/2335574693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff00c8240 0x7f9ff0157c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53628dc9090c333b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.101+0000 7f9feffff640 1 -- 172.21.15.45:0/2335574693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe802cbd0 con 0x7f9ff00c8240 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.101+0000 7f9feffff640 1 -- 172.21.15.45:0/2335574693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe802cd30 con 0x7f9ff00c8240 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.101+0000 7f9feffff640 1 -- 172.21.15.45:0/2335574693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe802cea0 con 0x7f9ff00c8240 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 -- 172.21.15.45:0/2335574693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff00c8240 msgr2=0x7f9ff0157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/2335574693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff00c8240 0x7f9ff0157c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe802be20 comp rx=0 tx=0).stop 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 -- 172.21.15.45:0/2335574693 shutdown_connections 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/2335574693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff00c8240 0x7f9ff0157c90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/2335574693 >> v2:172.21.15.114:3300/0 conn(0x7f9ff00c7b10 0x7f9ff0151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 -- 172.21.15.45:0/2335574693 >> 172.21.15.45:0/2335574693 conn(0x7f9ff006b850 msgr2=0x7f9ff006bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 -- 172.21.15.45:0/2335574693 shutdown_connections 2023-12-08T08:16:19.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.102+0000 7f9ff62c3640 1 -- 172.21.15.45:0/2335574693 wait complete. 2023-12-08T08:16:19.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.104+0000 7f9ff62c3640 1 Processor -- start 2023-12-08T08:16:19.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.104+0000 7f9ff62c3640 1 -- start start 2023-12-08T08:16:19.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ff00c7b10 0x7f9ff0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff00c8240 0x7f9ff01edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01e9e50 con 0x7f9ff0151a50 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01ed440 con 0x7f9ff00c8240 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff62c3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00aba70 con 0x7f9ff00c7b10 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52190/0 (socket says 172.21.15.45:52190) 2023-12-08T08:16:19.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/4067013563 learned_addr learned my addr 172.21.15.45:0/4067013563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ff00c7b10 msgr2=0x7f9ff0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ff00c7b10 0x7f9ff0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff00c8240 msgr2=0x7f9ff01edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff00c8240 0x7f9ff01edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.105+0000 7f9ff5ac2640 1 -- 172.21.15.45:0/4067013563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8009a70 con 0x7f9ff0151a50 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9ff5ac2640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009eb0 tx=0x7f9fe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe802cea0 con 0x7f9ff0151a50 2023-12-08T08:16:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe803e610 con 0x7f9ff0151a50 2023-12-08T08:16:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe803e9a0 con 0x7f9ff0151a50 2023-12-08T08:16:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff00abd50 con 0x7f9ff0151a50 2023-12-08T08:16:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.106+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff00ac310 con 0x7f9ff0151a50 2023-12-08T08:16:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.107+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff00678c0 con 0x7f9ff0151a50 2023-12-08T08:16:19.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.108+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fe803b050 con 0x7f9ff0151a50 2023-12-08T08:16:19.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.109+0000 7f9fedffb640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:19.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.109+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f9fe80aba50 con 0x7f9ff0151a50 2023-12-08T08:16:19.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.110+0000 7f9ff52c1640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:19.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.110+0000 7f9ff52c1640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 0x7f9fdc06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0007fd0 tx=0x7f9fe0007960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:19.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.114+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fe8076930 con 0x7f9ff0151a50 2023-12-08T08:16:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.308+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ff00ca1d0 con 0x7f9ff0151a50 2023-12-08T08:16:19.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.863+0000 7f9fedffb640 1 -- 172.21.15.45:0/4067013563 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9fe804d0d0 con 0x7f9ff0151a50 2023-12-08T08:16:19.866 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-08T08:16:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 msgr2=0x7f9fdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 0x7f9fdc06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0007fd0 tx=0x7f9fe0007960 comp rx=0 tx=0).stop 2023-12-08T08:16:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 msgr2=0x7f9ff01ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009eb0 tx=0x7f9fe8004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 shutdown_connections 2023-12-08T08:16:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9fdc06ae70 0x7f9fdc06d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ff0151a50 0x7f9ff01ea2a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ff00c8240 0x7f9ff01edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 --2- 172.21.15.45:0/4067013563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ff00c7b10 0x7f9ff0157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 >> 172.21.15.45:0/4067013563 conn(0x7f9ff006b850 msgr2=0x7f9ff01534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 shutdown_connections 2023-12-08T08:16:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:19.867+0000 7f9ff62c3640 1 -- 172.21.15.45:0/4067013563 wait complete. 2023-12-08T08:16:19.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-08T08:16:20.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.107+0000 7f0c9a021640 1 Processor -- start 2023-12-08T08:16:20.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.107+0000 7f0c9a021640 1 -- start start 2023-12-08T08:16:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c9414faf0 0x7f0c94156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c940a4da0 0x7f0c940aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c940ab150 0x7f0c940c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9406c3f0 con 0x7f0c9414faf0 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9406db60 con 0x7f0c940ab150 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.108+0000 7f0c9a021640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9406d330 con 0x7f0c940a4da0 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c9414faf0 0x7f0c94156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c9414faf0 0x7f0c94156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52202/0 (socket says 172.21.15.45:52202) 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 -- 172.21.15.45:0/3377297188 learned_addr learned my addr 172.21.15.45:0/3377297188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 -- 172.21.15.45:0/3377297188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c940a4da0 msgr2=0x7f0c940aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 --2- 172.21.15.45:0/3377297188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c940a4da0 0x7f0c940aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 -- 172.21.15.45:0/3377297188 >> v2:172.21.15.114:3300/0 conn(0x7f0c940ab150 msgr2=0x7f0c940c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c99820640 1 --2- 172.21.15.45:0/3377297188 >> v2:172.21.15.114:3300/0 conn(0x7f0c940ab150 0x7f0c940c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 --2- 172.21.15.45:0/3377297188 >> v2:172.21.15.114:3300/0 conn(0x7f0c940ab150 0x7f0c940c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.109+0000 7f0c9901f640 1 -- 172.21.15.45:0/3377297188 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94156890 con 0x7f0c9414faf0 2023-12-08T08:16:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.110+0000 7f0c9901f640 1 --2- 172.21.15.45:0/3377297188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c9414faf0 0x7f0c94156350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c940c55e0 tx=0x7f0c9002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f76a3ff6e5c862 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.111+0000 7f0c8bfff640 1 -- 172.21.15.45:0/3377297188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9002c950 con 0x7f0c9414faf0 2023-12-08T08:16:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.111+0000 7f0c8bfff640 1 -- 172.21.15.45:0/3377297188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9002cab0 con 0x7f0c9414faf0 2023-12-08T08:16:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.111+0000 7f0c8bfff640 1 -- 172.21.15.45:0/3377297188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9002ce40 con 0x7f0c9414faf0 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.111+0000 7f0c9a021640 1 -- 172.21.15.45:0/3377297188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c9414faf0 msgr2=0x7f0c94156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.111+0000 7f0c9a021640 1 --2- 172.21.15.45:0/3377297188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c9414faf0 0x7f0c94156350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c940c55e0 tx=0x7f0c9002bdb0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 -- 172.21.15.45:0/3377297188 shutdown_connections 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 --2- 172.21.15.45:0/3377297188 >> v2:172.21.15.114:3300/0 conn(0x7f0c940ab150 0x7f0c940c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 --2- 172.21.15.45:0/3377297188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c940a4da0 0x7f0c940aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 --2- 172.21.15.45:0/3377297188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c9414faf0 0x7f0c94156350 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 -- 172.21.15.45:0/3377297188 >> 172.21.15.45:0/3377297188 conn(0x7f0c940c6010 msgr2=0x7f0c940a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 -- 172.21.15.45:0/3377297188 shutdown_connections 2023-12-08T08:16:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.112+0000 7f0c9a021640 1 -- 172.21.15.45:0/3377297188 wait complete. 2023-12-08T08:16:20.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.113+0000 7f0c9a021640 1 Processor -- start 2023-12-08T08:16:20.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 -- start start 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c940a4da0 0x7f0c940c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c9414faf0 0x7f0c94149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9414b290 con 0x7f0c940ab150 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9414b7c0 con 0x7f0c940a4da0 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.114+0000 7f0c9a021640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941e7060 con 0x7f0c9414faf0 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52210/0 (socket says 172.21.15.45:52210) 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 -- 172.21.15.45:0/1187644094 learned_addr learned my addr 172.21.15.45:0/1187644094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c99820640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c9414faf0 0x7f0c94149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9901f640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c940a4da0 0x7f0c940c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 -- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c9414faf0 msgr2=0x7f0c94149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:20.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c9414faf0 0x7f0c94149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 -- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c940a4da0 msgr2=0x7f0c940c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:20.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c940a4da0 0x7f0c940c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.115+0000 7f0c9881e640 1 -- 172.21.15.45:0/1187644094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009b30 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c9881e640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400b4d0 tx=0x7f0c8400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84010870 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c840109d0 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84010d80 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9414b4e0 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.116+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c941e6cf0 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.117+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c941e71f0 con 0x7f0c940ab150 2023-12-08T08:16:20.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.118+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c8400f3c0 con 0x7f0c940ab150 2023-12-08T08:16:20.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.119+0000 7f0c89ffb640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:20.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.119+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f0c84089630 con 0x7f0c940ab150 2023-12-08T08:16:20.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.119+0000 7f0c9901f640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:20.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.120+0000 7f0c9901f640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 0x7f0c7806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c90035000 tx=0x7f0c90030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.124+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c84054690 con 0x7f0c940ab150 2023-12-08T08:16:20.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.317+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c94074450 con 0x7f0c940ab150 2023-12-08T08:16:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.866+0000 7f0c89ffb640 1 -- 172.21.15.45:0/1187644094 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f0c84057cb0 con 0x7f0c940ab150 2023-12-08T08:16:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' removed 2023-12-08T08:16:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.870+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 msgr2=0x7f0c7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.870+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 0x7f0c7806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c90035000 tx=0x7f0c90030000 comp rx=0 tx=0).stop 2023-12-08T08:16:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 msgr2=0x7f0c94149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400b4d0 tx=0x7f0c8400b990 comp rx=0 tx=0).stop 2023-12-08T08:16:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 shutdown_connections 2023-12-08T08:16:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0c7806ae40 0x7f0c7806d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0c9414faf0 0x7f0c94149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c940ab150 0x7f0c94149820 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 --2- 172.21.15.45:0/1187644094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c940a4da0 0x7f0c940c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 >> 172.21.15.45:0/1187644094 conn(0x7f0c940c6010 msgr2=0x7f0c940a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.871+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 shutdown_connections 2023-12-08T08:16:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:20.874+0000 7f0c9a021640 1 -- 172.21.15.45:0/1187644094 wait complete. 2023-12-08T08:16:20.904 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:16:20.904 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:16:20.905 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:16:20.905 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:16:20.905 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:16:20.905 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:16:20.905 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:16:20.905 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:16:20.905 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:16:20.906 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:16:20.906 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:16:20.906 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:16:20.906 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:16:20.906 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:16:20.906 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:16:20.906 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:16:20.924 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:16:20.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:16:20.925 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:16:20.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:16:20.927 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:16:20.928 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:16:20.930 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:16:20.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:16:20.973 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:16:20.974 DEBUG:teuthology.parallel:result is None 2023-12-08T08:16:20.978 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:16:20.978 DEBUG:teuthology.parallel:result is None 2023-12-08T08:16:20.980 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:16:20.980 DEBUG:teuthology.parallel:result is None 2023-12-08T08:16:20.985 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:16:20.986 DEBUG:teuthology.parallel:result is None 2023-12-08T08:16:20.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:16:21.140 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:16:21.142 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:16:21.142 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:16:21.143 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-12-08T08:16:21.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.182+0000 7f0de89be640 1 Processor -- start 2023-12-08T08:16:21.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.182+0000 7f0de89be640 1 -- start start 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de89be640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0de40c4bb0 0x7f0de40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de89be640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de406bc90 con 0x7f0de4151b30 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de89be640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40aa940 con 0x7f0de406c120 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de89be640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de40aa0a0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de1d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0de4151b30 0x7f0de4151f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52296/0 (socket says 172.21.15.45:52296) 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de1d9b640 1 -- 172.21.15.45:0/4041181267 learned_addr learned my addr 172.21.15.45:0/4041181267 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.183+0000 7f0de259c640 1 --2- 172.21.15.45:0/4041181267 >> v2:172.21.15.114:3300/0 conn(0x7f0de40c4bb0 0x7f0de40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947252157 0 0) 0x7f0de406bc90 con 0x7f0de4151b30 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd0003520 con 0x7f0de4151b30 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056388134 0 0) 0x7f0de40aa940 con 0x7f0de406c120 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de406bc90 con 0x7f0de406c120 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de259c640 1 -- 172.21.15.45:0/4041181267 >> v1:172.21.15.114:6789/0 conn(0x7f0de406c120 legacy=0x7f0de406c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de259c640 1 -- 172.21.15.45:0/4041181267 >> v1:172.21.15.45:6789/0 conn(0x7f0de4151b30 legacy=0x7f0de4151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.184+0000 7f0de259c640 1 -- 172.21.15.45:0/4041181267 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40aa380 con 0x7f0de40c4bb0 2023-12-08T08:16:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.185+0000 7f0de259c640 1 --2- 172.21.15.45:0/4041181267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de40c4bb0 0x7f0de40c12b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd5b336867d6eb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.186+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd402cc60 con 0x7f0de40c4bb0 2023-12-08T08:16:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.186+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd402cdc0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.186+0000 7f0de159a640 1 -- 172.21.15.45:0/4041181267 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4034660 con 0x7f0de40c4bb0 2023-12-08T08:16:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.186+0000 7f0de89be640 1 -- 172.21.15.45:0/4041181267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de40c4bb0 msgr2=0x7f0de40c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.186+0000 7f0de89be640 1 --2- 172.21.15.45:0/4041181267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de40c4bb0 0x7f0de40c12b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd402beb0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.187+0000 7f0de89be640 1 -- 172.21.15.45:0/4041181267 shutdown_connections 2023-12-08T08:16:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.187+0000 7f0de89be640 1 --2- 172.21.15.45:0/4041181267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de40c4bb0 0x7f0de40c12b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.187+0000 7f0de89be640 1 -- 172.21.15.45:0/4041181267 >> 172.21.15.45:0/4041181267 conn(0x7f0de4066db0 msgr2=0x7f0de40c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.187+0000 7f0de89be640 1 -- 172.21.15.45:0/4041181267 shutdown_connections 2023-12-08T08:16:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.187+0000 7f0de89be640 1 -- 172.21.15.45:0/4041181267 wait complete. 2023-12-08T08:16:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.188+0000 7f0de89be640 1 Processor -- start 2023-12-08T08:16:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 -- start start 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 0x7f0de4099e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4151b30 0x7f0de41ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40a84b0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40a6e80 con 0x7f0de406c120 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.189+0000 7f0de89be640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40a7160 con 0x7f0de4151b30 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52256/0 (socket says 172.21.15.45:52256) 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 -- 172.21.15.45:0/2170741646 learned_addr learned my addr 172.21.15.45:0/2170741646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de2d9d640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4151b30 0x7f0de41ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de259c640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 0x7f0de4099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 -- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4151b30 msgr2=0x7f0de41ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4151b30 0x7f0de41ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 -- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 msgr2=0x7f0de4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 0x7f0de4099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de1d9b640 1 -- 172.21.15.45:0/2170741646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009a70 con 0x7f0de40c4bb0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.190+0000 7f0de259c640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 0x7f0de4099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0de1d9b640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c410 tx=0x7f0dcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc005ce0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc005e40 con 0x7f0de40c4bb0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0072d0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de40a7440 con 0x7f0de40c4bb0 2023-12-08T08:16:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.191+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de41ed0b0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.192+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de4074600 con 0x7f0de40c4bb0 2023-12-08T08:16:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.193+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dcc007430 con 0x7f0de40c4bb0 2023-12-08T08:16:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.194+0000 7f0ddaffd640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 0x7f0dc406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.194+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0dcc088960 con 0x7f0de40c4bb0 2023-12-08T08:16:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.195+0000 7f0de259c640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 0x7f0dc406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.195+0000 7f0de259c640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 0x7f0dc406d350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4036000 tx=0x7f0dd4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.199+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dcc057780 con 0x7f0de40c4bb0 2023-12-08T08:16:21.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.408+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0de40a85f0 con 0x7f0de40c4bb0 2023-12-08T08:16:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.901+0000 7f0ddaffd640 1 -- 172.21.15.45:0/2170741646 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0dcc017080 con 0x7f0de40c4bb0 2023-12-08T08:16:21.904 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 msgr2=0x7f0dc406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 0x7f0dc406d350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4036000 tx=0x7f0dd4030000 comp rx=0 tx=0).stop 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 msgr2=0x7f0de4154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c410 tx=0x7f0dcc00c8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 shutdown_connections 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc406ae90 0x7f0dc406d350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4151b30 0x7f0de41ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c4bb0 0x7f0de4154bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 --2- 172.21.15.45:0/2170741646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de406c120 0x7f0de4099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.905+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 >> 172.21.15.45:0/2170741646 conn(0x7f0de4066db0 msgr2=0x7f0de40c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.906+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 shutdown_connections 2023-12-08T08:16:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:21.906+0000 7f0de89be640 1 -- 172.21.15.45:0/2170741646 wait complete. 2023-12-08T08:16:21.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:16:22.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.149+0000 7f9d3636c640 1 Processor -- start 2023-12-08T08:16:22.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.149+0000 7f9d3636c640 1 -- start start 2023-12-08T08:16:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.151+0000 7f9d3636c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 0x7f9d300aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.151+0000 7f9d3636c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d300c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.151+0000 7f9d3636c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300c28d0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.151+0000 7f9d3636c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300aa060 con 0x7f9d300aa2d0 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.151+0000 7f9d3636c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300a9d80 con 0x7f9d300a98c0 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d3536a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 0x7f9d300aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d34b69640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d300c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d3536a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 0x7f9d300aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:59068/0 (socket says 172.21.15.45:59068) 2023-12-08T08:16:22.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d3536a640 1 -- 172.21.15.45:0/4044562895 learned_addr learned my addr 172.21.15.45:0/4044562895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:22.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d34b69640 1 -- 172.21.15.45:0/4044562895 >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 msgr2=0x7f9d300aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:22.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d34b69640 1 --2- 172.21.15.45:0/4044562895 >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 0x7f9d300aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d34b69640 1 -- 172.21.15.45:0/4044562895 >> v1:172.21.15.114:6789/0 conn(0x7f9d300c2ce0 legacy=0x7f9d300c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.152+0000 7f9d34b69640 1 -- 172.21.15.45:0/4044562895 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3006cf70 con 0x7f9d300a98c0 2023-12-08T08:16:22.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.154+0000 7f9d34b69640 1 --2- 172.21.15.45:0/4044562895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d300c4c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097a0 tx=0x7f9d2002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=951275fa89b7ae5d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.154+0000 7f9d27fff640 1 -- 172.21.15.45:0/4044562895 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2002e070 con 0x7f9d300a98c0 2023-12-08T08:16:22.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d27fff640 1 -- 172.21.15.45:0/4044562895 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d200315a0 con 0x7f9d300a98c0 2023-12-08T08:16:22.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d27fff640 1 -- 172.21.15.45:0/4044562895 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20031930 con 0x7f9d300a98c0 2023-12-08T08:16:22.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d3636c640 1 -- 172.21.15.45:0/4044562895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 msgr2=0x7f9d300c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d3636c640 1 --2- 172.21.15.45:0/4044562895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d300c4c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097a0 tx=0x7f9d2002b840 comp rx=0 tx=0).stop 2023-12-08T08:16:22.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d3636c640 1 -- 172.21.15.45:0/4044562895 shutdown_connections 2023-12-08T08:16:22.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.155+0000 7f9d3636c640 1 --2- 172.21.15.45:0/4044562895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d300c4c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.156+0000 7f9d3636c640 1 --2- 172.21.15.45:0/4044562895 >> v2:172.21.15.114:3300/0 conn(0x7f9d300aa2d0 0x7f9d300aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.156+0000 7f9d3636c640 1 -- 172.21.15.45:0/4044562895 >> 172.21.15.45:0/4044562895 conn(0x7f9d300a88b0 msgr2=0x7f9d300a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:22.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.156+0000 7f9d3636c640 1 -- 172.21.15.45:0/4044562895 shutdown_connections 2023-12-08T08:16:22.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.156+0000 7f9d3636c640 1 -- 172.21.15.45:0/4044562895 wait complete. 2023-12-08T08:16:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.158+0000 7f9d3636c640 1 Processor -- start 2023-12-08T08:16:22.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.158+0000 7f9d3636c640 1 -- start start 2023-12-08T08:16:22.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d301ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d300aa2d0 0x7f9d30150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d301ec130 con 0x7f9d300c2ce0 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30071da0 con 0x7f9d300aa2d0 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.159+0000 7f9d3636c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30072890 con 0x7f9d300a98c0 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d35b6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d35b6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52264/0 (socket says 172.21.15.45:52264) 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d3536a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d301ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d35b6b640 1 -- 172.21.15.45:0/842092884 learned_addr learned my addr 172.21.15.45:0/842092884 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:22.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d34b69640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d300aa2d0 0x7f9d30150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d35b6b640 1 -- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 msgr2=0x7f9d301ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.160+0000 7f9d35b6b640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d301ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d35b6b640 1 -- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d300aa2d0 msgr2=0x7f9d30150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d35b6b640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d300aa2d0 0x7f9d30150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d35b6b640 1 -- 172.21.15.45:0/842092884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20009400 con 0x7f9d300c2ce0 2023-12-08T08:16:22.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d35b6b640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c6e0 tx=0x7f9d2800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003b70 con 0x7f9d300c2ce0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28003cf0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28005310 con 0x7f9d300c2ce0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30071ff0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.161+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d300725b0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.162+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d30066d30 con 0x7f9d300c2ce0 2023-12-08T08:16:22.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.164+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d28005470 con 0x7f9d300c2ce0 2023-12-08T08:16:22.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.164+0000 7f9d25ffb640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 0x7f9d1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.165+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9d280890b0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.165+0000 7f9d3536a640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 0x7f9d1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.166+0000 7f9d3536a640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 0x7f9d1406d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009bd0 tx=0x7f9d2c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.169+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d28054380 con 0x7f9d300c2ce0 2023-12-08T08:16:22.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.436+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d300743e0 con 0x7f9d300c2ce0 2023-12-08T08:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.436+0000 7f9d25ffb640 1 -- 172.21.15.45:0/842092884 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f9d28003e60 con 0x7f9d300c2ce0 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJla7GwKRAABCs1sRB3k9+U2d+Nv+6Qsg==", 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:16:22.442 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlUl35EBAAKLS/fMIt6G9vqde16uAsoA==", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.443 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlkimAOhAARjxtAqp4aGMJAk9pQEuEcg==", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlhY+rIRAAOcH5Vdj4eehrPUQuDuwLRw==", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBN0HJlen9oARAAcqoG1WYSzpUAuVNvDa1mKg==", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-08T08:16:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBQ0HJlEsRmGxAAfml/gGZ8vfNzJsUlDsTbyg==", 2023-12-08T08:16:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBU0HJl+ct7CBAAEuBM0fSR04+8zaRtqq8k/g==", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBX0HJlVnwVExAAFxt0oSVa42WXjwm+S9Ts6Q==", 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBe0HJlqX4IGBAAoSzK53JRumPJ10WGo1EjYA==", 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-08T08:16:22.449 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBh0HJlA6GSMRAAqOCPmn8QGJzAco8jgWd3zQ==", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBl0HJlXY8/ABAAXD0SJ5TMILJDA/sXMzLSRA==", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBo0HJlBOSzCRAA8e0cUSeNL2bCJyy587oT2Q==", 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-08T08:16:22.451 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg==", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA==", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-08T08:16:22.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBI0HJlPJ/uHBAAJP4PeCgGIkF9JZ0ruG0wGQ==", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-12-08T08:16:22.453 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJlfq52JhAA0Dul12EywJCnQDPsIMr58Q==", 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJlSrh2JhAA9iayvGZ+3mMd9elgK3nfwQ==", 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJlJcF2JhAAB6WDwZOLRT2Er9xLNaLhJA==", 2023-12-08T08:16:22.454 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJl78l2JhAAc6CAGhluR8eqDoOMK/nXbg==", 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJl6NJ2JhAAIKBcQVERwqD1qNO5UGY9ig==", 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.455 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBw0HJlsN52JhAAc4XzBLC4w/sbjNT/9gCj/A==", 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-08T08:16:22.456 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJl/rIKHRAAaJjZUtDXcmEgavGZvjHxow==", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlKZgvERAAL98Wtoye5tepo7AlBftDNg==", 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:16:22.457 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-08T08:16:22.458 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.439+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 msgr2=0x7f9d1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.439+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 0x7f9d1406d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009bd0 tx=0x7f9d2c009240 comp rx=0 tx=0).stop 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.439+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 msgr2=0x7f9d301495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.439+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c6e0 tx=0x7f9d2800cba0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 shutdown_connections 2023-12-08T08:16:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d1406ae40 0x7f9d1406d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d300c2ce0 0x7f9d301495d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d300aa2d0 0x7f9d30150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 --2- 172.21.15.45:0/842092884 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d300a98c0 0x7f9d301ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 >> 172.21.15.45:0/842092884 conn(0x7f9d300a88b0 msgr2=0x7f9d30155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 shutdown_connections 2023-12-08T08:16:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.440+0000 7f9d3636c640 1 -- 172.21.15.45:0/842092884 wait complete. 2023-12-08T08:16:22.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-08T08:16:22.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.687+0000 7f9eb4a00640 1 Processor -- start 2023-12-08T08:16:22.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.687+0000 7f9eb4a00640 1 -- start start 2023-12-08T08:16:22.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.688+0000 7f9eb4a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eb4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb0154a20 0x7f9eb0154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eb4a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00c63b0 con 0x7f9eb0154190 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eb4a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb00a9f20 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eb4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00a9580 con 0x7f9eb0154a20 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52274/0 (socket says 172.21.15.45:52274) 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 -- 172.21.15.45:0/1676737905 learned_addr learned my addr 172.21.15.45:0/1676737905 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eaed9d640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb0154a20 0x7f9eb0154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 -- 172.21.15.45:0/1676737905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb0154a20 msgr2=0x7f9eb0154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb0154a20 0x7f9eb0154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 -- 172.21.15.45:0/1676737905 >> v1:172.21.15.114:6789/0 conn(0x7f9eb0154190 legacy=0x7f9eb00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.689+0000 7f9eadd9b640 1 -- 172.21.15.45:0/1676737905 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00a9860 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.691+0000 7f9eadd9b640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009870 tx=0x7f9ea402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7495a68b477d46a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.691+0000 7f9ead59a640 1 -- 172.21.15.45:0/1676737905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40317c0 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.691+0000 7f9ead59a640 1 -- 172.21.15.45:0/1676737905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4031920 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.691+0000 7f9ead59a640 1 -- 172.21.15.45:0/1676737905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4031cb0 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 -- 172.21.15.45:0/1676737905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb00aa2b0 msgr2=0x7f9eb00a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009870 tx=0x7f9ea402b860 comp rx=0 tx=0).stop 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 -- 172.21.15.45:0/1676737905 shutdown_connections 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb0154a20 0x7f9eb0154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/1676737905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb00aa2b0 0x7f9eb00a4f30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 -- 172.21.15.45:0/1676737905 >> 172.21.15.45:0/1676737905 conn(0x7f9eb00661f0 msgr2=0x7f9eb0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 -- 172.21.15.45:0/1676737905 shutdown_connections 2023-12-08T08:16:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.692+0000 7f9eb4a00640 1 -- 172.21.15.45:0/1676737905 wait complete. 2023-12-08T08:16:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.694+0000 7f9eb4a00640 1 Processor -- start 2023-12-08T08:16:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.694+0000 7f9eb4a00640 1 -- start start 2023-12-08T08:16:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb00aa2b0 0x7f9eb01ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eb0154190 0x7f9eb01ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb014ee30 con 0x7f9eb0154a20 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01ede90 con 0x7f9eb0154190 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eb4a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0071880 con 0x7f9eb00aa2b0 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eaed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eaed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52278/0 (socket says 172.21.15.45:52278) 2023-12-08T08:16:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eaed9d640 1 -- 172.21.15.45:0/833431527 learned_addr learned my addr 172.21.15.45:0/833431527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eadd9b640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eb0154190 0x7f9eb01ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.696+0000 7f9eae59c640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb00aa2b0 0x7f9eb01ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 -- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb00aa2b0 msgr2=0x7f9eb01ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb00aa2b0 0x7f9eb01ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 -- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eb0154190 msgr2=0x7f9eb01ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eb0154190 0x7f9eb01ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 -- 172.21.15.45:0/833431527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea40094d0 con 0x7f9eb0154a20 2023-12-08T08:16:22.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eaed9d640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007e90 tx=0x7f9ea800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8014420 con 0x7f9eb0154a20 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8014580 con 0x7f9eb0154a20 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8014930 con 0x7f9eb0154a20 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.697+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb01dd4e0 con 0x7f9eb0154a20 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.698+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb014f0d0 con 0x7f9eb0154a20 2023-12-08T08:16:22.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.699+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb01ee0b0 con 0x7f9eb0154a20 2023-12-08T08:16:22.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.700+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea8014a90 con 0x7f9eb0154a20 2023-12-08T08:16:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.701+0000 7f9e9effd640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 0x7f9e9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.702+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9ea8089c80 con 0x7f9eb0154a20 2023-12-08T08:16:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.702+0000 7f9eae59c640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 0x7f9e9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.702+0000 7f9eae59c640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 0x7f9e9006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0004ea0 tx=0x7f9ea0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.706+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ea8054fd0 con 0x7f9eb0154a20 2023-12-08T08:16:22.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.977+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9eb0074600 con 0x7f9eb0154a20 2023-12-08T08:16:22.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.982+0000 7f9e9effd640 1 -- 172.21.15.45:0/833431527 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9ea80585f0 con 0x7f9eb0154a20 2023-12-08T08:16:22.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.985+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 msgr2=0x7f9e9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.985+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 0x7f9e9006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0004ea0 tx=0x7f9ea0009040 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.985+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 msgr2=0x7f9eb01da9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.985+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007e90 tx=0x7f9ea800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 shutdown_connections 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9e9006ae40 0x7f9e9006d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0154a20 0x7f9eb01da9a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9eb0154190 0x7f9eb01ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 --2- 172.21.15.45:0/833431527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9eb00aa2b0 0x7f9eb01ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 >> 172.21.15.45:0/833431527 conn(0x7f9eb00661f0 msgr2=0x7f9eb00665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 shutdown_connections 2023-12-08T08:16:22.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:22.986+0000 7f9eb4a00640 1 -- 172.21.15.45:0/833431527 wait complete. 2023-12-08T08:16:23.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-08T08:16:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.233+0000 7f9bb3439640 1 Processor -- start 2023-12-08T08:16:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.234+0000 7f9bb3439640 1 -- start start 2023-12-08T08:16:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb3439640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 0x7f9bac164750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb3439640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bac08a2d0 0x7f9bac164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb3439640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac06d6b0 con 0x7f9bac0c5990 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb3439640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0bff20 con 0x7f9bac08a2d0 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb3439640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0bf9f0 con 0x7f9bac0a5080 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb2c38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bac08a2d0 0x7f9bac164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb2c38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bac08a2d0 0x7f9bac164c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52286/0 (socket says 172.21.15.45:52286) 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.235+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1804899519 learned_addr learned my addr 172.21.15.45:0/1804899519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.237+0000 7f9bb1435640 1 -- 172.21.15.45:0/1804899519 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928349822 0 0) 0x7f9bac06d6b0 con 0x7f9bac0c5990 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.236+0000 7f9bb1c36640 1 --2- 172.21.15.45:0/1804899519 >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 0x7f9bac164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb1435640 1 -- 172.21.15.45:0/1804899519 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b98007930 con 0x7f9bac0c5990 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1804899519 >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 msgr2=0x7f9bac164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb2c38640 1 --2- 172.21.15.45:0/1804899519 >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 0x7f9bac164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1804899519 >> v1:172.21.15.114:6789/0 conn(0x7f9bac0c5990 legacy=0x7f9bac161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1804899519 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0bfc40 con 0x7f9bac08a2d0 2023-12-08T08:16:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.247+0000 7f9bb1c36640 1 --2- 172.21.15.45:0/1804899519 >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 0x7f9bac164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:23.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.249+0000 7f9bb2c38640 1 --2- 172.21.15.45:0/1804899519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac08a2d0 0x7f9bac164c90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0c68d0 tx=0x7f9ba402c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4772c1e460660e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.249+0000 7f9bb1435640 1 -- 172.21.15.45:0/1804899519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4034440 con 0x7f9bac08a2d0 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.249+0000 7f9bb1435640 1 -- 172.21.15.45:0/1804899519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba40345a0 con 0x7f9bac08a2d0 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.249+0000 7f9bb1435640 1 -- 172.21.15.45:0/1804899519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4034930 con 0x7f9bac08a2d0 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 -- 172.21.15.45:0/1804899519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac08a2d0 msgr2=0x7f9bac164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1804899519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac08a2d0 0x7f9bac164c90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0c68d0 tx=0x7f9ba402c200 comp rx=0 tx=0).stop 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 -- 172.21.15.45:0/1804899519 shutdown_connections 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1804899519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac08a2d0 0x7f9bac164c90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1804899519 >> v2:172.21.15.114:3300/0 conn(0x7f9bac0a5080 0x7f9bac164750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 -- 172.21.15.45:0/1804899519 >> 172.21.15.45:0/1804899519 conn(0x7f9bac06c180 msgr2=0x7f9bac0a88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 -- 172.21.15.45:0/1804899519 shutdown_connections 2023-12-08T08:16:23.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.250+0000 7f9bb3439640 1 -- 172.21.15.45:0/1804899519 wait complete. 2023-12-08T08:16:23.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.252+0000 7f9bb3439640 1 Processor -- start 2023-12-08T08:16:23.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.252+0000 7f9bb3439640 1 -- start start 2023-12-08T08:16:23.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac08a2d0 0x7f9bac0bef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bac0a5080 0x7f9bac0bf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0bb5b0 con 0x7f9bac0c5990 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac15e6a0 con 0x7f9bac08a2d0 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb3439640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac1f7c20 con 0x7f9bac0a5080 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb2c38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb2c38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52292/0 (socket says 172.21.15.45:52292) 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1778224222 learned_addr learned my addr 172.21.15.45:0/1778224222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.253+0000 7f9bb2437640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac08a2d0 0x7f9bac0bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb1c36640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bac0a5080 0x7f9bac0bf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bac0a5080 msgr2=0x7f9bac0bf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bac0a5080 0x7f9bac0bf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac08a2d0 msgr2=0x7f9bac0bef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac08a2d0 0x7f9bac0bef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 -- 172.21.15.45:0/1778224222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4008b20 con 0x7f9bac0c5990 2023-12-08T08:16:23.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb2c38640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4008fb0 tx=0x7f9ba4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4034440 con 0x7f9bac0c5990 2023-12-08T08:16:23.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4032b00 con 0x7f9bac0c5990 2023-12-08T08:16:23.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40074f0 con 0x7f9bac0c5990 2023-12-08T08:16:23.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.254+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0a7190 con 0x7f9bac0c5990 2023-12-08T08:16:23.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.255+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac1f7e70 con 0x7f9bac0c5990 2023-12-08T08:16:23.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.256+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac160220 con 0x7f9bac0c5990 2023-12-08T08:16:23.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.257+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ba403e400 con 0x7f9bac0c5990 2023-12-08T08:16:23.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.258+0000 7f9ba2ffd640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 0x7f9b9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.258+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9ba400d040 con 0x7f9bac0c5990 2023-12-08T08:16:23.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.258+0000 7f9bb2437640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 0x7f9b9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.259+0000 7f9bb2437640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 0x7f9b9006d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80011e0 tx=0x7f9ba8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.262+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ba4077510 con 0x7f9bac0c5990 2023-12-08T08:16:23.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.526+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9bac0743e0 con 0x7f9bac0c5990 2023-12-08T08:16:23.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.529+0000 7f9ba2ffd640 1 -- 172.21.15.45:0/1778224222 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9ba407ab30 con 0x7f9bac0c5990 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.532+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 msgr2=0x7f9b9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.532+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 0x7f9b9006d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80011e0 tx=0x7f9ba8009040 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.532+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 msgr2=0x7f9bac1f9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.532+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4008fb0 tx=0x7f9ba4004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 shutdown_connections 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b9006ae40 0x7f9b9006d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bac0a5080 0x7f9bac0bf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bac0c5990 0x7f9bac1f9f90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 --2- 172.21.15.45:0/1778224222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bac08a2d0 0x7f9bac0bef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 >> 172.21.15.45:0/1778224222 conn(0x7f9bac06c180 msgr2=0x7f9bac0aa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:23.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 shutdown_connections 2023-12-08T08:16:23.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.533+0000 7f9bb3439640 1 -- 172.21.15.45:0/1778224222 wait complete. 2023-12-08T08:16:23.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-08T08:16:23.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.773+0000 7f0a8b59e640 1 Processor -- start 2023-12-08T08:16:23.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.773+0000 7f0a8b59e640 1 -- start start 2023-12-08T08:16:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.774+0000 7f0a8b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a8c0aa2d0 0x7f0a8c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.774+0000 7f0a8b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0c28d0 con 0x7f0a8c0c5310 2023-12-08T08:16:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.774+0000 7f0a8b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0aa060 con 0x7f0a8c0a98c0 2023-12-08T08:16:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.774+0000 7f0a8b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0a9d80 con 0x7f0a8c0aa2d0 2023-12-08T08:16:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.775+0000 7f0a8ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a8c0c5310 0x7f0a8c15cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52300/0 (socket says 172.21.15.45:52300) 2023-12-08T08:16:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.775+0000 7f0a8ad9d640 1 -- 172.21.15.45:0/1852942246 learned_addr learned my addr 172.21.15.45:0/1852942246 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.775+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/1852942246 >> v2:172.21.15.114:3300/0 conn(0x7f0a8c0aa2d0 0x7f0a8c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.775+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505296932 0 0) 0x7f0a8c0c28d0 con 0x7f0a8c0c5310 2023-12-08T08:16:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.775+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a78003520 con 0x7f0a8c0c5310 2023-12-08T08:16:23.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782522698 0 0) 0x7f0a78003520 con 0x7f0a8c0c5310 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 >> v2:172.21.15.114:3300/0 conn(0x7f0a8c0aa2d0 msgr2=0x7f0a8c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 --2- 172.21.15.45:0/1852942246 >> v2:172.21.15.114:3300/0 conn(0x7f0a8c0aa2d0 0x7f0a8c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 >> v1:172.21.15.114:6789/0 conn(0x7f0a8c0a98c0 legacy=0x7f0a8c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c06cf70 con 0x7f0a8c0c5310 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f0a840019f0 con 0x7f0a8c0c5310 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 >> v1:172.21.15.45:6789/0 conn(0x7f0a8c0c5310 legacy=0x7f0a8c15cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780039c0 0x7f0a78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a780047c0 0x7f0a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 0x7f0a7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0a9d80 con 0x7f0a780051d0 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7800c120 con 0x7f0a780039c0 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7800c2e0 con 0x7f0a780047c0 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.776+0000 7f0a8ad9d640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 0x7f0a7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780039c0 0x7f0a78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a83fff640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a780047c0 0x7f0a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8ad9d640 1 -- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a780047c0 msgr2=0x7f0a78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8ad9d640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a780047c0 0x7f0a78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8ad9d640 1 -- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780039c0 msgr2=0x7f0a78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8ad9d640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780039c0 0x7f0a78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.777+0000 7f0a8ad9d640 1 -- 172.21.15.45:0/1852942246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78003520 con 0x7f0a780051d0 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.778+0000 7f0a8ad9d640 1 -- 172.21.15.45:0/1852942246 reap_dead start 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.778+0000 7f0a8ad9d640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 0x7f0a7800b980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0a84002230 tx=0x7f0a780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1718026c762e9234 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.778+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84034630 con 0x7f0a780051d0 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.778+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8402f070 con 0x7f0a780051d0 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.778+0000 7f0a89d9b640 1 -- 172.21.15.45:0/1852942246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840349d0 con 0x7f0a780051d0 2023-12-08T08:16:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 -- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 msgr2=0x7f0a7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 0x7f0a7800b980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0a84002230 tx=0x7f0a780057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 -- 172.21.15.45:0/1852942246 shutdown_connections 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/1852942246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a780051d0 0x7f0a7800b980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 -- 172.21.15.45:0/1852942246 >> 172.21.15.45:0/1852942246 conn(0x7f0a8c0a88b0 msgr2=0x7f0a8c0a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 -- 172.21.15.45:0/1852942246 shutdown_connections 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.779+0000 7f0a8b59e640 1 -- 172.21.15.45:0/1852942246 wait complete. 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.781+0000 7f0a8b59e640 1 Processor -- start 2023-12-08T08:16:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.781+0000 7f0a8b59e640 1 -- start start 2023-12-08T08:16:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 0x7f0a8c070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a8c1dbbb0 0x7f0a8c1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0a6ef0 con 0x7f0a8c0700d0 2023-12-08T08:16:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c06f960 con 0x7f0a780051d0 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a8b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c06fc40 con 0x7f0a8c1dbbb0 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52310/0 (socket says 172.21.15.45:52310) 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.782+0000 7f0a83fff640 1 -- 172.21.15.45:0/3191074752 learned_addr learned my addr 172.21.15.45:0/3191074752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 0x7f0a8c070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 -- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a8c1dbbb0 msgr2=0x7f0a8c1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a8c1dbbb0 0x7f0a8c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 -- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 msgr2=0x7f0a8c070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 0x7f0a8c070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 -- 172.21.15.45:0/3191074752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0a7140 con 0x7f0a8c0700d0 2023-12-08T08:16:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 0x7f0a8c070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a83fff640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e440 tx=0x7f0a7400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a740052e0 con 0x7f0a8c0700d0 2023-12-08T08:16:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74005440 con 0x7f0a8c0700d0 2023-12-08T08:16:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74003830 con 0x7f0a8c0700d0 2023-12-08T08:16:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.783+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c0a7420 con 0x7f0a8c0700d0 2023-12-08T08:16:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.784+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c0a6040 con 0x7f0a8c0700d0 2023-12-08T08:16:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.785+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c0a5200 con 0x7f0a8c0700d0 2023-12-08T08:16:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.786+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a74003990 con 0x7f0a8c0700d0 2023-12-08T08:16:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.787+0000 7f0a82ffd640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.787+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0a74089110 con 0x7f0a8c0700d0 2023-12-08T08:16:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.787+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.788+0000 7f0a8a59c640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 0x7f0a6c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009980 tx=0x7f0a7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:23.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:23.791+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a740543d0 con 0x7f0a8c0700d0 2023-12-08T08:16:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.058+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0a8c0743e0 con 0x7f0a8c0700d0 2023-12-08T08:16:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.063+0000 7f0a82ffd640 1 -- 172.21.15.45:0/3191074752 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0a740579f0 con 0x7f0a8c0700d0 2023-12-08T08:16:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 msgr2=0x7f0a6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 0x7f0a6c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009980 tx=0x7f0a7c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 msgr2=0x7f0a8c1db670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400e440 tx=0x7f0a7400e900 comp rx=0 tx=0).stop 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 shutdown_connections 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a8c1dbbb0 0x7f0a8c1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.065+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8c0700d0 0x7f0a8c1db670 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.066+0000 7f0a8b59e640 1 --2- 172.21.15.45:0/3191074752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a780051d0 0x7f0a8c070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.066+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 >> 172.21.15.45:0/3191074752 conn(0x7f0a8c0a88b0 msgr2=0x7f0a8c0661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.066+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 shutdown_connections 2023-12-08T08:16:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.066+0000 7f0a8b59e640 1 -- 172.21.15.45:0/3191074752 wait complete. 2023-12-08T08:16:24.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-08T08:16:24.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.312+0000 7fafa91f4640 1 Processor -- start 2023-12-08T08:16:24.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.313+0000 7fafa91f4640 1 -- start start 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa91f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7fafa41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa91f4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40c50d0 con 0x7fafa40c7b10 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa91f4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa4157a60 con 0x7fafa4151ca0 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa91f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40c5470 con 0x7fafa40c4590 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa89f3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafa40c7b10 0x7fafa40c9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52310/0 (socket says 172.21.15.45:52310) 2023-12-08T08:16:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.314+0000 7fafa89f3640 1 -- 172.21.15.45:0/3555423022 learned_addr learned my addr 172.21.15.45:0/3555423022 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7fafa41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805738398 0 0) 0x7fafa40c50d0 con 0x7fafa40c7b10 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003520 con 0x7fafa40c7b10 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825543537 0 0) 0x7faf90003520 con 0x7fafa40c7b10 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 msgr2=0x7fafa41584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7fafa41584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 >> v1:172.21.15.114:6789/0 conn(0x7fafa4151ca0 legacy=0x7fafa4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4158020 con 0x7fafa40c7b10 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7faf9c001670 con 0x7fafa40c7b10 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 >> v1:172.21.15.45:6789/0 conn(0x7fafa40c7b10 legacy=0x7fafa40c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7faf900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf90003f70 0x7faf900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.315+0000 7fafa2ffd640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40c5470 con 0x7faf90003f70 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000bb70 con 0x7faf90004d00 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000bd30 con 0x7fafa40c4590 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf90003f70 0x7faf900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa89f3640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa3fff640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7faf900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 -- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 msgr2=0x7faf900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafa40c4590 0x7faf900039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 -- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf90004d00 msgr2=0x7faf90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.316+0000 7fafa37fe640 1 -- 172.21.15.45:0/3555423022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90003520 con 0x7faf90003f70 2023-12-08T08:16:24.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.317+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf90003f70 0x7faf900047c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009ac0 tx=0x7faf900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9ecb02fbca8f1c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02c6b0 con 0x7faf90003f70 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c02c810 con 0x7faf90003f70 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa2ffd640 1 -- 172.21.15.45:0/3555423022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02cba0 con 0x7faf90003f70 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa91f4640 1 -- 172.21.15.45:0/3555423022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf90003f70 msgr2=0x7faf900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3555423022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf90003f70 0x7faf900047c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009ac0 tx=0x7faf900057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa89f3640 1 -- 172.21.15.45:0/3555423022 reap_dead start 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa91f4640 1 -- 172.21.15.45:0/3555423022 shutdown_connections 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.318+0000 7fafa91f4640 1 -- 172.21.15.45:0/3555423022 >> 172.21.15.45:0/3555423022 conn(0x7fafa406b850 msgr2=0x7fafa406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.319+0000 7fafa91f4640 1 -- 172.21.15.45:0/3555423022 shutdown_connections 2023-12-08T08:16:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.319+0000 7fafa91f4640 1 -- 172.21.15.45:0/3555423022 wait complete. 2023-12-08T08:16:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.320+0000 7fafa91f4640 1 Processor -- start 2023-12-08T08:16:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.320+0000 7fafa91f4640 1 -- start start 2023-12-08T08:16:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf90003f70 0x7fafa41ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafa41ed6e0 0x7fafa41edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa414e600 con 0x7fafa414c400 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41576c0 con 0x7fafa41ed6e0 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.321+0000 7fafa91f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4156b80 con 0x7faf90003f70 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52330/0 (socket says 172.21.15.45:52330) 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 -- 172.21.15.45:0/3220096333 learned_addr learned my addr 172.21.15.45:0/3220096333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa3fff640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf90003f70 0x7fafa41ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa89f3640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafa41ed6e0 0x7fafa41edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 -- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf90003f70 msgr2=0x7fafa41ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf90003f70 0x7fafa41ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 -- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafa41ed6e0 msgr2=0x7fafa41edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafa41ed6e0 0x7fafa41edb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 -- 172.21.15.45:0/3220096333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa41ea9a0 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.322+0000 7fafa37fe640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf8c02c250 tx=0x7faf8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.323+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003810 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.323+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c003970 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.323+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003ce0 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.323+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4156e20 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.323+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa41573e0 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.324+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40743e0 con 0x7fafa414c400 2023-12-08T08:16:24.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.325+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf8c034440 con 0x7fafa414c400 2023-12-08T08:16:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.326+0000 7fafa0ff9640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.326+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7faf8c0ab720 con 0x7fafa414c400 2023-12-08T08:16:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.326+0000 7fafa3fff640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.327+0000 7fafa3fff640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 0x7faf8406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faf94007fd0 tx=0x7faf94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.330+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf8c076ba0 con 0x7fafa414c400 2023-12-08T08:16:24.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.595+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fafa40c9980 con 0x7fafa414c400 2023-12-08T08:16:24.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.600+0000 7fafa0ff9640 1 -- 172.21.15.45:0/3220096333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf8c0044e0 con 0x7fafa414c400 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.602+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 msgr2=0x7faf8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.602+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 0x7faf8406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faf94007fd0 tx=0x7faf94009040 comp rx=0 tx=0).stop 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.602+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 msgr2=0x7fafa40aa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.602+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf8c02c250 tx=0x7faf8c004730 comp rx=0 tx=0).stop 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 shutdown_connections 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafa41ed6e0 0x7fafa41edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafa414c400 0x7fafa40aa790 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 --2- 172.21.15.45:0/3220096333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf90003f70 0x7fafa41ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 >> 172.21.15.45:0/3220096333 conn(0x7fafa406b850 msgr2=0x7fafa41531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 shutdown_connections 2023-12-08T08:16:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.603+0000 7fafa91f4640 1 -- 172.21.15.45:0/3220096333 wait complete. 2023-12-08T08:16:24.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-08T08:16:24.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.849+0000 7fcd28d5c640 1 Processor -- start 2023-12-08T08:16:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.849+0000 7fcd28d5c640 1 -- start start 2023-12-08T08:16:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.850+0000 7fcd28d5c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd240c5600 0x7fcd2406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.850+0000 7fcd28d5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd240c50b0 0x7fcd240c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd28d5c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd241521e0 con 0x7fcd2406b7b0 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd28d5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd24152b80 con 0x7fcd240c50b0 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd28d5c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd241524c0 con 0x7fcd240c5600 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd240c50b0 0x7fcd240c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd240c50b0 0x7fcd240c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52344/0 (socket says 172.21.15.45:52344) 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 -- 172.21.15.45:0/1512465909 learned_addr learned my addr 172.21.15.45:0/1512465909 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd237fe640 1 --2- 172.21.15.45:0/1512465909 >> v2:172.21.15.114:3300/0 conn(0x7fcd240c5600 0x7fcd2406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 -- 172.21.15.45:0/1512465909 >> v2:172.21.15.114:3300/0 conn(0x7fcd240c5600 msgr2=0x7fcd2406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 --2- 172.21.15.45:0/1512465909 >> v2:172.21.15.114:3300/0 conn(0x7fcd240c5600 0x7fcd2406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 -- 172.21.15.45:0/1512465909 >> v1:172.21.15.114:6789/0 conn(0x7fcd2406b7b0 legacy=0x7fcd241556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.851+0000 7fcd22ffd640 1 -- 172.21.15.45:0/1512465909 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd241527a0 con 0x7fcd240c50b0 2023-12-08T08:16:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.853+0000 7fcd22ffd640 1 --2- 172.21.15.45:0/1512465909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd240c59e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcd240aae60 tx=0x7fcd1802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7a3a5331311ab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.853+0000 7fcd227fc640 1 -- 172.21.15.45:0/1512465909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180317e0 con 0x7fcd240c50b0 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.853+0000 7fcd227fc640 1 -- 172.21.15.45:0/1512465909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18031940 con 0x7fcd240c50b0 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.853+0000 7fcd227fc640 1 -- 172.21.15.45:0/1512465909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18031cd0 con 0x7fcd240c50b0 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 -- 172.21.15.45:0/1512465909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 msgr2=0x7fcd240c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/1512465909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd240c59e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcd240aae60 tx=0x7fcd1802b880 comp rx=0 tx=0).stop 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 -- 172.21.15.45:0/1512465909 shutdown_connections 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/1512465909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd240c59e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/1512465909 >> v2:172.21.15.114:3300/0 conn(0x7fcd240c5600 0x7fcd2406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 -- 172.21.15.45:0/1512465909 >> 172.21.15.45:0/1512465909 conn(0x7fcd240a7600 msgr2=0x7fcd240a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 -- 172.21.15.45:0/1512465909 shutdown_connections 2023-12-08T08:16:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.854+0000 7fcd28d5c640 1 -- 172.21.15.45:0/1512465909 wait complete. 2023-12-08T08:16:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.856+0000 7fcd28d5c640 1 Processor -- start 2023-12-08T08:16:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.856+0000 7fcd28d5c640 1 -- start start 2023-12-08T08:16:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 0x7fcd2414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd240c5600 0x7fcd241dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24151680 con 0x7fcd240c50b0 2023-12-08T08:16:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24143760 con 0x7fcd2406b7b0 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd28d5c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241e9200 con 0x7fcd240c5600 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52356/0 (socket says 172.21.15.45:52356) 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 -- 172.21.15.45:0/4081237485 learned_addr learned my addr 172.21.15.45:0/4081237485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd237fe640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 0x7fcd2414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 -- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd240c5600 msgr2=0x7fcd241dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd240c5600 0x7fcd241dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 -- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 msgr2=0x7fcd2414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 0x7fcd2414ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd22ffd640 1 -- 172.21.15.45:0/4081237485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180094d0 con 0x7fcd240c50b0 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.857+0000 7fcd237fe640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 0x7fcd2414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd22ffd640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802b8c0 tx=0x7fcd180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032880 con 0x7fcd240c50b0 2023-12-08T08:16:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd180329e0 con 0x7fcd240c50b0 2023-12-08T08:16:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032d90 con 0x7fcd240c50b0 2023-12-08T08:16:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd241e7d10 con 0x7fcd240c50b0 2023-12-08T08:16:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.858+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd240c11d0 con 0x7fcd240c50b0 2023-12-08T08:16:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.859+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd241e7f00 con 0x7fcd240c50b0 2023-12-08T08:16:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.861+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd1804e450 con 0x7fcd240c50b0 2023-12-08T08:16:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.861+0000 7fcd0bfff640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 0x7fcd1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.862+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcd180ab510 con 0x7fcd240c50b0 2023-12-08T08:16:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.862+0000 7fcd237fe640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 0x7fcd1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.862+0000 7fcd237fe640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 0x7fcd1006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009f50 tx=0x7fcd1400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:24.866+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd18076870 con 0x7fcd240c50b0 2023-12-08T08:16:25.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.127+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcd240743e0 con 0x7fcd240c50b0 2023-12-08T08:16:25.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.132+0000 7fcd0bfff640 1 -- 172.21.15.45:0/4081237485 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd18079e90 con 0x7fcd240c50b0 2023-12-08T08:16:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.134+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 msgr2=0x7fcd1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.134+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 0x7fcd1006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009f50 tx=0x7fcd1400b040 comp rx=0 tx=0).stop 2023-12-08T08:16:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.134+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 msgr2=0x7fcd241dd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.134+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802b8c0 tx=0x7fcd180046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 shutdown_connections 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd1006ae40 0x7fcd1006d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd240c5600 0x7fcd241dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd240c50b0 0x7fcd241dd8c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 --2- 172.21.15.45:0/4081237485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd2406b7b0 0x7fcd2414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 >> 172.21.15.45:0/4081237485 conn(0x7fcd240a7600 msgr2=0x7fcd24151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 shutdown_connections 2023-12-08T08:16:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.135+0000 7fcd28d5c640 1 -- 172.21.15.45:0/4081237485 wait complete. 2023-12-08T08:16:25.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-08T08:16:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.369+0000 7f905cf16640 1 Processor -- start 2023-12-08T08:16:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.369+0000 7f905cf16640 1 -- start start 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90580c6880 0x7f90580c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90580c4e90 0x7f9058154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90580c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90581558c0 con 0x7f90580c4e90 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90580c80f0 con 0x7f90580c6880 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f905cf16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c83d0 con 0x7f9058155430 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f9055d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90580c4e90 0x7f9058154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f9055d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90580c4e90 0x7f9058154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41648/0 (socket says 172.21.15.45:41648) 2023-12-08T08:16:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.371+0000 7f9055d9b640 1 -- 172.21.15.45:0/2985983237 learned_addr learned my addr 172.21.15.45:0/2985983237 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9056d9d640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90580c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f905659c640 1 --2- 172.21.15.45:0/2985983237 >> v2:172.21.15.114:3300/0 conn(0x7f90580c6880 0x7f90580c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9055d9b640 1 -- 172.21.15.45:0/2985983237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 msgr2=0x7f90580c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9055d9b640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90580c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9055d9b640 1 -- 172.21.15.45:0/2985983237 >> v2:172.21.15.114:3300/0 conn(0x7f90580c6880 msgr2=0x7f90580c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9055d9b640 1 --2- 172.21.15.45:0/2985983237 >> v2:172.21.15.114:3300/0 conn(0x7f90580c6880 0x7f90580c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.372+0000 7f9055d9b640 1 -- 172.21.15.45:0/2985983237 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580c86b0 con 0x7f90580c4e90 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.373+0000 7f9055d9b640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c4e90 0x7f9058154ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f90580c5680 tx=0x7f904c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1366526c77c1ae6a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.373+0000 7f905559a640 1 -- 172.21.15.45:0/2985983237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c031860 con 0x7f90580c4e90 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.373+0000 7f905559a640 1 -- 172.21.15.45:0/2985983237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c0319c0 con 0x7f90580c4e90 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.373+0000 7f905559a640 1 -- 172.21.15.45:0/2985983237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c031d50 con 0x7f90580c4e90 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 -- 172.21.15.45:0/2985983237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c4e90 msgr2=0x7f9058154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c4e90 0x7f9058154ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f90580c5680 tx=0x7f904c02b900 comp rx=0 tx=0).stop 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 -- 172.21.15.45:0/2985983237 shutdown_connections 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90580c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 --2- 172.21.15.45:0/2985983237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c4e90 0x7f9058154ef0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 --2- 172.21.15.45:0/2985983237 >> v2:172.21.15.114:3300/0 conn(0x7f90580c6880 0x7f90580c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 -- 172.21.15.45:0/2985983237 >> 172.21.15.45:0/2985983237 conn(0x7f9058072240 msgr2=0x7f90580661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 -- 172.21.15.45:0/2985983237 shutdown_connections 2023-12-08T08:16:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.374+0000 7f905cf16640 1 -- 172.21.15.45:0/2985983237 wait complete. 2023-12-08T08:16:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.376+0000 7f905cf16640 1 Processor -- start 2023-12-08T08:16:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.376+0000 7f905cf16640 1 -- start start 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 0x7f90580aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90581e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580ac1f0 con 0x7f90580c6880 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580aaf00 con 0x7f90580c4e90 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f905cf16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90581ed930 con 0x7f9058155430 2023-12-08T08:16:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.377+0000 7f9055d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41650/0 (socket says 172.21.15.45:41650) 2023-12-08T08:16:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 -- 172.21.15.45:0/1278906610 learned_addr learned my addr 172.21.15.45:0/1278906610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f905659c640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 0x7f90580aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 -- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 msgr2=0x7f90581e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9056d9d640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90581e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90581e0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 -- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 msgr2=0x7f90580aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 0x7f90580aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 -- 172.21.15.45:0/1278906610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0094d0 con 0x7f90580c6880 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f905659c640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 0x7f90580aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.378+0000 7f9055d9b640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f904c02b940 tx=0x7f904c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.379+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c03ad30 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.379+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c0443f0 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.379+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0447a0 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.379+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90580abb30 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.379+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90581edc10 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.380+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058074600 con 0x7f90580c6880 2023-12-08T08:16:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.381+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f904c04d450 con 0x7f90580c6880 2023-12-08T08:16:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.382+0000 7f9046ffd640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 0x7f903806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.382+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f904c0ab960 con 0x7f90580c6880 2023-12-08T08:16:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.382+0000 7f905659c640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 0x7f903806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.383+0000 7f905659c640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 0x7f903806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9048009f70 tx=0x7f904800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.386+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f904c076c10 con 0x7f90580c6880 2023-12-08T08:16:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.647+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f90580c75d0 con 0x7f90580c6880 2023-12-08T08:16:25.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.651+0000 7f9046ffd640 1 -- 172.21.15.45:0/1278906610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f904c035070 con 0x7f90580c6880 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 msgr2=0x7f903806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 0x7f903806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9048009f70 tx=0x7f904800b040 comp rx=0 tx=0).stop 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 msgr2=0x7f90580c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f904c02b940 tx=0x7f904c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 shutdown_connections 2023-12-08T08:16:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f903806ae70 0x7f903806d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9058155430 0x7f90581e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90580c6880 0x7f90580c1640 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 --2- 172.21.15.45:0/1278906610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90580c4e90 0x7f90580aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 >> 172.21.15.45:0/1278906610 conn(0x7f9058072240 msgr2=0x7f9058152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.654+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 shutdown_connections 2023-12-08T08:16:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.655+0000 7f905cf16640 1 -- 172.21.15.45:0/1278906610 wait complete. 2023-12-08T08:16:25.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.868+0000 7f79f2147640 1 Processor -- start 2023-12-08T08:16:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.868+0000 7f79f2147640 1 -- start start 2023-12-08T08:16:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f2147640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79ec0c44d0 0x7f79ec1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f2147640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f79ec0c7a50 0x7f79ec0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f2147640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0c4a00 con 0x7f79ec1519c0 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f2147640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec0c4ce0 con 0x7f79ec0c44d0 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f2147640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec1579e0 con 0x7f79ec0c7a50 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f0944640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79ec0c44d0 0x7f79ec1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f0944640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79ec0c44d0 0x7f79ec1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41662/0 (socket says 172.21.15.45:41662) 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f0944640 1 -- 172.21.15.45:0/1292598861 learned_addr learned my addr 172.21.15.45:0/1292598861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.870+0000 7f79f1946640 1 --2- 172.21.15.45:0/1292598861 >> v2:172.21.15.114:3300/0 conn(0x7f79ec0c7a50 0x7f79ec0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.871+0000 7f79f0944640 1 -- 172.21.15.45:0/1292598861 >> v2:172.21.15.114:3300/0 conn(0x7f79ec0c7a50 msgr2=0x7f79ec0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.871+0000 7f79f0944640 1 --2- 172.21.15.45:0/1292598861 >> v2:172.21.15.114:3300/0 conn(0x7f79ec0c7a50 0x7f79ec0ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.871+0000 7f79f0944640 1 -- 172.21.15.45:0/1292598861 >> v1:172.21.15.114:6789/0 conn(0x7f79ec1519c0 legacy=0x7f79ec154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.871+0000 7f79f0944640 1 -- 172.21.15.45:0/1292598861 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec157cc0 con 0x7f79ec0c44d0 2023-12-08T08:16:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.872+0000 7f79f0944640 1 --2- 172.21.15.45:0/1292598861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c44d0 0x7f79ec1584c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c3f80 tx=0x7f79dc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf66bc2f8625bea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.872+0000 7f79e3fff640 1 -- 172.21.15.45:0/1292598861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc031750 con 0x7f79ec0c44d0 2023-12-08T08:16:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.872+0000 7f79e3fff640 1 -- 172.21.15.45:0/1292598861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0318b0 con 0x7f79ec0c44d0 2023-12-08T08:16:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.872+0000 7f79e3fff640 1 -- 172.21.15.45:0/1292598861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc031c40 con 0x7f79ec0c44d0 2023-12-08T08:16:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 -- 172.21.15.45:0/1292598861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c44d0 msgr2=0x7f79ec1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 --2- 172.21.15.45:0/1292598861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c44d0 0x7f79ec1584c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0c3f80 tx=0x7f79dc02b7f0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 -- 172.21.15.45:0/1292598861 shutdown_connections 2023-12-08T08:16:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 --2- 172.21.15.45:0/1292598861 >> v2:172.21.15.114:3300/0 conn(0x7f79ec0c7a50 0x7f79ec0ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 --2- 172.21.15.45:0/1292598861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c44d0 0x7f79ec1584c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 -- 172.21.15.45:0/1292598861 >> 172.21.15.45:0/1292598861 conn(0x7f79ec0661f0 msgr2=0x7f79ec066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 -- 172.21.15.45:0/1292598861 shutdown_connections 2023-12-08T08:16:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.873+0000 7f79f2147640 1 -- 172.21.15.45:0/1292598861 wait complete. 2023-12-08T08:16:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.875+0000 7f79f2147640 1 Processor -- start 2023-12-08T08:16:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.875+0000 7f79f2147640 1 -- start start 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 0x7f79ec0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79ec1519c0 0x7f79ec152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec152770 con 0x7f79ec0c7a50 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec1eb0d0 con 0x7f79ec0c44d0 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f2147640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec1538d0 con 0x7f79ec1519c0 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f0944640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f0944640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41664/0 (socket says 172.21.15.45:41664) 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.876+0000 7f79f0944640 1 -- 172.21.15.45:0/122001465 learned_addr learned my addr 172.21.15.45:0/122001465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f1145640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 0x7f79ec0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f1946640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79ec1519c0 0x7f79ec152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 -- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79ec1519c0 msgr2=0x7f79ec152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79ec1519c0 0x7f79ec152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 -- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 msgr2=0x7f79ec0ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 0x7f79ec0ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 -- 172.21.15.45:0/122001465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0094d0 con 0x7f79ec0c7a50 2023-12-08T08:16:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f1145640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 0x7f79ec0ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f0944640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f79dc000c00 tx=0x7f79dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc033c80 con 0x7f79ec0c7a50 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc033de0 con 0x7f79ec0c7a50 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc03c620 con 0x7f79ec0c7a50 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.877+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec1540e0 con 0x7f79ec0c7a50 2023-12-08T08:16:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.878+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec153e00 con 0x7f79ec0c7a50 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.879+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec1528b0 con 0x7f79ec0c7a50 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.880+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79dc03a040 con 0x7f79ec0c7a50 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.881+0000 7f79e1ffb640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 0x7f79d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.881+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f79dc0ab000 con 0x7f79ec0c7a50 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.881+0000 7f79f1145640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 0x7f79d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.882+0000 7f79f1145640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 0x7f79d006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f79e800a830 tx=0x7f79e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:25.885+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79ec1528b0 con 0x7f79ec0c7a50 2023-12-08T08:16:26.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.071+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79ec1528b0 con 0x7f79ec0c7a50 2023-12-08T08:16:26.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.073+0000 7f79e1ffb640 1 -- 172.21.15.45:0/122001465 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13038 (secure 0 0 0) 0x7f79ec1528b0 con 0x7f79ec0c7a50 2023-12-08T08:16:26.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:26.076 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:21.916759+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 msgr2=0x7f79d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 0x7f79d006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f79e800a830 tx=0x7f79e8008040 comp rx=0 tx=0).stop 2023-12-08T08:16:26.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 msgr2=0x7f79ec1eab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f79dc000c00 tx=0x7f79dc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 shutdown_connections 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f79d006ae40 0x7f79d006d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f79ec1519c0 0x7f79ec152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79ec0c7a50 0x7f79ec1eab90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 --2- 172.21.15.45:0/122001465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79ec0c44d0 0x7f79ec0ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.075+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 >> 172.21.15.45:0/122001465 conn(0x7f79ec0661f0 msgr2=0x7f79ec150790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.076+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 shutdown_connections 2023-12-08T08:16:26.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.076+0000 7f79f2147640 1 -- 172.21.15.45:0/122001465 wait complete. 2023-12-08T08:16:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:16:26.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.311+0000 7fefccbbc640 1 Processor -- start 2023-12-08T08:16:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.312+0000 7fefccbbc640 1 -- start start 2023-12-08T08:16:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefccbbc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc8151ad0 0x7fefc80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefccbbc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fefc80ca610 0x7fefc8155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefccbbc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc8151eb0 con 0x7fefc8157a20 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefccbbc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80c56a0 con 0x7fefc8151ad0 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefccbbc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80c80d0 con 0x7fefc80ca610 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.313+0000 7fefc77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc8151ad0 0x7fefc80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc8151ad0 0x7fefc80ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41672/0 (socket says 172.21.15.45:41672) 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 -- 172.21.15.45:0/4279025144 learned_addr learned my addr 172.21.15.45:0/4279025144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc6ffd640 1 --1- 172.21.15.45:0/4279025144 >> v1:172.21.15.45:6789/0 conn(0x7fefc8157a20 0x7fefc8154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47630/0 (socket says 172.21.15.45:47630) 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc7fff640 1 --2- 172.21.15.45:0/4279025144 >> v2:172.21.15.114:3300/0 conn(0x7fefc80ca610 0x7fefc8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 -- 172.21.15.45:0/4279025144 >> v2:172.21.15.114:3300/0 conn(0x7fefc80ca610 msgr2=0x7fefc8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 --2- 172.21.15.45:0/4279025144 >> v2:172.21.15.114:3300/0 conn(0x7fefc80ca610 0x7fefc8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 -- 172.21.15.45:0/4279025144 >> v1:172.21.15.45:6789/0 conn(0x7fefc8157a20 legacy=0x7fefc8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.314+0000 7fefc77fe640 1 -- 172.21.15.45:0/4279025144 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8154430 con 0x7fefc8151ad0 2023-12-08T08:16:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.315+0000 7fefc77fe640 1 --2- 172.21.15.45:0/4279025144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8151ad0 0x7fefc80ca0d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fefc806bca0 tx=0x7fefb802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8f63882165d6b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.315+0000 7fefc67fc640 1 -- 172.21.15.45:0/4279025144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb802cb10 con 0x7fefc8151ad0 2023-12-08T08:16:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefc67fc640 1 -- 172.21.15.45:0/4279025144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb802cc70 con 0x7fefc8151ad0 2023-12-08T08:16:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefc67fc640 1 -- 172.21.15.45:0/4279025144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80343f0 con 0x7fefc8151ad0 2023-12-08T08:16:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 -- 172.21.15.45:0/4279025144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8151ad0 msgr2=0x7fefc80ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 --2- 172.21.15.45:0/4279025144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8151ad0 0x7fefc80ca0d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fefc806bca0 tx=0x7fefb802bf70 comp rx=0 tx=0).stop 2023-12-08T08:16:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 -- 172.21.15.45:0/4279025144 shutdown_connections 2023-12-08T08:16:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 --2- 172.21.15.45:0/4279025144 >> v2:172.21.15.114:3300/0 conn(0x7fefc80ca610 0x7fefc8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 --2- 172.21.15.45:0/4279025144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8151ad0 0x7fefc80ca0d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 -- 172.21.15.45:0/4279025144 >> 172.21.15.45:0/4279025144 conn(0x7fefc8066610 msgr2=0x7fefc8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.316+0000 7fefccbbc640 1 -- 172.21.15.45:0/4279025144 shutdown_connections 2023-12-08T08:16:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.317+0000 7fefccbbc640 1 -- 172.21.15.45:0/4279025144 wait complete. 2023-12-08T08:16:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.318+0000 7fefccbbc640 1 Processor -- start 2023-12-08T08:16:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.318+0000 7fefccbbc640 1 -- start start 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 0x7fefc814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefc8157a20 0x7fefc80c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80c1420 con 0x7fefc8147490 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80bffb0 con 0x7fefc8157a20 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.319+0000 7fefccbbc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8155820 con 0x7fefc80ca610 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41682/0 (socket says 172.21.15.45:41682) 2023-12-08T08:16:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 -- 172.21.15.45:0/598479263 learned_addr learned my addr 172.21.15.45:0/598479263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc77fe640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 0x7fefc814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc6ffd640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefc8157a20 0x7fefc80c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 -- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 msgr2=0x7fefc814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 0x7fefc814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 -- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefc8157a20 msgr2=0x7fefc80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefc8157a20 0x7fefc80c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 -- 172.21.15.45:0/598479263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009b30 con 0x7fefc8147490 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc77fe640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 0x7fefc814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.320+0000 7fefc7fff640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d830 tx=0x7fefc000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.321+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000b6c0 con 0x7fefc8147490 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.321+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000b840 con 0x7fefc8147490 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.321+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000bbf0 con 0x7fefc8147490 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.321+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc814bd70 con 0x7fefc8147490 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.321+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc80c0c10 con 0x7fefc8147490 2023-12-08T08:16:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.322+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc81e9ab0 con 0x7fefc8147490 2023-12-08T08:16:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.323+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefc001e460 con 0x7fefc8147490 2023-12-08T08:16:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.324+0000 7fefaffff640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 0x7fefb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.324+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fefc0089b70 con 0x7fefc8147490 2023-12-08T08:16:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.325+0000 7fefc77fe640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 0x7fefb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.325+0000 7fefc77fe640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 0x7fefb406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fefb8035000 tx=0x7fefb8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.329+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fefc81e9ab0 con 0x7fefc8147490 2023-12-08T08:16:26.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.520+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefc81e9ab0 con 0x7fefc8147490 2023-12-08T08:16:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.521+0000 7fefaffff640 1 -- 172.21.15.45:0/598479263 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefc81e9ab0 con 0x7fefc8147490 2023-12-08T08:16:26.524 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 msgr2=0x7fefb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 0x7fefb406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fefb8035000 tx=0x7fefb8030000 comp rx=0 tx=0).stop 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 msgr2=0x7fefc80c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefc000d830 tx=0x7fefc000dcf0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 shutdown_connections 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefb406ae40 0x7fefb406d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc8147490 0x7fefc80c3060 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefc8157a20 0x7fefc80c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 --2- 172.21.15.45:0/598479263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefc80ca610 0x7fefc814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 >> 172.21.15.45:0/598479263 conn(0x7fefc8066610 msgr2=0x7fefc814e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 shutdown_connections 2023-12-08T08:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.524+0000 7fefccbbc640 1 -- 172.21.15.45:0/598479263 wait complete. 2023-12-08T08:16:26.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:16:26.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.771+0000 7f88b9bdb640 1 Processor -- start 2023-12-08T08:16:26.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.771+0000 7f88b9bdb640 1 -- start start 2023-12-08T08:16:26.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.772+0000 7f88b9bdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88b4155250 0x7f88b406c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.772+0000 7f88b9bdb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b41546b0 con 0x7f88b406c550 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88b9bdb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b40c1d60 con 0x7f88b40aaa20 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88b9bdb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b40aae00 con 0x7f88b4155250 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88b93da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88b4155250 0x7f88b406c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88abfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f88b406c550 0x7f88b4154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47644/0 (socket says 172.21.15.45:47644) 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88abfff640 1 -- 172.21.15.45:0/3974422672 learned_addr learned my addr 172.21.15.45:0/3974422672 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.773+0000 7f88b93da640 1 -- 172.21.15.45:0/3974422672 >> v1:172.21.15.114:6789/0 conn(0x7f88b40aaa20 legacy=0x7f88b40c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.774+0000 7f88b93da640 1 -- 172.21.15.45:0/3974422672 >> v1:172.21.15.45:6789/0 conn(0x7f88b406c550 legacy=0x7f88b4154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.774+0000 7f88ab7fe640 1 -- 172.21.15.45:0/3974422672 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499126430 0 0) 0x7f88b41546b0 con 0x7f88b406c550 2023-12-08T08:16:26.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.774+0000 7f88b93da640 1 -- 172.21.15.45:0/3974422672 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40c0c30 con 0x7f88b4155250 2023-12-08T08:16:26.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.775+0000 7f88b93da640 1 --2- 172.21.15.45:0/3974422672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4155250 0x7f88b406c9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009d90 tx=0x7f88ac02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6648a5133d7a21a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.775+0000 7f88ab7fe640 1 -- 172.21.15.45:0/3974422672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac02cc60 con 0x7f88b4155250 2023-12-08T08:16:26.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.775+0000 7f88ab7fe640 1 -- 172.21.15.45:0/3974422672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac02cdc0 con 0x7f88b4155250 2023-12-08T08:16:26.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.775+0000 7f88ab7fe640 1 -- 172.21.15.45:0/3974422672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac034660 con 0x7f88b4155250 2023-12-08T08:16:26.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 -- 172.21.15.45:0/3974422672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4155250 msgr2=0x7f88b406c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/3974422672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4155250 0x7f88b406c9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009d90 tx=0x7f88ac02beb0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 -- 172.21.15.45:0/3974422672 shutdown_connections 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/3974422672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b4155250 0x7f88b406c9b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 -- 172.21.15.45:0/3974422672 >> 172.21.15.45:0/3974422672 conn(0x7f88b4066d40 msgr2=0x7f88b40c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 -- 172.21.15.45:0/3974422672 shutdown_connections 2023-12-08T08:16:26.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.776+0000 7f88b9bdb640 1 -- 172.21.15.45:0/3974422672 wait complete. 2023-12-08T08:16:26.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.777+0000 7f88b9bdb640 1 Processor -- start 2023-12-08T08:16:26.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 -- start start 2023-12-08T08:16:26.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88b406c550 0x7f88b41469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88b4155250 0x7f88b41427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4145610 con 0x7f88b40aaa20 2023-12-08T08:16:26.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414db50 con 0x7f88b4155250 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.778+0000 7f88b9bdb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b414e690 con 0x7f88b406c550 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41706/0 (socket says 172.21.15.45:41706) 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 -- 172.21.15.45:0/701298609 learned_addr learned my addr 172.21.15.45:0/701298609 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 -- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88b406c550 msgr2=0x7f88b41469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88b406c550 0x7f88b41469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 -- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88b4155250 msgr2=0x7f88b41427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88b4155250 0x7f88b41427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 -- 172.21.15.45:0/701298609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009a70 con 0x7f88b40aaa20 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.779+0000 7f88abfff640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c420 tx=0x7f88a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.780+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40074e0 con 0x7f88b40aaa20 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.780+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4007640 con 0x7f88b40aaa20 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.780+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4004a20 con 0x7f88b40aaa20 2023-12-08T08:16:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.780+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b414e080 con 0x7f88b40aaa20 2023-12-08T08:16:26.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.780+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b414e320 con 0x7f88b40aaa20 2023-12-08T08:16:26.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.781+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b414dee0 con 0x7f88b40aaa20 2023-12-08T08:16:26.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.782+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88a4004b80 con 0x7f88b40aaa20 2023-12-08T08:16:26.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.783+0000 7f88a97fa640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 0x7f88a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:26.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.783+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f88a40891a0 con 0x7f88b40aaa20 2023-12-08T08:16:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.783+0000 7f88b8bd9640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 0x7f88a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.784+0000 7f88b8bd9640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 0x7f88a006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000f60 tx=0x7f88b00079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.788+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88b414dee0 con 0x7f88b40aaa20 2023-12-08T08:16:26.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.984+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f88b414dee0 con 0x7f88b40aaa20 2023-12-08T08:16:26.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.985+0000 7f88a97fa640 1 -- 172.21.15.45:0/701298609 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f88b414dee0 con 0x7f88b40aaa20 2023-12-08T08:16:26.988 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:26.988 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:16:26.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:26.989 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:16:26.989 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:16:26.989 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:26.989 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 msgr2=0x7f88a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 0x7f88a006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000f60 tx=0x7f88b00079b0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 msgr2=0x7f88b4142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c420 tx=0x7f88a400c8e0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 shutdown_connections 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f88a006ae40 0x7f88a006d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88b4155250 0x7f88b41427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b40aaa20 0x7f88b4142260 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 --2- 172.21.15.45:0/701298609 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f88b406c550 0x7f88b41469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:26.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 >> 172.21.15.45:0/701298609 conn(0x7f88b4066d40 msgr2=0x7f88b406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:26.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 shutdown_connections 2023-12-08T08:16:26.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:26.988+0000 7f88b9bdb640 1 -- 172.21.15.45:0/701298609 wait complete. 2023-12-08T08:16:27.010 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:16:27.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:16:27.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.230+0000 7f175d162640 1 Processor -- start 2023-12-08T08:16:27.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.230+0000 7f175d162640 1 -- start start 2023-12-08T08:16:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175d162640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1758153780 0x7f1758156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175d162640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f175806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175d162640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1758152290 con 0x7f175814f740 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175d162640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1758153180 con 0x7f1758153780 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175d162640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c16f0 con 0x7f17580a4d10 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f1757fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f175814f740 0x7f1758152a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47654/0 (socket says 172.21.15.45:47654) 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f1757fff640 1 -- 172.21.15.45:0/4001075460 learned_addr learned my addr 172.21.15.45:0/4001075460 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f174f7fe640 1 --2- 172.21.15.45:0/4001075460 >> v2:172.21.15.45:3300/0 conn(0x7f1758153780 0x7f1758156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.232+0000 7f175c961640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f175806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.233+0000 7f17577fe640 1 -- 172.21.15.45:0/4001075460 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109571284 0 0) 0x7f1758152290 con 0x7f175814f740 2023-12-08T08:16:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.233+0000 7f174f7fe640 1 -- 172.21.15.45:0/4001075460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 msgr2=0x7f175806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.233+0000 7f174f7fe640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f175806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.233+0000 7f174f7fe640 1 -- 172.21.15.45:0/4001075460 >> v1:172.21.15.45:6789/0 conn(0x7f175814f740 legacy=0x7f1758152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.233+0000 7f174f7fe640 1 -- 172.21.15.45:0/4001075460 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580c19d0 con 0x7f1758153780 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.234+0000 7f174f7fe640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1758153780 0x7f1758156290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17400097a0 tx=0x7f174002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f336914e3a24f7ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.234+0000 7f17577fe640 1 -- 172.21.15.45:0/4001075460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400316f0 con 0x7f1758153780 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.234+0000 7f17577fe640 1 -- 172.21.15.45:0/4001075460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740031850 con 0x7f1758153780 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.234+0000 7f17577fe640 1 -- 172.21.15.45:0/4001075460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740031be0 con 0x7f1758153780 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 -- 172.21.15.45:0/4001075460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1758153780 msgr2=0x7f1758156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1758153780 0x7f1758156290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17400097a0 tx=0x7f174002b790 comp rx=0 tx=0).stop 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 -- 172.21.15.45:0/4001075460 shutdown_connections 2023-12-08T08:16:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f175806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 --2- 172.21.15.45:0/4001075460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1758153780 0x7f1758156290 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 -- 172.21.15.45:0/4001075460 >> 172.21.15.45:0/4001075460 conn(0x7f1758066df0 msgr2=0x7f17580a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 -- 172.21.15.45:0/4001075460 shutdown_connections 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.235+0000 7f175d162640 1 -- 172.21.15.45:0/4001075460 wait complete. 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.237+0000 7f175d162640 1 Processor -- start 2023-12-08T08:16:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.237+0000 7f175d162640 1 -- start start 2023-12-08T08:16:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f17581ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1758153780 0x7f175814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580a76f0 con 0x7f175814f740 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580a9890 con 0x7f1758153780 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f175d162640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17581eaca0 con 0x7f17580a4d10 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41726/0 (socket says 172.21.15.45:41726) 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.238+0000 7f174f7fe640 1 -- 172.21.15.45:0/2126557761 learned_addr learned my addr 172.21.15.45:0/2126557761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f1757fff640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f17581ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 -- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 msgr2=0x7f17581ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f17581ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f175c961640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1758153780 0x7f175814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 -- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1758153780 msgr2=0x7f175814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1758153780 0x7f175814a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 -- 172.21.15.45:0/2126557761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009400 con 0x7f175814f740 2023-12-08T08:16:27.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f1757fff640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f17581ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:27.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f174f7fe640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1740000c00 tx=0x7f17400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:27.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740034890 con 0x7f175814f740 2023-12-08T08:16:27.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400349f0 con 0x7f175814f740 2023-12-08T08:16:27.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740034da0 con 0x7f175814f740 2023-12-08T08:16:27.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.239+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17580a9e10 con 0x7f175814f740 2023-12-08T08:16:27.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.240+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175814b350 con 0x7f175814f740 2023-12-08T08:16:27.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.241+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1758067900 con 0x7f175814f740 2023-12-08T08:16:27.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.242+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f174003b040 con 0x7f175814f740 2023-12-08T08:16:27.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.243+0000 7f17557fa640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 0x7f173806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:27.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.243+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f17400aade0 con 0x7f175814f740 2023-12-08T08:16:27.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.243+0000 7f1757fff640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 0x7f173806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:27.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.244+0000 7f1757fff640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 0x7f173806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1748000f60 tx=0x7f1748009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.247+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1740076090 con 0x7f175814f740 2023-12-08T08:16:27.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.444+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f175806da00 con 0x7f175814f740 2023-12-08T08:16:27.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.927+0000 7f17557fa640 1 -- 172.21.15.45:0/2126557761 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f17400390b0 con 0x7f175814f740 2023-12-08T08:16:27.930 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.931+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 msgr2=0x7f173806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.931+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 0x7f173806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1748000f60 tx=0x7f1748009040 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.931+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 msgr2=0x7f17580a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.931+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1740000c00 tx=0x7f17400046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 shutdown_connections 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f173806ae70 0x7f173806d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1758153780 0x7f175814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f175814f740 0x7f17580a6bb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 --2- 172.21.15.45:0/2126557761 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f17580a4d10 0x7f17581ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.932+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 >> 172.21.15.45:0/2126557761 conn(0x7f1758066df0 msgr2=0x7f17580a8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:27.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.933+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 shutdown_connections 2023-12-08T08:16:27.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:27.933+0000 7f175d162640 1 -- 172.21.15.45:0/2126557761 wait complete. 2023-12-08T08:16:27.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:16:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.183+0000 7f72d00bb640 1 Processor -- start 2023-12-08T08:16:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.183+0000 7f72d00bb640 1 -- start start 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72d00bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c80c1630 0x7f72c815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72d00bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c8154cf0 con 0x7f72c80a6ec0 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72d00bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c8151e50 con 0x7f72c8151a70 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72d00bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c81543e0 con 0x7f72c80c1630 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72ce658640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c80c1630 0x7f72c815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72ce658640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c80c1630 0x7f72c815fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41738/0 (socket says 172.21.15.45:41738) 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72ce658640 1 -- 172.21.15.45:0/3555689249 learned_addr learned my addr 172.21.15.45:0/3555689249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.185+0000 7f72cd656640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72c80a6ec0 0x7f72c80c0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47664/0 (socket says 172.21.15.45:47664) 2023-12-08T08:16:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.186+0000 7f72ce658640 1 -- 172.21.15.45:0/3555689249 >> v1:172.21.15.114:6789/0 conn(0x7f72c8151a70 legacy=0x7f72c80c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.186+0000 7f72ce658640 1 -- 172.21.15.45:0/3555689249 >> v1:172.21.15.45:6789/0 conn(0x7f72c80a6ec0 legacy=0x7f72c80c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.186+0000 7f72ce658640 1 -- 172.21.15.45:0/3555689249 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80a7440 con 0x7f72c80c1630 2023-12-08T08:16:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.187+0000 7f72ce658640 1 --2- 172.21.15.45:0/3555689249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c80c1630 0x7f72c815fd70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009e50 tx=0x7f72c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317b483863987fe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.187+0000 7f72cce55640 1 -- 172.21.15.45:0/3555689249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c002c9f0 con 0x7f72c80c1630 2023-12-08T08:16:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.187+0000 7f72cce55640 1 -- 172.21.15.45:0/3555689249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c002cb50 con 0x7f72c80c1630 2023-12-08T08:16:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.187+0000 7f72cce55640 1 -- 172.21.15.45:0/3555689249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00343f0 con 0x7f72c80c1630 2023-12-08T08:16:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 -- 172.21.15.45:0/3555689249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c80c1630 msgr2=0x7f72c815fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3555689249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c80c1630 0x7f72c815fd70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009e50 tx=0x7f72c002be50 comp rx=0 tx=0).stop 2023-12-08T08:16:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 -- 172.21.15.45:0/3555689249 shutdown_connections 2023-12-08T08:16:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3555689249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c80c1630 0x7f72c815fd70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 -- 172.21.15.45:0/3555689249 >> 172.21.15.45:0/3555689249 conn(0x7f72c80a98a0 msgr2=0x7f72c80a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 -- 172.21.15.45:0/3555689249 shutdown_connections 2023-12-08T08:16:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.188+0000 7f72d00bb640 1 -- 172.21.15.45:0/3555689249 wait complete. 2023-12-08T08:16:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.190+0000 7f72d00bb640 1 Processor -- start 2023-12-08T08:16:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.190+0000 7f72d00bb640 1 -- start start 2023-12-08T08:16:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f72c80a6ec0 0x7f72c80c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 0x7f72c80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814bd10 con 0x7f72c8151a70 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814c2d0 con 0x7f72c81586c0 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72d00bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c3650 con 0x7f72c80a6ec0 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72cd656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72cd656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41750/0 (socket says 172.21.15.45:41750) 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72cd656640 1 -- 172.21.15.45:0/3326015935 learned_addr learned my addr 172.21.15.45:0/3326015935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72ce658640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 0x7f72c80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.191+0000 7f72cde57640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f72c80a6ec0 0x7f72c80c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 -- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f72c80a6ec0 msgr2=0x7f72c80c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f72c80a6ec0 0x7f72c80c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 -- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 msgr2=0x7f72c80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 0x7f72c80c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 -- 172.21.15.45:0/3326015935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0009b30 con 0x7f72c8151a70 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72ce658640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 0x7f72c80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72cd656640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c430 tx=0x7f72b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b80074e0 con 0x7f72c8151a70 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8007640 con 0x7f72c8151a70 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8004a00 con 0x7f72c8151a70 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80c3930 con 0x7f72c8151a70 2023-12-08T08:16:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.192+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80c2ba0 con 0x7f72c8151a70 2023-12-08T08:16:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.193+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c814ad00 con 0x7f72c8151a70 2023-12-08T08:16:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.195+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72b8004b60 con 0x7f72c8151a70 2023-12-08T08:16:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.196+0000 7f72be7fc640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 0x7f72ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.196+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f72b80896c0 con 0x7f72c8151a70 2023-12-08T08:16:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.196+0000 7f72cde57640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 0x7f72ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.197+0000 7f72cde57640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 0x7f72ac06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72c4006fd0 tx=0x7f72c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.199+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72b8054880 con 0x7f72c8151a70 2023-12-08T08:16:28.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:28.212 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.397+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f72c8074670 con 0x7f72c8151a70 2023-12-08T08:16:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.934+0000 7f72be7fc640 1 -- 172.21.15.45:0/3326015935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f72b8057ea0 con 0x7f72c8151a70 2023-12-08T08:16:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-08T08:16:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 msgr2=0x7f72ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 0x7f72ac06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72c4006fd0 tx=0x7f72c4008040 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 msgr2=0x7f72c814d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c430 tx=0x7f72b800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 shutdown_connections 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f72ac06ae40 0x7f72ac06d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c81586c0 0x7f72c80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c8151a70 0x7f72c814d4f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 --2- 172.21.15.45:0/3326015935 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f72c80a6ec0 0x7f72c80c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 >> 172.21.15.45:0/3326015935 conn(0x7f72c80a98a0 msgr2=0x7f72c8152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:28.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.938+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 shutdown_connections 2023-12-08T08:16:28.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:28.939+0000 7f72d00bb640 1 -- 172.21.15.45:0/3326015935 wait complete. 2023-12-08T08:16:28.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:16:29.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.165+0000 7f751359e640 1 Processor -- start 2023-12-08T08:16:29.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.165+0000 7f751359e640 1 -- start start 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 0x7f75141591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75140c36e0 0x7f75140c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751359e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751406d2d0 con 0x7f7514155e40 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75141597a0 con 0x7f75140c36e0 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7514156220 con 0x7f751406ba10 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7514155e40 0x7f75140c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47670/0 (socket says 172.21.15.45:47670) 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f7512d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75140c36e0 0x7f75140c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.166+0000 7f751259c640 1 -- 172.21.15.45:0/117354527 learned_addr learned my addr 172.21.15.45:0/117354527 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7511d9b640 1 --2- 172.21.15.45:0/117354527 >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 0x7f75141591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7512d9d640 1 -- 172.21.15.45:0/117354527 >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 msgr2=0x7f75141591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7512d9d640 1 --2- 172.21.15.45:0/117354527 >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 0x7f75141591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7512d9d640 1 -- 172.21.15.45:0/117354527 >> v1:172.21.15.45:6789/0 conn(0x7f7514155e40 legacy=0x7f75140c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7512d9d640 1 -- 172.21.15.45:0/117354527 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140c5470 con 0x7f75140c36e0 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f751159a640 1 -- 172.21.15.45:0/117354527 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21747112 0 0) 0x7f751406d2d0 con 0x7f7514155e40 2023-12-08T08:16:29.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.167+0000 7f7511d9b640 1 --2- 172.21.15.45:0/117354527 >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 0x7f75141591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:29.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.168+0000 7f7512d9d640 1 --2- 172.21.15.45:0/117354527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c3af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f751406b590 tx=0x7f750c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1013b624bc154ba server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:29.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.168+0000 7f751159a640 1 -- 172.21.15.45:0/117354527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c031830 con 0x7f75140c36e0 2023-12-08T08:16:29.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.168+0000 7f751159a640 1 -- 172.21.15.45:0/117354527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c031990 con 0x7f75140c36e0 2023-12-08T08:16:29.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.168+0000 7f751159a640 1 -- 172.21.15.45:0/117354527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c031d20 con 0x7f75140c36e0 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 -- 172.21.15.45:0/117354527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 msgr2=0x7f75140c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 --2- 172.21.15.45:0/117354527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c3af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f751406b590 tx=0x7f750c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 -- 172.21.15.45:0/117354527 shutdown_connections 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 --2- 172.21.15.45:0/117354527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c3af0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 --2- 172.21.15.45:0/117354527 >> v2:172.21.15.114:3300/0 conn(0x7f751406ba10 0x7f75141591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 -- 172.21.15.45:0/117354527 >> 172.21.15.45:0/117354527 conn(0x7f7514066ce0 msgr2=0x7f75140a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:29.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 -- 172.21.15.45:0/117354527 shutdown_connections 2023-12-08T08:16:29.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.169+0000 7f751359e640 1 -- 172.21.15.45:0/117354527 wait complete. 2023-12-08T08:16:29.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.171+0000 7f751359e640 1 Processor -- start 2023-12-08T08:16:29.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.171+0000 7f751359e640 1 -- start start 2023-12-08T08:16:29.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 0x7f75141f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7514155e40 0x7f75141edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75141f1f50 con 0x7f75140c36e0 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7514070380 con 0x7f7514155e40 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751406fdc0 con 0x7f751406ba10 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f7511d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f7511d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41768/0 (socket says 172.21.15.45:41768) 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f7511d9b640 1 -- 172.21.15.45:0/1302247433 learned_addr learned my addr 172.21.15.45:0/1302247433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.172+0000 7f751259c640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 0x7f75141f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7512d9d640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7514155e40 0x7f75141edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 -- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 msgr2=0x7f75141f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 0x7f75141f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 -- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7514155e40 msgr2=0x7f75141edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7514155e40 0x7f75141edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 -- 172.21.15.45:0/1302247433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009400 con 0x7f75140c36e0 2023-12-08T08:16:29.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f751259c640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 0x7f75141f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:29.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f7511d9b640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ce00 tx=0x7f74fc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:29.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00f890 con 0x7f75140c36e0 2023-12-08T08:16:29.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00f9f0 con 0x7f75140c36e0 2023-12-08T08:16:29.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00fdc0 con 0x7f75140c36e0 2023-12-08T08:16:29.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75140700a0 con 0x7f75140c36e0 2023-12-08T08:16:29.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.173+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75141f14f0 con 0x7f75140c36e0 2023-12-08T08:16:29.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.175+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75141f1070 con 0x7f75140c36e0 2023-12-08T08:16:29.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.176+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74fc00b040 con 0x7f75140c36e0 2023-12-08T08:16:29.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.177+0000 7f750affd640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 0x7f74f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:29.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.177+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f74fc08a450 con 0x7f75140c36e0 2023-12-08T08:16:29.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.177+0000 7f751259c640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 0x7f74f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:29.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.178+0000 7f751259c640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 0x7f74f406d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:29.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.180+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74fc055540 con 0x7f75140c36e0 2023-12-08T08:16:29.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.409+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f75141f1070 con 0x7f75140c36e0 2023-12-08T08:16:29.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.979+0000 7f750affd640 1 -- 172.21.15.45:0/1302247433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f75141f1070 con 0x7f75140c36e0 2023-12-08T08:16:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-12-08T08:16:29.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.988+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 msgr2=0x7f74f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.988+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 0x7f74f406d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504009040 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 msgr2=0x7f75140c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ce00 tx=0x7f74fc00a650 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 shutdown_connections 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f74f406ae40 0x7f74f406d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7514155e40 0x7f75141edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75140c36e0 0x7f75140c0660 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ce00 tx=0x7f74fc00a650 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 --2- 172.21.15.45:0/1302247433 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f751406ba10 0x7f75141f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.989+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 >> 172.21.15.45:0/1302247433 conn(0x7f7514066ce0 msgr2=0x7f75140c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.990+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 shutdown_connections 2023-12-08T08:16:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:29.994+0000 7f751359e640 1 -- 172.21.15.45:0/1302247433 wait complete. 2023-12-08T08:16:30.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.214+0000 7f51a7fff640 1 Processor -- start 2023-12-08T08:16:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.214+0000 7f51a7fff640 1 -- start start 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51a80c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a7fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a8155850 con 0x7f51a81521b0 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a7fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a80c0890 con 0x7f51a80c1dc0 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c0b70 con 0x7f51a80a7910 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f51a81521b0 0x7f51a8155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47672/0 (socket says 172.21.15.45:47672) 2023-12-08T08:16:30.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.216+0000 7f51a77fe640 1 -- 172.21.15.45:0/3088621276 learned_addr learned my addr 172.21.15.45:0/3088621276 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51a80c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693851588 0 0) 0x7f51a8155850 con 0x7f51a81521b0 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5194003520 con 0x7f51a81521b0 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369451662 0 0) 0x7f5194003520 con 0x7f51a81521b0 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 msgr2=0x7f51a80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51a80c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 >> v1:172.21.15.114:6789/0 conn(0x7f51a80c1dc0 legacy=0x7f51a814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80c0e50 con 0x7f51a81521b0 2023-12-08T08:16:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f51a0001670 con 0x7f51a81521b0 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 >> v1:172.21.15.45:6789/0 conn(0x7f51a81521b0 legacy=0x7f51a8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51940039a0 0x7f5194003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5194004d00 0x7f5194005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80c0b70 con 0x7f5194004d00 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519400bab0 con 0x7f51940039a0 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.217+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519400bc70 con 0x7f51a80a7910 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5194004d00 0x7f5194005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51940039a0 0x7f5194003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a67fc640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 -- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 msgr2=0x7f51940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80a7910 0x7f51940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 -- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51940039a0 msgr2=0x7f5194003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51940039a0 0x7f5194003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.218+0000 7f51a77fe640 1 -- 172.21.15.45:0/3088621276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194003520 con 0x7f5194004d00 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.219+0000 7f51a77fe640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5194004d00 0x7f5194005180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f51a80c32c0 tx=0x7f51940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f48af739cee86c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0005ad0 con 0x7f5194004d00 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0005c30 con 0x7f5194004d00 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a5ffb640 1 -- 172.21.15.45:0/3088621276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a002c850 con 0x7f5194004d00 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a7fff640 1 -- 172.21.15.45:0/3088621276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5194004d00 msgr2=0x7f5194005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a7fff640 1 --2- 172.21.15.45:0/3088621276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5194004d00 0x7f5194005180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f51a80c32c0 tx=0x7f51940057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a77fe640 1 -- 172.21.15.45:0/3088621276 reap_dead start 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a7fff640 1 -- 172.21.15.45:0/3088621276 shutdown_connections 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a7fff640 1 -- 172.21.15.45:0/3088621276 >> 172.21.15.45:0/3088621276 conn(0x7f51a80c5780 msgr2=0x7f51a80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:30.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.220+0000 7f51a7fff640 1 -- 172.21.15.45:0/3088621276 shutdown_connections 2023-12-08T08:16:30.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.221+0000 7f51a7fff640 1 -- 172.21.15.45:0/3088621276 wait complete. 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.222+0000 7f51a7fff640 1 Processor -- start 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.222+0000 7f51a7fff640 1 -- start start 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 0x7f51a81e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 0x7f51a8071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80709c0 con 0x7f51a814c990 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a81e8b50 con 0x7f51a80713a0 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.223+0000 7f51a7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80ba8b0 con 0x7f51a80bf110 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41784/0 (socket says 172.21.15.45:41784) 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 -- 172.21.15.45:0/2268461741 learned_addr learned my addr 172.21.15.45:0/2268461741 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a77fe640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 0x7f51a8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 0x7f51a81e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 -- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 msgr2=0x7f51a81e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 0x7f51a81e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 -- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 msgr2=0x7f51a8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 0x7f51a8071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 -- 172.21.15.45:0/2268461741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80bab90 con 0x7f51a814c990 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 0x7f51a81e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a77fe640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 0x7f51a8071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.224+0000 7f51a67fc640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f519000e580 tx=0x7f519000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.225+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900052e0 con 0x7f51a814c990 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.225+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5190005440 con 0x7f51a814c990 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.225+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190003810 con 0x7f51a814c990 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.225+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80bae70 con 0x7f51a814c990 2023-12-08T08:16:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.225+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a8070e80 con 0x7f51a814c990 2023-12-08T08:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.226+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a80bb0b0 con 0x7f51a814c990 2023-12-08T08:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.227+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5190003970 con 0x7f51a814c990 2023-12-08T08:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.228+0000 7f519ffff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 0x7f518806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.228+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5190089620 con 0x7f51a814c990 2023-12-08T08:16:30.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.229+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 0x7f518806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.229+0000 7f51a6ffd640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 0x7f518806d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5198007440 tx=0x7f519800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.233+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5190054500 con 0x7f51a814c990 2023-12-08T08:16:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.428+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51a8071010 con 0x7f51a814c990 2023-12-08T08:16:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.431+0000 7f519ffff640 1 -- 172.21.15.45:0/2268461741 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f5190057b20 con 0x7f51a814c990 2023-12-08T08:16:30.434 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:30.434 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:29.411241+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 msgr2=0x7f518806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 0x7f518806d330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5198007440 tx=0x7f519800b040 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 msgr2=0x7f51a814ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f519000e580 tx=0x7f519000ea40 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 shutdown_connections 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f518806ae70 0x7f518806d330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51a80713a0 0x7f51a8071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a814c990 0x7f51a814ce10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 --2- 172.21.15.45:0/2268461741 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51a80bf110 0x7f51a81e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 >> 172.21.15.45:0/2268461741 conn(0x7f51a80c5780 msgr2=0x7f51a8151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 shutdown_connections 2023-12-08T08:16:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.434+0000 7f51a7fff640 1 -- 172.21.15.45:0/2268461741 wait complete. 2023-12-08T08:16:30.456 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.682+0000 7f3d9bd2c640 1 Processor -- start 2023-12-08T08:16:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.682+0000 7f3d9bd2c640 1 -- start start 2023-12-08T08:16:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9bd2c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d94154600 0x7f3d940c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9bd2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d940c6fd0 0x7f3d940c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9bd2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d94158410 con 0x7f3d94151c40 2023-12-08T08:16:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9bd2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940c5820 con 0x7f3d940c6fd0 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9bd2c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d94158220 con 0x7f3d94154600 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d99ac8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3d94151c40 0x7f3d94157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47682/0 (socket says 172.21.15.45:47682) 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d99ac8640 1 -- 172.21.15.45:0/2590971037 learned_addr learned my addr 172.21.15.45:0/2590971037 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.684+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/2590971037 >> v2:172.21.15.45:3300/0 conn(0x7f3d940c6fd0 0x7f3d940c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d992c7640 1 --2- 172.21.15.45:0/2590971037 >> v2:172.21.15.114:3300/0 conn(0x7f3d94154600 0x7f3d940c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/2590971037 >> v2:172.21.15.114:3300/0 conn(0x7f3d94154600 msgr2=0x7f3d940c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d98ac6640 1 -- 172.21.15.45:0/2590971037 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782091872 0 0) 0x7f3d94158410 con 0x7f3d94151c40 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/2590971037 >> v2:172.21.15.114:3300/0 conn(0x7f3d94154600 0x7f3d940c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/2590971037 >> v1:172.21.15.45:6789/0 conn(0x7f3d94151c40 legacy=0x7f3d94157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.685+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/2590971037 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d941586f0 con 0x7f3d940c6fd0 2023-12-08T08:16:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.686+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/2590971037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d940c6fd0 0x7f3d940c46a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d9406d730 tx=0x7f3d8c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fea36bab3e9814 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.686+0000 7f3d98ac6640 1 -- 172.21.15.45:0/2590971037 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c02cbf0 con 0x7f3d940c6fd0 2023-12-08T08:16:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.686+0000 7f3d98ac6640 1 -- 172.21.15.45:0/2590971037 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c02cd50 con 0x7f3d940c6fd0 2023-12-08T08:16:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.686+0000 7f3d98ac6640 1 -- 172.21.15.45:0/2590971037 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c034660 con 0x7f3d940c6fd0 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/2590971037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d940c6fd0 msgr2=0x7f3d940c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/2590971037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d940c6fd0 0x7f3d940c46a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d9406d730 tx=0x7f3d8c02be40 comp rx=0 tx=0).stop 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/2590971037 shutdown_connections 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/2590971037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d940c6fd0 0x7f3d940c46a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/2590971037 >> v2:172.21.15.114:3300/0 conn(0x7f3d94154600 0x7f3d940c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/2590971037 >> 172.21.15.45:0/2590971037 conn(0x7f3d940ab8b0 msgr2=0x7f3d940abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/2590971037 shutdown_connections 2023-12-08T08:16:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.687+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/2590971037 wait complete. 2023-12-08T08:16:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.689+0000 7f3d9bd2c640 1 Processor -- start 2023-12-08T08:16:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.689+0000 7f3d9bd2c640 1 -- start start 2023-12-08T08:16:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 0x7f3d941ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d94151c40 0x7f3d941eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941ea700 con 0x7f3d94154600 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941eb0f0 con 0x7f3d940c6fd0 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9bd2c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c02d0 con 0x7f3d94151c40 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9a2c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9a2c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41810/0 (socket says 172.21.15.45:41810) 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/3600798426 learned_addr learned my addr 172.21.15.45:0/3600798426 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d99ac8640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 0x7f3d941ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d992c7640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d94151c40 0x7f3d941eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.690+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d94151c40 msgr2=0x7f3d941eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d94151c40 0x7f3d941eabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 msgr2=0x7f3d941ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 0x7f3d941ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9a2c9640 1 -- 172.21.15.45:0/3600798426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c009a70 con 0x7f3d94154600 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d99ac8640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 0x7f3d941ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9a2c9640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c037040 tx=0x7f3d8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c040650 con 0x7f3d94154600 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0407b0 con 0x7f3d94154600 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d940c05b0 con 0x7f3d94154600 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c040b40 con 0x7f3d94154600 2023-12-08T08:16:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.691+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940c0df0 con 0x7f3d94154600 2023-12-08T08:16:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.693+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d94074600 con 0x7f3d94154600 2023-12-08T08:16:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.694+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d8c040ca0 con 0x7f3d94154600 2023-12-08T08:16:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.695+0000 7f3d927fc640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 0x7f3d7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.695+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3d8c0ac640 con 0x7f3d94154600 2023-12-08T08:16:30.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.695+0000 7f3d99ac8640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 0x7f3d7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.696+0000 7f3d99ac8640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 0x7f3d7806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000f60 tx=0x7f3d88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.700+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d8c077630 con 0x7f3d94154600 2023-12-08T08:16:30.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.897+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d940c8da0 con 0x7f3d94154600 2023-12-08T08:16:30.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.900+0000 7f3d927fc640 1 -- 172.21.15.45:0/3600798426 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f3d8c07ac50 con 0x7f3d94154600 2023-12-08T08:16:30.903 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:30.903 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:29.411241+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 msgr2=0x7f3d7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 0x7f3d7806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d88000f60 tx=0x7f3d88009040 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 msgr2=0x7f3d940c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c037040 tx=0x7f3d8c004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 shutdown_connections 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d7806ae40 0x7f3d7806d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d94151c40 0x7f3d941eabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d94154600 0x7f3d940c18d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 --2- 172.21.15.45:0/3600798426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d940c6fd0 0x7f3d941ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 >> 172.21.15.45:0/3600798426 conn(0x7f3d940ab8b0 msgr2=0x7f3d940c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:30.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 shutdown_connections 2023-12-08T08:16:30.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:30.903+0000 7f3d9bd2c640 1 -- 172.21.15.45:0/3600798426 wait complete. 2023-12-08T08:16:30.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.154+0000 7f312ffff640 1 Processor -- start 2023-12-08T08:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.155+0000 7f312ffff640 1 -- start start 2023-12-08T08:16:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.156+0000 7f312ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3130151ad0 0x7f31300ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f312ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3130151eb0 con 0x7f3130157a20 2023-12-08T08:16:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f312ffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31300c80d0 con 0x7f31300ca610 2023-12-08T08:16:31.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f312ffff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31300c56a0 con 0x7f3130151ad0 2023-12-08T08:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f3127fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3130157a20 0x7f3130154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47694/0 (socket says 172.21.15.45:47694) 2023-12-08T08:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f3127fff640 1 -- 172.21.15.45:0/985661256 learned_addr learned my addr 172.21.15.45:0/985661256 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f312effd640 1 --2- 172.21.15.45:0/985661256 >> v2:172.21.15.114:3300/0 conn(0x7f3130151ad0 0x7f31300ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.157+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469266113 0 0) 0x7f3130151eb0 con 0x7f3130157a20 2023-12-08T08:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c003520 con 0x7f3130157a20 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183001146 0 0) 0x7f311c003520 con 0x7f3130157a20 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 >> v2:172.21.15.114:3300/0 conn(0x7f3130151ad0 msgr2=0x7f31300ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 --2- 172.21.15.45:0/985661256 >> v2:172.21.15.114:3300/0 conn(0x7f3130151ad0 0x7f31300ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 >> v1:172.21.15.114:6789/0 conn(0x7f31300ca610 legacy=0x7f313015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130154430 con 0x7f3130157a20 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f3118001670 con 0x7f3130157a20 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 >> v1:172.21.15.45:6789/0 conn(0x7f3130157a20 legacy=0x7f3130154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f311c005180 0x7f311c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00bff0 con 0x7f311c0047c0 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00c160 con 0x7f311c003970 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00c320 con 0x7f311c005180 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.158+0000 7f3127fff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f312effd640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f3127fff640 1 -- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f311c005180 msgr2=0x7f311c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f3127fff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f311c005180 0x7f311c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f3127fff640 1 -- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f311c003970 msgr2=0x7f311c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f3127fff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f3127fff640 1 -- 172.21.15.45:0/985661256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c003520 con 0x7f311c0047c0 2023-12-08T08:16:31.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.159+0000 7f312f7fe640 1 -- 172.21.15.45:0/985661256 reap_dead start 2023-12-08T08:16:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.160+0000 7f3127fff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f311c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8f1eba4a1962d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.160+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118005ad0 con 0x7f311c0047c0 2023-12-08T08:16:31.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.160+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3118005c30 con 0x7f311c0047c0 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.160+0000 7f312e7fc640 1 -- 172.21.15.45:0/985661256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311802cab0 con 0x7f311c0047c0 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 -- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 msgr2=0x7f311c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f311c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 -- 172.21.15.45:0/985661256 shutdown_connections 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 --2- 172.21.15.45:0/985661256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 -- 172.21.15.45:0/985661256 >> 172.21.15.45:0/985661256 conn(0x7f3130066610 msgr2=0x7f3130066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 -- 172.21.15.45:0/985661256 shutdown_connections 2023-12-08T08:16:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.161+0000 7f312ffff640 1 -- 172.21.15.45:0/985661256 wait complete. 2023-12-08T08:16:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.163+0000 7f312ffff640 1 Processor -- start 2023-12-08T08:16:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.163+0000 7f312ffff640 1 -- start start 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f31300c33e0 0x7f31300aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 0x7f31300aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31301ed6f0 con 0x7f311c0047c0 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300c3be0 con 0x7f31301edb80 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300c1d80 con 0x7f31300c33e0 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41828/0 (socket says 172.21.15.45:41828) 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.164+0000 7f312effd640 1 -- 172.21.15.45:0/2966553659 learned_addr learned my addr 172.21.15.45:0/2966553659 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f3127fff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f31300c33e0 0x7f31300aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312f7fe640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 0x7f31300aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 -- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f31300c33e0 msgr2=0x7f31300aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f31300c33e0 0x7f31300aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 -- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 msgr2=0x7f31300aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 0x7f31300aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 -- 172.21.15.45:0/2966553659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300c3900 con 0x7f311c0047c0 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312f7fe640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 0x7f31300aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.165+0000 7f312effd640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f31200116d0 tx=0x7f3120011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.166+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000f9c0 con 0x7f311c0047c0 2023-12-08T08:16:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.166+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312000fb20 con 0x7f311c0047c0 2023-12-08T08:16:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.166+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31301ed0a0 con 0x7f311c0047c0 2023-12-08T08:16:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.166+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000fe90 con 0x7f311c0047c0 2023-12-08T08:16:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.166+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3130151090 con 0x7f311c0047c0 2023-12-08T08:16:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.167+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31300743e0 con 0x7f311c0047c0 2023-12-08T08:16:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.168+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3120015460 con 0x7f311c0047c0 2023-12-08T08:16:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.169+0000 7f31277fe640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 0x7f311006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.170+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3120089ff0 con 0x7f311c0047c0 2023-12-08T08:16:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.170+0000 7f3127fff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 0x7f311006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.170+0000 7f3127fff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 0x7f311006d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3118034000 tx=0x7f3118009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.174+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3120054fb0 con 0x7f311c0047c0 2023-12-08T08:16:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.406+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31300c7a40 con 0x7f311c0047c0 2023-12-08T08:16:31.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.990+0000 7f31277fe640 1 -- 172.21.15.45:0/2966553659 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f31200585d0 con 0x7f311c0047c0 2023-12-08T08:16:31.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.993+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 msgr2=0x7f311006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.993+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 0x7f311006d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3118034000 tx=0x7f3118009030 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.993+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 msgr2=0x7f3130150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.993+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f31200116d0 tx=0x7f3120011b90 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 shutdown_connections 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f311006ae70 0x7f311006d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f31300c33e0 0x7f31300aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31301edb80 0x7f31300aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 --2- 172.21.15.45:0/2966553659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f311c0047c0 0x7f3130150b50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 >> 172.21.15.45:0/2966553659 conn(0x7f3130066610 msgr2=0x7f313014a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 shutdown_connections 2023-12-08T08:16:31.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:31.994+0000 7f312ffff640 1 -- 172.21.15.45:0/2966553659 wait complete. 2023-12-08T08:16:32.019 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:16:32.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:16:32.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.248+0000 7f4f134f8640 1 Processor -- start 2023-12-08T08:16:32.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.248+0000 7f4f134f8640 1 -- start start 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f134f8640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f0c0c6fb0 0x7f4f0c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f134f8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c14fbb0 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f134f8640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0c7520 con 0x7f4f0c152e00 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f134f8640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c152110 con 0x7f4f0c0c6fb0 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f124f6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f0c0c3e50 0x7f4f0c155700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47710/0 (socket says 172.21.15.45:47710) 2023-12-08T08:16:32.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.249+0000 7f4f124f6640 1 -- 172.21.15.45:0/4269710559 learned_addr learned my addr 172.21.15.45:0/4269710559 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:32.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f12cf7640 1 --2- 172.21.15.45:0/4269710559 >> v2:172.21.15.114:3300/0 conn(0x7f4f0c0c6fb0 0x7f4f0c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191974831 0 0) 0x7f4f0c14fbb0 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef8003520 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151117466 0 0) 0x7f4ef8003520 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 >> v2:172.21.15.114:3300/0 conn(0x7f4f0c0c6fb0 msgr2=0x7f4f0c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 --2- 172.21.15.45:0/4269710559 >> v2:172.21.15.114:3300/0 conn(0x7f4f0c0c6fb0 0x7f4f0c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 >> v1:172.21.15.114:6789/0 conn(0x7f4f0c152e00 legacy=0x7f4f0c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c152320 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f4f080019f0 con 0x7f4f0c0c3e50 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 >> v1:172.21.15.45:6789/0 conn(0x7f4f0c0c3e50 legacy=0x7f4f0c155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 0x7f4ef8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.250+0000 7f4f114f4640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ef80047c0 0x7f4ef8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f114f4640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8005180 0x7f4ef800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c152110 con 0x7f4ef8003970 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef800c120 con 0x7f4ef80047c0 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef800c2e0 con 0x7f4ef8005180 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 0x7f4ef8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f11cf5640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ef80047c0 0x7f4ef8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 -- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8005180 msgr2=0x7f4ef800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:32.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8005180 0x7f4ef800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 -- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ef80047c0 msgr2=0x7f4ef8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:32.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ef80047c0 0x7f4ef8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f124f6640 1 -- 172.21.15.45:0/4269710559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8003520 con 0x7f4ef8003970 2023-12-08T08:16:32.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.251+0000 7f4f12cf7640 1 -- 172.21.15.45:0/4269710559 reap_dead start 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.252+0000 7f4f124f6640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 0x7f4ef8003d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800a830 tx=0x7f4ef80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7aedc9793995d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080072d0 con 0x7f4ef8003970 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0802f070 con 0x7f4ef8003970 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f114f4640 1 -- 172.21.15.45:0/4269710559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08007690 con 0x7f4ef8003970 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 -- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 msgr2=0x7f4ef8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 0x7f4ef8003d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800a830 tx=0x7f4ef80057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 -- 172.21.15.45:0/4269710559 shutdown_connections 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 --2- 172.21.15.45:0/4269710559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ef8003970 0x7f4ef8003d90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 -- 172.21.15.45:0/4269710559 >> 172.21.15.45:0/4269710559 conn(0x7f4f0c0c4840 msgr2=0x7f4f0c0c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.253+0000 7f4f134f8640 1 -- 172.21.15.45:0/4269710559 shutdown_connections 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.254+0000 7f4f134f8640 1 -- 172.21.15.45:0/4269710559 wait complete. 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.255+0000 7f4f134f8640 1 Processor -- start 2023-12-08T08:16:32.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.255+0000 7f4f134f8640 1 -- start start 2023-12-08T08:16:32.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8003970 0x7f4f0c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0c06bdb0 0x7f4f0c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c1565a0 con 0x7f4f0c06b880 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c155c50 con 0x7f4f0c06bdb0 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.256+0000 7f4f134f8640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c1ea830 con 0x7f4ef8003970 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41832/0 (socket says 172.21.15.45:41832) 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 -- 172.21.15.45:0/742845653 learned_addr learned my addr 172.21.15.45:0/742845653 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f124f6640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8003970 0x7f4f0c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f12cf7640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0c06bdb0 0x7f4f0c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 -- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8003970 msgr2=0x7f4f0c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:32.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8003970 0x7f4f0c06c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 -- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0c06bdb0 msgr2=0x7f4f0c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0c06bdb0 0x7f4f0c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.257+0000 7f4f11cf5640 1 -- 172.21.15.45:0/742845653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c1561c0 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f11cf5640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00d4e0 tx=0x7f4efc00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc012800 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc012960 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc012d10 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c06cbd0 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.258+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c0c28d0 con 0x7f4f0c06b880 2023-12-08T08:16:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.259+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c156350 con 0x7f4f0c06b880 2023-12-08T08:16:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.260+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4efc019360 con 0x7f4f0c06b880 2023-12-08T08:16:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.262+0000 7f4f02ffd640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.262+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4efc089840 con 0x7f4f0c06b880 2023-12-08T08:16:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.262+0000 7f4f124f6640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.263+0000 7f4f124f6640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 0x7f4ef006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f08034000 tx=0x7f4f08007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:32.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.266+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4efc054710 con 0x7f4f0c06b880 2023-12-08T08:16:32.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.503+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4f0c0673e0 con 0x7f4f0c06b880 2023-12-08T08:16:32.913 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-08T08:16:32.906+0000 7f415f2dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:16:32.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.993+0000 7f4f02ffd640 1 -- 172.21.15.45:0/742845653 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4efc057d30 con 0x7f4f0c06b880 2023-12-08T08:16:32.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 msgr2=0x7f4ef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 0x7f4ef006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f08034000 tx=0x7f4f08007000 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 msgr2=0x7f4f0c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00d4e0 tx=0x7f4efc00d9a0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 shutdown_connections 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef006ae70 0x7f4ef006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0c06bdb0 0x7f4f0c155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f0c06b880 0x7f4f0c1551d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 --2- 172.21.15.45:0/742845653 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ef8003970 0x7f4f0c06c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 >> 172.21.15.45:0/742845653 conn(0x7f4f0c0c4840 msgr2=0x7f4f0c14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 shutdown_connections 2023-12-08T08:16:33.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:32.997+0000 7f4f134f8640 1 -- 172.21.15.45:0/742845653 wait complete. 2023-12-08T08:16:33.021 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:16:33.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.257+0000 7fcf48e44640 1 Processor -- start 2023-12-08T08:16:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.257+0000 7fcf48e44640 1 -- start start 2023-12-08T08:16:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf48e44640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf48e44640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf440c1dc0 0x7fcf4414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf48e44640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf44155850 con 0x7fcf441521b0 2023-12-08T08:16:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf48e44640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440c0890 con 0x7fcf440c1dc0 2023-12-08T08:16:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf48e44640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c0b70 con 0x7fcf440a7910 2023-12-08T08:16:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf440c1dc0 0x7fcf4414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf440c1dc0 0x7fcf4414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41834/0 (socket says 172.21.15.45:41834) 2023-12-08T08:16:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.259+0000 7fcf3bfff640 1 -- 172.21.15.45:0/1473065882 learned_addr learned my addr 172.21.15.45:0/1473065882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.260+0000 7fcf437fe640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.260+0000 7fcf3bfff640 1 -- 172.21.15.45:0/1473065882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 msgr2=0x7fcf440c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.260+0000 7fcf3bfff640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.260+0000 7fcf3bfff640 1 -- 172.21.15.45:0/1473065882 >> v1:172.21.15.45:6789/0 conn(0x7fcf441521b0 legacy=0x7fcf44155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.260+0000 7fcf3bfff640 1 -- 172.21.15.45:0/1473065882 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf440c0e50 con 0x7fcf440c1dc0 2023-12-08T08:16:33.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.261+0000 7fcf3bfff640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf440c1dc0 0x7fcf4414f5e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4e3dc96c3db223 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.261+0000 7fcf42ffd640 1 -- 172.21.15.45:0/1473065882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c031640 con 0x7fcf440c1dc0 2023-12-08T08:16:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.261+0000 7fcf42ffd640 1 -- 172.21.15.45:0/1473065882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0317a0 con 0x7fcf440c1dc0 2023-12-08T08:16:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.261+0000 7fcf42ffd640 1 -- 172.21.15.45:0/1473065882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c031b30 con 0x7fcf440c1dc0 2023-12-08T08:16:33.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 -- 172.21.15.45:0/1473065882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf440c1dc0 msgr2=0x7fcf4414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf440c1dc0 0x7fcf4414f5e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 -- 172.21.15.45:0/1473065882 shutdown_connections 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf440c1dc0 0x7fcf4414f5e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 --2- 172.21.15.45:0/1473065882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 -- 172.21.15.45:0/1473065882 >> 172.21.15.45:0/1473065882 conn(0x7fcf440c5780 msgr2=0x7fcf440c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 -- 172.21.15.45:0/1473065882 shutdown_connections 2023-12-08T08:16:33.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.262+0000 7fcf48e44640 1 -- 172.21.15.45:0/1473065882 wait complete. 2023-12-08T08:16:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.264+0000 7fcf48e44640 1 Processor -- start 2023-12-08T08:16:33.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.264+0000 7fcf48e44640 1 -- start start 2023-12-08T08:16:33.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 0x7fcf441ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440c5460 con 0x7fcf441521b0 2023-12-08T08:16:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441ecb10 con 0x7fcf440c1dc0 2023-12-08T08:16:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf48e44640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441ed9e0 con 0x7fcf440a7910 2023-12-08T08:16:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41842/0 (socket says 172.21.15.45:41842) 2023-12-08T08:16:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.265+0000 7fcf43fff640 1 -- 172.21.15.45:0/2349097019 learned_addr learned my addr 172.21.15.45:0/2349097019 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf437fe640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 -- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 msgr2=0x7fcf440bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf3bfff640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 0x7fcf441ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 -- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 msgr2=0x7fcf441ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 0x7fcf441ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 -- 172.21.15.45:0/2349097019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094d0 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf3bfff640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 0x7fcf441ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.266+0000 7fcf43fff640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c760 tx=0x7fcf3c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.267+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c003b70 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.267+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c003cd0 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.267+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00aa90 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.267+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf440c4f30 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.267+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440c4070 con 0x7fcf441521b0 2023-12-08T08:16:33.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.268+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf441ecc80 con 0x7fcf441521b0 2023-12-08T08:16:33.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.269+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf3c00abf0 con 0x7fcf441521b0 2023-12-08T08:16:33.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.270+0000 7fcf40ff9640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 0x7fcf2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.270+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf3c089500 con 0x7fcf441521b0 2023-12-08T08:16:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.270+0000 7fcf437fe640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 0x7fcf2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.271+0000 7fcf437fe640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 0x7fcf2406d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006fd0 tx=0x7fcf34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.274+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf441ecc80 con 0x7fcf441521b0 2023-12-08T08:16:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.511+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf441ecc80 con 0x7fcf441521b0 2023-12-08T08:16:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.512+0000 7fcf40ff9640 1 -- 172.21.15.45:0/2349097019 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4904 (secure 0 0 0) 0x7fcf441ecc80 con 0x7fcf441521b0 2023-12-08T08:16:33.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:33.515 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:16:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2023-12-08T08:16:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.514+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 msgr2=0x7fcf2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.514+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 0x7fcf2406d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006fd0 tx=0x7fcf34008040 comp rx=0 tx=0).stop 2023-12-08T08:16:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.514+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 msgr2=0x7fcf441ed4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.514+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c760 tx=0x7fcf3c00cc20 comp rx=0 tx=0).stop 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 shutdown_connections 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf2406ae70 0x7fcf2406d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf441521b0 0x7fcf441ed4a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf440c1dc0 0x7fcf441ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 --2- 172.21.15.45:0/2349097019 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf440a7910 0x7fcf440bf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 >> 172.21.15.45:0/2349097019 conn(0x7fcf440c5780 msgr2=0x7fcf4414f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 shutdown_connections 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.515+0000 7fcf48e44640 1 -- 172.21.15.45:0/2349097019 wait complete. 2023-12-08T08:16:33.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:33.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.754+0000 7f5185f1b640 1 Processor -- start 2023-12-08T08:16:33.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.755+0000 7f5185f1b640 1 -- start start 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f5185f1b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51800c44d0 0x7f51801584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f5185f1b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51800c7a50 0x7f51800ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f5185f1b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800c4a00 con 0x7f51801519c0 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f5185f1b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c4ce0 con 0x7f51800c44d0 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f5185f1b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51801579e0 con 0x7f51800c7a50 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f517ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51800c44d0 0x7f51801584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f517ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51800c44d0 0x7f51801584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41852/0 (socket says 172.21.15.45:41852) 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.756+0000 7f517ffff640 1 -- 172.21.15.45:0/1825382637 learned_addr learned my addr 172.21.15.45:0/1825382637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.757+0000 7f518571a640 1 --2- 172.21.15.45:0/1825382637 >> v2:172.21.15.114:3300/0 conn(0x7f51800c7a50 0x7f51800ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.757+0000 7f517ffff640 1 -- 172.21.15.45:0/1825382637 >> v2:172.21.15.114:3300/0 conn(0x7f51800c7a50 msgr2=0x7f51800ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.757+0000 7f517ffff640 1 --2- 172.21.15.45:0/1825382637 >> v2:172.21.15.114:3300/0 conn(0x7f51800c7a50 0x7f51800ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.757+0000 7f517ffff640 1 -- 172.21.15.45:0/1825382637 >> v1:172.21.15.114:6789/0 conn(0x7f51801519c0 legacy=0x7f5180154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:33.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.757+0000 7f517ffff640 1 -- 172.21.15.45:0/1825382637 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180157cc0 con 0x7f51800c44d0 2023-12-08T08:16:33.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.758+0000 7f517ffff640 1 --2- 172.21.15.45:0/1825382637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c44d0 0x7f51801584c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51800c3f80 tx=0x7f517002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1d13ba61827ead server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.758+0000 7f517f7fe640 1 -- 172.21.15.45:0/1825382637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517002c960 con 0x7f51800c44d0 2023-12-08T08:16:33.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f517f7fe640 1 -- 172.21.15.45:0/1825382637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517002cac0 con 0x7f51800c44d0 2023-12-08T08:16:33.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f517f7fe640 1 -- 172.21.15.45:0/1825382637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517002ce50 con 0x7f51800c44d0 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 -- 172.21.15.45:0/1825382637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c44d0 msgr2=0x7f51801584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 --2- 172.21.15.45:0/1825382637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c44d0 0x7f51801584c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51800c3f80 tx=0x7f517002bdc0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 -- 172.21.15.45:0/1825382637 shutdown_connections 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 --2- 172.21.15.45:0/1825382637 >> v2:172.21.15.114:3300/0 conn(0x7f51800c7a50 0x7f51800ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 --2- 172.21.15.45:0/1825382637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c44d0 0x7f51801584c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 -- 172.21.15.45:0/1825382637 >> 172.21.15.45:0/1825382637 conn(0x7f51800661f0 msgr2=0x7f5180066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 -- 172.21.15.45:0/1825382637 shutdown_connections 2023-12-08T08:16:33.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.759+0000 7f5185f1b640 1 -- 172.21.15.45:0/1825382637 wait complete. 2023-12-08T08:16:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.761+0000 7f5185f1b640 1 Processor -- start 2023-12-08T08:16:33.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.761+0000 7f5185f1b640 1 -- start start 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 0x7f51800aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c7a50 0x7f51801e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801ea0c0 con 0x7f51801519c0 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801e5de0 con 0x7f51800c44d0 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.762+0000 7f5185f1b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51801e5a70 con 0x7f51800c7a50 2023-12-08T08:16:33.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41866/0 (socket says 172.21.15.45:41866) 2023-12-08T08:16:33.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 -- 172.21.15.45:0/2776241993 learned_addr learned my addr 172.21.15.45:0/2776241993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f517ffff640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c7a50 0x7f51801e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 -- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c7a50 msgr2=0x7f51801e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f5184f19640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 0x7f51800aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c7a50 0x7f51801e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 -- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 msgr2=0x7f51800aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 0x7f51800aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 -- 172.21.15.45:0/2776241993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170009b30 con 0x7f51801519c0 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f5184f19640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 0x7f51800aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.763+0000 7f518571a640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f517800d830 tx=0x7f517800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.764+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800b6c0 con 0x7f51801519c0 2023-12-08T08:16:33.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.764+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800b840 con 0x7f51801519c0 2023-12-08T08:16:33.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.764+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800bbf0 con 0x7f51801519c0 2023-12-08T08:16:33.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.764+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5180153e80 con 0x7f51801519c0 2023-12-08T08:16:33.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.764+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180153ba0 con 0x7f51801519c0 2023-12-08T08:16:33.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.765+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51801e5f20 con 0x7f51801519c0 2023-12-08T08:16:33.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.766+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f517801e460 con 0x7f51801519c0 2023-12-08T08:16:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.767+0000 7f517d7fa640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.768+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5178089f10 con 0x7f51801519c0 2023-12-08T08:16:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.768+0000 7f5184f19640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:33.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.768+0000 7f5184f19640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51800ab940 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.771+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51801e5f20 con 0x7f51801519c0 2023-12-08T08:16:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.968+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51801e5f20 con 0x7f51801519c0 2023-12-08T08:16:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.970+0000 7f517d7fa640 1 -- 172.21.15.45:0/2776241993 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f51801e5f20 con 0x7f51801519c0 2023-12-08T08:16:33.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:33.973 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:30.977155+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.972+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 msgr2=0x7f516006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.972+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f51800ab940 tx=0x7f5168008040 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 msgr2=0x7f51801e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f517800d830 tx=0x7f517800dcf0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 shutdown_connections 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c7a50 0x7f51801e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51801519c0 0x7f51801e6740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 --2- 172.21.15.45:0/2776241993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51800c44d0 0x7f51800aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 >> 172.21.15.45:0/2776241993 conn(0x7f51800661f0 msgr2=0x7f518014dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 shutdown_connections 2023-12-08T08:16:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:33.973+0000 7f5185f1b640 1 -- 172.21.15.45:0/2776241993 wait complete. 2023-12-08T08:16:33.996 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:16:33.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:16:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.218+0000 7fb141378640 1 Processor -- start 2023-12-08T08:16:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.219+0000 7fb141378640 1 -- start start 2023-12-08T08:16:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.220+0000 7fb141378640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb13c154600 0x7fb13c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.220+0000 7fb141378640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c158410 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb141378640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c1586f0 con 0x7fb13c151c40 2023-12-08T08:16:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb141378640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0c5820 con 0x7fb13c154600 2023-12-08T08:16:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb13b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb13c0c6fd0 0x7fb13c0c46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47726/0 (socket says 172.21.15.45:47726) 2023-12-08T08:16:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb13b7fe640 1 -- 172.21.15.45:0/3785764527 learned_addr learned my addr 172.21.15.45:0/3785764527 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb13a7fc640 1 --2- 172.21.15.45:0/3785764527 >> v2:172.21.15.114:3300/0 conn(0x7fb13c154600 0x7fb13c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301971743 0 0) 0x7fb13c158410 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.221+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb128003520 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618509893 0 0) 0x7fb128003520 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 >> v2:172.21.15.114:3300/0 conn(0x7fb13c154600 msgr2=0x7fb13c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 --2- 172.21.15.45:0/3785764527 >> v2:172.21.15.114:3300/0 conn(0x7fb13c154600 0x7fb13c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 >> v1:172.21.15.114:6789/0 conn(0x7fb13c151c40 legacy=0x7fb13c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0c67d0 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fb134001670 con 0x7fb13c0c6fd0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 >> v1:172.21.15.45:6789/0 conn(0x7fb13c0c6fd0 legacy=0x7fb13c0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb128003970 0x7fb128003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1280047c0 0x7fb128004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 0x7fb12800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c5820 con 0x7fb128005180 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12800c120 con 0x7fb1280047c0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12800c2e0 con 0x7fb128003970 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.222+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 0x7fb12800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13a7fc640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1280047c0 0x7fb128004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13affd640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb128003970 0x7fb128003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13b7fe640 1 -- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb128003970 msgr2=0x7fb128003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb128003970 0x7fb128003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13b7fe640 1 -- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1280047c0 msgr2=0x7fb128004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1280047c0 0x7fb128004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.223+0000 7fb13b7fe640 1 -- 172.21.15.45:0/3785764527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128003520 con 0x7fb128005180 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.224+0000 7fb13b7fe640 1 -- 172.21.15.45:0/3785764527 reap_dead start 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.224+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 0x7fb12800b980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c240 tx=0x7fb1280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d6f5a92ddb27d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.224+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134005ad0 con 0x7fb128005180 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.224+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134005c50 con 0x7fb128005180 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.224+0000 7fb139ffb640 1 -- 172.21.15.45:0/3785764527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13402c8b0 con 0x7fb128005180 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 -- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 msgr2=0x7fb12800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 0x7fb12800b980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c240 tx=0x7fb1280057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 -- 172.21.15.45:0/3785764527 shutdown_connections 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 --2- 172.21.15.45:0/3785764527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb128005180 0x7fb12800b980 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 -- 172.21.15.45:0/3785764527 >> 172.21.15.45:0/3785764527 conn(0x7fb13c0ab8b0 msgr2=0x7fb13c0abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 -- 172.21.15.45:0/3785764527 shutdown_connections 2023-12-08T08:16:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.225+0000 7fb141378640 1 -- 172.21.15.45:0/3785764527 wait complete. 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.227+0000 7fb141378640 1 Processor -- start 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.227+0000 7fb141378640 1 -- start start 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb128005180 0x7fb13c0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 0x7fb13c1ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c153ce0 con 0x7fb13c157520 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c0df0 con 0x7fb128005180 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb141378640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c1ea940 con 0x7fb13c0c2790 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb13a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb13a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41894/0 (socket says 172.21.15.45:41894) 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb13a7fc640 1 -- 172.21.15.45:0/2468684205 learned_addr learned my addr 172.21.15.45:0/2468684205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.228+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 0x7fb13c1ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 -- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 msgr2=0x7fb13c1ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 0x7fb13c1ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 -- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb128005180 msgr2=0x7fb13c0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb128005180 0x7fb13c0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 -- 172.21.15.45:0/2468684205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c156960 con 0x7fb13c157520 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13b7fe640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 0x7fb13c1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb13a7fc640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb124010890 tx=0x7fb124010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1240095b0 con 0x7fb13c157520 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400eb80 con 0x7fb13c157520 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12401c400 con 0x7fb13c157520 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.229+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c156c40 con 0x7fb13c157520 2023-12-08T08:16:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.230+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0c2c10 con 0x7fb13c157520 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.231+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c157160 con 0x7fb13c157520 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.232+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1240143f0 con 0x7fb13c157520 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.232+0000 7fb1337fe640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 0x7fb11c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.233+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb124089930 con 0x7fb13c157520 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.233+0000 7fb13affd640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 0x7fb11c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.234+0000 7fb13affd640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 0x7fb11c06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb12c001ce0 tx=0x7fb12c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.237+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb124054890 con 0x7fb13c157520 2023-12-08T08:16:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.431+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb13c1589d0 con 0x7fb11c06ae70 2023-12-08T08:16:34.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.456+0000 7fb1337fe640 1 -- 172.21.15.45:0/2468684205 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286888 (secure 0 0 0) 0x7fb12c0019d0 con 0x7fb11c06ae70 2023-12-08T08:16:34.463 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:34.465 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:16:34.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 msgr2=0x7fb11c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 0x7fb11c06d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb12c001ce0 tx=0x7fb12c009040 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 msgr2=0x7fb13c0c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb124010890 tx=0x7fb124010d50 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 shutdown_connections 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb11c06ae70 0x7fb11c06d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb13c0c2790 0x7fb13c1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb13c157520 0x7fb13c0c2250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 --2- 172.21.15.45:0/2468684205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb128005180 0x7fb13c0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 >> 172.21.15.45:0/2468684205 conn(0x7fb13c0ab8b0 msgr2=0x7fb13c14f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 shutdown_connections 2023-12-08T08:16:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.463+0000 7fb141378640 1 -- 172.21.15.45:0/2468684205 wait complete. 2023-12-08T08:16:34.485 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-12-08T08:16:33.733808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237628,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737092,"statfs":{"total":773094113280,"available":772850782208,"internally_reserved":0,"allocated":4923392,"data_stored":2757220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.802893"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983346+0000","last_change":"2023-12-08T08:16:30.002627+0000","last_active":"2023-12-08T08:16:30.983346+0000","last_peered":"2023-12-08T08:16:30.983346+0000","last_clean":"2023-12-08T08:16:30.983346+0000","last_became_active":"2023-12-08T08:16:30.001969+0000","last_became_peered":"2023-12-08T08:16:30.001969+0000","last_unstale":"2023-12-08T08:16:30.983346+0000","last_undegraded":"2023-12-08T08:16:30.983346+0000","last_fullsized":"2023-12-08T08:16:30.983346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983069+0000","last_change":"2023-12-08T08:16:30.005992+0000","last_active":"2023-12-08T08:16:30.983069+0000","last_peered":"2023-12-08T08:16:30.983069+0000","last_clean":"2023-12-08T08:16:30.983069+0000","last_became_active":"2023-12-08T08:16:30.004730+0000","last_became_peered":"2023-12-08T08:16:30.004730+0000","last_unstale":"2023-12-08T08:16:30.983069+0000","last_undegraded":"2023-12-08T08:16:30.983069+0000","last_fullsized":"2023-12-08T08:16:30.983069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028562+0000","last_change":"2023-12-08T08:16:30.018833+0000","last_active":"2023-12-08T08:16:31.028562+0000","last_peered":"2023-12-08T08:16:31.028562+0000","last_clean":"2023-12-08T08:16:31.028562+0000","last_became_active":"2023-12-08T08:16:30.018490+0000","last_became_peered":"2023-12-08T08:16:30.018490+0000","last_unstale":"2023-12-08T08:16:31.028562+0000","last_undegraded":"2023-12-08T08:16:31.028562+0000","last_fullsized":"2023-12-08T08:16:31.028562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:01.019985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029192+0000","last_change":"2023-12-08T08:16:30.006081+0000","last_active":"2023-12-08T08:16:31.029192+0000","last_peered":"2023-12-08T08:16:31.029192+0000","last_clean":"2023-12-08T08:16:31.029192+0000","last_became_active":"2023-12-08T08:16:30.005783+0000","last_became_peered":"2023-12-08T08:16:30.005783+0000","last_unstale":"2023-12-08T08:16:31.029192+0000","last_undegraded":"2023-12-08T08:16:31.029192+0000","last_fullsized":"2023-12-08T08:16:31.029192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:28.498447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028130+0000","last_change":"2023-12-08T08:16:30.008831+0000","last_active":"2023-12-08T08:16:31.028130+0000","last_peered":"2023-12-08T08:16:31.028130+0000","last_clean":"2023-12-08T08:16:31.028130+0000","last_became_active":"2023-12-08T08:16:30.006730+0000","last_became_peered":"2023-12-08T08:16:30.006730+0000","last_unstale":"2023-12-08T08:16:31.028130+0000","last_undegraded":"2023-12-08T08:16:31.028130+0000","last_fullsized":"2023-12-08T08:16:31.028130+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:54.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027401+0000","last_change":"2023-12-08T08:16:29.995593+0000","last_active":"2023-12-08T08:16:31.027401+0000","last_peered":"2023-12-08T08:16:31.027401+0000","last_clean":"2023-12-08T08:16:31.027401+0000","last_became_active":"2023-12-08T08:16:29.995301+0000","last_became_peered":"2023-12-08T08:16:29.995301+0000","last_unstale":"2023-12-08T08:16:31.027401+0000","last_undegraded":"2023-12-08T08:16:31.027401+0000","last_fullsized":"2023-12-08T08:16:31.027401+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:26:22.011359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027862+0000","last_change":"2023-12-08T08:16:30.015416+0000","last_active":"2023-12-08T08:16:31.027862+0000","last_peered":"2023-12-08T08:16:31.027862+0000","last_clean":"2023-12-08T08:16:31.027862+0000","last_became_active":"2023-12-08T08:16:30.015060+0000","last_became_peered":"2023-12-08T08:16:30.015060+0000","last_unstale":"2023-12-08T08:16:31.027862+0000","last_undegraded":"2023-12-08T08:16:31.027862+0000","last_fullsized":"2023-12-08T08:16:31.027862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982591+0000","last_change":"2023-12-08T08:16:29.993605+0000","last_active":"2023-12-08T08:16:30.982591+0000","last_peered":"2023-12-08T08:16:30.982591+0000","last_clean":"2023-12-08T08:16:30.982591+0000","last_became_active":"2023-12-08T08:16:29.993263+0000","last_became_peered":"2023-12-08T08:16:29.993263+0000","last_unstale":"2023-12-08T08:16:30.982591+0000","last_undegraded":"2023-12-08T08:16:30.982591+0000","last_fullsized":"2023-12-08T08:16:30.982591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028934+0000","last_change":"2023-12-08T08:16:30.015099+0000","last_active":"2023-12-08T08:16:31.028934+0000","last_peered":"2023-12-08T08:16:31.028934+0000","last_clean":"2023-12-08T08:16:31.028934+0000","last_became_active":"2023-12-08T08:16:30.014849+0000","last_became_peered":"2023-12-08T08:16:30.014849+0000","last_unstale":"2023-12-08T08:16:31.028934+0000","last_undegraded":"2023-12-08T08:16:31.028934+0000","last_fullsized":"2023-12-08T08:16:31.028934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:08.500259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028546+0000","last_change":"2023-12-08T08:16:30.007497+0000","last_active":"2023-12-08T08:16:31.028546+0000","last_peered":"2023-12-08T08:16:31.028546+0000","last_clean":"2023-12-08T08:16:31.028546+0000","last_became_active":"2023-12-08T08:16:30.007046+0000","last_became_peered":"2023-12-08T08:16:30.007046+0000","last_unstale":"2023-12-08T08:16:31.028546+0000","last_undegraded":"2023-12-08T08:16:31.028546+0000","last_fullsized":"2023-12-08T08:16:31.028546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029154+0000","last_change":"2023-12-08T08:16:30.002707+0000","last_active":"2023-12-08T08:16:31.029154+0000","last_peered":"2023-12-08T08:16:31.029154+0000","last_clean":"2023-12-08T08:16:31.029154+0000","last_became_active":"2023-12-08T08:16:30.002244+0000","last_became_peered":"2023-12-08T08:16:30.002244+0000","last_unstale":"2023-12-08T08:16:31.029154+0000","last_undegraded":"2023-12-08T08:16:31.029154+0000","last_fullsized":"2023-12-08T08:16:31.029154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028333+0000","last_change":"2023-12-08T08:16:29.996936+0000","last_active":"2023-12-08T08:16:31.028333+0000","last_peered":"2023-12-08T08:16:31.028333+0000","last_clean":"2023-12-08T08:16:31.028333+0000","last_became_active":"2023-12-08T08:16:29.996661+0000","last_became_peered":"2023-12-08T08:16:29.996661+0000","last_unstale":"2023-12-08T08:16:31.028333+0000","last_undegraded":"2023-12-08T08:16:31.028333+0000","last_fullsized":"2023-12-08T08:16:31.028333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028001+0000","last_change":"2023-12-08T08:16:30.004638+0000","last_active":"2023-12-08T08:16:31.028001+0000","last_peered":"2023-12-08T08:16:31.028001+0000","last_clean":"2023-12-08T08:16:31.028001+0000","last_became_active":"2023-12-08T08:16:30.004298+0000","last_became_peered":"2023-12-08T08:16:30.004298+0000","last_unstale":"2023-12-08T08:16:31.028001+0000","last_undegraded":"2023-12-08T08:16:31.028001+0000","last_fullsized":"2023-12-08T08:16:31.028001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986195+0000","last_change":"2023-12-08T08:16:29.998886+0000","last_active":"2023-12-08T08:16:30.986195+0000","last_peered":"2023-12-08T08:16:30.986195+0000","last_clean":"2023-12-08T08:16:30.986195+0000","last_became_active":"2023-12-08T08:16:29.998501+0000","last_became_peered":"2023-12-08T08:16:29.998501+0000","last_unstale":"2023-12-08T08:16:30.986195+0000","last_undegraded":"2023-12-08T08:16:30.986195+0000","last_fullsized":"2023-12-08T08:16:30.986195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027843+0000","last_change":"2023-12-08T08:16:29.996508+0000","last_active":"2023-12-08T08:16:31.027843+0000","last_peered":"2023-12-08T08:16:31.027843+0000","last_clean":"2023-12-08T08:16:31.027843+0000","last_became_active":"2023-12-08T08:16:29.995570+0000","last_became_peered":"2023-12-08T08:16:29.995570+0000","last_unstale":"2023-12-08T08:16:31.027843+0000","last_undegraded":"2023-12-08T08:16:31.027843+0000","last_fullsized":"2023-12-08T08:16:31.027843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029805+0000","last_change":"2023-12-08T08:16:30.016548+0000","last_active":"2023-12-08T08:16:31.029805+0000","last_peered":"2023-12-08T08:16:31.029805+0000","last_clean":"2023-12-08T08:16:31.029805+0000","last_became_active":"2023-12-08T08:16:30.016231+0000","last_became_peered":"2023-12-08T08:16:30.016231+0000","last_unstale":"2023-12-08T08:16:31.029805+0000","last_undegraded":"2023-12-08T08:16:31.029805+0000","last_fullsized":"2023-12-08T08:16:31.029805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.033377+0000","last_change":"2023-12-08T08:16:30.018546+0000","last_active":"2023-12-08T08:16:31.033377+0000","last_peered":"2023-12-08T08:16:31.033377+0000","last_clean":"2023-12-08T08:16:31.033377+0000","last_became_active":"2023-12-08T08:16:30.018247+0000","last_became_peered":"2023-12-08T08:16:30.018247+0000","last_unstale":"2023-12-08T08:16:31.033377+0000","last_undegraded":"2023-12-08T08:16:31.033377+0000","last_fullsized":"2023-12-08T08:16:31.033377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030874+0000","last_change":"2023-12-08T08:16:30.004791+0000","last_active":"2023-12-08T08:16:31.030874+0000","last_peered":"2023-12-08T08:16:31.030874+0000","last_clean":"2023-12-08T08:16:31.030874+0000","last_became_active":"2023-12-08T08:16:30.002347+0000","last_became_peered":"2023-12-08T08:16:30.002347+0000","last_unstale":"2023-12-08T08:16:31.030874+0000","last_undegraded":"2023-12-08T08:16:31.030874+0000","last_fullsized":"2023-12-08T08:16:31.030874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029810+0000","last_change":"2023-12-08T08:16:29.992462+0000","last_active":"2023-12-08T08:16:31.029810+0000","last_peered":"2023-12-08T08:16:31.029810+0000","last_clean":"2023-12-08T08:16:31.029810+0000","last_became_active":"2023-12-08T08:16:29.991153+0000","last_became_peered":"2023-12-08T08:16:29.991153+0000","last_unstale":"2023-12-08T08:16:31.029810+0000","last_undegraded":"2023-12-08T08:16:31.029810+0000","last_fullsized":"2023-12-08T08:16:31.029810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:20.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030745+0000","last_change":"2023-12-08T08:16:30.002827+0000","last_active":"2023-12-08T08:16:31.030745+0000","last_peered":"2023-12-08T08:16:31.030745+0000","last_clean":"2023-12-08T08:16:31.030745+0000","last_became_active":"2023-12-08T08:16:30.002525+0000","last_became_peered":"2023-12-08T08:16:30.002525+0000","last_unstale":"2023-12-08T08:16:31.030745+0000","last_undegraded":"2023-12-08T08:16:31.030745+0000","last_fullsized":"2023-12-08T08:16:31.030745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028256+0000","last_change":"2023-12-08T08:16:30.009287+0000","last_active":"2023-12-08T08:16:31.028256+0000","last_peered":"2023-12-08T08:16:31.028256+0000","last_clean":"2023-12-08T08:16:31.028256+0000","last_became_active":"2023-12-08T08:16:30.008873+0000","last_became_peered":"2023-12-08T08:16:30.008873+0000","last_unstale":"2023-12-08T08:16:31.028256+0000","last_undegraded":"2023-12-08T08:16:31.028256+0000","last_fullsized":"2023-12-08T08:16:31.028256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986591+0000","last_change":"2023-12-08T08:16:30.000677+0000","last_active":"2023-12-08T08:16:30.986591+0000","last_peered":"2023-12-08T08:16:30.986591+0000","last_clean":"2023-12-08T08:16:30.986591+0000","last_became_active":"2023-12-08T08:16:29.998275+0000","last_became_peered":"2023-12-08T08:16:29.998275+0000","last_unstale":"2023-12-08T08:16:30.986591+0000","last_undegraded":"2023-12-08T08:16:30.986591+0000","last_fullsized":"2023-12-08T08:16:30.986591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:02.066542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030993+0000","last_change":"2023-12-08T08:16:29.999599+0000","last_active":"2023-12-08T08:16:31.030993+0000","last_peered":"2023-12-08T08:16:31.030993+0000","last_clean":"2023-12-08T08:16:31.030993+0000","last_became_active":"2023-12-08T08:16:29.998776+0000","last_became_peered":"2023-12-08T08:16:29.998776+0000","last_unstale":"2023-12-08T08:16:31.030993+0000","last_undegraded":"2023-12-08T08:16:31.030993+0000","last_fullsized":"2023-12-08T08:16:31.030993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.026224+0000","last_change":"2023-12-08T08:16:29.998897+0000","last_active":"2023-12-08T08:16:31.026224+0000","last_peered":"2023-12-08T08:16:31.026224+0000","last_clean":"2023-12-08T08:16:31.026224+0000","last_became_active":"2023-12-08T08:16:29.998609+0000","last_became_peered":"2023-12-08T08:16:29.998609+0000","last_unstale":"2023-12-08T08:16:31.026224+0000","last_undegraded":"2023-12-08T08:16:31.026224+0000","last_fullsized":"2023-12-08T08:16:31.026224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:40.747230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031857+0000","last_change":"2023-12-08T08:16:29.991119+0000","last_active":"2023-12-08T08:16:31.031857+0000","last_peered":"2023-12-08T08:16:31.031857+0000","last_clean":"2023-12-08T08:16:31.031857+0000","last_became_active":"2023-12-08T08:16:29.990839+0000","last_became_peered":"2023-12-08T08:16:29.990839+0000","last_unstale":"2023-12-08T08:16:31.031857+0000","last_undegraded":"2023-12-08T08:16:31.031857+0000","last_fullsized":"2023-12-08T08:16:31.031857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029837+0000","last_change":"2023-12-08T08:16:30.020097+0000","last_active":"2023-12-08T08:16:31.029837+0000","last_peered":"2023-12-08T08:16:31.029837+0000","last_clean":"2023-12-08T08:16:31.029837+0000","last_became_active":"2023-12-08T08:16:30.017380+0000","last_became_peered":"2023-12-08T08:16:30.017380+0000","last_unstale":"2023-12-08T08:16:31.029837+0000","last_undegraded":"2023-12-08T08:16:31.029837+0000","last_fullsized":"2023-12-08T08:16:31.029837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:35.005481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031276+0000","last_change":"2023-12-08T08:16:29.990154+0000","last_active":"2023-12-08T08:16:31.031276+0000","last_peered":"2023-12-08T08:16:31.031276+0000","last_clean":"2023-12-08T08:16:31.031276+0000","last_became_active":"2023-12-08T08:16:29.989050+0000","last_became_peered":"2023-12-08T08:16:29.989050+0000","last_unstale":"2023-12-08T08:16:31.031276+0000","last_undegraded":"2023-12-08T08:16:31.031276+0000","last_fullsized":"2023-12-08T08:16:31.031276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028549+0000","last_change":"2023-12-08T08:16:30.006811+0000","last_active":"2023-12-08T08:16:31.028549+0000","last_peered":"2023-12-08T08:16:31.028549+0000","last_clean":"2023-12-08T08:16:31.028549+0000","last_became_active":"2023-12-08T08:16:30.006397+0000","last_became_peered":"2023-12-08T08:16:30.006397+0000","last_unstale":"2023-12-08T08:16:31.028549+0000","last_undegraded":"2023-12-08T08:16:31.028549+0000","last_fullsized":"2023-12-08T08:16:31.028549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030487+0000","last_change":"2023-12-08T08:16:29.996114+0000","last_active":"2023-12-08T08:16:31.030487+0000","last_peered":"2023-12-08T08:16:31.030487+0000","last_clean":"2023-12-08T08:16:31.030487+0000","last_became_active":"2023-12-08T08:16:29.995823+0000","last_became_peered":"2023-12-08T08:16:29.995823+0000","last_unstale":"2023-12-08T08:16:31.030487+0000","last_undegraded":"2023-12-08T08:16:31.030487+0000","last_fullsized":"2023-12-08T08:16:31.030487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:24.233820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030560+0000","last_change":"2023-12-08T08:16:29.993060+0000","last_active":"2023-12-08T08:16:31.030560+0000","last_peered":"2023-12-08T08:16:31.030560+0000","last_clean":"2023-12-08T08:16:31.030560+0000","last_became_active":"2023-12-08T08:16:29.992718+0000","last_became_peered":"2023-12-08T08:16:29.992718+0000","last_unstale":"2023-12-08T08:16:31.030560+0000","last_undegraded":"2023-12-08T08:16:31.030560+0000","last_fullsized":"2023-12-08T08:16:31.030560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:29.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031343+0000","last_change":"2023-12-08T08:16:30.000366+0000","last_active":"2023-12-08T08:16:31.031343+0000","last_peered":"2023-12-08T08:16:31.031343+0000","last_clean":"2023-12-08T08:16:31.031343+0000","last_became_active":"2023-12-08T08:16:29.999086+0000","last_became_peered":"2023-12-08T08:16:29.999086+0000","last_unstale":"2023-12-08T08:16:31.031343+0000","last_undegraded":"2023-12-08T08:16:31.031343+0000","last_fullsized":"2023-12-08T08:16:31.031343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027504+0000","last_change":"2023-12-08T08:16:30.001378+0000","last_active":"2023-12-08T08:16:31.027504+0000","last_peered":"2023-12-08T08:16:31.027504+0000","last_clean":"2023-12-08T08:16:31.027504+0000","last_became_active":"2023-12-08T08:16:30.000249+0000","last_became_peered":"2023-12-08T08:16:30.000249+0000","last_unstale":"2023-12-08T08:16:31.027504+0000","last_undegraded":"2023-12-08T08:16:31.027504+0000","last_fullsized":"2023-12-08T08:16:31.027504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:52.117326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032839+0000","last_change":"2023-12-08T08:16:30.018277+0000","last_active":"2023-12-08T08:16:31.032839+0000","last_peered":"2023-12-08T08:16:31.032839+0000","last_clean":"2023-12-08T08:16:31.032839+0000","last_became_active":"2023-12-08T08:16:30.017958+0000","last_became_peered":"2023-12-08T08:16:30.017958+0000","last_unstale":"2023-12-08T08:16:31.032839+0000","last_undegraded":"2023-12-08T08:16:31.032839+0000","last_fullsized":"2023-12-08T08:16:31.032839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031983+0000","last_change":"2023-12-08T08:16:28.972135+0000","last_active":"2023-12-08T08:16:31.031983+0000","last_peered":"2023-12-08T08:16:31.031983+0000","last_clean":"2023-12-08T08:16:31.031983+0000","last_became_active":"2023-12-08T08:16:28.971791+0000","last_became_peered":"2023-12-08T08:16:28.971791+0000","last_unstale":"2023-12-08T08:16:31.031983+0000","last_undegraded":"2023-12-08T08:16:31.031983+0000","last_fullsized":"2023-12-08T08:16:31.031983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027918+0000","last_change":"2023-12-08T08:16:30.017910+0000","last_active":"2023-12-08T08:16:31.027918+0000","last_peered":"2023-12-08T08:16:31.027918+0000","last_clean":"2023-12-08T08:16:31.027918+0000","last_became_active":"2023-12-08T08:16:30.017619+0000","last_became_peered":"2023-12-08T08:16:30.017619+0000","last_unstale":"2023-12-08T08:16:31.027918+0000","last_undegraded":"2023-12-08T08:16:31.027918+0000","last_fullsized":"2023-12-08T08:16:31.027918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:15.253515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029248+0000","last_change":"2023-12-08T08:16:28.974333+0000","last_active":"2023-12-08T08:16:31.029248+0000","last_peered":"2023-12-08T08:16:31.029248+0000","last_clean":"2023-12-08T08:16:31.029248+0000","last_became_active":"2023-12-08T08:16:28.974049+0000","last_became_peered":"2023-12-08T08:16:28.974049+0000","last_unstale":"2023-12-08T08:16:31.029248+0000","last_undegraded":"2023-12-08T08:16:31.029248+0000","last_fullsized":"2023-12-08T08:16:31.029248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:01.053374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986315+0000","last_change":"2023-12-08T08:16:30.000953+0000","last_active":"2023-12-08T08:16:30.986315+0000","last_peered":"2023-12-08T08:16:30.986315+0000","last_clean":"2023-12-08T08:16:30.986315+0000","last_became_active":"2023-12-08T08:16:30.000673+0000","last_became_peered":"2023-12-08T08:16:30.000673+0000","last_unstale":"2023-12-08T08:16:30.986315+0000","last_undegraded":"2023-12-08T08:16:30.986315+0000","last_fullsized":"2023-12-08T08:16:30.986315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029120+0000","last_change":"2023-12-08T08:16:28.970890+0000","last_active":"2023-12-08T08:16:31.029120+0000","last_peered":"2023-12-08T08:16:31.029120+0000","last_clean":"2023-12-08T08:16:31.029120+0000","last_became_active":"2023-12-08T08:16:28.970617+0000","last_became_peered":"2023-12-08T08:16:28.970617+0000","last_unstale":"2023-12-08T08:16:31.029120+0000","last_undegraded":"2023-12-08T08:16:31.029120+0000","last_fullsized":"2023-12-08T08:16:31.029120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:27.409906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983237+0000","last_change":"2023-12-08T08:16:30.002841+0000","last_active":"2023-12-08T08:16:30.983237+0000","last_peered":"2023-12-08T08:16:30.983237+0000","last_clean":"2023-12-08T08:16:30.983237+0000","last_became_active":"2023-12-08T08:16:30.002371+0000","last_became_peered":"2023-12-08T08:16:30.002371+0000","last_unstale":"2023-12-08T08:16:30.983237+0000","last_undegraded":"2023-12-08T08:16:30.983237+0000","last_fullsized":"2023-12-08T08:16:30.983237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986104+0000","last_change":"2023-12-08T08:16:28.966804+0000","last_active":"2023-12-08T08:16:30.986104+0000","last_peered":"2023-12-08T08:16:30.986104+0000","last_clean":"2023-12-08T08:16:30.986104+0000","last_became_active":"2023-12-08T08:16:28.966500+0000","last_became_peered":"2023-12-08T08:16:28.966500+0000","last_unstale":"2023-12-08T08:16:30.986104+0000","last_undegraded":"2023-12-08T08:16:30.986104+0000","last_fullsized":"2023-12-08T08:16:30.986104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029544+0000","last_change":"2023-12-08T08:16:29.999014+0000","last_active":"2023-12-08T08:16:31.029544+0000","last_peered":"2023-12-08T08:16:31.029544+0000","last_clean":"2023-12-08T08:16:31.029544+0000","last_became_active":"2023-12-08T08:16:29.998706+0000","last_became_peered":"2023-12-08T08:16:29.998706+0000","last_unstale":"2023-12-08T08:16:31.029544+0000","last_undegraded":"2023-12-08T08:16:31.029544+0000","last_fullsized":"2023-12-08T08:16:31.029544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028339+0000","last_change":"2023-12-08T08:16:28.972751+0000","last_active":"2023-12-08T08:16:31.028339+0000","last_peered":"2023-12-08T08:16:31.028339+0000","last_clean":"2023-12-08T08:16:31.028339+0000","last_became_active":"2023-12-08T08:16:28.971599+0000","last_became_peered":"2023-12-08T08:16:28.971599+0000","last_unstale":"2023-12-08T08:16:31.028339+0000","last_undegraded":"2023-12-08T08:16:31.028339+0000","last_fullsized":"2023-12-08T08:16:31.028339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028938+0000","last_change":"2023-12-08T08:16:30.005902+0000","last_active":"2023-12-08T08:16:31.028938+0000","last_peered":"2023-12-08T08:16:31.028938+0000","last_clean":"2023-12-08T08:16:31.028938+0000","last_became_active":"2023-12-08T08:16:30.005581+0000","last_became_peered":"2023-12-08T08:16:30.005581+0000","last_unstale":"2023-12-08T08:16:31.028938+0000","last_undegraded":"2023-12-08T08:16:31.028938+0000","last_fullsized":"2023-12-08T08:16:31.028938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032365+0000","last_change":"2023-12-08T08:16:28.980410+0000","last_active":"2023-12-08T08:16:31.032365+0000","last_peered":"2023-12-08T08:16:31.032365+0000","last_clean":"2023-12-08T08:16:31.032365+0000","last_became_active":"2023-12-08T08:16:28.980037+0000","last_became_peered":"2023-12-08T08:16:28.980037+0000","last_unstale":"2023-12-08T08:16:31.032365+0000","last_undegraded":"2023-12-08T08:16:31.032365+0000","last_fullsized":"2023-12-08T08:16:31.032365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:00.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986606+0000","last_change":"2023-12-08T08:16:30.012886+0000","last_active":"2023-12-08T08:16:30.986606+0000","last_peered":"2023-12-08T08:16:30.986606+0000","last_clean":"2023-12-08T08:16:30.986606+0000","last_became_active":"2023-12-08T08:16:30.012578+0000","last_became_peered":"2023-12-08T08:16:30.012578+0000","last_unstale":"2023-12-08T08:16:30.986606+0000","last_undegraded":"2023-12-08T08:16:30.986606+0000","last_fullsized":"2023-12-08T08:16:30.986606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027786+0000","last_change":"2023-12-08T08:16:28.966099+0000","last_active":"2023-12-08T08:16:31.027786+0000","last_peered":"2023-12-08T08:16:31.027786+0000","last_clean":"2023-12-08T08:16:31.027786+0000","last_became_active":"2023-12-08T08:16:28.965830+0000","last_became_peered":"2023-12-08T08:16:28.965830+0000","last_unstale":"2023-12-08T08:16:31.027786+0000","last_undegraded":"2023-12-08T08:16:31.027786+0000","last_fullsized":"2023-12-08T08:16:31.027786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.868360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982736+0000","last_change":"2023-12-08T08:16:30.004935+0000","last_active":"2023-12-08T08:16:30.982736+0000","last_peered":"2023-12-08T08:16:30.982736+0000","last_clean":"2023-12-08T08:16:30.982736+0000","last_became_active":"2023-12-08T08:16:30.004484+0000","last_became_peered":"2023-12-08T08:16:30.004484+0000","last_unstale":"2023-12-08T08:16:30.982736+0000","last_undegraded":"2023-12-08T08:16:30.982736+0000","last_fullsized":"2023-12-08T08:16:30.982736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.985470+0000","last_change":"2023-12-08T08:16:28.970395+0000","last_active":"2023-12-08T08:16:30.985470+0000","last_peered":"2023-12-08T08:16:30.985470+0000","last_clean":"2023-12-08T08:16:30.985470+0000","last_became_active":"2023-12-08T08:16:28.969828+0000","last_became_peered":"2023-12-08T08:16:28.969828+0000","last_unstale":"2023-12-08T08:16:30.985470+0000","last_undegraded":"2023-12-08T08:16:30.985470+0000","last_fullsized":"2023-12-08T08:16:30.985470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029359+0000","last_change":"2023-12-08T08:16:29.996118+0000","last_active":"2023-12-08T08:16:31.029359+0000","last_peered":"2023-12-08T08:16:31.029359+0000","last_clean":"2023-12-08T08:16:31.029359+0000","last_became_active":"2023-12-08T08:16:29.995815+0000","last_became_peered":"2023-12-08T08:16:29.995815+0000","last_unstale":"2023-12-08T08:16:31.029359+0000","last_undegraded":"2023-12-08T08:16:31.029359+0000","last_fullsized":"2023-12-08T08:16:31.029359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:14.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983302+0000","last_change":"2023-12-08T08:16:28.970249+0000","last_active":"2023-12-08T08:16:30.983302+0000","last_peered":"2023-12-08T08:16:30.983302+0000","last_clean":"2023-12-08T08:16:30.983302+0000","last_became_active":"2023-12-08T08:16:28.969959+0000","last_became_peered":"2023-12-08T08:16:28.969959+0000","last_unstale":"2023-12-08T08:16:30.983302+0000","last_undegraded":"2023-12-08T08:16:30.983302+0000","last_fullsized":"2023-12-08T08:16:30.983302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030993+0000","last_change":"2023-12-08T08:16:30.011144+0000","last_active":"2023-12-08T08:16:31.030993+0000","last_peered":"2023-12-08T08:16:31.030993+0000","last_clean":"2023-12-08T08:16:31.030993+0000","last_became_active":"2023-12-08T08:16:30.010821+0000","last_became_peered":"2023-12-08T08:16:30.010821+0000","last_unstale":"2023-12-08T08:16:31.030993+0000","last_undegraded":"2023-12-08T08:16:31.030993+0000","last_fullsized":"2023-12-08T08:16:31.030993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028935+0000","last_change":"2023-12-08T08:16:28.972703+0000","last_active":"2023-12-08T08:16:31.028935+0000","last_peered":"2023-12-08T08:16:31.028935+0000","last_clean":"2023-12-08T08:16:31.028935+0000","last_became_active":"2023-12-08T08:16:28.972337+0000","last_became_peered":"2023-12-08T08:16:28.972337+0000","last_unstale":"2023-12-08T08:16:31.028935+0000","last_undegraded":"2023-12-08T08:16:31.028935+0000","last_fullsized":"2023-12-08T08:16:31.028935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028960+0000","last_change":"2023-12-08T08:16:30.002548+0000","last_active":"2023-12-08T08:16:31.028960+0000","last_peered":"2023-12-08T08:16:31.028960+0000","last_clean":"2023-12-08T08:16:31.028960+0000","last_became_active":"2023-12-08T08:16:30.002266+0000","last_became_peered":"2023-12-08T08:16:30.002266+0000","last_unstale":"2023-12-08T08:16:31.028960+0000","last_undegraded":"2023-12-08T08:16:31.028960+0000","last_fullsized":"2023-12-08T08:16:31.028960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:12.090220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031103+0000","last_change":"2023-12-08T08:16:28.974757+0000","last_active":"2023-12-08T08:16:31.031103+0000","last_peered":"2023-12-08T08:16:31.031103+0000","last_clean":"2023-12-08T08:16:31.031103+0000","last_became_active":"2023-12-08T08:16:28.974470+0000","last_became_peered":"2023-12-08T08:16:28.974470+0000","last_unstale":"2023-12-08T08:16:31.031103+0000","last_undegraded":"2023-12-08T08:16:31.031103+0000","last_fullsized":"2023-12-08T08:16:31.031103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:07.487090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986357+0000","last_change":"2023-12-08T08:16:30.000962+0000","last_active":"2023-12-08T08:16:30.986357+0000","last_peered":"2023-12-08T08:16:30.986357+0000","last_clean":"2023-12-08T08:16:30.986357+0000","last_became_active":"2023-12-08T08:16:29.999415+0000","last_became_peered":"2023-12-08T08:16:29.999415+0000","last_unstale":"2023-12-08T08:16:30.986357+0000","last_undegraded":"2023-12-08T08:16:30.986357+0000","last_fullsized":"2023-12-08T08:16:30.986357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:52.760726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983048+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:30.983048+0000","last_peered":"2023-12-08T08:16:30.983048+0000","last_clean":"2023-12-08T08:16:30.983048+0000","last_became_active":"2023-12-08T08:16:28.974334+0000","last_became_peered":"2023-12-08T08:16:28.974334+0000","last_unstale":"2023-12-08T08:16:30.983048+0000","last_undegraded":"2023-12-08T08:16:30.983048+0000","last_fullsized":"2023-12-08T08:16:30.983048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029133+0000","last_change":"2023-12-08T08:16:30.009858+0000","last_active":"2023-12-08T08:16:31.029133+0000","last_peered":"2023-12-08T08:16:31.029133+0000","last_clean":"2023-12-08T08:16:31.029133+0000","last_became_active":"2023-12-08T08:16:30.009477+0000","last_became_peered":"2023-12-08T08:16:30.009477+0000","last_unstale":"2023-12-08T08:16:31.029133+0000","last_undegraded":"2023-12-08T08:16:31.029133+0000","last_fullsized":"2023-12-08T08:16:31.029133+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982897+0000","last_change":"2023-12-08T08:16:28.975330+0000","last_active":"2023-12-08T08:16:30.982897+0000","last_peered":"2023-12-08T08:16:30.982897+0000","last_clean":"2023-12-08T08:16:30.982897+0000","last_became_active":"2023-12-08T08:16:28.974952+0000","last_became_peered":"2023-12-08T08:16:28.974952+0000","last_unstale":"2023-12-08T08:16:30.982897+0000","last_undegraded":"2023-12-08T08:16:30.982897+0000","last_fullsized":"2023-12-08T08:16:30.982897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982675+0000","last_change":"2023-12-08T08:16:29.998148+0000","last_active":"2023-12-08T08:16:30.982675+0000","last_peered":"2023-12-08T08:16:30.982675+0000","last_clean":"2023-12-08T08:16:30.982675+0000","last_became_active":"2023-12-08T08:16:29.997889+0000","last_became_peered":"2023-12-08T08:16:29.997889+0000","last_unstale":"2023-12-08T08:16:30.982675+0000","last_undegraded":"2023-12-08T08:16:30.982675+0000","last_fullsized":"2023-12-08T08:16:30.982675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027441+0000","last_change":"2023-12-08T08:16:28.965346+0000","last_active":"2023-12-08T08:16:31.027441+0000","last_peered":"2023-12-08T08:16:31.027441+0000","last_clean":"2023-12-08T08:16:31.027441+0000","last_became_active":"2023-12-08T08:16:28.965039+0000","last_became_peered":"2023-12-08T08:16:28.965039+0000","last_unstale":"2023-12-08T08:16:31.027441+0000","last_undegraded":"2023-12-08T08:16:31.027441+0000","last_fullsized":"2023-12-08T08:16:31.027441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:36:27.005922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032241+0000","last_change":"2023-12-08T08:16:30.004598+0000","last_active":"2023-12-08T08:16:31.032241+0000","last_peered":"2023-12-08T08:16:31.032241+0000","last_clean":"2023-12-08T08:16:31.032241+0000","last_became_active":"2023-12-08T08:16:30.004063+0000","last_became_peered":"2023-12-08T08:16:30.004063+0000","last_unstale":"2023-12-08T08:16:31.032241+0000","last_undegraded":"2023-12-08T08:16:31.032241+0000","last_fullsized":"2023-12-08T08:16:31.032241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029904+0000","last_change":"2023-12-08T08:16:28.978542+0000","last_active":"2023-12-08T08:16:31.029904+0000","last_peered":"2023-12-08T08:16:31.029904+0000","last_clean":"2023-12-08T08:16:31.029904+0000","last_became_active":"2023-12-08T08:16:28.977515+0000","last_became_peered":"2023-12-08T08:16:28.977515+0000","last_unstale":"2023-12-08T08:16:31.029904+0000","last_undegraded":"2023-12-08T08:16:31.029904+0000","last_fullsized":"2023-12-08T08:16:31.029904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:17.021805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982887+0000","last_change":"2023-12-08T08:16:29.999746+0000","last_active":"2023-12-08T08:16:30.982887+0000","last_peered":"2023-12-08T08:16:30.982887+0000","last_clean":"2023-12-08T08:16:30.982887+0000","last_became_active":"2023-12-08T08:16:29.999490+0000","last_became_peered":"2023-12-08T08:16:29.999490+0000","last_unstale":"2023-12-08T08:16:30.982887+0000","last_undegraded":"2023-12-08T08:16:30.982887+0000","last_fullsized":"2023-12-08T08:16:30.982887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030051+0000","last_change":"2023-12-08T08:16:28.980456+0000","last_active":"2023-12-08T08:16:31.030051+0000","last_peered":"2023-12-08T08:16:31.030051+0000","last_clean":"2023-12-08T08:16:31.030051+0000","last_became_active":"2023-12-08T08:16:28.980144+0000","last_became_peered":"2023-12-08T08:16:28.980144+0000","last_unstale":"2023-12-08T08:16:31.030051+0000","last_undegraded":"2023-12-08T08:16:31.030051+0000","last_fullsized":"2023-12-08T08:16:31.030051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982931+0000","last_change":"2023-12-08T08:16:29.997495+0000","last_active":"2023-12-08T08:16:30.982931+0000","last_peered":"2023-12-08T08:16:30.982931+0000","last_clean":"2023-12-08T08:16:30.982931+0000","last_became_active":"2023-12-08T08:16:29.997224+0000","last_became_peered":"2023-12-08T08:16:29.997224+0000","last_unstale":"2023-12-08T08:16:30.982931+0000","last_undegraded":"2023-12-08T08:16:30.982931+0000","last_fullsized":"2023-12-08T08:16:30.982931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028886+0000","last_change":"2023-12-08T08:16:28.975373+0000","last_active":"2023-12-08T08:16:31.028886+0000","last_peered":"2023-12-08T08:16:31.028886+0000","last_clean":"2023-12-08T08:16:31.028886+0000","last_became_active":"2023-12-08T08:16:28.974985+0000","last_became_peered":"2023-12-08T08:16:28.974985+0000","last_unstale":"2023-12-08T08:16:31.028886+0000","last_undegraded":"2023-12-08T08:16:31.028886+0000","last_fullsized":"2023-12-08T08:16:31.028886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031500+0000","last_change":"2023-12-08T08:16:30.002534+0000","last_active":"2023-12-08T08:16:31.031500+0000","last_peered":"2023-12-08T08:16:31.031500+0000","last_clean":"2023-12-08T08:16:31.031500+0000","last_became_active":"2023-12-08T08:16:30.001495+0000","last_became_peered":"2023-12-08T08:16:30.001495+0000","last_unstale":"2023-12-08T08:16:31.031500+0000","last_undegraded":"2023-12-08T08:16:31.031500+0000","last_fullsized":"2023-12-08T08:16:31.031500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:52.176838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986482+0000","last_change":"2023-12-08T08:16:28.978336+0000","last_active":"2023-12-08T08:16:30.986482+0000","last_peered":"2023-12-08T08:16:30.986482+0000","last_clean":"2023-12-08T08:16:30.986482+0000","last_became_active":"2023-12-08T08:16:28.977153+0000","last_became_peered":"2023-12-08T08:16:28.977153+0000","last_unstale":"2023-12-08T08:16:30.986482+0000","last_undegraded":"2023-12-08T08:16:30.986482+0000","last_fullsized":"2023-12-08T08:16:30.986482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986298+0000","last_change":"2023-12-08T08:16:30.003307+0000","last_active":"2023-12-08T08:16:30.986298+0000","last_peered":"2023-12-08T08:16:30.986298+0000","last_clean":"2023-12-08T08:16:30.986298+0000","last_became_active":"2023-12-08T08:16:30.002242+0000","last_became_peered":"2023-12-08T08:16:30.002242+0000","last_unstale":"2023-12-08T08:16:30.986298+0000","last_undegraded":"2023-12-08T08:16:30.986298+0000","last_fullsized":"2023-12-08T08:16:30.986298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029930+0000","last_change":"2023-12-08T08:16:28.971697+0000","last_active":"2023-12-08T08:16:31.029930+0000","last_peered":"2023-12-08T08:16:31.029930+0000","last_clean":"2023-12-08T08:16:31.029930+0000","last_became_active":"2023-12-08T08:16:28.971403+0000","last_became_peered":"2023-12-08T08:16:28.971403+0000","last_unstale":"2023-12-08T08:16:31.029930+0000","last_undegraded":"2023-12-08T08:16:31.029930+0000","last_fullsized":"2023-12-08T08:16:31.029930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:55:26.868497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029902+0000","last_change":"2023-12-08T08:16:30.004120+0000","last_active":"2023-12-08T08:16:31.029902+0000","last_peered":"2023-12-08T08:16:31.029902+0000","last_clean":"2023-12-08T08:16:31.029902+0000","last_became_active":"2023-12-08T08:16:30.003839+0000","last_became_peered":"2023-12-08T08:16:30.003839+0000","last_unstale":"2023-12-08T08:16:31.029902+0000","last_undegraded":"2023-12-08T08:16:31.029902+0000","last_fullsized":"2023-12-08T08:16:31.029902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:24:40.270711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027294+0000","last_change":"2023-12-08T08:16:28.972924+0000","last_active":"2023-12-08T08:16:31.027294+0000","last_peered":"2023-12-08T08:16:31.027294+0000","last_clean":"2023-12-08T08:16:31.027294+0000","last_became_active":"2023-12-08T08:16:28.971768+0000","last_became_peered":"2023-12-08T08:16:28.971768+0000","last_unstale":"2023-12-08T08:16:31.027294+0000","last_undegraded":"2023-12-08T08:16:31.027294+0000","last_fullsized":"2023-12-08T08:16:31.027294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.012974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030247+0000","last_change":"2023-12-08T08:16:30.008721+0000","last_active":"2023-12-08T08:16:31.030247+0000","last_peered":"2023-12-08T08:16:31.030247+0000","last_clean":"2023-12-08T08:16:31.030247+0000","last_became_active":"2023-12-08T08:16:30.007946+0000","last_became_peered":"2023-12-08T08:16:30.007946+0000","last_unstale":"2023-12-08T08:16:31.030247+0000","last_undegraded":"2023-12-08T08:16:31.030247+0000","last_fullsized":"2023-12-08T08:16:31.030247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028287+0000","last_change":"2023-12-08T08:16:28.964831+0000","last_active":"2023-12-08T08:16:31.028287+0000","last_peered":"2023-12-08T08:16:31.028287+0000","last_clean":"2023-12-08T08:16:31.028287+0000","last_became_active":"2023-12-08T08:16:28.964526+0000","last_became_peered":"2023-12-08T08:16:28.964526+0000","last_unstale":"2023-12-08T08:16:31.028287+0000","last_undegraded":"2023-12-08T08:16:31.028287+0000","last_fullsized":"2023-12-08T08:16:31.028287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:28.711499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028471+0000","last_change":"2023-12-08T08:16:30.007994+0000","last_active":"2023-12-08T08:16:31.028471+0000","last_peered":"2023-12-08T08:16:31.028471+0000","last_clean":"2023-12-08T08:16:31.028471+0000","last_became_active":"2023-12-08T08:16:30.006242+0000","last_became_peered":"2023-12-08T08:16:30.006242+0000","last_unstale":"2023-12-08T08:16:31.028471+0000","last_undegraded":"2023-12-08T08:16:31.028471+0000","last_fullsized":"2023-12-08T08:16:31.028471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:31.687770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028144+0000","last_change":"2023-12-08T08:16:28.967837+0000","last_active":"2023-12-08T08:16:31.028144+0000","last_peered":"2023-12-08T08:16:31.028144+0000","last_clean":"2023-12-08T08:16:31.028144+0000","last_became_active":"2023-12-08T08:16:28.967450+0000","last_became_peered":"2023-12-08T08:16:28.967450+0000","last_unstale":"2023-12-08T08:16:31.028144+0000","last_undegraded":"2023-12-08T08:16:31.028144+0000","last_fullsized":"2023-12-08T08:16:31.028144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:00.811457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028859+0000","last_change":"2023-12-08T08:16:29.994820+0000","last_active":"2023-12-08T08:16:31.028859+0000","last_peered":"2023-12-08T08:16:31.028859+0000","last_clean":"2023-12-08T08:16:31.028859+0000","last_became_active":"2023-12-08T08:16:29.994544+0000","last_became_peered":"2023-12-08T08:16:29.994544+0000","last_unstale":"2023-12-08T08:16:31.028859+0000","last_undegraded":"2023-12-08T08:16:31.028859+0000","last_fullsized":"2023-12-08T08:16:31.028859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031510+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:31.031510+0000","last_peered":"2023-12-08T08:16:31.031510+0000","last_clean":"2023-12-08T08:16:31.031510+0000","last_became_active":"2023-12-08T08:16:28.974336+0000","last_became_peered":"2023-12-08T08:16:28.974336+0000","last_unstale":"2023-12-08T08:16:31.031510+0000","last_undegraded":"2023-12-08T08:16:31.031510+0000","last_fullsized":"2023-12-08T08:16:31.031510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982774+0000","last_change":"2023-12-08T08:16:30.000662+0000","last_active":"2023-12-08T08:16:30.982774+0000","last_peered":"2023-12-08T08:16:30.982774+0000","last_clean":"2023-12-08T08:16:30.982774+0000","last_became_active":"2023-12-08T08:16:30.000315+0000","last_became_peered":"2023-12-08T08:16:30.000315+0000","last_unstale":"2023-12-08T08:16:30.982774+0000","last_undegraded":"2023-12-08T08:16:30.982774+0000","last_fullsized":"2023-12-08T08:16:30.982774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.026130+0000","last_change":"2023-12-08T08:16:28.965034+0000","last_active":"2023-12-08T08:16:31.026130+0000","last_peered":"2023-12-08T08:16:31.026130+0000","last_clean":"2023-12-08T08:16:31.026130+0000","last_became_active":"2023-12-08T08:16:28.964719+0000","last_became_peered":"2023-12-08T08:16:28.964719+0000","last_unstale":"2023-12-08T08:16:31.026130+0000","last_undegraded":"2023-12-08T08:16:31.026130+0000","last_fullsized":"2023-12-08T08:16:31.026130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:49.109342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027173+0000","last_change":"2023-12-08T08:16:30.019492+0000","last_active":"2023-12-08T08:16:31.027173+0000","last_peered":"2023-12-08T08:16:31.027173+0000","last_clean":"2023-12-08T08:16:31.027173+0000","last_became_active":"2023-12-08T08:16:30.019182+0000","last_became_peered":"2023-12-08T08:16:30.019182+0000","last_unstale":"2023-12-08T08:16:31.027173+0000","last_undegraded":"2023-12-08T08:16:31.027173+0000","last_fullsized":"2023-12-08T08:16:31.027173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:32:53.506356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031225+0000","last_change":"2023-12-08T08:16:28.975323+0000","last_active":"2023-12-08T08:16:31.031225+0000","last_peered":"2023-12-08T08:16:31.031225+0000","last_clean":"2023-12-08T08:16:31.031225+0000","last_became_active":"2023-12-08T08:16:28.974944+0000","last_became_peered":"2023-12-08T08:16:28.974944+0000","last_unstale":"2023-12-08T08:16:31.031225+0000","last_undegraded":"2023-12-08T08:16:31.031225+0000","last_fullsized":"2023-12-08T08:16:31.031225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031346+0000","last_change":"2023-12-08T08:16:30.016409+0000","last_active":"2023-12-08T08:16:31.031346+0000","last_peered":"2023-12-08T08:16:31.031346+0000","last_clean":"2023-12-08T08:16:31.031346+0000","last_became_active":"2023-12-08T08:16:30.016111+0000","last_became_peered":"2023-12-08T08:16:30.016111+0000","last_unstale":"2023-12-08T08:16:31.031346+0000","last_undegraded":"2023-12-08T08:16:31.031346+0000","last_fullsized":"2023-12-08T08:16:31.031346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.154037+0000","last_change":"2023-12-08T08:16:28.973691+0000","last_active":"2023-12-08T08:16:31.154037+0000","last_peered":"2023-12-08T08:16:31.154037+0000","last_clean":"2023-12-08T08:16:31.154037+0000","last_became_active":"2023-12-08T08:16:28.973374+0000","last_became_peered":"2023-12-08T08:16:28.973374+0000","last_unstale":"2023-12-08T08:16:31.154037+0000","last_undegraded":"2023-12-08T08:16:31.154037+0000","last_fullsized":"2023-12-08T08:16:31.154037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:16.503221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983149+0000","last_change":"2023-12-08T08:16:30.004996+0000","last_active":"2023-12-08T08:16:30.983149+0000","last_peered":"2023-12-08T08:16:30.983149+0000","last_clean":"2023-12-08T08:16:30.983149+0000","last_became_active":"2023-12-08T08:16:30.004414+0000","last_became_peered":"2023-12-08T08:16:30.004414+0000","last_unstale":"2023-12-08T08:16:30.983149+0000","last_undegraded":"2023-12-08T08:16:30.983149+0000","last_fullsized":"2023-12-08T08:16:30.983149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028510+0000","last_change":"2023-12-08T08:16:28.976308+0000","last_active":"2023-12-08T08:16:31.028510+0000","last_peered":"2023-12-08T08:16:31.028510+0000","last_clean":"2023-12-08T08:16:31.028510+0000","last_became_active":"2023-12-08T08:16:28.974927+0000","last_became_peered":"2023-12-08T08:16:28.974927+0000","last_unstale":"2023-12-08T08:16:31.028510+0000","last_undegraded":"2023-12-08T08:16:31.028510+0000","last_fullsized":"2023-12-08T08:16:31.028510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029317+0000","last_change":"2023-12-08T08:16:30.013944+0000","last_active":"2023-12-08T08:16:31.029317+0000","last_peered":"2023-12-08T08:16:31.029317+0000","last_clean":"2023-12-08T08:16:31.029317+0000","last_became_active":"2023-12-08T08:16:30.013655+0000","last_became_peered":"2023-12-08T08:16:30.013655+0000","last_unstale":"2023-12-08T08:16:31.029317+0000","last_undegraded":"2023-12-08T08:16:31.029317+0000","last_fullsized":"2023-12-08T08:16:31.029317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028949+0000","last_change":"2023-12-08T08:16:28.977478+0000","last_active":"2023-12-08T08:16:31.028949+0000","last_peered":"2023-12-08T08:16:31.028949+0000","last_clean":"2023-12-08T08:16:31.028949+0000","last_became_active":"2023-12-08T08:16:28.976902+0000","last_became_peered":"2023-12-08T08:16:28.976902+0000","last_unstale":"2023-12-08T08:16:31.028949+0000","last_undegraded":"2023-12-08T08:16:31.028949+0000","last_fullsized":"2023-12-08T08:16:31.028949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027541+0000","last_change":"2023-12-08T08:16:30.000645+0000","last_active":"2023-12-08T08:16:31.027541+0000","last_peered":"2023-12-08T08:16:31.027541+0000","last_clean":"2023-12-08T08:16:31.027541+0000","last_became_active":"2023-12-08T08:16:30.000349+0000","last_became_peered":"2023-12-08T08:16:30.000349+0000","last_unstale":"2023-12-08T08:16:31.027541+0000","last_undegraded":"2023-12-08T08:16:31.027541+0000","last_fullsized":"2023-12-08T08:16:31.027541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:07:53.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030782+0000","last_change":"2023-12-08T08:16:28.969401+0000","last_active":"2023-12-08T08:16:31.030782+0000","last_peered":"2023-12-08T08:16:31.030782+0000","last_clean":"2023-12-08T08:16:31.030782+0000","last_became_active":"2023-12-08T08:16:28.968937+0000","last_became_peered":"2023-12-08T08:16:28.968937+0000","last_unstale":"2023-12-08T08:16:31.030782+0000","last_undegraded":"2023-12-08T08:16:31.030782+0000","last_fullsized":"2023-12-08T08:16:31.030782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986240+0000","last_change":"2023-12-08T08:16:30.001694+0000","last_active":"2023-12-08T08:16:30.986240+0000","last_peered":"2023-12-08T08:16:30.986240+0000","last_clean":"2023-12-08T08:16:30.986240+0000","last_became_active":"2023-12-08T08:16:30.001411+0000","last_became_peered":"2023-12-08T08:16:30.001411+0000","last_unstale":"2023-12-08T08:16:30.986240+0000","last_undegraded":"2023-12-08T08:16:30.986240+0000","last_fullsized":"2023-12-08T08:16:30.986240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.985672+0000","last_change":"2023-12-08T08:16:28.964871+0000","last_active":"2023-12-08T08:16:30.985672+0000","last_peered":"2023-12-08T08:16:30.985672+0000","last_clean":"2023-12-08T08:16:30.985672+0000","last_became_active":"2023-12-08T08:16:28.964469+0000","last_became_peered":"2023-12-08T08:16:28.964469+0000","last_unstale":"2023-12-08T08:16:30.985672+0000","last_undegraded":"2023-12-08T08:16:30.985672+0000","last_fullsized":"2023-12-08T08:16:30.985672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:49.019319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032792+0000","last_change":"2023-12-08T08:16:30.009647+0000","last_active":"2023-12-08T08:16:31.032792+0000","last_peered":"2023-12-08T08:16:31.032792+0000","last_clean":"2023-12-08T08:16:31.032792+0000","last_became_active":"2023-12-08T08:16:30.009174+0000","last_became_peered":"2023-12-08T08:16:30.009174+0000","last_unstale":"2023-12-08T08:16:31.032792+0000","last_undegraded":"2023-12-08T08:16:31.032792+0000","last_fullsized":"2023-12-08T08:16:31.032792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982552+0000","last_change":"2023-12-08T08:16:28.969690+0000","last_active":"2023-12-08T08:16:30.982552+0000","last_peered":"2023-12-08T08:16:30.982552+0000","last_clean":"2023-12-08T08:16:30.982552+0000","last_became_active":"2023-12-08T08:16:28.969355+0000","last_became_peered":"2023-12-08T08:16:28.969355+0000","last_unstale":"2023-12-08T08:16:30.982552+0000","last_undegraded":"2023-12-08T08:16:30.982552+0000","last_fullsized":"2023-12-08T08:16:30.982552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:52.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029722+0000","last_change":"2023-12-08T08:16:30.013379+0000","last_active":"2023-12-08T08:16:31.029722+0000","last_peered":"2023-12-08T08:16:31.029722+0000","last_clean":"2023-12-08T08:16:31.029722+0000","last_became_active":"2023-12-08T08:16:30.013056+0000","last_became_peered":"2023-12-08T08:16:30.013056+0000","last_unstale":"2023-12-08T08:16:31.029722+0000","last_undegraded":"2023-12-08T08:16:31.029722+0000","last_fullsized":"2023-12-08T08:16:31.029722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032934+0000","last_change":"2023-12-08T08:16:28.977566+0000","last_active":"2023-12-08T08:16:31.032934+0000","last_peered":"2023-12-08T08:16:31.032934+0000","last_clean":"2023-12-08T08:16:31.032934+0000","last_became_active":"2023-12-08T08:16:28.976769+0000","last_became_peered":"2023-12-08T08:16:28.976769+0000","last_unstale":"2023-12-08T08:16:31.032934+0000","last_undegraded":"2023-12-08T08:16:31.032934+0000","last_fullsized":"2023-12-08T08:16:31.032934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-08T08:16:29.997283+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:16:29.997283+0000","last_peered":"2023-12-08T08:16:29.997283+0000","last_clean":"2023-12-08T08:16:29.997283+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:16:29.997283+0000","last_undegraded":"2023-12-08T08:16:29.997283+0000","last_fullsized":"2023-12-08T08:16:29.997283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":788508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.165}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.2649999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.389},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":1.4359999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.361},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.754}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6779999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.581}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":19.065999999999999,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":19.364999999999998,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.075}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.351}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5680000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.28}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.393},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.7809999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.665},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.625}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.627}]},{"osd":1,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.4359999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.167}]},{"osd":3,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.379},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2949999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.337},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.7110000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.5449999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.804},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.47}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":197062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.626},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":1.296,"5min":1.296,"15min":1.296},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.5}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":475136,"data_stored":198104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.0429999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.234},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.3600000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.117},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.587},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.496}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6699999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":196528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.75},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.4399999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.135}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.643}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.607},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.351}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":196548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.67800000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":786860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.96799999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.8480000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.462}]},{"osd":5,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.544},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.593}]},{"osd":6,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.696},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.49}]},{"osd":7,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.6559999999999997,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.667}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:16:34.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:16:34.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.758+0000 7f7ad7085640 1 Processor -- start 2023-12-08T08:16:34.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.758+0000 7f7ad7085640 1 -- start start 2023-12-08T08:16:34.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.759+0000 7f7ad7085640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ad014e260 0x7f7ad01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.759+0000 7f7ad7085640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad00a7770 0x7f7ad00a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.759+0000 7f7ad7085640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad00a7300 con 0x7f7ad00beb30 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad7085640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00bfb90 con 0x7f7ad00a7770 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad7085640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00bf010 con 0x7f7ad014e260 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad00a7770 0x7f7ad00a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad00a7770 0x7f7ad00a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41906/0 (socket says 172.21.15.45:41906) 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 -- 172.21.15.45:0/3448035277 learned_addr learned my addr 172.21.15.45:0/3448035277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:34.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6083640 1 --2- 172.21.15.45:0/3448035277 >> v2:172.21.15.114:3300/0 conn(0x7f7ad014e260 0x7f7ad01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 -- 172.21.15.45:0/3448035277 >> v2:172.21.15.114:3300/0 conn(0x7f7ad014e260 msgr2=0x7f7ad01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:34.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 --2- 172.21.15.45:0/3448035277 >> v2:172.21.15.114:3300/0 conn(0x7f7ad014e260 0x7f7ad01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 -- 172.21.15.45:0/3448035277 >> v1:172.21.15.45:6789/0 conn(0x7f7ad00beb30 legacy=0x7f7ad006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.760+0000 7f7ad6884640 1 -- 172.21.15.45:0/3448035277 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00bf2f0 con 0x7f7ad00a7770 2023-12-08T08:16:34.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.762+0000 7f7ad6884640 1 --2- 172.21.15.45:0/3448035277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00a7be0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00bffd0 tx=0x7f7ac802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac3ab839d57f384 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.762+0000 7f7ad5081640 1 -- 172.21.15.45:0/3448035277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac802cb10 con 0x7f7ad00a7770 2023-12-08T08:16:34.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.762+0000 7f7ad5081640 1 -- 172.21.15.45:0/3448035277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac802cc70 con 0x7f7ad00a7770 2023-12-08T08:16:34.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.762+0000 7f7ad5081640 1 -- 172.21.15.45:0/3448035277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80343f0 con 0x7f7ad00a7770 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 -- 172.21.15.45:0/3448035277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 msgr2=0x7f7ad00a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 --2- 172.21.15.45:0/3448035277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00a7be0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00bffd0 tx=0x7f7ac802bf70 comp rx=0 tx=0).stop 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 -- 172.21.15.45:0/3448035277 shutdown_connections 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 --2- 172.21.15.45:0/3448035277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00a7be0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 --2- 172.21.15.45:0/3448035277 >> v2:172.21.15.114:3300/0 conn(0x7f7ad014e260 0x7f7ad01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 -- 172.21.15.45:0/3448035277 >> 172.21.15.45:0/3448035277 conn(0x7f7ad00c5780 msgr2=0x7f7ad00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:34.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 -- 172.21.15.45:0/3448035277 shutdown_connections 2023-12-08T08:16:34.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.763+0000 7f7ad7085640 1 -- 172.21.15.45:0/3448035277 wait complete. 2023-12-08T08:16:34.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.765+0000 7f7ad7085640 1 Processor -- start 2023-12-08T08:16:34.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.765+0000 7f7ad7085640 1 -- start start 2023-12-08T08:16:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad00beb30 0x7f7ad0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ad014e260 0x7f7ad0147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0149030 con 0x7f7ad00a7770 2023-12-08T08:16:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad01e96d0 con 0x7f7ad00beb30 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad7085640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0157a60 con 0x7f7ad014e260 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad6083640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad6083640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41918/0 (socket says 172.21.15.45:41918) 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.766+0000 7f7ad6083640 1 -- 172.21.15.45:0/4071467329 learned_addr learned my addr 172.21.15.45:0/4071467329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 -- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ad014e260 msgr2=0x7f7ad0147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ad014e260 0x7f7ad0147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 -- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad00beb30 msgr2=0x7f7ad0155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad00beb30 0x7f7ad0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 -- 172.21.15.45:0/4071467329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009b30 con 0x7f7ad00a7770 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad6083640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d5f0 tx=0x7f7acc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0125f0 con 0x7f7ad00a7770 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc012750 con 0x7f7ad00a7770 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc012ae0 con 0x7f7ad00a7770 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.767+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad0157d40 con 0x7f7ad00a7770 2023-12-08T08:16:34.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.768+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad0158300 con 0x7f7ad00a7770 2023-12-08T08:16:34.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.769+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad01e9840 con 0x7f7ad00a7770 2023-12-08T08:16:34.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.770+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7acc012c40 con 0x7f7ad00a7770 2023-12-08T08:16:34.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.771+0000 7f7ac6ffd640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:34.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.771+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7acc089cd0 con 0x7f7ad00a7770 2023-12-08T08:16:34.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.772+0000 7f7ad5882640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:34.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.772+0000 7f7ad5882640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 0x7f7ab406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0000f60 tx=0x7f7ac00079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:34.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.776+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7acc054ba0 con 0x7f7ad00a7770 2023-12-08T08:16:34.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.967+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ad00a6380 con 0x7f7ab406ae40 2023-12-08T08:16:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.989+0000 7f7ac6ffd640 1 -- 172.21.15.45:0/4071467329 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286888 (secure 0 0 0) 0x7f7ad00a6380 con 0x7f7ab406ae40 2023-12-08T08:16:34.996 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:34.997 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:16:34.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 msgr2=0x7f7ab406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 0x7f7ab406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0000f60 tx=0x7f7ac00079b0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 msgr2=0x7f7ad00aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d5f0 tx=0x7f7acc00dab0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 shutdown_connections 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ad014e260 0x7f7ad0147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad00beb30 0x7f7ad0155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 --2- 172.21.15.45:0/4071467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad00a7770 0x7f7ad00aa3c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 >> 172.21.15.45:0/4071467329 conn(0x7f7ad00c5780 msgr2=0x7f7ad00c0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 shutdown_connections 2023-12-08T08:16:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:34.994+0000 7f7ad7085640 1 -- 172.21.15.45:0/4071467329 wait complete. 2023-12-08T08:16:35.018 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-12-08T08:16:33.733808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237628,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737092,"statfs":{"total":773094113280,"available":772850782208,"internally_reserved":0,"allocated":4923392,"data_stored":2757220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.802893"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983346+0000","last_change":"2023-12-08T08:16:30.002627+0000","last_active":"2023-12-08T08:16:30.983346+0000","last_peered":"2023-12-08T08:16:30.983346+0000","last_clean":"2023-12-08T08:16:30.983346+0000","last_became_active":"2023-12-08T08:16:30.001969+0000","last_became_peered":"2023-12-08T08:16:30.001969+0000","last_unstale":"2023-12-08T08:16:30.983346+0000","last_undegraded":"2023-12-08T08:16:30.983346+0000","last_fullsized":"2023-12-08T08:16:30.983346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983069+0000","last_change":"2023-12-08T08:16:30.005992+0000","last_active":"2023-12-08T08:16:30.983069+0000","last_peered":"2023-12-08T08:16:30.983069+0000","last_clean":"2023-12-08T08:16:30.983069+0000","last_became_active":"2023-12-08T08:16:30.004730+0000","last_became_peered":"2023-12-08T08:16:30.004730+0000","last_unstale":"2023-12-08T08:16:30.983069+0000","last_undegraded":"2023-12-08T08:16:30.983069+0000","last_fullsized":"2023-12-08T08:16:30.983069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028562+0000","last_change":"2023-12-08T08:16:30.018833+0000","last_active":"2023-12-08T08:16:31.028562+0000","last_peered":"2023-12-08T08:16:31.028562+0000","last_clean":"2023-12-08T08:16:31.028562+0000","last_became_active":"2023-12-08T08:16:30.018490+0000","last_became_peered":"2023-12-08T08:16:30.018490+0000","last_unstale":"2023-12-08T08:16:31.028562+0000","last_undegraded":"2023-12-08T08:16:31.028562+0000","last_fullsized":"2023-12-08T08:16:31.028562+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:01.019985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029192+0000","last_change":"2023-12-08T08:16:30.006081+0000","last_active":"2023-12-08T08:16:31.029192+0000","last_peered":"2023-12-08T08:16:31.029192+0000","last_clean":"2023-12-08T08:16:31.029192+0000","last_became_active":"2023-12-08T08:16:30.005783+0000","last_became_peered":"2023-12-08T08:16:30.005783+0000","last_unstale":"2023-12-08T08:16:31.029192+0000","last_undegraded":"2023-12-08T08:16:31.029192+0000","last_fullsized":"2023-12-08T08:16:31.029192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:28.498447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028130+0000","last_change":"2023-12-08T08:16:30.008831+0000","last_active":"2023-12-08T08:16:31.028130+0000","last_peered":"2023-12-08T08:16:31.028130+0000","last_clean":"2023-12-08T08:16:31.028130+0000","last_became_active":"2023-12-08T08:16:30.006730+0000","last_became_peered":"2023-12-08T08:16:30.006730+0000","last_unstale":"2023-12-08T08:16:31.028130+0000","last_undegraded":"2023-12-08T08:16:31.028130+0000","last_fullsized":"2023-12-08T08:16:31.028130+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:54.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027401+0000","last_change":"2023-12-08T08:16:29.995593+0000","last_active":"2023-12-08T08:16:31.027401+0000","last_peered":"2023-12-08T08:16:31.027401+0000","last_clean":"2023-12-08T08:16:31.027401+0000","last_became_active":"2023-12-08T08:16:29.995301+0000","last_became_peered":"2023-12-08T08:16:29.995301+0000","last_unstale":"2023-12-08T08:16:31.027401+0000","last_undegraded":"2023-12-08T08:16:31.027401+0000","last_fullsized":"2023-12-08T08:16:31.027401+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:26:22.011359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027862+0000","last_change":"2023-12-08T08:16:30.015416+0000","last_active":"2023-12-08T08:16:31.027862+0000","last_peered":"2023-12-08T08:16:31.027862+0000","last_clean":"2023-12-08T08:16:31.027862+0000","last_became_active":"2023-12-08T08:16:30.015060+0000","last_became_peered":"2023-12-08T08:16:30.015060+0000","last_unstale":"2023-12-08T08:16:31.027862+0000","last_undegraded":"2023-12-08T08:16:31.027862+0000","last_fullsized":"2023-12-08T08:16:31.027862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982591+0000","last_change":"2023-12-08T08:16:29.993605+0000","last_active":"2023-12-08T08:16:30.982591+0000","last_peered":"2023-12-08T08:16:30.982591+0000","last_clean":"2023-12-08T08:16:30.982591+0000","last_became_active":"2023-12-08T08:16:29.993263+0000","last_became_peered":"2023-12-08T08:16:29.993263+0000","last_unstale":"2023-12-08T08:16:30.982591+0000","last_undegraded":"2023-12-08T08:16:30.982591+0000","last_fullsized":"2023-12-08T08:16:30.982591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028934+0000","last_change":"2023-12-08T08:16:30.015099+0000","last_active":"2023-12-08T08:16:31.028934+0000","last_peered":"2023-12-08T08:16:31.028934+0000","last_clean":"2023-12-08T08:16:31.028934+0000","last_became_active":"2023-12-08T08:16:30.014849+0000","last_became_peered":"2023-12-08T08:16:30.014849+0000","last_unstale":"2023-12-08T08:16:31.028934+0000","last_undegraded":"2023-12-08T08:16:31.028934+0000","last_fullsized":"2023-12-08T08:16:31.028934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:08.500259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028546+0000","last_change":"2023-12-08T08:16:30.007497+0000","last_active":"2023-12-08T08:16:31.028546+0000","last_peered":"2023-12-08T08:16:31.028546+0000","last_clean":"2023-12-08T08:16:31.028546+0000","last_became_active":"2023-12-08T08:16:30.007046+0000","last_became_peered":"2023-12-08T08:16:30.007046+0000","last_unstale":"2023-12-08T08:16:31.028546+0000","last_undegraded":"2023-12-08T08:16:31.028546+0000","last_fullsized":"2023-12-08T08:16:31.028546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029154+0000","last_change":"2023-12-08T08:16:30.002707+0000","last_active":"2023-12-08T08:16:31.029154+0000","last_peered":"2023-12-08T08:16:31.029154+0000","last_clean":"2023-12-08T08:16:31.029154+0000","last_became_active":"2023-12-08T08:16:30.002244+0000","last_became_peered":"2023-12-08T08:16:30.002244+0000","last_unstale":"2023-12-08T08:16:31.029154+0000","last_undegraded":"2023-12-08T08:16:31.029154+0000","last_fullsized":"2023-12-08T08:16:31.029154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028333+0000","last_change":"2023-12-08T08:16:29.996936+0000","last_active":"2023-12-08T08:16:31.028333+0000","last_peered":"2023-12-08T08:16:31.028333+0000","last_clean":"2023-12-08T08:16:31.028333+0000","last_became_active":"2023-12-08T08:16:29.996661+0000","last_became_peered":"2023-12-08T08:16:29.996661+0000","last_unstale":"2023-12-08T08:16:31.028333+0000","last_undegraded":"2023-12-08T08:16:31.028333+0000","last_fullsized":"2023-12-08T08:16:31.028333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028001+0000","last_change":"2023-12-08T08:16:30.004638+0000","last_active":"2023-12-08T08:16:31.028001+0000","last_peered":"2023-12-08T08:16:31.028001+0000","last_clean":"2023-12-08T08:16:31.028001+0000","last_became_active":"2023-12-08T08:16:30.004298+0000","last_became_peered":"2023-12-08T08:16:30.004298+0000","last_unstale":"2023-12-08T08:16:31.028001+0000","last_undegraded":"2023-12-08T08:16:31.028001+0000","last_fullsized":"2023-12-08T08:16:31.028001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986195+0000","last_change":"2023-12-08T08:16:29.998886+0000","last_active":"2023-12-08T08:16:30.986195+0000","last_peered":"2023-12-08T08:16:30.986195+0000","last_clean":"2023-12-08T08:16:30.986195+0000","last_became_active":"2023-12-08T08:16:29.998501+0000","last_became_peered":"2023-12-08T08:16:29.998501+0000","last_unstale":"2023-12-08T08:16:30.986195+0000","last_undegraded":"2023-12-08T08:16:30.986195+0000","last_fullsized":"2023-12-08T08:16:30.986195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027843+0000","last_change":"2023-12-08T08:16:29.996508+0000","last_active":"2023-12-08T08:16:31.027843+0000","last_peered":"2023-12-08T08:16:31.027843+0000","last_clean":"2023-12-08T08:16:31.027843+0000","last_became_active":"2023-12-08T08:16:29.995570+0000","last_became_peered":"2023-12-08T08:16:29.995570+0000","last_unstale":"2023-12-08T08:16:31.027843+0000","last_undegraded":"2023-12-08T08:16:31.027843+0000","last_fullsized":"2023-12-08T08:16:31.027843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029805+0000","last_change":"2023-12-08T08:16:30.016548+0000","last_active":"2023-12-08T08:16:31.029805+0000","last_peered":"2023-12-08T08:16:31.029805+0000","last_clean":"2023-12-08T08:16:31.029805+0000","last_became_active":"2023-12-08T08:16:30.016231+0000","last_became_peered":"2023-12-08T08:16:30.016231+0000","last_unstale":"2023-12-08T08:16:31.029805+0000","last_undegraded":"2023-12-08T08:16:31.029805+0000","last_fullsized":"2023-12-08T08:16:31.029805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.033377+0000","last_change":"2023-12-08T08:16:30.018546+0000","last_active":"2023-12-08T08:16:31.033377+0000","last_peered":"2023-12-08T08:16:31.033377+0000","last_clean":"2023-12-08T08:16:31.033377+0000","last_became_active":"2023-12-08T08:16:30.018247+0000","last_became_peered":"2023-12-08T08:16:30.018247+0000","last_unstale":"2023-12-08T08:16:31.033377+0000","last_undegraded":"2023-12-08T08:16:31.033377+0000","last_fullsized":"2023-12-08T08:16:31.033377+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030874+0000","last_change":"2023-12-08T08:16:30.004791+0000","last_active":"2023-12-08T08:16:31.030874+0000","last_peered":"2023-12-08T08:16:31.030874+0000","last_clean":"2023-12-08T08:16:31.030874+0000","last_became_active":"2023-12-08T08:16:30.002347+0000","last_became_peered":"2023-12-08T08:16:30.002347+0000","last_unstale":"2023-12-08T08:16:31.030874+0000","last_undegraded":"2023-12-08T08:16:31.030874+0000","last_fullsized":"2023-12-08T08:16:31.030874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029810+0000","last_change":"2023-12-08T08:16:29.992462+0000","last_active":"2023-12-08T08:16:31.029810+0000","last_peered":"2023-12-08T08:16:31.029810+0000","last_clean":"2023-12-08T08:16:31.029810+0000","last_became_active":"2023-12-08T08:16:29.991153+0000","last_became_peered":"2023-12-08T08:16:29.991153+0000","last_unstale":"2023-12-08T08:16:31.029810+0000","last_undegraded":"2023-12-08T08:16:31.029810+0000","last_fullsized":"2023-12-08T08:16:31.029810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:20.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030745+0000","last_change":"2023-12-08T08:16:30.002827+0000","last_active":"2023-12-08T08:16:31.030745+0000","last_peered":"2023-12-08T08:16:31.030745+0000","last_clean":"2023-12-08T08:16:31.030745+0000","last_became_active":"2023-12-08T08:16:30.002525+0000","last_became_peered":"2023-12-08T08:16:30.002525+0000","last_unstale":"2023-12-08T08:16:31.030745+0000","last_undegraded":"2023-12-08T08:16:31.030745+0000","last_fullsized":"2023-12-08T08:16:31.030745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028256+0000","last_change":"2023-12-08T08:16:30.009287+0000","last_active":"2023-12-08T08:16:31.028256+0000","last_peered":"2023-12-08T08:16:31.028256+0000","last_clean":"2023-12-08T08:16:31.028256+0000","last_became_active":"2023-12-08T08:16:30.008873+0000","last_became_peered":"2023-12-08T08:16:30.008873+0000","last_unstale":"2023-12-08T08:16:31.028256+0000","last_undegraded":"2023-12-08T08:16:31.028256+0000","last_fullsized":"2023-12-08T08:16:31.028256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986591+0000","last_change":"2023-12-08T08:16:30.000677+0000","last_active":"2023-12-08T08:16:30.986591+0000","last_peered":"2023-12-08T08:16:30.986591+0000","last_clean":"2023-12-08T08:16:30.986591+0000","last_became_active":"2023-12-08T08:16:29.998275+0000","last_became_peered":"2023-12-08T08:16:29.998275+0000","last_unstale":"2023-12-08T08:16:30.986591+0000","last_undegraded":"2023-12-08T08:16:30.986591+0000","last_fullsized":"2023-12-08T08:16:30.986591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:02.066542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030993+0000","last_change":"2023-12-08T08:16:29.999599+0000","last_active":"2023-12-08T08:16:31.030993+0000","last_peered":"2023-12-08T08:16:31.030993+0000","last_clean":"2023-12-08T08:16:31.030993+0000","last_became_active":"2023-12-08T08:16:29.998776+0000","last_became_peered":"2023-12-08T08:16:29.998776+0000","last_unstale":"2023-12-08T08:16:31.030993+0000","last_undegraded":"2023-12-08T08:16:31.030993+0000","last_fullsized":"2023-12-08T08:16:31.030993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.026224+0000","last_change":"2023-12-08T08:16:29.998897+0000","last_active":"2023-12-08T08:16:31.026224+0000","last_peered":"2023-12-08T08:16:31.026224+0000","last_clean":"2023-12-08T08:16:31.026224+0000","last_became_active":"2023-12-08T08:16:29.998609+0000","last_became_peered":"2023-12-08T08:16:29.998609+0000","last_unstale":"2023-12-08T08:16:31.026224+0000","last_undegraded":"2023-12-08T08:16:31.026224+0000","last_fullsized":"2023-12-08T08:16:31.026224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:40.747230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031857+0000","last_change":"2023-12-08T08:16:29.991119+0000","last_active":"2023-12-08T08:16:31.031857+0000","last_peered":"2023-12-08T08:16:31.031857+0000","last_clean":"2023-12-08T08:16:31.031857+0000","last_became_active":"2023-12-08T08:16:29.990839+0000","last_became_peered":"2023-12-08T08:16:29.990839+0000","last_unstale":"2023-12-08T08:16:31.031857+0000","last_undegraded":"2023-12-08T08:16:31.031857+0000","last_fullsized":"2023-12-08T08:16:31.031857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029837+0000","last_change":"2023-12-08T08:16:30.020097+0000","last_active":"2023-12-08T08:16:31.029837+0000","last_peered":"2023-12-08T08:16:31.029837+0000","last_clean":"2023-12-08T08:16:31.029837+0000","last_became_active":"2023-12-08T08:16:30.017380+0000","last_became_peered":"2023-12-08T08:16:30.017380+0000","last_unstale":"2023-12-08T08:16:31.029837+0000","last_undegraded":"2023-12-08T08:16:31.029837+0000","last_fullsized":"2023-12-08T08:16:31.029837+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:35.005481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031276+0000","last_change":"2023-12-08T08:16:29.990154+0000","last_active":"2023-12-08T08:16:31.031276+0000","last_peered":"2023-12-08T08:16:31.031276+0000","last_clean":"2023-12-08T08:16:31.031276+0000","last_became_active":"2023-12-08T08:16:29.989050+0000","last_became_peered":"2023-12-08T08:16:29.989050+0000","last_unstale":"2023-12-08T08:16:31.031276+0000","last_undegraded":"2023-12-08T08:16:31.031276+0000","last_fullsized":"2023-12-08T08:16:31.031276+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028549+0000","last_change":"2023-12-08T08:16:30.006811+0000","last_active":"2023-12-08T08:16:31.028549+0000","last_peered":"2023-12-08T08:16:31.028549+0000","last_clean":"2023-12-08T08:16:31.028549+0000","last_became_active":"2023-12-08T08:16:30.006397+0000","last_became_peered":"2023-12-08T08:16:30.006397+0000","last_unstale":"2023-12-08T08:16:31.028549+0000","last_undegraded":"2023-12-08T08:16:31.028549+0000","last_fullsized":"2023-12-08T08:16:31.028549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030487+0000","last_change":"2023-12-08T08:16:29.996114+0000","last_active":"2023-12-08T08:16:31.030487+0000","last_peered":"2023-12-08T08:16:31.030487+0000","last_clean":"2023-12-08T08:16:31.030487+0000","last_became_active":"2023-12-08T08:16:29.995823+0000","last_became_peered":"2023-12-08T08:16:29.995823+0000","last_unstale":"2023-12-08T08:16:31.030487+0000","last_undegraded":"2023-12-08T08:16:31.030487+0000","last_fullsized":"2023-12-08T08:16:31.030487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:24.233820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030560+0000","last_change":"2023-12-08T08:16:29.993060+0000","last_active":"2023-12-08T08:16:31.030560+0000","last_peered":"2023-12-08T08:16:31.030560+0000","last_clean":"2023-12-08T08:16:31.030560+0000","last_became_active":"2023-12-08T08:16:29.992718+0000","last_became_peered":"2023-12-08T08:16:29.992718+0000","last_unstale":"2023-12-08T08:16:31.030560+0000","last_undegraded":"2023-12-08T08:16:31.030560+0000","last_fullsized":"2023-12-08T08:16:31.030560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:29.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031343+0000","last_change":"2023-12-08T08:16:30.000366+0000","last_active":"2023-12-08T08:16:31.031343+0000","last_peered":"2023-12-08T08:16:31.031343+0000","last_clean":"2023-12-08T08:16:31.031343+0000","last_became_active":"2023-12-08T08:16:29.999086+0000","last_became_peered":"2023-12-08T08:16:29.999086+0000","last_unstale":"2023-12-08T08:16:31.031343+0000","last_undegraded":"2023-12-08T08:16:31.031343+0000","last_fullsized":"2023-12-08T08:16:31.031343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027504+0000","last_change":"2023-12-08T08:16:30.001378+0000","last_active":"2023-12-08T08:16:31.027504+0000","last_peered":"2023-12-08T08:16:31.027504+0000","last_clean":"2023-12-08T08:16:31.027504+0000","last_became_active":"2023-12-08T08:16:30.000249+0000","last_became_peered":"2023-12-08T08:16:30.000249+0000","last_unstale":"2023-12-08T08:16:31.027504+0000","last_undegraded":"2023-12-08T08:16:31.027504+0000","last_fullsized":"2023-12-08T08:16:31.027504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:52.117326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032839+0000","last_change":"2023-12-08T08:16:30.018277+0000","last_active":"2023-12-08T08:16:31.032839+0000","last_peered":"2023-12-08T08:16:31.032839+0000","last_clean":"2023-12-08T08:16:31.032839+0000","last_became_active":"2023-12-08T08:16:30.017958+0000","last_became_peered":"2023-12-08T08:16:30.017958+0000","last_unstale":"2023-12-08T08:16:31.032839+0000","last_undegraded":"2023-12-08T08:16:31.032839+0000","last_fullsized":"2023-12-08T08:16:31.032839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031983+0000","last_change":"2023-12-08T08:16:28.972135+0000","last_active":"2023-12-08T08:16:31.031983+0000","last_peered":"2023-12-08T08:16:31.031983+0000","last_clean":"2023-12-08T08:16:31.031983+0000","last_became_active":"2023-12-08T08:16:28.971791+0000","last_became_peered":"2023-12-08T08:16:28.971791+0000","last_unstale":"2023-12-08T08:16:31.031983+0000","last_undegraded":"2023-12-08T08:16:31.031983+0000","last_fullsized":"2023-12-08T08:16:31.031983+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027918+0000","last_change":"2023-12-08T08:16:30.017910+0000","last_active":"2023-12-08T08:16:31.027918+0000","last_peered":"2023-12-08T08:16:31.027918+0000","last_clean":"2023-12-08T08:16:31.027918+0000","last_became_active":"2023-12-08T08:16:30.017619+0000","last_became_peered":"2023-12-08T08:16:30.017619+0000","last_unstale":"2023-12-08T08:16:31.027918+0000","last_undegraded":"2023-12-08T08:16:31.027918+0000","last_fullsized":"2023-12-08T08:16:31.027918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:15.253515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029248+0000","last_change":"2023-12-08T08:16:28.974333+0000","last_active":"2023-12-08T08:16:31.029248+0000","last_peered":"2023-12-08T08:16:31.029248+0000","last_clean":"2023-12-08T08:16:31.029248+0000","last_became_active":"2023-12-08T08:16:28.974049+0000","last_became_peered":"2023-12-08T08:16:28.974049+0000","last_unstale":"2023-12-08T08:16:31.029248+0000","last_undegraded":"2023-12-08T08:16:31.029248+0000","last_fullsized":"2023-12-08T08:16:31.029248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:01.053374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986315+0000","last_change":"2023-12-08T08:16:30.000953+0000","last_active":"2023-12-08T08:16:30.986315+0000","last_peered":"2023-12-08T08:16:30.986315+0000","last_clean":"2023-12-08T08:16:30.986315+0000","last_became_active":"2023-12-08T08:16:30.000673+0000","last_became_peered":"2023-12-08T08:16:30.000673+0000","last_unstale":"2023-12-08T08:16:30.986315+0000","last_undegraded":"2023-12-08T08:16:30.986315+0000","last_fullsized":"2023-12-08T08:16:30.986315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029120+0000","last_change":"2023-12-08T08:16:28.970890+0000","last_active":"2023-12-08T08:16:31.029120+0000","last_peered":"2023-12-08T08:16:31.029120+0000","last_clean":"2023-12-08T08:16:31.029120+0000","last_became_active":"2023-12-08T08:16:28.970617+0000","last_became_peered":"2023-12-08T08:16:28.970617+0000","last_unstale":"2023-12-08T08:16:31.029120+0000","last_undegraded":"2023-12-08T08:16:31.029120+0000","last_fullsized":"2023-12-08T08:16:31.029120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:27.409906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983237+0000","last_change":"2023-12-08T08:16:30.002841+0000","last_active":"2023-12-08T08:16:30.983237+0000","last_peered":"2023-12-08T08:16:30.983237+0000","last_clean":"2023-12-08T08:16:30.983237+0000","last_became_active":"2023-12-08T08:16:30.002371+0000","last_became_peered":"2023-12-08T08:16:30.002371+0000","last_unstale":"2023-12-08T08:16:30.983237+0000","last_undegraded":"2023-12-08T08:16:30.983237+0000","last_fullsized":"2023-12-08T08:16:30.983237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986104+0000","last_change":"2023-12-08T08:16:28.966804+0000","last_active":"2023-12-08T08:16:30.986104+0000","last_peered":"2023-12-08T08:16:30.986104+0000","last_clean":"2023-12-08T08:16:30.986104+0000","last_became_active":"2023-12-08T08:16:28.966500+0000","last_became_peered":"2023-12-08T08:16:28.966500+0000","last_unstale":"2023-12-08T08:16:30.986104+0000","last_undegraded":"2023-12-08T08:16:30.986104+0000","last_fullsized":"2023-12-08T08:16:30.986104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029544+0000","last_change":"2023-12-08T08:16:29.999014+0000","last_active":"2023-12-08T08:16:31.029544+0000","last_peered":"2023-12-08T08:16:31.029544+0000","last_clean":"2023-12-08T08:16:31.029544+0000","last_became_active":"2023-12-08T08:16:29.998706+0000","last_became_peered":"2023-12-08T08:16:29.998706+0000","last_unstale":"2023-12-08T08:16:31.029544+0000","last_undegraded":"2023-12-08T08:16:31.029544+0000","last_fullsized":"2023-12-08T08:16:31.029544+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028339+0000","last_change":"2023-12-08T08:16:28.972751+0000","last_active":"2023-12-08T08:16:31.028339+0000","last_peered":"2023-12-08T08:16:31.028339+0000","last_clean":"2023-12-08T08:16:31.028339+0000","last_became_active":"2023-12-08T08:16:28.971599+0000","last_became_peered":"2023-12-08T08:16:28.971599+0000","last_unstale":"2023-12-08T08:16:31.028339+0000","last_undegraded":"2023-12-08T08:16:31.028339+0000","last_fullsized":"2023-12-08T08:16:31.028339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028938+0000","last_change":"2023-12-08T08:16:30.005902+0000","last_active":"2023-12-08T08:16:31.028938+0000","last_peered":"2023-12-08T08:16:31.028938+0000","last_clean":"2023-12-08T08:16:31.028938+0000","last_became_active":"2023-12-08T08:16:30.005581+0000","last_became_peered":"2023-12-08T08:16:30.005581+0000","last_unstale":"2023-12-08T08:16:31.028938+0000","last_undegraded":"2023-12-08T08:16:31.028938+0000","last_fullsized":"2023-12-08T08:16:31.028938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032365+0000","last_change":"2023-12-08T08:16:28.980410+0000","last_active":"2023-12-08T08:16:31.032365+0000","last_peered":"2023-12-08T08:16:31.032365+0000","last_clean":"2023-12-08T08:16:31.032365+0000","last_became_active":"2023-12-08T08:16:28.980037+0000","last_became_peered":"2023-12-08T08:16:28.980037+0000","last_unstale":"2023-12-08T08:16:31.032365+0000","last_undegraded":"2023-12-08T08:16:31.032365+0000","last_fullsized":"2023-12-08T08:16:31.032365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:00.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986606+0000","last_change":"2023-12-08T08:16:30.012886+0000","last_active":"2023-12-08T08:16:30.986606+0000","last_peered":"2023-12-08T08:16:30.986606+0000","last_clean":"2023-12-08T08:16:30.986606+0000","last_became_active":"2023-12-08T08:16:30.012578+0000","last_became_peered":"2023-12-08T08:16:30.012578+0000","last_unstale":"2023-12-08T08:16:30.986606+0000","last_undegraded":"2023-12-08T08:16:30.986606+0000","last_fullsized":"2023-12-08T08:16:30.986606+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027786+0000","last_change":"2023-12-08T08:16:28.966099+0000","last_active":"2023-12-08T08:16:31.027786+0000","last_peered":"2023-12-08T08:16:31.027786+0000","last_clean":"2023-12-08T08:16:31.027786+0000","last_became_active":"2023-12-08T08:16:28.965830+0000","last_became_peered":"2023-12-08T08:16:28.965830+0000","last_unstale":"2023-12-08T08:16:31.027786+0000","last_undegraded":"2023-12-08T08:16:31.027786+0000","last_fullsized":"2023-12-08T08:16:31.027786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.868360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982736+0000","last_change":"2023-12-08T08:16:30.004935+0000","last_active":"2023-12-08T08:16:30.982736+0000","last_peered":"2023-12-08T08:16:30.982736+0000","last_clean":"2023-12-08T08:16:30.982736+0000","last_became_active":"2023-12-08T08:16:30.004484+0000","last_became_peered":"2023-12-08T08:16:30.004484+0000","last_unstale":"2023-12-08T08:16:30.982736+0000","last_undegraded":"2023-12-08T08:16:30.982736+0000","last_fullsized":"2023-12-08T08:16:30.982736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.985470+0000","last_change":"2023-12-08T08:16:28.970395+0000","last_active":"2023-12-08T08:16:30.985470+0000","last_peered":"2023-12-08T08:16:30.985470+0000","last_clean":"2023-12-08T08:16:30.985470+0000","last_became_active":"2023-12-08T08:16:28.969828+0000","last_became_peered":"2023-12-08T08:16:28.969828+0000","last_unstale":"2023-12-08T08:16:30.985470+0000","last_undegraded":"2023-12-08T08:16:30.985470+0000","last_fullsized":"2023-12-08T08:16:30.985470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029359+0000","last_change":"2023-12-08T08:16:29.996118+0000","last_active":"2023-12-08T08:16:31.029359+0000","last_peered":"2023-12-08T08:16:31.029359+0000","last_clean":"2023-12-08T08:16:31.029359+0000","last_became_active":"2023-12-08T08:16:29.995815+0000","last_became_peered":"2023-12-08T08:16:29.995815+0000","last_unstale":"2023-12-08T08:16:31.029359+0000","last_undegraded":"2023-12-08T08:16:31.029359+0000","last_fullsized":"2023-12-08T08:16:31.029359+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:14.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983302+0000","last_change":"2023-12-08T08:16:28.970249+0000","last_active":"2023-12-08T08:16:30.983302+0000","last_peered":"2023-12-08T08:16:30.983302+0000","last_clean":"2023-12-08T08:16:30.983302+0000","last_became_active":"2023-12-08T08:16:28.969959+0000","last_became_peered":"2023-12-08T08:16:28.969959+0000","last_unstale":"2023-12-08T08:16:30.983302+0000","last_undegraded":"2023-12-08T08:16:30.983302+0000","last_fullsized":"2023-12-08T08:16:30.983302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030993+0000","last_change":"2023-12-08T08:16:30.011144+0000","last_active":"2023-12-08T08:16:31.030993+0000","last_peered":"2023-12-08T08:16:31.030993+0000","last_clean":"2023-12-08T08:16:31.030993+0000","last_became_active":"2023-12-08T08:16:30.010821+0000","last_became_peered":"2023-12-08T08:16:30.010821+0000","last_unstale":"2023-12-08T08:16:31.030993+0000","last_undegraded":"2023-12-08T08:16:31.030993+0000","last_fullsized":"2023-12-08T08:16:31.030993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028935+0000","last_change":"2023-12-08T08:16:28.972703+0000","last_active":"2023-12-08T08:16:31.028935+0000","last_peered":"2023-12-08T08:16:31.028935+0000","last_clean":"2023-12-08T08:16:31.028935+0000","last_became_active":"2023-12-08T08:16:28.972337+0000","last_became_peered":"2023-12-08T08:16:28.972337+0000","last_unstale":"2023-12-08T08:16:31.028935+0000","last_undegraded":"2023-12-08T08:16:31.028935+0000","last_fullsized":"2023-12-08T08:16:31.028935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028960+0000","last_change":"2023-12-08T08:16:30.002548+0000","last_active":"2023-12-08T08:16:31.028960+0000","last_peered":"2023-12-08T08:16:31.028960+0000","last_clean":"2023-12-08T08:16:31.028960+0000","last_became_active":"2023-12-08T08:16:30.002266+0000","last_became_peered":"2023-12-08T08:16:30.002266+0000","last_unstale":"2023-12-08T08:16:31.028960+0000","last_undegraded":"2023-12-08T08:16:31.028960+0000","last_fullsized":"2023-12-08T08:16:31.028960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:12.090220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031103+0000","last_change":"2023-12-08T08:16:28.974757+0000","last_active":"2023-12-08T08:16:31.031103+0000","last_peered":"2023-12-08T08:16:31.031103+0000","last_clean":"2023-12-08T08:16:31.031103+0000","last_became_active":"2023-12-08T08:16:28.974470+0000","last_became_peered":"2023-12-08T08:16:28.974470+0000","last_unstale":"2023-12-08T08:16:31.031103+0000","last_undegraded":"2023-12-08T08:16:31.031103+0000","last_fullsized":"2023-12-08T08:16:31.031103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:07.487090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986357+0000","last_change":"2023-12-08T08:16:30.000962+0000","last_active":"2023-12-08T08:16:30.986357+0000","last_peered":"2023-12-08T08:16:30.986357+0000","last_clean":"2023-12-08T08:16:30.986357+0000","last_became_active":"2023-12-08T08:16:29.999415+0000","last_became_peered":"2023-12-08T08:16:29.999415+0000","last_unstale":"2023-12-08T08:16:30.986357+0000","last_undegraded":"2023-12-08T08:16:30.986357+0000","last_fullsized":"2023-12-08T08:16:30.986357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:52.760726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983048+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:30.983048+0000","last_peered":"2023-12-08T08:16:30.983048+0000","last_clean":"2023-12-08T08:16:30.983048+0000","last_became_active":"2023-12-08T08:16:28.974334+0000","last_became_peered":"2023-12-08T08:16:28.974334+0000","last_unstale":"2023-12-08T08:16:30.983048+0000","last_undegraded":"2023-12-08T08:16:30.983048+0000","last_fullsized":"2023-12-08T08:16:30.983048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029133+0000","last_change":"2023-12-08T08:16:30.009858+0000","last_active":"2023-12-08T08:16:31.029133+0000","last_peered":"2023-12-08T08:16:31.029133+0000","last_clean":"2023-12-08T08:16:31.029133+0000","last_became_active":"2023-12-08T08:16:30.009477+0000","last_became_peered":"2023-12-08T08:16:30.009477+0000","last_unstale":"2023-12-08T08:16:31.029133+0000","last_undegraded":"2023-12-08T08:16:31.029133+0000","last_fullsized":"2023-12-08T08:16:31.029133+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982897+0000","last_change":"2023-12-08T08:16:28.975330+0000","last_active":"2023-12-08T08:16:30.982897+0000","last_peered":"2023-12-08T08:16:30.982897+0000","last_clean":"2023-12-08T08:16:30.982897+0000","last_became_active":"2023-12-08T08:16:28.974952+0000","last_became_peered":"2023-12-08T08:16:28.974952+0000","last_unstale":"2023-12-08T08:16:30.982897+0000","last_undegraded":"2023-12-08T08:16:30.982897+0000","last_fullsized":"2023-12-08T08:16:30.982897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982675+0000","last_change":"2023-12-08T08:16:29.998148+0000","last_active":"2023-12-08T08:16:30.982675+0000","last_peered":"2023-12-08T08:16:30.982675+0000","last_clean":"2023-12-08T08:16:30.982675+0000","last_became_active":"2023-12-08T08:16:29.997889+0000","last_became_peered":"2023-12-08T08:16:29.997889+0000","last_unstale":"2023-12-08T08:16:30.982675+0000","last_undegraded":"2023-12-08T08:16:30.982675+0000","last_fullsized":"2023-12-08T08:16:30.982675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027441+0000","last_change":"2023-12-08T08:16:28.965346+0000","last_active":"2023-12-08T08:16:31.027441+0000","last_peered":"2023-12-08T08:16:31.027441+0000","last_clean":"2023-12-08T08:16:31.027441+0000","last_became_active":"2023-12-08T08:16:28.965039+0000","last_became_peered":"2023-12-08T08:16:28.965039+0000","last_unstale":"2023-12-08T08:16:31.027441+0000","last_undegraded":"2023-12-08T08:16:31.027441+0000","last_fullsized":"2023-12-08T08:16:31.027441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:36:27.005922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032241+0000","last_change":"2023-12-08T08:16:30.004598+0000","last_active":"2023-12-08T08:16:31.032241+0000","last_peered":"2023-12-08T08:16:31.032241+0000","last_clean":"2023-12-08T08:16:31.032241+0000","last_became_active":"2023-12-08T08:16:30.004063+0000","last_became_peered":"2023-12-08T08:16:30.004063+0000","last_unstale":"2023-12-08T08:16:31.032241+0000","last_undegraded":"2023-12-08T08:16:31.032241+0000","last_fullsized":"2023-12-08T08:16:31.032241+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029904+0000","last_change":"2023-12-08T08:16:28.978542+0000","last_active":"2023-12-08T08:16:31.029904+0000","last_peered":"2023-12-08T08:16:31.029904+0000","last_clean":"2023-12-08T08:16:31.029904+0000","last_became_active":"2023-12-08T08:16:28.977515+0000","last_became_peered":"2023-12-08T08:16:28.977515+0000","last_unstale":"2023-12-08T08:16:31.029904+0000","last_undegraded":"2023-12-08T08:16:31.029904+0000","last_fullsized":"2023-12-08T08:16:31.029904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:17.021805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982887+0000","last_change":"2023-12-08T08:16:29.999746+0000","last_active":"2023-12-08T08:16:30.982887+0000","last_peered":"2023-12-08T08:16:30.982887+0000","last_clean":"2023-12-08T08:16:30.982887+0000","last_became_active":"2023-12-08T08:16:29.999490+0000","last_became_peered":"2023-12-08T08:16:29.999490+0000","last_unstale":"2023-12-08T08:16:30.982887+0000","last_undegraded":"2023-12-08T08:16:30.982887+0000","last_fullsized":"2023-12-08T08:16:30.982887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030051+0000","last_change":"2023-12-08T08:16:28.980456+0000","last_active":"2023-12-08T08:16:31.030051+0000","last_peered":"2023-12-08T08:16:31.030051+0000","last_clean":"2023-12-08T08:16:31.030051+0000","last_became_active":"2023-12-08T08:16:28.980144+0000","last_became_peered":"2023-12-08T08:16:28.980144+0000","last_unstale":"2023-12-08T08:16:31.030051+0000","last_undegraded":"2023-12-08T08:16:31.030051+0000","last_fullsized":"2023-12-08T08:16:31.030051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982931+0000","last_change":"2023-12-08T08:16:29.997495+0000","last_active":"2023-12-08T08:16:30.982931+0000","last_peered":"2023-12-08T08:16:30.982931+0000","last_clean":"2023-12-08T08:16:30.982931+0000","last_became_active":"2023-12-08T08:16:29.997224+0000","last_became_peered":"2023-12-08T08:16:29.997224+0000","last_unstale":"2023-12-08T08:16:30.982931+0000","last_undegraded":"2023-12-08T08:16:30.982931+0000","last_fullsized":"2023-12-08T08:16:30.982931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028886+0000","last_change":"2023-12-08T08:16:28.975373+0000","last_active":"2023-12-08T08:16:31.028886+0000","last_peered":"2023-12-08T08:16:31.028886+0000","last_clean":"2023-12-08T08:16:31.028886+0000","last_became_active":"2023-12-08T08:16:28.974985+0000","last_became_peered":"2023-12-08T08:16:28.974985+0000","last_unstale":"2023-12-08T08:16:31.028886+0000","last_undegraded":"2023-12-08T08:16:31.028886+0000","last_fullsized":"2023-12-08T08:16:31.028886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031500+0000","last_change":"2023-12-08T08:16:30.002534+0000","last_active":"2023-12-08T08:16:31.031500+0000","last_peered":"2023-12-08T08:16:31.031500+0000","last_clean":"2023-12-08T08:16:31.031500+0000","last_became_active":"2023-12-08T08:16:30.001495+0000","last_became_peered":"2023-12-08T08:16:30.001495+0000","last_unstale":"2023-12-08T08:16:31.031500+0000","last_undegraded":"2023-12-08T08:16:31.031500+0000","last_fullsized":"2023-12-08T08:16:31.031500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:52.176838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986482+0000","last_change":"2023-12-08T08:16:28.978336+0000","last_active":"2023-12-08T08:16:30.986482+0000","last_peered":"2023-12-08T08:16:30.986482+0000","last_clean":"2023-12-08T08:16:30.986482+0000","last_became_active":"2023-12-08T08:16:28.977153+0000","last_became_peered":"2023-12-08T08:16:28.977153+0000","last_unstale":"2023-12-08T08:16:30.986482+0000","last_undegraded":"2023-12-08T08:16:30.986482+0000","last_fullsized":"2023-12-08T08:16:30.986482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986298+0000","last_change":"2023-12-08T08:16:30.003307+0000","last_active":"2023-12-08T08:16:30.986298+0000","last_peered":"2023-12-08T08:16:30.986298+0000","last_clean":"2023-12-08T08:16:30.986298+0000","last_became_active":"2023-12-08T08:16:30.002242+0000","last_became_peered":"2023-12-08T08:16:30.002242+0000","last_unstale":"2023-12-08T08:16:30.986298+0000","last_undegraded":"2023-12-08T08:16:30.986298+0000","last_fullsized":"2023-12-08T08:16:30.986298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029930+0000","last_change":"2023-12-08T08:16:28.971697+0000","last_active":"2023-12-08T08:16:31.029930+0000","last_peered":"2023-12-08T08:16:31.029930+0000","last_clean":"2023-12-08T08:16:31.029930+0000","last_became_active":"2023-12-08T08:16:28.971403+0000","last_became_peered":"2023-12-08T08:16:28.971403+0000","last_unstale":"2023-12-08T08:16:31.029930+0000","last_undegraded":"2023-12-08T08:16:31.029930+0000","last_fullsized":"2023-12-08T08:16:31.029930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:55:26.868497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029902+0000","last_change":"2023-12-08T08:16:30.004120+0000","last_active":"2023-12-08T08:16:31.029902+0000","last_peered":"2023-12-08T08:16:31.029902+0000","last_clean":"2023-12-08T08:16:31.029902+0000","last_became_active":"2023-12-08T08:16:30.003839+0000","last_became_peered":"2023-12-08T08:16:30.003839+0000","last_unstale":"2023-12-08T08:16:31.029902+0000","last_undegraded":"2023-12-08T08:16:31.029902+0000","last_fullsized":"2023-12-08T08:16:31.029902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:24:40.270711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027294+0000","last_change":"2023-12-08T08:16:28.972924+0000","last_active":"2023-12-08T08:16:31.027294+0000","last_peered":"2023-12-08T08:16:31.027294+0000","last_clean":"2023-12-08T08:16:31.027294+0000","last_became_active":"2023-12-08T08:16:28.971768+0000","last_became_peered":"2023-12-08T08:16:28.971768+0000","last_unstale":"2023-12-08T08:16:31.027294+0000","last_undegraded":"2023-12-08T08:16:31.027294+0000","last_fullsized":"2023-12-08T08:16:31.027294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.012974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030247+0000","last_change":"2023-12-08T08:16:30.008721+0000","last_active":"2023-12-08T08:16:31.030247+0000","last_peered":"2023-12-08T08:16:31.030247+0000","last_clean":"2023-12-08T08:16:31.030247+0000","last_became_active":"2023-12-08T08:16:30.007946+0000","last_became_peered":"2023-12-08T08:16:30.007946+0000","last_unstale":"2023-12-08T08:16:31.030247+0000","last_undegraded":"2023-12-08T08:16:31.030247+0000","last_fullsized":"2023-12-08T08:16:31.030247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028287+0000","last_change":"2023-12-08T08:16:28.964831+0000","last_active":"2023-12-08T08:16:31.028287+0000","last_peered":"2023-12-08T08:16:31.028287+0000","last_clean":"2023-12-08T08:16:31.028287+0000","last_became_active":"2023-12-08T08:16:28.964526+0000","last_became_peered":"2023-12-08T08:16:28.964526+0000","last_unstale":"2023-12-08T08:16:31.028287+0000","last_undegraded":"2023-12-08T08:16:31.028287+0000","last_fullsized":"2023-12-08T08:16:31.028287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:28.711499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028471+0000","last_change":"2023-12-08T08:16:30.007994+0000","last_active":"2023-12-08T08:16:31.028471+0000","last_peered":"2023-12-08T08:16:31.028471+0000","last_clean":"2023-12-08T08:16:31.028471+0000","last_became_active":"2023-12-08T08:16:30.006242+0000","last_became_peered":"2023-12-08T08:16:30.006242+0000","last_unstale":"2023-12-08T08:16:31.028471+0000","last_undegraded":"2023-12-08T08:16:31.028471+0000","last_fullsized":"2023-12-08T08:16:31.028471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:31.687770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028144+0000","last_change":"2023-12-08T08:16:28.967837+0000","last_active":"2023-12-08T08:16:31.028144+0000","last_peered":"2023-12-08T08:16:31.028144+0000","last_clean":"2023-12-08T08:16:31.028144+0000","last_became_active":"2023-12-08T08:16:28.967450+0000","last_became_peered":"2023-12-08T08:16:28.967450+0000","last_unstale":"2023-12-08T08:16:31.028144+0000","last_undegraded":"2023-12-08T08:16:31.028144+0000","last_fullsized":"2023-12-08T08:16:31.028144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:00.811457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028859+0000","last_change":"2023-12-08T08:16:29.994820+0000","last_active":"2023-12-08T08:16:31.028859+0000","last_peered":"2023-12-08T08:16:31.028859+0000","last_clean":"2023-12-08T08:16:31.028859+0000","last_became_active":"2023-12-08T08:16:29.994544+0000","last_became_peered":"2023-12-08T08:16:29.994544+0000","last_unstale":"2023-12-08T08:16:31.028859+0000","last_undegraded":"2023-12-08T08:16:31.028859+0000","last_fullsized":"2023-12-08T08:16:31.028859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031510+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:31.031510+0000","last_peered":"2023-12-08T08:16:31.031510+0000","last_clean":"2023-12-08T08:16:31.031510+0000","last_became_active":"2023-12-08T08:16:28.974336+0000","last_became_peered":"2023-12-08T08:16:28.974336+0000","last_unstale":"2023-12-08T08:16:31.031510+0000","last_undegraded":"2023-12-08T08:16:31.031510+0000","last_fullsized":"2023-12-08T08:16:31.031510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982774+0000","last_change":"2023-12-08T08:16:30.000662+0000","last_active":"2023-12-08T08:16:30.982774+0000","last_peered":"2023-12-08T08:16:30.982774+0000","last_clean":"2023-12-08T08:16:30.982774+0000","last_became_active":"2023-12-08T08:16:30.000315+0000","last_became_peered":"2023-12-08T08:16:30.000315+0000","last_unstale":"2023-12-08T08:16:30.982774+0000","last_undegraded":"2023-12-08T08:16:30.982774+0000","last_fullsized":"2023-12-08T08:16:30.982774+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.026130+0000","last_change":"2023-12-08T08:16:28.965034+0000","last_active":"2023-12-08T08:16:31.026130+0000","last_peered":"2023-12-08T08:16:31.026130+0000","last_clean":"2023-12-08T08:16:31.026130+0000","last_became_active":"2023-12-08T08:16:28.964719+0000","last_became_peered":"2023-12-08T08:16:28.964719+0000","last_unstale":"2023-12-08T08:16:31.026130+0000","last_undegraded":"2023-12-08T08:16:31.026130+0000","last_fullsized":"2023-12-08T08:16:31.026130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:49.109342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027173+0000","last_change":"2023-12-08T08:16:30.019492+0000","last_active":"2023-12-08T08:16:31.027173+0000","last_peered":"2023-12-08T08:16:31.027173+0000","last_clean":"2023-12-08T08:16:31.027173+0000","last_became_active":"2023-12-08T08:16:30.019182+0000","last_became_peered":"2023-12-08T08:16:30.019182+0000","last_unstale":"2023-12-08T08:16:31.027173+0000","last_undegraded":"2023-12-08T08:16:31.027173+0000","last_fullsized":"2023-12-08T08:16:31.027173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:32:53.506356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031225+0000","last_change":"2023-12-08T08:16:28.975323+0000","last_active":"2023-12-08T08:16:31.031225+0000","last_peered":"2023-12-08T08:16:31.031225+0000","last_clean":"2023-12-08T08:16:31.031225+0000","last_became_active":"2023-12-08T08:16:28.974944+0000","last_became_peered":"2023-12-08T08:16:28.974944+0000","last_unstale":"2023-12-08T08:16:31.031225+0000","last_undegraded":"2023-12-08T08:16:31.031225+0000","last_fullsized":"2023-12-08T08:16:31.031225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.031346+0000","last_change":"2023-12-08T08:16:30.016409+0000","last_active":"2023-12-08T08:16:31.031346+0000","last_peered":"2023-12-08T08:16:31.031346+0000","last_clean":"2023-12-08T08:16:31.031346+0000","last_became_active":"2023-12-08T08:16:30.016111+0000","last_became_peered":"2023-12-08T08:16:30.016111+0000","last_unstale":"2023-12-08T08:16:31.031346+0000","last_undegraded":"2023-12-08T08:16:31.031346+0000","last_fullsized":"2023-12-08T08:16:31.031346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.154037+0000","last_change":"2023-12-08T08:16:28.973691+0000","last_active":"2023-12-08T08:16:31.154037+0000","last_peered":"2023-12-08T08:16:31.154037+0000","last_clean":"2023-12-08T08:16:31.154037+0000","last_became_active":"2023-12-08T08:16:28.973374+0000","last_became_peered":"2023-12-08T08:16:28.973374+0000","last_unstale":"2023-12-08T08:16:31.154037+0000","last_undegraded":"2023-12-08T08:16:31.154037+0000","last_fullsized":"2023-12-08T08:16:31.154037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:16.503221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.983149+0000","last_change":"2023-12-08T08:16:30.004996+0000","last_active":"2023-12-08T08:16:30.983149+0000","last_peered":"2023-12-08T08:16:30.983149+0000","last_clean":"2023-12-08T08:16:30.983149+0000","last_became_active":"2023-12-08T08:16:30.004414+0000","last_became_peered":"2023-12-08T08:16:30.004414+0000","last_unstale":"2023-12-08T08:16:30.983149+0000","last_undegraded":"2023-12-08T08:16:30.983149+0000","last_fullsized":"2023-12-08T08:16:30.983149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028510+0000","last_change":"2023-12-08T08:16:28.976308+0000","last_active":"2023-12-08T08:16:31.028510+0000","last_peered":"2023-12-08T08:16:31.028510+0000","last_clean":"2023-12-08T08:16:31.028510+0000","last_became_active":"2023-12-08T08:16:28.974927+0000","last_became_peered":"2023-12-08T08:16:28.974927+0000","last_unstale":"2023-12-08T08:16:31.028510+0000","last_undegraded":"2023-12-08T08:16:31.028510+0000","last_fullsized":"2023-12-08T08:16:31.028510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029317+0000","last_change":"2023-12-08T08:16:30.013944+0000","last_active":"2023-12-08T08:16:31.029317+0000","last_peered":"2023-12-08T08:16:31.029317+0000","last_clean":"2023-12-08T08:16:31.029317+0000","last_became_active":"2023-12-08T08:16:30.013655+0000","last_became_peered":"2023-12-08T08:16:30.013655+0000","last_unstale":"2023-12-08T08:16:31.029317+0000","last_undegraded":"2023-12-08T08:16:31.029317+0000","last_fullsized":"2023-12-08T08:16:31.029317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.028949+0000","last_change":"2023-12-08T08:16:28.977478+0000","last_active":"2023-12-08T08:16:31.028949+0000","last_peered":"2023-12-08T08:16:31.028949+0000","last_clean":"2023-12-08T08:16:31.028949+0000","last_became_active":"2023-12-08T08:16:28.976902+0000","last_became_peered":"2023-12-08T08:16:28.976902+0000","last_unstale":"2023-12-08T08:16:31.028949+0000","last_undegraded":"2023-12-08T08:16:31.028949+0000","last_fullsized":"2023-12-08T08:16:31.028949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.027541+0000","last_change":"2023-12-08T08:16:30.000645+0000","last_active":"2023-12-08T08:16:31.027541+0000","last_peered":"2023-12-08T08:16:31.027541+0000","last_clean":"2023-12-08T08:16:31.027541+0000","last_became_active":"2023-12-08T08:16:30.000349+0000","last_became_peered":"2023-12-08T08:16:30.000349+0000","last_unstale":"2023-12-08T08:16:31.027541+0000","last_undegraded":"2023-12-08T08:16:31.027541+0000","last_fullsized":"2023-12-08T08:16:31.027541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:07:53.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.030782+0000","last_change":"2023-12-08T08:16:28.969401+0000","last_active":"2023-12-08T08:16:31.030782+0000","last_peered":"2023-12-08T08:16:31.030782+0000","last_clean":"2023-12-08T08:16:31.030782+0000","last_became_active":"2023-12-08T08:16:28.968937+0000","last_became_peered":"2023-12-08T08:16:28.968937+0000","last_unstale":"2023-12-08T08:16:31.030782+0000","last_undegraded":"2023-12-08T08:16:31.030782+0000","last_fullsized":"2023-12-08T08:16:31.030782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.986240+0000","last_change":"2023-12-08T08:16:30.001694+0000","last_active":"2023-12-08T08:16:30.986240+0000","last_peered":"2023-12-08T08:16:30.986240+0000","last_clean":"2023-12-08T08:16:30.986240+0000","last_became_active":"2023-12-08T08:16:30.001411+0000","last_became_peered":"2023-12-08T08:16:30.001411+0000","last_unstale":"2023-12-08T08:16:30.986240+0000","last_undegraded":"2023-12-08T08:16:30.986240+0000","last_fullsized":"2023-12-08T08:16:30.986240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.985672+0000","last_change":"2023-12-08T08:16:28.964871+0000","last_active":"2023-12-08T08:16:30.985672+0000","last_peered":"2023-12-08T08:16:30.985672+0000","last_clean":"2023-12-08T08:16:30.985672+0000","last_became_active":"2023-12-08T08:16:28.964469+0000","last_became_peered":"2023-12-08T08:16:28.964469+0000","last_unstale":"2023-12-08T08:16:30.985672+0000","last_undegraded":"2023-12-08T08:16:30.985672+0000","last_fullsized":"2023-12-08T08:16:30.985672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:49.019319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032792+0000","last_change":"2023-12-08T08:16:30.009647+0000","last_active":"2023-12-08T08:16:31.032792+0000","last_peered":"2023-12-08T08:16:31.032792+0000","last_clean":"2023-12-08T08:16:31.032792+0000","last_became_active":"2023-12-08T08:16:30.009174+0000","last_became_peered":"2023-12-08T08:16:30.009174+0000","last_unstale":"2023-12-08T08:16:31.032792+0000","last_undegraded":"2023-12-08T08:16:31.032792+0000","last_fullsized":"2023-12-08T08:16:31.032792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:30.982552+0000","last_change":"2023-12-08T08:16:28.969690+0000","last_active":"2023-12-08T08:16:30.982552+0000","last_peered":"2023-12-08T08:16:30.982552+0000","last_clean":"2023-12-08T08:16:30.982552+0000","last_became_active":"2023-12-08T08:16:28.969355+0000","last_became_peered":"2023-12-08T08:16:28.969355+0000","last_unstale":"2023-12-08T08:16:30.982552+0000","last_undegraded":"2023-12-08T08:16:30.982552+0000","last_fullsized":"2023-12-08T08:16:30.982552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:52.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.029722+0000","last_change":"2023-12-08T08:16:30.013379+0000","last_active":"2023-12-08T08:16:31.029722+0000","last_peered":"2023-12-08T08:16:31.029722+0000","last_clean":"2023-12-08T08:16:31.029722+0000","last_became_active":"2023-12-08T08:16:30.013056+0000","last_became_peered":"2023-12-08T08:16:30.013056+0000","last_unstale":"2023-12-08T08:16:31.029722+0000","last_undegraded":"2023-12-08T08:16:31.029722+0000","last_fullsized":"2023-12-08T08:16:31.029722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-08T08:16:31.032934+0000","last_change":"2023-12-08T08:16:28.977566+0000","last_active":"2023-12-08T08:16:31.032934+0000","last_peered":"2023-12-08T08:16:31.032934+0000","last_clean":"2023-12-08T08:16:31.032934+0000","last_became_active":"2023-12-08T08:16:28.976769+0000","last_became_peered":"2023-12-08T08:16:28.976769+0000","last_unstale":"2023-12-08T08:16:31.032934+0000","last_undegraded":"2023-12-08T08:16:31.032934+0000","last_fullsized":"2023-12-08T08:16:31.032934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-08T08:16:29.997283+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:16:29.997283+0000","last_peered":"2023-12-08T08:16:29.997283+0000","last_clean":"2023-12-08T08:16:29.997283+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:16:29.997283+0000","last_undegraded":"2023-12-08T08:16:29.997283+0000","last_fullsized":"2023-12-08T08:16:29.997283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1069056,"data_stored":788508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.165}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.2649999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.389},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":1.4359999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.361},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.754}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6779999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.581}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":197040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":19.065999999999999,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":19.364999999999998,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.075}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.351}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5680000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.28}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.393},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.7809999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.665},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.625}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.627}]},{"osd":1,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.4359999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.167}]},{"osd":3,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.379},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.2949999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.337},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.7110000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":1.5449999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.804},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.47}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":197062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.626},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.53200000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":1.296,"5min":1.296,"15min":1.296},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.5}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":475136,"data_stored":198104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.0429999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.234},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.3600000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.117},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.587},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.496}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6699999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":462848,"data_stored":196528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.75},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.4399999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.135}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.643}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.607},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.351}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":462848,"data_stored":196548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.67800000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":786860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.96799999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.75}]},{"osd":3,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.8480000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.462}]},{"osd":5,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.544},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.593}]},{"osd":6,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.696},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.49}]},{"osd":7,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.6559999999999997,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.667}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:16:35.023 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:16:35.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:16:35.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.296+0000 7f4f9359e640 1 Processor -- start 2023-12-08T08:16:35.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.296+0000 7f4f9359e640 1 -- start start 2023-12-08T08:16:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f940c5c10 0x7f4f940c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f9406af10 0x7f4f94154db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f940c4490 0x7f4f941517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9406c3a0 con 0x7f4f940c5c10 2023-12-08T08:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940c53a0 con 0x7f4f9406af10 2023-12-08T08:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c7f50 con 0x7f4f940c4490 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f940c5c10 0x7f4f940c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f940c5c10 0x7f4f940c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47874/0 (socket says 172.21.15.45:47874) 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.298+0000 7f4f9259c640 1 -- 172.21.15.45:0/285866802 learned_addr learned my addr 172.21.15.45:0/285866802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f92d9d640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f940c4490 0x7f4f941517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f91d9b640 1 --2- 172.21.15.45:0/285866802 >> v2:172.21.15.114:3300/0 conn(0x7f4f9406af10 0x7f4f94154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f9259c640 1 -- 172.21.15.45:0/285866802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f940c4490 msgr2=0x7f4f941517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f9259c640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f940c4490 0x7f4f941517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f9259c640 1 -- 172.21.15.45:0/285866802 >> v2:172.21.15.114:3300/0 conn(0x7f4f9406af10 msgr2=0x7f4f94154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f9259c640 1 --2- 172.21.15.45:0/285866802 >> v2:172.21.15.114:3300/0 conn(0x7f4f9406af10 0x7f4f94154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.299+0000 7f4f9259c640 1 -- 172.21.15.45:0/285866802 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940c4de0 con 0x7f4f940c5c10 2023-12-08T08:16:35.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.301+0000 7f4f9259c640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c5c10 0x7f4f940c7a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4f9408b760 tx=0x7f4f8402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6052196cdabf89e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.301+0000 7f4f9159a640 1 -- 172.21.15.45:0/285866802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840317e0 con 0x7f4f940c5c10 2023-12-08T08:16:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.301+0000 7f4f9159a640 1 -- 172.21.15.45:0/285866802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84031940 con 0x7f4f940c5c10 2023-12-08T08:16:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.301+0000 7f4f9159a640 1 -- 172.21.15.45:0/285866802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84031cd0 con 0x7f4f940c5c10 2023-12-08T08:16:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 -- 172.21.15.45:0/285866802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c5c10 msgr2=0x7f4f940c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c5c10 0x7f4f940c7a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4f9408b760 tx=0x7f4f8402b880 comp rx=0 tx=0).stop 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 -- 172.21.15.45:0/285866802 shutdown_connections 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 --2- 172.21.15.45:0/285866802 >> v2:172.21.15.114:3300/0 conn(0x7f4f9406af10 0x7f4f94154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f940c4490 0x7f4f941517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 --2- 172.21.15.45:0/285866802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c5c10 0x7f4f940c7a10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 -- 172.21.15.45:0/285866802 >> 172.21.15.45:0/285866802 conn(0x7f4f940c9b10 msgr2=0x7f4f940c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 -- 172.21.15.45:0/285866802 shutdown_connections 2023-12-08T08:16:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.302+0000 7f4f9359e640 1 -- 172.21.15.45:0/285866802 wait complete. 2023-12-08T08:16:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.304+0000 7f4f9359e640 1 Processor -- start 2023-12-08T08:16:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.304+0000 7f4f9359e640 1 -- start start 2023-12-08T08:16:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f9406af10 0x7f4f941e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 0x7f4f94156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94156fd0 con 0x7f4f940c4490 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940bd6e0 con 0x7f4f940c5c10 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c05a0 con 0x7f4f9406af10 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f91d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f91d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47880/0 (socket says 172.21.15.45:47880) 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f91d9b640 1 -- 172.21.15.45:0/3165435036 learned_addr learned my addr 172.21.15.45:0/3165435036 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.305+0000 7f4f9259c640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f9406af10 0x7f4f941e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f92d9d640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 0x7f4f94156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 -- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f9406af10 msgr2=0x7f4f941e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f9406af10 0x7f4f941e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 -- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 msgr2=0x7f4f94156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 0x7f4f94156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 -- 172.21.15.45:0/3165435036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840094d0 con 0x7f4f940c4490 2023-12-08T08:16:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f92d9d640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 0x7f4f94156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f91d9b640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d800 tx=0x7f4f8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.306+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800b6c0 con 0x7f4f940c4490 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.307+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800b820 con 0x7f4f940c4490 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.307+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800bbb0 con 0x7f4f940c4490 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.307+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f940bd950 con 0x7f4f940c4490 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.307+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f941503b0 con 0x7f4f940c4490 2023-12-08T08:16:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.308+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94155270 con 0x7f4f940c4490 2023-12-08T08:16:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.309+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f8800bd10 con 0x7f4f940c4490 2023-12-08T08:16:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.310+0000 7f4f82ffd640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 0x7f4f7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.310+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f88089c60 con 0x7f4f940c4490 2023-12-08T08:16:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.310+0000 7f4f9259c640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 0x7f4f7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.311+0000 7f4f9259c640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 0x7f4f7406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f84036000 tx=0x7f4f8403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.314+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f88054c60 con 0x7f4f940c4490 2023-12-08T08:16:35.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.576+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4f940743e0 con 0x7f4f940c4490 2023-12-08T08:16:35.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.580+0000 7f4f82ffd640 1 -- 172.21.15.45:0/3165435036 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4f88058280 con 0x7f4f940c4490 2023-12-08T08:16:35.583 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-08T08:16:35.583 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg== 2023-12-08T08:16:35.583 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:16:35.584 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:16:35.584 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:16:35.584 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 msgr2=0x7f4f7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 0x7f4f7406d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f84036000 tx=0x7f4f8403d040 comp rx=0 tx=0).stop 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 msgr2=0x7f4f941e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d800 tx=0x7f4f8800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 shutdown_connections 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f7406ae40 0x7f4f7406d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f940c5c10 0x7f4f94156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f940c4490 0x7f4f941e6eb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 --2- 172.21.15.45:0/3165435036 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f9406af10 0x7f4f941e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 >> 172.21.15.45:0/3165435036 conn(0x7f4f940c9b10 msgr2=0x7f4f94151590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:35.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 shutdown_connections 2023-12-08T08:16:35.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.583+0000 7f4f9359e640 1 -- 172.21.15.45:0/3165435036 wait complete. 2023-12-08T08:16:35.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.828+0000 7fe2a8809640 1 Processor -- start 2023-12-08T08:16:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.828+0000 7fe2a8809640 1 -- start start 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe2a8809640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2a40a7910 0x7fe2a40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe2a8809640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a4155850 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe2a8809640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40c0890 con 0x7fe2a41521b0 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe2a8809640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40c0b70 con 0x7fe2a40a7910 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe29bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe2a40c1dc0 0x7fe2a414f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43770/0 (socket says 172.21.15.45:43770) 2023-12-08T08:16:35.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.830+0000 7fe29bfff640 1 -- 172.21.15.45:0/3559636753 learned_addr learned my addr 172.21.15.45:0/3559636753 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a37fe640 1 --2- 172.21.15.45:0/3559636753 >> v2:172.21.15.114:3300/0 conn(0x7fe2a40a7910 0x7fe2a40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525089226 0 0) 0x7fe2a4155850 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe290003520 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135424289 0 0) 0x7fe290003520 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 >> v2:172.21.15.114:3300/0 conn(0x7fe2a40a7910 msgr2=0x7fe2a40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 --2- 172.21.15.45:0/3559636753 >> v2:172.21.15.114:3300/0 conn(0x7fe2a40a7910 0x7fe2a40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 >> v1:172.21.15.114:6789/0 conn(0x7fe2a41521b0 legacy=0x7fe2a4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40c0e50 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe28c001670 con 0x7fe2a40c1dc0 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 >> v1:172.21.15.45:6789/0 conn(0x7fe2a40c1dc0 legacy=0x7fe2a414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2900039c0 0x7fe290003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2900047c0 0x7fe290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe29000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40c0b70 con 0x7fe2900051d0 2023-12-08T08:16:35.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29000c120 con 0x7fe2900039c0 2023-12-08T08:16:35.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.831+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29000c2e0 con 0x7fe2900047c0 2023-12-08T08:16:35.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe29000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a37fe640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2900039c0 0x7fe290003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe29bfff640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2900047c0 0x7fe290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 -- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2900047c0 msgr2=0x7fe290004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:35.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2900047c0 0x7fe290004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 -- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2900039c0 msgr2=0x7fe290003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:35.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2900039c0 0x7fe290003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.832+0000 7fe2a3fff640 1 -- 172.21.15.45:0/3559636753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290003520 con 0x7fe2900051d0 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.833+0000 7fe2a3fff640 1 -- 172.21.15.45:0/3559636753 reap_dead start 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.833+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe29000b980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe29c001e20 tx=0x7fe2900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fff5e926d36b052 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c003b70 con 0x7fe2900051d0 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c003cd0 con 0x7fe2900051d0 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a2ffd640 1 -- 172.21.15.45:0/3559636753 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0052f0 con 0x7fe2900051d0 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a8809640 1 -- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 msgr2=0x7fe29000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a8809640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe29000b980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe29c001e20 tx=0x7fe2900057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a8809640 1 -- 172.21.15.45:0/3559636753 shutdown_connections 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a8809640 1 --2- 172.21.15.45:0/3559636753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe29000b980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.834+0000 7fe2a8809640 1 -- 172.21.15.45:0/3559636753 >> 172.21.15.45:0/3559636753 conn(0x7fe2a40c5780 msgr2=0x7fe2a40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.835+0000 7fe2a8809640 1 -- 172.21.15.45:0/3559636753 shutdown_connections 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.835+0000 7fe2a8809640 1 -- 172.21.15.45:0/3559636753 wait complete. 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.836+0000 7fe2a8809640 1 Processor -- start 2023-12-08T08:16:35.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.837+0000 7fe2a8809640 1 -- start start 2023-12-08T08:16:35.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2a414f130 0x7fe2a41ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 0x7fe2a41db300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41dc530 con 0x7fe2900051d0 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41ea7c0 con 0x7fe2a414f130 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a8809640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41dbd20 con 0x7fe2a41548c0 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47896/0 (socket says 172.21.15.45:47896) 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 -- 172.21.15.45:0/2917592030 learned_addr learned my addr 172.21.15.45:0/2917592030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe29bfff640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2a414f130 0x7fe2a41ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 0x7fe2a41db300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 -- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 msgr2=0x7fe2a41db300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 0x7fe2a41db300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 -- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2a414f130 msgr2=0x7fe2a41ea280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2a414f130 0x7fe2a41ea280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a37fe640 1 -- 172.21.15.45:0/2917592030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a41dbf70 con 0x7fe2900051d0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.838+0000 7fe2a3fff640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 0x7fe2a41db300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a37fe640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe294011570 tx=0x7fe294011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294015930 con 0x7fe2900051d0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe294015a90 con 0x7fe2900051d0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294015e20 con 0x7fe2900051d0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a41dc250 con 0x7fe2900051d0 2023-12-08T08:16:35.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.839+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a41dade0 con 0x7fe2900051d0 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.840+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a41da960 con 0x7fe2900051d0 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.841+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe29401d400 con 0x7fe2900051d0 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.843+0000 7fe2a0ff9640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 0x7fe28406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.843+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe294089e00 con 0x7fe2900051d0 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.843+0000 7fe29bfff640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 0x7fe28406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.844+0000 7fe29bfff640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 0x7fe28406d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406d110 tx=0x7fe28c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:35.847+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2a41da960 con 0x7fe2900051d0 2023-12-08T08:16:36.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.082+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2a41da960 con 0x7fe2900051d0 2023-12-08T08:16:36.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.083+0000 7fe2a0ff9640 1 -- 172.21.15.45:0/2917592030 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4904 (secure 0 0 0) 0x7fe2a41da960 con 0x7fe2900051d0 2023-12-08T08:16:36.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:36.086 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:16:36.086 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2023-12-08T08:16:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 msgr2=0x7fe28406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 0x7fe28406d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2a406d110 tx=0x7fe28c009040 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 msgr2=0x7fe2a40c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe294011570 tx=0x7fe294011a30 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 shutdown_connections 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe28406ae70 0x7fe28406d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2a41548c0 0x7fe2a41db300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2a414f130 0x7fe2a41ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 --2- 172.21.15.45:0/2917592030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2900051d0 0x7fe2a40c3940 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.085+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 >> 172.21.15.45:0/2917592030 conn(0x7fe2a40c5780 msgr2=0x7fe2a40aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.086+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 shutdown_connections 2023-12-08T08:16:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.086+0000 7fe2a8809640 1 -- 172.21.15.45:0/2917592030 wait complete. 2023-12-08T08:16:36.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:16:29.411749+0000', 'modified': '2023-12-08T08:16:32.505404+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5253}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5253': {'gid': 5253, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6837/2643055', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 2643055}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 2643055}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:16:36.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:16:36.510 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-08T08:16:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.750+0000 7fc05895c640 1 Processor -- start 2023-12-08T08:16:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.750+0000 7fc05895c640 1 -- start start 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc05895c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc054155dd0 0x7fc05406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc05895c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0541521e0 con 0x7fc0540c50b0 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc05895c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0541524c0 con 0x7fc0540c5600 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc05895c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc054152b80 con 0x7fc054155dd0 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc04affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc0540c50b0 0x7fc05415aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43774/0 (socket says 172.21.15.45:43774) 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc04affd640 1 -- 172.21.15.45:0/484532302 learned_addr learned my addr 172.21.15.45:0/484532302 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.752+0000 7fc053fff640 1 --2- 172.21.15.45:0/484532302 >> v2:172.21.15.45:3300/0 conn(0x7fc054155dd0 0x7fc05406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.753+0000 7fc053fff640 1 -- 172.21.15.45:0/484532302 >> v1:172.21.15.114:6789/0 conn(0x7fc0540c5600 legacy=0x7fc0541556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.753+0000 7fc053fff640 1 -- 172.21.15.45:0/484532302 >> v1:172.21.15.45:6789/0 conn(0x7fc0540c50b0 legacy=0x7fc05415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.753+0000 7fc053fff640 1 -- 172.21.15.45:0/484532302 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0541527a0 con 0x7fc054155dd0 2023-12-08T08:16:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.753+0000 7fc052ffd640 1 -- 172.21.15.45:0/484532302 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317880133 0 0) 0x7fc0541521e0 con 0x7fc0540c50b0 2023-12-08T08:16:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.754+0000 7fc053fff640 1 --2- 172.21.15.45:0/484532302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc054155dd0 0x7fc05406db60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009d90 tx=0x7fc04c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299971c08b91111d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.754+0000 7fc052ffd640 1 -- 172.21.15.45:0/484532302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c02cbd0 con 0x7fc054155dd0 2023-12-08T08:16:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.754+0000 7fc052ffd640 1 -- 172.21.15.45:0/484532302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c02cd30 con 0x7fc054155dd0 2023-12-08T08:16:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.754+0000 7fc052ffd640 1 -- 172.21.15.45:0/484532302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c02cea0 con 0x7fc054155dd0 2023-12-08T08:16:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 -- 172.21.15.45:0/484532302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc054155dd0 msgr2=0x7fc05406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 --2- 172.21.15.45:0/484532302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc054155dd0 0x7fc05406db60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009d90 tx=0x7fc04c02be20 comp rx=0 tx=0).stop 2023-12-08T08:16:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 -- 172.21.15.45:0/484532302 shutdown_connections 2023-12-08T08:16:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 --2- 172.21.15.45:0/484532302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc054155dd0 0x7fc05406db60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 -- 172.21.15.45:0/484532302 >> 172.21.15.45:0/484532302 conn(0x7fc0540a7600 msgr2=0x7fc0540a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 -- 172.21.15.45:0/484532302 shutdown_connections 2023-12-08T08:16:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.755+0000 7fc05895c640 1 -- 172.21.15.45:0/484532302 wait complete. 2023-12-08T08:16:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.757+0000 7fc05895c640 1 Processor -- start 2023-12-08T08:16:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.757+0000 7fc05895c640 1 -- start start 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0540c50b0 0x7fc054153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc054155dd0 0x7fc05414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054070710 con 0x7fc0540c5600 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541ed380 con 0x7fc0540c50b0 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.758+0000 7fc05895c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc054070150 con 0x7fc054155dd0 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47922/0 (socket says 172.21.15.45:47922) 2023-12-08T08:16:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 -- 172.21.15.45:0/3030111927 learned_addr learned my addr 172.21.15.45:0/3030111927 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0540c50b0 0x7fc054153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 -- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc054155dd0 msgr2=0x7fc05414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc053fff640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc054155dd0 0x7fc05414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc054155dd0 0x7fc05414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 -- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0540c50b0 msgr2=0x7fc054153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0540c50b0 0x7fc054153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 -- 172.21.15.45:0/3030111927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009a70 con 0x7fc0540c5600 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.759+0000 7fc04affd640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c4b0 tx=0x7fc03c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.760+0000 7fc050ff9640 1 -- 172.21.15.45:0/3030111927 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0074e0 con 0x7fc0540c5600 2023-12-08T08:16:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.760+0000 7fc050ff9640 1 -- 172.21.15.45:0/3030111927 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c007660 con 0x7fc0540c5600 2023-12-08T08:16:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.760+0000 7fc050ff9640 1 -- 172.21.15.45:0/3030111927 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c004a20 con 0x7fc0540c5600 2023-12-08T08:16:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.760+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054070430 con 0x7fc0540c5600 2023-12-08T08:16:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.760+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05414e2c0 con 0x7fc0540c5600 2023-12-08T08:16:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.762+0000 7fc050ff9640 1 -- 172.21.15.45:0/3030111927 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc03c004b80 con 0x7fc0540c5600 2023-12-08T08:16:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.763+0000 7fc050ff9640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 0x7fc03406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.763+0000 7fc050ff9640 1 -- 172.21.15.45:0/3030111927 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc03c0889c0 con 0x7fc0540c5600 2023-12-08T08:16:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.763+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 0x7fc03406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.764+0000 7fc05c82e740 1 Processor -- start 2023-12-08T08:16:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.764+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 0x7fc03406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc044004ea0 tx=0x7fc044009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.764+0000 7fc05c82e740 1 -- start start 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd61ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd53b880 con 0x555acd617b30 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd54aae0 con 0x555acd5de880 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x555acd5481d0 con 0x555acd61b340 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.765+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47934/0 (socket says 172.21.15.45:47934) 2023-12-08T08:16:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 -- 172.21.15.45:0/2257083048 learned_addr learned my addr 172.21.15.45:0/2257083048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc053fff640 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 -- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 msgr2=0x555acd5d7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 -- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 msgr2=0x555acd61ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc04affd640 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd61ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd61ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 -- 172.21.15.45:0/2257083048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555acd50b860 con 0x555acd617b30 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.766+0000 7fc0537fe640 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e7e0 tx=0x7fc044011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547d667c97b2b2c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc0497fa640 1 -- 172.21.15.45:0/2257083048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0440159b0 con 0x555acd617b30 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc0497fa640 1 -- 172.21.15.45:0/2257083048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044015b10 con 0x555acd617b30 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc0497fa640 1 -- 172.21.15.45:0/2257083048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044015e80 con 0x555acd617b30 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 -- 172.21.15.45:0/2257083048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 msgr2=0x555acd617f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e7e0 tx=0x7fc044011000 comp rx=0 tx=0).stop 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 -- 172.21.15.45:0/2257083048 shutdown_connections 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5d7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd61ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 --2- 172.21.15.45:0/2257083048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd617b30 0x555acd617f10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.767+0000 7fc05c82e740 1 -- 172.21.15.45:0/2257083048 >> 172.21.15.45:0/2257083048 conn(0x555acd59ec70 msgr2=0x555acd5fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.768+0000 7fc05c82e740 1 -- 172.21.15.45:0/2257083048 shutdown_connections 2023-12-08T08:16:36.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.768+0000 7fc05c82e740 1 -- 172.21.15.45:0/2257083048 wait complete. 2023-12-08T08:16:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.768+0000 7fc05c82e740 1 -- start start 2023-12-08T08:16:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.768+0000 7fc05c82e740 1 Processor -- start 2023-12-08T08:16:36.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd617b30 0x555acd62d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd543ac0 con 0x555acd5de880 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd4e02f0 con 0x555acd617b30 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.769+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x555acd4fdc70 con 0x555acd61b340 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc05c82e740 10 client.0 _ll_register_callbacks cb 0x555acd5023b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47942/0 (socket says 172.21.15.45:47942) 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 -- 172.21.15.45:0/271684901 learned_addr learned my addr 172.21.15.45:0/271684901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc053fff640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc04affd640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd617b30 0x555acd62d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 -- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 msgr2=0x555acd5fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5fba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 -- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd617b30 msgr2=0x555acd62d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd617b30 0x555acd62d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.770+0000 7fc0537fe640 1 -- 172.21.15.45:0/271684901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04400f040 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0537fe640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc044023040 tx=0x7fc0440036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab6c0833d5a6159 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0327fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044020a40 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc044020ba0 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555acd53caa0 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc044020d60 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc05c82e740 10 client.5436 fetch_fsmap learned FSMap version 17 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555acd542140 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.771+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555acd53caa0 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc044033430 con 0x555acd5de880 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 10 client.5436 fetch_fsmap finished waiting for FSMap version 17 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 10 client.5436 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 20 client.5436 populate_metadata read hostname 'smithi045' 2023-12-08T08:16:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd61e040 0x555acd61e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 4 client.5436 mds_command: new command op to 5253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:16:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 --> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555acd53c7c0 con 0x555acd61e040 2023-12-08T08:16:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.772+0000 7fc04affd640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd61e040 0x555acd61e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.773+0000 7fc04affd640 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd61e040 0x555acd61e420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7e13a3ec826c7c server_cookie=ae1394d156d2f8cf in_seq=0 out_seq=0 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.773+0000 7fc0327fc640 10 client.5436 ms_handle_connect on v2:172.21.15.45:6836/2643055 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.773+0000 7fc0327fc640 1 -- 172.21.15.45:0/271684901 <== mds.0 v2:172.21.15.45:6836/2643055 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555acd53c7c0 con 0x555acd61e040 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.773+0000 7fc0327fc640 10 client.5436 handle_command_reply: tid=0 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.773+0000 7fc05c82e740 1 client.5436 shutdown 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 msgr2=0x555acd5fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc044023040 tx=0x7fc0440036f0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 shutdown_connections 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd61e040 0x555acd61e420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd61b340 0x555acd5fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd617b30 0x555acd62d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc0327fc640 0 client.5436 ms_handle_reset on v2:172.21.15.45:6836/2643055 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 --2- 172.21.15.45:0/271684901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd5de880 0x555acd5fdc90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 >> 172.21.15.45:0/271684901 conn(0x555acd59ec70 msgr2=0x555acd61cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 shutdown_connections 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 1 -- 172.21.15.45:0/271684901 wait complete. 2023-12-08T08:16:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.774+0000 7fc05c82e740 20 client.5436 trim_cache size 0 max 16384 2023-12-08T08:16:36.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.791+0000 7fc05c82e740 1 Processor -- start 2023-12-08T08:16:36.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.791+0000 7fc05c82e740 1 -- start start 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd2a6f20 con 0x555acd61b340 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd4f7e30 con 0x555acd5de880 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x555acd6164f0 con 0x555acd617b30 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc053fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc053fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47954/0 (socket says 172.21.15.45:47954) 2023-12-08T08:16:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.792+0000 7fc053fff640 1 -- 172.21.15.45:0/3435066491 learned_addr learned my addr 172.21.15.45:0/3435066491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc04affd640 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 -- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 msgr2=0x555acd6295c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6295c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 -- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 msgr2=0x555acd5d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 -- 172.21.15.45:0/3435066491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555acd4dfb80 con 0x555acd61b340 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc053fff640 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc04c037040 tx=0x7fc04c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48647157d309daa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.793+0000 7fc049ffb640 1 -- 172.21.15.45:0/3435066491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c02cea0 con 0x555acd61b340 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc049ffb640 1 -- 172.21.15.45:0/3435066491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c043070 con 0x555acd61b340 2023-12-08T08:16:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc049ffb640 1 -- 172.21.15.45:0/3435066491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c03f890 con 0x555acd61b340 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 -- 172.21.15.45:0/3435066491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 msgr2=0x555acd629b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc04c037040 tx=0x7fc04c02e000 comp rx=0 tx=0).stop 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 -- 172.21.15.45:0/3435066491 shutdown_connections 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6295c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd629b00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3435066491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 -- 172.21.15.45:0/3435066491 >> 172.21.15.45:0/3435066491 conn(0x555acd59ec70 msgr2=0x555acd617f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 -- 172.21.15.45:0/3435066491 shutdown_connections 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.794+0000 7fc05c82e740 1 -- 172.21.15.45:0/3435066491 wait complete. 2023-12-08T08:16:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.795+0000 7fc05c82e740 1 -- start start 2023-12-08T08:16:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.795+0000 7fc05c82e740 1 Processor -- start 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd61ecd0 con 0x555acd61b340 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x555acd61e9c0 con 0x555acd5de880 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x555acd621440 con 0x555acd617b30 2023-12-08T08:16:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc05c82e740 10 client.0 _ll_register_callbacks cb 0x7fc044023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc053fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc053fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47968/0 (socket says 172.21.15.45:47968) 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.796+0000 7fc053fff640 1 -- 172.21.15.45:0/3588436408 learned_addr learned my addr 172.21.15.45:0/3588436408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 -- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 msgr2=0x555acd6294d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 -- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 msgr2=0x555acd5d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 -- 172.21.15.45:0/3588436408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0541527a0 con 0x555acd61b340 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc053fff640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e80 tx=0x7fc04c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f19e2259c6cc7e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc0327fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c02cea0 con 0x555acd61b340 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc04c045070 con 0x555acd61b340 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.797+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc044015b10 con 0x555acd61b340 2023-12-08T08:16:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc04c02cbc0 con 0x555acd61b340 2023-12-08T08:16:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 10 client.5442 fetch_fsmap learned FSMap version 17 2023-12-08T08:16:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555acd505170 con 0x555acd61b340 2023-12-08T08:16:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044015b10 con 0x555acd61b340 2023-12-08T08:16:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc04c03f450 con 0x555acd61b340 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 10 client.5442 fetch_fsmap finished waiting for FSMap version 17 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 10 client.5442 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 20 client.5442 populate_metadata read hostname 'smithi045' 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd6810a0 0x555acd683690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 4 client.5442 mds_command: new command op to 5253 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 --> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555acd2446c0 con 0x555acd6810a0 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.798+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd6810a0 0x555acd683690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc0537fe640 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd6810a0 0x555acd683690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51b52b6b53c02cd server_cookie=eebf95a38cf7b2cb in_seq=0 out_seq=0 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc0327fc640 10 client.5442 ms_handle_connect on v2:172.21.15.45:6836/2643055 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc0327fc640 1 -- 172.21.15.45:0/3588436408 <== mds.0 v2:172.21.15.45:6836/2643055 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555acd2446c0 con 0x555acd6810a0 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc0327fc640 10 client.5442 handle_command_reply: tid=0 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc05c82e740 1 client.5442 shutdown 2023-12-08T08:16:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 msgr2=0x555acd6809c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.799+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e80 tx=0x7fc04c004ab0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 shutdown_connections 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:6836/2643055,v1:172.21.15.45:6837/2643055] conn(0x555acd6810a0 0x555acd683690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x555acd617b30 0x555acd6294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555acd61b340 0x555acd6809c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc0327fc640 0 client.5442 ms_handle_reset on v2:172.21.15.45:6836/2643055 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 --2- 172.21.15.45:0/3588436408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x555acd5de880 0x555acd5d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 >> 172.21.15.45:0/3588436408 conn(0x555acd59ec70 msgr2=0x555acd5fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 shutdown_connections 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 1 -- 172.21.15.45:0/3588436408 wait complete. 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.800+0000 7fc05c82e740 20 client.5442 trim_cache size 0 max 16384 2023-12-08T08:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2", 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5253, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.8137258149999997, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 17, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 40, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 40, 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.653620794 2023-12-08T08:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:16:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 msgr2=0x7fc03406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 0x7fc03406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc044004ea0 tx=0x7fc044009040 comp rx=0 tx=0).stop 2023-12-08T08:16:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 msgr2=0x7fc054155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c4b0 tx=0x7fc03c00c970 comp rx=0 tx=0).stop 2023-12-08T08:16:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 shutdown_connections 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc03406ae40 0x7fc03406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc054155dd0 0x7fc05414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0540c5600 0x7fc054155690 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 --2- 172.21.15.45:0/3030111927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0540c50b0 0x7fc054153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 >> 172.21.15.45:0/3030111927 conn(0x7fc0540a7600 msgr2=0x7fc05414e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 shutdown_connections 2023-12-08T08:16:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:36.801+0000 7fc05895c640 1 -- 172.21.15.45:0/3030111927 wait complete. 2023-12-08T08:16:36.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:16:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.038+0000 7f9736c9b640 1 Processor -- start 2023-12-08T08:16:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.039+0000 7f9736c9b640 1 -- start start 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9736c9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97300a4f30 0x7f9730155130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9736c9b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300c63b0 con 0x7f9730154190 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9736c9b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300a5380 con 0x7f97300aa2b0 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9736c9b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300a9f20 con 0x7f97300a4f30 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9734a37640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9730154190 0x7f97300c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43780/0 (socket says 172.21.15.45:43780) 2023-12-08T08:16:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.040+0000 7f9734a37640 1 -- 172.21.15.45:0/2361080768 learned_addr learned my addr 172.21.15.45:0/2361080768 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f9735238640 1 --2- 172.21.15.45:0/2361080768 >> v2:172.21.15.45:3300/0 conn(0x7f97300a4f30 0x7f9730155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145055642 0 0) 0x7f97300c63b0 con 0x7f9730154190 2023-12-08T08:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9720003520 con 0x7f9730154190 2023-12-08T08:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3996981576 0 0) 0x7f9720003520 con 0x7f9730154190 2023-12-08T08:16:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 >> v2:172.21.15.45:3300/0 conn(0x7f97300a4f30 msgr2=0x7f9730155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 --2- 172.21.15.45:0/2361080768 >> v2:172.21.15.45:3300/0 conn(0x7f97300a4f30 0x7f9730155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 >> v1:172.21.15.114:6789/0 conn(0x7f97300aa2b0 legacy=0x7f9730154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300a9580 con 0x7f9730154190 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9724001670 con 0x7f9730154190 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 >> v1:172.21.15.45:6789/0 conn(0x7f9730154190 legacy=0x7f97300c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 0x7f9720003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97200047c0 0x7f9720004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200051d0 0x7f972000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300a9f20 con 0x7f97200039c0 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972000c120 con 0x7f97200047c0 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972000c2e0 con 0x7f97200051d0 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.041+0000 7f9735238640 1 --2- 172.21.15.45:0/2361080768 >> v2:172.21.15.45:3300/0 conn(0x7f97300a4f30 0x7f9730155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 0x7f9720003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f972ffff640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97200047c0 0x7f9720004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 -- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200051d0 msgr2=0x7f972000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200051d0 0x7f972000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 -- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97200047c0 msgr2=0x7f9720004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97200047c0 0x7f9720004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9734a37640 1 -- 172.21.15.45:0/2361080768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720003520 con 0x7f97200039c0 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f972ffff640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97200047c0 0x7f9720004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.042+0000 7f9735238640 1 -- 172.21.15.45:0/2361080768 reap_dead start 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.043+0000 7f9734a37640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 0x7f9720003de0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9724001eb0 tx=0x7f97200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6e1815ac2a1081 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724005ad0 con 0x7f97200039c0 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724005c30 con 0x7f97200039c0 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f972f7fe640 1 -- 172.21.15.45:0/2361080768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972402c9d0 con 0x7f97200039c0 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 -- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 msgr2=0x7f9720003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 0x7f9720003de0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9724001eb0 tx=0x7f97200057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 -- 172.21.15.45:0/2361080768 shutdown_connections 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2361080768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97200039c0 0x7f9720003de0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 -- 172.21.15.45:0/2361080768 >> 172.21.15.45:0/2361080768 conn(0x7f97300661f0 msgr2=0x7f9730066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 -- 172.21.15.45:0/2361080768 shutdown_connections 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.044+0000 7f9736c9b640 1 -- 172.21.15.45:0/2361080768 wait complete. 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.046+0000 7f9736c9b640 1 Processor -- start 2023-12-08T08:16:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.046+0000 7f9736c9b640 1 -- start start 2023-12-08T08:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 0x7f973014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97301ec210 0x7f973013bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973014b4d0 con 0x7f973014c080 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730142060 con 0x7f97301ec210 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f9736c9b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300bf4b0 con 0x7f97200039c0 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f972ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.047+0000 7f972ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48012/0 (socket says 172.21.15.45:48012) 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 -- 172.21.15.45:0/2166442422 learned_addr learned my addr 172.21.15.45:0/2166442422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f9734a37640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 0x7f973014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f9735238640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97301ec210 0x7f973013bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 -- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 msgr2=0x7f973014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 0x7f973014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 -- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97301ec210 msgr2=0x7f973013bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97301ec210 0x7f973013bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 -- 172.21.15.45:0/2166442422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973014b130 con 0x7f973014c080 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f9734a37640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 0x7f973014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:37.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.048+0000 7f972ffff640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d4b0 tx=0x7f971c00d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.049+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c005480 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.049+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c003610 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.049+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730141d80 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.049+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c003a00 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.049+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300bf160 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.050+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973014af90 con 0x7f973014c080 2023-12-08T08:16:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.051+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f971c003b60 con 0x7f973014c080 2023-12-08T08:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.052+0000 7f972d7fa640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 0x7f971406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.052+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f971c089550 con 0x7f973014c080 2023-12-08T08:16:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.052+0000 7f9734a37640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 0x7f971406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.053+0000 7f9734a37640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 0x7f971406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9724034000 tx=0x7f9724009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.056+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f973014af90 con 0x7f973014c080 2023-12-08T08:16:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.291+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f973014af90 con 0x7f973014c080 2023-12-08T08:16:37.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.292+0000 7f972d7fa640 1 -- 172.21.15.45:0/2166442422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f973014af90 con 0x7f973014c080 2023-12-08T08:16:37.295 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 msgr2=0x7f971406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 0x7f971406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9724034000 tx=0x7f9724009030 comp rx=0 tx=0).stop 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 msgr2=0x7f97301ebcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f971c00d4b0 tx=0x7f971c00d970 comp rx=0 tx=0).stop 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 shutdown_connections 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f971406ae40 0x7f971406d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97301ec210 0x7f973013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973014c080 0x7f97301ebcd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 --2- 172.21.15.45:0/2166442422 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f97200039c0 0x7f973014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 >> 172.21.15.45:0/2166442422 conn(0x7f97300661f0 msgr2=0x7f97300c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 shutdown_connections 2023-12-08T08:16:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:37.295+0000 7f9736c9b640 1 -- 172.21.15.45:0/2166442422 wait complete. 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:16:37.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:16:37.319 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:16:37.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.319 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:16:37.375 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42035sec preferred_lft 42035sec 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:37.376 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:37.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.378 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:16:37.479 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:16:37.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.484 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:16:37.540 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:16:37.541 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:16:37.541 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:16:37.541 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:16:37.541 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:16:37.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.541 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:16:37.541 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:16:37.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:16:37.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:16:37.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:16:37.542 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:16:37.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.742 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:16:37.798 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:16:37.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:16:37.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:37.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:16:37.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:37.907 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:16:37.968 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:16:37.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:37.969 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:16:38.028 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:16:38.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:38.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:38.174 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:38.174 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:38.210 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:38.210 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:38.211 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:16:38.211 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:16:38.211 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:16:38.214 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-08T08:16:38.214 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:16:38.214 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:16:38.214 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:16:38.214 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:16:38.217 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:16:38.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:38.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:16:38.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:38.311 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:16:38.375 INFO:teuthology.orchestra.run.smithi045.stdout:client5454 2023-12-08T08:16:38.376 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:38.376 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:38.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:16:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.648+0000 7f7153cd0640 1 Processor -- start 2023-12-08T08:16:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.649+0000 7f7153cd0640 1 -- start start 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7153cd0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f714c154190 0x7f714c0aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7153cd0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0c63b0 con 0x7f714c154a20 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7153cd0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0a53c0 con 0x7f714c0a4f30 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7153cd0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0a9f20 con 0x7f714c154190 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7151a6c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f714c154190 0x7f714c0aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7151a6c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f714c154190 0x7f714c0aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48022/0 (socket says 172.21.15.45:48022) 2023-12-08T08:16:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.650+0000 7f7151a6c640 1 -- 172.21.15.45:0/1256756757 learned_addr learned my addr 172.21.15.45:0/1256756757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.651+0000 7f7151a6c640 1 -- 172.21.15.45:0/1256756757 >> v1:172.21.15.114:6789/0 conn(0x7f714c0a4f30 legacy=0x7f714c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.651+0000 7f7151a6c640 1 -- 172.21.15.45:0/1256756757 >> v1:172.21.15.45:6789/0 conn(0x7f714c154a20 legacy=0x7f714c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.651+0000 7f7151a6c640 1 -- 172.21.15.45:0/1256756757 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0a9580 con 0x7f714c154190 2023-12-08T08:16:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.651+0000 7f7150a6a640 1 -- 172.21.15.45:0/1256756757 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61399938 0 0) 0x7f714c0c63b0 con 0x7f714c154a20 2023-12-08T08:16:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.652+0000 7f7151a6c640 1 --2- 172.21.15.45:0/1256756757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154190 0x7f714c0aa2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7148009e50 tx=0x7f714802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9c00934364b9b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.652+0000 7f7150a6a640 1 -- 172.21.15.45:0/1256756757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714802ca80 con 0x7f714c154190 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.652+0000 7f7150a6a640 1 -- 172.21.15.45:0/1256756757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714802cbe0 con 0x7f714c154190 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.652+0000 7f7150a6a640 1 -- 172.21.15.45:0/1256756757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71480343f0 con 0x7f714c154190 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 -- 172.21.15.45:0/1256756757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154190 msgr2=0x7f714c0aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 --2- 172.21.15.45:0/1256756757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154190 0x7f714c0aa2b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7148009e50 tx=0x7f714802bee0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 -- 172.21.15.45:0/1256756757 shutdown_connections 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 --2- 172.21.15.45:0/1256756757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154190 0x7f714c0aa2b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 -- 172.21.15.45:0/1256756757 >> 172.21.15.45:0/1256756757 conn(0x7f714c0661f0 msgr2=0x7f714c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 -- 172.21.15.45:0/1256756757 shutdown_connections 2023-12-08T08:16:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.653+0000 7f7153cd0640 1 -- 172.21.15.45:0/1256756757 wait complete. 2023-12-08T08:16:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.655+0000 7f7153cd0640 1 Processor -- start 2023-12-08T08:16:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.655+0000 7f7153cd0640 1 -- start start 2023-12-08T08:16:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f714c0a4f30 0x7f714c0ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f714c154190 0x7f714c0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06fe60 con 0x7f714c154a20 2023-12-08T08:16:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c070420 con 0x7f714c0a4f30 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7153cd0640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1e9c10 con 0x7f714c154190 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f715226d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f715226d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48036/0 (socket says 172.21.15.45:48036) 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f715226d640 1 -- 172.21.15.45:0/4256552114 learned_addr learned my addr 172.21.15.45:0/4256552114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f7151a6c640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f714c0a4f30 0x7f714c0ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.656+0000 7f715126b640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f714c154190 0x7f714c0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 -- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f714c154190 msgr2=0x7f714c0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f714c154190 0x7f714c0a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 -- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f714c0a4f30 msgr2=0x7f714c0ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f714c0a4f30 0x7f714c0ba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 -- 172.21.15.45:0/4256552114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009b30 con 0x7f714c154a20 2023-12-08T08:16:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f715226d640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f714400c390 tx=0x7f714400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440035f0 con 0x7f714c154a20 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144003750 con 0x7f714c154a20 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144003b00 con 0x7f714c154a20 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c1e9ef0 con 0x7f714c154a20 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.657+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c0a6f80 con 0x7f714c154a20 2023-12-08T08:16:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.659+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c0c2b20 con 0x7f714c154a20 2023-12-08T08:16:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.660+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7144003c60 con 0x7f714c154a20 2023-12-08T08:16:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.661+0000 7f71427fc640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.661+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7144088d30 con 0x7f714c154a20 2023-12-08T08:16:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.662+0000 7f7151a6c640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.662+0000 7f7151a6c640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7148035000 tx=0x7f7148030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.666+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7144053c90 con 0x7f714c154a20 2023-12-08T08:16:38.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.899+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f714c0673e0 con 0x7f714c154a20 2023-12-08T08:16:38.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.900+0000 7f71427fc640 1 -- 172.21.15.45:0/4256552114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7144017020 con 0x7f714c154a20 2023-12-08T08:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:16:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 msgr2=0x7f713006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7148035000 tx=0x7f7148030000 comp rx=0 tx=0).stop 2023-12-08T08:16:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 msgr2=0x7f714c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f714400c390 tx=0x7f714400c850 comp rx=0 tx=0).stop 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 shutdown_connections 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f714c154190 0x7f714c0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f714c154a20 0x7f714c0712d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 --2- 172.21.15.45:0/4256552114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f714c0a4f30 0x7f714c0ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 >> 172.21.15.45:0/4256552114 conn(0x7f714c0661f0 msgr2=0x7f714c154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 shutdown_connections 2023-12-08T08:16:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:38.903+0000 7f7153cd0640 1 -- 172.21.15.45:0/4256552114 wait complete. 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:16:38.926 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:38.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:38.927 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:16:38.987 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:16:38.988 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42016sec preferred_lft 42016sec 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.989 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:16:38.990 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:16:38.990 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:16:38.990 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:38.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:38.991 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:16:39.084 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:16:39.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.088 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:16:39.143 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:16:39.144 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:16:39.144 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:16:39.144 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:16:39.144 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:16:39.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.144 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:16:39.144 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:16:39.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:16:39.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:16:39.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:16:39.145 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:16:39.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.326 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:16:39.379 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:16:39.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:39.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:16:39.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:39.480 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:39.533 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:39.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:39.533 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:39.585 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:16:39.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:39.729 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:39.730 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:39.766 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:39.766 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:39.766 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:16:39.766 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:16:39.766 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:16:39.768 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:16:39.769 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:16:39.769 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:16:39.769 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:16:39.769 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:16:39.773 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:16:39.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:39.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:39.854 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:16:39.911 INFO:teuthology.orchestra.run.smithi114.stdout:client5466 2023-12-08T08:16:39.912 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:39.912 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:39.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:16:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.193+0000 7f278b59e640 1 Processor -- start 2023-12-08T08:16:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.193+0000 7f278b59e640 1 -- start start 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.194+0000 7f278b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f278c14e680 0x7f278c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.194+0000 7f278b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f278c14ea60 0x7f278c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.194+0000 7f278b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c154b90 con 0x7f278c06d820 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c154e70 con 0x7f278c14e680 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c155150 con 0x7f278c14ea60 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f278c14e680 0x7f278c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f278c14e680 0x7f278c1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48042/0 (socket says 172.21.15.45:48042) 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 -- 172.21.15.45:0/1653008812 learned_addr learned my addr 172.21.15.45:0/1653008812 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f2783fff640 1 --2- 172.21.15.45:0/1653008812 >> v2:172.21.15.114:3300/0 conn(0x7f278c14ea60 0x7f278c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 -- 172.21.15.45:0/1653008812 >> v2:172.21.15.114:3300/0 conn(0x7f278c14ea60 msgr2=0x7f278c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 --2- 172.21.15.45:0/1653008812 >> v2:172.21.15.114:3300/0 conn(0x7f278c14ea60 0x7f278c0c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 -- 172.21.15.45:0/1653008812 >> v1:172.21.15.114:6789/0 conn(0x7f278c06d820 legacy=0x7f278c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.195+0000 7f278a59c640 1 -- 172.21.15.45:0/1653008812 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c155430 con 0x7f278c14e680 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.196+0000 7f278a59c640 1 --2- 172.21.15.45:0/1653008812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c14e680 0x7f278c1545b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f278c0c0ac0 tx=0x7f277c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f854f51441fc264a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.197+0000 7f2789d9b640 1 -- 172.21.15.45:0/1653008812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c0317e0 con 0x7f278c14e680 2023-12-08T08:16:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.197+0000 7f2789d9b640 1 -- 172.21.15.45:0/1653008812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c031940 con 0x7f278c14e680 2023-12-08T08:16:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.197+0000 7f2789d9b640 1 -- 172.21.15.45:0/1653008812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c031cd0 con 0x7f278c14e680 2023-12-08T08:16:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.197+0000 7f278b59e640 1 -- 172.21.15.45:0/1653008812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c14e680 msgr2=0x7f278c1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.197+0000 7f278b59e640 1 --2- 172.21.15.45:0/1653008812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c14e680 0x7f278c1545b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f278c0c0ac0 tx=0x7f277c02b880 comp rx=0 tx=0).stop 2023-12-08T08:16:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 -- 172.21.15.45:0/1653008812 shutdown_connections 2023-12-08T08:16:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 --2- 172.21.15.45:0/1653008812 >> v2:172.21.15.114:3300/0 conn(0x7f278c14ea60 0x7f278c0c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 --2- 172.21.15.45:0/1653008812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c14e680 0x7f278c1545b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 -- 172.21.15.45:0/1653008812 >> 172.21.15.45:0/1653008812 conn(0x7f278c0a7600 msgr2=0x7f278c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 -- 172.21.15.45:0/1653008812 shutdown_connections 2023-12-08T08:16:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.198+0000 7f278b59e640 1 -- 172.21.15.45:0/1653008812 wait complete. 2023-12-08T08:16:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.199+0000 7f278b59e640 1 Processor -- start 2023-12-08T08:16:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.200+0000 7f278b59e640 1 -- start start 2023-12-08T08:16:40.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 0x7f278c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c14ea60 0x7f278c1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c15df60 con 0x7f278c06d820 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c14efe0 con 0x7f278c14e680 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c150a90 con 0x7f278c14ea60 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48044/0 (socket says 172.21.15.45:48044) 2023-12-08T08:16:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278a59c640 1 -- 172.21.15.45:0/3159546443 learned_addr learned my addr 172.21.15.45:0/3159546443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f2783fff640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 0x7f278c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278ad9d640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c14ea60 0x7f278c1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278a59c640 1 -- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c14ea60 msgr2=0x7f278c1ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.201+0000 7f278a59c640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c14ea60 0x7f278c1ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278a59c640 1 -- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 msgr2=0x7f278c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278a59c640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 0x7f278c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278a59c640 1 -- 172.21.15.45:0/3159546443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0094d0 con 0x7f278c06d820 2023-12-08T08:16:40.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f2783fff640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 0x7f278c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278a59c640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f277c02b8c0 tx=0x7f277c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c0329c0 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c032b40 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c150d70 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c0453f0 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.202+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c150700 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.204+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c06d5e0 con 0x7f278c06d820 2023-12-08T08:16:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.205+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f277c04e450 con 0x7f278c06d820 2023-12-08T08:16:40.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.206+0000 7f2782ffd640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 0x7f276c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.206+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f277c0aba80 con 0x7f278c06d820 2023-12-08T08:16:40.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.206+0000 7f2783fff640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 0x7f276c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.207+0000 7f2783fff640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 0x7f276c06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2774006fd0 tx=0x7f2774008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.211+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f277c0769e0 con 0x7f278c06d820 2023-12-08T08:16:40.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.474+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f278c149a30 con 0x7f278c06d820 2023-12-08T08:16:40.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.475+0000 7f2782ffd640 1 -- 172.21.15.45:0/3159546443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f277c07a000 con 0x7f278c06d820 2023-12-08T08:16:40.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.477+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 msgr2=0x7f276c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.477+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 0x7f276c06d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2774006fd0 tx=0x7f2774008040 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.477+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 msgr2=0x7f278c1494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.477+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f277c02b8c0 tx=0x7f277c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 shutdown_connections 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f276c06ae40 0x7f276c06d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f278c14ea60 0x7f278c1ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f278c14e680 0x7f278c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 --2- 172.21.15.45:0/3159546443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f278c06d820 0x7f278c1494f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 >> 172.21.15.45:0/3159546443 conn(0x7f278c0a7600 msgr2=0x7f278c0a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 shutdown_connections 2023-12-08T08:16:40.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.478+0000 7f278b59e640 1 -- 172.21.15.45:0/3159546443 wait complete. 2023-12-08T08:16:40.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:40.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.720+0000 7fcd9b768640 1 Processor -- start 2023-12-08T08:16:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.720+0000 7fcd9b768640 1 -- start start 2023-12-08T08:16:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.721+0000 7fcd9b768640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd9414c4a0 0x7fcd94156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.721+0000 7fcd9b768640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd940a4d10 0x7fcd94155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd9b768640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9414c880 con 0x7fcd94155ec0 2023-12-08T08:16:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd9b768640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940c4730 con 0x7fcd940a4d10 2023-12-08T08:16:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd9b768640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940c56e0 con 0x7fcd9414c4a0 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd99d05640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcd94155ec0 0x7fcd94153880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43794/0 (socket says 172.21.15.45:43794) 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd99d05640 1 -- 172.21.15.45:0/1806256069 learned_addr learned my addr 172.21.15.45:0/1806256069 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1806256069 >> v2:172.21.15.45:3300/0 conn(0x7fcd940a4d10 0x7fcd94155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd99504640 1 --2- 172.21.15.45:0/1806256069 >> v2:172.21.15.114:3300/0 conn(0x7fcd9414c4a0 0x7fcd94156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd8bfff640 1 -- 172.21.15.45:0/1806256069 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009417575 0 0) 0x7fcd9414c880 con 0x7fcd94155ec0 2023-12-08T08:16:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd98d03640 1 -- 172.21.15.45:0/1806256069 >> v2:172.21.15.114:3300/0 conn(0x7fcd9414c4a0 msgr2=0x7fcd94156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1806256069 >> v2:172.21.15.114:3300/0 conn(0x7fcd9414c4a0 0x7fcd94156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.722+0000 7fcd98d03640 1 -- 172.21.15.45:0/1806256069 >> v1:172.21.15.45:6789/0 conn(0x7fcd94155ec0 legacy=0x7fcd94153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.723+0000 7fcd98d03640 1 -- 172.21.15.45:0/1806256069 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940c63b0 con 0x7fcd940a4d10 2023-12-08T08:16:40.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1806256069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94155980 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd940aae70 tx=0x7fcd8402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dba62123845257 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd8bfff640 1 -- 172.21.15.45:0/1806256069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8402e070 con 0x7fcd940a4d10 2023-12-08T08:16:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd8bfff640 1 -- 172.21.15.45:0/1806256069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd840315a0 con 0x7fcd940a4d10 2023-12-08T08:16:40.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd8bfff640 1 -- 172.21.15.45:0/1806256069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84031930 con 0x7fcd940a4d10 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd9b768640 1 -- 172.21.15.45:0/1806256069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 msgr2=0x7fcd94155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.724+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1806256069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94155980 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd940aae70 tx=0x7fcd8402b840 comp rx=0 tx=0).stop 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 -- 172.21.15.45:0/1806256069 shutdown_connections 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1806256069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94155980 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1806256069 >> v2:172.21.15.114:3300/0 conn(0x7fcd9414c4a0 0x7fcd94156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 -- 172.21.15.45:0/1806256069 >> 172.21.15.45:0/1806256069 conn(0x7fcd940661f0 msgr2=0x7fcd94066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 -- 172.21.15.45:0/1806256069 shutdown_connections 2023-12-08T08:16:40.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.725+0000 7fcd9b768640 1 -- 172.21.15.45:0/1806256069 wait complete. 2023-12-08T08:16:40.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.726+0000 7fcd9b768640 1 Processor -- start 2023-12-08T08:16:40.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.726+0000 7fcd9b768640 1 -- start start 2023-12-08T08:16:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9414c4a0 0x7fcd94070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd94155ec0 0x7fcd941ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941ea010 con 0x7fcd940a4d10 2023-12-08T08:16:40.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd941538d0 con 0x7fcd9414c4a0 2023-12-08T08:16:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.727+0000 7fcd9b768640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94154af0 con 0x7fcd94155ec0 2023-12-08T08:16:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48072/0 (socket says 172.21.15.45:48072) 2023-12-08T08:16:40.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 -- 172.21.15.45:0/1878103375 learned_addr learned my addr 172.21.15.45:0/1878103375 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99d05640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd94155ec0 0x7fcd941ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 -- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd94155ec0 msgr2=0x7fcd941ecc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9414c4a0 0x7fcd94070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd94155ec0 0x7fcd941ecc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 -- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9414c4a0 msgr2=0x7fcd94070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9414c4a0 0x7fcd94070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 -- 172.21.15.45:0/1878103375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84009400 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.728+0000 7fcd99504640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d800 tx=0x7fcd9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.729+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000b6c0 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.729+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000b820 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.729+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd941e99c0 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.729+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000bbb0 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.729+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd941e9670 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.730+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd941e9800 con 0x7fcd940a4d10 2023-12-08T08:16:40.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.731+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd9000bd10 con 0x7fcd940a4d10 2023-12-08T08:16:40.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.732+0000 7fcd89ffb640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 0x7fcd7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:40.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.732+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcd90089cc0 con 0x7fcd940a4d10 2023-12-08T08:16:40.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.733+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 0x7fcd7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:40.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.733+0000 7fcd98d03640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 0x7fcd7806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd84036000 tx=0x7fcd8403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.737+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd90090080 con 0x7fcd940a4d10 2023-12-08T08:16:40.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.924+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd94074600 con 0x7fcd940a4d10 2023-12-08T08:16:40.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.925+0000 7fcd89ffb640 1 -- 172.21.15.45:0/1878103375 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7fcd90054c20 con 0x7fcd940a4d10 2023-12-08T08:16:40.929 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:40.929 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:30.977155+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:40.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 msgr2=0x7fcd7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 0x7fcd7806d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd84036000 tx=0x7fcd8403d040 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 msgr2=0x7fcd94154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d800 tx=0x7fcd9000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 shutdown_connections 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcd7806ae70 0x7fcd7806d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcd94155ec0 0x7fcd941ecc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd9414c4a0 0x7fcd94070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 --2- 172.21.15.45:0/1878103375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd940a4d10 0x7fcd94154460 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 >> 172.21.15.45:0/1878103375 conn(0x7fcd940661f0 msgr2=0x7fcd94146040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 shutdown_connections 2023-12-08T08:16:40.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:40.928+0000 7fcd9b768640 1 -- 172.21.15.45:0/1878103375 wait complete. 2023-12-08T08:16:40.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:16:27.503085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:16:28.455815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:16:40.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.168+0000 7ff2589b5640 1 Processor -- start 2023-12-08T08:16:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.168+0000 7ff2589b5640 1 -- start start 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff2589b5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2540a4d10 0x7ff254155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff2589b5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540c60c0 con 0x7ff2540c4970 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff2589b5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff254152dc0 con 0x7ff25414c280 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff2589b5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2541563e0 con 0x7ff2540a4d10 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff25259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff2540c4970 0x7ff254155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43800/0 (socket says 172.21.15.45:43800) 2023-12-08T08:16:41.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.170+0000 7ff25259c640 1 -- 172.21.15.45:0/1227933004 learned_addr learned my addr 172.21.15.45:0/1227933004 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:41.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144677177 0 0) 0x7ff248001110 con 0x7ff2540c4970 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff25359e640 1 --2- 172.21.15.45:0/1227933004 >> v2:172.21.15.114:3300/0 conn(0x7ff2540a4d10 0x7ff254155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff23c003520 con 0x7ff2540c4970 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964355253 0 0) 0x7ff23c003520 con 0x7ff2540c4970 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 >> v2:172.21.15.114:3300/0 conn(0x7ff2540a4d10 msgr2=0x7ff254155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 --2- 172.21.15.45:0/1227933004 >> v2:172.21.15.114:3300/0 conn(0x7ff2540a4d10 0x7ff254155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 >> v1:172.21.15.114:6789/0 conn(0x7ff25414c280 legacy=0x7ff25406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2541521d0 con 0x7ff2540c4970 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ff248001800 con 0x7ff2540c4970 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 >> v1:172.21.15.45:6789/0 conn(0x7ff2540c4970 legacy=0x7ff254155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff23c0039c0 0x7ff23c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff23c0047c0 0x7ff23c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff23c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541563e0 con 0x7ff23c0051d0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c00c120 con 0x7ff23c0047c0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.171+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c00c2e0 con 0x7ff23c0039c0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff23c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25259c640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff23c0047c0 0x7ff23c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 -- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff23c0039c0 msgr2=0x7ff23c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff23c0039c0 0x7ff23c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 -- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff23c0047c0 msgr2=0x7ff23c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff23c0047c0 0x7ff23c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.172+0000 7ff25359e640 1 -- 172.21.15.45:0/1227933004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c003520 con 0x7ff23c0051d0 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.173+0000 7ff25359e640 1 -- 172.21.15.45:0/1227933004 reap_dead start 2023-12-08T08:16:41.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.173+0000 7ff25359e640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff23c00b980 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009f90 tx=0x7ff23c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e88572498028743 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.173+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cc20 con 0x7ff23c0051d0 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.173+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c00f040 con 0x7ff23c0051d0 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.173+0000 7ff251d9b640 1 -- 172.21.15.45:0/1227933004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c003990 con 0x7ff23c0051d0 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 -- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 msgr2=0x7ff23c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff23c00b980 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009f90 tx=0x7ff23c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 -- 172.21.15.45:0/1227933004 shutdown_connections 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 --2- 172.21.15.45:0/1227933004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff23c00b980 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 -- 172.21.15.45:0/1227933004 >> 172.21.15.45:0/1227933004 conn(0x7ff254066ce0 msgr2=0x7ff2540a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 -- 172.21.15.45:0/1227933004 shutdown_connections 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.174+0000 7ff2589b5640 1 -- 172.21.15.45:0/1227933004 wait complete. 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.176+0000 7ff2589b5640 1 Processor -- start 2023-12-08T08:16:41.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.176+0000 7ff2589b5640 1 -- start start 2023-12-08T08:16:41.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff25414b710 0x7ff2540bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff254145a40 0x7ff254145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25414bb90 con 0x7ff23c0051d0 2023-12-08T08:16:41.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a8e10 con 0x7ff254145a40 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff2589b5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a55d0 con 0x7ff25414b710 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff252d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff252d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48092/0 (socket says 172.21.15.45:48092) 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.177+0000 7ff252d9d640 1 -- 172.21.15.45:0/3838101308 learned_addr learned my addr 172.21.15.45:0/3838101308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff25259c640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff25414b710 0x7ff2540bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff25359e640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff254145a40 0x7ff254145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 -- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff25414b710 msgr2=0x7ff2540bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff25414b710 0x7ff2540bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 -- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff254145a40 msgr2=0x7ff254145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff254145a40 0x7ff254145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 -- 172.21.15.45:0/3838101308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540a8b30 con 0x7ff23c0051d0 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff252d9d640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c3c0 tx=0x7ff24400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440052d0 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244005430 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244003830 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.178+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2540a5870 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.179+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2540bf3c0 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.180+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2540678c0 con 0x7ff23c0051d0 2023-12-08T08:16:41.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.181+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff244003990 con 0x7ff23c0051d0 2023-12-08T08:16:41.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.182+0000 7ff23b7fe640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 0x7ff24006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.182+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff244088c50 con 0x7ff23c0051d0 2023-12-08T08:16:41.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.182+0000 7ff25259c640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 0x7ff24006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.183+0000 7ff25259c640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 0x7ff24006d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff2540726b0 tx=0x7ff248000fd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.186+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff244053bb0 con 0x7ff23c0051d0 2023-12-08T08:16:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.372+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2540743e0 con 0x7ff23c0051d0 2023-12-08T08:16:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.373+0000 7ff23b7fe640 1 -- 172.21.15.45:0/3838101308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2440170a0 con 0x7ff23c0051d0 2023-12-08T08:16:41.375 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 msgr2=0x7ff24006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 0x7ff24006d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff2540726b0 tx=0x7ff248000fd0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 msgr2=0x7ff2540a7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c3c0 tx=0x7ff24400c880 comp rx=0 tx=0).stop 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 shutdown_connections 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff24006ae40 0x7ff24006d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff25414b710 0x7ff2540bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff254145a40 0x7ff254145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.375+0000 7ff2589b5640 1 --2- 172.21.15.45:0/3838101308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff23c0051d0 0x7ff2540a7310 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.376+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 >> 172.21.15.45:0/3838101308 conn(0x7ff254066ce0 msgr2=0x7ff2540c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.376+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 shutdown_connections 2023-12-08T08:16:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.376+0000 7ff2589b5640 1 -- 172.21.15.45:0/3838101308 wait complete. 2023-12-08T08:16:41.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:41.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.620+0000 7fc5ab59e640 1 Processor -- start 2023-12-08T08:16:41.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.620+0000 7fc5ab59e640 1 -- start start 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 0x7fc5ac0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5ac157a20 0x7fc5ac154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac0ca610 0x7fc5ac154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac0c56a0 con 0x7fc5ac157a20 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ac151eb0 con 0x7fc5ac151ad0 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5ab59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0c80d0 con 0x7fc5ac0ca610 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.621+0000 7fc5a9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5ac157a20 0x7fc5ac154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5ac157a20 0x7fc5ac154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48102/0 (socket says 172.21.15.45:48102) 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 -- 172.21.15.45:0/870738355 learned_addr learned my addr 172.21.15.45:0/870738355 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5aa59c640 1 --2- 172.21.15.45:0/870738355 >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 0x7fc5ac0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5aad9d640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac0ca610 0x7fc5ac154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 -- 172.21.15.45:0/870738355 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac0ca610 msgr2=0x7fc5ac154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac0ca610 0x7fc5ac154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 -- 172.21.15.45:0/870738355 >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 msgr2=0x7fc5ac0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 --2- 172.21.15.45:0/870738355 >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 0x7fc5ac0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5a9d9b640 1 -- 172.21.15.45:0/870738355 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac154430 con 0x7fc5ac157a20 2023-12-08T08:16:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.622+0000 7fc5aa59c640 1 --2- 172.21.15.45:0/870738355 >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 0x7fc5ac0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.623+0000 7fc5a9d9b640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac154930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac06c930 tx=0x7fc59402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bfd92e2398fcc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.624+0000 7fc5a959a640 1 -- 172.21.15.45:0/870738355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594031860 con 0x7fc5ac157a20 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.624+0000 7fc5a959a640 1 -- 172.21.15.45:0/870738355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940319c0 con 0x7fc5ac157a20 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.624+0000 7fc5a959a640 1 -- 172.21.15.45:0/870738355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594031d50 con 0x7fc5ac157a20 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 -- 172.21.15.45:0/870738355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 msgr2=0x7fc5ac154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac154930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac06c930 tx=0x7fc59402b900 comp rx=0 tx=0).stop 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 -- 172.21.15.45:0/870738355 shutdown_connections 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac0ca610 0x7fc5ac154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/870738355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac154930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/870738355 >> v2:172.21.15.114:3300/0 conn(0x7fc5ac151ad0 0x7fc5ac0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 -- 172.21.15.45:0/870738355 >> 172.21.15.45:0/870738355 conn(0x7fc5ac066610 msgr2=0x7fc5ac066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 -- 172.21.15.45:0/870738355 shutdown_connections 2023-12-08T08:16:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.625+0000 7fc5ab59e640 1 -- 172.21.15.45:0/870738355 wait complete. 2023-12-08T08:16:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.627+0000 7fc5ab59e640 1 Processor -- start 2023-12-08T08:16:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.627+0000 7fc5ab59e640 1 -- start start 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ac0ca610 0x7fc5ac0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac151ad0 0x7fc5ac156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0c2420 con 0x7fc5ac157a20 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ac1b0 con 0x7fc5ac0ca610 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.628+0000 7fc5ab59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ac0ac490 con 0x7fc5ac151ad0 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48112/0 (socket says 172.21.15.45:48112) 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 -- 172.21.15.45:0/1645267920 learned_addr learned my addr 172.21.15.45:0/1645267920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aa59c640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ac0ca610 0x7fc5ac0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5a9d9b640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac151ad0 0x7fc5ac156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 -- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac151ad0 msgr2=0x7fc5ac156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac151ad0 0x7fc5ac156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 -- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ac0ca610 msgr2=0x7fc5ac0af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ac0ca610 0x7fc5ac0af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.629+0000 7fc5aad9d640 1 -- 172.21.15.45:0/1645267920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940094d0 con 0x7fc5ac157a20 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5aad9d640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4007e60 tx=0x7fc5a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4014620 con 0x7fc5ac157a20 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400ee90 con 0x7fc5ac157a20 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40149e0 con 0x7fc5ac157a20 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ac0c3590 con 0x7fc5ac157a20 2023-12-08T08:16:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.630+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ac156ff0 con 0x7fc5ac157a20 2023-12-08T08:16:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.631+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ac0c3ab0 con 0x7fc5ac157a20 2023-12-08T08:16:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.633+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5a4014b40 con 0x7fc5ac157a20 2023-12-08T08:16:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.633+0000 7fc5a2ffd640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 0x7fc58c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.634+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc5a4089ff0 con 0x7fc5ac157a20 2023-12-08T08:16:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.634+0000 7fc5aa59c640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 0x7fc58c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.634+0000 7fc5aa59c640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 0x7fc58c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac152d00 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.639+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5ac0c3ab0 con 0x7fc5ac157a20 2023-12-08T08:16:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.833+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5ac0c3ab0 con 0x7fc5ac157a20 2023-12-08T08:16:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.834+0000 7fc5a2ffd640 1 -- 172.21.15.45:0/1645267920 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5ac0c3ab0 con 0x7fc5ac157a20 2023-12-08T08:16:41.837 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 msgr2=0x7fc58c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 0x7fc58c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac152d00 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 msgr2=0x7fc5ac146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4007e60 tx=0x7fc5a400e4b0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 shutdown_connections 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc58c06ae70 0x7fc58c06d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc5ac151ad0 0x7fc5ac156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5ac157a20 0x7fc5ac146cb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 --2- 172.21.15.45:0/1645267920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ac0ca610 0x7fc5ac0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.837+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 >> 172.21.15.45:0/1645267920 conn(0x7fc5ac066610 msgr2=0x7fc5ac0c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.838+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 shutdown_connections 2023-12-08T08:16:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:41.838+0000 7fc5ab59e640 1 -- 172.21.15.45:0/1645267920 wait complete. 2023-12-08T08:16:41.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:42.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.067+0000 7f4f84928640 1 Processor -- start 2023-12-08T08:16:42.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.067+0000 7f4f84928640 1 -- start start 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.068+0000 7f4f84928640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f80155c50 0x7f4f8006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.068+0000 7f4f84928640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f80158fe0 con 0x7f4f8015c150 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.068+0000 7f4f84928640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8015c5c0 con 0x7f4f8015bca0 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.068+0000 7f4f84928640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800c7160 con 0x7f4f80155c50 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f8015c150 0x7f4f800c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43806/0 (socket says 172.21.15.45:43806) 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f80155c50 0x7f4f8006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7ffff640 1 -- 172.21.15.45:0/3656470083 learned_addr learned my addr 172.21.15.45:0/3656470083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:42.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7f7fe640 1 -- 172.21.15.45:0/3656470083 >> v1:172.21.15.114:6789/0 conn(0x7f4f8015bca0 legacy=0x7f4f800c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:42.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7f7fe640 1 -- 172.21.15.45:0/3656470083 >> v1:172.21.15.45:6789/0 conn(0x7f4f8015c150 legacy=0x7f4f800c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.069+0000 7f4f7f7fe640 1 -- 172.21.15.45:0/3656470083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f801586d0 con 0x7f4f80155c50 2023-12-08T08:16:42.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.070+0000 7f4f7f7fe640 1 --2- 172.21.15.45:0/3656470083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f80155c50 0x7f4f8006f1c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4f700097a0 tx=0x7f4f7002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34604bc0ea9a61d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f7e7fc640 1 -- 172.21.15.45:0/3656470083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7002f050 con 0x7f4f80155c50 2023-12-08T08:16:42.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f7e7fc640 1 -- 172.21.15.45:0/3656470083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70031700 con 0x7f4f80155c50 2023-12-08T08:16:42.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f7e7fc640 1 -- 172.21.15.45:0/3656470083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70031a90 con 0x7f4f80155c50 2023-12-08T08:16:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 -- 172.21.15.45:0/3656470083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f80155c50 msgr2=0x7f4f8006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 --2- 172.21.15.45:0/3656470083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f80155c50 0x7f4f8006f1c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4f700097a0 tx=0x7f4f7002b7a0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 -- 172.21.15.45:0/3656470083 shutdown_connections 2023-12-08T08:16:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 --2- 172.21.15.45:0/3656470083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f80155c50 0x7f4f8006f1c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 -- 172.21.15.45:0/3656470083 >> 172.21.15.45:0/3656470083 conn(0x7f4f800a9620 msgr2=0x7f4f800a9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:42.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 -- 172.21.15.45:0/3656470083 shutdown_connections 2023-12-08T08:16:42.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.071+0000 7f4f84928640 1 -- 172.21.15.45:0/3656470083 wait complete. 2023-12-08T08:16:42.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.073+0000 7f4f84928640 1 Processor -- start 2023-12-08T08:16:42.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.073+0000 7f4f84928640 1 -- start start 2023-12-08T08:16:42.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 0x7f4f8006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f8015bca0 0x7f4f800c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8014d130 con 0x7f4f8015c150 2023-12-08T08:16:42.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8006b680 con 0x7f4f80155c50 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.074+0000 7f4f84928640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8014afc0 con 0x7f4f8015bca0 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48134/0 (socket says 172.21.15.45:48134) 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 -- 172.21.15.45:0/1873631460 learned_addr learned my addr 172.21.15.45:0/1873631460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7f7fe640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 0x7f4f8006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 -- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f8015bca0 msgr2=0x7f4f800c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f8015bca0 0x7f4f800c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 -- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 msgr2=0x7f4f8006cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 0x7f4f8006cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 -- 172.21.15.45:0/1873631460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009400 con 0x7f4f8015c150 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7f7fe640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 0x7f4f8006cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.075+0000 7f4f7ffff640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800c3c0 tx=0x7f4f7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.076+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78005ce0 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.076+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78005e40 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.076+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8014ace0 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.076+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780072d0 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.076+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f801f2660 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.077+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f801f27f0 con 0x7f4f8015c150 2023-12-08T08:16:42.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.078+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f780074f0 con 0x7f4f8015c150 2023-12-08T08:16:42.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.079+0000 7f4f77fff640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 0x7f4f6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.079+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f78088b80 con 0x7f4f8015c150 2023-12-08T08:16:42.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.079+0000 7f4f7f7fe640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 0x7f4f6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.080+0000 7f4f7f7fe640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 0x7f4f6006d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f70035000 tx=0x7f4f70008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.083+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f78053b90 con 0x7f4f8015c150 2023-12-08T08:16:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.277+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f800673e0 con 0x7f4f8015c150 2023-12-08T08:16:42.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.278+0000 7f4f77fff640 1 -- 172.21.15.45:0/1873631460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f780170a0 con 0x7f4f8015c150 2023-12-08T08:16:42.281 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.280+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 msgr2=0x7f4f6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.280+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 0x7f4f6006d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f70035000 tx=0x7f4f70008030 comp rx=0 tx=0).stop 2023-12-08T08:16:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.280+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 msgr2=0x7f4f801ee360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.280+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800c3c0 tx=0x7f4f7800c880 comp rx=0 tx=0).stop 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 shutdown_connections 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f6006ae40 0x7f4f6006d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f8015bca0 0x7f4f800c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f8015c150 0x7f4f801ee360 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 --2- 172.21.15.45:0/1873631460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f80155c50 0x7f4f8006cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 >> 172.21.15.45:0/1873631460 conn(0x7f4f800a9620 msgr2=0x7f4f800c7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 shutdown_connections 2023-12-08T08:16:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.281+0000 7f4f84928640 1 -- 172.21.15.45:0/1873631460 wait complete. 2023-12-08T08:16:42.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:16:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.528+0000 7f9de4a44640 1 Processor -- start 2023-12-08T08:16:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.528+0000 7f9de4a44640 1 -- start start 2023-12-08T08:16:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.530+0000 7f9de4a44640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9de0155bf0 0x7f9de01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.530+0000 7f9de4a44640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de006d230 con 0x7f9de0159eb0 2023-12-08T08:16:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.530+0000 7f9de4a44640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de015cd10 con 0x7f9de015c220 2023-12-08T08:16:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.530+0000 7f9de4a44640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de00c6090 con 0x7f9de0155bf0 2023-12-08T08:16:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dded9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9de0159eb0 0x7f9de015a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43810/0 (socket says 172.21.15.45:43810) 2023-12-08T08:16:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dded9d640 1 -- 172.21.15.45:0/2730763605 learned_addr learned my addr 172.21.15.45:0/2730763605 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dd7fff640 1 --2- 172.21.15.45:0/2730763605 >> v2:172.21.15.45:3300/0 conn(0x7f9de0155bf0 0x7f9de01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dd7fff640 1 -- 172.21.15.45:0/2730763605 >> v1:172.21.15.114:6789/0 conn(0x7f9de015c220 legacy=0x7f9de015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dd7fff640 1 -- 172.21.15.45:0/2730763605 >> v1:172.21.15.45:6789/0 conn(0x7f9de0159eb0 legacy=0x7f9de015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dddd9b640 1 -- 172.21.15.45:0/2730763605 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208425064 0 0) 0x7f9de006d230 con 0x7f9de0159eb0 2023-12-08T08:16:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.531+0000 7f9dd7fff640 1 -- 172.21.15.45:0/2730763605 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de006d480 con 0x7f9de0155bf0 2023-12-08T08:16:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.533+0000 7f9dd7fff640 1 --2- 172.21.15.45:0/2730763605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de0155bf0 0x7f9de01560a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80097a0 tx=0x7f9dc802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18c824359494763 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.533+0000 7f9dddd9b640 1 -- 172.21.15.45:0/2730763605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8031830 con 0x7f9de0155bf0 2023-12-08T08:16:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.533+0000 7f9dddd9b640 1 -- 172.21.15.45:0/2730763605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8031990 con 0x7f9de0155bf0 2023-12-08T08:16:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.533+0000 7f9dddd9b640 1 -- 172.21.15.45:0/2730763605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8031d20 con 0x7f9de0155bf0 2023-12-08T08:16:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 -- 172.21.15.45:0/2730763605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de0155bf0 msgr2=0x7f9de01560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 --2- 172.21.15.45:0/2730763605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de0155bf0 0x7f9de01560a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80097a0 tx=0x7f9dc802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 -- 172.21.15.45:0/2730763605 shutdown_connections 2023-12-08T08:16:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 --2- 172.21.15.45:0/2730763605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de0155bf0 0x7f9de01560a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 -- 172.21.15.45:0/2730763605 >> 172.21.15.45:0/2730763605 conn(0x7f9de00661f0 msgr2=0x7f9de0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 -- 172.21.15.45:0/2730763605 shutdown_connections 2023-12-08T08:16:42.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.534+0000 7f9de4a44640 1 -- 172.21.15.45:0/2730763605 wait complete. 2023-12-08T08:16:42.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.536+0000 7f9de4a44640 1 Processor -- start 2023-12-08T08:16:42.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.536+0000 7f9de4a44640 1 -- start start 2023-12-08T08:16:42.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de0159eb0 0x7f9de00a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9de00a5020 0x7f9de0070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a4270 con 0x7f9de015c220 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a3cb0 con 0x7f9de0159eb0 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9de4a44640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00aada0 con 0x7f9de00a5020 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48160/0 (socket says 172.21.15.45:48160) 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.537+0000 7f9dd7fff640 1 -- 172.21.15.45:0/655536988 learned_addr learned my addr 172.21.15.45:0/655536988 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dded9d640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9de00a5020 0x7f9de0070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dde59c640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de0159eb0 0x7f9de00a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 -- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9de00a5020 msgr2=0x7f9de0070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9de00a5020 0x7f9de0070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 -- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de0159eb0 msgr2=0x7f9de00a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de0159eb0 0x7f9de00a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 -- 172.21.15.45:0/655536988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc8009400 con 0x7f9de015c220 2023-12-08T08:16:42.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd7fff640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802be60 tx=0x7f9dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.538+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80317f0 con 0x7f9de015c220 2023-12-08T08:16:42.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.539+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8004030 con 0x7f9de015c220 2023-12-08T08:16:42.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.539+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004400 con 0x7f9de015c220 2023-12-08T08:16:42.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.539+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de01f21c0 con 0x7f9de015c220 2023-12-08T08:16:42.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.539+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00a3f00 con 0x7f9de015c220 2023-12-08T08:16:42.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.540+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de00a4420 con 0x7f9de015c220 2023-12-08T08:16:42.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.541+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dc8043070 con 0x7f9de015c220 2023-12-08T08:16:42.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.542+0000 7f9dd6ffd640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 0x7f9dc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:42.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.542+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9dc80ab5b0 con 0x7f9de015c220 2023-12-08T08:16:42.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.542+0000 7f9dde59c640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 0x7f9dc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:42.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.543+0000 7f9dde59c640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 0x7f9dc006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9de00a6cd0 tx=0x7f9dd0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:42.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.547+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9de00a4420 con 0x7f9de015c220 2023-12-08T08:16:42.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.742+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9de00a4420 con 0x7f9de015c220 2023-12-08T08:16:42.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.743+0000 7f9dd6ffd640 1 -- 172.21.15.45:0/655536988 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+207 (secure 0 0 0) 0x7f9dc80350e0 con 0x7f9de015c220 2023-12-08T08:16:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:42.746 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 5, 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 6, 2023-12-08T08:16:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_data" 2023-12-08T08:16:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:16:42.748 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 msgr2=0x7f9dc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 0x7f9dc006d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9de00a6cd0 tx=0x7f9dd0009040 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 msgr2=0x7f9de006fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802be60 tx=0x7f9dc80046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 shutdown_connections 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9dc006ae40 0x7f9dc006d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9de00a5020 0x7f9de0070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9de015c220 0x7f9de006fbe0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 --2- 172.21.15.45:0/655536988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9de0159eb0 0x7f9de00a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 >> 172.21.15.45:0/655536988 conn(0x7f9de00661f0 msgr2=0x7f9de015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 shutdown_connections 2023-12-08T08:16:42.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.746+0000 7f9de4a44640 1 -- 172.21.15.45:0/655536988 wait complete. 2023-12-08T08:16:42.770 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:16:42.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:16:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.997+0000 7fea1ce85640 1 Processor -- start 2023-12-08T08:16:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.997+0000 7fea1ce85640 1 -- start start 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.998+0000 7fea1ce85640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 0x7fea180c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.998+0000 7fea1ce85640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea180c57b0 0x7fea180a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea1ce85640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180a9810 con 0x7fea180c5c10 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea1ce85640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180a5040 con 0x7fea180c57b0 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea1ce85640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180a52e0 con 0x7fea180c1640 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea17fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea180c5c10 0x7fea18151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43818/0 (socket says 172.21.15.45:43818) 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea17fff640 1 -- 172.21.15.45:0/401048457 learned_addr learned my addr 172.21.15.45:0/401048457 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea177fe640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 0x7fea180c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:42.999+0000 7fea0ffff640 1 --2- 172.21.15.45:0/401048457 >> v2:172.21.15.114:3300/0 conn(0x7fea180c57b0 0x7fea180a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318334314 0 0) 0x7fea180a9810 con 0x7fea180c5c10 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea04003520 con 0x7fea180c5c10 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871797291 0 0) 0x7fea04003520 con 0x7fea180c5c10 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 msgr2=0x7fea180c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 0x7fea180c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 >> v2:172.21.15.114:3300/0 conn(0x7fea180c57b0 msgr2=0x7fea180a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 --2- 172.21.15.45:0/401048457 >> v2:172.21.15.114:3300/0 conn(0x7fea180c57b0 0x7fea180a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180a94a0 con 0x7fea180c5c10 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fea100019f0 con 0x7fea180c5c10 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea0ffff640 1 --2- 172.21.15.45:0/401048457 >> v2:172.21.15.114:3300/0 conn(0x7fea180c57b0 0x7fea180a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 >> v1:172.21.15.45:6789/0 conn(0x7fea180c5c10 legacy=0x7fea18151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 0x7fea04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180a5040 con 0x7fea04003970 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180a52e0 con 0x7fea040047c0 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.000+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0400b980 con 0x7fea180c1640 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea04003970 0x7fea04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 -- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 msgr2=0x7fea04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea180c1640 0x7fea04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 -- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea040047c0 msgr2=0x7fea04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea0ffff640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea177fe640 1 -- 172.21.15.45:0/401048457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04003520 con 0x7fea04003970 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.001+0000 7fea0ffff640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea040047c0 0x7fea04004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.002+0000 7fea177fe640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea04003970 0x7fea04003d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea08009ac0 tx=0x7fea040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732a5d0877dbfc55 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.002+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0802c710 con 0x7fea04003970 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0802c870 con 0x7fea04003970 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea16ffd640 1 -- 172.21.15.45:0/401048457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0802cc00 con 0x7fea04003970 2023-12-08T08:16:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 -- 172.21.15.45:0/401048457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea04003970 msgr2=0x7fea04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 --2- 172.21.15.45:0/401048457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea04003970 0x7fea04003d90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea08009ac0 tx=0x7fea040057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea17fff640 1 -- 172.21.15.45:0/401048457 reap_dead start 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 -- 172.21.15.45:0/401048457 shutdown_connections 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 -- 172.21.15.45:0/401048457 >> 172.21.15.45:0/401048457 conn(0x7fea18066df0 msgr2=0x7fea180a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 -- 172.21.15.45:0/401048457 shutdown_connections 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.003+0000 7fea1ce85640 1 -- 172.21.15.45:0/401048457 wait complete. 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.005+0000 7fea1ce85640 1 Processor -- start 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.005+0000 7fea1ce85640 1 -- start start 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 0x7fea180a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 0x7fea180c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18071a00 con 0x7fea181e9d70 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181e9920 con 0x7fea180c01c0 2023-12-08T08:16:43.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea1ce85640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1806fa30 con 0x7fea04003970 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.006+0000 7fea0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48180/0 (socket says 172.21.15.45:48180) 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 -- 172.21.15.45:0/3794298736 learned_addr learned my addr 172.21.15.45:0/3794298736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea177fe640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 0x7fea180a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea17fff640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 0x7fea180c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 -- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 msgr2=0x7fea180a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 0x7fea180a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 -- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 msgr2=0x7fea180c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 0x7fea180c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 -- 172.21.15.45:0/3794298736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea181ed270 con 0x7fea181e9d70 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea177fe640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 0x7fea180a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea17fff640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 0x7fea180c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.007+0000 7fea0ffff640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea00010c30 tx=0x7fea0000e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.008+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000ee50 con 0x7fea181e9d70 2023-12-08T08:16:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.008+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0001c400 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.008+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0001c770 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.008+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea181ed550 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.008+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea181edb10 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.009+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea18067900 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.010+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea0001c8d0 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.011+0000 7fea14ff9640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.011+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fea00089d60 con 0x7fea181e9d70 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.011+0000 7fea177fe640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.012+0000 7fea177fe640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 0x7fe9f806d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fea08036000 tx=0x7fea08030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:43.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.018+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea00054cc0 con 0x7fea181e9d70 2023-12-08T08:16:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:43.214+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea180743e0 con 0x7fea181e9d70 2023-12-08T08:16:44.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.057+0000 7fea14ff9640 1 -- 172.21.15.45:0/3794298736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v41) v1 ==== 140+0+0 (secure 0 0 0) 0x7fea000582e0 con 0x7fea181e9d70 2023-12-08T08:16:44.061 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:16:44.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.061+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 msgr2=0x7fe9f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.061+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 0x7fe9f806d330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fea08036000 tx=0x7fea08030000 comp rx=0 tx=0).stop 2023-12-08T08:16:44.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.061+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 msgr2=0x7fea181ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.061+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea00010c30 tx=0x7fea0000e540 comp rx=0 tx=0).stop 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 shutdown_connections 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9f806ae70 0x7fe9f806d330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea180c01c0 0x7fea180c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea181e9d70 0x7fea181ea1f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 --2- 172.21.15.45:0/3794298736 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea04003970 0x7fea180a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.062+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 >> 172.21.15.45:0/3794298736 conn(0x7fea18066df0 msgr2=0x7fea180becf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.063+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 shutdown_connections 2023-12-08T08:16:44.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.063+0000 7fea1ce85640 1 -- 172.21.15.45:0/3794298736 wait complete. 2023-12-08T08:16:44.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:16:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.295+0000 7ff78ac36640 1 Processor -- start 2023-12-08T08:16:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.295+0000 7ff78ac36640 1 -- start start 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.296+0000 7ff78ac36640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff7840c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.296+0000 7ff78ac36640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff784152660 con 0x7ff7840c1930 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.296+0000 7ff78ac36640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff784153200 con 0x7ff78406d960 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.296+0000 7ff78ac36640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840a4d10 con 0x7ff7840aaf60 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.297+0000 7ff7891d3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff7840c1930 0x7ff78415cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43820/0 (socket says 172.21.15.45:43820) 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.297+0000 7ff7891d3640 1 -- 172.21.15.45:0/3482616239 learned_addr learned my addr 172.21.15.45:0/3482616239 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.297+0000 7ff7889d2640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff7840c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.297+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301048680 0 0) 0x7ff784152660 con 0x7ff7840c1930 2023-12-08T08:16:44.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76c003520 con 0x7ff7840c1930 2023-12-08T08:16:44.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893873376 0 0) 0x7ff76c003520 con 0x7ff7840c1930 2023-12-08T08:16:44.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 msgr2=0x7ff7840c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:44.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff7840c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 >> v1:172.21.15.114:6789/0 conn(0x7ff78406d960 legacy=0x7ff784152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840c3310 con 0x7ff7840c1930 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ff77c0019f0 con 0x7ff7840c1930 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 >> v1:172.21.15.45:6789/0 conn(0x7ff7840c1930 legacy=0x7ff78415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff76c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff76c003ee0 0x7ff76c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c004d00 0x7ff76c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840a4d10 con 0x7ff76c003ee0 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00ba90 con 0x7ff76c004d00 2023-12-08T08:16:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c00bc50 con 0x7ff7840aaf60 2023-12-08T08:16:44.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.298+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff76c003ee0 0x7ff76c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff7889d2640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff76c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff7891d3640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c004d00 0x7ff76c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff77bfff640 1 -- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 msgr2=0x7ff76c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:44.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7840aaf60 0x7ff76c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff77bfff640 1 -- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c004d00 msgr2=0x7ff76c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff76c004d00 0x7ff76c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.299+0000 7ff77bfff640 1 -- 172.21.15.45:0/3482616239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c003520 con 0x7ff76c003ee0 2023-12-08T08:16:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.300+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff76c003ee0 0x7ff76c0047c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff774001910 tx=0x7ff76c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783e23468e050976 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.300+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774032620 con 0x7ff76c003ee0 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.300+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774032780 con 0x7ff76c003ee0 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.300+0000 7ff77b7fe640 1 -- 172.21.15.45:0/3482616239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774032b50 con 0x7ff76c003ee0 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 -- 172.21.15.45:0/3482616239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff76c003ee0 msgr2=0x7ff76c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3482616239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff76c003ee0 0x7ff76c0047c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff774001910 tx=0x7ff76c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff7891d3640 1 -- 172.21.15.45:0/3482616239 reap_dead start 2023-12-08T08:16:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 -- 172.21.15.45:0/3482616239 shutdown_connections 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 -- 172.21.15.45:0/3482616239 >> 172.21.15.45:0/3482616239 conn(0x7ff7840c2430 msgr2=0x7ff7840c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 -- 172.21.15.45:0/3482616239 shutdown_connections 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.301+0000 7ff78ac36640 1 -- 172.21.15.45:0/3482616239 wait complete. 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.303+0000 7ff78ac36640 1 Processor -- start 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.303+0000 7ff78ac36640 1 -- start start 2023-12-08T08:16:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff76c003ee0 0x7ff7841e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff784147010 0x7ff784070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7841e8390 con 0x7ff78414c8f0 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840725f0 con 0x7ff784147010 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff78ac36640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840728d0 con 0x7ff76c003ee0 2023-12-08T08:16:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48198/0 (socket says 172.21.15.45:48198) 2023-12-08T08:16:44.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.304+0000 7ff77bfff640 1 -- 172.21.15.45:0/3855155389 learned_addr learned my addr 172.21.15.45:0/3855155389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:44.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff7889d2640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff76c003ee0 0x7ff7841e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff7891d3640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff784147010 0x7ff784070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 -- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff76c003ee0 msgr2=0x7ff7841e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff76c003ee0 0x7ff7841e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 -- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff784147010 msgr2=0x7ff784070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:44.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff784147010 0x7ff784070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:44.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 -- 172.21.15.45:0/3855155389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7841e7fb0 con 0x7ff78414c8f0 2023-12-08T08:16:44.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.305+0000 7ff77bfff640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff774034040 tx=0x7ff7740012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:44.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.306+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774005270 con 0x7ff78414c8f0 2023-12-08T08:16:44.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.306+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740053d0 con 0x7ff78414c8f0 2023-12-08T08:16:44.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.306+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740069d0 con 0x7ff78414c8f0 2023-12-08T08:16:44.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.306+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff784155900 con 0x7ff78414c8f0 2023-12-08T08:16:44.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.306+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7841475d0 con 0x7ff78414c8f0 2023-12-08T08:16:44.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.307+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff784074670 con 0x7ff78414c8f0 2023-12-08T08:16:44.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.308+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff774042070 con 0x7ff78414c8f0 2023-12-08T08:16:44.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.309+0000 7ff7797fa640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 0x7ff77006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:44.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.309+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6400+0+0 (secure 0 0 0) 0x7ff7740ab610 con 0x7ff78414c8f0 2023-12-08T08:16:44.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.309+0000 7ff7889d2640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 0x7ff77006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:44.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.310+0000 7ff7889d2640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 0x7ff77006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff780009a10 tx=0x7ff780008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:44.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.315+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff774076420 con 0x7ff78414c8f0 2023-12-08T08:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:44.511+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff784151d60 con 0x7ff78414c8f0 2023-12-08T08:16:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.064+0000 7ff7797fa640 1 -- 172.21.15.45:0/3855155389 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff774079a40 con 0x7ff78414c8f0 2023-12-08T08:16:45.067 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' created 2023-12-08T08:16:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.068+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 msgr2=0x7ff77006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.068+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 0x7ff77006d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff780009a10 tx=0x7ff780008040 comp rx=0 tx=0).stop 2023-12-08T08:16:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.068+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 msgr2=0x7ff784146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.068+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff774034040 tx=0x7ff7740012b0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 shutdown_connections 2023-12-08T08:16:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff77006ae70 0x7ff77006d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff784147010 0x7ff784070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78414c8f0 0x7ff784146700 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 --2- 172.21.15.45:0/3855155389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff76c003ee0 0x7ff7841e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.069+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 >> 172.21.15.45:0/3855155389 conn(0x7ff7840c2430 msgr2=0x7ff784150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.071+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 shutdown_connections 2023-12-08T08:16:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.072+0000 7ff78ac36640 1 -- 172.21.15.45:0/3855155389 wait complete. 2023-12-08T08:16:45.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:16:45.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.301+0000 7f4bdfb16640 1 Processor -- start 2023-12-08T08:16:45.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.301+0000 7f4bdfb16640 1 -- start start 2023-12-08T08:16:45.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdfb16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd8151d70 0x7f4bd8155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdfb16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bd806ca50 0x7f4bd80bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdfb16640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80c5670 con 0x7f4bd80c4a60 2023-12-08T08:16:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdfb16640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd8158120 con 0x7f4bd806ca50 2023-12-08T08:16:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdfb16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80a4f60 con 0x7f4bd8151d70 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdd0b1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4bd80c4a60 0x7f4bd8158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36790/0 (socket says 172.21.15.45:36790) 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bdd0b1640 1 -- 172.21.15.45:0/2570414109 learned_addr learned my addr 172.21.15.45:0/2570414109 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.303+0000 7f4bde0b3640 1 --2- 172.21.15.45:0/2570414109 >> v2:172.21.15.45:3300/0 conn(0x7f4bd806ca50 0x7f4bd80bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bdd8b2640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd8151d70 0x7f4bd8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919109706 0 0) 0x7f4bd80c5670 con 0x7f4bd80c4a60 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc4003520 con 0x7f4bd80c4a60 2023-12-08T08:16:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bde0b3640 1 -- 172.21.15.45:0/2570414109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd8151d70 msgr2=0x7f4bd8155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bde0b3640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd8151d70 0x7f4bd8155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888691957 0 0) 0x7f4bc4003520 con 0x7f4bd80c4a60 2023-12-08T08:16:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bde0b3640 1 -- 172.21.15.45:0/2570414109 >> v1:172.21.15.45:6789/0 conn(0x7f4bd80c4a60 legacy=0x7f4bd8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.304+0000 7f4bde0b3640 1 -- 172.21.15.45:0/2570414109 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80a5240 con 0x7f4bd806ca50 2023-12-08T08:16:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.306+0000 7f4bde0b3640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd806ca50 0x7f4bd80bed60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009d90 tx=0x7f4bd002bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826796dfb4284c69 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.306+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8001670 con 0x7f4bd806ca50 2023-12-08T08:16:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.306+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd002c780 con 0x7f4bd806ca50 2023-12-08T08:16:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.306+0000 7f4bdc8b0640 1 -- 172.21.15.45:0/2570414109 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd002cb10 con 0x7f4bd806ca50 2023-12-08T08:16:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 -- 172.21.15.45:0/2570414109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd806ca50 msgr2=0x7f4bd80bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd806ca50 0x7f4bd80bed60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009d90 tx=0x7f4bd002bc50 comp rx=0 tx=0).stop 2023-12-08T08:16:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 -- 172.21.15.45:0/2570414109 shutdown_connections 2023-12-08T08:16:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd806ca50 0x7f4bd80bed60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/2570414109 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd8151d70 0x7f4bd8155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 -- 172.21.15.45:0/2570414109 >> 172.21.15.45:0/2570414109 conn(0x7f4bd80c2430 msgr2=0x7f4bd80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 -- 172.21.15.45:0/2570414109 shutdown_connections 2023-12-08T08:16:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.307+0000 7f4bdfb16640 1 -- 172.21.15.45:0/2570414109 wait complete. 2023-12-08T08:16:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.309+0000 7f4bdfb16640 1 Processor -- start 2023-12-08T08:16:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.309+0000 7f4bdfb16640 1 -- start start 2023-12-08T08:16:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd806ca50 0x7f4bd80ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bd8151d70 0x7f4bd81e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80abb50 con 0x7f4bd80c4a60 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80a4640 con 0x7f4bd8151d70 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdfb16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd81ea7e0 con 0x7f4bd806ca50 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdd0b1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdd0b1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33430/0 (socket says 172.21.15.45:33430) 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.310+0000 7f4bdd0b1640 1 -- 172.21.15.45:0/4258852996 learned_addr learned my addr 172.21.15.45:0/4258852996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd8b2640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd806ca50 0x7f4bd80ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bde0b3640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bd8151d70 0x7f4bd81e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 -- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd806ca50 msgr2=0x7f4bd80ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd806ca50 0x7f4bd80ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 -- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bd8151d70 msgr2=0x7f4bd81e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bd8151d70 0x7f4bd81e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 -- 172.21.15.45:0/4258852996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009a70 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.311+0000 7f4bdd0b1640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c710 tx=0x7f4bc800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.312+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8005ad0 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.312+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8005c30 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.312+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8007070 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.312+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd80a4890 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.312+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd81578d0 con 0x7f4bd80c4a60 2023-12-08T08:16:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.313+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd8074670 con 0x7f4bd80c4a60 2023-12-08T08:16:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.314+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bc80071f0 con 0x7f4bd80c4a60 2023-12-08T08:16:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.315+0000 7f4bce7fc640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 0x7f4bbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.315+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6783+0+0 (secure 0 0 0) 0x7f4bc8089910 con 0x7f4bd80c4a60 2023-12-08T08:16:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.315+0000 7f4bdd8b2640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 0x7f4bbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.316+0000 7f4bdd8b2640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 0x7f4bbc06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80c53a0 tx=0x7f4bd4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:45.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.320+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bc80544f0 con 0x7f4bd80c4a60 2023-12-08T08:16:45.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:45.554+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f4bd80bfc70 con 0x7f4bd80c4a60 2023-12-08T08:16:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.092+0000 7f4bce7fc640 1 -- 172.21.15.45:0/4258852996 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f4bc8057b10 con 0x7f4bd80c4a60 2023-12-08T08:16:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 7 and data pool 8 2023-12-08T08:16:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 msgr2=0x7f4bbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 0x7f4bbc06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80c53a0 tx=0x7f4bd4008040 comp rx=0 tx=0).stop 2023-12-08T08:16:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 msgr2=0x7f4bd80a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c710 tx=0x7f4bc800cbd0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 shutdown_connections 2023-12-08T08:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4bbc06ae40 0x7f4bbc06d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bd8151d70 0x7f4bd81e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c4a60 0x7f4bd80a9100 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 --2- 172.21.15.45:0/4258852996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4bd806ca50 0x7f4bd80ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 >> 172.21.15.45:0/4258852996 conn(0x7f4bd80c2430 msgr2=0x7f4bd80a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.096+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 shutdown_connections 2023-12-08T08:16:46.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.097+0000 7f4bdfb16640 1 -- 172.21.15.45:0/4258852996 wait complete. 2023-12-08T08:16:46.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.333+0000 7fba8227e640 1 Processor -- start 2023-12-08T08:16:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.333+0000 7fba8227e640 1 -- start start 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba7c1593e0 0x7fba7c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba7c0c6660 0x7fba7c15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0c5f50 con 0x7fba7c1593e0 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c1597c0 con 0x7fba7c0c6660 2023-12-08T08:16:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.334+0000 7fba8227e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15c7e0 con 0x7fba7c0c7f60 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba7c1593e0 0x7fba7c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba7c1593e0 0x7fba7c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33442/0 (socket says 172.21.15.45:33442) 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 -- 172.21.15.45:0/2894681582 learned_addr learned my addr 172.21.15.45:0/2894681582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba81a7d640 1 --2- 172.21.15.45:0/2894681582 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0c6660 0x7fba7c15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba80a7b640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 -- 172.21.15.45:0/2894681582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 msgr2=0x7fba7c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 -- 172.21.15.45:0/2894681582 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0c6660 msgr2=0x7fba7c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 --2- 172.21.15.45:0/2894681582 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0c6660 0x7fba7c15c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.335+0000 7fba8127c640 1 -- 172.21.15.45:0/2894681582 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0c5c70 con 0x7fba7c1593e0 2023-12-08T08:16:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.337+0000 7fba8127c640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c1593e0 0x7fba7c0c6120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06b300 tx=0x7fba6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe905dcb75d9455 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.337+0000 7fba7bfff640 1 -- 172.21.15.45:0/2894681582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c02c9e0 con 0x7fba7c1593e0 2023-12-08T08:16:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.337+0000 7fba7bfff640 1 -- 172.21.15.45:0/2894681582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c02cb40 con 0x7fba7c1593e0 2023-12-08T08:16:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.337+0000 7fba7bfff640 1 -- 172.21.15.45:0/2894681582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0343f0 con 0x7fba7c1593e0 2023-12-08T08:16:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 -- 172.21.15.45:0/2894681582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c1593e0 msgr2=0x7fba7c0c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c1593e0 0x7fba7c0c6120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06b300 tx=0x7fba6c02be40 comp rx=0 tx=0).stop 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 -- 172.21.15.45:0/2894681582 shutdown_connections 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 --2- 172.21.15.45:0/2894681582 >> v2:172.21.15.114:3300/0 conn(0x7fba7c0c6660 0x7fba7c15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 --2- 172.21.15.45:0/2894681582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c1593e0 0x7fba7c0c6120 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 -- 172.21.15.45:0/2894681582 >> 172.21.15.45:0/2894681582 conn(0x7fba7c0668b0 msgr2=0x7fba7c0a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 -- 172.21.15.45:0/2894681582 shutdown_connections 2023-12-08T08:16:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.338+0000 7fba8227e640 1 -- 172.21.15.45:0/2894681582 wait complete. 2023-12-08T08:16:46.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.340+0000 7fba8227e640 1 Processor -- start 2023-12-08T08:16:46.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.340+0000 7fba8227e640 1 -- start start 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 0x7fba7c1f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1f1210 con 0x7fba7c0c6660 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1f0ec0 con 0x7fba7c1593e0 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8227e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0ac460 con 0x7fba7c0c7f60 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8127c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8127c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33458/0 (socket says 172.21.15.45:33458) 2023-12-08T08:16:46.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.341+0000 7fba8127c640 1 -- 172.21.15.45:0/4081629670 learned_addr learned my addr 172.21.15.45:0/4081629670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:46.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba81a7d640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 0x7fba7c1f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba80a7b640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 -- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 msgr2=0x7fba7c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 -- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 msgr2=0x7fba7c1f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 0x7fba7c1f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 -- 172.21.15.45:0/4081629670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009b30 con 0x7fba7c0c6660 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba81a7d640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 0x7fba7c1f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8127c640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fba6c036040 tx=0x7fba6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c03e450 con 0x7fba7c0c6660 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c03e5b0 con 0x7fba7c0c6660 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c03e960 con 0x7fba7c0c6660 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.342+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0ac720 con 0x7fba7c0c6660 2023-12-08T08:16:46.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.343+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c15b830 con 0x7fba7c0c6660 2023-12-08T08:16:46.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.344+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c1f1480 con 0x7fba7c0c6660 2023-12-08T08:16:46.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.345+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba6c03eac0 con 0x7fba7c0c6660 2023-12-08T08:16:46.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.346+0000 7fba79ffb640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 0x7fba6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.346+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fba6c0ac5e0 con 0x7fba7c0c6660 2023-12-08T08:16:46.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.346+0000 7fba80a7b640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 0x7fba6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.347+0000 7fba80a7b640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 0x7fba6806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba7c1e51b0 tx=0x7fba70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.350+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba6c0771e0 con 0x7fba7c0c6660 2023-12-08T08:16:46.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.547+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba7c0673e0 con 0x7fba7c0c6660 2023-12-08T08:16:46.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.551+0000 7fba79ffb640 1 -- 172.21.15.45:0/4081629670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+20479 (secure 0 0 0) 0x7fba6c07a800 con 0x7fba7c0c6660 2023-12-08T08:16:46.554 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:46.554 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:45.556648+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.553+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 msgr2=0x7fba6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.553+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 0x7fba6806d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba7c1e51b0 tx=0x7fba70008040 comp rx=0 tx=0).stop 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.553+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 msgr2=0x7fba7c0ab060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.553+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fba6c036040 tx=0x7fba6c004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 shutdown_connections 2023-12-08T08:16:46.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba6806ae70 0x7fba6806d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba7c0c7f60 0x7fba7c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba7c1593e0 0x7fba7c1f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 --2- 172.21.15.45:0/4081629670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c6660 0x7fba7c0ab060 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 >> 172.21.15.45:0/4081629670 conn(0x7fba7c0668b0 msgr2=0x7fba7c156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 shutdown_connections 2023-12-08T08:16:46.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.554+0000 7fba8227e640 1 -- 172.21.15.45:0/4081629670 wait complete. 2023-12-08T08:16:46.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:46.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.798+0000 7f0a233b5640 1 Processor -- start 2023-12-08T08:16:46.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.798+0000 7f0a233b5640 1 -- start start 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a233b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a1c0c1210 0x7f0a1c0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a233b5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c154850 con 0x7f0a1c14e840 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a233b5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c154b30 con 0x7f0a1c0a9e80 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a233b5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c14ec20 con 0x7f0a1c0c1210 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a21bb2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a1c0c1210 0x7f0a1c0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a223b3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a1c14e840 0x7f0a1c151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36804/0 (socket says 172.21.15.45:36804) 2023-12-08T08:16:46.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.800+0000 7f0a223b3640 1 -- 172.21.15.45:0/1717899640 learned_addr learned my addr 172.21.15.45:0/1717899640 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:46.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.801+0000 7f0a21bb2640 1 -- 172.21.15.45:0/1717899640 >> v1:172.21.15.114:6789/0 conn(0x7f0a1c0a9e80 legacy=0x7f0a1c0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:46.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.801+0000 7f0a21bb2640 1 -- 172.21.15.45:0/1717899640 >> v1:172.21.15.45:6789/0 conn(0x7f0a1c14e840 legacy=0x7f0a1c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.801+0000 7f0a21bb2640 1 -- 172.21.15.45:0/1717899640 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c154e10 con 0x7f0a1c0c1210 2023-12-08T08:16:46.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.802+0000 7f0a21bb2640 1 --2- 172.21.15.45:0/1717899640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c0c16a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0097a0 tx=0x7f0a0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8b7a7cca00b546 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.802+0000 7f0a213b1640 1 -- 172.21.15.45:0/1717899640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c02e070 con 0x7f0a1c0c1210 2023-12-08T08:16:46.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.802+0000 7f0a213b1640 1 -- 172.21.15.45:0/1717899640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c0315a0 con 0x7f0a1c0c1210 2023-12-08T08:16:46.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.802+0000 7f0a213b1640 1 -- 172.21.15.45:0/1717899640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c031930 con 0x7f0a1c0c1210 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 -- 172.21.15.45:0/1717899640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 msgr2=0x7f0a1c0c16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 --2- 172.21.15.45:0/1717899640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c0c16a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0097a0 tx=0x7f0a0c02b840 comp rx=0 tx=0).stop 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 -- 172.21.15.45:0/1717899640 shutdown_connections 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 --2- 172.21.15.45:0/1717899640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c0c16a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 -- 172.21.15.45:0/1717899640 >> 172.21.15.45:0/1717899640 conn(0x7f0a1c0c5780 msgr2=0x7f0a1c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 -- 172.21.15.45:0/1717899640 shutdown_connections 2023-12-08T08:16:46.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.803+0000 7f0a233b5640 1 -- 172.21.15.45:0/1717899640 wait complete. 2023-12-08T08:16:46.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.805+0000 7f0a233b5640 1 Processor -- start 2023-12-08T08:16:46.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.805+0000 7f0a233b5640 1 -- start start 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 0x7f0a1c14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a1c14e840 0x7f0a1c0beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c072330 con 0x7f0a1c0c1210 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1ecc40 con 0x7f0a1c0a9e80 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a233b5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1e9f20 con 0x7f0a1c14e840 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a21bb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a21bb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33484/0 (socket says 172.21.15.45:33484) 2023-12-08T08:16:46.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.806+0000 7f0a21bb2640 1 -- 172.21.15.45:0/3632885928 learned_addr learned my addr 172.21.15.45:0/3632885928 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a223b3640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 0x7f0a1c14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 -- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a1c14e840 msgr2=0x7f0a1c0beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a1c14e840 0x7f0a1c0beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 -- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 msgr2=0x7f0a1c14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 0x7f0a1c14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 -- 172.21.15.45:0/3632885928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009400 con 0x7f0a1c0c1210 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a223b3640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 0x7f0a1c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.807+0000 7f0a21bb2640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c034040 tx=0x7f0a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.808+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c032900 con 0x7f0a1c0c1210 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.808+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c032a80 con 0x7f0a1c0c1210 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.808+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c032e30 con 0x7f0a1c0c1210 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.808+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c1ea200 con 0x7f0a1c0c1210 2023-12-08T08:16:46.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.808+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c1ece90 con 0x7f0a1c0c1210 2023-12-08T08:16:46.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.809+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c0743e0 con 0x7f0a1c0c1210 2023-12-08T08:16:46.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.810+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a0c03b3f0 con 0x7f0a1c0c1210 2023-12-08T08:16:46.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.811+0000 7f0a12ffd640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 0x7f0a0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:46.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.812+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0a0c0abb60 con 0x7f0a1c0c1210 2023-12-08T08:16:46.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.812+0000 7f0a223b3640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 0x7f0a0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:46.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.812+0000 7f0a223b3640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 0x7f0a0006d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f60 tx=0x7f0a18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:46.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:46.816+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a0c076760 con 0x7f0a1c0c1210 2023-12-08T08:16:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.013+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a1c0a8150 con 0x7f0a1c0c1210 2023-12-08T08:16:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.015+0000 7f0a12ffd640 1 -- 172.21.15.45:0/3632885928 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f0a0c079d80 con 0x7f0a1c0c1210 2023-12-08T08:16:47.019 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:47.019 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:47.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.018+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 msgr2=0x7f0a0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.018+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 0x7f0a0006d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f60 tx=0x7f0a18009040 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.018+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 msgr2=0x7f0a1c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.018+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c034040 tx=0x7f0a0c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 shutdown_connections 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0a0006ae40 0x7f0a0006d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0a1c14e840 0x7f0a1c0beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a1c0c1210 0x7f0a1c06fd90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 --2- 172.21.15.45:0/3632885928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a1c0a9e80 0x7f0a1c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 >> 172.21.15.45:0/3632885928 conn(0x7f0a1c0c5780 msgr2=0x7f0a1c0c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 shutdown_connections 2023-12-08T08:16:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.019+0000 7f0a233b5640 1 -- 172.21.15.45:0/3632885928 wait complete. 2023-12-08T08:16:47.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:16:47.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.266+0000 7fbf648b3640 1 Processor -- start 2023-12-08T08:16:47.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.267+0000 7fbf648b3640 1 -- start start 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbf6014c280 0x7fbf600a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf6006d3e0 0x7fbf60155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600c60c0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf60152dc0 con 0x7fbf6014c280 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf648b3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601521d0 con 0x7fbf600c4970 2023-12-08T08:16:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.268+0000 7fbf5f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf6006d3e0 0x7fbf60155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf6006d3e0 0x7fbf60155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33488/0 (socket says 172.21.15.45:33488) 2023-12-08T08:16:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 -- 172.21.15.45:0/1347532646 learned_addr learned my addr 172.21.15.45:0/1347532646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5ed9d640 1 --2- 172.21.15.45:0/1347532646 >> v2:172.21.15.114:3300/0 conn(0x7fbf6014c280 0x7fbf600a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf57fff640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 -- 172.21.15.45:0/1347532646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 msgr2=0x7fbf6006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 -- 172.21.15.45:0/1347532646 >> v2:172.21.15.114:3300/0 conn(0x7fbf6014c280 msgr2=0x7fbf600a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 --2- 172.21.15.45:0/1347532646 >> v2:172.21.15.114:3300/0 conn(0x7fbf6014c280 0x7fbf600a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf5f59e640 1 -- 172.21.15.45:0/1347532646 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6014c660 con 0x7fbf6006d3e0 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.269+0000 7fbf57fff640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.270+0000 7fbf5f59e640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf60155790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbf600aaba0 tx=0x7fbf5802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9c6c8a66c5a0e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf5e59c640 1 -- 172.21.15.45:0/1347532646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5802c9f0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf5e59c640 1 -- 172.21.15.45:0/1347532646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5802cb50 con 0x7fbf6006d3e0 2023-12-08T08:16:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf5e59c640 1 -- 172.21.15.45:0/1347532646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580343f0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 -- 172.21.15.45:0/1347532646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 msgr2=0x7fbf60155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf60155790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbf600aaba0 tx=0x7fbf5802be50 comp rx=0 tx=0).stop 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 -- 172.21.15.45:0/1347532646 shutdown_connections 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf60155790 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1347532646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1347532646 >> v2:172.21.15.114:3300/0 conn(0x7fbf6014c280 0x7fbf600a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.271+0000 7fbf648b3640 1 -- 172.21.15.45:0/1347532646 >> 172.21.15.45:0/1347532646 conn(0x7fbf60066ce0 msgr2=0x7fbf600a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.272+0000 7fbf648b3640 1 -- 172.21.15.45:0/1347532646 shutdown_connections 2023-12-08T08:16:47.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.272+0000 7fbf648b3640 1 -- 172.21.15.45:0/1347532646 wait complete. 2023-12-08T08:16:47.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.273+0000 7fbf648b3640 1 Processor -- start 2023-12-08T08:16:47.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.273+0000 7fbf648b3640 1 -- start start 2023-12-08T08:16:47.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6014c280 0x7fbf601e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60152fc0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600c1500 con 0x7fbf6014c280 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.274+0000 7fbf648b3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60154190 con 0x7fbf600c4970 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33496/0 (socket says 172.21.15.45:33496) 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 -- 172.21.15.45:0/1369976483 learned_addr learned my addr 172.21.15.45:0/1369976483 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 -- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 msgr2=0x7fbf6014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 -- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6014c280 msgr2=0x7fbf601e7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:47.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6014c280 0x7fbf601e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:47.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 -- 172.21.15.45:0/1369976483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009b30 con 0x7fbf6006d3e0 2023-12-08T08:16:47.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.275+0000 7fbf5ed9d640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d5f0 tx=0x7fbf5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.276+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500125f0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.276+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50012750 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.276+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50012b00 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.276+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6014ba60 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.276+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf600c1a30 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.277+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf600678c0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.278+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf50012c60 con 0x7fbf6006d3e0 2023-12-08T08:16:47.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.279+0000 7fbf577fe640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 0x7fbf4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:47.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.279+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbf50089fe0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.279+0000 7fbf57fff640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 0x7fbf4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:47.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.280+0000 7fbf57fff640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 0x7fbf4006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf48006b10 tx=0x7fbf48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:47.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.283+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf50054bb0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:47.513+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbf600743e0 con 0x7fbf6006d3e0 2023-12-08T08:16:47.916 INFO:tasks.ceph.mds.d.smithi114.stderr:2023-12-08T08:16:47.914+0000 7faff64aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:16:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.114+0000 7fbf577fe640 1 -- 172.21.15.45:0/1369976483 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fbf500581d0 con 0x7fbf6006d3e0 2023-12-08T08:16:48.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 msgr2=0x7fbf4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 0x7fbf4006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf48006b10 tx=0x7fbf48008040 comp rx=0 tx=0).stop 2023-12-08T08:16:48.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 msgr2=0x7fbf601429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d5f0 tx=0x7fbf5000dab0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 shutdown_connections 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbf4006ae40 0x7fbf4006d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbf600c4970 0x7fbf6014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf6014c280 0x7fbf601e7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 --2- 172.21.15.45:0/1369976483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf6006d3e0 0x7fbf601429f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.118+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 >> 172.21.15.45:0/1369976483 conn(0x7fbf60066ce0 msgr2=0x7fbf601560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.119+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 shutdown_connections 2023-12-08T08:16:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.119+0000 7fbf648b3640 1 -- 172.21.15.45:0/1369976483 wait complete. 2023-12-08T08:16:48.143 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:16:48.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:16:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.371+0000 7f8455b25640 1 Processor -- start 2023-12-08T08:16:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.372+0000 7f8455b25640 1 -- start start 2023-12-08T08:16:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.373+0000 7f8455b25640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84500c3830 0x7f845015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.373+0000 7f8455b25640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8450152660 con 0x7f845006d960 2023-12-08T08:16:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.373+0000 7f8455b25640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8450153200 con 0x7f84500aaf60 2023-12-08T08:16:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.373+0000 7f8455b25640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84500a4d10 con 0x7f84500c3830 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f8447fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f845006d960 0x7f84500c1930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36818/0 (socket says 172.21.15.45:36818) 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f844ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84500c3830 0x7f845015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f8447fff640 1 -- 172.21.15.45:0/3748911656 learned_addr learned my addr 172.21.15.45:0/3748911656 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f844ffff640 1 -- 172.21.15.45:0/3748911656 >> v1:172.21.15.114:6789/0 conn(0x7f84500aaf60 legacy=0x7f8450152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f844ffff640 1 -- 172.21.15.45:0/3748911656 >> v1:172.21.15.45:6789/0 conn(0x7f845006d960 legacy=0x7f84500c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f844effd640 1 -- 172.21.15.45:0/3748911656 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291920223 0 0) 0x7f8450152660 con 0x7f845006d960 2023-12-08T08:16:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.374+0000 7f844ffff640 1 -- 172.21.15.45:0/3748911656 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500c3310 con 0x7f84500c3830 2023-12-08T08:16:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.376+0000 7f844ffff640 1 --2- 172.21.15.45:0/3748911656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845015dc50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8448009d90 tx=0x7f844802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9131ac3c63bda48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.376+0000 7f844effd640 1 -- 172.21.15.45:0/3748911656 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844802cd00 con 0x7f84500c3830 2023-12-08T08:16:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.376+0000 7f844effd640 1 -- 172.21.15.45:0/3748911656 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844802ce60 con 0x7f84500c3830 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.376+0000 7f844effd640 1 -- 172.21.15.45:0/3748911656 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448034660 con 0x7f84500c3830 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 -- 172.21.15.45:0/3748911656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 msgr2=0x7f845015dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 --2- 172.21.15.45:0/3748911656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845015dc50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8448009d90 tx=0x7f844802bf50 comp rx=0 tx=0).stop 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 -- 172.21.15.45:0/3748911656 shutdown_connections 2023-12-08T08:16:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 --2- 172.21.15.45:0/3748911656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845015dc50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 -- 172.21.15.45:0/3748911656 >> 172.21.15.45:0/3748911656 conn(0x7f84500c2430 msgr2=0x7f84500c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 -- 172.21.15.45:0/3748911656 shutdown_connections 2023-12-08T08:16:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.377+0000 7f8455b25640 1 -- 172.21.15.45:0/3748911656 wait complete. 2023-12-08T08:16:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.379+0000 7f8455b25640 1 Processor -- start 2023-12-08T08:16:48.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.379+0000 7f8455b25640 1 -- start start 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f845006d960 0x7f84500a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 0x7f845014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501548b0 con 0x7f84500c3830 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450156590 con 0x7f84500aaf60 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8455b25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845014f080 con 0x7f845006d960 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33506/0 (socket says 172.21.15.45:33506) 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 -- 172.21.15.45:0/3008489359 learned_addr learned my addr 172.21.15.45:0/3008489359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8447fff640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 0x7f845014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844f7fe640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f845006d960 0x7f84500a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 -- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f845006d960 msgr2=0x7f84500a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f845006d960 0x7f84500a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 -- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 msgr2=0x7f845014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 0x7f845014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f844ffff640 1 -- 172.21.15.45:0/3008489359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009a70 con 0x7f84500c3830 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.380+0000 7f8447fff640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 0x7f845014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f844ffff640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8448009d90 tx=0x7f8448004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844803d600 con 0x7f84500c3830 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844803d780 con 0x7f84500c3830 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844803db30 con 0x7f84500c3830 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8450155f40 con 0x7f84500c3830 2023-12-08T08:16:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.381+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84500aa2e0 con 0x7f84500c3830 2023-12-08T08:16:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.383+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845014daf0 con 0x7f84500c3830 2023-12-08T08:16:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.383+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f844803b040 con 0x7f84500c3830 2023-12-08T08:16:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.384+0000 7f844cff9640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 0x7f843006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.385+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f84480aba90 con 0x7f84500c3830 2023-12-08T08:16:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.385+0000 7f844f7fe640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 0x7f843006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:48.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.386+0000 7f844f7fe640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 0x7f843006d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8440000f60 tx=0x7f8440009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.389+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8448076730 con 0x7f84500c3830 2023-12-08T08:16:48.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:48.618+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8450074670 con 0x7f84500c3830 2023-12-08T08:16:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.126+0000 7f844cff9640 1 -- 172.21.15.45:0/3008489359 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8448079d50 con 0x7f84500c3830 2023-12-08T08:16:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 msgr2=0x7f843006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 0x7f843006d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8440000f60 tx=0x7f8440009040 comp rx=0 tx=0).stop 2023-12-08T08:16:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 msgr2=0x7f845014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8448009d90 tx=0x7f8448004a40 comp rx=0 tx=0).stop 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 shutdown_connections 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.130+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f843006ae40 0x7f843006d300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84500c3830 0x7f845014e310 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84500aaf60 0x7f845014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 --2- 172.21.15.45:0/3008489359 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f845006d960 0x7f84500a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 >> 172.21.15.45:0/3008489359 conn(0x7f84500c2430 msgr2=0x7f84500a56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 shutdown_connections 2023-12-08T08:16:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.131+0000 7f8455b25640 1 -- 172.21.15.45:0/3008489359 wait complete. 2023-12-08T08:16:49.153 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:16:49.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:16:49.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.375+0000 7ff74a225640 1 Processor -- start 2023-12-08T08:16:49.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.376+0000 7ff74a225640 1 -- start start 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff74a225640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7440c44d0 0x7ff7441584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff74a225640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7440c4a00 con 0x7ff7441519c0 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff74a225640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7440c4ce0 con 0x7ff7440c7a50 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff74a225640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7441579e0 con 0x7ff7440c44d0 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff748a22640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7440c44d0 0x7ff7441584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.377+0000 7ff749223640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff7441519c0 0x7ff744154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36832/0 (socket says 172.21.15.45:36832) 2023-12-08T08:16:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.378+0000 7ff749223640 1 -- 172.21.15.45:0/1543850891 learned_addr learned my addr 172.21.15.45:0/1543850891 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.378+0000 7ff748a22640 1 -- 172.21.15.45:0/1543850891 >> v1:172.21.15.114:6789/0 conn(0x7ff7440c7a50 legacy=0x7ff7440ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.378+0000 7ff748a22640 1 -- 172.21.15.45:0/1543850891 >> v1:172.21.15.45:6789/0 conn(0x7ff7441519c0 legacy=0x7ff744154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.378+0000 7ff743fff640 1 -- 172.21.15.45:0/1543850891 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059758574 0 0) 0x7ff7440c4a00 con 0x7ff7441519c0 2023-12-08T08:16:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.378+0000 7ff748a22640 1 -- 172.21.15.45:0/1543850891 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744157cc0 con 0x7ff7440c44d0 2023-12-08T08:16:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.379+0000 7ff748a22640 1 --2- 172.21.15.45:0/1543850891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440c44d0 0x7ff7441584c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7380097a0 tx=0x7ff73802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d06595e6391f2b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.379+0000 7ff743fff640 1 -- 172.21.15.45:0/1543850891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73802f050 con 0x7ff7440c44d0 2023-12-08T08:16:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff743fff640 1 -- 172.21.15.45:0/1543850891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738031700 con 0x7ff7440c44d0 2023-12-08T08:16:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff743fff640 1 -- 172.21.15.45:0/1543850891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738031a90 con 0x7ff7440c44d0 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 -- 172.21.15.45:0/1543850891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440c44d0 msgr2=0x7ff7441584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 --2- 172.21.15.45:0/1543850891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440c44d0 0x7ff7441584c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7380097a0 tx=0x7ff73802b7a0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 -- 172.21.15.45:0/1543850891 shutdown_connections 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 --2- 172.21.15.45:0/1543850891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440c44d0 0x7ff7441584c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 -- 172.21.15.45:0/1543850891 >> 172.21.15.45:0/1543850891 conn(0x7ff7440661f0 msgr2=0x7ff744066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 -- 172.21.15.45:0/1543850891 shutdown_connections 2023-12-08T08:16:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.380+0000 7ff74a225640 1 -- 172.21.15.45:0/1543850891 wait complete. 2023-12-08T08:16:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.382+0000 7ff74a225640 1 Processor -- start 2023-12-08T08:16:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.382+0000 7ff74a225640 1 -- start start 2023-12-08T08:16:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 0x7ff7440c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 0x7ff7441ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440c1a80 con 0x7ff7441519c0 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74414df50 con 0x7ff7440c7a50 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff74a225640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74414e170 con 0x7ff7440c44d0 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff749a24640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff749a24640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33514/0 (socket says 172.21.15.45:33514) 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.383+0000 7ff749a24640 1 -- 172.21.15.45:0/867440547 learned_addr learned my addr 172.21.15.45:0/867440547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff748a22640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 0x7ff7441ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749223640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 0x7ff7440c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 -- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 msgr2=0x7ff7440c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 0x7ff7440c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 -- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 msgr2=0x7ff7441ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 0x7ff7441ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 -- 172.21.15.45:0/867440547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738009400 con 0x7ff7441519c0 2023-12-08T08:16:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff748a22640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 0x7ff7441ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749223640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 0x7ff7440c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff749a24640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c410 tx=0x7ff73c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011790 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0118f0 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011ce0 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.384+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74414e450 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.385+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7441edd40 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.386+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7440c21b0 con 0x7ff7441519c0 2023-12-08T08:16:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.387+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff73c01c460 con 0x7ff7441519c0 2023-12-08T08:16:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.387+0000 7ff741ffb640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 0x7ff73006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.388+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff73c089790 con 0x7ff7441519c0 2023-12-08T08:16:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.388+0000 7ff749223640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 0x7ff73006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.388+0000 7ff749223640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 0x7ff73006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff734007fd0 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.392+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7440c21b0 con 0x7ff7441519c0 2023-12-08T08:16:49.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.626+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7440c21b0 con 0x7ff7441519c0 2023-12-08T08:16:49.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.627+0000 7ff741ffb640 1 -- 172.21.15.45:0/867440547 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6121 (secure 0 0 0) 0x7ff7440c21b0 con 0x7ff7441519c0 2023-12-08T08:16:49.630 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:49.630 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:16:49.631 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 msgr2=0x7ff73006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 0x7ff73006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff734007fd0 tx=0x7ff734009040 comp rx=0 tx=0).stop 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 msgr2=0x7ff7441ed800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c410 tx=0x7ff73c00c8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 shutdown_connections 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff73006ae40 0x7ff73006d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7441519c0 0x7ff7441ed800 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7440c7a50 0x7ff7441ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 --2- 172.21.15.45:0/867440547 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff7440c44d0 0x7ff7440c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 >> 172.21.15.45:0/867440547 conn(0x7ff7440661f0 msgr2=0x7ff74414f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 shutdown_connections 2023-12-08T08:16:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.630+0000 7ff74a225640 1 -- 172.21.15.45:0/867440547 wait complete. 2023-12-08T08:16:49.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.861+0000 7fb200839640 1 Processor -- start 2023-12-08T08:16:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.861+0000 7fb200839640 1 -- start start 2023-12-08T08:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1fc0a7910 0x7fb1fc0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc0c1dc0 0x7fb1fc14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1fc1521b0 0x7fb1fc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc155850 con 0x7fb1fc0a7910 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0c0890 con 0x7fb1fc1521b0 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb200839640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0c0b70 con 0x7fb1fc0c1dc0 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb1fb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1fc0a7910 0x7fb1fc0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb1fb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1fc0a7910 0x7fb1fc0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33522/0 (socket says 172.21.15.45:33522) 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.863+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/676173506 learned_addr learned my addr 172.21.15.45:0/676173506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1faffd640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc0c1dc0 0x7fb1fc14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fbfff640 1 --2- 172.21.15.45:0/676173506 >> v2:172.21.15.114:3300/0 conn(0x7fb1fc1521b0 0x7fb1fc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/676173506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc0c1dc0 msgr2=0x7fb1fc14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc0c1dc0 0x7fb1fc14f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/676173506 >> v2:172.21.15.114:3300/0 conn(0x7fb1fc1521b0 msgr2=0x7fb1fc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/676173506 >> v2:172.21.15.114:3300/0 conn(0x7fb1fc1521b0 0x7fb1fc155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.864+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/676173506 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0c0e50 con 0x7fb1fc0a7910 2023-12-08T08:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.865+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0c1880 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0a5460 tx=0x7fb1ec02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e90c4b16aa53fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.865+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/676173506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0317d0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.865+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/676173506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec031930 con 0x7fb1fc0a7910 2023-12-08T08:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.865+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/676173506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec031cc0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 -- 172.21.15.45:0/676173506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 msgr2=0x7fb1fc0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0c1880 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0a5460 tx=0x7fb1ec02b870 comp rx=0 tx=0).stop 2023-12-08T08:16:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 -- 172.21.15.45:0/676173506 shutdown_connections 2023-12-08T08:16:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 --2- 172.21.15.45:0/676173506 >> v2:172.21.15.114:3300/0 conn(0x7fb1fc1521b0 0x7fb1fc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc0c1dc0 0x7fb1fc14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 --2- 172.21.15.45:0/676173506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0c1880 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 -- 172.21.15.45:0/676173506 >> 172.21.15.45:0/676173506 conn(0x7fb1fc0c5780 msgr2=0x7fb1fc0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:49.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 -- 172.21.15.45:0/676173506 shutdown_connections 2023-12-08T08:16:49.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.866+0000 7fb200839640 1 -- 172.21.15.45:0/676173506 wait complete. 2023-12-08T08:16:49.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.868+0000 7fb200839640 1 Processor -- start 2023-12-08T08:16:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.868+0000 7fb200839640 1 -- start start 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1fc0c1dc0 0x7fb1fc0a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc1521b0 0x7fb1fc14c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0a74f0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1e9890 con 0x7fb1fc0c1dc0 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb200839640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1e9b70 con 0x7fb1fc1521b0 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33534/0 (socket says 172.21.15.45:33534) 2023-12-08T08:16:49.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.869+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/1227583212 learned_addr learned my addr 172.21.15.45:0/1227583212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fbfff640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc1521b0 0x7fb1fc14c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1faffd640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1fc0c1dc0 0x7fb1fc0a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc1521b0 msgr2=0x7fb1fc14c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc1521b0 0x7fb1fc14c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1fc0c1dc0 msgr2=0x7fb1fc0a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1fc0c1dc0 0x7fb1fc0a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/1227583212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0094d0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.870+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec02b8b0 tx=0x7fb1ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.871+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec032970 con 0x7fb1fc0a7910 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.871+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec032af0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.871+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec032ea0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.871+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc1e9e50 con 0x7fb1fc0a7910 2023-12-08T08:16:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.871+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc0bf2e0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.872+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0743e0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.873+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1ec030070 con 0x7fb1fc0a7910 2023-12-08T08:16:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.874+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 0x7fb1e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.874+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb1ec0abcf0 con 0x7fb1fc0a7910 2023-12-08T08:16:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.875+0000 7fb1faffd640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 0x7fb1e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.875+0000 7fb1faffd640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 0x7fb1e806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0c67c0 tx=0x7fb1f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:49.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:49.879+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1ec0769a0 con 0x7fb1fc0a7910 2023-12-08T08:16:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.075+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1fc150830 con 0x7fb1fc0a7910 2023-12-08T08:16:50.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.078+0000 7fb1e3fff640 1 -- 172.21.15.45:0/1227583212 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7fb1ec079fc0 con 0x7fb1fc0a7910 2023-12-08T08:16:50.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:50.082 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 msgr2=0x7fb1e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 0x7fb1e806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0c67c0 tx=0x7fb1f0008040 comp rx=0 tx=0).stop 2023-12-08T08:16:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 msgr2=0x7fb1fc0beda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec02b8b0 tx=0x7fb1ec0046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 shutdown_connections 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1e806ae40 0x7fb1e806d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1fc1521b0 0x7fb1fc14c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1fc0c1dc0 0x7fb1fc0a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 --2- 172.21.15.45:0/1227583212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc0a7910 0x7fb1fc0beda0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.081+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 >> 172.21.15.45:0/1227583212 conn(0x7fb1fc0c5780 msgr2=0x7fb1fc0aad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.082+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 shutdown_connections 2023-12-08T08:16:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.082+0000 7fb200839640 1 -- 172.21.15.45:0/1227583212 wait complete. 2023-12-08T08:16:50.104 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:16:50.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:16:50.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.328+0000 7f3b49d63640 1 Processor -- start 2023-12-08T08:16:50.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.329+0000 7f3b49d63640 1 -- start start 2023-12-08T08:16:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.330+0000 7f3b49d63640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4414e260 0x7f3b441542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.330+0000 7f3b49d63640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b440a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.330+0000 7f3b49d63640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440a7300 con 0x7f3b440beb30 2023-12-08T08:16:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.330+0000 7f3b49d63640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440bfb90 con 0x7f3b4414e260 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.330+0000 7f3b49d63640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440bf010 con 0x7f3b440a7770 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4414e260 0x7f3b441542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4414e260 0x7f3b441542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33536/0 (socket says 172.21.15.45:33536) 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 -- 172.21.15.45:0/1033582671 learned_addr learned my addr 172.21.15.45:0/1033582671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b49562640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b440a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 -- 172.21.15.45:0/1033582671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 msgr2=0x7f3b440a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:50.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b440a7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 -- 172.21.15.45:0/1033582671 >> v1:172.21.15.45:6789/0 conn(0x7f3b440beb30 legacy=0x7f3b4406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.331+0000 7f3b48d61640 1 -- 172.21.15.45:0/1033582671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440bf2f0 con 0x7f3b4414e260 2023-12-08T08:16:50.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b48d61640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4414e260 0x7f3b441542a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009870 tx=0x7f3b3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d5f3e823aa9a32 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b437fe640 1 -- 172.21.15.45:0/1033582671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38030840 con 0x7f3b4414e260 2023-12-08T08:16:50.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b437fe640 1 -- 172.21.15.45:0/1033582671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380309a0 con 0x7f3b4414e260 2023-12-08T08:16:50.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b437fe640 1 -- 172.21.15.45:0/1033582671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38030d30 con 0x7f3b4414e260 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b49d63640 1 -- 172.21.15.45:0/1033582671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4414e260 msgr2=0x7f3b441542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.333+0000 7f3b49d63640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4414e260 0x7f3b441542a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009870 tx=0x7f3b3802b980 comp rx=0 tx=0).stop 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 -- 172.21.15.45:0/1033582671 shutdown_connections 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b440a7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 --2- 172.21.15.45:0/1033582671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4414e260 0x7f3b441542a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 -- 172.21.15.45:0/1033582671 >> 172.21.15.45:0/1033582671 conn(0x7f3b440c5780 msgr2=0x7f3b440c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 -- 172.21.15.45:0/1033582671 shutdown_connections 2023-12-08T08:16:50.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.334+0000 7f3b49d63640 1 -- 172.21.15.45:0/1033582671 wait complete. 2023-12-08T08:16:50.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.335+0000 7f3b49d63640 1 Processor -- start 2023-12-08T08:16:50.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.336+0000 7f3b49d63640 1 -- start start 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.336+0000 7f3b49d63640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b44153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.336+0000 7f3b49d63640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.336+0000 7f3b49d63640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4414e260 0x7f3b441ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b49d63640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440a8f30 con 0x7f3b440beb30 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b49d63640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b441514b0 con 0x7f3b4414e260 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b49d63640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b44150ef0 con 0x7f3b440a7770 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33550/0 (socket says 172.21.15.45:33550) 2023-12-08T08:16:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 -- 172.21.15.45:0/3158638902 learned_addr learned my addr 172.21.15.45:0/3158638902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 -- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 msgr2=0x7f3b44153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b44153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 -- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4414e260 msgr2=0x7f3b441ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4414e260 0x7f3b441ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.337+0000 7f3b43fff640 1 -- 172.21.15.45:0/3158638902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b380094d0 con 0x7f3b440beb30 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b43fff640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000c430 tx=0x7f3b3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300052d0 con 0x7f3b440beb30 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30005430 con 0x7f3b440beb30 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30003830 con 0x7f3b440beb30 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b440a9bf0 con 0x7f3b440beb30 2023-12-08T08:16:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.338+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b440a8740 con 0x7f3b440beb30 2023-12-08T08:16:50.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.339+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b440743e0 con 0x7f3b440beb30 2023-12-08T08:16:50.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.340+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b30003990 con 0x7f3b440beb30 2023-12-08T08:16:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.341+0000 7f3b417fa640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 0x7f3b2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.341+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3b30088fd0 con 0x7f3b440beb30 2023-12-08T08:16:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.342+0000 7f3b48d61640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 0x7f3b2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.342+0000 7f3b48d61640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 0x7f3b2806d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3b38036000 tx=0x7f3b3803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.346+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b30053c70 con 0x7f3b440beb30 2023-12-08T08:16:50.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.536+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b440c0000 con 0x7f3b2806ae70 2023-12-08T08:16:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.578+0000 7f3b417fa640 1 -- 172.21.15.45:0/3158638902 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525392 (secure 0 0 0) 0x7f3b440c0000 con 0x7f3b2806ae70 2023-12-08T08:16:50.588 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:16:50.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.589+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 msgr2=0x7f3b2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.589+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 0x7f3b2806d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3b38036000 tx=0x7f3b3803b040 comp rx=0 tx=0).stop 2023-12-08T08:16:50.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.589+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 msgr2=0x7f3b441ec840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.589+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000c430 tx=0x7f3b3000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 shutdown_connections 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3b2806ae70 0x7f3b2806d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4414e260 0x7f3b441ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b440beb30 0x7f3b441ec840 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 --2- 172.21.15.45:0/3158638902 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3b440a7770 0x7f3b44153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 >> 172.21.15.45:0/3158638902 conn(0x7f3b440c5780 msgr2=0x7f3b440c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 shutdown_connections 2023-12-08T08:16:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.590+0000 7f3b49d63640 1 -- 172.21.15.45:0/3158638902 wait complete. 2023-12-08T08:16:50.619 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-08T08:16:49.739242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":344,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238072,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736648,"statfs":{"total":773094113280,"available":772850327552,"internally_reserved":0,"allocated":5357568,"data_stored":2989044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678289"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055758+0000","last_change":"2023-12-08T08:16:45.714161+0000","last_active":"2023-12-08T08:16:47.055758+0000","last_peered":"2023-12-08T08:16:47.055758+0000","last_clean":"2023-12-08T08:16:47.055758+0000","last_became_active":"2023-12-08T08:16:45.713885+0000","last_became_peered":"2023-12-08T08:16:45.713885+0000","last_unstale":"2023-12-08T08:16:47.055758+0000","last_undegraded":"2023-12-08T08:16:47.055758+0000","last_fullsized":"2023-12-08T08:16:47.055758+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:04.738536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702994+0000","last_change":"2023-12-08T08:16:30.002627+0000","last_active":"2023-12-08T08:16:45.702994+0000","last_peered":"2023-12-08T08:16:45.702994+0000","last_clean":"2023-12-08T08:16:45.702994+0000","last_became_active":"2023-12-08T08:16:30.001969+0000","last_became_peered":"2023-12-08T08:16:30.001969+0000","last_unstale":"2023-12-08T08:16:45.702994+0000","last_undegraded":"2023-12-08T08:16:45.702994+0000","last_fullsized":"2023-12-08T08:16:45.702994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.051730+0000","last_change":"2023-12-08T08:16:45.690183+0000","last_active":"2023-12-08T08:16:47.051730+0000","last_peered":"2023-12-08T08:16:47.051730+0000","last_clean":"2023-12-08T08:16:47.051730+0000","last_became_active":"2023-12-08T08:16:45.688663+0000","last_became_peered":"2023-12-08T08:16:45.688663+0000","last_unstale":"2023-12-08T08:16:47.051730+0000","last_undegraded":"2023-12-08T08:16:47.051730+0000","last_fullsized":"2023-12-08T08:16:47.051730+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:16.630882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701172+0000","last_change":"2023-12-08T08:16:30.005992+0000","last_active":"2023-12-08T08:16:45.701172+0000","last_peered":"2023-12-08T08:16:45.701172+0000","last_clean":"2023-12-08T08:16:45.701172+0000","last_became_active":"2023-12-08T08:16:30.004730+0000","last_became_peered":"2023-12-08T08:16:30.004730+0000","last_unstale":"2023-12-08T08:16:45.701172+0000","last_undegraded":"2023-12-08T08:16:45.701172+0000","last_fullsized":"2023-12-08T08:16:45.701172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052443+0000","last_change":"2023-12-08T08:16:45.690852+0000","last_active":"2023-12-08T08:16:47.052443+0000","last_peered":"2023-12-08T08:16:47.052443+0000","last_clean":"2023-12-08T08:16:47.052443+0000","last_became_active":"2023-12-08T08:16:45.689851+0000","last_became_peered":"2023-12-08T08:16:45.689851+0000","last_unstale":"2023-12-08T08:16:47.052443+0000","last_undegraded":"2023-12-08T08:16:47.052443+0000","last_fullsized":"2023-12-08T08:16:47.052443+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:52:05.728783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695481+0000","last_change":"2023-12-08T08:16:30.018833+0000","last_active":"2023-12-08T08:16:45.695481+0000","last_peered":"2023-12-08T08:16:45.695481+0000","last_clean":"2023-12-08T08:16:45.695481+0000","last_became_active":"2023-12-08T08:16:30.018490+0000","last_became_peered":"2023-12-08T08:16:30.018490+0000","last_unstale":"2023-12-08T08:16:45.695481+0000","last_undegraded":"2023-12-08T08:16:45.695481+0000","last_fullsized":"2023-12-08T08:16:45.695481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:01.019985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831870+0000","last_change":"2023-12-08T08:16:45.705891+0000","last_active":"2023-12-08T08:16:46.831870+0000","last_peered":"2023-12-08T08:16:46.831870+0000","last_clean":"2023-12-08T08:16:46.831870+0000","last_became_active":"2023-12-08T08:16:45.705558+0000","last_became_peered":"2023-12-08T08:16:45.705558+0000","last_unstale":"2023-12-08T08:16:46.831870+0000","last_undegraded":"2023-12-08T08:16:46.831870+0000","last_fullsized":"2023-12-08T08:16:46.831870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:28.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694867+0000","last_change":"2023-12-08T08:16:30.006081+0000","last_active":"2023-12-08T08:16:45.694867+0000","last_peered":"2023-12-08T08:16:45.694867+0000","last_clean":"2023-12-08T08:16:45.694867+0000","last_became_active":"2023-12-08T08:16:30.005783+0000","last_became_peered":"2023-12-08T08:16:30.005783+0000","last_unstale":"2023-12-08T08:16:45.694867+0000","last_undegraded":"2023-12-08T08:16:45.694867+0000","last_fullsized":"2023-12-08T08:16:45.694867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:28.498447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.685321+0000","last_change":"2023-12-08T08:16:45.708481+0000","last_active":"2023-12-08T08:16:46.685321+0000","last_peered":"2023-12-08T08:16:46.685321+0000","last_clean":"2023-12-08T08:16:46.685321+0000","last_became_active":"2023-12-08T08:16:45.708090+0000","last_became_peered":"2023-12-08T08:16:45.708090+0000","last_unstale":"2023-12-08T08:16:46.685321+0000","last_undegraded":"2023-12-08T08:16:46.685321+0000","last_fullsized":"2023-12-08T08:16:46.685321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:47.696692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.692302+0000","last_change":"2023-12-08T08:16:30.008831+0000","last_active":"2023-12-08T08:16:45.692302+0000","last_peered":"2023-12-08T08:16:45.692302+0000","last_clean":"2023-12-08T08:16:45.692302+0000","last_became_active":"2023-12-08T08:16:30.006730+0000","last_became_peered":"2023-12-08T08:16:30.006730+0000","last_unstale":"2023-12-08T08:16:45.692302+0000","last_undegraded":"2023-12-08T08:16:45.692302+0000","last_fullsized":"2023-12-08T08:16:45.692302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:54.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053801+0000","last_change":"2023-12-08T08:16:45.712320+0000","last_active":"2023-12-08T08:16:47.053801+0000","last_peered":"2023-12-08T08:16:47.053801+0000","last_clean":"2023-12-08T08:16:47.053801+0000","last_became_active":"2023-12-08T08:16:45.712016+0000","last_became_peered":"2023-12-08T08:16:45.712016+0000","last_unstale":"2023-12-08T08:16:47.053801+0000","last_undegraded":"2023-12-08T08:16:47.053801+0000","last_fullsized":"2023-12-08T08:16:47.053801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:12.546207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680078+0000","last_change":"2023-12-08T08:16:29.995593+0000","last_active":"2023-12-08T08:16:45.680078+0000","last_peered":"2023-12-08T08:16:45.680078+0000","last_clean":"2023-12-08T08:16:45.680078+0000","last_became_active":"2023-12-08T08:16:29.995301+0000","last_became_peered":"2023-12-08T08:16:29.995301+0000","last_unstale":"2023-12-08T08:16:45.680078+0000","last_undegraded":"2023-12-08T08:16:45.680078+0000","last_fullsized":"2023-12-08T08:16:45.680078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:26:22.011359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054337+0000","last_change":"2023-12-08T08:16:45.715594+0000","last_active":"2023-12-08T08:16:47.054337+0000","last_peered":"2023-12-08T08:16:47.054337+0000","last_clean":"2023-12-08T08:16:47.054337+0000","last_became_active":"2023-12-08T08:16:45.715295+0000","last_became_peered":"2023-12-08T08:16:45.715295+0000","last_unstale":"2023-12-08T08:16:47.054337+0000","last_undegraded":"2023-12-08T08:16:47.054337+0000","last_fullsized":"2023-12-08T08:16:47.054337+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:57.860549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701854+0000","last_change":"2023-12-08T08:16:30.015416+0000","last_active":"2023-12-08T08:16:45.701854+0000","last_peered":"2023-12-08T08:16:45.701854+0000","last_clean":"2023-12-08T08:16:45.701854+0000","last_became_active":"2023-12-08T08:16:30.015060+0000","last_became_peered":"2023-12-08T08:16:30.015060+0000","last_unstale":"2023-12-08T08:16:45.701854+0000","last_undegraded":"2023-12-08T08:16:45.701854+0000","last_fullsized":"2023-12-08T08:16:45.701854+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052835+0000","last_change":"2023-12-08T08:16:45.699329+0000","last_active":"2023-12-08T08:16:47.052835+0000","last_peered":"2023-12-08T08:16:47.052835+0000","last_clean":"2023-12-08T08:16:47.052835+0000","last_became_active":"2023-12-08T08:16:45.698992+0000","last_became_peered":"2023-12-08T08:16:45.698992+0000","last_unstale":"2023-12-08T08:16:47.052835+0000","last_undegraded":"2023-12-08T08:16:47.052835+0000","last_fullsized":"2023-12-08T08:16:47.052835+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:08.785963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699723+0000","last_change":"2023-12-08T08:16:29.993605+0000","last_active":"2023-12-08T08:16:45.699723+0000","last_peered":"2023-12-08T08:16:45.699723+0000","last_clean":"2023-12-08T08:16:45.699723+0000","last_became_active":"2023-12-08T08:16:29.993263+0000","last_became_peered":"2023-12-08T08:16:29.993263+0000","last_unstale":"2023-12-08T08:16:45.699723+0000","last_undegraded":"2023-12-08T08:16:45.699723+0000","last_fullsized":"2023-12-08T08:16:45.699723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831734+0000","last_change":"2023-12-08T08:16:45.709502+0000","last_active":"2023-12-08T08:16:46.831734+0000","last_peered":"2023-12-08T08:16:46.831734+0000","last_clean":"2023-12-08T08:16:46.831734+0000","last_became_active":"2023-12-08T08:16:45.709220+0000","last_became_peered":"2023-12-08T08:16:45.709220+0000","last_unstale":"2023-12-08T08:16:46.831734+0000","last_undegraded":"2023-12-08T08:16:46.831734+0000","last_fullsized":"2023-12-08T08:16:46.831734+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:52.646667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703252+0000","last_change":"2023-12-08T08:16:30.015099+0000","last_active":"2023-12-08T08:16:45.703252+0000","last_peered":"2023-12-08T08:16:45.703252+0000","last_clean":"2023-12-08T08:16:45.703252+0000","last_became_active":"2023-12-08T08:16:30.014849+0000","last_became_peered":"2023-12-08T08:16:30.014849+0000","last_unstale":"2023-12-08T08:16:45.703252+0000","last_undegraded":"2023-12-08T08:16:45.703252+0000","last_fullsized":"2023-12-08T08:16:45.703252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:08.500259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052453+0000","last_change":"2023-12-08T08:16:45.710499+0000","last_active":"2023-12-08T08:16:47.052453+0000","last_peered":"2023-12-08T08:16:47.052453+0000","last_clean":"2023-12-08T08:16:47.052453+0000","last_became_active":"2023-12-08T08:16:45.710222+0000","last_became_peered":"2023-12-08T08:16:45.710222+0000","last_unstale":"2023-12-08T08:16:47.052453+0000","last_undegraded":"2023-12-08T08:16:47.052453+0000","last_fullsized":"2023-12-08T08:16:47.052453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:26:04.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694254+0000","last_change":"2023-12-08T08:16:30.007497+0000","last_active":"2023-12-08T08:16:45.694254+0000","last_peered":"2023-12-08T08:16:45.694254+0000","last_clean":"2023-12-08T08:16:45.694254+0000","last_became_active":"2023-12-08T08:16:30.007046+0000","last_became_peered":"2023-12-08T08:16:30.007046+0000","last_unstale":"2023-12-08T08:16:45.694254+0000","last_undegraded":"2023-12-08T08:16:45.694254+0000","last_fullsized":"2023-12-08T08:16:45.694254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687232+0000","last_change":"2023-12-08T08:16:45.707211+0000","last_active":"2023-12-08T08:16:46.687232+0000","last_peered":"2023-12-08T08:16:46.687232+0000","last_clean":"2023-12-08T08:16:46.687232+0000","last_became_active":"2023-12-08T08:16:45.706870+0000","last_became_peered":"2023-12-08T08:16:45.706870+0000","last_unstale":"2023-12-08T08:16:46.687232+0000","last_undegraded":"2023-12-08T08:16:46.687232+0000","last_fullsized":"2023-12-08T08:16:46.687232+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:05.336760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695074+0000","last_change":"2023-12-08T08:16:30.002707+0000","last_active":"2023-12-08T08:16:45.695074+0000","last_peered":"2023-12-08T08:16:45.695074+0000","last_clean":"2023-12-08T08:16:45.695074+0000","last_became_active":"2023-12-08T08:16:30.002244+0000","last_became_peered":"2023-12-08T08:16:30.002244+0000","last_unstale":"2023-12-08T08:16:45.695074+0000","last_undegraded":"2023-12-08T08:16:45.695074+0000","last_fullsized":"2023-12-08T08:16:45.695074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052113+0000","last_change":"2023-12-08T08:16:45.711028+0000","last_active":"2023-12-08T08:16:47.052113+0000","last_peered":"2023-12-08T08:16:47.052113+0000","last_clean":"2023-12-08T08:16:47.052113+0000","last_became_active":"2023-12-08T08:16:45.709593+0000","last_became_peered":"2023-12-08T08:16:45.709593+0000","last_unstale":"2023-12-08T08:16:47.052113+0000","last_undegraded":"2023-12-08T08:16:47.052113+0000","last_fullsized":"2023-12-08T08:16:47.052113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:44.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694479+0000","last_change":"2023-12-08T08:16:29.996936+0000","last_active":"2023-12-08T08:16:45.694479+0000","last_peered":"2023-12-08T08:16:45.694479+0000","last_clean":"2023-12-08T08:16:45.694479+0000","last_became_active":"2023-12-08T08:16:29.996661+0000","last_became_peered":"2023-12-08T08:16:29.996661+0000","last_unstale":"2023-12-08T08:16:45.694479+0000","last_undegraded":"2023-12-08T08:16:45.694479+0000","last_fullsized":"2023-12-08T08:16:45.694479+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832378+0000","last_change":"2023-12-08T08:16:45.707524+0000","last_active":"2023-12-08T08:16:46.832378+0000","last_peered":"2023-12-08T08:16:46.832378+0000","last_clean":"2023-12-08T08:16:46.832378+0000","last_became_active":"2023-12-08T08:16:45.707219+0000","last_became_peered":"2023-12-08T08:16:45.707219+0000","last_unstale":"2023-12-08T08:16:46.832378+0000","last_undegraded":"2023-12-08T08:16:46.832378+0000","last_fullsized":"2023-12-08T08:16:46.832378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:32.207784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696284+0000","last_change":"2023-12-08T08:16:30.004638+0000","last_active":"2023-12-08T08:16:45.696284+0000","last_peered":"2023-12-08T08:16:45.696284+0000","last_clean":"2023-12-08T08:16:45.696284+0000","last_became_active":"2023-12-08T08:16:30.004298+0000","last_became_peered":"2023-12-08T08:16:30.004298+0000","last_unstale":"2023-12-08T08:16:45.696284+0000","last_undegraded":"2023-12-08T08:16:45.696284+0000","last_fullsized":"2023-12-08T08:16:45.696284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056229+0000","last_change":"2023-12-08T08:16:45.719897+0000","last_active":"2023-12-08T08:16:47.056229+0000","last_peered":"2023-12-08T08:16:47.056229+0000","last_clean":"2023-12-08T08:16:47.056229+0000","last_became_active":"2023-12-08T08:16:45.719131+0000","last_became_peered":"2023-12-08T08:16:45.719131+0000","last_unstale":"2023-12-08T08:16:47.056229+0000","last_undegraded":"2023-12-08T08:16:47.056229+0000","last_fullsized":"2023-12-08T08:16:47.056229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:56.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679167+0000","last_change":"2023-12-08T08:16:29.998886+0000","last_active":"2023-12-08T08:16:45.679167+0000","last_peered":"2023-12-08T08:16:45.679167+0000","last_clean":"2023-12-08T08:16:45.679167+0000","last_became_active":"2023-12-08T08:16:29.998501+0000","last_became_peered":"2023-12-08T08:16:29.998501+0000","last_unstale":"2023-12-08T08:16:45.679167+0000","last_undegraded":"2023-12-08T08:16:45.679167+0000","last_fullsized":"2023-12-08T08:16:45.679167+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052976+0000","last_change":"2023-12-08T08:16:45.711028+0000","last_active":"2023-12-08T08:16:47.052976+0000","last_peered":"2023-12-08T08:16:47.052976+0000","last_clean":"2023-12-08T08:16:47.052976+0000","last_became_active":"2023-12-08T08:16:45.708573+0000","last_became_peered":"2023-12-08T08:16:45.708573+0000","last_unstale":"2023-12-08T08:16:47.052976+0000","last_undegraded":"2023-12-08T08:16:47.052976+0000","last_fullsized":"2023-12-08T08:16:47.052976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:58.811940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701967+0000","last_change":"2023-12-08T08:16:29.996508+0000","last_active":"2023-12-08T08:16:45.701967+0000","last_peered":"2023-12-08T08:16:45.701967+0000","last_clean":"2023-12-08T08:16:45.701967+0000","last_became_active":"2023-12-08T08:16:29.995570+0000","last_became_peered":"2023-12-08T08:16:29.995570+0000","last_unstale":"2023-12-08T08:16:45.701967+0000","last_undegraded":"2023-12-08T08:16:45.701967+0000","last_fullsized":"2023-12-08T08:16:45.701967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057498+0000","last_change":"2023-12-08T08:16:45.721513+0000","last_active":"2023-12-08T08:16:47.057498+0000","last_peered":"2023-12-08T08:16:47.057498+0000","last_clean":"2023-12-08T08:16:47.057498+0000","last_became_active":"2023-12-08T08:16:45.720898+0000","last_became_peered":"2023-12-08T08:16:45.720898+0000","last_unstale":"2023-12-08T08:16:47.057498+0000","last_undegraded":"2023-12-08T08:16:47.057498+0000","last_fullsized":"2023-12-08T08:16:47.057498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:51.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.705581+0000","last_change":"2023-12-08T08:16:30.016548+0000","last_active":"2023-12-08T08:16:45.705581+0000","last_peered":"2023-12-08T08:16:45.705581+0000","last_clean":"2023-12-08T08:16:45.705581+0000","last_became_active":"2023-12-08T08:16:30.016231+0000","last_became_peered":"2023-12-08T08:16:30.016231+0000","last_unstale":"2023-12-08T08:16:45.705581+0000","last_undegraded":"2023-12-08T08:16:45.705581+0000","last_fullsized":"2023-12-08T08:16:45.705581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831792+0000","last_change":"2023-12-08T08:16:45.707501+0000","last_active":"2023-12-08T08:16:46.831792+0000","last_peered":"2023-12-08T08:16:46.831792+0000","last_clean":"2023-12-08T08:16:46.831792+0000","last_became_active":"2023-12-08T08:16:45.704587+0000","last_became_peered":"2023-12-08T08:16:45.704587+0000","last_unstale":"2023-12-08T08:16:46.831792+0000","last_undegraded":"2023-12-08T08:16:46.831792+0000","last_fullsized":"2023-12-08T08:16:46.831792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:25:12.937736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708931+0000","last_change":"2023-12-08T08:16:30.018546+0000","last_active":"2023-12-08T08:16:45.708931+0000","last_peered":"2023-12-08T08:16:45.708931+0000","last_clean":"2023-12-08T08:16:45.708931+0000","last_became_active":"2023-12-08T08:16:30.018247+0000","last_became_peered":"2023-12-08T08:16:30.018247+0000","last_unstale":"2023-12-08T08:16:45.708931+0000","last_undegraded":"2023-12-08T08:16:45.708931+0000","last_fullsized":"2023-12-08T08:16:45.708931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055281+0000","last_change":"2023-12-08T08:16:45.712421+0000","last_active":"2023-12-08T08:16:47.055281+0000","last_peered":"2023-12-08T08:16:47.055281+0000","last_clean":"2023-12-08T08:16:47.055281+0000","last_became_active":"2023-12-08T08:16:45.711804+0000","last_became_peered":"2023-12-08T08:16:45.711804+0000","last_unstale":"2023-12-08T08:16:47.055281+0000","last_undegraded":"2023-12-08T08:16:47.055281+0000","last_fullsized":"2023-12-08T08:16:47.055281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:25.961695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.688758+0000","last_change":"2023-12-08T08:16:30.004791+0000","last_active":"2023-12-08T08:16:45.688758+0000","last_peered":"2023-12-08T08:16:45.688758+0000","last_clean":"2023-12-08T08:16:45.688758+0000","last_became_active":"2023-12-08T08:16:30.002347+0000","last_became_peered":"2023-12-08T08:16:30.002347+0000","last_unstale":"2023-12-08T08:16:45.688758+0000","last_undegraded":"2023-12-08T08:16:45.688758+0000","last_fullsized":"2023-12-08T08:16:45.688758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832333+0000","last_change":"2023-12-08T08:16:45.704132+0000","last_active":"2023-12-08T08:16:46.832333+0000","last_peered":"2023-12-08T08:16:46.832333+0000","last_clean":"2023-12-08T08:16:46.832333+0000","last_became_active":"2023-12-08T08:16:45.703807+0000","last_became_peered":"2023-12-08T08:16:45.703807+0000","last_unstale":"2023-12-08T08:16:46.832333+0000","last_undegraded":"2023-12-08T08:16:46.832333+0000","last_fullsized":"2023-12-08T08:16:46.832333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:12.546207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696214+0000","last_change":"2023-12-08T08:16:29.992462+0000","last_active":"2023-12-08T08:16:45.696214+0000","last_peered":"2023-12-08T08:16:45.696214+0000","last_clean":"2023-12-08T08:16:45.696214+0000","last_became_active":"2023-12-08T08:16:29.991153+0000","last_became_peered":"2023-12-08T08:16:29.991153+0000","last_unstale":"2023-12-08T08:16:45.696214+0000","last_undegraded":"2023-12-08T08:16:45.696214+0000","last_fullsized":"2023-12-08T08:16:45.696214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:20.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057346+0000","last_change":"2023-12-08T08:16:45.718888+0000","last_active":"2023-12-08T08:16:47.057346+0000","last_peered":"2023-12-08T08:16:47.057346+0000","last_clean":"2023-12-08T08:16:47.057346+0000","last_became_active":"2023-12-08T08:16:45.717952+0000","last_became_peered":"2023-12-08T08:16:45.717952+0000","last_unstale":"2023-12-08T08:16:47.057346+0000","last_undegraded":"2023-12-08T08:16:47.057346+0000","last_fullsized":"2023-12-08T08:16:47.057346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:00:29.393392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686268+0000","last_change":"2023-12-08T08:16:30.002827+0000","last_active":"2023-12-08T08:16:45.686268+0000","last_peered":"2023-12-08T08:16:45.686268+0000","last_clean":"2023-12-08T08:16:45.686268+0000","last_became_active":"2023-12-08T08:16:30.002525+0000","last_became_peered":"2023-12-08T08:16:30.002525+0000","last_unstale":"2023-12-08T08:16:45.686268+0000","last_undegraded":"2023-12-08T08:16:45.686268+0000","last_fullsized":"2023-12-08T08:16:45.686268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053574+0000","last_change":"2023-12-08T08:16:45.705320+0000","last_active":"2023-12-08T08:16:47.053574+0000","last_peered":"2023-12-08T08:16:47.053574+0000","last_clean":"2023-12-08T08:16:47.053574+0000","last_became_active":"2023-12-08T08:16:45.704745+0000","last_became_peered":"2023-12-08T08:16:45.704745+0000","last_unstale":"2023-12-08T08:16:47.053574+0000","last_undegraded":"2023-12-08T08:16:47.053574+0000","last_fullsized":"2023-12-08T08:16:47.053574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:45.137213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696374+0000","last_change":"2023-12-08T08:16:30.009287+0000","last_active":"2023-12-08T08:16:45.696374+0000","last_peered":"2023-12-08T08:16:45.696374+0000","last_clean":"2023-12-08T08:16:45.696374+0000","last_became_active":"2023-12-08T08:16:30.008873+0000","last_became_peered":"2023-12-08T08:16:30.008873+0000","last_unstale":"2023-12-08T08:16:45.696374+0000","last_undegraded":"2023-12-08T08:16:45.696374+0000","last_fullsized":"2023-12-08T08:16:45.696374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056129+0000","last_change":"2023-12-08T08:16:45.707925+0000","last_active":"2023-12-08T08:16:47.056129+0000","last_peered":"2023-12-08T08:16:47.056129+0000","last_clean":"2023-12-08T08:16:47.056129+0000","last_became_active":"2023-12-08T08:16:45.707542+0000","last_became_peered":"2023-12-08T08:16:45.707542+0000","last_unstale":"2023-12-08T08:16:47.056129+0000","last_undegraded":"2023-12-08T08:16:47.056129+0000","last_fullsized":"2023-12-08T08:16:47.056129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:30.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679703+0000","last_change":"2023-12-08T08:16:30.000677+0000","last_active":"2023-12-08T08:16:45.679703+0000","last_peered":"2023-12-08T08:16:45.679703+0000","last_clean":"2023-12-08T08:16:45.679703+0000","last_became_active":"2023-12-08T08:16:29.998275+0000","last_became_peered":"2023-12-08T08:16:29.998275+0000","last_unstale":"2023-12-08T08:16:45.679703+0000","last_undegraded":"2023-12-08T08:16:45.679703+0000","last_fullsized":"2023-12-08T08:16:45.679703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:02.066542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832490+0000","last_change":"2023-12-08T08:16:45.714720+0000","last_active":"2023-12-08T08:16:46.832490+0000","last_peered":"2023-12-08T08:16:46.832490+0000","last_clean":"2023-12-08T08:16:46.832490+0000","last_became_active":"2023-12-08T08:16:45.714308+0000","last_became_peered":"2023-12-08T08:16:45.714308+0000","last_unstale":"2023-12-08T08:16:46.832490+0000","last_undegraded":"2023-12-08T08:16:46.832490+0000","last_fullsized":"2023-12-08T08:16:46.832490+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:42.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707968+0000","last_change":"2023-12-08T08:16:29.999599+0000","last_active":"2023-12-08T08:16:45.707968+0000","last_peered":"2023-12-08T08:16:45.707968+0000","last_clean":"2023-12-08T08:16:45.707968+0000","last_became_active":"2023-12-08T08:16:29.998776+0000","last_became_peered":"2023-12-08T08:16:29.998776+0000","last_unstale":"2023-12-08T08:16:45.707968+0000","last_undegraded":"2023-12-08T08:16:45.707968+0000","last_fullsized":"2023-12-08T08:16:45.707968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053573+0000","last_change":"2023-12-08T08:16:45.709900+0000","last_active":"2023-12-08T08:16:47.053573+0000","last_peered":"2023-12-08T08:16:47.053573+0000","last_clean":"2023-12-08T08:16:47.053573+0000","last_became_active":"2023-12-08T08:16:45.708321+0000","last_became_peered":"2023-12-08T08:16:45.708321+0000","last_unstale":"2023-12-08T08:16:47.053573+0000","last_undegraded":"2023-12-08T08:16:47.053573+0000","last_fullsized":"2023-12-08T08:16:47.053573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:32.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693129+0000","last_change":"2023-12-08T08:16:29.998897+0000","last_active":"2023-12-08T08:16:45.693129+0000","last_peered":"2023-12-08T08:16:45.693129+0000","last_clean":"2023-12-08T08:16:45.693129+0000","last_became_active":"2023-12-08T08:16:29.998609+0000","last_became_peered":"2023-12-08T08:16:29.998609+0000","last_unstale":"2023-12-08T08:16:45.693129+0000","last_undegraded":"2023-12-08T08:16:45.693129+0000","last_fullsized":"2023-12-08T08:16:45.693129+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:40.747230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.684866+0000","last_change":"2023-12-08T08:16:45.716126+0000","last_active":"2023-12-08T08:16:46.684866+0000","last_peered":"2023-12-08T08:16:46.684866+0000","last_clean":"2023-12-08T08:16:46.684866+0000","last_became_active":"2023-12-08T08:16:45.714854+0000","last_became_peered":"2023-12-08T08:16:45.714854+0000","last_unstale":"2023-12-08T08:16:46.684866+0000","last_undegraded":"2023-12-08T08:16:46.684866+0000","last_fullsized":"2023-12-08T08:16:46.684866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:07.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.689757+0000","last_change":"2023-12-08T08:16:29.991119+0000","last_active":"2023-12-08T08:16:45.689757+0000","last_peered":"2023-12-08T08:16:45.689757+0000","last_clean":"2023-12-08T08:16:45.689757+0000","last_became_active":"2023-12-08T08:16:29.990839+0000","last_became_peered":"2023-12-08T08:16:29.990839+0000","last_unstale":"2023-12-08T08:16:45.689757+0000","last_undegraded":"2023-12-08T08:16:45.689757+0000","last_fullsized":"2023-12-08T08:16:45.689757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831689+0000","last_change":"2023-12-08T08:16:45.707560+0000","last_active":"2023-12-08T08:16:46.831689+0000","last_peered":"2023-12-08T08:16:46.831689+0000","last_clean":"2023-12-08T08:16:46.831689+0000","last_became_active":"2023-12-08T08:16:45.706867+0000","last_became_peered":"2023-12-08T08:16:45.706867+0000","last_unstale":"2023-12-08T08:16:46.831689+0000","last_undegraded":"2023-12-08T08:16:46.831689+0000","last_fullsized":"2023-12-08T08:16:46.831689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:26:04.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680589+0000","last_change":"2023-12-08T08:16:30.020097+0000","last_active":"2023-12-08T08:16:45.680589+0000","last_peered":"2023-12-08T08:16:45.680589+0000","last_clean":"2023-12-08T08:16:45.680589+0000","last_became_active":"2023-12-08T08:16:30.017380+0000","last_became_peered":"2023-12-08T08:16:30.017380+0000","last_unstale":"2023-12-08T08:16:45.680589+0000","last_undegraded":"2023-12-08T08:16:45.680589+0000","last_fullsized":"2023-12-08T08:16:45.680589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:35.005481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054022+0000","last_change":"2023-12-08T08:16:45.710209+0000","last_active":"2023-12-08T08:16:47.054022+0000","last_peered":"2023-12-08T08:16:47.054022+0000","last_clean":"2023-12-08T08:16:47.054022+0000","last_became_active":"2023-12-08T08:16:45.707987+0000","last_became_peered":"2023-12-08T08:16:45.707987+0000","last_unstale":"2023-12-08T08:16:47.054022+0000","last_undegraded":"2023-12-08T08:16:47.054022+0000","last_fullsized":"2023-12-08T08:16:47.054022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:57.040711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.689536+0000","last_change":"2023-12-08T08:16:29.990154+0000","last_active":"2023-12-08T08:16:45.689536+0000","last_peered":"2023-12-08T08:16:45.689536+0000","last_clean":"2023-12-08T08:16:45.689536+0000","last_became_active":"2023-12-08T08:16:29.989050+0000","last_became_peered":"2023-12-08T08:16:29.989050+0000","last_unstale":"2023-12-08T08:16:45.689536+0000","last_undegraded":"2023-12-08T08:16:45.689536+0000","last_fullsized":"2023-12-08T08:16:45.689536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054260+0000","last_change":"2023-12-08T08:16:45.712351+0000","last_active":"2023-12-08T08:16:47.054260+0000","last_peered":"2023-12-08T08:16:47.054260+0000","last_clean":"2023-12-08T08:16:47.054260+0000","last_became_active":"2023-12-08T08:16:45.711262+0000","last_became_peered":"2023-12-08T08:16:45.711262+0000","last_unstale":"2023-12-08T08:16:47.054260+0000","last_undegraded":"2023-12-08T08:16:47.054260+0000","last_fullsized":"2023-12-08T08:16:47.054260+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:32.207784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.697707+0000","last_change":"2023-12-08T08:16:30.006811+0000","last_active":"2023-12-08T08:16:45.697707+0000","last_peered":"2023-12-08T08:16:45.697707+0000","last_clean":"2023-12-08T08:16:45.697707+0000","last_became_active":"2023-12-08T08:16:30.006397+0000","last_became_peered":"2023-12-08T08:16:30.006397+0000","last_unstale":"2023-12-08T08:16:45.697707+0000","last_undegraded":"2023-12-08T08:16:45.697707+0000","last_fullsized":"2023-12-08T08:16:45.697707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832355+0000","last_change":"2023-12-08T08:16:45.705973+0000","last_active":"2023-12-08T08:16:46.832355+0000","last_peered":"2023-12-08T08:16:46.832355+0000","last_clean":"2023-12-08T08:16:46.832355+0000","last_became_active":"2023-12-08T08:16:45.705677+0000","last_became_peered":"2023-12-08T08:16:45.705677+0000","last_unstale":"2023-12-08T08:16:46.832355+0000","last_undegraded":"2023-12-08T08:16:46.832355+0000","last_fullsized":"2023-12-08T08:16:46.832355+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:20.118262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.687301+0000","last_change":"2023-12-08T08:16:29.996114+0000","last_active":"2023-12-08T08:16:45.687301+0000","last_peered":"2023-12-08T08:16:45.687301+0000","last_clean":"2023-12-08T08:16:45.687301+0000","last_became_active":"2023-12-08T08:16:29.995823+0000","last_became_peered":"2023-12-08T08:16:29.995823+0000","last_unstale":"2023-12-08T08:16:45.687301+0000","last_undegraded":"2023-12-08T08:16:45.687301+0000","last_fullsized":"2023-12-08T08:16:45.687301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:24.233820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057578+0000","last_change":"2023-12-08T08:16:45.703015+0000","last_active":"2023-12-08T08:16:47.057578+0000","last_peered":"2023-12-08T08:16:47.057578+0000","last_clean":"2023-12-08T08:16:47.057578+0000","last_became_active":"2023-12-08T08:16:45.699795+0000","last_became_peered":"2023-12-08T08:16:45.699795+0000","last_unstale":"2023-12-08T08:16:47.057578+0000","last_undegraded":"2023-12-08T08:16:47.057578+0000","last_fullsized":"2023-12-08T08:16:47.057578+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:27:54.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686368+0000","last_change":"2023-12-08T08:16:29.993060+0000","last_active":"2023-12-08T08:16:45.686368+0000","last_peered":"2023-12-08T08:16:45.686368+0000","last_clean":"2023-12-08T08:16:45.686368+0000","last_became_active":"2023-12-08T08:16:29.992718+0000","last_became_peered":"2023-12-08T08:16:29.992718+0000","last_unstale":"2023-12-08T08:16:45.686368+0000","last_undegraded":"2023-12-08T08:16:45.686368+0000","last_fullsized":"2023-12-08T08:16:45.686368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:29.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832407+0000","last_change":"2023-12-08T08:16:45.716261+0000","last_active":"2023-12-08T08:16:46.832407+0000","last_peered":"2023-12-08T08:16:46.832407+0000","last_clean":"2023-12-08T08:16:46.832407+0000","last_became_active":"2023-12-08T08:16:45.715939+0000","last_became_peered":"2023-12-08T08:16:45.715939+0000","last_unstale":"2023-12-08T08:16:46.832407+0000","last_undegraded":"2023-12-08T08:16:46.832407+0000","last_fullsized":"2023-12-08T08:16:46.832407+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:57.860549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708067+0000","last_change":"2023-12-08T08:16:30.000366+0000","last_active":"2023-12-08T08:16:45.708067+0000","last_peered":"2023-12-08T08:16:45.708067+0000","last_clean":"2023-12-08T08:16:45.708067+0000","last_became_active":"2023-12-08T08:16:29.999086+0000","last_became_peered":"2023-12-08T08:16:29.999086+0000","last_unstale":"2023-12-08T08:16:45.708067+0000","last_undegraded":"2023-12-08T08:16:45.708067+0000","last_fullsized":"2023-12-08T08:16:45.708067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057836+0000","last_change":"2023-12-08T08:16:45.721719+0000","last_active":"2023-12-08T08:16:47.057836+0000","last_peered":"2023-12-08T08:16:47.057836+0000","last_clean":"2023-12-08T08:16:47.057836+0000","last_became_active":"2023-12-08T08:16:45.721247+0000","last_became_peered":"2023-12-08T08:16:45.721247+0000","last_unstale":"2023-12-08T08:16:47.057836+0000","last_undegraded":"2023-12-08T08:16:47.057836+0000","last_fullsized":"2023-12-08T08:16:47.057836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:05.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.674991+0000","last_change":"2023-12-08T08:16:30.001378+0000","last_active":"2023-12-08T08:16:45.674991+0000","last_peered":"2023-12-08T08:16:45.674991+0000","last_clean":"2023-12-08T08:16:45.674991+0000","last_became_active":"2023-12-08T08:16:30.000249+0000","last_became_peered":"2023-12-08T08:16:30.000249+0000","last_unstale":"2023-12-08T08:16:45.674991+0000","last_undegraded":"2023-12-08T08:16:45.674991+0000","last_fullsized":"2023-12-08T08:16:45.674991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:52.117326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054280+0000","last_change":"2023-12-08T08:16:45.711289+0000","last_active":"2023-12-08T08:16:47.054280+0000","last_peered":"2023-12-08T08:16:47.054280+0000","last_clean":"2023-12-08T08:16:47.054280+0000","last_became_active":"2023-12-08T08:16:45.708816+0000","last_became_peered":"2023-12-08T08:16:45.708816+0000","last_unstale":"2023-12-08T08:16:47.054280+0000","last_undegraded":"2023-12-08T08:16:47.054280+0000","last_fullsized":"2023-12-08T08:16:47.054280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:29.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053691+0000","last_change":"2023-12-08T08:16:45.105864+0000","last_active":"2023-12-08T08:16:47.053691+0000","last_peered":"2023-12-08T08:16:47.053691+0000","last_clean":"2023-12-08T08:16:47.053691+0000","last_became_active":"2023-12-08T08:16:45.103673+0000","last_became_peered":"2023-12-08T08:16:45.103673+0000","last_unstale":"2023-12-08T08:16:47.053691+0000","last_undegraded":"2023-12-08T08:16:47.053691+0000","last_fullsized":"2023-12-08T08:16:47.053691+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:02.005336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708719+0000","last_change":"2023-12-08T08:16:30.018277+0000","last_active":"2023-12-08T08:16:45.708719+0000","last_peered":"2023-12-08T08:16:45.708719+0000","last_clean":"2023-12-08T08:16:45.708719+0000","last_became_active":"2023-12-08T08:16:30.017958+0000","last_became_peered":"2023-12-08T08:16:30.017958+0000","last_unstale":"2023-12-08T08:16:45.708719+0000","last_undegraded":"2023-12-08T08:16:45.708719+0000","last_fullsized":"2023-12-08T08:16:45.708719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.690371+0000","last_change":"2023-12-08T08:16:28.972135+0000","last_active":"2023-12-08T08:16:45.690371+0000","last_peered":"2023-12-08T08:16:45.690371+0000","last_clean":"2023-12-08T08:16:45.690371+0000","last_became_active":"2023-12-08T08:16:28.971791+0000","last_became_peered":"2023-12-08T08:16:28.971791+0000","last_unstale":"2023-12-08T08:16:45.690371+0000","last_undegraded":"2023-12-08T08:16:45.690371+0000","last_fullsized":"2023-12-08T08:16:45.690371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053161+0000","last_change":"2023-12-08T08:16:45.705418+0000","last_active":"2023-12-08T08:16:47.053161+0000","last_peered":"2023-12-08T08:16:47.053161+0000","last_clean":"2023-12-08T08:16:47.053161+0000","last_became_active":"2023-12-08T08:16:45.705049+0000","last_became_peered":"2023-12-08T08:16:45.705049+0000","last_unstale":"2023-12-08T08:16:47.053161+0000","last_undegraded":"2023-12-08T08:16:47.053161+0000","last_fullsized":"2023-12-08T08:16:47.053161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:25:12.937736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060382+0000","last_change":"2023-12-08T08:16:45.102201+0000","last_active":"2023-12-08T08:16:47.060382+0000","last_peered":"2023-12-08T08:16:47.060382+0000","last_clean":"2023-12-08T08:16:47.060382+0000","last_became_active":"2023-12-08T08:16:45.101874+0000","last_became_peered":"2023-12-08T08:16:45.101874+0000","last_unstale":"2023-12-08T08:16:47.060382+0000","last_undegraded":"2023-12-08T08:16:47.060382+0000","last_fullsized":"2023-12-08T08:16:47.060382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:20.563413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.678887+0000","last_change":"2023-12-08T08:16:30.017910+0000","last_active":"2023-12-08T08:16:45.678887+0000","last_peered":"2023-12-08T08:16:45.678887+0000","last_clean":"2023-12-08T08:16:45.678887+0000","last_became_active":"2023-12-08T08:16:30.017619+0000","last_became_peered":"2023-12-08T08:16:30.017619+0000","last_unstale":"2023-12-08T08:16:45.678887+0000","last_undegraded":"2023-12-08T08:16:45.678887+0000","last_fullsized":"2023-12-08T08:16:45.678887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:15.253515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.697950+0000","last_change":"2023-12-08T08:16:28.974333+0000","last_active":"2023-12-08T08:16:45.697950+0000","last_peered":"2023-12-08T08:16:45.697950+0000","last_clean":"2023-12-08T08:16:45.697950+0000","last_became_active":"2023-12-08T08:16:28.974049+0000","last_became_peered":"2023-12-08T08:16:28.974049+0000","last_unstale":"2023-12-08T08:16:45.697950+0000","last_undegraded":"2023-12-08T08:16:45.697950+0000","last_fullsized":"2023-12-08T08:16:45.697950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:01.053374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055256+0000","last_change":"2023-12-08T08:16:45.706125+0000","last_active":"2023-12-08T08:16:47.055256+0000","last_peered":"2023-12-08T08:16:47.055256+0000","last_clean":"2023-12-08T08:16:47.055256+0000","last_became_active":"2023-12-08T08:16:45.705771+0000","last_became_peered":"2023-12-08T08:16:45.705771+0000","last_unstale":"2023-12-08T08:16:47.055256+0000","last_undegraded":"2023-12-08T08:16:47.055256+0000","last_fullsized":"2023-12-08T08:16:47.055256+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:58.532849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058615+0000","last_change":"2023-12-08T08:16:45.105380+0000","last_active":"2023-12-08T08:16:47.058615+0000","last_peered":"2023-12-08T08:16:47.058615+0000","last_clean":"2023-12-08T08:16:47.058615+0000","last_became_active":"2023-12-08T08:16:45.104137+0000","last_became_peered":"2023-12-08T08:16:45.104137+0000","last_unstale":"2023-12-08T08:16:47.058615+0000","last_undegraded":"2023-12-08T08:16:47.058615+0000","last_fullsized":"2023-12-08T08:16:47.058615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:07.293948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679772+0000","last_change":"2023-12-08T08:16:30.000953+0000","last_active":"2023-12-08T08:16:45.679772+0000","last_peered":"2023-12-08T08:16:45.679772+0000","last_clean":"2023-12-08T08:16:45.679772+0000","last_became_active":"2023-12-08T08:16:30.000673+0000","last_became_peered":"2023-12-08T08:16:30.000673+0000","last_unstale":"2023-12-08T08:16:45.679772+0000","last_undegraded":"2023-12-08T08:16:45.679772+0000","last_fullsized":"2023-12-08T08:16:45.679772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679333+0000","last_change":"2023-12-08T08:16:28.970890+0000","last_active":"2023-12-08T08:16:45.679333+0000","last_peered":"2023-12-08T08:16:45.679333+0000","last_clean":"2023-12-08T08:16:45.679333+0000","last_became_active":"2023-12-08T08:16:28.970617+0000","last_became_peered":"2023-12-08T08:16:28.970617+0000","last_unstale":"2023-12-08T08:16:45.679333+0000","last_undegraded":"2023-12-08T08:16:45.679333+0000","last_fullsized":"2023-12-08T08:16:45.679333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:27.409906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058015+0000","last_change":"2023-12-08T08:16:45.715855+0000","last_active":"2023-12-08T08:16:47.058015+0000","last_peered":"2023-12-08T08:16:47.058015+0000","last_clean":"2023-12-08T08:16:47.058015+0000","last_became_active":"2023-12-08T08:16:45.715182+0000","last_became_peered":"2023-12-08T08:16:45.715182+0000","last_unstale":"2023-12-08T08:16:47.058015+0000","last_undegraded":"2023-12-08T08:16:47.058015+0000","last_fullsized":"2023-12-08T08:16:47.058015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:51.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052933+0000","last_change":"2023-12-08T08:16:45.091402+0000","last_active":"2023-12-08T08:16:47.052933+0000","last_peered":"2023-12-08T08:16:47.052933+0000","last_clean":"2023-12-08T08:16:47.052933+0000","last_became_active":"2023-12-08T08:16:45.091037+0000","last_became_peered":"2023-12-08T08:16:45.091037+0000","last_unstale":"2023-12-08T08:16:47.052933+0000","last_undegraded":"2023-12-08T08:16:47.052933+0000","last_fullsized":"2023-12-08T08:16:47.052933+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:38.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702861+0000","last_change":"2023-12-08T08:16:30.002841+0000","last_active":"2023-12-08T08:16:45.702861+0000","last_peered":"2023-12-08T08:16:45.702861+0000","last_clean":"2023-12-08T08:16:45.702861+0000","last_became_active":"2023-12-08T08:16:30.002371+0000","last_became_peered":"2023-12-08T08:16:30.002371+0000","last_unstale":"2023-12-08T08:16:45.702861+0000","last_undegraded":"2023-12-08T08:16:45.702861+0000","last_fullsized":"2023-12-08T08:16:45.702861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.683064+0000","last_change":"2023-12-08T08:16:28.966804+0000","last_active":"2023-12-08T08:16:45.683064+0000","last_peered":"2023-12-08T08:16:45.683064+0000","last_clean":"2023-12-08T08:16:45.683064+0000","last_became_active":"2023-12-08T08:16:28.966500+0000","last_became_peered":"2023-12-08T08:16:28.966500+0000","last_unstale":"2023-12-08T08:16:45.683064+0000","last_undegraded":"2023-12-08T08:16:45.683064+0000","last_fullsized":"2023-12-08T08:16:45.683064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053889+0000","last_change":"2023-12-08T08:16:45.708581+0000","last_active":"2023-12-08T08:16:47.053889+0000","last_peered":"2023-12-08T08:16:47.053889+0000","last_clean":"2023-12-08T08:16:47.053889+0000","last_became_active":"2023-12-08T08:16:45.707960+0000","last_became_peered":"2023-12-08T08:16:45.707960+0000","last_unstale":"2023-12-08T08:16:47.053889+0000","last_undegraded":"2023-12-08T08:16:47.053889+0000","last_fullsized":"2023-12-08T08:16:47.053889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:20.118262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054020+0000","last_change":"2023-12-08T08:16:45.103816+0000","last_active":"2023-12-08T08:16:47.054020+0000","last_peered":"2023-12-08T08:16:47.054020+0000","last_clean":"2023-12-08T08:16:47.054020+0000","last_became_active":"2023-12-08T08:16:45.103203+0000","last_became_peered":"2023-12-08T08:16:45.103203+0000","last_unstale":"2023-12-08T08:16:47.054020+0000","last_undegraded":"2023-12-08T08:16:47.054020+0000","last_fullsized":"2023-12-08T08:16:47.054020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:08.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693188+0000","last_change":"2023-12-08T08:16:29.999014+0000","last_active":"2023-12-08T08:16:45.693188+0000","last_peered":"2023-12-08T08:16:45.693188+0000","last_clean":"2023-12-08T08:16:45.693188+0000","last_became_active":"2023-12-08T08:16:29.998706+0000","last_became_peered":"2023-12-08T08:16:29.998706+0000","last_unstale":"2023-12-08T08:16:45.693188+0000","last_undegraded":"2023-12-08T08:16:45.693188+0000","last_fullsized":"2023-12-08T08:16:45.693188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696486+0000","last_change":"2023-12-08T08:16:28.972751+0000","last_active":"2023-12-08T08:16:45.696486+0000","last_peered":"2023-12-08T08:16:45.696486+0000","last_clean":"2023-12-08T08:16:45.696486+0000","last_became_active":"2023-12-08T08:16:28.971599+0000","last_became_peered":"2023-12-08T08:16:28.971599+0000","last_unstale":"2023-12-08T08:16:45.696486+0000","last_undegraded":"2023-12-08T08:16:45.696486+0000","last_fullsized":"2023-12-08T08:16:45.696486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056869+0000","last_change":"2023-12-08T08:16:45.718745+0000","last_active":"2023-12-08T08:16:47.056869+0000","last_peered":"2023-12-08T08:16:47.056869+0000","last_clean":"2023-12-08T08:16:47.056869+0000","last_became_active":"2023-12-08T08:16:45.718434+0000","last_became_peered":"2023-12-08T08:16:45.718434+0000","last_unstale":"2023-12-08T08:16:47.056869+0000","last_undegraded":"2023-12-08T08:16:47.056869+0000","last_fullsized":"2023-12-08T08:16:47.056869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:25.961695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831444+0000","last_change":"2023-12-08T08:16:45.106766+0000","last_active":"2023-12-08T08:16:46.831444+0000","last_peered":"2023-12-08T08:16:46.831444+0000","last_clean":"2023-12-08T08:16:46.831444+0000","last_became_active":"2023-12-08T08:16:45.106317+0000","last_became_peered":"2023-12-08T08:16:45.106317+0000","last_unstale":"2023-12-08T08:16:46.831444+0000","last_undegraded":"2023-12-08T08:16:46.831444+0000","last_fullsized":"2023-12-08T08:16:46.831444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:03.725391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702100+0000","last_change":"2023-12-08T08:16:30.005902+0000","last_active":"2023-12-08T08:16:45.702100+0000","last_peered":"2023-12-08T08:16:45.702100+0000","last_clean":"2023-12-08T08:16:45.702100+0000","last_became_active":"2023-12-08T08:16:30.005581+0000","last_became_peered":"2023-12-08T08:16:30.005581+0000","last_unstale":"2023-12-08T08:16:45.702100+0000","last_undegraded":"2023-12-08T08:16:45.702100+0000","last_fullsized":"2023-12-08T08:16:45.702100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707647+0000","last_change":"2023-12-08T08:16:28.980410+0000","last_active":"2023-12-08T08:16:45.707647+0000","last_peered":"2023-12-08T08:16:45.707647+0000","last_clean":"2023-12-08T08:16:45.707647+0000","last_became_active":"2023-12-08T08:16:28.980037+0000","last_became_peered":"2023-12-08T08:16:28.980037+0000","last_unstale":"2023-12-08T08:16:45.707647+0000","last_undegraded":"2023-12-08T08:16:45.707647+0000","last_fullsized":"2023-12-08T08:16:45.707647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:00.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687406+0000","last_change":"2023-12-08T08:16:45.701754+0000","last_active":"2023-12-08T08:16:46.687406+0000","last_peered":"2023-12-08T08:16:46.687406+0000","last_clean":"2023-12-08T08:16:46.687406+0000","last_became_active":"2023-12-08T08:16:45.700029+0000","last_became_peered":"2023-12-08T08:16:45.700029+0000","last_unstale":"2023-12-08T08:16:46.687406+0000","last_undegraded":"2023-12-08T08:16:46.687406+0000","last_fullsized":"2023-12-08T08:16:46.687406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:08.307093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832004+0000","last_change":"2023-12-08T08:16:45.104969+0000","last_active":"2023-12-08T08:16:46.832004+0000","last_peered":"2023-12-08T08:16:46.832004+0000","last_clean":"2023-12-08T08:16:46.832004+0000","last_became_active":"2023-12-08T08:16:45.104653+0000","last_became_peered":"2023-12-08T08:16:45.104653+0000","last_unstale":"2023-12-08T08:16:46.832004+0000","last_undegraded":"2023-12-08T08:16:46.832004+0000","last_fullsized":"2023-12-08T08:16:46.832004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:55.511584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679767+0000","last_change":"2023-12-08T08:16:30.012886+0000","last_active":"2023-12-08T08:16:45.679767+0000","last_peered":"2023-12-08T08:16:45.679767+0000","last_clean":"2023-12-08T08:16:45.679767+0000","last_became_active":"2023-12-08T08:16:30.012578+0000","last_became_peered":"2023-12-08T08:16:30.012578+0000","last_unstale":"2023-12-08T08:16:45.679767+0000","last_undegraded":"2023-12-08T08:16:45.679767+0000","last_fullsized":"2023-12-08T08:16:45.679767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675900+0000","last_change":"2023-12-08T08:16:28.966099+0000","last_active":"2023-12-08T08:16:45.675900+0000","last_peered":"2023-12-08T08:16:45.675900+0000","last_clean":"2023-12-08T08:16:45.675900+0000","last_became_active":"2023-12-08T08:16:28.965830+0000","last_became_peered":"2023-12-08T08:16:28.965830+0000","last_unstale":"2023-12-08T08:16:45.675900+0000","last_undegraded":"2023-12-08T08:16:45.675900+0000","last_fullsized":"2023-12-08T08:16:45.675900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.868360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058546+0000","last_change":"2023-12-08T08:16:45.720839+0000","last_active":"2023-12-08T08:16:47.058546+0000","last_peered":"2023-12-08T08:16:47.058546+0000","last_clean":"2023-12-08T08:16:47.058546+0000","last_became_active":"2023-12-08T08:16:45.720542+0000","last_became_peered":"2023-12-08T08:16:45.720542+0000","last_unstale":"2023-12-08T08:16:47.058546+0000","last_undegraded":"2023-12-08T08:16:47.058546+0000","last_fullsized":"2023-12-08T08:16:47.058546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:19.866958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686790+0000","last_change":"2023-12-08T08:16:45.104589+0000","last_active":"2023-12-08T08:16:46.686790+0000","last_peered":"2023-12-08T08:16:46.686790+0000","last_clean":"2023-12-08T08:16:46.686790+0000","last_became_active":"2023-12-08T08:16:45.104122+0000","last_became_peered":"2023-12-08T08:16:45.104122+0000","last_unstale":"2023-12-08T08:16:46.686790+0000","last_undegraded":"2023-12-08T08:16:46.686790+0000","last_fullsized":"2023-12-08T08:16:46.686790+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:08.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701925+0000","last_change":"2023-12-08T08:16:30.004935+0000","last_active":"2023-12-08T08:16:45.701925+0000","last_peered":"2023-12-08T08:16:45.701925+0000","last_clean":"2023-12-08T08:16:45.701925+0000","last_became_active":"2023-12-08T08:16:30.004484+0000","last_became_peered":"2023-12-08T08:16:30.004484+0000","last_unstale":"2023-12-08T08:16:45.701925+0000","last_undegraded":"2023-12-08T08:16:45.701925+0000","last_fullsized":"2023-12-08T08:16:45.701925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680485+0000","last_change":"2023-12-08T08:16:28.970395+0000","last_active":"2023-12-08T08:16:45.680485+0000","last_peered":"2023-12-08T08:16:45.680485+0000","last_clean":"2023-12-08T08:16:45.680485+0000","last_became_active":"2023-12-08T08:16:28.969828+0000","last_became_peered":"2023-12-08T08:16:28.969828+0000","last_unstale":"2023-12-08T08:16:45.680485+0000","last_undegraded":"2023-12-08T08:16:45.680485+0000","last_fullsized":"2023-12-08T08:16:45.680485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832007+0000","last_change":"2023-12-08T08:16:45.703374+0000","last_active":"2023-12-08T08:16:46.832007+0000","last_peered":"2023-12-08T08:16:46.832007+0000","last_clean":"2023-12-08T08:16:46.832007+0000","last_became_active":"2023-12-08T08:16:45.703067+0000","last_became_peered":"2023-12-08T08:16:45.703067+0000","last_unstale":"2023-12-08T08:16:46.832007+0000","last_undegraded":"2023-12-08T08:16:46.832007+0000","last_fullsized":"2023-12-08T08:16:46.832007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:32.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058050+0000","last_change":"2023-12-08T08:16:45.095663+0000","last_active":"2023-12-08T08:16:47.058050+0000","last_peered":"2023-12-08T08:16:47.058050+0000","last_clean":"2023-12-08T08:16:47.058050+0000","last_became_active":"2023-12-08T08:16:45.095200+0000","last_became_peered":"2023-12-08T08:16:45.095200+0000","last_unstale":"2023-12-08T08:16:47.058050+0000","last_undegraded":"2023-12-08T08:16:47.058050+0000","last_fullsized":"2023-12-08T08:16:47.058050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:17.803865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694967+0000","last_change":"2023-12-08T08:16:29.996118+0000","last_active":"2023-12-08T08:16:45.694967+0000","last_peered":"2023-12-08T08:16:45.694967+0000","last_clean":"2023-12-08T08:16:45.694967+0000","last_became_active":"2023-12-08T08:16:29.995815+0000","last_became_peered":"2023-12-08T08:16:29.995815+0000","last_unstale":"2023-12-08T08:16:45.694967+0000","last_undegraded":"2023-12-08T08:16:45.694967+0000","last_fullsized":"2023-12-08T08:16:45.694967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:14.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703101+0000","last_change":"2023-12-08T08:16:28.970249+0000","last_active":"2023-12-08T08:16:45.703101+0000","last_peered":"2023-12-08T08:16:45.703101+0000","last_clean":"2023-12-08T08:16:45.703101+0000","last_became_active":"2023-12-08T08:16:28.969959+0000","last_became_peered":"2023-12-08T08:16:28.969959+0000","last_unstale":"2023-12-08T08:16:45.703101+0000","last_undegraded":"2023-12-08T08:16:45.703101+0000","last_fullsized":"2023-12-08T08:16:45.703101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687345+0000","last_change":"2023-12-08T08:16:45.703480+0000","last_active":"2023-12-08T08:16:46.687345+0000","last_peered":"2023-12-08T08:16:46.687345+0000","last_clean":"2023-12-08T08:16:46.687345+0000","last_became_active":"2023-12-08T08:16:45.702891+0000","last_became_peered":"2023-12-08T08:16:45.702891+0000","last_unstale":"2023-12-08T08:16:46.687345+0000","last_undegraded":"2023-12-08T08:16:46.687345+0000","last_fullsized":"2023-12-08T08:16:46.687345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:40:25.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053662+0000","last_change":"2023-12-08T08:16:45.100074+0000","last_active":"2023-12-08T08:16:47.053662+0000","last_peered":"2023-12-08T08:16:47.053662+0000","last_clean":"2023-12-08T08:16:47.053662+0000","last_became_active":"2023-12-08T08:16:45.099785+0000","last_became_peered":"2023-12-08T08:16:45.099785+0000","last_unstale":"2023-12-08T08:16:47.053662+0000","last_undegraded":"2023-12-08T08:16:47.053662+0000","last_fullsized":"2023-12-08T08:16:47.053662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:18.853813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.709965+0000","last_change":"2023-12-08T08:16:30.011144+0000","last_active":"2023-12-08T08:16:45.709965+0000","last_peered":"2023-12-08T08:16:45.709965+0000","last_clean":"2023-12-08T08:16:45.709965+0000","last_became_active":"2023-12-08T08:16:30.010821+0000","last_became_peered":"2023-12-08T08:16:30.010821+0000","last_unstale":"2023-12-08T08:16:45.709965+0000","last_undegraded":"2023-12-08T08:16:45.709965+0000","last_fullsized":"2023-12-08T08:16:45.709965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695032+0000","last_change":"2023-12-08T08:16:28.972703+0000","last_active":"2023-12-08T08:16:45.695032+0000","last_peered":"2023-12-08T08:16:45.695032+0000","last_clean":"2023-12-08T08:16:45.695032+0000","last_became_active":"2023-12-08T08:16:28.972337+0000","last_became_peered":"2023-12-08T08:16:28.972337+0000","last_unstale":"2023-12-08T08:16:45.695032+0000","last_undegraded":"2023-12-08T08:16:45.695032+0000","last_fullsized":"2023-12-08T08:16:45.695032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686518+0000","last_change":"2023-12-08T08:16:45.711650+0000","last_active":"2023-12-08T08:16:46.686518+0000","last_peered":"2023-12-08T08:16:46.686518+0000","last_clean":"2023-12-08T08:16:46.686518+0000","last_became_active":"2023-12-08T08:16:45.711134+0000","last_became_peered":"2023-12-08T08:16:45.711134+0000","last_unstale":"2023-12-08T08:16:46.686518+0000","last_undegraded":"2023-12-08T08:16:46.686518+0000","last_fullsized":"2023-12-08T08:16:46.686518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:20.080487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057028+0000","last_change":"2023-12-08T08:16:45.107603+0000","last_active":"2023-12-08T08:16:47.057028+0000","last_peered":"2023-12-08T08:16:47.057028+0000","last_clean":"2023-12-08T08:16:47.057028+0000","last_became_active":"2023-12-08T08:16:45.105714+0000","last_became_peered":"2023-12-08T08:16:45.105714+0000","last_unstale":"2023-12-08T08:16:47.057028+0000","last_undegraded":"2023-12-08T08:16:47.057028+0000","last_fullsized":"2023-12-08T08:16:47.057028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:17.947688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696700+0000","last_change":"2023-12-08T08:16:30.002548+0000","last_active":"2023-12-08T08:16:45.696700+0000","last_peered":"2023-12-08T08:16:45.696700+0000","last_clean":"2023-12-08T08:16:45.696700+0000","last_became_active":"2023-12-08T08:16:30.002266+0000","last_became_peered":"2023-12-08T08:16:30.002266+0000","last_unstale":"2023-12-08T08:16:45.696700+0000","last_undegraded":"2023-12-08T08:16:45.696700+0000","last_fullsized":"2023-12-08T08:16:45.696700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:12.090220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695546+0000","last_change":"2023-12-08T08:16:28.974757+0000","last_active":"2023-12-08T08:16:45.695546+0000","last_peered":"2023-12-08T08:16:45.695546+0000","last_clean":"2023-12-08T08:16:45.695546+0000","last_became_active":"2023-12-08T08:16:28.974470+0000","last_became_peered":"2023-12-08T08:16:28.974470+0000","last_unstale":"2023-12-08T08:16:45.695546+0000","last_undegraded":"2023-12-08T08:16:45.695546+0000","last_fullsized":"2023-12-08T08:16:45.695546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:07.487090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054888+0000","last_change":"2023-12-08T08:16:45.715112+0000","last_active":"2023-12-08T08:16:47.054888+0000","last_peered":"2023-12-08T08:16:47.054888+0000","last_clean":"2023-12-08T08:16:47.054888+0000","last_became_active":"2023-12-08T08:16:45.714811+0000","last_became_peered":"2023-12-08T08:16:45.714811+0000","last_unstale":"2023-12-08T08:16:47.054888+0000","last_undegraded":"2023-12-08T08:16:47.054888+0000","last_fullsized":"2023-12-08T08:16:47.054888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:56.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.688035+0000","last_change":"2023-12-08T08:16:45.108742+0000","last_active":"2023-12-08T08:16:46.688035+0000","last_peered":"2023-12-08T08:16:46.688035+0000","last_clean":"2023-12-08T08:16:46.688035+0000","last_became_active":"2023-12-08T08:16:45.108466+0000","last_became_peered":"2023-12-08T08:16:45.108466+0000","last_unstale":"2023-12-08T08:16:46.688035+0000","last_undegraded":"2023-12-08T08:16:46.688035+0000","last_fullsized":"2023-12-08T08:16:46.688035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:23.293185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.682856+0000","last_change":"2023-12-08T08:16:30.000962+0000","last_active":"2023-12-08T08:16:45.682856+0000","last_peered":"2023-12-08T08:16:45.682856+0000","last_clean":"2023-12-08T08:16:45.682856+0000","last_became_active":"2023-12-08T08:16:29.999415+0000","last_became_peered":"2023-12-08T08:16:29.999415+0000","last_unstale":"2023-12-08T08:16:45.682856+0000","last_undegraded":"2023-12-08T08:16:45.682856+0000","last_fullsized":"2023-12-08T08:16:45.682856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:52.760726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.700626+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:45.700626+0000","last_peered":"2023-12-08T08:16:45.700626+0000","last_clean":"2023-12-08T08:16:45.700626+0000","last_became_active":"2023-12-08T08:16:28.974334+0000","last_became_peered":"2023-12-08T08:16:28.974334+0000","last_unstale":"2023-12-08T08:16:45.700626+0000","last_undegraded":"2023-12-08T08:16:45.700626+0000","last_fullsized":"2023-12-08T08:16:45.700626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053600+0000","last_change":"2023-12-08T08:16:45.715925+0000","last_active":"2023-12-08T08:16:47.053600+0000","last_peered":"2023-12-08T08:16:47.053600+0000","last_clean":"2023-12-08T08:16:47.053600+0000","last_became_active":"2023-12-08T08:16:45.715658+0000","last_became_peered":"2023-12-08T08:16:45.715658+0000","last_unstale":"2023-12-08T08:16:47.053600+0000","last_undegraded":"2023-12-08T08:16:47.053600+0000","last_fullsized":"2023-12-08T08:16:47.053600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:24.919971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055975+0000","last_change":"2023-12-08T08:16:45.102583+0000","last_active":"2023-12-08T08:16:47.055975+0000","last_peered":"2023-12-08T08:16:47.055975+0000","last_clean":"2023-12-08T08:16:47.055975+0000","last_became_active":"2023-12-08T08:16:45.102245+0000","last_became_peered":"2023-12-08T08:16:45.102245+0000","last_unstale":"2023-12-08T08:16:47.055975+0000","last_undegraded":"2023-12-08T08:16:47.055975+0000","last_fullsized":"2023-12-08T08:16:47.055975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:53.971361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693342+0000","last_change":"2023-12-08T08:16:30.009858+0000","last_active":"2023-12-08T08:16:45.693342+0000","last_peered":"2023-12-08T08:16:45.693342+0000","last_clean":"2023-12-08T08:16:45.693342+0000","last_became_active":"2023-12-08T08:16:30.009477+0000","last_became_peered":"2023-12-08T08:16:30.009477+0000","last_unstale":"2023-12-08T08:16:45.693342+0000","last_undegraded":"2023-12-08T08:16:45.693342+0000","last_fullsized":"2023-12-08T08:16:45.693342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703155+0000","last_change":"2023-12-08T08:16:28.975330+0000","last_active":"2023-12-08T08:16:45.703155+0000","last_peered":"2023-12-08T08:16:45.703155+0000","last_clean":"2023-12-08T08:16:45.703155+0000","last_became_active":"2023-12-08T08:16:28.974952+0000","last_became_peered":"2023-12-08T08:16:28.974952+0000","last_unstale":"2023-12-08T08:16:45.703155+0000","last_undegraded":"2023-12-08T08:16:45.703155+0000","last_fullsized":"2023-12-08T08:16:45.703155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832995+0000","last_change":"2023-12-08T08:16:45.715865+0000","last_active":"2023-12-08T08:16:46.832995+0000","last_peered":"2023-12-08T08:16:46.832995+0000","last_clean":"2023-12-08T08:16:46.832995+0000","last_became_active":"2023-12-08T08:16:45.715602+0000","last_became_peered":"2023-12-08T08:16:45.715602+0000","last_unstale":"2023-12-08T08:16:46.832995+0000","last_undegraded":"2023-12-08T08:16:46.832995+0000","last_fullsized":"2023-12-08T08:16:46.832995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:05:15.892327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052639+0000","last_change":"2023-12-08T08:16:45.094244+0000","last_active":"2023-12-08T08:16:47.052639+0000","last_peered":"2023-12-08T08:16:47.052639+0000","last_clean":"2023-12-08T08:16:47.052639+0000","last_became_active":"2023-12-08T08:16:45.093417+0000","last_became_peered":"2023-12-08T08:16:45.093417+0000","last_unstale":"2023-12-08T08:16:47.052639+0000","last_undegraded":"2023-12-08T08:16:47.052639+0000","last_fullsized":"2023-12-08T08:16:47.052639+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:04.196403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701275+0000","last_change":"2023-12-08T08:16:29.998148+0000","last_active":"2023-12-08T08:16:45.701275+0000","last_peered":"2023-12-08T08:16:45.701275+0000","last_clean":"2023-12-08T08:16:45.701275+0000","last_became_active":"2023-12-08T08:16:29.997889+0000","last_became_peered":"2023-12-08T08:16:29.997889+0000","last_unstale":"2023-12-08T08:16:45.701275+0000","last_undegraded":"2023-12-08T08:16:45.701275+0000","last_fullsized":"2023-12-08T08:16:45.701275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.681311+0000","last_change":"2023-12-08T08:16:28.965346+0000","last_active":"2023-12-08T08:16:45.681311+0000","last_peered":"2023-12-08T08:16:45.681311+0000","last_clean":"2023-12-08T08:16:45.681311+0000","last_became_active":"2023-12-08T08:16:28.965039+0000","last_became_peered":"2023-12-08T08:16:28.965039+0000","last_unstale":"2023-12-08T08:16:45.681311+0000","last_undegraded":"2023-12-08T08:16:45.681311+0000","last_fullsized":"2023-12-08T08:16:45.681311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:36:27.005922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060058+0000","last_change":"2023-12-08T08:16:45.719099+0000","last_active":"2023-12-08T08:16:47.060058+0000","last_peered":"2023-12-08T08:16:47.060058+0000","last_clean":"2023-12-08T08:16:47.060058+0000","last_became_active":"2023-12-08T08:16:45.718014+0000","last_became_peered":"2023-12-08T08:16:45.718014+0000","last_unstale":"2023-12-08T08:16:47.060058+0000","last_undegraded":"2023-12-08T08:16:47.060058+0000","last_fullsized":"2023-12-08T08:16:47.060058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:05.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831967+0000","last_change":"2023-12-08T08:16:45.108506+0000","last_active":"2023-12-08T08:16:46.831967+0000","last_peered":"2023-12-08T08:16:46.831967+0000","last_clean":"2023-12-08T08:16:46.831967+0000","last_became_active":"2023-12-08T08:16:45.108113+0000","last_became_peered":"2023-12-08T08:16:45.108113+0000","last_unstale":"2023-12-08T08:16:46.831967+0000","last_undegraded":"2023-12-08T08:16:46.831967+0000","last_fullsized":"2023-12-08T08:16:46.831967+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:28.909613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707522+0000","last_change":"2023-12-08T08:16:30.004598+0000","last_active":"2023-12-08T08:16:45.707522+0000","last_peered":"2023-12-08T08:16:45.707522+0000","last_clean":"2023-12-08T08:16:45.707522+0000","last_became_active":"2023-12-08T08:16:30.004063+0000","last_became_peered":"2023-12-08T08:16:30.004063+0000","last_unstale":"2023-12-08T08:16:45.707522+0000","last_undegraded":"2023-12-08T08:16:45.707522+0000","last_fullsized":"2023-12-08T08:16:45.707522+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686525+0000","last_change":"2023-12-08T08:16:28.978542+0000","last_active":"2023-12-08T08:16:45.686525+0000","last_peered":"2023-12-08T08:16:45.686525+0000","last_clean":"2023-12-08T08:16:45.686525+0000","last_became_active":"2023-12-08T08:16:28.977515+0000","last_became_peered":"2023-12-08T08:16:28.977515+0000","last_unstale":"2023-12-08T08:16:45.686525+0000","last_undegraded":"2023-12-08T08:16:45.686525+0000","last_fullsized":"2023-12-08T08:16:45.686525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:17.021805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832505+0000","last_change":"2023-12-08T08:16:45.698391+0000","last_active":"2023-12-08T08:16:46.832505+0000","last_peered":"2023-12-08T08:16:46.832505+0000","last_clean":"2023-12-08T08:16:46.832505+0000","last_became_active":"2023-12-08T08:16:45.697851+0000","last_became_peered":"2023-12-08T08:16:45.697851+0000","last_unstale":"2023-12-08T08:16:46.832505+0000","last_undegraded":"2023-12-08T08:16:46.832505+0000","last_fullsized":"2023-12-08T08:16:46.832505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:43.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053870+0000","last_change":"2023-12-08T08:16:45.106145+0000","last_active":"2023-12-08T08:16:47.053870+0000","last_peered":"2023-12-08T08:16:47.053870+0000","last_clean":"2023-12-08T08:16:47.053870+0000","last_became_active":"2023-12-08T08:16:45.105863+0000","last_became_peered":"2023-12-08T08:16:45.105863+0000","last_unstale":"2023-12-08T08:16:47.053870+0000","last_undegraded":"2023-12-08T08:16:47.053870+0000","last_fullsized":"2023-12-08T08:16:47.053870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:25.955858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703038+0000","last_change":"2023-12-08T08:16:29.999746+0000","last_active":"2023-12-08T08:16:45.703038+0000","last_peered":"2023-12-08T08:16:45.703038+0000","last_clean":"2023-12-08T08:16:45.703038+0000","last_became_active":"2023-12-08T08:16:29.999490+0000","last_became_peered":"2023-12-08T08:16:29.999490+0000","last_unstale":"2023-12-08T08:16:45.703038+0000","last_undegraded":"2023-12-08T08:16:45.703038+0000","last_fullsized":"2023-12-08T08:16:45.703038+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711492+0000","last_change":"2023-12-08T08:16:28.980456+0000","last_active":"2023-12-08T08:16:45.711492+0000","last_peered":"2023-12-08T08:16:45.711492+0000","last_clean":"2023-12-08T08:16:45.711492+0000","last_became_active":"2023-12-08T08:16:28.980144+0000","last_became_peered":"2023-12-08T08:16:28.980144+0000","last_unstale":"2023-12-08T08:16:45.711492+0000","last_undegraded":"2023-12-08T08:16:45.711492+0000","last_fullsized":"2023-12-08T08:16:45.711492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686600+0000","last_change":"2023-12-08T08:16:45.703220+0000","last_active":"2023-12-08T08:16:46.686600+0000","last_peered":"2023-12-08T08:16:46.686600+0000","last_clean":"2023-12-08T08:16:46.686600+0000","last_became_active":"2023-12-08T08:16:45.702653+0000","last_became_peered":"2023-12-08T08:16:45.702653+0000","last_unstale":"2023-12-08T08:16:46.686600+0000","last_undegraded":"2023-12-08T08:16:46.686600+0000","last_fullsized":"2023-12-08T08:16:46.686600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:35.927659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057172+0000","last_change":"2023-12-08T08:16:45.109165+0000","last_active":"2023-12-08T08:16:47.057172+0000","last_peered":"2023-12-08T08:16:47.057172+0000","last_clean":"2023-12-08T08:16:47.057172+0000","last_became_active":"2023-12-08T08:16:45.108823+0000","last_became_peered":"2023-12-08T08:16:45.108823+0000","last_unstale":"2023-12-08T08:16:47.057172+0000","last_undegraded":"2023-12-08T08:16:47.057172+0000","last_fullsized":"2023-12-08T08:16:47.057172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:04.323615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.700439+0000","last_change":"2023-12-08T08:16:29.997495+0000","last_active":"2023-12-08T08:16:45.700439+0000","last_peered":"2023-12-08T08:16:45.700439+0000","last_clean":"2023-12-08T08:16:45.700439+0000","last_became_active":"2023-12-08T08:16:29.997224+0000","last_became_peered":"2023-12-08T08:16:29.997224+0000","last_unstale":"2023-12-08T08:16:45.700439+0000","last_undegraded":"2023-12-08T08:16:45.700439+0000","last_fullsized":"2023-12-08T08:16:45.700439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698920+0000","last_change":"2023-12-08T08:16:28.975373+0000","last_active":"2023-12-08T08:16:45.698920+0000","last_peered":"2023-12-08T08:16:45.698920+0000","last_clean":"2023-12-08T08:16:45.698920+0000","last_became_active":"2023-12-08T08:16:28.974985+0000","last_became_peered":"2023-12-08T08:16:28.974985+0000","last_unstale":"2023-12-08T08:16:45.698920+0000","last_undegraded":"2023-12-08T08:16:45.698920+0000","last_fullsized":"2023-12-08T08:16:45.698920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053333+0000","last_change":"2023-12-08T08:16:45.704122+0000","last_active":"2023-12-08T08:16:47.053333+0000","last_peered":"2023-12-08T08:16:47.053333+0000","last_clean":"2023-12-08T08:16:47.053333+0000","last_became_active":"2023-12-08T08:16:45.703859+0000","last_became_peered":"2023-12-08T08:16:45.703859+0000","last_unstale":"2023-12-08T08:16:47.053333+0000","last_undegraded":"2023-12-08T08:16:47.053333+0000","last_fullsized":"2023-12-08T08:16:47.053333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:33.431520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056143+0000","last_change":"2023-12-08T08:16:45.108912+0000","last_active":"2023-12-08T08:16:47.056143+0000","last_peered":"2023-12-08T08:16:47.056143+0000","last_clean":"2023-12-08T08:16:47.056143+0000","last_became_active":"2023-12-08T08:16:45.108571+0000","last_became_peered":"2023-12-08T08:16:45.108571+0000","last_unstale":"2023-12-08T08:16:47.056143+0000","last_undegraded":"2023-12-08T08:16:47.056143+0000","last_fullsized":"2023-12-08T08:16:47.056143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:50.175293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695281+0000","last_change":"2023-12-08T08:16:30.002534+0000","last_active":"2023-12-08T08:16:45.695281+0000","last_peered":"2023-12-08T08:16:45.695281+0000","last_clean":"2023-12-08T08:16:45.695281+0000","last_became_active":"2023-12-08T08:16:30.001495+0000","last_became_peered":"2023-12-08T08:16:30.001495+0000","last_unstale":"2023-12-08T08:16:45.695281+0000","last_undegraded":"2023-12-08T08:16:45.695281+0000","last_fullsized":"2023-12-08T08:16:45.695281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:52.176838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680083+0000","last_change":"2023-12-08T08:16:28.978336+0000","last_active":"2023-12-08T08:16:45.680083+0000","last_peered":"2023-12-08T08:16:45.680083+0000","last_clean":"2023-12-08T08:16:45.680083+0000","last_became_active":"2023-12-08T08:16:28.977153+0000","last_became_peered":"2023-12-08T08:16:28.977153+0000","last_unstale":"2023-12-08T08:16:45.680083+0000","last_undegraded":"2023-12-08T08:16:45.680083+0000","last_fullsized":"2023-12-08T08:16:45.680083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052517+0000","last_change":"2023-12-08T08:16:45.706774+0000","last_active":"2023-12-08T08:16:47.052517+0000","last_peered":"2023-12-08T08:16:47.052517+0000","last_clean":"2023-12-08T08:16:47.052517+0000","last_became_active":"2023-12-08T08:16:45.706491+0000","last_became_peered":"2023-12-08T08:16:45.706491+0000","last_unstale":"2023-12-08T08:16:47.052517+0000","last_undegraded":"2023-12-08T08:16:47.052517+0000","last_fullsized":"2023-12-08T08:16:47.052517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:52.646667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832558+0000","last_change":"2023-12-08T08:16:45.096437+0000","last_active":"2023-12-08T08:16:46.832558+0000","last_peered":"2023-12-08T08:16:46.832558+0000","last_clean":"2023-12-08T08:16:46.832558+0000","last_became_active":"2023-12-08T08:16:45.095975+0000","last_became_peered":"2023-12-08T08:16:45.095975+0000","last_unstale":"2023-12-08T08:16:46.832558+0000","last_undegraded":"2023-12-08T08:16:46.832558+0000","last_fullsized":"2023-12-08T08:16:46.832558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:00.764340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679566+0000","last_change":"2023-12-08T08:16:30.003307+0000","last_active":"2023-12-08T08:16:45.679566+0000","last_peered":"2023-12-08T08:16:45.679566+0000","last_clean":"2023-12-08T08:16:45.679566+0000","last_became_active":"2023-12-08T08:16:30.002242+0000","last_became_peered":"2023-12-08T08:16:30.002242+0000","last_unstale":"2023-12-08T08:16:45.679566+0000","last_undegraded":"2023-12-08T08:16:45.679566+0000","last_fullsized":"2023-12-08T08:16:45.679566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696315+0000","last_change":"2023-12-08T08:16:28.971697+0000","last_active":"2023-12-08T08:16:45.696315+0000","last_peered":"2023-12-08T08:16:45.696315+0000","last_clean":"2023-12-08T08:16:45.696315+0000","last_became_active":"2023-12-08T08:16:28.971403+0000","last_became_peered":"2023-12-08T08:16:28.971403+0000","last_unstale":"2023-12-08T08:16:45.696315+0000","last_undegraded":"2023-12-08T08:16:45.696315+0000","last_fullsized":"2023-12-08T08:16:45.696315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:55:26.868497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.051794+0000","last_change":"2023-12-08T08:16:45.706728+0000","last_active":"2023-12-08T08:16:47.051794+0000","last_peered":"2023-12-08T08:16:47.051794+0000","last_clean":"2023-12-08T08:16:47.051794+0000","last_became_active":"2023-12-08T08:16:45.704612+0000","last_became_peered":"2023-12-08T08:16:45.704612+0000","last_unstale":"2023-12-08T08:16:47.051794+0000","last_undegraded":"2023-12-08T08:16:47.051794+0000","last_fullsized":"2023-12-08T08:16:47.051794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:38.863172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.684349+0000","last_change":"2023-12-08T08:16:45.104393+0000","last_active":"2023-12-08T08:16:46.684349+0000","last_peered":"2023-12-08T08:16:46.684349+0000","last_clean":"2023-12-08T08:16:46.684349+0000","last_became_active":"2023-12-08T08:16:45.104114+0000","last_became_peered":"2023-12-08T08:16:45.104114+0000","last_unstale":"2023-12-08T08:16:46.684349+0000","last_undegraded":"2023-12-08T08:16:46.684349+0000","last_fullsized":"2023-12-08T08:16:46.684349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:45.006852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693910+0000","last_change":"2023-12-08T08:16:30.004120+0000","last_active":"2023-12-08T08:16:45.693910+0000","last_peered":"2023-12-08T08:16:45.693910+0000","last_clean":"2023-12-08T08:16:45.693910+0000","last_became_active":"2023-12-08T08:16:30.003839+0000","last_became_peered":"2023-12-08T08:16:30.003839+0000","last_unstale":"2023-12-08T08:16:45.693910+0000","last_undegraded":"2023-12-08T08:16:45.693910+0000","last_fullsized":"2023-12-08T08:16:45.693910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:24:40.270711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675305+0000","last_change":"2023-12-08T08:16:28.972924+0000","last_active":"2023-12-08T08:16:45.675305+0000","last_peered":"2023-12-08T08:16:45.675305+0000","last_clean":"2023-12-08T08:16:45.675305+0000","last_became_active":"2023-12-08T08:16:28.971768+0000","last_became_peered":"2023-12-08T08:16:28.971768+0000","last_unstale":"2023-12-08T08:16:45.675305+0000","last_undegraded":"2023-12-08T08:16:45.675305+0000","last_fullsized":"2023-12-08T08:16:45.675305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.012974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832677+0000","last_change":"2023-12-08T08:16:45.702984+0000","last_active":"2023-12-08T08:16:46.832677+0000","last_peered":"2023-12-08T08:16:46.832677+0000","last_clean":"2023-12-08T08:16:46.832677+0000","last_became_active":"2023-12-08T08:16:45.702646+0000","last_became_peered":"2023-12-08T08:16:45.702646+0000","last_unstale":"2023-12-08T08:16:46.832677+0000","last_undegraded":"2023-12-08T08:16:46.832677+0000","last_fullsized":"2023-12-08T08:16:46.832677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:00:51.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831546+0000","last_change":"2023-12-08T08:16:45.100716+0000","last_active":"2023-12-08T08:16:46.831546+0000","last_peered":"2023-12-08T08:16:46.831546+0000","last_clean":"2023-12-08T08:16:46.831546+0000","last_became_active":"2023-12-08T08:16:45.100426+0000","last_became_peered":"2023-12-08T08:16:45.100426+0000","last_unstale":"2023-12-08T08:16:46.831546+0000","last_undegraded":"2023-12-08T08:16:46.831546+0000","last_fullsized":"2023-12-08T08:16:46.831546+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:18.853813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711587+0000","last_change":"2023-12-08T08:16:30.008721+0000","last_active":"2023-12-08T08:16:45.711587+0000","last_peered":"2023-12-08T08:16:45.711587+0000","last_clean":"2023-12-08T08:16:45.711587+0000","last_became_active":"2023-12-08T08:16:30.007946+0000","last_became_peered":"2023-12-08T08:16:30.007946+0000","last_unstale":"2023-12-08T08:16:45.711587+0000","last_undegraded":"2023-12-08T08:16:45.711587+0000","last_fullsized":"2023-12-08T08:16:45.711587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.692363+0000","last_change":"2023-12-08T08:16:28.964831+0000","last_active":"2023-12-08T08:16:45.692363+0000","last_peered":"2023-12-08T08:16:45.692363+0000","last_clean":"2023-12-08T08:16:45.692363+0000","last_became_active":"2023-12-08T08:16:28.964526+0000","last_became_peered":"2023-12-08T08:16:28.964526+0000","last_unstale":"2023-12-08T08:16:45.692363+0000","last_undegraded":"2023-12-08T08:16:45.692363+0000","last_fullsized":"2023-12-08T08:16:45.692363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:28.711499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053157+0000","last_change":"2023-12-08T08:16:45.712579+0000","last_active":"2023-12-08T08:16:47.053157+0000","last_peered":"2023-12-08T08:16:47.053157+0000","last_clean":"2023-12-08T08:16:47.053157+0000","last_became_active":"2023-12-08T08:16:45.712241+0000","last_became_peered":"2023-12-08T08:16:45.712241+0000","last_unstale":"2023-12-08T08:16:47.053157+0000","last_undegraded":"2023-12-08T08:16:47.053157+0000","last_fullsized":"2023-12-08T08:16:47.053157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:19:01.547108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.683450+0000","last_change":"2023-12-08T08:16:45.102474+0000","last_active":"2023-12-08T08:16:46.683450+0000","last_peered":"2023-12-08T08:16:46.683450+0000","last_clean":"2023-12-08T08:16:46.683450+0000","last_became_active":"2023-12-08T08:16:45.102119+0000","last_became_peered":"2023-12-08T08:16:45.102119+0000","last_unstale":"2023-12-08T08:16:46.683450+0000","last_undegraded":"2023-12-08T08:16:46.683450+0000","last_fullsized":"2023-12-08T08:16:46.683450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:39.350930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699516+0000","last_change":"2023-12-08T08:16:30.007994+0000","last_active":"2023-12-08T08:16:45.699516+0000","last_peered":"2023-12-08T08:16:45.699516+0000","last_clean":"2023-12-08T08:16:45.699516+0000","last_became_active":"2023-12-08T08:16:30.006242+0000","last_became_peered":"2023-12-08T08:16:30.006242+0000","last_unstale":"2023-12-08T08:16:45.699516+0000","last_undegraded":"2023-12-08T08:16:45.699516+0000","last_fullsized":"2023-12-08T08:16:45.699516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:31.687770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693701+0000","last_change":"2023-12-08T08:16:28.967837+0000","last_active":"2023-12-08T08:16:45.693701+0000","last_peered":"2023-12-08T08:16:45.693701+0000","last_clean":"2023-12-08T08:16:45.693701+0000","last_became_active":"2023-12-08T08:16:28.967450+0000","last_became_peered":"2023-12-08T08:16:28.967450+0000","last_unstale":"2023-12-08T08:16:45.693701+0000","last_undegraded":"2023-12-08T08:16:45.693701+0000","last_fullsized":"2023-12-08T08:16:45.693701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:00.811457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060398+0000","last_change":"2023-12-08T08:16:45.714822+0000","last_active":"2023-12-08T08:16:47.060398+0000","last_peered":"2023-12-08T08:16:47.060398+0000","last_clean":"2023-12-08T08:16:47.060398+0000","last_became_active":"2023-12-08T08:16:45.713684+0000","last_became_peered":"2023-12-08T08:16:45.713684+0000","last_unstale":"2023-12-08T08:16:47.060398+0000","last_undegraded":"2023-12-08T08:16:47.060398+0000","last_fullsized":"2023-12-08T08:16:47.060398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:46.529491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052577+0000","last_change":"2023-12-08T08:16:45.106011+0000","last_active":"2023-12-08T08:16:47.052577+0000","last_peered":"2023-12-08T08:16:47.052577+0000","last_clean":"2023-12-08T08:16:47.052577+0000","last_became_active":"2023-12-08T08:16:45.105691+0000","last_became_peered":"2023-12-08T08:16:45.105691+0000","last_unstale":"2023-12-08T08:16:47.052577+0000","last_undegraded":"2023-12-08T08:16:47.052577+0000","last_fullsized":"2023-12-08T08:16:47.052577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:36.414053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696688+0000","last_change":"2023-12-08T08:16:29.994820+0000","last_active":"2023-12-08T08:16:45.696688+0000","last_peered":"2023-12-08T08:16:45.696688+0000","last_clean":"2023-12-08T08:16:45.696688+0000","last_became_active":"2023-12-08T08:16:29.994544+0000","last_became_peered":"2023-12-08T08:16:29.994544+0000","last_unstale":"2023-12-08T08:16:45.696688+0000","last_undegraded":"2023-12-08T08:16:45.696688+0000","last_fullsized":"2023-12-08T08:16:45.696688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708166+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:45.708166+0000","last_peered":"2023-12-08T08:16:45.708166+0000","last_clean":"2023-12-08T08:16:45.708166+0000","last_became_active":"2023-12-08T08:16:28.974336+0000","last_became_peered":"2023-12-08T08:16:28.974336+0000","last_unstale":"2023-12-08T08:16:45.708166+0000","last_undegraded":"2023-12-08T08:16:45.708166+0000","last_fullsized":"2023-12-08T08:16:45.708166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054341+0000","last_change":"2023-12-08T08:16:45.701665+0000","last_active":"2023-12-08T08:16:47.054341+0000","last_peered":"2023-12-08T08:16:47.054341+0000","last_clean":"2023-12-08T08:16:47.054341+0000","last_became_active":"2023-12-08T08:16:45.701366+0000","last_became_peered":"2023-12-08T08:16:45.701366+0000","last_unstale":"2023-12-08T08:16:47.054341+0000","last_undegraded":"2023-12-08T08:16:47.054341+0000","last_fullsized":"2023-12-08T08:16:47.054341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:32.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053147+0000","last_change":"2023-12-08T08:16:45.102325+0000","last_active":"2023-12-08T08:16:47.053147+0000","last_peered":"2023-12-08T08:16:47.053147+0000","last_clean":"2023-12-08T08:16:47.053147+0000","last_became_active":"2023-12-08T08:16:45.099815+0000","last_became_peered":"2023-12-08T08:16:45.099815+0000","last_unstale":"2023-12-08T08:16:47.053147+0000","last_undegraded":"2023-12-08T08:16:47.053147+0000","last_fullsized":"2023-12-08T08:16:47.053147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:45.516346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702934+0000","last_change":"2023-12-08T08:16:30.000662+0000","last_active":"2023-12-08T08:16:45.702934+0000","last_peered":"2023-12-08T08:16:45.702934+0000","last_clean":"2023-12-08T08:16:45.702934+0000","last_became_active":"2023-12-08T08:16:30.000315+0000","last_became_peered":"2023-12-08T08:16:30.000315+0000","last_unstale":"2023-12-08T08:16:45.702934+0000","last_undegraded":"2023-12-08T08:16:45.702934+0000","last_fullsized":"2023-12-08T08:16:45.702934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693301+0000","last_change":"2023-12-08T08:16:28.965034+0000","last_active":"2023-12-08T08:16:45.693301+0000","last_peered":"2023-12-08T08:16:45.693301+0000","last_clean":"2023-12-08T08:16:45.693301+0000","last_became_active":"2023-12-08T08:16:28.964719+0000","last_became_peered":"2023-12-08T08:16:28.964719+0000","last_unstale":"2023-12-08T08:16:45.693301+0000","last_undegraded":"2023-12-08T08:16:45.693301+0000","last_fullsized":"2023-12-08T08:16:45.693301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:49.109342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052477+0000","last_change":"2023-12-08T08:16:45.701885+0000","last_active":"2023-12-08T08:16:47.052477+0000","last_peered":"2023-12-08T08:16:47.052477+0000","last_clean":"2023-12-08T08:16:47.052477+0000","last_became_active":"2023-12-08T08:16:45.701519+0000","last_became_peered":"2023-12-08T08:16:45.701519+0000","last_unstale":"2023-12-08T08:16:47.052477+0000","last_undegraded":"2023-12-08T08:16:47.052477+0000","last_fullsized":"2023-12-08T08:16:47.052477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:21:38.358024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058147+0000","last_change":"2023-12-08T08:16:45.101482+0000","last_active":"2023-12-08T08:16:47.058147+0000","last_peered":"2023-12-08T08:16:47.058147+0000","last_clean":"2023-12-08T08:16:47.058147+0000","last_became_active":"2023-12-08T08:16:45.101177+0000","last_became_peered":"2023-12-08T08:16:45.101177+0000","last_unstale":"2023-12-08T08:16:47.058147+0000","last_undegraded":"2023-12-08T08:16:47.058147+0000","last_fullsized":"2023-12-08T08:16:47.058147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:20.563413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675048+0000","last_change":"2023-12-08T08:16:30.019492+0000","last_active":"2023-12-08T08:16:45.675048+0000","last_peered":"2023-12-08T08:16:45.675048+0000","last_clean":"2023-12-08T08:16:45.675048+0000","last_became_active":"2023-12-08T08:16:30.019182+0000","last_became_peered":"2023-12-08T08:16:30.019182+0000","last_unstale":"2023-12-08T08:16:45.675048+0000","last_undegraded":"2023-12-08T08:16:45.675048+0000","last_fullsized":"2023-12-08T08:16:45.675048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:32:53.506356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699089+0000","last_change":"2023-12-08T08:16:28.975323+0000","last_active":"2023-12-08T08:16:45.699089+0000","last_peered":"2023-12-08T08:16:45.699089+0000","last_clean":"2023-12-08T08:16:45.699089+0000","last_became_active":"2023-12-08T08:16:28.974944+0000","last_became_peered":"2023-12-08T08:16:28.974944+0000","last_unstale":"2023-12-08T08:16:45.699089+0000","last_undegraded":"2023-12-08T08:16:45.699089+0000","last_fullsized":"2023-12-08T08:16:45.699089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053402+0000","last_change":"2023-12-08T08:16:45.709696+0000","last_active":"2023-12-08T08:16:47.053402+0000","last_peered":"2023-12-08T08:16:47.053402+0000","last_clean":"2023-12-08T08:16:47.053402+0000","last_became_active":"2023-12-08T08:16:45.709388+0000","last_became_peered":"2023-12-08T08:16:45.709388+0000","last_unstale":"2023-12-08T08:16:47.053402+0000","last_undegraded":"2023-12-08T08:16:47.053402+0000","last_fullsized":"2023-12-08T08:16:47.053402+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:28.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832034+0000","last_change":"2023-12-08T08:16:45.102562+0000","last_active":"2023-12-08T08:16:46.832034+0000","last_peered":"2023-12-08T08:16:46.832034+0000","last_clean":"2023-12-08T08:16:46.832034+0000","last_became_active":"2023-12-08T08:16:45.102264+0000","last_became_peered":"2023-12-08T08:16:45.102264+0000","last_unstale":"2023-12-08T08:16:46.832034+0000","last_undegraded":"2023-12-08T08:16:46.832034+0000","last_fullsized":"2023-12-08T08:16:46.832034+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:57.519704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.712901+0000","last_change":"2023-12-08T08:16:30.016409+0000","last_active":"2023-12-08T08:16:45.712901+0000","last_peered":"2023-12-08T08:16:45.712901+0000","last_clean":"2023-12-08T08:16:45.712901+0000","last_became_active":"2023-12-08T08:16:30.016111+0000","last_became_peered":"2023-12-08T08:16:30.016111+0000","last_unstale":"2023-12-08T08:16:45.712901+0000","last_undegraded":"2023-12-08T08:16:45.712901+0000","last_fullsized":"2023-12-08T08:16:45.712901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695930+0000","last_change":"2023-12-08T08:16:28.973691+0000","last_active":"2023-12-08T08:16:45.695930+0000","last_peered":"2023-12-08T08:16:45.695930+0000","last_clean":"2023-12-08T08:16:45.695930+0000","last_became_active":"2023-12-08T08:16:28.973374+0000","last_became_peered":"2023-12-08T08:16:28.973374+0000","last_unstale":"2023-12-08T08:16:45.695930+0000","last_undegraded":"2023-12-08T08:16:45.695930+0000","last_fullsized":"2023-12-08T08:16:45.695930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:16.503221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055652+0000","last_change":"2023-12-08T08:16:45.714381+0000","last_active":"2023-12-08T08:16:47.055652+0000","last_peered":"2023-12-08T08:16:47.055652+0000","last_clean":"2023-12-08T08:16:47.055652+0000","last_became_active":"2023-12-08T08:16:45.712158+0000","last_became_peered":"2023-12-08T08:16:45.712158+0000","last_unstale":"2023-12-08T08:16:47.055652+0000","last_undegraded":"2023-12-08T08:16:47.055652+0000","last_fullsized":"2023-12-08T08:16:47.055652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:00:29.393392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.059028+0000","last_change":"2023-12-08T08:16:45.109726+0000","last_active":"2023-12-08T08:16:47.059028+0000","last_peered":"2023-12-08T08:16:47.059028+0000","last_clean":"2023-12-08T08:16:47.059028+0000","last_became_active":"2023-12-08T08:16:45.109407+0000","last_became_peered":"2023-12-08T08:16:45.109407+0000","last_unstale":"2023-12-08T08:16:47.059028+0000","last_undegraded":"2023-12-08T08:16:47.059028+0000","last_fullsized":"2023-12-08T08:16:47.059028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:40:24.021285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701285+0000","last_change":"2023-12-08T08:16:30.004996+0000","last_active":"2023-12-08T08:16:45.701285+0000","last_peered":"2023-12-08T08:16:45.701285+0000","last_clean":"2023-12-08T08:16:45.701285+0000","last_became_active":"2023-12-08T08:16:30.004414+0000","last_became_peered":"2023-12-08T08:16:30.004414+0000","last_unstale":"2023-12-08T08:16:45.701285+0000","last_undegraded":"2023-12-08T08:16:45.701285+0000","last_fullsized":"2023-12-08T08:16:45.701285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695621+0000","last_change":"2023-12-08T08:16:28.976308+0000","last_active":"2023-12-08T08:16:45.695621+0000","last_peered":"2023-12-08T08:16:45.695621+0000","last_clean":"2023-12-08T08:16:45.695621+0000","last_became_active":"2023-12-08T08:16:28.974927+0000","last_became_peered":"2023-12-08T08:16:28.974927+0000","last_unstale":"2023-12-08T08:16:45.695621+0000","last_undegraded":"2023-12-08T08:16:45.695621+0000","last_fullsized":"2023-12-08T08:16:45.695621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832429+0000","last_change":"2023-12-08T08:16:45.707958+0000","last_active":"2023-12-08T08:16:46.832429+0000","last_peered":"2023-12-08T08:16:46.832429+0000","last_clean":"2023-12-08T08:16:46.832429+0000","last_became_active":"2023-12-08T08:16:45.706589+0000","last_became_peered":"2023-12-08T08:16:45.706589+0000","last_unstale":"2023-12-08T08:16:46.832429+0000","last_undegraded":"2023-12-08T08:16:46.832429+0000","last_fullsized":"2023-12-08T08:16:46.832429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:57:30.047578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686398+0000","last_change":"2023-12-08T08:16:45.108291+0000","last_active":"2023-12-08T08:16:46.686398+0000","last_peered":"2023-12-08T08:16:46.686398+0000","last_clean":"2023-12-08T08:16:46.686398+0000","last_became_active":"2023-12-08T08:16:45.107044+0000","last_became_peered":"2023-12-08T08:16:45.107044+0000","last_unstale":"2023-12-08T08:16:46.686398+0000","last_undegraded":"2023-12-08T08:16:46.686398+0000","last_fullsized":"2023-12-08T08:16:46.686398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:25.955858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693512+0000","last_change":"2023-12-08T08:16:30.013944+0000","last_active":"2023-12-08T08:16:45.693512+0000","last_peered":"2023-12-08T08:16:45.693512+0000","last_clean":"2023-12-08T08:16:45.693512+0000","last_became_active":"2023-12-08T08:16:30.013655+0000","last_became_peered":"2023-12-08T08:16:30.013655+0000","last_unstale":"2023-12-08T08:16:45.693512+0000","last_undegraded":"2023-12-08T08:16:45.693512+0000","last_fullsized":"2023-12-08T08:16:45.693512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698526+0000","last_change":"2023-12-08T08:16:28.977478+0000","last_active":"2023-12-08T08:16:45.698526+0000","last_peered":"2023-12-08T08:16:45.698526+0000","last_clean":"2023-12-08T08:16:45.698526+0000","last_became_active":"2023-12-08T08:16:28.976902+0000","last_became_peered":"2023-12-08T08:16:28.976902+0000","last_unstale":"2023-12-08T08:16:45.698526+0000","last_undegraded":"2023-12-08T08:16:45.698526+0000","last_fullsized":"2023-12-08T08:16:45.698526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054496+0000","last_change":"2023-12-08T08:16:45.710538+0000","last_active":"2023-12-08T08:16:47.054496+0000","last_peered":"2023-12-08T08:16:47.054496+0000","last_clean":"2023-12-08T08:16:47.054496+0000","last_became_active":"2023-12-08T08:16:45.710218+0000","last_became_peered":"2023-12-08T08:16:45.710218+0000","last_unstale":"2023-12-08T08:16:47.054496+0000","last_undegraded":"2023-12-08T08:16:47.054496+0000","last_fullsized":"2023-12-08T08:16:47.054496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:57:30.047578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058999+0000","last_change":"2023-12-08T08:16:45.102325+0000","last_active":"2023-12-08T08:16:47.058999+0000","last_peered":"2023-12-08T08:16:47.058999+0000","last_clean":"2023-12-08T08:16:47.058999+0000","last_became_active":"2023-12-08T08:16:45.102026+0000","last_became_peered":"2023-12-08T08:16:45.102026+0000","last_unstale":"2023-12-08T08:16:47.058999+0000","last_undegraded":"2023-12-08T08:16:47.058999+0000","last_fullsized":"2023-12-08T08:16:47.058999+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:57.519704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675638+0000","last_change":"2023-12-08T08:16:30.000645+0000","last_active":"2023-12-08T08:16:45.675638+0000","last_peered":"2023-12-08T08:16:45.675638+0000","last_clean":"2023-12-08T08:16:45.675638+0000","last_became_active":"2023-12-08T08:16:30.000349+0000","last_became_peered":"2023-12-08T08:16:30.000349+0000","last_unstale":"2023-12-08T08:16:45.675638+0000","last_undegraded":"2023-12-08T08:16:45.675638+0000","last_fullsized":"2023-12-08T08:16:45.675638+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:07:53.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686417+0000","last_change":"2023-12-08T08:16:28.969401+0000","last_active":"2023-12-08T08:16:45.686417+0000","last_peered":"2023-12-08T08:16:45.686417+0000","last_clean":"2023-12-08T08:16:45.686417+0000","last_became_active":"2023-12-08T08:16:28.968937+0000","last_became_peered":"2023-12-08T08:16:28.968937+0000","last_unstale":"2023-12-08T08:16:45.686417+0000","last_undegraded":"2023-12-08T08:16:45.686417+0000","last_fullsized":"2023-12-08T08:16:45.686417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832033+0000","last_change":"2023-12-08T08:16:45.708830+0000","last_active":"2023-12-08T08:16:46.832033+0000","last_peered":"2023-12-08T08:16:46.832033+0000","last_clean":"2023-12-08T08:16:46.832033+0000","last_became_active":"2023-12-08T08:16:45.707429+0000","last_became_peered":"2023-12-08T08:16:45.707429+0000","last_unstale":"2023-12-08T08:16:46.832033+0000","last_undegraded":"2023-12-08T08:16:46.832033+0000","last_fullsized":"2023-12-08T08:16:46.832033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:24.919971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054053+0000","last_change":"2023-12-08T08:16:45.095896+0000","last_active":"2023-12-08T08:16:47.054053+0000","last_peered":"2023-12-08T08:16:47.054053+0000","last_clean":"2023-12-08T08:16:47.054053+0000","last_became_active":"2023-12-08T08:16:45.095588+0000","last_became_peered":"2023-12-08T08:16:45.095588+0000","last_unstale":"2023-12-08T08:16:47.054053+0000","last_undegraded":"2023-12-08T08:16:47.054053+0000","last_fullsized":"2023-12-08T08:16:47.054053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:00.764340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679411+0000","last_change":"2023-12-08T08:16:30.001694+0000","last_active":"2023-12-08T08:16:45.679411+0000","last_peered":"2023-12-08T08:16:45.679411+0000","last_clean":"2023-12-08T08:16:45.679411+0000","last_became_active":"2023-12-08T08:16:30.001411+0000","last_became_peered":"2023-12-08T08:16:30.001411+0000","last_unstale":"2023-12-08T08:16:45.679411+0000","last_undegraded":"2023-12-08T08:16:45.679411+0000","last_fullsized":"2023-12-08T08:16:45.679411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680880+0000","last_change":"2023-12-08T08:16:28.964871+0000","last_active":"2023-12-08T08:16:45.680880+0000","last_peered":"2023-12-08T08:16:45.680880+0000","last_clean":"2023-12-08T08:16:45.680880+0000","last_became_active":"2023-12-08T08:16:28.964469+0000","last_became_peered":"2023-12-08T08:16:28.964469+0000","last_unstale":"2023-12-08T08:16:45.680880+0000","last_undegraded":"2023-12-08T08:16:45.680880+0000","last_fullsized":"2023-12-08T08:16:45.680880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:49.019319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060088+0000","last_change":"2023-12-08T08:16:45.718017+0000","last_active":"2023-12-08T08:16:47.060088+0000","last_peered":"2023-12-08T08:16:47.060088+0000","last_clean":"2023-12-08T08:16:47.060088+0000","last_became_active":"2023-12-08T08:16:45.717716+0000","last_became_peered":"2023-12-08T08:16:45.717716+0000","last_unstale":"2023-12-08T08:16:47.060088+0000","last_undegraded":"2023-12-08T08:16:47.060088+0000","last_fullsized":"2023-12-08T08:16:47.060088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:19.866958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053253+0000","last_change":"2023-12-08T08:16:45.090959+0000","last_active":"2023-12-08T08:16:47.053253+0000","last_peered":"2023-12-08T08:16:47.053253+0000","last_clean":"2023-12-08T08:16:47.053253+0000","last_became_active":"2023-12-08T08:16:45.090690+0000","last_became_peered":"2023-12-08T08:16:45.090690+0000","last_unstale":"2023-12-08T08:16:47.053253+0000","last_undegraded":"2023-12-08T08:16:47.053253+0000","last_fullsized":"2023-12-08T08:16:47.053253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:28.909613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708016+0000","last_change":"2023-12-08T08:16:30.009647+0000","last_active":"2023-12-08T08:16:45.708016+0000","last_peered":"2023-12-08T08:16:45.708016+0000","last_clean":"2023-12-08T08:16:45.708016+0000","last_became_active":"2023-12-08T08:16:30.009174+0000","last_became_peered":"2023-12-08T08:16:30.009174+0000","last_unstale":"2023-12-08T08:16:45.708016+0000","last_undegraded":"2023-12-08T08:16:45.708016+0000","last_fullsized":"2023-12-08T08:16:45.708016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699808+0000","last_change":"2023-12-08T08:16:28.969690+0000","last_active":"2023-12-08T08:16:45.699808+0000","last_peered":"2023-12-08T08:16:45.699808+0000","last_clean":"2023-12-08T08:16:45.699808+0000","last_became_active":"2023-12-08T08:16:28.969355+0000","last_became_peered":"2023-12-08T08:16:28.969355+0000","last_unstale":"2023-12-08T08:16:45.699808+0000","last_undegraded":"2023-12-08T08:16:45.699808+0000","last_fullsized":"2023-12-08T08:16:45.699808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:52.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054762+0000","last_change":"2023-12-08T08:16:45.708421+0000","last_active":"2023-12-08T08:16:47.054762+0000","last_peered":"2023-12-08T08:16:47.054762+0000","last_clean":"2023-12-08T08:16:47.054762+0000","last_became_active":"2023-12-08T08:16:45.705931+0000","last_became_peered":"2023-12-08T08:16:45.705931+0000","last_unstale":"2023-12-08T08:16:47.054762+0000","last_undegraded":"2023-12-08T08:16:47.054762+0000","last_fullsized":"2023-12-08T08:16:47.054762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:52.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832661+0000","last_change":"2023-12-08T08:16:45.096450+0000","last_active":"2023-12-08T08:16:46.832661+0000","last_peered":"2023-12-08T08:16:46.832661+0000","last_clean":"2023-12-08T08:16:46.832661+0000","last_became_active":"2023-12-08T08:16:45.096105+0000","last_became_peered":"2023-12-08T08:16:45.096105+0000","last_unstale":"2023-12-08T08:16:46.832661+0000","last_undegraded":"2023-12-08T08:16:46.832661+0000","last_fullsized":"2023-12-08T08:16:46.832661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:45.516346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698757+0000","last_change":"2023-12-08T08:16:30.013379+0000","last_active":"2023-12-08T08:16:45.698757+0000","last_peered":"2023-12-08T08:16:45.698757+0000","last_clean":"2023-12-08T08:16:45.698757+0000","last_became_active":"2023-12-08T08:16:30.013056+0000","last_became_peered":"2023-12-08T08:16:30.013056+0000","last_unstale":"2023-12-08T08:16:45.698757+0000","last_undegraded":"2023-12-08T08:16:45.698757+0000","last_fullsized":"2023-12-08T08:16:45.698757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708317+0000","last_change":"2023-12-08T08:16:28.977566+0000","last_active":"2023-12-08T08:16:45.708317+0000","last_peered":"2023-12-08T08:16:45.708317+0000","last_clean":"2023-12-08T08:16:45.708317+0000","last_became_active":"2023-12-08T08:16:28.976769+0000","last_became_peered":"2023-12-08T08:16:28.976769+0000","last_unstale":"2023-12-08T08:16:45.708317+0000","last_undegraded":"2023-12-08T08:16:45.708317+0000","last_fullsized":"2023-12-08T08:16:45.708317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711693+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:16:45.711693+0000","last_peered":"2023-12-08T08:16:45.711693+0000","last_clean":"2023-12-08T08:16:45.711693+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:16:45.711693+0000","last_undegraded":"2023-12-08T08:16:45.711693+0000","last_fullsized":"2023-12-08T08:16:45.711693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":812521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.383},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.1140000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.333},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":1.2809999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.246},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.427}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.496}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.55},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.581}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":227563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":19.065999999999999,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":19.364999999999998,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.1000000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5369999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.6259999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.2070000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.593}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.51}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":218964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":2.1779999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.4910000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":2.6539999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":2.5569999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.675}]},{"osd":6,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":2.464},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":2.0459999999999998},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":3.1859999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":227515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.056},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.125}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.1779999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.238}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6519999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.583},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.288}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.752},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.929}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":1.296,"5min":1.296,"15min":1.296},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.9850000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":231104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.502},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.087}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.569},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.7949999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.722}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":2.0209999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.4399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":2.1930000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.617},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.2330000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":228011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.753}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.873}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.323}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.056}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":226579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.1559999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":1.389}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.603},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.444}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":2.1280000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.52}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":2.2440000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":816787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.496},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.872},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.083},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.6559999999999997,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.84699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:16:50.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:16:50.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.890+0000 7ff5224f1640 1 Processor -- start 2023-12-08T08:16:50.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.890+0000 7ff5224f1640 1 -- start start 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5224f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff51c06cc30 0x7ff51c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5224f1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c0c3850 con 0x7ff51c151ad0 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5224f1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c0a7540 con 0x7ff51c0c73f0 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5224f1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0a6d30 con 0x7ff51c06cc30 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5214ef640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff51c151ad0 0x7ff51c157a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36850/0 (socket says 172.21.15.45:36850) 2023-12-08T08:16:50.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff5214ef640 1 -- 172.21.15.45:0/3751210088 learned_addr learned my addr 172.21.15.45:0/3751210088 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.892+0000 7ff520cee640 1 --2- 172.21.15.45:0/3751210088 >> v2:172.21.15.45:3300/0 conn(0x7ff51c06cc30 0x7ff51c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.893+0000 7ff513fff640 1 -- 172.21.15.45:0/3751210088 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460160339 0 0) 0x7ff51c0c3850 con 0x7ff51c151ad0 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.893+0000 7ff513fff640 1 -- 172.21.15.45:0/3751210088 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff508003520 con 0x7ff51c151ad0 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.893+0000 7ff520cee640 1 -- 172.21.15.45:0/3751210088 >> v1:172.21.15.114:6789/0 conn(0x7ff51c0c73f0 legacy=0x7ff51c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.893+0000 7ff520cee640 1 -- 172.21.15.45:0/3751210088 >> v1:172.21.15.45:6789/0 conn(0x7ff51c151ad0 legacy=0x7ff51c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.893+0000 7ff520cee640 1 -- 172.21.15.45:0/3751210088 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c0c3b10 con 0x7ff51c06cc30 2023-12-08T08:16:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.894+0000 7ff520cee640 1 --2- 172.21.15.45:0/3751210088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c0c6eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097a0 tx=0x7ff50c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b00fca9afa8131 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff513fff640 1 -- 172.21.15.45:0/3751210088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c031830 con 0x7ff51c06cc30 2023-12-08T08:16:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff513fff640 1 -- 172.21.15.45:0/3751210088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c031990 con 0x7ff51c06cc30 2023-12-08T08:16:50.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff513fff640 1 -- 172.21.15.45:0/3751210088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c031d20 con 0x7ff51c06cc30 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 -- 172.21.15.45:0/3751210088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 msgr2=0x7ff51c0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 --2- 172.21.15.45:0/3751210088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c0c6eb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0097a0 tx=0x7ff50c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 -- 172.21.15.45:0/3751210088 shutdown_connections 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 --2- 172.21.15.45:0/3751210088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c0c6eb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 -- 172.21.15.45:0/3751210088 >> 172.21.15.45:0/3751210088 conn(0x7ff51c0a9770 msgr2=0x7ff51c0a9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 -- 172.21.15.45:0/3751210088 shutdown_connections 2023-12-08T08:16:50.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.895+0000 7ff5224f1640 1 -- 172.21.15.45:0/3751210088 wait complete. 2023-12-08T08:16:50.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.897+0000 7ff5224f1640 1 Processor -- start 2023-12-08T08:16:50.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.897+0000 7ff5224f1640 1 -- start start 2023-12-08T08:16:50.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51c0c73f0 0x7ff51c0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff51c151ad0 0x7ff51c0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c14c6c0 con 0x7ff51c06cc30 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c156f80 con 0x7ff51c151ad0 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.898+0000 7ff5224f1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c157260 con 0x7ff51c0c73f0 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33568/0 (socket says 172.21.15.45:33568) 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 -- 172.21.15.45:0/1831460825 learned_addr learned my addr 172.21.15.45:0/1831460825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 -- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51c0c73f0 msgr2=0x7ff51c0ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51c0c73f0 0x7ff51c0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 -- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff51c151ad0 msgr2=0x7ff51c0ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff51c151ad0 0x7ff51c0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:50.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 -- 172.21.15.45:0/1831460825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009400 con 0x7ff51c06cc30 2023-12-08T08:16:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.899+0000 7ff5214ef640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c410 tx=0x7ff51800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.900+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518005ce0 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.900+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518005e40 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.900+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c156080 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.900+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180072f0 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.900+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c157540 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.901+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c1565a0 con 0x7ff51c06cc30 2023-12-08T08:16:50.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.902+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff518007490 con 0x7ff51c06cc30 2023-12-08T08:16:50.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.903+0000 7ff511ffb640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:50.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.903+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff518089270 con 0x7ff51c06cc30 2023-12-08T08:16:50.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.903+0000 7ff520cee640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:50.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.904+0000 7ff520cee640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff50c036000 tx=0x7ff50c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:50.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:50.908+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff51c1565a0 con 0x7ff51c06cc30 2023-12-08T08:16:51.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.102+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff51c06c6e0 con 0x7ff50006ae40 2023-12-08T08:16:51.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.140+0000 7ff511ffb640 1 -- 172.21.15.45:0/1831460825 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525392 (secure 0 0 0) 0x7ff51c06c6e0 con 0x7ff50006ae40 2023-12-08T08:16:51.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:51.156 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.147+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 msgr2=0x7ff50006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.147+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff50c036000 tx=0x7ff50c030000 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.147+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 msgr2=0x7ff51c14c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.147+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff51800c410 tx=0x7ff51800c8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 shutdown_connections 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff51c0c73f0 0x7ff51c0ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff51c151ad0 0x7ff51c0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 --2- 172.21.15.45:0/1831460825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff51c06cc30 0x7ff51c14c180 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 >> 172.21.15.45:0/1831460825 conn(0x7ff51c0a9770 msgr2=0x7ff51c072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 shutdown_connections 2023-12-08T08:16:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.148+0000 7ff5224f1640 1 -- 172.21.15.45:0/1831460825 wait complete. 2023-12-08T08:16:51.172 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-08T08:16:49.739242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":344,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238072,"kb_used_data":5232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736648,"statfs":{"total":773094113280,"available":772850327552,"internally_reserved":0,"allocated":5357568,"data_stored":2989044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.678289"},"pg_stats":[{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055758+0000","last_change":"2023-12-08T08:16:45.714161+0000","last_active":"2023-12-08T08:16:47.055758+0000","last_peered":"2023-12-08T08:16:47.055758+0000","last_clean":"2023-12-08T08:16:47.055758+0000","last_became_active":"2023-12-08T08:16:45.713885+0000","last_became_peered":"2023-12-08T08:16:45.713885+0000","last_unstale":"2023-12-08T08:16:47.055758+0000","last_undegraded":"2023-12-08T08:16:47.055758+0000","last_fullsized":"2023-12-08T08:16:47.055758+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:04.738536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702994+0000","last_change":"2023-12-08T08:16:30.002627+0000","last_active":"2023-12-08T08:16:45.702994+0000","last_peered":"2023-12-08T08:16:45.702994+0000","last_clean":"2023-12-08T08:16:45.702994+0000","last_became_active":"2023-12-08T08:16:30.001969+0000","last_became_peered":"2023-12-08T08:16:30.001969+0000","last_unstale":"2023-12-08T08:16:45.702994+0000","last_undegraded":"2023-12-08T08:16:45.702994+0000","last_fullsized":"2023-12-08T08:16:45.702994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.051730+0000","last_change":"2023-12-08T08:16:45.690183+0000","last_active":"2023-12-08T08:16:47.051730+0000","last_peered":"2023-12-08T08:16:47.051730+0000","last_clean":"2023-12-08T08:16:47.051730+0000","last_became_active":"2023-12-08T08:16:45.688663+0000","last_became_peered":"2023-12-08T08:16:45.688663+0000","last_unstale":"2023-12-08T08:16:47.051730+0000","last_undegraded":"2023-12-08T08:16:47.051730+0000","last_fullsized":"2023-12-08T08:16:47.051730+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:16.630882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701172+0000","last_change":"2023-12-08T08:16:30.005992+0000","last_active":"2023-12-08T08:16:45.701172+0000","last_peered":"2023-12-08T08:16:45.701172+0000","last_clean":"2023-12-08T08:16:45.701172+0000","last_became_active":"2023-12-08T08:16:30.004730+0000","last_became_peered":"2023-12-08T08:16:30.004730+0000","last_unstale":"2023-12-08T08:16:45.701172+0000","last_undegraded":"2023-12-08T08:16:45.701172+0000","last_fullsized":"2023-12-08T08:16:45.701172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052443+0000","last_change":"2023-12-08T08:16:45.690852+0000","last_active":"2023-12-08T08:16:47.052443+0000","last_peered":"2023-12-08T08:16:47.052443+0000","last_clean":"2023-12-08T08:16:47.052443+0000","last_became_active":"2023-12-08T08:16:45.689851+0000","last_became_peered":"2023-12-08T08:16:45.689851+0000","last_unstale":"2023-12-08T08:16:47.052443+0000","last_undegraded":"2023-12-08T08:16:47.052443+0000","last_fullsized":"2023-12-08T08:16:47.052443+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:52:05.728783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695481+0000","last_change":"2023-12-08T08:16:30.018833+0000","last_active":"2023-12-08T08:16:45.695481+0000","last_peered":"2023-12-08T08:16:45.695481+0000","last_clean":"2023-12-08T08:16:45.695481+0000","last_became_active":"2023-12-08T08:16:30.018490+0000","last_became_peered":"2023-12-08T08:16:30.018490+0000","last_unstale":"2023-12-08T08:16:45.695481+0000","last_undegraded":"2023-12-08T08:16:45.695481+0000","last_fullsized":"2023-12-08T08:16:45.695481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:01.019985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831870+0000","last_change":"2023-12-08T08:16:45.705891+0000","last_active":"2023-12-08T08:16:46.831870+0000","last_peered":"2023-12-08T08:16:46.831870+0000","last_clean":"2023-12-08T08:16:46.831870+0000","last_became_active":"2023-12-08T08:16:45.705558+0000","last_became_peered":"2023-12-08T08:16:45.705558+0000","last_unstale":"2023-12-08T08:16:46.831870+0000","last_undegraded":"2023-12-08T08:16:46.831870+0000","last_fullsized":"2023-12-08T08:16:46.831870+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:28.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694867+0000","last_change":"2023-12-08T08:16:30.006081+0000","last_active":"2023-12-08T08:16:45.694867+0000","last_peered":"2023-12-08T08:16:45.694867+0000","last_clean":"2023-12-08T08:16:45.694867+0000","last_became_active":"2023-12-08T08:16:30.005783+0000","last_became_peered":"2023-12-08T08:16:30.005783+0000","last_unstale":"2023-12-08T08:16:45.694867+0000","last_undegraded":"2023-12-08T08:16:45.694867+0000","last_fullsized":"2023-12-08T08:16:45.694867+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:28.498447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.685321+0000","last_change":"2023-12-08T08:16:45.708481+0000","last_active":"2023-12-08T08:16:46.685321+0000","last_peered":"2023-12-08T08:16:46.685321+0000","last_clean":"2023-12-08T08:16:46.685321+0000","last_became_active":"2023-12-08T08:16:45.708090+0000","last_became_peered":"2023-12-08T08:16:45.708090+0000","last_unstale":"2023-12-08T08:16:46.685321+0000","last_undegraded":"2023-12-08T08:16:46.685321+0000","last_fullsized":"2023-12-08T08:16:46.685321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:47.696692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.692302+0000","last_change":"2023-12-08T08:16:30.008831+0000","last_active":"2023-12-08T08:16:45.692302+0000","last_peered":"2023-12-08T08:16:45.692302+0000","last_clean":"2023-12-08T08:16:45.692302+0000","last_became_active":"2023-12-08T08:16:30.006730+0000","last_became_peered":"2023-12-08T08:16:30.006730+0000","last_unstale":"2023-12-08T08:16:45.692302+0000","last_undegraded":"2023-12-08T08:16:45.692302+0000","last_fullsized":"2023-12-08T08:16:45.692302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:54.746954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053801+0000","last_change":"2023-12-08T08:16:45.712320+0000","last_active":"2023-12-08T08:16:47.053801+0000","last_peered":"2023-12-08T08:16:47.053801+0000","last_clean":"2023-12-08T08:16:47.053801+0000","last_became_active":"2023-12-08T08:16:45.712016+0000","last_became_peered":"2023-12-08T08:16:45.712016+0000","last_unstale":"2023-12-08T08:16:47.053801+0000","last_undegraded":"2023-12-08T08:16:47.053801+0000","last_fullsized":"2023-12-08T08:16:47.053801+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:12.546207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680078+0000","last_change":"2023-12-08T08:16:29.995593+0000","last_active":"2023-12-08T08:16:45.680078+0000","last_peered":"2023-12-08T08:16:45.680078+0000","last_clean":"2023-12-08T08:16:45.680078+0000","last_became_active":"2023-12-08T08:16:29.995301+0000","last_became_peered":"2023-12-08T08:16:29.995301+0000","last_unstale":"2023-12-08T08:16:45.680078+0000","last_undegraded":"2023-12-08T08:16:45.680078+0000","last_fullsized":"2023-12-08T08:16:45.680078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:26:22.011359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054337+0000","last_change":"2023-12-08T08:16:45.715594+0000","last_active":"2023-12-08T08:16:47.054337+0000","last_peered":"2023-12-08T08:16:47.054337+0000","last_clean":"2023-12-08T08:16:47.054337+0000","last_became_active":"2023-12-08T08:16:45.715295+0000","last_became_peered":"2023-12-08T08:16:45.715295+0000","last_unstale":"2023-12-08T08:16:47.054337+0000","last_undegraded":"2023-12-08T08:16:47.054337+0000","last_fullsized":"2023-12-08T08:16:47.054337+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:57.860549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701854+0000","last_change":"2023-12-08T08:16:30.015416+0000","last_active":"2023-12-08T08:16:45.701854+0000","last_peered":"2023-12-08T08:16:45.701854+0000","last_clean":"2023-12-08T08:16:45.701854+0000","last_became_active":"2023-12-08T08:16:30.015060+0000","last_became_peered":"2023-12-08T08:16:30.015060+0000","last_unstale":"2023-12-08T08:16:45.701854+0000","last_undegraded":"2023-12-08T08:16:45.701854+0000","last_fullsized":"2023-12-08T08:16:45.701854+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052835+0000","last_change":"2023-12-08T08:16:45.699329+0000","last_active":"2023-12-08T08:16:47.052835+0000","last_peered":"2023-12-08T08:16:47.052835+0000","last_clean":"2023-12-08T08:16:47.052835+0000","last_became_active":"2023-12-08T08:16:45.698992+0000","last_became_peered":"2023-12-08T08:16:45.698992+0000","last_unstale":"2023-12-08T08:16:47.052835+0000","last_undegraded":"2023-12-08T08:16:47.052835+0000","last_fullsized":"2023-12-08T08:16:47.052835+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:08.785963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699723+0000","last_change":"2023-12-08T08:16:29.993605+0000","last_active":"2023-12-08T08:16:45.699723+0000","last_peered":"2023-12-08T08:16:45.699723+0000","last_clean":"2023-12-08T08:16:45.699723+0000","last_became_active":"2023-12-08T08:16:29.993263+0000","last_became_peered":"2023-12-08T08:16:29.993263+0000","last_unstale":"2023-12-08T08:16:45.699723+0000","last_undegraded":"2023-12-08T08:16:45.699723+0000","last_fullsized":"2023-12-08T08:16:45.699723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831734+0000","last_change":"2023-12-08T08:16:45.709502+0000","last_active":"2023-12-08T08:16:46.831734+0000","last_peered":"2023-12-08T08:16:46.831734+0000","last_clean":"2023-12-08T08:16:46.831734+0000","last_became_active":"2023-12-08T08:16:45.709220+0000","last_became_peered":"2023-12-08T08:16:45.709220+0000","last_unstale":"2023-12-08T08:16:46.831734+0000","last_undegraded":"2023-12-08T08:16:46.831734+0000","last_fullsized":"2023-12-08T08:16:46.831734+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:52.646667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703252+0000","last_change":"2023-12-08T08:16:30.015099+0000","last_active":"2023-12-08T08:16:45.703252+0000","last_peered":"2023-12-08T08:16:45.703252+0000","last_clean":"2023-12-08T08:16:45.703252+0000","last_became_active":"2023-12-08T08:16:30.014849+0000","last_became_peered":"2023-12-08T08:16:30.014849+0000","last_unstale":"2023-12-08T08:16:45.703252+0000","last_undegraded":"2023-12-08T08:16:45.703252+0000","last_fullsized":"2023-12-08T08:16:45.703252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:08.500259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052453+0000","last_change":"2023-12-08T08:16:45.710499+0000","last_active":"2023-12-08T08:16:47.052453+0000","last_peered":"2023-12-08T08:16:47.052453+0000","last_clean":"2023-12-08T08:16:47.052453+0000","last_became_active":"2023-12-08T08:16:45.710222+0000","last_became_peered":"2023-12-08T08:16:45.710222+0000","last_unstale":"2023-12-08T08:16:47.052453+0000","last_undegraded":"2023-12-08T08:16:47.052453+0000","last_fullsized":"2023-12-08T08:16:47.052453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:26:04.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694254+0000","last_change":"2023-12-08T08:16:30.007497+0000","last_active":"2023-12-08T08:16:45.694254+0000","last_peered":"2023-12-08T08:16:45.694254+0000","last_clean":"2023-12-08T08:16:45.694254+0000","last_became_active":"2023-12-08T08:16:30.007046+0000","last_became_peered":"2023-12-08T08:16:30.007046+0000","last_unstale":"2023-12-08T08:16:45.694254+0000","last_undegraded":"2023-12-08T08:16:45.694254+0000","last_fullsized":"2023-12-08T08:16:45.694254+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687232+0000","last_change":"2023-12-08T08:16:45.707211+0000","last_active":"2023-12-08T08:16:46.687232+0000","last_peered":"2023-12-08T08:16:46.687232+0000","last_clean":"2023-12-08T08:16:46.687232+0000","last_became_active":"2023-12-08T08:16:45.706870+0000","last_became_peered":"2023-12-08T08:16:45.706870+0000","last_unstale":"2023-12-08T08:16:46.687232+0000","last_undegraded":"2023-12-08T08:16:46.687232+0000","last_fullsized":"2023-12-08T08:16:46.687232+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:05.336760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695074+0000","last_change":"2023-12-08T08:16:30.002707+0000","last_active":"2023-12-08T08:16:45.695074+0000","last_peered":"2023-12-08T08:16:45.695074+0000","last_clean":"2023-12-08T08:16:45.695074+0000","last_became_active":"2023-12-08T08:16:30.002244+0000","last_became_peered":"2023-12-08T08:16:30.002244+0000","last_unstale":"2023-12-08T08:16:45.695074+0000","last_undegraded":"2023-12-08T08:16:45.695074+0000","last_fullsized":"2023-12-08T08:16:45.695074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052113+0000","last_change":"2023-12-08T08:16:45.711028+0000","last_active":"2023-12-08T08:16:47.052113+0000","last_peered":"2023-12-08T08:16:47.052113+0000","last_clean":"2023-12-08T08:16:47.052113+0000","last_became_active":"2023-12-08T08:16:45.709593+0000","last_became_peered":"2023-12-08T08:16:45.709593+0000","last_unstale":"2023-12-08T08:16:47.052113+0000","last_undegraded":"2023-12-08T08:16:47.052113+0000","last_fullsized":"2023-12-08T08:16:47.052113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:44.207829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694479+0000","last_change":"2023-12-08T08:16:29.996936+0000","last_active":"2023-12-08T08:16:45.694479+0000","last_peered":"2023-12-08T08:16:45.694479+0000","last_clean":"2023-12-08T08:16:45.694479+0000","last_became_active":"2023-12-08T08:16:29.996661+0000","last_became_peered":"2023-12-08T08:16:29.996661+0000","last_unstale":"2023-12-08T08:16:45.694479+0000","last_undegraded":"2023-12-08T08:16:45.694479+0000","last_fullsized":"2023-12-08T08:16:45.694479+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832378+0000","last_change":"2023-12-08T08:16:45.707524+0000","last_active":"2023-12-08T08:16:46.832378+0000","last_peered":"2023-12-08T08:16:46.832378+0000","last_clean":"2023-12-08T08:16:46.832378+0000","last_became_active":"2023-12-08T08:16:45.707219+0000","last_became_peered":"2023-12-08T08:16:45.707219+0000","last_unstale":"2023-12-08T08:16:46.832378+0000","last_undegraded":"2023-12-08T08:16:46.832378+0000","last_fullsized":"2023-12-08T08:16:46.832378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:32.207784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696284+0000","last_change":"2023-12-08T08:16:30.004638+0000","last_active":"2023-12-08T08:16:45.696284+0000","last_peered":"2023-12-08T08:16:45.696284+0000","last_clean":"2023-12-08T08:16:45.696284+0000","last_became_active":"2023-12-08T08:16:30.004298+0000","last_became_peered":"2023-12-08T08:16:30.004298+0000","last_unstale":"2023-12-08T08:16:45.696284+0000","last_undegraded":"2023-12-08T08:16:45.696284+0000","last_fullsized":"2023-12-08T08:16:45.696284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056229+0000","last_change":"2023-12-08T08:16:45.719897+0000","last_active":"2023-12-08T08:16:47.056229+0000","last_peered":"2023-12-08T08:16:47.056229+0000","last_clean":"2023-12-08T08:16:47.056229+0000","last_became_active":"2023-12-08T08:16:45.719131+0000","last_became_peered":"2023-12-08T08:16:45.719131+0000","last_unstale":"2023-12-08T08:16:47.056229+0000","last_undegraded":"2023-12-08T08:16:47.056229+0000","last_fullsized":"2023-12-08T08:16:47.056229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:56.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679167+0000","last_change":"2023-12-08T08:16:29.998886+0000","last_active":"2023-12-08T08:16:45.679167+0000","last_peered":"2023-12-08T08:16:45.679167+0000","last_clean":"2023-12-08T08:16:45.679167+0000","last_became_active":"2023-12-08T08:16:29.998501+0000","last_became_peered":"2023-12-08T08:16:29.998501+0000","last_unstale":"2023-12-08T08:16:45.679167+0000","last_undegraded":"2023-12-08T08:16:45.679167+0000","last_fullsized":"2023-12-08T08:16:45.679167+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052976+0000","last_change":"2023-12-08T08:16:45.711028+0000","last_active":"2023-12-08T08:16:47.052976+0000","last_peered":"2023-12-08T08:16:47.052976+0000","last_clean":"2023-12-08T08:16:47.052976+0000","last_became_active":"2023-12-08T08:16:45.708573+0000","last_became_peered":"2023-12-08T08:16:45.708573+0000","last_unstale":"2023-12-08T08:16:47.052976+0000","last_undegraded":"2023-12-08T08:16:47.052976+0000","last_fullsized":"2023-12-08T08:16:47.052976+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:58.811940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701967+0000","last_change":"2023-12-08T08:16:29.996508+0000","last_active":"2023-12-08T08:16:45.701967+0000","last_peered":"2023-12-08T08:16:45.701967+0000","last_clean":"2023-12-08T08:16:45.701967+0000","last_became_active":"2023-12-08T08:16:29.995570+0000","last_became_peered":"2023-12-08T08:16:29.995570+0000","last_unstale":"2023-12-08T08:16:45.701967+0000","last_undegraded":"2023-12-08T08:16:45.701967+0000","last_fullsized":"2023-12-08T08:16:45.701967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057498+0000","last_change":"2023-12-08T08:16:45.721513+0000","last_active":"2023-12-08T08:16:47.057498+0000","last_peered":"2023-12-08T08:16:47.057498+0000","last_clean":"2023-12-08T08:16:47.057498+0000","last_became_active":"2023-12-08T08:16:45.720898+0000","last_became_peered":"2023-12-08T08:16:45.720898+0000","last_unstale":"2023-12-08T08:16:47.057498+0000","last_undegraded":"2023-12-08T08:16:47.057498+0000","last_fullsized":"2023-12-08T08:16:47.057498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:51.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.705581+0000","last_change":"2023-12-08T08:16:30.016548+0000","last_active":"2023-12-08T08:16:45.705581+0000","last_peered":"2023-12-08T08:16:45.705581+0000","last_clean":"2023-12-08T08:16:45.705581+0000","last_became_active":"2023-12-08T08:16:30.016231+0000","last_became_peered":"2023-12-08T08:16:30.016231+0000","last_unstale":"2023-12-08T08:16:45.705581+0000","last_undegraded":"2023-12-08T08:16:45.705581+0000","last_fullsized":"2023-12-08T08:16:45.705581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831792+0000","last_change":"2023-12-08T08:16:45.707501+0000","last_active":"2023-12-08T08:16:46.831792+0000","last_peered":"2023-12-08T08:16:46.831792+0000","last_clean":"2023-12-08T08:16:46.831792+0000","last_became_active":"2023-12-08T08:16:45.704587+0000","last_became_peered":"2023-12-08T08:16:45.704587+0000","last_unstale":"2023-12-08T08:16:46.831792+0000","last_undegraded":"2023-12-08T08:16:46.831792+0000","last_fullsized":"2023-12-08T08:16:46.831792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:25:12.937736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708931+0000","last_change":"2023-12-08T08:16:30.018546+0000","last_active":"2023-12-08T08:16:45.708931+0000","last_peered":"2023-12-08T08:16:45.708931+0000","last_clean":"2023-12-08T08:16:45.708931+0000","last_became_active":"2023-12-08T08:16:30.018247+0000","last_became_peered":"2023-12-08T08:16:30.018247+0000","last_unstale":"2023-12-08T08:16:45.708931+0000","last_undegraded":"2023-12-08T08:16:45.708931+0000","last_fullsized":"2023-12-08T08:16:45.708931+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055281+0000","last_change":"2023-12-08T08:16:45.712421+0000","last_active":"2023-12-08T08:16:47.055281+0000","last_peered":"2023-12-08T08:16:47.055281+0000","last_clean":"2023-12-08T08:16:47.055281+0000","last_became_active":"2023-12-08T08:16:45.711804+0000","last_became_peered":"2023-12-08T08:16:45.711804+0000","last_unstale":"2023-12-08T08:16:47.055281+0000","last_undegraded":"2023-12-08T08:16:47.055281+0000","last_fullsized":"2023-12-08T08:16:47.055281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:25.961695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.688758+0000","last_change":"2023-12-08T08:16:30.004791+0000","last_active":"2023-12-08T08:16:45.688758+0000","last_peered":"2023-12-08T08:16:45.688758+0000","last_clean":"2023-12-08T08:16:45.688758+0000","last_became_active":"2023-12-08T08:16:30.002347+0000","last_became_peered":"2023-12-08T08:16:30.002347+0000","last_unstale":"2023-12-08T08:16:45.688758+0000","last_undegraded":"2023-12-08T08:16:45.688758+0000","last_fullsized":"2023-12-08T08:16:45.688758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832333+0000","last_change":"2023-12-08T08:16:45.704132+0000","last_active":"2023-12-08T08:16:46.832333+0000","last_peered":"2023-12-08T08:16:46.832333+0000","last_clean":"2023-12-08T08:16:46.832333+0000","last_became_active":"2023-12-08T08:16:45.703807+0000","last_became_peered":"2023-12-08T08:16:45.703807+0000","last_unstale":"2023-12-08T08:16:46.832333+0000","last_undegraded":"2023-12-08T08:16:46.832333+0000","last_fullsized":"2023-12-08T08:16:46.832333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:12.546207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696214+0000","last_change":"2023-12-08T08:16:29.992462+0000","last_active":"2023-12-08T08:16:45.696214+0000","last_peered":"2023-12-08T08:16:45.696214+0000","last_clean":"2023-12-08T08:16:45.696214+0000","last_became_active":"2023-12-08T08:16:29.991153+0000","last_became_peered":"2023-12-08T08:16:29.991153+0000","last_unstale":"2023-12-08T08:16:45.696214+0000","last_undegraded":"2023-12-08T08:16:45.696214+0000","last_fullsized":"2023-12-08T08:16:45.696214+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:20.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057346+0000","last_change":"2023-12-08T08:16:45.718888+0000","last_active":"2023-12-08T08:16:47.057346+0000","last_peered":"2023-12-08T08:16:47.057346+0000","last_clean":"2023-12-08T08:16:47.057346+0000","last_became_active":"2023-12-08T08:16:45.717952+0000","last_became_peered":"2023-12-08T08:16:45.717952+0000","last_unstale":"2023-12-08T08:16:47.057346+0000","last_undegraded":"2023-12-08T08:16:47.057346+0000","last_fullsized":"2023-12-08T08:16:47.057346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:00:29.393392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686268+0000","last_change":"2023-12-08T08:16:30.002827+0000","last_active":"2023-12-08T08:16:45.686268+0000","last_peered":"2023-12-08T08:16:45.686268+0000","last_clean":"2023-12-08T08:16:45.686268+0000","last_became_active":"2023-12-08T08:16:30.002525+0000","last_became_peered":"2023-12-08T08:16:30.002525+0000","last_unstale":"2023-12-08T08:16:45.686268+0000","last_undegraded":"2023-12-08T08:16:45.686268+0000","last_fullsized":"2023-12-08T08:16:45.686268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:51.361917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053574+0000","last_change":"2023-12-08T08:16:45.705320+0000","last_active":"2023-12-08T08:16:47.053574+0000","last_peered":"2023-12-08T08:16:47.053574+0000","last_clean":"2023-12-08T08:16:47.053574+0000","last_became_active":"2023-12-08T08:16:45.704745+0000","last_became_peered":"2023-12-08T08:16:45.704745+0000","last_unstale":"2023-12-08T08:16:47.053574+0000","last_undegraded":"2023-12-08T08:16:47.053574+0000","last_fullsized":"2023-12-08T08:16:47.053574+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:31:45.137213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696374+0000","last_change":"2023-12-08T08:16:30.009287+0000","last_active":"2023-12-08T08:16:45.696374+0000","last_peered":"2023-12-08T08:16:45.696374+0000","last_clean":"2023-12-08T08:16:45.696374+0000","last_became_active":"2023-12-08T08:16:30.008873+0000","last_became_peered":"2023-12-08T08:16:30.008873+0000","last_unstale":"2023-12-08T08:16:45.696374+0000","last_undegraded":"2023-12-08T08:16:45.696374+0000","last_fullsized":"2023-12-08T08:16:45.696374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056129+0000","last_change":"2023-12-08T08:16:45.707925+0000","last_active":"2023-12-08T08:16:47.056129+0000","last_peered":"2023-12-08T08:16:47.056129+0000","last_clean":"2023-12-08T08:16:47.056129+0000","last_became_active":"2023-12-08T08:16:45.707542+0000","last_became_peered":"2023-12-08T08:16:45.707542+0000","last_unstale":"2023-12-08T08:16:47.056129+0000","last_undegraded":"2023-12-08T08:16:47.056129+0000","last_fullsized":"2023-12-08T08:16:47.056129+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:30.372839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679703+0000","last_change":"2023-12-08T08:16:30.000677+0000","last_active":"2023-12-08T08:16:45.679703+0000","last_peered":"2023-12-08T08:16:45.679703+0000","last_clean":"2023-12-08T08:16:45.679703+0000","last_became_active":"2023-12-08T08:16:29.998275+0000","last_became_peered":"2023-12-08T08:16:29.998275+0000","last_unstale":"2023-12-08T08:16:45.679703+0000","last_undegraded":"2023-12-08T08:16:45.679703+0000","last_fullsized":"2023-12-08T08:16:45.679703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:02.066542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832490+0000","last_change":"2023-12-08T08:16:45.714720+0000","last_active":"2023-12-08T08:16:46.832490+0000","last_peered":"2023-12-08T08:16:46.832490+0000","last_clean":"2023-12-08T08:16:46.832490+0000","last_became_active":"2023-12-08T08:16:45.714308+0000","last_became_peered":"2023-12-08T08:16:45.714308+0000","last_unstale":"2023-12-08T08:16:46.832490+0000","last_undegraded":"2023-12-08T08:16:46.832490+0000","last_fullsized":"2023-12-08T08:16:46.832490+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:42.133814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707968+0000","last_change":"2023-12-08T08:16:29.999599+0000","last_active":"2023-12-08T08:16:45.707968+0000","last_peered":"2023-12-08T08:16:45.707968+0000","last_clean":"2023-12-08T08:16:45.707968+0000","last_became_active":"2023-12-08T08:16:29.998776+0000","last_became_peered":"2023-12-08T08:16:29.998776+0000","last_unstale":"2023-12-08T08:16:45.707968+0000","last_undegraded":"2023-12-08T08:16:45.707968+0000","last_fullsized":"2023-12-08T08:16:45.707968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:24.145510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053573+0000","last_change":"2023-12-08T08:16:45.709900+0000","last_active":"2023-12-08T08:16:47.053573+0000","last_peered":"2023-12-08T08:16:47.053573+0000","last_clean":"2023-12-08T08:16:47.053573+0000","last_became_active":"2023-12-08T08:16:45.708321+0000","last_became_peered":"2023-12-08T08:16:45.708321+0000","last_unstale":"2023-12-08T08:16:47.053573+0000","last_undegraded":"2023-12-08T08:16:47.053573+0000","last_fullsized":"2023-12-08T08:16:47.053573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:32.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693129+0000","last_change":"2023-12-08T08:16:29.998897+0000","last_active":"2023-12-08T08:16:45.693129+0000","last_peered":"2023-12-08T08:16:45.693129+0000","last_clean":"2023-12-08T08:16:45.693129+0000","last_became_active":"2023-12-08T08:16:29.998609+0000","last_became_peered":"2023-12-08T08:16:29.998609+0000","last_unstale":"2023-12-08T08:16:45.693129+0000","last_undegraded":"2023-12-08T08:16:45.693129+0000","last_fullsized":"2023-12-08T08:16:45.693129+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:40.747230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.684866+0000","last_change":"2023-12-08T08:16:45.716126+0000","last_active":"2023-12-08T08:16:46.684866+0000","last_peered":"2023-12-08T08:16:46.684866+0000","last_clean":"2023-12-08T08:16:46.684866+0000","last_became_active":"2023-12-08T08:16:45.714854+0000","last_became_peered":"2023-12-08T08:16:45.714854+0000","last_unstale":"2023-12-08T08:16:46.684866+0000","last_undegraded":"2023-12-08T08:16:46.684866+0000","last_fullsized":"2023-12-08T08:16:46.684866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:07.492172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.689757+0000","last_change":"2023-12-08T08:16:29.991119+0000","last_active":"2023-12-08T08:16:45.689757+0000","last_peered":"2023-12-08T08:16:45.689757+0000","last_clean":"2023-12-08T08:16:45.689757+0000","last_became_active":"2023-12-08T08:16:29.990839+0000","last_became_peered":"2023-12-08T08:16:29.990839+0000","last_unstale":"2023-12-08T08:16:45.689757+0000","last_undegraded":"2023-12-08T08:16:45.689757+0000","last_fullsized":"2023-12-08T08:16:45.689757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831689+0000","last_change":"2023-12-08T08:16:45.707560+0000","last_active":"2023-12-08T08:16:46.831689+0000","last_peered":"2023-12-08T08:16:46.831689+0000","last_clean":"2023-12-08T08:16:46.831689+0000","last_became_active":"2023-12-08T08:16:45.706867+0000","last_became_peered":"2023-12-08T08:16:45.706867+0000","last_unstale":"2023-12-08T08:16:46.831689+0000","last_undegraded":"2023-12-08T08:16:46.831689+0000","last_fullsized":"2023-12-08T08:16:46.831689+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:26:04.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680589+0000","last_change":"2023-12-08T08:16:30.020097+0000","last_active":"2023-12-08T08:16:45.680589+0000","last_peered":"2023-12-08T08:16:45.680589+0000","last_clean":"2023-12-08T08:16:45.680589+0000","last_became_active":"2023-12-08T08:16:30.017380+0000","last_became_peered":"2023-12-08T08:16:30.017380+0000","last_unstale":"2023-12-08T08:16:45.680589+0000","last_undegraded":"2023-12-08T08:16:45.680589+0000","last_fullsized":"2023-12-08T08:16:45.680589+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:35.005481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054022+0000","last_change":"2023-12-08T08:16:45.710209+0000","last_active":"2023-12-08T08:16:47.054022+0000","last_peered":"2023-12-08T08:16:47.054022+0000","last_clean":"2023-12-08T08:16:47.054022+0000","last_became_active":"2023-12-08T08:16:45.707987+0000","last_became_peered":"2023-12-08T08:16:45.707987+0000","last_unstale":"2023-12-08T08:16:47.054022+0000","last_undegraded":"2023-12-08T08:16:47.054022+0000","last_fullsized":"2023-12-08T08:16:47.054022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:45:57.040711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.689536+0000","last_change":"2023-12-08T08:16:29.990154+0000","last_active":"2023-12-08T08:16:45.689536+0000","last_peered":"2023-12-08T08:16:45.689536+0000","last_clean":"2023-12-08T08:16:45.689536+0000","last_became_active":"2023-12-08T08:16:29.989050+0000","last_became_peered":"2023-12-08T08:16:29.989050+0000","last_unstale":"2023-12-08T08:16:45.689536+0000","last_undegraded":"2023-12-08T08:16:45.689536+0000","last_fullsized":"2023-12-08T08:16:45.689536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054260+0000","last_change":"2023-12-08T08:16:45.712351+0000","last_active":"2023-12-08T08:16:47.054260+0000","last_peered":"2023-12-08T08:16:47.054260+0000","last_clean":"2023-12-08T08:16:47.054260+0000","last_became_active":"2023-12-08T08:16:45.711262+0000","last_became_peered":"2023-12-08T08:16:45.711262+0000","last_unstale":"2023-12-08T08:16:47.054260+0000","last_undegraded":"2023-12-08T08:16:47.054260+0000","last_fullsized":"2023-12-08T08:16:47.054260+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:54:32.207784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.697707+0000","last_change":"2023-12-08T08:16:30.006811+0000","last_active":"2023-12-08T08:16:45.697707+0000","last_peered":"2023-12-08T08:16:45.697707+0000","last_clean":"2023-12-08T08:16:45.697707+0000","last_became_active":"2023-12-08T08:16:30.006397+0000","last_became_peered":"2023-12-08T08:16:30.006397+0000","last_unstale":"2023-12-08T08:16:45.697707+0000","last_undegraded":"2023-12-08T08:16:45.697707+0000","last_fullsized":"2023-12-08T08:16:45.697707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832355+0000","last_change":"2023-12-08T08:16:45.705973+0000","last_active":"2023-12-08T08:16:46.832355+0000","last_peered":"2023-12-08T08:16:46.832355+0000","last_clean":"2023-12-08T08:16:46.832355+0000","last_became_active":"2023-12-08T08:16:45.705677+0000","last_became_peered":"2023-12-08T08:16:45.705677+0000","last_unstale":"2023-12-08T08:16:46.832355+0000","last_undegraded":"2023-12-08T08:16:46.832355+0000","last_fullsized":"2023-12-08T08:16:46.832355+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:20.118262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.687301+0000","last_change":"2023-12-08T08:16:29.996114+0000","last_active":"2023-12-08T08:16:45.687301+0000","last_peered":"2023-12-08T08:16:45.687301+0000","last_clean":"2023-12-08T08:16:45.687301+0000","last_became_active":"2023-12-08T08:16:29.995823+0000","last_became_peered":"2023-12-08T08:16:29.995823+0000","last_unstale":"2023-12-08T08:16:45.687301+0000","last_undegraded":"2023-12-08T08:16:45.687301+0000","last_fullsized":"2023-12-08T08:16:45.687301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:24.233820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057578+0000","last_change":"2023-12-08T08:16:45.703015+0000","last_active":"2023-12-08T08:16:47.057578+0000","last_peered":"2023-12-08T08:16:47.057578+0000","last_clean":"2023-12-08T08:16:47.057578+0000","last_became_active":"2023-12-08T08:16:45.699795+0000","last_became_peered":"2023-12-08T08:16:45.699795+0000","last_unstale":"2023-12-08T08:16:47.057578+0000","last_undegraded":"2023-12-08T08:16:47.057578+0000","last_fullsized":"2023-12-08T08:16:47.057578+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:27:54.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686368+0000","last_change":"2023-12-08T08:16:29.993060+0000","last_active":"2023-12-08T08:16:45.686368+0000","last_peered":"2023-12-08T08:16:45.686368+0000","last_clean":"2023-12-08T08:16:45.686368+0000","last_became_active":"2023-12-08T08:16:29.992718+0000","last_became_peered":"2023-12-08T08:16:29.992718+0000","last_unstale":"2023-12-08T08:16:45.686368+0000","last_undegraded":"2023-12-08T08:16:45.686368+0000","last_fullsized":"2023-12-08T08:16:45.686368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:29.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832407+0000","last_change":"2023-12-08T08:16:45.716261+0000","last_active":"2023-12-08T08:16:46.832407+0000","last_peered":"2023-12-08T08:16:46.832407+0000","last_clean":"2023-12-08T08:16:46.832407+0000","last_became_active":"2023-12-08T08:16:45.715939+0000","last_became_peered":"2023-12-08T08:16:45.715939+0000","last_unstale":"2023-12-08T08:16:46.832407+0000","last_undegraded":"2023-12-08T08:16:46.832407+0000","last_fullsized":"2023-12-08T08:16:46.832407+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:57.860549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708067+0000","last_change":"2023-12-08T08:16:30.000366+0000","last_active":"2023-12-08T08:16:45.708067+0000","last_peered":"2023-12-08T08:16:45.708067+0000","last_clean":"2023-12-08T08:16:45.708067+0000","last_became_active":"2023-12-08T08:16:29.999086+0000","last_became_peered":"2023-12-08T08:16:29.999086+0000","last_unstale":"2023-12-08T08:16:45.708067+0000","last_undegraded":"2023-12-08T08:16:45.708067+0000","last_fullsized":"2023-12-08T08:16:45.708067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057836+0000","last_change":"2023-12-08T08:16:45.721719+0000","last_active":"2023-12-08T08:16:47.057836+0000","last_peered":"2023-12-08T08:16:47.057836+0000","last_clean":"2023-12-08T08:16:47.057836+0000","last_became_active":"2023-12-08T08:16:45.721247+0000","last_became_peered":"2023-12-08T08:16:45.721247+0000","last_unstale":"2023-12-08T08:16:47.057836+0000","last_undegraded":"2023-12-08T08:16:47.057836+0000","last_fullsized":"2023-12-08T08:16:47.057836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:05.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.674991+0000","last_change":"2023-12-08T08:16:30.001378+0000","last_active":"2023-12-08T08:16:45.674991+0000","last_peered":"2023-12-08T08:16:45.674991+0000","last_clean":"2023-12-08T08:16:45.674991+0000","last_became_active":"2023-12-08T08:16:30.000249+0000","last_became_peered":"2023-12-08T08:16:30.000249+0000","last_unstale":"2023-12-08T08:16:45.674991+0000","last_undegraded":"2023-12-08T08:16:45.674991+0000","last_fullsized":"2023-12-08T08:16:45.674991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:13:52.117326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054280+0000","last_change":"2023-12-08T08:16:45.711289+0000","last_active":"2023-12-08T08:16:47.054280+0000","last_peered":"2023-12-08T08:16:47.054280+0000","last_clean":"2023-12-08T08:16:47.054280+0000","last_became_active":"2023-12-08T08:16:45.708816+0000","last_became_peered":"2023-12-08T08:16:45.708816+0000","last_unstale":"2023-12-08T08:16:47.054280+0000","last_undegraded":"2023-12-08T08:16:47.054280+0000","last_fullsized":"2023-12-08T08:16:47.054280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:29.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053691+0000","last_change":"2023-12-08T08:16:45.105864+0000","last_active":"2023-12-08T08:16:47.053691+0000","last_peered":"2023-12-08T08:16:47.053691+0000","last_clean":"2023-12-08T08:16:47.053691+0000","last_became_active":"2023-12-08T08:16:45.103673+0000","last_became_peered":"2023-12-08T08:16:45.103673+0000","last_unstale":"2023-12-08T08:16:47.053691+0000","last_undegraded":"2023-12-08T08:16:47.053691+0000","last_fullsized":"2023-12-08T08:16:47.053691+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:02.005336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708719+0000","last_change":"2023-12-08T08:16:30.018277+0000","last_active":"2023-12-08T08:16:45.708719+0000","last_peered":"2023-12-08T08:16:45.708719+0000","last_clean":"2023-12-08T08:16:45.708719+0000","last_became_active":"2023-12-08T08:16:30.017958+0000","last_became_peered":"2023-12-08T08:16:30.017958+0000","last_unstale":"2023-12-08T08:16:45.708719+0000","last_undegraded":"2023-12-08T08:16:45.708719+0000","last_fullsized":"2023-12-08T08:16:45.708719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.690371+0000","last_change":"2023-12-08T08:16:28.972135+0000","last_active":"2023-12-08T08:16:45.690371+0000","last_peered":"2023-12-08T08:16:45.690371+0000","last_clean":"2023-12-08T08:16:45.690371+0000","last_became_active":"2023-12-08T08:16:28.971791+0000","last_became_peered":"2023-12-08T08:16:28.971791+0000","last_unstale":"2023-12-08T08:16:45.690371+0000","last_undegraded":"2023-12-08T08:16:45.690371+0000","last_fullsized":"2023-12-08T08:16:45.690371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053161+0000","last_change":"2023-12-08T08:16:45.705418+0000","last_active":"2023-12-08T08:16:47.053161+0000","last_peered":"2023-12-08T08:16:47.053161+0000","last_clean":"2023-12-08T08:16:47.053161+0000","last_became_active":"2023-12-08T08:16:45.705049+0000","last_became_peered":"2023-12-08T08:16:45.705049+0000","last_unstale":"2023-12-08T08:16:47.053161+0000","last_undegraded":"2023-12-08T08:16:47.053161+0000","last_fullsized":"2023-12-08T08:16:47.053161+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:25:12.937736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060382+0000","last_change":"2023-12-08T08:16:45.102201+0000","last_active":"2023-12-08T08:16:47.060382+0000","last_peered":"2023-12-08T08:16:47.060382+0000","last_clean":"2023-12-08T08:16:47.060382+0000","last_became_active":"2023-12-08T08:16:45.101874+0000","last_became_peered":"2023-12-08T08:16:45.101874+0000","last_unstale":"2023-12-08T08:16:47.060382+0000","last_undegraded":"2023-12-08T08:16:47.060382+0000","last_fullsized":"2023-12-08T08:16:47.060382+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:20.563413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.678887+0000","last_change":"2023-12-08T08:16:30.017910+0000","last_active":"2023-12-08T08:16:45.678887+0000","last_peered":"2023-12-08T08:16:45.678887+0000","last_clean":"2023-12-08T08:16:45.678887+0000","last_became_active":"2023-12-08T08:16:30.017619+0000","last_became_peered":"2023-12-08T08:16:30.017619+0000","last_unstale":"2023-12-08T08:16:45.678887+0000","last_undegraded":"2023-12-08T08:16:45.678887+0000","last_fullsized":"2023-12-08T08:16:45.678887+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:15.253515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.697950+0000","last_change":"2023-12-08T08:16:28.974333+0000","last_active":"2023-12-08T08:16:45.697950+0000","last_peered":"2023-12-08T08:16:45.697950+0000","last_clean":"2023-12-08T08:16:45.697950+0000","last_became_active":"2023-12-08T08:16:28.974049+0000","last_became_peered":"2023-12-08T08:16:28.974049+0000","last_unstale":"2023-12-08T08:16:45.697950+0000","last_undegraded":"2023-12-08T08:16:45.697950+0000","last_fullsized":"2023-12-08T08:16:45.697950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:43:01.053374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055256+0000","last_change":"2023-12-08T08:16:45.706125+0000","last_active":"2023-12-08T08:16:47.055256+0000","last_peered":"2023-12-08T08:16:47.055256+0000","last_clean":"2023-12-08T08:16:47.055256+0000","last_became_active":"2023-12-08T08:16:45.705771+0000","last_became_peered":"2023-12-08T08:16:45.705771+0000","last_unstale":"2023-12-08T08:16:47.055256+0000","last_undegraded":"2023-12-08T08:16:47.055256+0000","last_fullsized":"2023-12-08T08:16:47.055256+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:58.532849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"43'4","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058615+0000","last_change":"2023-12-08T08:16:45.105380+0000","last_active":"2023-12-08T08:16:47.058615+0000","last_peered":"2023-12-08T08:16:47.058615+0000","last_clean":"2023-12-08T08:16:47.058615+0000","last_became_active":"2023-12-08T08:16:45.104137+0000","last_became_peered":"2023-12-08T08:16:45.104137+0000","last_unstale":"2023-12-08T08:16:47.058615+0000","last_undegraded":"2023-12-08T08:16:47.058615+0000","last_fullsized":"2023-12-08T08:16:47.058615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:07.293948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679772+0000","last_change":"2023-12-08T08:16:30.000953+0000","last_active":"2023-12-08T08:16:45.679772+0000","last_peered":"2023-12-08T08:16:45.679772+0000","last_clean":"2023-12-08T08:16:45.679772+0000","last_became_active":"2023-12-08T08:16:30.000673+0000","last_became_peered":"2023-12-08T08:16:30.000673+0000","last_unstale":"2023-12-08T08:16:45.679772+0000","last_undegraded":"2023-12-08T08:16:45.679772+0000","last_fullsized":"2023-12-08T08:16:45.679772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:40.516510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679333+0000","last_change":"2023-12-08T08:16:28.970890+0000","last_active":"2023-12-08T08:16:45.679333+0000","last_peered":"2023-12-08T08:16:45.679333+0000","last_clean":"2023-12-08T08:16:45.679333+0000","last_became_active":"2023-12-08T08:16:28.970617+0000","last_became_peered":"2023-12-08T08:16:28.970617+0000","last_unstale":"2023-12-08T08:16:45.679333+0000","last_undegraded":"2023-12-08T08:16:45.679333+0000","last_fullsized":"2023-12-08T08:16:45.679333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:27.409906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058015+0000","last_change":"2023-12-08T08:16:45.715855+0000","last_active":"2023-12-08T08:16:47.058015+0000","last_peered":"2023-12-08T08:16:47.058015+0000","last_clean":"2023-12-08T08:16:47.058015+0000","last_became_active":"2023-12-08T08:16:45.715182+0000","last_became_peered":"2023-12-08T08:16:45.715182+0000","last_unstale":"2023-12-08T08:16:47.058015+0000","last_undegraded":"2023-12-08T08:16:47.058015+0000","last_fullsized":"2023-12-08T08:16:47.058015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:51.742018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052933+0000","last_change":"2023-12-08T08:16:45.091402+0000","last_active":"2023-12-08T08:16:47.052933+0000","last_peered":"2023-12-08T08:16:47.052933+0000","last_clean":"2023-12-08T08:16:47.052933+0000","last_became_active":"2023-12-08T08:16:45.091037+0000","last_became_peered":"2023-12-08T08:16:45.091037+0000","last_unstale":"2023-12-08T08:16:47.052933+0000","last_undegraded":"2023-12-08T08:16:47.052933+0000","last_fullsized":"2023-12-08T08:16:47.052933+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:38.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702861+0000","last_change":"2023-12-08T08:16:30.002841+0000","last_active":"2023-12-08T08:16:45.702861+0000","last_peered":"2023-12-08T08:16:45.702861+0000","last_clean":"2023-12-08T08:16:45.702861+0000","last_became_active":"2023-12-08T08:16:30.002371+0000","last_became_peered":"2023-12-08T08:16:30.002371+0000","last_unstale":"2023-12-08T08:16:45.702861+0000","last_undegraded":"2023-12-08T08:16:45.702861+0000","last_fullsized":"2023-12-08T08:16:45.702861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:19.797404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.683064+0000","last_change":"2023-12-08T08:16:28.966804+0000","last_active":"2023-12-08T08:16:45.683064+0000","last_peered":"2023-12-08T08:16:45.683064+0000","last_clean":"2023-12-08T08:16:45.683064+0000","last_became_active":"2023-12-08T08:16:28.966500+0000","last_became_peered":"2023-12-08T08:16:28.966500+0000","last_unstale":"2023-12-08T08:16:45.683064+0000","last_undegraded":"2023-12-08T08:16:45.683064+0000","last_fullsized":"2023-12-08T08:16:45.683064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053889+0000","last_change":"2023-12-08T08:16:45.708581+0000","last_active":"2023-12-08T08:16:47.053889+0000","last_peered":"2023-12-08T08:16:47.053889+0000","last_clean":"2023-12-08T08:16:47.053889+0000","last_became_active":"2023-12-08T08:16:45.707960+0000","last_became_peered":"2023-12-08T08:16:45.707960+0000","last_unstale":"2023-12-08T08:16:47.053889+0000","last_undegraded":"2023-12-08T08:16:47.053889+0000","last_fullsized":"2023-12-08T08:16:47.053889+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:20.118262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054020+0000","last_change":"2023-12-08T08:16:45.103816+0000","last_active":"2023-12-08T08:16:47.054020+0000","last_peered":"2023-12-08T08:16:47.054020+0000","last_clean":"2023-12-08T08:16:47.054020+0000","last_became_active":"2023-12-08T08:16:45.103203+0000","last_became_peered":"2023-12-08T08:16:45.103203+0000","last_unstale":"2023-12-08T08:16:47.054020+0000","last_undegraded":"2023-12-08T08:16:47.054020+0000","last_fullsized":"2023-12-08T08:16:47.054020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:08.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693188+0000","last_change":"2023-12-08T08:16:29.999014+0000","last_active":"2023-12-08T08:16:45.693188+0000","last_peered":"2023-12-08T08:16:45.693188+0000","last_clean":"2023-12-08T08:16:45.693188+0000","last_became_active":"2023-12-08T08:16:29.998706+0000","last_became_peered":"2023-12-08T08:16:29.998706+0000","last_unstale":"2023-12-08T08:16:45.693188+0000","last_undegraded":"2023-12-08T08:16:45.693188+0000","last_fullsized":"2023-12-08T08:16:45.693188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696486+0000","last_change":"2023-12-08T08:16:28.972751+0000","last_active":"2023-12-08T08:16:45.696486+0000","last_peered":"2023-12-08T08:16:45.696486+0000","last_clean":"2023-12-08T08:16:45.696486+0000","last_became_active":"2023-12-08T08:16:28.971599+0000","last_became_peered":"2023-12-08T08:16:28.971599+0000","last_unstale":"2023-12-08T08:16:45.696486+0000","last_undegraded":"2023-12-08T08:16:45.696486+0000","last_fullsized":"2023-12-08T08:16:45.696486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056869+0000","last_change":"2023-12-08T08:16:45.718745+0000","last_active":"2023-12-08T08:16:47.056869+0000","last_peered":"2023-12-08T08:16:47.056869+0000","last_clean":"2023-12-08T08:16:47.056869+0000","last_became_active":"2023-12-08T08:16:45.718434+0000","last_became_peered":"2023-12-08T08:16:45.718434+0000","last_unstale":"2023-12-08T08:16:47.056869+0000","last_undegraded":"2023-12-08T08:16:47.056869+0000","last_fullsized":"2023-12-08T08:16:47.056869+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:25.961695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831444+0000","last_change":"2023-12-08T08:16:45.106766+0000","last_active":"2023-12-08T08:16:46.831444+0000","last_peered":"2023-12-08T08:16:46.831444+0000","last_clean":"2023-12-08T08:16:46.831444+0000","last_became_active":"2023-12-08T08:16:45.106317+0000","last_became_peered":"2023-12-08T08:16:45.106317+0000","last_unstale":"2023-12-08T08:16:46.831444+0000","last_undegraded":"2023-12-08T08:16:46.831444+0000","last_fullsized":"2023-12-08T08:16:46.831444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:08:03.725391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702100+0000","last_change":"2023-12-08T08:16:30.005902+0000","last_active":"2023-12-08T08:16:45.702100+0000","last_peered":"2023-12-08T08:16:45.702100+0000","last_clean":"2023-12-08T08:16:45.702100+0000","last_became_active":"2023-12-08T08:16:30.005581+0000","last_became_peered":"2023-12-08T08:16:30.005581+0000","last_unstale":"2023-12-08T08:16:45.702100+0000","last_undegraded":"2023-12-08T08:16:45.702100+0000","last_fullsized":"2023-12-08T08:16:45.702100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707647+0000","last_change":"2023-12-08T08:16:28.980410+0000","last_active":"2023-12-08T08:16:45.707647+0000","last_peered":"2023-12-08T08:16:45.707647+0000","last_clean":"2023-12-08T08:16:45.707647+0000","last_became_active":"2023-12-08T08:16:28.980037+0000","last_became_peered":"2023-12-08T08:16:28.980037+0000","last_unstale":"2023-12-08T08:16:45.707647+0000","last_undegraded":"2023-12-08T08:16:45.707647+0000","last_fullsized":"2023-12-08T08:16:45.707647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:00.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687406+0000","last_change":"2023-12-08T08:16:45.701754+0000","last_active":"2023-12-08T08:16:46.687406+0000","last_peered":"2023-12-08T08:16:46.687406+0000","last_clean":"2023-12-08T08:16:46.687406+0000","last_became_active":"2023-12-08T08:16:45.700029+0000","last_became_peered":"2023-12-08T08:16:45.700029+0000","last_unstale":"2023-12-08T08:16:46.687406+0000","last_undegraded":"2023-12-08T08:16:46.687406+0000","last_fullsized":"2023-12-08T08:16:46.687406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:09:08.307093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832004+0000","last_change":"2023-12-08T08:16:45.104969+0000","last_active":"2023-12-08T08:16:46.832004+0000","last_peered":"2023-12-08T08:16:46.832004+0000","last_clean":"2023-12-08T08:16:46.832004+0000","last_became_active":"2023-12-08T08:16:45.104653+0000","last_became_peered":"2023-12-08T08:16:45.104653+0000","last_unstale":"2023-12-08T08:16:46.832004+0000","last_undegraded":"2023-12-08T08:16:46.832004+0000","last_fullsized":"2023-12-08T08:16:46.832004+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:55.511584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679767+0000","last_change":"2023-12-08T08:16:30.012886+0000","last_active":"2023-12-08T08:16:45.679767+0000","last_peered":"2023-12-08T08:16:45.679767+0000","last_clean":"2023-12-08T08:16:45.679767+0000","last_became_active":"2023-12-08T08:16:30.012578+0000","last_became_peered":"2023-12-08T08:16:30.012578+0000","last_unstale":"2023-12-08T08:16:45.679767+0000","last_undegraded":"2023-12-08T08:16:45.679767+0000","last_fullsized":"2023-12-08T08:16:45.679767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:41.312954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675900+0000","last_change":"2023-12-08T08:16:28.966099+0000","last_active":"2023-12-08T08:16:45.675900+0000","last_peered":"2023-12-08T08:16:45.675900+0000","last_clean":"2023-12-08T08:16:45.675900+0000","last_became_active":"2023-12-08T08:16:28.965830+0000","last_became_peered":"2023-12-08T08:16:28.965830+0000","last_unstale":"2023-12-08T08:16:45.675900+0000","last_undegraded":"2023-12-08T08:16:45.675900+0000","last_fullsized":"2023-12-08T08:16:45.675900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.868360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058546+0000","last_change":"2023-12-08T08:16:45.720839+0000","last_active":"2023-12-08T08:16:47.058546+0000","last_peered":"2023-12-08T08:16:47.058546+0000","last_clean":"2023-12-08T08:16:47.058546+0000","last_became_active":"2023-12-08T08:16:45.720542+0000","last_became_peered":"2023-12-08T08:16:45.720542+0000","last_unstale":"2023-12-08T08:16:47.058546+0000","last_undegraded":"2023-12-08T08:16:47.058546+0000","last_fullsized":"2023-12-08T08:16:47.058546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:19.866958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686790+0000","last_change":"2023-12-08T08:16:45.104589+0000","last_active":"2023-12-08T08:16:46.686790+0000","last_peered":"2023-12-08T08:16:46.686790+0000","last_clean":"2023-12-08T08:16:46.686790+0000","last_became_active":"2023-12-08T08:16:45.104122+0000","last_became_peered":"2023-12-08T08:16:45.104122+0000","last_unstale":"2023-12-08T08:16:46.686790+0000","last_undegraded":"2023-12-08T08:16:46.686790+0000","last_fullsized":"2023-12-08T08:16:46.686790+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:08.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701925+0000","last_change":"2023-12-08T08:16:30.004935+0000","last_active":"2023-12-08T08:16:45.701925+0000","last_peered":"2023-12-08T08:16:45.701925+0000","last_clean":"2023-12-08T08:16:45.701925+0000","last_became_active":"2023-12-08T08:16:30.004484+0000","last_became_peered":"2023-12-08T08:16:30.004484+0000","last_unstale":"2023-12-08T08:16:45.701925+0000","last_undegraded":"2023-12-08T08:16:45.701925+0000","last_fullsized":"2023-12-08T08:16:45.701925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680485+0000","last_change":"2023-12-08T08:16:28.970395+0000","last_active":"2023-12-08T08:16:45.680485+0000","last_peered":"2023-12-08T08:16:45.680485+0000","last_clean":"2023-12-08T08:16:45.680485+0000","last_became_active":"2023-12-08T08:16:28.969828+0000","last_became_peered":"2023-12-08T08:16:28.969828+0000","last_unstale":"2023-12-08T08:16:45.680485+0000","last_undegraded":"2023-12-08T08:16:45.680485+0000","last_fullsized":"2023-12-08T08:16:45.680485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832007+0000","last_change":"2023-12-08T08:16:45.703374+0000","last_active":"2023-12-08T08:16:46.832007+0000","last_peered":"2023-12-08T08:16:46.832007+0000","last_clean":"2023-12-08T08:16:46.832007+0000","last_became_active":"2023-12-08T08:16:45.703067+0000","last_became_peered":"2023-12-08T08:16:45.703067+0000","last_unstale":"2023-12-08T08:16:46.832007+0000","last_undegraded":"2023-12-08T08:16:46.832007+0000","last_fullsized":"2023-12-08T08:16:46.832007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:32.622621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"43'3","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058050+0000","last_change":"2023-12-08T08:16:45.095663+0000","last_active":"2023-12-08T08:16:47.058050+0000","last_peered":"2023-12-08T08:16:47.058050+0000","last_clean":"2023-12-08T08:16:47.058050+0000","last_became_active":"2023-12-08T08:16:45.095200+0000","last_became_peered":"2023-12-08T08:16:45.095200+0000","last_unstale":"2023-12-08T08:16:47.058050+0000","last_undegraded":"2023-12-08T08:16:47.058050+0000","last_fullsized":"2023-12-08T08:16:47.058050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:17.803865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.694967+0000","last_change":"2023-12-08T08:16:29.996118+0000","last_active":"2023-12-08T08:16:45.694967+0000","last_peered":"2023-12-08T08:16:45.694967+0000","last_clean":"2023-12-08T08:16:45.694967+0000","last_became_active":"2023-12-08T08:16:29.995815+0000","last_became_peered":"2023-12-08T08:16:29.995815+0000","last_unstale":"2023-12-08T08:16:45.694967+0000","last_undegraded":"2023-12-08T08:16:45.694967+0000","last_fullsized":"2023-12-08T08:16:45.694967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:14.393578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703101+0000","last_change":"2023-12-08T08:16:28.970249+0000","last_active":"2023-12-08T08:16:45.703101+0000","last_peered":"2023-12-08T08:16:45.703101+0000","last_clean":"2023-12-08T08:16:45.703101+0000","last_became_active":"2023-12-08T08:16:28.969959+0000","last_became_peered":"2023-12-08T08:16:28.969959+0000","last_unstale":"2023-12-08T08:16:45.703101+0000","last_undegraded":"2023-12-08T08:16:45.703101+0000","last_fullsized":"2023-12-08T08:16:45.703101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.687345+0000","last_change":"2023-12-08T08:16:45.703480+0000","last_active":"2023-12-08T08:16:46.687345+0000","last_peered":"2023-12-08T08:16:46.687345+0000","last_clean":"2023-12-08T08:16:46.687345+0000","last_became_active":"2023-12-08T08:16:45.702891+0000","last_became_peered":"2023-12-08T08:16:45.702891+0000","last_unstale":"2023-12-08T08:16:46.687345+0000","last_undegraded":"2023-12-08T08:16:46.687345+0000","last_fullsized":"2023-12-08T08:16:46.687345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:40:25.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"43'6","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053662+0000","last_change":"2023-12-08T08:16:45.100074+0000","last_active":"2023-12-08T08:16:47.053662+0000","last_peered":"2023-12-08T08:16:47.053662+0000","last_clean":"2023-12-08T08:16:47.053662+0000","last_became_active":"2023-12-08T08:16:45.099785+0000","last_became_peered":"2023-12-08T08:16:45.099785+0000","last_unstale":"2023-12-08T08:16:47.053662+0000","last_undegraded":"2023-12-08T08:16:47.053662+0000","last_fullsized":"2023-12-08T08:16:47.053662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:18.853813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.709965+0000","last_change":"2023-12-08T08:16:30.011144+0000","last_active":"2023-12-08T08:16:45.709965+0000","last_peered":"2023-12-08T08:16:45.709965+0000","last_clean":"2023-12-08T08:16:45.709965+0000","last_became_active":"2023-12-08T08:16:30.010821+0000","last_became_peered":"2023-12-08T08:16:30.010821+0000","last_unstale":"2023-12-08T08:16:45.709965+0000","last_undegraded":"2023-12-08T08:16:45.709965+0000","last_fullsized":"2023-12-08T08:16:45.709965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:53.583077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695032+0000","last_change":"2023-12-08T08:16:28.972703+0000","last_active":"2023-12-08T08:16:45.695032+0000","last_peered":"2023-12-08T08:16:45.695032+0000","last_clean":"2023-12-08T08:16:45.695032+0000","last_became_active":"2023-12-08T08:16:28.972337+0000","last_became_peered":"2023-12-08T08:16:28.972337+0000","last_unstale":"2023-12-08T08:16:45.695032+0000","last_undegraded":"2023-12-08T08:16:45.695032+0000","last_fullsized":"2023-12-08T08:16:45.695032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:11.077052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686518+0000","last_change":"2023-12-08T08:16:45.711650+0000","last_active":"2023-12-08T08:16:46.686518+0000","last_peered":"2023-12-08T08:16:46.686518+0000","last_clean":"2023-12-08T08:16:46.686518+0000","last_became_active":"2023-12-08T08:16:45.711134+0000","last_became_peered":"2023-12-08T08:16:45.711134+0000","last_unstale":"2023-12-08T08:16:46.686518+0000","last_undegraded":"2023-12-08T08:16:46.686518+0000","last_fullsized":"2023-12-08T08:16:46.686518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:20.080487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057028+0000","last_change":"2023-12-08T08:16:45.107603+0000","last_active":"2023-12-08T08:16:47.057028+0000","last_peered":"2023-12-08T08:16:47.057028+0000","last_clean":"2023-12-08T08:16:47.057028+0000","last_became_active":"2023-12-08T08:16:45.105714+0000","last_became_peered":"2023-12-08T08:16:45.105714+0000","last_unstale":"2023-12-08T08:16:47.057028+0000","last_undegraded":"2023-12-08T08:16:47.057028+0000","last_fullsized":"2023-12-08T08:16:47.057028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:17.947688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696700+0000","last_change":"2023-12-08T08:16:30.002548+0000","last_active":"2023-12-08T08:16:45.696700+0000","last_peered":"2023-12-08T08:16:45.696700+0000","last_clean":"2023-12-08T08:16:45.696700+0000","last_became_active":"2023-12-08T08:16:30.002266+0000","last_became_peered":"2023-12-08T08:16:30.002266+0000","last_unstale":"2023-12-08T08:16:45.696700+0000","last_undegraded":"2023-12-08T08:16:45.696700+0000","last_fullsized":"2023-12-08T08:16:45.696700+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:36:12.090220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695546+0000","last_change":"2023-12-08T08:16:28.974757+0000","last_active":"2023-12-08T08:16:45.695546+0000","last_peered":"2023-12-08T08:16:45.695546+0000","last_clean":"2023-12-08T08:16:45.695546+0000","last_became_active":"2023-12-08T08:16:28.974470+0000","last_became_peered":"2023-12-08T08:16:28.974470+0000","last_unstale":"2023-12-08T08:16:45.695546+0000","last_undegraded":"2023-12-08T08:16:45.695546+0000","last_fullsized":"2023-12-08T08:16:45.695546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:07.487090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054888+0000","last_change":"2023-12-08T08:16:45.715112+0000","last_active":"2023-12-08T08:16:47.054888+0000","last_peered":"2023-12-08T08:16:47.054888+0000","last_clean":"2023-12-08T08:16:47.054888+0000","last_became_active":"2023-12-08T08:16:45.714811+0000","last_became_peered":"2023-12-08T08:16:45.714811+0000","last_unstale":"2023-12-08T08:16:47.054888+0000","last_undegraded":"2023-12-08T08:16:47.054888+0000","last_fullsized":"2023-12-08T08:16:47.054888+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:56:56.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.688035+0000","last_change":"2023-12-08T08:16:45.108742+0000","last_active":"2023-12-08T08:16:46.688035+0000","last_peered":"2023-12-08T08:16:46.688035+0000","last_clean":"2023-12-08T08:16:46.688035+0000","last_became_active":"2023-12-08T08:16:45.108466+0000","last_became_peered":"2023-12-08T08:16:45.108466+0000","last_unstale":"2023-12-08T08:16:46.688035+0000","last_undegraded":"2023-12-08T08:16:46.688035+0000","last_fullsized":"2023-12-08T08:16:46.688035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:23.293185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.682856+0000","last_change":"2023-12-08T08:16:30.000962+0000","last_active":"2023-12-08T08:16:45.682856+0000","last_peered":"2023-12-08T08:16:45.682856+0000","last_clean":"2023-12-08T08:16:45.682856+0000","last_became_active":"2023-12-08T08:16:29.999415+0000","last_became_peered":"2023-12-08T08:16:29.999415+0000","last_unstale":"2023-12-08T08:16:45.682856+0000","last_undegraded":"2023-12-08T08:16:45.682856+0000","last_fullsized":"2023-12-08T08:16:45.682856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:52.760726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.700626+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:45.700626+0000","last_peered":"2023-12-08T08:16:45.700626+0000","last_clean":"2023-12-08T08:16:45.700626+0000","last_became_active":"2023-12-08T08:16:28.974334+0000","last_became_peered":"2023-12-08T08:16:28.974334+0000","last_unstale":"2023-12-08T08:16:45.700626+0000","last_undegraded":"2023-12-08T08:16:45.700626+0000","last_fullsized":"2023-12-08T08:16:45.700626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053600+0000","last_change":"2023-12-08T08:16:45.715925+0000","last_active":"2023-12-08T08:16:47.053600+0000","last_peered":"2023-12-08T08:16:47.053600+0000","last_clean":"2023-12-08T08:16:47.053600+0000","last_became_active":"2023-12-08T08:16:45.715658+0000","last_became_peered":"2023-12-08T08:16:45.715658+0000","last_unstale":"2023-12-08T08:16:47.053600+0000","last_undegraded":"2023-12-08T08:16:47.053600+0000","last_fullsized":"2023-12-08T08:16:47.053600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:24.919971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055975+0000","last_change":"2023-12-08T08:16:45.102583+0000","last_active":"2023-12-08T08:16:47.055975+0000","last_peered":"2023-12-08T08:16:47.055975+0000","last_clean":"2023-12-08T08:16:47.055975+0000","last_became_active":"2023-12-08T08:16:45.102245+0000","last_became_peered":"2023-12-08T08:16:45.102245+0000","last_unstale":"2023-12-08T08:16:47.055975+0000","last_undegraded":"2023-12-08T08:16:47.055975+0000","last_fullsized":"2023-12-08T08:16:47.055975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:53.971361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693342+0000","last_change":"2023-12-08T08:16:30.009858+0000","last_active":"2023-12-08T08:16:45.693342+0000","last_peered":"2023-12-08T08:16:45.693342+0000","last_clean":"2023-12-08T08:16:45.693342+0000","last_became_active":"2023-12-08T08:16:30.009477+0000","last_became_peered":"2023-12-08T08:16:30.009477+0000","last_unstale":"2023-12-08T08:16:45.693342+0000","last_undegraded":"2023-12-08T08:16:45.693342+0000","last_fullsized":"2023-12-08T08:16:45.693342+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:49.608152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703155+0000","last_change":"2023-12-08T08:16:28.975330+0000","last_active":"2023-12-08T08:16:45.703155+0000","last_peered":"2023-12-08T08:16:45.703155+0000","last_clean":"2023-12-08T08:16:45.703155+0000","last_became_active":"2023-12-08T08:16:28.974952+0000","last_became_peered":"2023-12-08T08:16:28.974952+0000","last_unstale":"2023-12-08T08:16:45.703155+0000","last_undegraded":"2023-12-08T08:16:45.703155+0000","last_fullsized":"2023-12-08T08:16:45.703155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832995+0000","last_change":"2023-12-08T08:16:45.715865+0000","last_active":"2023-12-08T08:16:46.832995+0000","last_peered":"2023-12-08T08:16:46.832995+0000","last_clean":"2023-12-08T08:16:46.832995+0000","last_became_active":"2023-12-08T08:16:45.715602+0000","last_became_peered":"2023-12-08T08:16:45.715602+0000","last_unstale":"2023-12-08T08:16:46.832995+0000","last_undegraded":"2023-12-08T08:16:46.832995+0000","last_fullsized":"2023-12-08T08:16:46.832995+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:05:15.892327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"43'8","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052639+0000","last_change":"2023-12-08T08:16:45.094244+0000","last_active":"2023-12-08T08:16:47.052639+0000","last_peered":"2023-12-08T08:16:47.052639+0000","last_clean":"2023-12-08T08:16:47.052639+0000","last_became_active":"2023-12-08T08:16:45.093417+0000","last_became_peered":"2023-12-08T08:16:45.093417+0000","last_unstale":"2023-12-08T08:16:47.052639+0000","last_undegraded":"2023-12-08T08:16:47.052639+0000","last_fullsized":"2023-12-08T08:16:47.052639+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:04.196403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701275+0000","last_change":"2023-12-08T08:16:29.998148+0000","last_active":"2023-12-08T08:16:45.701275+0000","last_peered":"2023-12-08T08:16:45.701275+0000","last_clean":"2023-12-08T08:16:45.701275+0000","last_became_active":"2023-12-08T08:16:29.997889+0000","last_became_peered":"2023-12-08T08:16:29.997889+0000","last_unstale":"2023-12-08T08:16:45.701275+0000","last_undegraded":"2023-12-08T08:16:45.701275+0000","last_fullsized":"2023-12-08T08:16:45.701275+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:46:08.176075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.681311+0000","last_change":"2023-12-08T08:16:28.965346+0000","last_active":"2023-12-08T08:16:45.681311+0000","last_peered":"2023-12-08T08:16:45.681311+0000","last_clean":"2023-12-08T08:16:45.681311+0000","last_became_active":"2023-12-08T08:16:28.965039+0000","last_became_peered":"2023-12-08T08:16:28.965039+0000","last_unstale":"2023-12-08T08:16:45.681311+0000","last_undegraded":"2023-12-08T08:16:45.681311+0000","last_fullsized":"2023-12-08T08:16:45.681311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:36:27.005922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060058+0000","last_change":"2023-12-08T08:16:45.719099+0000","last_active":"2023-12-08T08:16:47.060058+0000","last_peered":"2023-12-08T08:16:47.060058+0000","last_clean":"2023-12-08T08:16:47.060058+0000","last_became_active":"2023-12-08T08:16:45.718014+0000","last_became_peered":"2023-12-08T08:16:45.718014+0000","last_unstale":"2023-12-08T08:16:47.060058+0000","last_undegraded":"2023-12-08T08:16:47.060058+0000","last_fullsized":"2023-12-08T08:16:47.060058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:20:05.209548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831967+0000","last_change":"2023-12-08T08:16:45.108506+0000","last_active":"2023-12-08T08:16:46.831967+0000","last_peered":"2023-12-08T08:16:46.831967+0000","last_clean":"2023-12-08T08:16:46.831967+0000","last_became_active":"2023-12-08T08:16:45.108113+0000","last_became_peered":"2023-12-08T08:16:45.108113+0000","last_unstale":"2023-12-08T08:16:46.831967+0000","last_undegraded":"2023-12-08T08:16:46.831967+0000","last_fullsized":"2023-12-08T08:16:46.831967+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:28.909613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.707522+0000","last_change":"2023-12-08T08:16:30.004598+0000","last_active":"2023-12-08T08:16:45.707522+0000","last_peered":"2023-12-08T08:16:45.707522+0000","last_clean":"2023-12-08T08:16:45.707522+0000","last_became_active":"2023-12-08T08:16:30.004063+0000","last_became_peered":"2023-12-08T08:16:30.004063+0000","last_unstale":"2023-12-08T08:16:45.707522+0000","last_undegraded":"2023-12-08T08:16:45.707522+0000","last_fullsized":"2023-12-08T08:16:45.707522+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686525+0000","last_change":"2023-12-08T08:16:28.978542+0000","last_active":"2023-12-08T08:16:45.686525+0000","last_peered":"2023-12-08T08:16:45.686525+0000","last_clean":"2023-12-08T08:16:45.686525+0000","last_became_active":"2023-12-08T08:16:28.977515+0000","last_became_peered":"2023-12-08T08:16:28.977515+0000","last_unstale":"2023-12-08T08:16:45.686525+0000","last_undegraded":"2023-12-08T08:16:45.686525+0000","last_fullsized":"2023-12-08T08:16:45.686525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:17.021805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832505+0000","last_change":"2023-12-08T08:16:45.698391+0000","last_active":"2023-12-08T08:16:46.832505+0000","last_peered":"2023-12-08T08:16:46.832505+0000","last_clean":"2023-12-08T08:16:46.832505+0000","last_became_active":"2023-12-08T08:16:45.697851+0000","last_became_peered":"2023-12-08T08:16:45.697851+0000","last_unstale":"2023-12-08T08:16:46.832505+0000","last_undegraded":"2023-12-08T08:16:46.832505+0000","last_fullsized":"2023-12-08T08:16:46.832505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:08:43.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053870+0000","last_change":"2023-12-08T08:16:45.106145+0000","last_active":"2023-12-08T08:16:47.053870+0000","last_peered":"2023-12-08T08:16:47.053870+0000","last_clean":"2023-12-08T08:16:47.053870+0000","last_became_active":"2023-12-08T08:16:45.105863+0000","last_became_peered":"2023-12-08T08:16:45.105863+0000","last_unstale":"2023-12-08T08:16:47.053870+0000","last_undegraded":"2023-12-08T08:16:47.053870+0000","last_fullsized":"2023-12-08T08:16:47.053870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:25.955858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.703038+0000","last_change":"2023-12-08T08:16:29.999746+0000","last_active":"2023-12-08T08:16:45.703038+0000","last_peered":"2023-12-08T08:16:45.703038+0000","last_clean":"2023-12-08T08:16:45.703038+0000","last_became_active":"2023-12-08T08:16:29.999490+0000","last_became_peered":"2023-12-08T08:16:29.999490+0000","last_unstale":"2023-12-08T08:16:45.703038+0000","last_undegraded":"2023-12-08T08:16:45.703038+0000","last_fullsized":"2023-12-08T08:16:45.703038+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711492+0000","last_change":"2023-12-08T08:16:28.980456+0000","last_active":"2023-12-08T08:16:45.711492+0000","last_peered":"2023-12-08T08:16:45.711492+0000","last_clean":"2023-12-08T08:16:45.711492+0000","last_became_active":"2023-12-08T08:16:28.980144+0000","last_became_peered":"2023-12-08T08:16:28.980144+0000","last_unstale":"2023-12-08T08:16:45.711492+0000","last_undegraded":"2023-12-08T08:16:45.711492+0000","last_fullsized":"2023-12-08T08:16:45.711492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686600+0000","last_change":"2023-12-08T08:16:45.703220+0000","last_active":"2023-12-08T08:16:46.686600+0000","last_peered":"2023-12-08T08:16:46.686600+0000","last_clean":"2023-12-08T08:16:46.686600+0000","last_became_active":"2023-12-08T08:16:45.702653+0000","last_became_peered":"2023-12-08T08:16:45.702653+0000","last_unstale":"2023-12-08T08:16:46.686600+0000","last_undegraded":"2023-12-08T08:16:46.686600+0000","last_fullsized":"2023-12-08T08:16:46.686600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:35.927659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.057172+0000","last_change":"2023-12-08T08:16:45.109165+0000","last_active":"2023-12-08T08:16:47.057172+0000","last_peered":"2023-12-08T08:16:47.057172+0000","last_clean":"2023-12-08T08:16:47.057172+0000","last_became_active":"2023-12-08T08:16:45.108823+0000","last_became_peered":"2023-12-08T08:16:45.108823+0000","last_unstale":"2023-12-08T08:16:47.057172+0000","last_undegraded":"2023-12-08T08:16:47.057172+0000","last_fullsized":"2023-12-08T08:16:47.057172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:04.323615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.700439+0000","last_change":"2023-12-08T08:16:29.997495+0000","last_active":"2023-12-08T08:16:45.700439+0000","last_peered":"2023-12-08T08:16:45.700439+0000","last_clean":"2023-12-08T08:16:45.700439+0000","last_became_active":"2023-12-08T08:16:29.997224+0000","last_became_peered":"2023-12-08T08:16:29.997224+0000","last_unstale":"2023-12-08T08:16:45.700439+0000","last_undegraded":"2023-12-08T08:16:45.700439+0000","last_fullsized":"2023-12-08T08:16:45.700439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:10.838748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698920+0000","last_change":"2023-12-08T08:16:28.975373+0000","last_active":"2023-12-08T08:16:45.698920+0000","last_peered":"2023-12-08T08:16:45.698920+0000","last_clean":"2023-12-08T08:16:45.698920+0000","last_became_active":"2023-12-08T08:16:28.974985+0000","last_became_peered":"2023-12-08T08:16:28.974985+0000","last_unstale":"2023-12-08T08:16:45.698920+0000","last_undegraded":"2023-12-08T08:16:45.698920+0000","last_fullsized":"2023-12-08T08:16:45.698920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:48.594984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053333+0000","last_change":"2023-12-08T08:16:45.704122+0000","last_active":"2023-12-08T08:16:47.053333+0000","last_peered":"2023-12-08T08:16:47.053333+0000","last_clean":"2023-12-08T08:16:47.053333+0000","last_became_active":"2023-12-08T08:16:45.703859+0000","last_became_peered":"2023-12-08T08:16:45.703859+0000","last_unstale":"2023-12-08T08:16:47.053333+0000","last_undegraded":"2023-12-08T08:16:47.053333+0000","last_fullsized":"2023-12-08T08:16:47.053333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:40:33.431520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.056143+0000","last_change":"2023-12-08T08:16:45.108912+0000","last_active":"2023-12-08T08:16:47.056143+0000","last_peered":"2023-12-08T08:16:47.056143+0000","last_clean":"2023-12-08T08:16:47.056143+0000","last_became_active":"2023-12-08T08:16:45.108571+0000","last_became_peered":"2023-12-08T08:16:45.108571+0000","last_unstale":"2023-12-08T08:16:47.056143+0000","last_undegraded":"2023-12-08T08:16:47.056143+0000","last_fullsized":"2023-12-08T08:16:47.056143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:50.175293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695281+0000","last_change":"2023-12-08T08:16:30.002534+0000","last_active":"2023-12-08T08:16:45.695281+0000","last_peered":"2023-12-08T08:16:45.695281+0000","last_clean":"2023-12-08T08:16:45.695281+0000","last_became_active":"2023-12-08T08:16:30.001495+0000","last_became_peered":"2023-12-08T08:16:30.001495+0000","last_unstale":"2023-12-08T08:16:45.695281+0000","last_undegraded":"2023-12-08T08:16:45.695281+0000","last_fullsized":"2023-12-08T08:16:45.695281+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:52.176838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680083+0000","last_change":"2023-12-08T08:16:28.978336+0000","last_active":"2023-12-08T08:16:45.680083+0000","last_peered":"2023-12-08T08:16:45.680083+0000","last_clean":"2023-12-08T08:16:45.680083+0000","last_became_active":"2023-12-08T08:16:28.977153+0000","last_became_peered":"2023-12-08T08:16:28.977153+0000","last_unstale":"2023-12-08T08:16:45.680083+0000","last_undegraded":"2023-12-08T08:16:45.680083+0000","last_fullsized":"2023-12-08T08:16:45.680083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:23.220652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052517+0000","last_change":"2023-12-08T08:16:45.706774+0000","last_active":"2023-12-08T08:16:47.052517+0000","last_peered":"2023-12-08T08:16:47.052517+0000","last_clean":"2023-12-08T08:16:47.052517+0000","last_became_active":"2023-12-08T08:16:45.706491+0000","last_became_peered":"2023-12-08T08:16:45.706491+0000","last_unstale":"2023-12-08T08:16:47.052517+0000","last_undegraded":"2023-12-08T08:16:47.052517+0000","last_fullsized":"2023-12-08T08:16:47.052517+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:33:52.646667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"43'1","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832558+0000","last_change":"2023-12-08T08:16:45.096437+0000","last_active":"2023-12-08T08:16:46.832558+0000","last_peered":"2023-12-08T08:16:46.832558+0000","last_clean":"2023-12-08T08:16:46.832558+0000","last_became_active":"2023-12-08T08:16:45.095975+0000","last_became_peered":"2023-12-08T08:16:45.095975+0000","last_unstale":"2023-12-08T08:16:46.832558+0000","last_undegraded":"2023-12-08T08:16:46.832558+0000","last_fullsized":"2023-12-08T08:16:46.832558+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:00.764340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679566+0000","last_change":"2023-12-08T08:16:30.003307+0000","last_active":"2023-12-08T08:16:45.679566+0000","last_peered":"2023-12-08T08:16:45.679566+0000","last_clean":"2023-12-08T08:16:45.679566+0000","last_became_active":"2023-12-08T08:16:30.002242+0000","last_became_peered":"2023-12-08T08:16:30.002242+0000","last_unstale":"2023-12-08T08:16:45.679566+0000","last_undegraded":"2023-12-08T08:16:45.679566+0000","last_fullsized":"2023-12-08T08:16:45.679566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:31.566438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696315+0000","last_change":"2023-12-08T08:16:28.971697+0000","last_active":"2023-12-08T08:16:45.696315+0000","last_peered":"2023-12-08T08:16:45.696315+0000","last_clean":"2023-12-08T08:16:45.696315+0000","last_became_active":"2023-12-08T08:16:28.971403+0000","last_became_peered":"2023-12-08T08:16:28.971403+0000","last_unstale":"2023-12-08T08:16:45.696315+0000","last_undegraded":"2023-12-08T08:16:45.696315+0000","last_fullsized":"2023-12-08T08:16:45.696315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:55:26.868497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.051794+0000","last_change":"2023-12-08T08:16:45.706728+0000","last_active":"2023-12-08T08:16:47.051794+0000","last_peered":"2023-12-08T08:16:47.051794+0000","last_clean":"2023-12-08T08:16:47.051794+0000","last_became_active":"2023-12-08T08:16:45.704612+0000","last_became_peered":"2023-12-08T08:16:45.704612+0000","last_unstale":"2023-12-08T08:16:47.051794+0000","last_undegraded":"2023-12-08T08:16:47.051794+0000","last_fullsized":"2023-12-08T08:16:47.051794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:34:38.863172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.684349+0000","last_change":"2023-12-08T08:16:45.104393+0000","last_active":"2023-12-08T08:16:46.684349+0000","last_peered":"2023-12-08T08:16:46.684349+0000","last_clean":"2023-12-08T08:16:46.684349+0000","last_became_active":"2023-12-08T08:16:45.104114+0000","last_became_peered":"2023-12-08T08:16:45.104114+0000","last_unstale":"2023-12-08T08:16:46.684349+0000","last_undegraded":"2023-12-08T08:16:46.684349+0000","last_fullsized":"2023-12-08T08:16:46.684349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:28:45.006852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693910+0000","last_change":"2023-12-08T08:16:30.004120+0000","last_active":"2023-12-08T08:16:45.693910+0000","last_peered":"2023-12-08T08:16:45.693910+0000","last_clean":"2023-12-08T08:16:45.693910+0000","last_became_active":"2023-12-08T08:16:30.003839+0000","last_became_peered":"2023-12-08T08:16:30.003839+0000","last_unstale":"2023-12-08T08:16:45.693910+0000","last_undegraded":"2023-12-08T08:16:45.693910+0000","last_fullsized":"2023-12-08T08:16:45.693910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:24:40.270711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675305+0000","last_change":"2023-12-08T08:16:28.972924+0000","last_active":"2023-12-08T08:16:45.675305+0000","last_peered":"2023-12-08T08:16:45.675305+0000","last_clean":"2023-12-08T08:16:45.675305+0000","last_became_active":"2023-12-08T08:16:28.971768+0000","last_became_peered":"2023-12-08T08:16:28.971768+0000","last_unstale":"2023-12-08T08:16:45.675305+0000","last_undegraded":"2023-12-08T08:16:45.675305+0000","last_fullsized":"2023-12-08T08:16:45.675305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:17.012974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832677+0000","last_change":"2023-12-08T08:16:45.702984+0000","last_active":"2023-12-08T08:16:46.832677+0000","last_peered":"2023-12-08T08:16:46.832677+0000","last_clean":"2023-12-08T08:16:46.832677+0000","last_became_active":"2023-12-08T08:16:45.702646+0000","last_became_peered":"2023-12-08T08:16:45.702646+0000","last_unstale":"2023-12-08T08:16:46.832677+0000","last_undegraded":"2023-12-08T08:16:46.832677+0000","last_fullsized":"2023-12-08T08:16:46.832677+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:00:51.565202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.831546+0000","last_change":"2023-12-08T08:16:45.100716+0000","last_active":"2023-12-08T08:16:46.831546+0000","last_peered":"2023-12-08T08:16:46.831546+0000","last_clean":"2023-12-08T08:16:46.831546+0000","last_became_active":"2023-12-08T08:16:45.100426+0000","last_became_peered":"2023-12-08T08:16:45.100426+0000","last_unstale":"2023-12-08T08:16:46.831546+0000","last_undegraded":"2023-12-08T08:16:46.831546+0000","last_fullsized":"2023-12-08T08:16:46.831546+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:18.853813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711587+0000","last_change":"2023-12-08T08:16:30.008721+0000","last_active":"2023-12-08T08:16:45.711587+0000","last_peered":"2023-12-08T08:16:45.711587+0000","last_clean":"2023-12-08T08:16:45.711587+0000","last_became_active":"2023-12-08T08:16:30.007946+0000","last_became_peered":"2023-12-08T08:16:30.007946+0000","last_unstale":"2023-12-08T08:16:45.711587+0000","last_undegraded":"2023-12-08T08:16:45.711587+0000","last_fullsized":"2023-12-08T08:16:45.711587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.692363+0000","last_change":"2023-12-08T08:16:28.964831+0000","last_active":"2023-12-08T08:16:45.692363+0000","last_peered":"2023-12-08T08:16:45.692363+0000","last_clean":"2023-12-08T08:16:45.692363+0000","last_became_active":"2023-12-08T08:16:28.964526+0000","last_became_peered":"2023-12-08T08:16:28.964526+0000","last_unstale":"2023-12-08T08:16:45.692363+0000","last_undegraded":"2023-12-08T08:16:45.692363+0000","last_fullsized":"2023-12-08T08:16:45.692363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:28.711499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053157+0000","last_change":"2023-12-08T08:16:45.712579+0000","last_active":"2023-12-08T08:16:47.053157+0000","last_peered":"2023-12-08T08:16:47.053157+0000","last_clean":"2023-12-08T08:16:47.053157+0000","last_became_active":"2023-12-08T08:16:45.712241+0000","last_became_peered":"2023-12-08T08:16:45.712241+0000","last_unstale":"2023-12-08T08:16:47.053157+0000","last_undegraded":"2023-12-08T08:16:47.053157+0000","last_fullsized":"2023-12-08T08:16:47.053157+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:19:01.547108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.683450+0000","last_change":"2023-12-08T08:16:45.102474+0000","last_active":"2023-12-08T08:16:46.683450+0000","last_peered":"2023-12-08T08:16:46.683450+0000","last_clean":"2023-12-08T08:16:46.683450+0000","last_became_active":"2023-12-08T08:16:45.102119+0000","last_became_peered":"2023-12-08T08:16:45.102119+0000","last_unstale":"2023-12-08T08:16:46.683450+0000","last_undegraded":"2023-12-08T08:16:46.683450+0000","last_fullsized":"2023-12-08T08:16:46.683450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:39.350930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699516+0000","last_change":"2023-12-08T08:16:30.007994+0000","last_active":"2023-12-08T08:16:45.699516+0000","last_peered":"2023-12-08T08:16:45.699516+0000","last_clean":"2023-12-08T08:16:45.699516+0000","last_became_active":"2023-12-08T08:16:30.006242+0000","last_became_peered":"2023-12-08T08:16:30.006242+0000","last_unstale":"2023-12-08T08:16:45.699516+0000","last_undegraded":"2023-12-08T08:16:45.699516+0000","last_fullsized":"2023-12-08T08:16:45.699516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:31.687770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693701+0000","last_change":"2023-12-08T08:16:28.967837+0000","last_active":"2023-12-08T08:16:45.693701+0000","last_peered":"2023-12-08T08:16:45.693701+0000","last_clean":"2023-12-08T08:16:45.693701+0000","last_became_active":"2023-12-08T08:16:28.967450+0000","last_became_peered":"2023-12-08T08:16:28.967450+0000","last_unstale":"2023-12-08T08:16:45.693701+0000","last_undegraded":"2023-12-08T08:16:45.693701+0000","last_fullsized":"2023-12-08T08:16:45.693701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:00.811457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060398+0000","last_change":"2023-12-08T08:16:45.714822+0000","last_active":"2023-12-08T08:16:47.060398+0000","last_peered":"2023-12-08T08:16:47.060398+0000","last_clean":"2023-12-08T08:16:47.060398+0000","last_became_active":"2023-12-08T08:16:45.713684+0000","last_became_peered":"2023-12-08T08:16:45.713684+0000","last_unstale":"2023-12-08T08:16:47.060398+0000","last_undegraded":"2023-12-08T08:16:47.060398+0000","last_fullsized":"2023-12-08T08:16:47.060398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:46.529491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052577+0000","last_change":"2023-12-08T08:16:45.106011+0000","last_active":"2023-12-08T08:16:47.052577+0000","last_peered":"2023-12-08T08:16:47.052577+0000","last_clean":"2023-12-08T08:16:47.052577+0000","last_became_active":"2023-12-08T08:16:45.105691+0000","last_became_peered":"2023-12-08T08:16:45.105691+0000","last_unstale":"2023-12-08T08:16:47.052577+0000","last_undegraded":"2023-12-08T08:16:47.052577+0000","last_fullsized":"2023-12-08T08:16:47.052577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:07:36.414053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.696688+0000","last_change":"2023-12-08T08:16:29.994820+0000","last_active":"2023-12-08T08:16:45.696688+0000","last_peered":"2023-12-08T08:16:45.696688+0000","last_clean":"2023-12-08T08:16:45.696688+0000","last_became_active":"2023-12-08T08:16:29.994544+0000","last_became_peered":"2023-12-08T08:16:29.994544+0000","last_unstale":"2023-12-08T08:16:45.696688+0000","last_undegraded":"2023-12-08T08:16:45.696688+0000","last_fullsized":"2023-12-08T08:16:45.696688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:37:35.058184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708166+0000","last_change":"2023-12-08T08:16:28.974660+0000","last_active":"2023-12-08T08:16:45.708166+0000","last_peered":"2023-12-08T08:16:45.708166+0000","last_clean":"2023-12-08T08:16:45.708166+0000","last_became_active":"2023-12-08T08:16:28.974336+0000","last_became_peered":"2023-12-08T08:16:28.974336+0000","last_unstale":"2023-12-08T08:16:45.708166+0000","last_undegraded":"2023-12-08T08:16:45.708166+0000","last_fullsized":"2023-12-08T08:16:45.708166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054341+0000","last_change":"2023-12-08T08:16:45.701665+0000","last_active":"2023-12-08T08:16:47.054341+0000","last_peered":"2023-12-08T08:16:47.054341+0000","last_clean":"2023-12-08T08:16:47.054341+0000","last_became_active":"2023-12-08T08:16:45.701366+0000","last_became_peered":"2023-12-08T08:16:45.701366+0000","last_unstale":"2023-12-08T08:16:47.054341+0000","last_undegraded":"2023-12-08T08:16:47.054341+0000","last_fullsized":"2023-12-08T08:16:47.054341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:32.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053147+0000","last_change":"2023-12-08T08:16:45.102325+0000","last_active":"2023-12-08T08:16:47.053147+0000","last_peered":"2023-12-08T08:16:47.053147+0000","last_clean":"2023-12-08T08:16:47.053147+0000","last_became_active":"2023-12-08T08:16:45.099815+0000","last_became_peered":"2023-12-08T08:16:45.099815+0000","last_unstale":"2023-12-08T08:16:47.053147+0000","last_undegraded":"2023-12-08T08:16:47.053147+0000","last_fullsized":"2023-12-08T08:16:47.053147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:45.516346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.702934+0000","last_change":"2023-12-08T08:16:30.000662+0000","last_active":"2023-12-08T08:16:45.702934+0000","last_peered":"2023-12-08T08:16:45.702934+0000","last_clean":"2023-12-08T08:16:45.702934+0000","last_became_active":"2023-12-08T08:16:30.000315+0000","last_became_peered":"2023-12-08T08:16:30.000315+0000","last_unstale":"2023-12-08T08:16:45.702934+0000","last_undegraded":"2023-12-08T08:16:45.702934+0000","last_fullsized":"2023-12-08T08:16:45.702934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:23.715715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693301+0000","last_change":"2023-12-08T08:16:28.965034+0000","last_active":"2023-12-08T08:16:45.693301+0000","last_peered":"2023-12-08T08:16:45.693301+0000","last_clean":"2023-12-08T08:16:45.693301+0000","last_became_active":"2023-12-08T08:16:28.964719+0000","last_became_peered":"2023-12-08T08:16:28.964719+0000","last_unstale":"2023-12-08T08:16:45.693301+0000","last_undegraded":"2023-12-08T08:16:45.693301+0000","last_fullsized":"2023-12-08T08:16:45.693301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:49.109342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.052477+0000","last_change":"2023-12-08T08:16:45.701885+0000","last_active":"2023-12-08T08:16:47.052477+0000","last_peered":"2023-12-08T08:16:47.052477+0000","last_clean":"2023-12-08T08:16:47.052477+0000","last_became_active":"2023-12-08T08:16:45.701519+0000","last_became_peered":"2023-12-08T08:16:45.701519+0000","last_unstale":"2023-12-08T08:16:47.052477+0000","last_undegraded":"2023-12-08T08:16:47.052477+0000","last_fullsized":"2023-12-08T08:16:47.052477+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:21:38.358024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058147+0000","last_change":"2023-12-08T08:16:45.101482+0000","last_active":"2023-12-08T08:16:47.058147+0000","last_peered":"2023-12-08T08:16:47.058147+0000","last_clean":"2023-12-08T08:16:47.058147+0000","last_became_active":"2023-12-08T08:16:45.101177+0000","last_became_peered":"2023-12-08T08:16:45.101177+0000","last_unstale":"2023-12-08T08:16:47.058147+0000","last_undegraded":"2023-12-08T08:16:47.058147+0000","last_fullsized":"2023-12-08T08:16:47.058147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:20.563413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675048+0000","last_change":"2023-12-08T08:16:30.019492+0000","last_active":"2023-12-08T08:16:45.675048+0000","last_peered":"2023-12-08T08:16:45.675048+0000","last_clean":"2023-12-08T08:16:45.675048+0000","last_became_active":"2023-12-08T08:16:30.019182+0000","last_became_peered":"2023-12-08T08:16:30.019182+0000","last_unstale":"2023-12-08T08:16:45.675048+0000","last_undegraded":"2023-12-08T08:16:45.675048+0000","last_fullsized":"2023-12-08T08:16:45.675048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:32:53.506356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699089+0000","last_change":"2023-12-08T08:16:28.975323+0000","last_active":"2023-12-08T08:16:45.699089+0000","last_peered":"2023-12-08T08:16:45.699089+0000","last_clean":"2023-12-08T08:16:45.699089+0000","last_became_active":"2023-12-08T08:16:28.974944+0000","last_became_peered":"2023-12-08T08:16:28.974944+0000","last_unstale":"2023-12-08T08:16:45.699089+0000","last_undegraded":"2023-12-08T08:16:45.699089+0000","last_fullsized":"2023-12-08T08:16:45.699089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:55.343899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053402+0000","last_change":"2023-12-08T08:16:45.709696+0000","last_active":"2023-12-08T08:16:47.053402+0000","last_peered":"2023-12-08T08:16:47.053402+0000","last_clean":"2023-12-08T08:16:47.053402+0000","last_became_active":"2023-12-08T08:16:45.709388+0000","last_became_peered":"2023-12-08T08:16:45.709388+0000","last_unstale":"2023-12-08T08:16:47.053402+0000","last_undegraded":"2023-12-08T08:16:47.053402+0000","last_fullsized":"2023-12-08T08:16:47.053402+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:28.193366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832034+0000","last_change":"2023-12-08T08:16:45.102562+0000","last_active":"2023-12-08T08:16:46.832034+0000","last_peered":"2023-12-08T08:16:46.832034+0000","last_clean":"2023-12-08T08:16:46.832034+0000","last_became_active":"2023-12-08T08:16:45.102264+0000","last_became_peered":"2023-12-08T08:16:45.102264+0000","last_unstale":"2023-12-08T08:16:46.832034+0000","last_undegraded":"2023-12-08T08:16:46.832034+0000","last_fullsized":"2023-12-08T08:16:46.832034+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:57.519704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.712901+0000","last_change":"2023-12-08T08:16:30.016409+0000","last_active":"2023-12-08T08:16:45.712901+0000","last_peered":"2023-12-08T08:16:45.712901+0000","last_clean":"2023-12-08T08:16:45.712901+0000","last_became_active":"2023-12-08T08:16:30.016111+0000","last_became_peered":"2023-12-08T08:16:30.016111+0000","last_unstale":"2023-12-08T08:16:45.712901+0000","last_undegraded":"2023-12-08T08:16:45.712901+0000","last_fullsized":"2023-12-08T08:16:45.712901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:48:19.401809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695930+0000","last_change":"2023-12-08T08:16:28.973691+0000","last_active":"2023-12-08T08:16:45.695930+0000","last_peered":"2023-12-08T08:16:45.695930+0000","last_clean":"2023-12-08T08:16:45.695930+0000","last_became_active":"2023-12-08T08:16:28.973374+0000","last_became_peered":"2023-12-08T08:16:28.973374+0000","last_unstale":"2023-12-08T08:16:45.695930+0000","last_undegraded":"2023-12-08T08:16:45.695930+0000","last_fullsized":"2023-12-08T08:16:45.695930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:10:16.503221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.055652+0000","last_change":"2023-12-08T08:16:45.714381+0000","last_active":"2023-12-08T08:16:47.055652+0000","last_peered":"2023-12-08T08:16:47.055652+0000","last_clean":"2023-12-08T08:16:47.055652+0000","last_became_active":"2023-12-08T08:16:45.712158+0000","last_became_peered":"2023-12-08T08:16:45.712158+0000","last_unstale":"2023-12-08T08:16:47.055652+0000","last_undegraded":"2023-12-08T08:16:47.055652+0000","last_fullsized":"2023-12-08T08:16:47.055652+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:00:29.393392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"43'2","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.059028+0000","last_change":"2023-12-08T08:16:45.109726+0000","last_active":"2023-12-08T08:16:47.059028+0000","last_peered":"2023-12-08T08:16:47.059028+0000","last_clean":"2023-12-08T08:16:47.059028+0000","last_became_active":"2023-12-08T08:16:45.109407+0000","last_became_peered":"2023-12-08T08:16:45.109407+0000","last_unstale":"2023-12-08T08:16:47.059028+0000","last_undegraded":"2023-12-08T08:16:47.059028+0000","last_fullsized":"2023-12-08T08:16:47.059028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:40:24.021285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.701285+0000","last_change":"2023-12-08T08:16:30.004996+0000","last_active":"2023-12-08T08:16:45.701285+0000","last_peered":"2023-12-08T08:16:45.701285+0000","last_clean":"2023-12-08T08:16:45.701285+0000","last_became_active":"2023-12-08T08:16:30.004414+0000","last_became_peered":"2023-12-08T08:16:30.004414+0000","last_unstale":"2023-12-08T08:16:45.701285+0000","last_undegraded":"2023-12-08T08:16:45.701285+0000","last_fullsized":"2023-12-08T08:16:45.701285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:23:03.950233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.695621+0000","last_change":"2023-12-08T08:16:28.976308+0000","last_active":"2023-12-08T08:16:45.695621+0000","last_peered":"2023-12-08T08:16:45.695621+0000","last_clean":"2023-12-08T08:16:45.695621+0000","last_became_active":"2023-12-08T08:16:28.974927+0000","last_became_peered":"2023-12-08T08:16:28.974927+0000","last_unstale":"2023-12-08T08:16:45.695621+0000","last_undegraded":"2023-12-08T08:16:45.695621+0000","last_fullsized":"2023-12-08T08:16:45.695621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:50.348749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832429+0000","last_change":"2023-12-08T08:16:45.707958+0000","last_active":"2023-12-08T08:16:46.832429+0000","last_peered":"2023-12-08T08:16:46.832429+0000","last_clean":"2023-12-08T08:16:46.832429+0000","last_became_active":"2023-12-08T08:16:45.706589+0000","last_became_peered":"2023-12-08T08:16:45.706589+0000","last_unstale":"2023-12-08T08:16:46.832429+0000","last_undegraded":"2023-12-08T08:16:46.832429+0000","last_fullsized":"2023-12-08T08:16:46.832429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:57:30.047578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.686398+0000","last_change":"2023-12-08T08:16:45.108291+0000","last_active":"2023-12-08T08:16:46.686398+0000","last_peered":"2023-12-08T08:16:46.686398+0000","last_clean":"2023-12-08T08:16:46.686398+0000","last_became_active":"2023-12-08T08:16:45.107044+0000","last_became_peered":"2023-12-08T08:16:45.107044+0000","last_unstale":"2023-12-08T08:16:46.686398+0000","last_undegraded":"2023-12-08T08:16:46.686398+0000","last_fullsized":"2023-12-08T08:16:46.686398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:25.955858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.693512+0000","last_change":"2023-12-08T08:16:30.013944+0000","last_active":"2023-12-08T08:16:45.693512+0000","last_peered":"2023-12-08T08:16:45.693512+0000","last_clean":"2023-12-08T08:16:45.693512+0000","last_became_active":"2023-12-08T08:16:30.013655+0000","last_became_peered":"2023-12-08T08:16:30.013655+0000","last_unstale":"2023-12-08T08:16:45.693512+0000","last_undegraded":"2023-12-08T08:16:45.693512+0000","last_fullsized":"2023-12-08T08:16:45.693512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:56.357067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698526+0000","last_change":"2023-12-08T08:16:28.977478+0000","last_active":"2023-12-08T08:16:45.698526+0000","last_peered":"2023-12-08T08:16:45.698526+0000","last_clean":"2023-12-08T08:16:45.698526+0000","last_became_active":"2023-12-08T08:16:28.976902+0000","last_became_peered":"2023-12-08T08:16:28.976902+0000","last_unstale":"2023-12-08T08:16:45.698526+0000","last_undegraded":"2023-12-08T08:16:45.698526+0000","last_fullsized":"2023-12-08T08:16:45.698526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:41:35.434761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054496+0000","last_change":"2023-12-08T08:16:45.710538+0000","last_active":"2023-12-08T08:16:47.054496+0000","last_peered":"2023-12-08T08:16:47.054496+0000","last_clean":"2023-12-08T08:16:47.054496+0000","last_became_active":"2023-12-08T08:16:45.710218+0000","last_became_peered":"2023-12-08T08:16:45.710218+0000","last_unstale":"2023-12-08T08:16:47.054496+0000","last_undegraded":"2023-12-08T08:16:47.054496+0000","last_fullsized":"2023-12-08T08:16:47.054496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:57:30.047578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.058999+0000","last_change":"2023-12-08T08:16:45.102325+0000","last_active":"2023-12-08T08:16:47.058999+0000","last_peered":"2023-12-08T08:16:47.058999+0000","last_clean":"2023-12-08T08:16:47.058999+0000","last_became_active":"2023-12-08T08:16:45.102026+0000","last_became_peered":"2023-12-08T08:16:45.102026+0000","last_unstale":"2023-12-08T08:16:47.058999+0000","last_undegraded":"2023-12-08T08:16:47.058999+0000","last_fullsized":"2023-12-08T08:16:47.058999+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:57.519704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.675638+0000","last_change":"2023-12-08T08:16:30.000645+0000","last_active":"2023-12-08T08:16:45.675638+0000","last_peered":"2023-12-08T08:16:45.675638+0000","last_clean":"2023-12-08T08:16:45.675638+0000","last_became_active":"2023-12-08T08:16:30.000349+0000","last_became_peered":"2023-12-08T08:16:30.000349+0000","last_unstale":"2023-12-08T08:16:45.675638+0000","last_undegraded":"2023-12-08T08:16:45.675638+0000","last_fullsized":"2023-12-08T08:16:45.675638+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:07:53.573778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.686417+0000","last_change":"2023-12-08T08:16:28.969401+0000","last_active":"2023-12-08T08:16:45.686417+0000","last_peered":"2023-12-08T08:16:45.686417+0000","last_clean":"2023-12-08T08:16:45.686417+0000","last_became_active":"2023-12-08T08:16:28.968937+0000","last_became_peered":"2023-12-08T08:16:28.968937+0000","last_unstale":"2023-12-08T08:16:45.686417+0000","last_undegraded":"2023-12-08T08:16:45.686417+0000","last_fullsized":"2023-12-08T08:16:45.686417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:39:19.618985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832033+0000","last_change":"2023-12-08T08:16:45.708830+0000","last_active":"2023-12-08T08:16:46.832033+0000","last_peered":"2023-12-08T08:16:46.832033+0000","last_clean":"2023-12-08T08:16:46.832033+0000","last_became_active":"2023-12-08T08:16:45.707429+0000","last_became_peered":"2023-12-08T08:16:45.707429+0000","last_unstale":"2023-12-08T08:16:46.832033+0000","last_undegraded":"2023-12-08T08:16:46.832033+0000","last_fullsized":"2023-12-08T08:16:46.832033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:54:24.919971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054053+0000","last_change":"2023-12-08T08:16:45.095896+0000","last_active":"2023-12-08T08:16:47.054053+0000","last_peered":"2023-12-08T08:16:47.054053+0000","last_clean":"2023-12-08T08:16:47.054053+0000","last_became_active":"2023-12-08T08:16:45.095588+0000","last_became_peered":"2023-12-08T08:16:45.095588+0000","last_unstale":"2023-12-08T08:16:47.054053+0000","last_undegraded":"2023-12-08T08:16:47.054053+0000","last_fullsized":"2023-12-08T08:16:47.054053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:00.764340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.679411+0000","last_change":"2023-12-08T08:16:30.001694+0000","last_active":"2023-12-08T08:16:45.679411+0000","last_peered":"2023-12-08T08:16:45.679411+0000","last_clean":"2023-12-08T08:16:45.679411+0000","last_became_active":"2023-12-08T08:16:30.001411+0000","last_became_peered":"2023-12-08T08:16:30.001411+0000","last_unstale":"2023-12-08T08:16:45.679411+0000","last_undegraded":"2023-12-08T08:16:45.679411+0000","last_fullsized":"2023-12-08T08:16:45.679411+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:58:29.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.680880+0000","last_change":"2023-12-08T08:16:28.964871+0000","last_active":"2023-12-08T08:16:45.680880+0000","last_peered":"2023-12-08T08:16:45.680880+0000","last_clean":"2023-12-08T08:16:45.680880+0000","last_became_active":"2023-12-08T08:16:28.964469+0000","last_became_peered":"2023-12-08T08:16:28.964469+0000","last_unstale":"2023-12-08T08:16:45.680880+0000","last_undegraded":"2023-12-08T08:16:45.680880+0000","last_fullsized":"2023-12-08T08:16:45.680880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:49.019319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.060088+0000","last_change":"2023-12-08T08:16:45.718017+0000","last_active":"2023-12-08T08:16:47.060088+0000","last_peered":"2023-12-08T08:16:47.060088+0000","last_clean":"2023-12-08T08:16:47.060088+0000","last_became_active":"2023-12-08T08:16:45.717716+0000","last_became_peered":"2023-12-08T08:16:45.717716+0000","last_unstale":"2023-12-08T08:16:47.060088+0000","last_undegraded":"2023-12-08T08:16:47.060088+0000","last_fullsized":"2023-12-08T08:16:47.060088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:32:19.866958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.053253+0000","last_change":"2023-12-08T08:16:45.090959+0000","last_active":"2023-12-08T08:16:47.053253+0000","last_peered":"2023-12-08T08:16:47.053253+0000","last_clean":"2023-12-08T08:16:47.053253+0000","last_became_active":"2023-12-08T08:16:45.090690+0000","last_became_peered":"2023-12-08T08:16:45.090690+0000","last_unstale":"2023-12-08T08:16:47.053253+0000","last_undegraded":"2023-12-08T08:16:47.053253+0000","last_fullsized":"2023-12-08T08:16:47.053253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:28.909613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708016+0000","last_change":"2023-12-08T08:16:30.009647+0000","last_active":"2023-12-08T08:16:45.708016+0000","last_peered":"2023-12-08T08:16:45.708016+0000","last_clean":"2023-12-08T08:16:45.708016+0000","last_became_active":"2023-12-08T08:16:30.009174+0000","last_became_peered":"2023-12-08T08:16:30.009174+0000","last_unstale":"2023-12-08T08:16:45.708016+0000","last_undegraded":"2023-12-08T08:16:45.708016+0000","last_fullsized":"2023-12-08T08:16:45.708016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:15:53.641432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.699808+0000","last_change":"2023-12-08T08:16:28.969690+0000","last_active":"2023-12-08T08:16:45.699808+0000","last_peered":"2023-12-08T08:16:45.699808+0000","last_clean":"2023-12-08T08:16:45.699808+0000","last_became_active":"2023-12-08T08:16:28.969355+0000","last_became_peered":"2023-12-08T08:16:28.969355+0000","last_unstale":"2023-12-08T08:16:45.699808+0000","last_undegraded":"2023-12-08T08:16:45.699808+0000","last_fullsized":"2023-12-08T08:16:45.699808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:52.569909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:47.054762+0000","last_change":"2023-12-08T08:16:45.708421+0000","last_active":"2023-12-08T08:16:47.054762+0000","last_peered":"2023-12-08T08:16:47.054762+0000","last_clean":"2023-12-08T08:16:47.054762+0000","last_became_active":"2023-12-08T08:16:45.705931+0000","last_became_peered":"2023-12-08T08:16:45.705931+0000","last_unstale":"2023-12-08T08:16:47.054762+0000","last_undegraded":"2023-12-08T08:16:47.054762+0000","last_fullsized":"2023-12-08T08:16:47.054762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:45.058476+0000","last_clean_scrub_stamp":"2023-12-08T08:16:45.058476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:52.346310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-08T08:16:46.832661+0000","last_change":"2023-12-08T08:16:45.096450+0000","last_active":"2023-12-08T08:16:46.832661+0000","last_peered":"2023-12-08T08:16:46.832661+0000","last_clean":"2023-12-08T08:16:46.832661+0000","last_became_active":"2023-12-08T08:16:45.096105+0000","last_became_peered":"2023-12-08T08:16:45.096105+0000","last_unstale":"2023-12-08T08:16:46.832661+0000","last_undegraded":"2023-12-08T08:16:46.832661+0000","last_fullsized":"2023-12-08T08:16:46.832661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:44.045331+0000","last_clean_scrub_stamp":"2023-12-08T08:16:44.045331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:45.516346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.698757+0000","last_change":"2023-12-08T08:16:30.013379+0000","last_active":"2023-12-08T08:16:45.698757+0000","last_peered":"2023-12-08T08:16:45.698757+0000","last_clean":"2023-12-08T08:16:45.698757+0000","last_became_active":"2023-12-08T08:16:30.013056+0000","last_became_peered":"2023-12-08T08:16:30.013056+0000","last_unstale":"2023-12-08T08:16:45.698757+0000","last_undegraded":"2023-12-08T08:16:45.698757+0000","last_fullsized":"2023-12-08T08:16:45.698757+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:28.928222+0000","last_clean_scrub_stamp":"2023-12-08T08:16:28.928222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:22:49.206505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.708317+0000","last_change":"2023-12-08T08:16:28.977566+0000","last_active":"2023-12-08T08:16:45.708317+0000","last_peered":"2023-12-08T08:16:45.708317+0000","last_clean":"2023-12-08T08:16:45.708317+0000","last_became_active":"2023-12-08T08:16:28.976769+0000","last_became_peered":"2023-12-08T08:16:28.976769+0000","last_unstale":"2023-12-08T08:16:45.708317+0000","last_undegraded":"2023-12-08T08:16:45.708317+0000","last_fullsized":"2023-12-08T08:16:45.708317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:16:27.915054+0000","last_clean_scrub_stamp":"2023-12-08T08:16:27.915054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:30.674602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":185,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-08T08:16:45.711693+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:16:45.711693+0000","last_peered":"2023-12-08T08:16:45.711693+0000","last_clean":"2023-12-08T08:16:45.711693+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:16:45.711693+0000","last_undegraded":"2023-12-08T08:16:45.711693+0000","last_fullsized":"2023-12-08T08:16:45.711693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":812521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.383},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.1140000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.333},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.524,"5min":3.524,"15min":3.524},"last":1.2809999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":3.7869999999999999,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.246},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.427}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.496}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.55},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.581}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":227563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":19.065999999999999,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":19.364999999999998,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.4009999999999998,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.1000000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5369999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.6259999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.2070000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.593}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.51}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":218964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":2.1779999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.4910000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":2.6539999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":2.5569999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.675}]},{"osd":6,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":2.464},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":2.1000000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:15:53 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":2.0459999999999998},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":3.1859999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":227515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.056},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.125}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.1779999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.238}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6519999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.583},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.288}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.752},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.929}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":1.296,"5min":1.296,"15min":1.296},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":1.9850000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":231104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.502},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.087}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.569},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.7949999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.722}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":2.0209999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":1.4399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":2.1930000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.617},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.3039999999999998,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.2330000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":524288,"data_stored":228011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.753}]},{"osd":3,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.873}]},{"osd":5,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.323}]},{"osd":6,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:15:52 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.056}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":226579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.1559999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0880000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.353},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":1.389}]},{"osd":4,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.552,"5min":2.552,"15min":2.552},"last":1.2629999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.603},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.444}]},{"osd":6,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2690000000000001,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":2.1280000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.52}]},{"osd":7,"last update":"Fri Dec 8 08:15:54 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.617,"15min":1.617},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":2.2440000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":816787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.5350000000000001,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.496},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.872},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.9279999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.083},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.5449999999999999,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:15:55 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.6559999999999997,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.84699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:16:51.181 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:16:51.182 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:16:51.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.451+0000 7fe2fb59e640 1 Processor -- start 2023-12-08T08:16:51.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.451+0000 7fe2fb59e640 1 -- start start 2023-12-08T08:16:51.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.453+0000 7fe2fb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2fc151cd0 0x7fe2fc0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.453+0000 7fe2fb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2fc0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.453+0000 7fe2fb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0c6070 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.453+0000 7fe2fb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c4be0 con 0x7fe2fc151cd0 2023-12-08T08:16:51.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.453+0000 7fe2fb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06c930 con 0x7fe2fc154cc0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2fa59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe2fc06b9a0 0x7fe2fc1515c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36852/0 (socket says 172.21.15.45:36852) 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2fa59c640 1 -- 172.21.15.45:0/403483130 learned_addr learned my addr 172.21.15.45:0/403483130 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2f9d9b640 1 --2- 172.21.15.45:0/403483130 >> v2:172.21.15.114:3300/0 conn(0x7fe2fc151cd0 0x7fe2fc0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2fc0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203387788 0 0) 0x7fe2fc0c6070 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.454+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e4003520 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045623496 0 0) 0x7fe2e4003520 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 msgr2=0x7fe2fc0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2fc0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 >> v2:172.21.15.114:3300/0 conn(0x7fe2fc151cd0 msgr2=0x7fe2fc0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 --2- 172.21.15.45:0/403483130 >> v2:172.21.15.114:3300/0 conn(0x7fe2fc151cd0 0x7fe2fc0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc06cbd0 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe2ec001670 con 0x7fe2fc06b9a0 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 >> v1:172.21.15.45:6789/0 conn(0x7fe2fc06b9a0 legacy=0x7fe2fc1515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e4003970 0x7fe2e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e4004d00 0x7fe2e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c4be0 con 0x7fe2e4004d00 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06c930 con 0x7fe2e4003970 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e400b9b0 con 0x7fe2fc154cc0 2023-12-08T08:16:51.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.455+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e4004d00 0x7fe2e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2f9d9b640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fa59c640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e4003970 0x7fe2e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fad9d640 1 -- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 msgr2=0x7fe2e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2fc154cc0 0x7fe2e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fad9d640 1 -- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e4003970 msgr2=0x7fe2e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2e4003970 0x7fe2e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.456+0000 7fe2fad9d640 1 -- 172.21.15.45:0/403483130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4003520 con 0x7fe2e4004d00 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.457+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e4004d00 0x7fe2e4005180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc08bbb0 tx=0x7fe2e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7821382c395ac5d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.457+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f402cb90 con 0x7fe2e4004d00 2023-12-08T08:16:51.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.457+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f400f040 con 0x7fe2e4004d00 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.457+0000 7fe2f959a640 1 -- 172.21.15.45:0/403483130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4034440 con 0x7fe2e4004d00 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 -- 172.21.15.45:0/403483130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e4004d00 msgr2=0x7fe2e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/403483130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e4004d00 0x7fe2e4005180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc08bbb0 tx=0x7fe2e40057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fad9d640 1 -- 172.21.15.45:0/403483130 reap_dead start 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 -- 172.21.15.45:0/403483130 shutdown_connections 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 -- 172.21.15.45:0/403483130 >> 172.21.15.45:0/403483130 conn(0x7fe2fc0ab7e0 msgr2=0x7fe2fc0abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 -- 172.21.15.45:0/403483130 shutdown_connections 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.458+0000 7fe2fb59e640 1 -- 172.21.15.45:0/403483130 wait complete. 2023-12-08T08:16:51.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.460+0000 7fe2fb59e640 1 Processor -- start 2023-12-08T08:16:51.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.460+0000 7fe2fb59e640 1 -- start start 2023-12-08T08:16:51.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e4004d00 0x7fe2fc1ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2fc143980 0x7fe2fc152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc143e30 con 0x7fe2fc0acd50 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0ade70 con 0x7fe2fc143980 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2fb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc1ea920 con 0x7fe2e4004d00 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2f9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2f9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33584/0 (socket says 172.21.15.45:33584) 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.461+0000 7fe2f9d9b640 1 -- 172.21.15.45:0/3529309017 learned_addr learned my addr 172.21.15.45:0/3529309017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2fa59c640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e4004d00 0x7fe2fc1ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2fad9d640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2fc143980 0x7fe2fc152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 -- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e4004d00 msgr2=0x7fe2fc1ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e4004d00 0x7fe2fc1ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 -- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2fc143980 msgr2=0x7fe2fc152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2fc143980 0x7fe2fc152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 -- 172.21.15.45:0/3529309017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0af9f0 con 0x7fe2fc0acd50 2023-12-08T08:16:51.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2f9d9b640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00116d0 tx=0x7fe2f0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:51.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000f960 con 0x7fe2fc0acd50 2023-12-08T08:16:51.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000fac0 con 0x7fe2fc0acd50 2023-12-08T08:16:51.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.462+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000fe30 con 0x7fe2fc0acd50 2023-12-08T08:16:51.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.463+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc0aec90 con 0x7fe2fc0acd50 2023-12-08T08:16:51.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.463+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc0af710 con 0x7fe2fc0acd50 2023-12-08T08:16:51.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.464+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc14eec0 con 0x7fe2fc0acd50 2023-12-08T08:16:51.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.465+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2f0015460 con 0x7fe2fc0acd50 2023-12-08T08:16:51.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.466+0000 7fe2eaffd640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 0x7fe2dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:51.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.466+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe2f0089f40 con 0x7fe2fc0acd50 2023-12-08T08:16:51.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.466+0000 7fe2fa59c640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 0x7fe2dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:51.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.467+0000 7fe2fa59c640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 0x7fe2dc06d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001050 tx=0x7fe2ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:51.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.470+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2f0054bf0 con 0x7fe2fc0acd50 2023-12-08T08:16:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.743+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fe2fc06a700 con 0x7fe2fc0acd50 2023-12-08T08:16:51.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.748+0000 7fe2eaffd640 1 -- 172.21.15.45:0/3529309017 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7fe2f00220e0 con 0x7fe2fc0acd50 2023-12-08T08:16:51.751 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-08T08:16:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA== 2023-12-08T08:16:51.751 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:16:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:16:51.752 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:16:51.752 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.1 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 msgr2=0x7fe2dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 0x7fe2dc06d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001050 tx=0x7fe2ec009040 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 msgr2=0x7fe2fc143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00116d0 tx=0x7fe2f0011b90 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 shutdown_connections 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe2dc06ae70 0x7fe2dc06d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2fc143980 0x7fe2fc152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0acd50 0x7fe2fc143440 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 --2- 172.21.15.45:0/3529309017 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2e4004d00 0x7fe2fc1ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:51.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.751+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 >> 172.21.15.45:0/3529309017 conn(0x7fe2fc0ab7e0 msgr2=0x7fe2fc0abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:51.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.752+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 shutdown_connections 2023-12-08T08:16:51.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:51.752+0000 7fe2fb59e640 1 -- 172.21.15.45:0/3529309017 wait complete. 2023-12-08T08:16:51.775 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:51.775 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:51.834 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:51.834 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:51.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:52.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.113+0000 7fa46c911640 1 Processor -- start 2023-12-08T08:16:52.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.114+0000 7fa46c911640 1 -- start start 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.115+0000 7fa46c911640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4681519c0 0x7fa4681584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.115+0000 7fa46c911640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 0x7fa468154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.115+0000 7fa46c911640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4681553b0 con 0x7fa4680c7a50 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.115+0000 7fa46c911640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680c4a00 con 0x7fa4681519c0 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.115+0000 7fa46c911640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680c4ce0 con 0x7fa4680c44d0 2023-12-08T08:16:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4681519c0 0x7fa4681584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4681519c0 0x7fa4681584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33596/0 (socket says 172.21.15.45:33596) 2023-12-08T08:16:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 -- 172.21.15.45:0/4173879993 learned_addr learned my addr 172.21.15.45:0/4173879993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa45ffff640 1 --2- 172.21.15.45:0/4173879993 >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 0x7fa468154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 -- 172.21.15.45:0/4173879993 >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 msgr2=0x7fa468154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 --2- 172.21.15.45:0/4173879993 >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 0x7fa468154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 -- 172.21.15.45:0/4173879993 >> v1:172.21.15.114:6789/0 conn(0x7fa4680c7a50 legacy=0x7fa4680ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa4677fe640 1 -- 172.21.15.45:0/4173879993 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4681579e0 con 0x7fa4681519c0 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.116+0000 7fa45ffff640 1 --2- 172.21.15.45:0/4173879993 >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 0x7fa468154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.117+0000 7fa4677fe640 1 --2- 172.21.15.45:0/4173879993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4681519c0 0x7fa4681584c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ac250 tx=0x7fa45802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06a479fc1630aef server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa466ffd640 1 -- 172.21.15.45:0/4173879993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458031750 con 0x7fa4681519c0 2023-12-08T08:16:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa466ffd640 1 -- 172.21.15.45:0/4173879993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4580318b0 con 0x7fa4681519c0 2023-12-08T08:16:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa466ffd640 1 -- 172.21.15.45:0/4173879993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458031c40 con 0x7fa4681519c0 2023-12-08T08:16:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 -- 172.21.15.45:0/4173879993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4681519c0 msgr2=0x7fa4681584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 --2- 172.21.15.45:0/4173879993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4681519c0 0x7fa4681584c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa4680ac250 tx=0x7fa45802b7f0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 -- 172.21.15.45:0/4173879993 shutdown_connections 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 --2- 172.21.15.45:0/4173879993 >> v2:172.21.15.114:3300/0 conn(0x7fa4680c44d0 0x7fa468154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 --2- 172.21.15.45:0/4173879993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4681519c0 0x7fa4681584c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.118+0000 7fa46c911640 1 -- 172.21.15.45:0/4173879993 >> 172.21.15.45:0/4173879993 conn(0x7fa4680661f0 msgr2=0x7fa468066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.119+0000 7fa46c911640 1 -- 172.21.15.45:0/4173879993 shutdown_connections 2023-12-08T08:16:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.119+0000 7fa46c911640 1 -- 172.21.15.45:0/4173879993 wait complete. 2023-12-08T08:16:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.120+0000 7fa46c911640 1 Processor -- start 2023-12-08T08:16:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.121+0000 7fa46c911640 1 -- start start 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.121+0000 7fa46c911640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4680c44d0 0x7fa4680ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.121+0000 7fa46c911640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa46c911640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4681519c0 0x7fa4681ee550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa46c911640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680aedf0 con 0x7fa4680c7a50 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa46c911640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680a9d80 con 0x7fa4681519c0 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa46c911640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4681eea90 con 0x7fa4680c44d0 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33604/0 (socket says 172.21.15.45:33604) 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 -- 172.21.15.45:0/1342028628 learned_addr learned my addr 172.21.15.45:0/1342028628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa4677fe640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4680c44d0 0x7fa4680ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa467fff640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4681519c0 0x7fa4681ee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 -- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4680c44d0 msgr2=0x7fa4680ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4680c44d0 0x7fa4680ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 -- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4681519c0 msgr2=0x7fa4681ee550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4681519c0 0x7fa4681ee550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.122+0000 7fa45ffff640 1 -- 172.21.15.45:0/1342028628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580094d0 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa45ffff640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa45000c850 tx=0x7fa45000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450007a30 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450007b90 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000cea0 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680ab750 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.123+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4680a9730 con 0x7fa4680c7a50 2023-12-08T08:16:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.124+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46806c860 con 0x7fa4680c7a50 2023-12-08T08:16:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.125+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4500113f0 con 0x7fa4680c7a50 2023-12-08T08:16:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.127+0000 7fa464ff9640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 0x7fa44806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.127+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa450089c50 con 0x7fa4680c7a50 2023-12-08T08:16:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.127+0000 7fa4677fe640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 0x7fa44806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.128+0000 7fa4677fe640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 0x7fa44806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa458035000 tx=0x7fa458008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.132+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa450054850 con 0x7fa4680c7a50 2023-12-08T08:16:52.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.328+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46814f510 con 0x7fa4680c7a50 2023-12-08T08:16:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.330+0000 7fa464ff9640 1 -- 172.21.15.45:0/1342028628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7fa45001f090 con 0x7fa4680c7a50 2023-12-08T08:16:52.334 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:52.334 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 msgr2=0x7fa44806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 0x7fa44806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa458035000 tx=0x7fa458008030 comp rx=0 tx=0).stop 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 msgr2=0x7fa4680aa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa45000c850 tx=0x7fa45000cc50 comp rx=0 tx=0).stop 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 shutdown_connections 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa44806ae40 0x7fa44806d300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4681519c0 0x7fa4681ee550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4680c7a50 0x7fa4680aa210 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 --2- 172.21.15.45:0/1342028628 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4680c44d0 0x7fa4680ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 >> 172.21.15.45:0/1342028628 conn(0x7fa4680661f0 msgr2=0x7fa46814f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 shutdown_connections 2023-12-08T08:16:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.334+0000 7fa46c911640 1 -- 172.21.15.45:0/1342028628 wait complete. 2023-12-08T08:16:52.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:16:27.503085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:16:28.455815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:16:43.271897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:16:44.566832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:16:52.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.590+0000 7f71e050f640 1 Processor -- start 2023-12-08T08:16:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.590+0000 7f71e050f640 1 -- start start 2023-12-08T08:16:52.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.591+0000 7f71e050f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71d8151c20 0x7f71d80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71e050f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d81589d0 con 0x7f71d80c81d0 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71e050f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d80c71b0 con 0x7f71d80c4e20 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71e050f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d8157dc0 con 0x7f71d8151c20 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71ddaaa640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71d80c81d0 0x7f71d80c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36854/0 (socket says 172.21.15.45:36854) 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71ddaaa640 1 -- 172.21.15.45:0/1437402246 learned_addr learned my addr 172.21.15.45:0/1437402246 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:52.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.592+0000 7f71de2ab640 1 --2- 172.21.15.45:0/1437402246 >> v2:172.21.15.45:3300/0 conn(0x7f71d8151c20 0x7f71d80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.593+0000 7f71dd2a9640 1 -- 172.21.15.45:0/1437402246 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524108517 0 0) 0x7f71d81589d0 con 0x7f71d80c81d0 2023-12-08T08:16:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.593+0000 7f71dd2a9640 1 -- 172.21.15.45:0/1437402246 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c4003520 con 0x7f71d80c81d0 2023-12-08T08:16:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.593+0000 7f71de2ab640 1 -- 172.21.15.45:0/1437402246 >> v1:172.21.15.114:6789/0 conn(0x7f71d80c4e20 legacy=0x7f71d8154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.593+0000 7f71de2ab640 1 -- 172.21.15.45:0/1437402246 >> v1:172.21.15.45:6789/0 conn(0x7f71d80c81d0 legacy=0x7f71d80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.593+0000 7f71de2ab640 1 -- 172.21.15.45:0/1437402246 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d81580a0 con 0x7f71d8151c20 2023-12-08T08:16:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.594+0000 7f71de2ab640 1 --2- 172.21.15.45:0/1437402246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d8151c20 0x7f71d80c7c90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097a0 tx=0x7f71d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca68172bc6005c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.594+0000 7f71dd2a9640 1 -- 172.21.15.45:0/1437402246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4031830 con 0x7f71d8151c20 2023-12-08T08:16:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.594+0000 7f71dd2a9640 1 -- 172.21.15.45:0/1437402246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4031990 con 0x7f71d8151c20 2023-12-08T08:16:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.594+0000 7f71dd2a9640 1 -- 172.21.15.45:0/1437402246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4031d20 con 0x7f71d8151c20 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 -- 172.21.15.45:0/1437402246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d8151c20 msgr2=0x7f71d80c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 --2- 172.21.15.45:0/1437402246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d8151c20 0x7f71d80c7c90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097a0 tx=0x7f71d402b8d0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 -- 172.21.15.45:0/1437402246 shutdown_connections 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 --2- 172.21.15.45:0/1437402246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d8151c20 0x7f71d80c7c90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 -- 172.21.15.45:0/1437402246 >> 172.21.15.45:0/1437402246 conn(0x7f71d80ab920 msgr2=0x7f71d80abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 -- 172.21.15.45:0/1437402246 shutdown_connections 2023-12-08T08:16:52.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.595+0000 7f71e050f640 1 -- 172.21.15.45:0/1437402246 wait complete. 2023-12-08T08:16:52.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.597+0000 7f71e050f640 1 Processor -- start 2023-12-08T08:16:52.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.597+0000 7f71e050f640 1 -- start start 2023-12-08T08:16:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71d80c4e20 0x7f71d8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 0x7f71d80aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80aca10 con 0x7f71d80c81d0 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8154ed0 con 0x7f71d80c4e20 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71e050f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80ae740 con 0x7f71d8151c20 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71ddaaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71ddaaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33620/0 (socket says 172.21.15.45:33620) 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.598+0000 7f71ddaaa640 1 -- 172.21.15.45:0/4130592798 learned_addr learned my addr 172.21.15.45:0/4130592798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71de2ab640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71d80c4e20 0x7f71d8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71deaac640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 0x7f71d80aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 -- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 msgr2=0x7f71d80aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 0x7f71d80aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 -- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71d80c4e20 msgr2=0x7f71d8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71d80c4e20 0x7f71d8152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 -- 172.21.15.45:0/4130592798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009400 con 0x7f71d80c81d0 2023-12-08T08:16:52.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71deaac640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 0x7f71d80aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ddaaa640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c500 tx=0x7f71c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8005ce0 con 0x7f71d80c81d0 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8005e40 con 0x7f71d80c81d0 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8007330 con 0x7f71d80c81d0 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.599+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d8154ab0 con 0x7f71d80c81d0 2023-12-08T08:16:52.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.600+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d8155100 con 0x7f71d80c81d0 2023-12-08T08:16:52.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.601+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80ae880 con 0x7f71d80c81d0 2023-12-08T08:16:52.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.602+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71c8007490 con 0x7f71d80c81d0 2023-12-08T08:16:52.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.603+0000 7f71ceffd640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 0x7f71bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:52.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.603+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f71c8089130 con 0x7f71d80c81d0 2023-12-08T08:16:52.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.603+0000 7f71de2ab640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 0x7f71bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:52.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.604+0000 7f71de2ab640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 0x7f71bc06d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:52.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.607+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71d80ae880 con 0x7f71d80c81d0 2023-12-08T08:16:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.803+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71d80ae880 con 0x7f71d80c81d0 2023-12-08T08:16:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.804+0000 7f71ceffd640 1 -- 172.21.15.45:0/4130592798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71d80ae880 con 0x7f71d80c81d0 2023-12-08T08:16:52.807 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:52.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 msgr2=0x7f71bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 0x7f71bc06d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d403c040 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 msgr2=0x7f71d814dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c500 tx=0x7f71c800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 shutdown_connections 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f71bc06ae40 0x7f71bc06d300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71d8151c20 0x7f71d80aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71d80c81d0 0x7f71d814dd30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 --2- 172.21.15.45:0/4130592798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71d80c4e20 0x7f71d8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 >> 172.21.15.45:0/4130592798 conn(0x7f71d80ab920 msgr2=0x7f71d806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 shutdown_connections 2023-12-08T08:16:52.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:52.807+0000 7f71e050f640 1 -- 172.21.15.45:0/4130592798 wait complete. 2023-12-08T08:16:52.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:53.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.058+0000 7f0f22767640 1 Processor -- start 2023-12-08T08:16:53.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.058+0000 7f0f22767640 1 -- start start 2023-12-08T08:16:53.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 0x7f0f1c06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 0x7f0f1c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0a8b30 con 0x7f0f1c151ec0 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0c16b0 con 0x7f0f1c0c4d30 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.059+0000 7f0f22767640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0c65d0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33628/0 (socket says 172.21.15.45:33628) 2023-12-08T08:16:53.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 -- 172.21.15.45:0/3980172379 learned_addr learned my addr 172.21.15.45:0/3980172379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f20f64640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 0x7f0f1c06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21f66640 1 --2- 172.21.15.45:0/3980172379 >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 0x7f0f1c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 -- 172.21.15.45:0/3980172379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 msgr2=0x7f0f1c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 0x7f0f1c06ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 -- 172.21.15.45:0/3980172379 >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 msgr2=0x7f0f1c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 --2- 172.21.15.45:0/3980172379 >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 0x7f0f1c06bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21765640 1 -- 172.21.15.45:0/3980172379 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c06c490 con 0x7f0f1c151ec0 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f21f66640 1 --2- 172.21.15.45:0/3980172379 >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 0x7f0f1c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.060+0000 7f0f20f64640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 0x7f0f1c06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.061+0000 7f0f21765640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0a54b0 tx=0x7f0f1802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54720950c3bc81a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.062+0000 7f0f13fff640 1 -- 172.21.15.45:0/3980172379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18031880 con 0x7f0f1c151ec0 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.062+0000 7f0f13fff640 1 -- 172.21.15.45:0/3980172379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f180319e0 con 0x7f0f1c151ec0 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.062+0000 7f0f13fff640 1 -- 172.21.15.45:0/3980172379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18031d70 con 0x7f0f1c151ec0 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.062+0000 7f0f22767640 1 -- 172.21.15.45:0/3980172379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c151ec0 msgr2=0x7f0f1c0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.062+0000 7f0f22767640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0a54b0 tx=0x7f0f1802b920 comp rx=0 tx=0).stop 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 -- 172.21.15.45:0/3980172379 shutdown_connections 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 --2- 172.21.15.45:0/3980172379 >> v2:172.21.15.114:3300/0 conn(0x7f0f1c0c4d30 0x7f0f1c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c1d60 0x7f0f1c06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 --2- 172.21.15.45:0/3980172379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c0c47f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 -- 172.21.15.45:0/3980172379 >> 172.21.15.45:0/3980172379 conn(0x7f0f1c066ce0 msgr2=0x7f0f1c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 -- 172.21.15.45:0/3980172379 shutdown_connections 2023-12-08T08:16:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.063+0000 7f0f22767640 1 -- 172.21.15.45:0/3980172379 wait complete. 2023-12-08T08:16:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.065+0000 7f0f22767640 1 Processor -- start 2023-12-08T08:16:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.065+0000 7f0f22767640 1 -- start start 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c4d30 0x7f0f1c148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0726e0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c072b00 con 0x7f0f1c151ec0 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.066+0000 7f0f22767640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0720b0 con 0x7f0f1c0c4d30 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33632/0 (socket says 172.21.15.45:33632) 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 -- 172.21.15.45:0/3204017835 learned_addr learned my addr 172.21.15.45:0/3204017835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21f66640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f20f64640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c4d30 0x7f0f1c148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 -- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c4d30 msgr2=0x7f0f1c148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c4d30 0x7f0f1c148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 -- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 msgr2=0x7f0f1c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 -- 172.21.15.45:0/3204017835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180094d0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21f66640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.067+0000 7f0f21765640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000c00 tx=0x7f0f180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.068+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18031870 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.068+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f180443f0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.068+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180447a0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.068+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c070f80 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.068+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c06fc30 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.069+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c0678c0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.070+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f18044900 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.071+0000 7f0f11ffb640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 0x7f0f0006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.071+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0f180ac1f0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.071+0000 7f0f20f64640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 0x7f0f0006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.072+0000 7f0f20f64640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 0x7f0f0006d350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c13ced0 tx=0x7f0f0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.076+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f18077090 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.274+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f1c0743e0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.275+0000 7f0f11ffb640 1 -- 172.21.15.45:0/3204017835 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f1807a6b0 con 0x7f0f1c0c1d60 2023-12-08T08:16:53.278 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 msgr2=0x7f0f0006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 0x7f0f0006d350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c13ced0 tx=0x7f0f0c008040 comp rx=0 tx=0).stop 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 msgr2=0x7f0f1c148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000c00 tx=0x7f0f180046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 shutdown_connections 2023-12-08T08:16:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0f0006ae90 0x7f0f0006d350 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0f1c0c4d30 0x7f0f1c148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f1c151ec0 0x7f0f1c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 --2- 172.21.15.45:0/3204017835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f1c0c1d60 0x7f0f1c148850 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 >> 172.21.15.45:0/3204017835 conn(0x7f0f1c066ce0 msgr2=0x7f0f1c0a5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.278+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 shutdown_connections 2023-12-08T08:16:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.279+0000 7f0f22767640 1 -- 172.21.15.45:0/3204017835 wait complete. 2023-12-08T08:16:53.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:53.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.515+0000 7f2088a61640 1 Processor -- start 2023-12-08T08:16:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.515+0000 7f2088a61640 1 -- start start 2023-12-08T08:16:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.516+0000 7f2088a61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20840c05a0 0x7f2084159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.516+0000 7f2088a61640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20840c0dd0 0x7f2084156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.516+0000 7f2088a61640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840c1f00 con 0x7f20840c0980 2023-12-08T08:16:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f2088a61640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208406c9a0 con 0x7f20840c05a0 2023-12-08T08:16:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f2088a61640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208406bf30 con 0x7f20840c0dd0 2023-12-08T08:16:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20840c05a0 0x7f2084159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20840c05a0 0x7f2084159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33634/0 (socket says 172.21.15.45:33634) 2023-12-08T08:16:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 -- 172.21.15.45:0/3170008498 learned_addr learned my addr 172.21.15.45:0/3170008498 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f2082d9d640 1 --2- 172.21.15.45:0/3170008498 >> v2:172.21.15.114:3300/0 conn(0x7f20840c0dd0 0x7f2084156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 -- 172.21.15.45:0/3170008498 >> v2:172.21.15.114:3300/0 conn(0x7f20840c0dd0 msgr2=0x7f2084156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 --2- 172.21.15.45:0/3170008498 >> v2:172.21.15.114:3300/0 conn(0x7f20840c0dd0 0x7f2084156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 -- 172.21.15.45:0/3170008498 >> v1:172.21.15.114:6789/0 conn(0x7f20840c0980 legacy=0x7f2084155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.517+0000 7f208259c640 1 -- 172.21.15.45:0/3170008498 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208406c210 con 0x7f20840c05a0 2023-12-08T08:16:53.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.519+0000 7f208259c640 1 --2- 172.21.15.45:0/3170008498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c05a0 0x7f2084159380 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2084158900 tx=0x7f207402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecfc6959ab045bf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.519+0000 7f208159a640 1 -- 172.21.15.45:0/3170008498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074031870 con 0x7f20840c05a0 2023-12-08T08:16:53.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.519+0000 7f208159a640 1 -- 172.21.15.45:0/3170008498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20740319d0 con 0x7f20840c05a0 2023-12-08T08:16:53.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.519+0000 7f208159a640 1 -- 172.21.15.45:0/3170008498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074031d60 con 0x7f20840c05a0 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 -- 172.21.15.45:0/3170008498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c05a0 msgr2=0x7f2084159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 --2- 172.21.15.45:0/3170008498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c05a0 0x7f2084159380 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2084158900 tx=0x7f207402b910 comp rx=0 tx=0).stop 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 -- 172.21.15.45:0/3170008498 shutdown_connections 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 --2- 172.21.15.45:0/3170008498 >> v2:172.21.15.114:3300/0 conn(0x7f20840c0dd0 0x7f2084156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 --2- 172.21.15.45:0/3170008498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c05a0 0x7f2084159380 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 -- 172.21.15.45:0/3170008498 >> 172.21.15.45:0/3170008498 conn(0x7f20840c2430 msgr2=0x7f20840c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 -- 172.21.15.45:0/3170008498 shutdown_connections 2023-12-08T08:16:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.520+0000 7f2088a61640 1 -- 172.21.15.45:0/3170008498 wait complete. 2023-12-08T08:16:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.522+0000 7f2088a61640 1 Processor -- start 2023-12-08T08:16:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.522+0000 7f2088a61640 1 -- start start 2023-12-08T08:16:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f20840c05a0 0x7f20841510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 0x7f208414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2084151d70 con 0x7f20840c0dd0 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208415b740 con 0x7f20840c0980 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2088a61640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208415ba20 con 0x7f20840c05a0 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2082d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2082d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33638/0 (socket says 172.21.15.45:33638) 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.523+0000 7f2082d9d640 1 -- 172.21.15.45:0/436038156 learned_addr learned my addr 172.21.15.45:0/436038156 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f208259c640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f20840c05a0 0x7f20841510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2081d9b640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 0x7f208414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 -- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f20840c05a0 msgr2=0x7f20841510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f20840c05a0 0x7f20841510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 -- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 msgr2=0x7f208414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 0x7f208414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 -- 172.21.15.45:0/436038156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740094d0 con 0x7f20840c0dd0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2081d9b640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 0x7f208414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2082d9d640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f207c007e60 tx=0x7f207c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c014420 con 0x7f20840c0dd0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c0145a0 con 0x7f20840c0dd0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.524+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c014950 con 0x7f20840c0dd0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.525+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208415bd00 con 0x7f20840c0dd0 2023-12-08T08:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.525+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208415c2c0 con 0x7f20840c0dd0 2023-12-08T08:16:53.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.526+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2084074670 con 0x7f20840c0dd0 2023-12-08T08:16:53.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.527+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f207c014ab0 con 0x7f20840c0dd0 2023-12-08T08:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.528+0000 7f2072ffd640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 0x7f206406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.528+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f207c08a470 con 0x7f20840c0dd0 2023-12-08T08:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.529+0000 7f208259c640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 0x7f206406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.530+0000 7f208259c640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 0x7f206406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2074036000 tx=0x7f207403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.533+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f207c055070 con 0x7f20840c0dd0 2023-12-08T08:16:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.733+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20840c3120 con 0x7f20840c0dd0 2023-12-08T08:16:53.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.734+0000 7f2072ffd640 1 -- 172.21.15.45:0/436038156 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f207c058690 con 0x7f20840c0dd0 2023-12-08T08:16:53.737 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 msgr2=0x7f206406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 0x7f206406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2074036000 tx=0x7f207403c040 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 msgr2=0x7f208414f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f207c007e60 tx=0x7f207c00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 shutdown_connections 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f206406ae40 0x7f206406d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20840c0dd0 0x7f208414f440 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20840c0980 0x7f208414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 --2- 172.21.15.45:0/436038156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f20840c05a0 0x7f20841510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 >> 172.21.15.45:0/436038156 conn(0x7f20840c2430 msgr2=0x7f20840c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 shutdown_connections 2023-12-08T08:16:53.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.737+0000 7f2088a61640 1 -- 172.21.15.45:0/436038156 wait complete. 2023-12-08T08:16:53.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:16:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.975+0000 7f7ea0904640 1 Processor -- start 2023-12-08T08:16:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.976+0000 7f7ea0904640 1 -- start start 2023-12-08T08:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 0x7f7e9c154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c56a0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9c151eb0 con 0x7f7e9c157a20 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7ea0904640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c80d0 con 0x7f7e9c0ca610 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7e9ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7e9ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33640/0 (socket says 172.21.15.45:33640) 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7e9ad9d640 1 -- 172.21.15.45:0/2098042966 learned_addr learned my addr 172.21.15.45:0/2098042966 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7e9b59e640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.977+0000 7f7e9a59c640 1 --2- 172.21.15.45:0/2098042966 >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 0x7f7e9c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9ad9d640 1 -- 172.21.15.45:0/2098042966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 msgr2=0x7f7e9c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9ad9d640 1 -- 172.21.15.45:0/2098042966 >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 msgr2=0x7f7e9c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/2098042966 >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 0x7f7e9c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9ad9d640 1 -- 172.21.15.45:0/2098042966 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c154430 con 0x7f7e9c151ad0 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9a59c640 1 --2- 172.21.15.45:0/2098042966 >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 0x7f7e9c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.978+0000 7f7e9b59e640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.979+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0c7e90 tx=0x7f7e8c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3068b45d9290b07b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.979+0000 7f7e99d9b640 1 -- 172.21.15.45:0/2098042966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c02ca80 con 0x7f7e9c151ad0 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.979+0000 7f7e99d9b640 1 -- 172.21.15.45:0/2098042966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c02cbe0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.979+0000 7f7e99d9b640 1 -- 172.21.15.45:0/2098042966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0343f0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 -- 172.21.15.45:0/2098042966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 msgr2=0x7f7e9c0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0c7e90 tx=0x7f7e8c02bee0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 -- 172.21.15.45:0/2098042966 shutdown_connections 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 --2- 172.21.15.45:0/2098042966 >> v2:172.21.15.114:3300/0 conn(0x7f7e9c157a20 0x7f7e9c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 --2- 172.21.15.45:0/2098042966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0ca0d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 -- 172.21.15.45:0/2098042966 >> 172.21.15.45:0/2098042966 conn(0x7f7e9c066610 msgr2=0x7f7e9c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 -- 172.21.15.45:0/2098042966 shutdown_connections 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.980+0000 7f7ea0904640 1 -- 172.21.15.45:0/2098042966 wait complete. 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.982+0000 7f7ea0904640 1 Processor -- start 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.983+0000 7f7ea0904640 1 -- start start 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.983+0000 7f7ea0904640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7ea0904640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7ea0904640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e9c157a20 0x7f7e9c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7ea0904640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0aa5e0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7ea0904640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c37a0 con 0x7f7e9c157a20 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7ea0904640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0a9a40 con 0x7f7e9c0ca610 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33648/0 (socket says 172.21.15.45:33648) 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 -- 172.21.15.45:0/3752512756 learned_addr learned my addr 172.21.15.45:0/3752512756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 -- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 msgr2=0x7f7e9c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 -- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e9c157a20 msgr2=0x7f7e9c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e9c157a20 0x7f7e9c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9a59c640 1 -- 172.21.15.45:0/3752512756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009b30 con 0x7f7e9c151ad0 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.984+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7e9a59c640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000c7f0 tx=0x7f7e9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90007820 con 0x7f7e9c151ad0 2023-12-08T08:16:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90007980 con 0x7f7e9c151ad0 2023-12-08T08:16:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90007d10 con 0x7f7e9c151ad0 2023-12-08T08:16:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c1eadc0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.985+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0a9d20 con 0x7f7e9c151ad0 2023-12-08T08:16:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.986+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c152dc0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.987+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e900113f0 con 0x7f7e9c151ad0 2023-12-08T08:16:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.988+0000 7f7e837fe640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 0x7f7e8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.988+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7e90089e10 con 0x7f7e9c151ad0 2023-12-08T08:16:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.988+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 0x7f7e8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.989+0000 7f7e9ad9d640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 0x7f7e8806d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c035000 tx=0x7f7e8c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:53.992+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e9008d030 con 0x7f7e9c151ad0 2023-12-08T08:16:54.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.188+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e9c0743e0 con 0x7f7e9c151ad0 2023-12-08T08:16:54.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.189+0000 7f7e837fe640 1 -- 172.21.15.45:0/3752512756 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7e9001f0b0 con 0x7f7e9c151ad0 2023-12-08T08:16:54.193 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:54.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 msgr2=0x7f7e8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 0x7f7e8806d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c035000 tx=0x7f7e8c030000 comp rx=0 tx=0).stop 2023-12-08T08:16:54.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 msgr2=0x7f7e9c0c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000c7f0 tx=0x7f7e9000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 shutdown_connections 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7e8806ae40 0x7f7e8806d300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e9c157a20 0x7f7e9c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e9c151ad0 0x7f7e9c0c3260 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 --2- 172.21.15.45:0/3752512756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e9c0ca610 0x7f7e9c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 >> 172.21.15.45:0/3752512756 conn(0x7f7e9c066610 msgr2=0x7f7e9c1525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.192+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 shutdown_connections 2023-12-08T08:16:54.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.193+0000 7f7ea0904640 1 -- 172.21.15.45:0/3752512756 wait complete. 2023-12-08T08:16:54.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:16:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.439+0000 7f377f59e640 1 Processor -- start 2023-12-08T08:16:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.439+0000 7f377f59e640 1 -- start start 2023-12-08T08:16:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37800c59e0 0x7f3780158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377f59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800c51f0 con 0x7f37800c0bf0 2023-12-08T08:16:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377f59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800c54d0 con 0x7f378006d1d0 2023-12-08T08:16:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377f59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800c1ce0 con 0x7f37800c59e0 2023-12-08T08:16:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37800c0bf0 0x7f3780154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36868/0 (socket says 172.21.15.45:36868) 2023-12-08T08:16:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.441+0000 7f377ed9d640 1 -- 172.21.15.45:0/2011722025 learned_addr learned my addr 172.21.15.45:0/2011722025 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377e59c640 1 --2- 172.21.15.45:0/2011722025 >> v2:172.21.15.114:3300/0 conn(0x7f37800c59e0 0x7f3780158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272423830 0 0) 0x7f37800c51f0 con 0x7f37800c0bf0 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3768003520 con 0x7f37800c0bf0 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2111575592 0 0) 0x7f3768003520 con 0x7f37800c0bf0 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 >> v2:172.21.15.114:3300/0 conn(0x7f37800c59e0 msgr2=0x7f3780158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 --2- 172.21.15.45:0/2011722025 >> v2:172.21.15.114:3300/0 conn(0x7f37800c59e0 0x7f3780158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 >> v1:172.21.15.114:6789/0 conn(0x7f378006d1d0 legacy=0x7f378006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780157ba0 con 0x7f37800c0bf0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f37780019f0 con 0x7f37800c0bf0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 >> v1:172.21.15.45:6789/0 conn(0x7f37800c0bf0 legacy=0x7f3780154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37680039c0 0x7f3768003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3768005180 0x7f376800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376800c030 con 0x7f37680047c0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376800c1a0 con 0x7f37680039c0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.442+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376800c360 con 0x7f3768005180 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377e59c640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37680039c0 0x7f3768003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377ed9d640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3768005180 0x7f376800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 -- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3768005180 msgr2=0x7f376800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3768005180 0x7f376800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 -- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37680039c0 msgr2=0x7f3768003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37680039c0 0x7f3768003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377dd9b640 1 -- 172.21.15.45:0/2011722025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768003520 con 0x7f37680047c0 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377e59c640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37680039c0 0x7f3768003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.443+0000 7f377ed9d640 1 -- 172.21.15.45:0/2011722025 reap_dead start 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.444+0000 7f377dd9b640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3768004c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3774001750 tx=0x7f37680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b962abfa14896f9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740052d0 con 0x7f37680047c0 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377402e050 con 0x7f37680047c0 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377d59a640 1 -- 172.21.15.45:0/2011722025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774003830 con 0x7f37680047c0 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377f59e640 1 -- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 msgr2=0x7f3768004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377f59e640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3768004c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3774001750 tx=0x7f37680057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377f59e640 1 -- 172.21.15.45:0/2011722025 shutdown_connections 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377f59e640 1 --2- 172.21.15.45:0/2011722025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3768004c40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.445+0000 7f377f59e640 1 -- 172.21.15.45:0/2011722025 >> 172.21.15.45:0/2011722025 conn(0x7f3780066ce0 msgr2=0x7f37800a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.446+0000 7f377f59e640 1 -- 172.21.15.45:0/2011722025 shutdown_connections 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.446+0000 7f377f59e640 1 -- 172.21.15.45:0/2011722025 wait complete. 2023-12-08T08:16:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.448+0000 7f377f59e640 1 Processor -- start 2023-12-08T08:16:54.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.448+0000 7f377f59e640 1 -- start start 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37801ecb90 0x7f3780072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3780156010 0x7f37800a8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378006fd80 con 0x7f37680047c0 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800a59c0 con 0x7f3780156010 2023-12-08T08:16:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.449+0000 7f377f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800aacb0 con 0x7f37801ecb90 2023-12-08T08:16:54.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33668/0 (socket says 172.21.15.45:33668) 2023-12-08T08:16:54.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 -- 172.21.15.45:0/3436303954 learned_addr learned my addr 172.21.15.45:0/3436303954 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 -- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37801ecb90 msgr2=0x7f3780072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377dd9b640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37801ecb90 0x7f3780072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377ed9d640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3780156010 0x7f37800a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37801ecb90 0x7f3780072420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 -- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3780156010 msgr2=0x7f37800a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3780156010 0x7f37800a8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 -- 172.21.15.45:0/3436303954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800a9c50 con 0x7f37680047c0 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.450+0000 7f377e59c640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3770011510 tx=0x7f37700119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.451+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770015870 con 0x7f37680047c0 2023-12-08T08:16:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.451+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37700159d0 con 0x7f37680047c0 2023-12-08T08:16:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.451+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770015d80 con 0x7f37680047c0 2023-12-08T08:16:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.451+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800aa980 con 0x7f37680047c0 2023-12-08T08:16:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.451+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800a5400 con 0x7f37680047c0 2023-12-08T08:16:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.452+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800aa7e0 con 0x7f37680047c0 2023-12-08T08:16:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.453+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f377001d400 con 0x7f37680047c0 2023-12-08T08:16:54.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.454+0000 7f376effd640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.454+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f377008a1e0 con 0x7f37680047c0 2023-12-08T08:16:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.454+0000 7f377dd9b640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.455+0000 7f377dd9b640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 0x7f376006d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3774033000 tx=0x7f3774009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.459+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37800aa7e0 con 0x7f37680047c0 2023-12-08T08:16:54.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.656+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f37800aa7e0 con 0x7f37680047c0 2023-12-08T08:16:54.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.657+0000 7f376effd640 1 -- 172.21.15.45:0/3436303954 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f37800aa7e0 con 0x7f37680047c0 2023-12-08T08:16:54.660 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 msgr2=0x7f376006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 0x7f376006d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3774033000 tx=0x7f3774009030 comp rx=0 tx=0).stop 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 msgr2=0x7f3780071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3770011510 tx=0x7f37700119d0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 shutdown_connections 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37801ecb90 0x7f3780072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3780156010 0x7f37800a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 --2- 172.21.15.45:0/3436303954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37680047c0 0x7f3780071910 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 >> 172.21.15.45:0/3436303954 conn(0x7f3780066ce0 msgr2=0x7f3780152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:54.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 shutdown_connections 2023-12-08T08:16:54.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.660+0000 7f377f59e640 1 -- 172.21.15.45:0/3436303954 wait complete. 2023-12-08T08:16:54.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:16:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.910+0000 7f7065aad640 1 Processor -- start 2023-12-08T08:16:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.910+0000 7f7065aad640 1 -- start start 2023-12-08T08:16:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.911+0000 7f7065aad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70600c6550 0x7f70600c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.911+0000 7f7065aad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f706006b960 0x7f70600c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.911+0000 7f7065aad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70600c6b30 con 0x7f706014e310 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f7065aad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70600c6e10 con 0x7f706006b960 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f7065aad640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706006ae80 con 0x7f70600c6550 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f70652ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f706006b960 0x7f70600c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f7064aab640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f706014e310 0x7f7060154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36870/0 (socket says 172.21.15.45:36870) 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f7064aab640 1 -- 172.21.15.45:0/1707664313 learned_addr learned my addr 172.21.15.45:0/1707664313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f705ffff640 1 --2- 172.21.15.45:0/1707664313 >> v2:172.21.15.114:3300/0 conn(0x7f70600c6550 0x7f70600c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f70652ac640 1 -- 172.21.15.45:0/1707664313 >> v2:172.21.15.114:3300/0 conn(0x7f70600c6550 msgr2=0x7f70600c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f70652ac640 1 --2- 172.21.15.45:0/1707664313 >> v2:172.21.15.114:3300/0 conn(0x7f70600c6550 0x7f70600c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f70652ac640 1 -- 172.21.15.45:0/1707664313 >> v1:172.21.15.45:6789/0 conn(0x7f706014e310 legacy=0x7f7060154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.913+0000 7f70652ac640 1 -- 172.21.15.45:0/1707664313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706006b160 con 0x7f706006b960 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.912+0000 7f705f7fe640 1 -- 172.21.15.45:0/1707664313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370414163 0 0) 0x7f70600c6b30 con 0x7f706014e310 2023-12-08T08:16:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f70652ac640 1 --2- 172.21.15.45:0/1707664313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f70600c44c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f706008bd50 tx=0x7f705802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eecf03e0f6f8a12 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f705f7fe640 1 -- 172.21.15.45:0/1707664313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058031710 con 0x7f706006b960 2023-12-08T08:16:54.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f705f7fe640 1 -- 172.21.15.45:0/1707664313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705802f050 con 0x7f706006b960 2023-12-08T08:16:54.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f705f7fe640 1 -- 172.21.15.45:0/1707664313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058031a90 con 0x7f706006b960 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f7065aad640 1 -- 172.21.15.45:0/1707664313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 msgr2=0x7f70600c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.914+0000 7f7065aad640 1 --2- 172.21.15.45:0/1707664313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f70600c44c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f706008bd50 tx=0x7f705802b7b0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 -- 172.21.15.45:0/1707664313 shutdown_connections 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 --2- 172.21.15.45:0/1707664313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f70600c44c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 --2- 172.21.15.45:0/1707664313 >> v2:172.21.15.114:3300/0 conn(0x7f70600c6550 0x7f70600c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 -- 172.21.15.45:0/1707664313 >> 172.21.15.45:0/1707664313 conn(0x7f70600ab710 msgr2=0x7f70600abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 -- 172.21.15.45:0/1707664313 shutdown_connections 2023-12-08T08:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.915+0000 7f7065aad640 1 -- 172.21.15.45:0/1707664313 wait complete. 2023-12-08T08:16:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.917+0000 7f7065aad640 1 Processor -- start 2023-12-08T08:16:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.917+0000 7f7065aad640 1 -- start start 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70600c6550 0x7f70601ea560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f706014e310 0x7f706014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70601eaaa0 con 0x7f706006b960 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600c0cb0 con 0x7f70600c6550 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7065aad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70601515a0 con 0x7f706014e310 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7064aab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7064aab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33684/0 (socket says 172.21.15.45:33684) 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f7064aab640 1 -- 172.21.15.45:0/2439730005 learned_addr learned my addr 172.21.15.45:0/2439730005 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f705ffff640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70600c6550 0x7f70601ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.918+0000 7f70652ac640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f706014e310 0x7f706014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 -- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f706014e310 msgr2=0x7f706014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f706014e310 0x7f706014a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 -- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70600c6550 msgr2=0x7f70601ea560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70600c6550 0x7f70601ea560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 -- 172.21.15.45:0/2439730005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058009400 con 0x7f706006b960 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7064aab640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f705000c7c0 tx=0x7f705000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000a640 con 0x7f706006b960 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000a7c0 con 0x7f706006b960 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000ab70 con 0x7f706006b960 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7060151880 con 0x7f706006b960 2023-12-08T08:16:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.919+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7060151b60 con 0x7f706006b960 2023-12-08T08:16:54.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.921+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600743e0 con 0x7f706006b960 2023-12-08T08:16:54.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.922+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f705000acd0 con 0x7f706006b960 2023-12-08T08:16:54.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.923+0000 7f705d7fa640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:54.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.923+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7050089130 con 0x7f706006b960 2023-12-08T08:16:54.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.924+0000 7f705ffff640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:54.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.924+0000 7f705ffff640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 0x7f704c06d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70601ee110 tx=0x7f7054008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:54.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:54.928+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7050053ca0 con 0x7f706006b960 2023-12-08T08:16:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.134+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7060153d70 con 0x7f706006b960 2023-12-08T08:16:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.135+0000 7f705d7fa640 1 -- 172.21.15.45:0/2439730005 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7050018080 con 0x7f706006b960 2023-12-08T08:16:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.137+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 msgr2=0x7f704c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.137+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 0x7f704c06d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70601ee110 tx=0x7f7054008040 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 msgr2=0x7f706014ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f705000c7c0 tx=0x7f705000cc80 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 shutdown_connections 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f706014e310 0x7f706014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70600c6550 0x7f70601ea560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 --2- 172.21.15.45:0/2439730005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f706006b960 0x7f706014ec00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 >> 172.21.15.45:0/2439730005 conn(0x7f70600ab710 msgr2=0x7f70600c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 shutdown_connections 2023-12-08T08:16:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.138+0000 7f7065aad640 1 -- 172.21.15.45:0/2439730005 wait complete. 2023-12-08T08:16:55.160 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:16:55.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:55.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:55.276 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:16:55.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:55.276 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:16:55.328 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:55.329 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:55.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:16:55.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:16:55.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.609+0000 7fa2c2d68640 1 Processor -- start 2023-12-08T08:16:55.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.609+0000 7fa2c2d68640 1 -- start start 2023-12-08T08:16:55.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.610+0000 7fa2c2d68640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2bc0c5a90 0x7fa2bc154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:55.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.610+0000 7fa2c2d68640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0a6d30 con 0x7fa2bc151f20 2023-12-08T08:16:55.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.610+0000 7fa2c2d68640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0a6f80 con 0x7fa2bc070310 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.610+0000 7fa2c2d68640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0a7260 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2bc0c5a90 0x7fa2bc154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2bc0c5a90 0x7fa2bc154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45530/0 (socket says 172.21.15.45:45530) 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 -- 172.21.15.45:0/4018257953 learned_addr learned my addr 172.21.15.45:0/4018257953 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 -- 172.21.15.45:0/4018257953 >> v1:172.21.15.114:6789/0 conn(0x7fa2bc070310 legacy=0x7fa2bc0c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 -- 172.21.15.45:0/4018257953 >> v1:172.21.15.45:6789/0 conn(0x7fa2bc151f20 legacy=0x7fa2bc158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bbfff640 1 -- 172.21.15.45:0/4018257953 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc157e40 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.611+0000 7fa2bb7fe640 1 -- 172.21.15.45:0/4018257953 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093662590 0 0) 0x7fa2bc0a6d30 con 0x7fa2bc151f20 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2bbfff640 1 --2- 172.21.15.45:0/4018257953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc154730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009870 tx=0x7fa2a802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11c2770fa54aa77 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2bb7fe640 1 -- 172.21.15.45:0/4018257953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8031860 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2bb7fe640 1 -- 172.21.15.45:0/4018257953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80319c0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2bb7fe640 1 -- 172.21.15.45:0/4018257953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8031d50 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2c2d68640 1 -- 172.21.15.45:0/4018257953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 msgr2=0x7fa2bc154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/4018257953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc154730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009870 tx=0x7fa2a802b900 comp rx=0 tx=0).stop 2023-12-08T08:16:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2c2d68640 1 -- 172.21.15.45:0/4018257953 shutdown_connections 2023-12-08T08:16:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/4018257953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc154730 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.613+0000 7fa2c2d68640 1 -- 172.21.15.45:0/4018257953 >> 172.21.15.45:0/4018257953 conn(0x7fa2bc0a98a0 msgr2=0x7fa2bc0a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:55.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.614+0000 7fa2c2d68640 1 -- 172.21.15.45:0/4018257953 shutdown_connections 2023-12-08T08:16:55.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.614+0000 7fa2c2d68640 1 -- 172.21.15.45:0/4018257953 wait complete. 2023-12-08T08:16:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.615+0000 7fa2c2d68640 1 Processor -- start 2023-12-08T08:16:55.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.615+0000 7fa2c2d68640 1 -- start start 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 0x7fa2bc1e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2bc151f20 0x7fa2bc1ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc14eae0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0700c0 con 0x7fa2bc070310 2023-12-08T08:16:55.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.616+0000 7fa2c2d68640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc1e9fe0 con 0x7fa2bc151f20 2023-12-08T08:16:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45534/0 (socket says 172.21.15.45:45534) 2023-12-08T08:16:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 -- 172.21.15.45:0/2516970709 learned_addr learned my addr 172.21.15.45:0/2516970709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2c0b04640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 0x7fa2bc1e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 -- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2bc151f20 msgr2=0x7fa2bc1ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2bc151f20 0x7fa2bc1ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 -- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 msgr2=0x7fa2bc1e9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 0x7fa2bc1e9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 -- 172.21.15.45:0/2516970709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80094d0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2c0b04640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 0x7fa2bc1e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.617+0000 7fa2bbfff640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8000c00 tx=0x7fa2a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.618+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a803ad30 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.618+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a803ae90 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.618+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8044630 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.618+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc1ea280 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.618+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc1ea840 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.619+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc1eaa30 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.620+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2a804d450 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.621+0000 7fa2b97fa640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 0x7fa2a006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:55.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.621+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa2a80ac1e0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.621+0000 7fa2c0b04640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 0x7fa2a006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:55.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.622+0000 7fa2c0b04640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 0x7fa2a006d350 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0000f60 tx=0x7fa2b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.626+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2a8076dd0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.861+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2bc154c70 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.862+0000 7fa2b97fa640 1 -- 172.21.15.45:0/2516970709 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fa2a807a3f0 con 0x7fa2bc0c5a90 2023-12-08T08:16:55.865 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:16:55.865 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:16:55.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.864+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 msgr2=0x7fa2a006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.864+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 0x7fa2a006d350 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0000f60 tx=0x7fa2b0009040 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 msgr2=0x7fa2bc0a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8000c00 tx=0x7fa2a80046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 shutdown_connections 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa2a006ae90 0x7fa2a006d350 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa2bc151f20 0x7fa2bc1ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2bc0c5a90 0x7fa2bc0a8a80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 --2- 172.21.15.45:0/2516970709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2bc070310 0x7fa2bc1e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 >> 172.21.15.45:0/2516970709 conn(0x7fa2bc0a98a0 msgr2=0x7fa2bc0c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 shutdown_connections 2023-12-08T08:16:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:55.865+0000 7fa2c2d68640 1 -- 172.21.15.45:0/2516970709 wait complete. 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:55.888 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:16:55.889 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:16:55.889 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:16:55.889 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:55.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:55.889 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:16:55.949 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:16:55.949 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:16:55.949 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:16:55.949 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:16:55.950 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41999sec preferred_lft 41999sec 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:16:55.951 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:16:55.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:55.952 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:16:56.044 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:16:56.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.048 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:16:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:16:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:16:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:16:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:16:56.101 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:16:56.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.101 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:16:56.101 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:16:56.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:16:56.101 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:16:56.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:16:56.102 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:16:56.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.274 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:16:56.323 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:16:56.324 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:56.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:16:56.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:56.416 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:56.470 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:16:56.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:16:56.471 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:56.523 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:16:56.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:56.663 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:56.698 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:16:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:16:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:16:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:16:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:16:56.701 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:16:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:16:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:16:56.701 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:16:56.702 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:16:56.708 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:16:56.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:16:56.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:16:56.800 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:16:56.874 INFO:teuthology.orchestra.run.smithi114.stdout:client5661 2023-12-08T08:16:56.875 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:16:56.875 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:56.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-08T08:16:57.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.165+0000 7fd171672640 1 Processor -- start 2023-12-08T08:16:57.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.165+0000 7fd171672640 1 -- start start 2023-12-08T08:16:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd171672640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd16c153780 0x7fd16c156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd171672640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c152290 con 0x7fd16c14f740 2023-12-08T08:16:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd171672640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c153180 con 0x7fd16c0a4d10 2023-12-08T08:16:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd171672640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0c16f0 con 0x7fd16c153780 2023-12-08T08:16:57.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd16bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd16c14f740 0x7fd16c152a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41140/0 (socket says 172.21.15.45:41140) 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd16bfff640 1 -- 172.21.15.45:0/327939591 learned_addr learned my addr 172.21.15.45:0/327939591 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd16b7fe640 1 --2- 172.21.15.45:0/327939591 >> v2:172.21.15.45:3300/0 conn(0x7fd16c153780 0x7fd16c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.167+0000 7fd16affd640 1 -- 172.21.15.45:0/327939591 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726598259 0 0) 0x7fd16c152290 con 0x7fd16c14f740 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.168+0000 7fd16affd640 1 -- 172.21.15.45:0/327939591 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd154003520 con 0x7fd16c14f740 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.168+0000 7fd16b7fe640 1 -- 172.21.15.45:0/327939591 >> v1:172.21.15.114:6789/0 conn(0x7fd16c0a4d10 legacy=0x7fd16c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.168+0000 7fd16b7fe640 1 -- 172.21.15.45:0/327939591 >> v1:172.21.15.45:6789/0 conn(0x7fd16c14f740 legacy=0x7fd16c152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.168+0000 7fd16b7fe640 1 -- 172.21.15.45:0/327939591 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0c19d0 con 0x7fd16c153780 2023-12-08T08:16:57.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.169+0000 7fd16b7fe640 1 --2- 172.21.15.45:0/327939591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c153780 0x7fd16c156290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd1600097a0 tx=0x7fd16002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d4bdfaf8b8ae53 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.169+0000 7fd16affd640 1 -- 172.21.15.45:0/327939591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16002e070 con 0x7fd16c153780 2023-12-08T08:16:57.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.169+0000 7fd16affd640 1 -- 172.21.15.45:0/327939591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1600315a0 con 0x7fd16c153780 2023-12-08T08:16:57.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.169+0000 7fd16affd640 1 -- 172.21.15.45:0/327939591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160031930 con 0x7fd16c153780 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 -- 172.21.15.45:0/327939591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c153780 msgr2=0x7fd16c156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 --2- 172.21.15.45:0/327939591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c153780 0x7fd16c156290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd1600097a0 tx=0x7fd16002b840 comp rx=0 tx=0).stop 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 -- 172.21.15.45:0/327939591 shutdown_connections 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 --2- 172.21.15.45:0/327939591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c153780 0x7fd16c156290 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 -- 172.21.15.45:0/327939591 >> 172.21.15.45:0/327939591 conn(0x7fd16c066df0 msgr2=0x7fd16c0a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 -- 172.21.15.45:0/327939591 shutdown_connections 2023-12-08T08:16:57.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.170+0000 7fd171672640 1 -- 172.21.15.45:0/327939591 wait complete. 2023-12-08T08:16:57.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.172+0000 7fd171672640 1 Processor -- start 2023-12-08T08:16:57.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.172+0000 7fd171672640 1 -- start start 2023-12-08T08:16:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16c14f740 0x7fd16c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd16c153780 0x7fd16c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0a6030 con 0x7fd16c0a4d10 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0a5c70 con 0x7fd16c14f740 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd171672640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0a2260 con 0x7fd16c153780 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45562/0 (socket says 172.21.15.45:45562) 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 -- 172.21.15.45:0/3259052365 learned_addr learned my addr 172.21.15.45:0/3259052365 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd170e71640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd16c153780 0x7fd16c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 -- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd16c153780 msgr2=0x7fd16c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd16c153780 0x7fd16c150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16b7fe640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16c14f740 0x7fd16c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.173+0000 7fd16bfff640 1 -- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16c14f740 msgr2=0x7fd16c0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd16bfff640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16c14f740 0x7fd16c0a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd16bfff640 1 -- 172.21.15.45:0/3259052365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160009400 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd16bfff640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c500 tx=0x7fd15c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c005ce0 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c005e40 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c007330 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0a2540 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.174+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0a31c0 con 0x7fd16c0a4d10 2023-12-08T08:16:57.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.176+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c067900 con 0x7fd16c0a4d10 2023-12-08T08:16:57.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.176+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd15c007550 con 0x7fd16c0a4d10 2023-12-08T08:16:57.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.177+0000 7fd168ff9640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 0x7fd15806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.177+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd15c089160 con 0x7fd16c0a4d10 2023-12-08T08:16:57.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.178+0000 7fd16b7fe640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 0x7fd15806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.178+0000 7fd16b7fe640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 0x7fd15806d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd160036000 tx=0x7fd16003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.182+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd15c053e20 con 0x7fd16c0a4d10 2023-12-08T08:16:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.415+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7fd16c0743e0 con 0x7fd16c0a4d10 2023-12-08T08:16:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.419+0000 7fd168ff9640 1 -- 172.21.15.45:0/3259052365 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v17) v1 ==== 134+0+185 (secure 0 0 0) 0x7fd15c0170c0 con 0x7fd16c0a4d10 2023-12-08T08:16:57.422 INFO:teuthology.orchestra.run.smithi045.stdout:[client.testuser] 2023-12-08T08:16:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg== 2023-12-08T08:16:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-08T08:16:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r fsname=cephfs" 2023-12-08T08:16:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 msgr2=0x7fd15806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 0x7fd15806d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd160036000 tx=0x7fd16003d040 comp rx=0 tx=0).stop 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 msgr2=0x7fd16c14b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c500 tx=0x7fd15c00c9c0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 shutdown_connections 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd15806ae40 0x7fd15806d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd16c153780 0x7fd16c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd16c14f740 0x7fd16c0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 --2- 172.21.15.45:0/3259052365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd16c0a4d10 0x7fd16c14b170 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 >> 172.21.15.45:0/3259052365 conn(0x7fd16c066df0 msgr2=0x7fd16c1544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.422+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 shutdown_connections 2023-12-08T08:16:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.423+0000 7fd171672640 1 -- 172.21.15.45:0/3259052365 wait complete. 2023-12-08T08:16:57.447 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:16:57.503 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.fQ5KfaSy4u 2023-12-08T08:16:57.504 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:57.504 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/tmp/tmp.fQ5KfaSy4u 2023-12-08T08:16:57.558 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:57.559 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:57.661 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:16:57.661 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:16:57.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:16:57.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.937+0000 7f6a049e5640 1 Processor -- start 2023-12-08T08:16:57.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.937+0000 7f6a049e5640 1 -- start start 2023-12-08T08:16:57.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f6a049e5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6a00154190 0x7f6a000aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f6a049e5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a000c63b0 con 0x7f6a000a4f30 2023-12-08T08:16:57.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f6a049e5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a000a53c0 con 0x7f6a00154a20 2023-12-08T08:16:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f6a049e5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a000a9f20 con 0x7f6a00154190 2023-12-08T08:16:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f69f7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a000a4f30 0x7f6a000c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41146/0 (socket says 172.21.15.45:41146) 2023-12-08T08:16:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f69f7fff640 1 -- 172.21.15.45:0/1580183156 learned_addr learned my addr 172.21.15.45:0/1580183156 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.939+0000 7f69fe59c640 1 --2- 172.21.15.45:0/1580183156 >> v2:172.21.15.114:3300/0 conn(0x7f6a00154190 0x7f6a000aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664329973 0 0) 0x7f6a000c63b0 con 0x7f6a000a4f30 2023-12-08T08:16:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69ec005730 con 0x7f6a000a4f30 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743960209 0 0) 0x7f69ec005730 con 0x7f6a000a4f30 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 >> v2:172.21.15.114:3300/0 conn(0x7f6a00154190 msgr2=0x7f6a000aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 --2- 172.21.15.45:0/1580183156 >> v2:172.21.15.114:3300/0 conn(0x7f6a00154190 0x7f6a000aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 >> v1:172.21.15.114:6789/0 conn(0x7f6a00154a20 legacy=0x7f6a00154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000a9580 con 0x7f6a000a4f30 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f69e8001670 con 0x7f6a000a4f30 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 >> v1:172.21.15.45:6789/0 conn(0x7f6a000a4f30 legacy=0x7f6a000c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f69ec005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec0069d0 0x7f69ec006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69ec0073e0 0x7f69ec00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000a9f20 con 0x7f69ec005bd0 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec00e330 con 0x7f69ec0069d0 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.940+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec00e4f0 con 0x7f69ec0073e0 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f69ec005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69f7fff640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec0069d0 0x7f69ec006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 -- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69ec0073e0 msgr2=0x7f69ec00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f69ec0073e0 0x7f69ec00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 -- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec0069d0 msgr2=0x7f69ec006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec0069d0 0x7f69ec006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fe59c640 1 -- 172.21.15.45:0/1580183156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec005730 con 0x7f69ec005bd0 2023-12-08T08:16:57.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69f7fff640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec0069d0 0x7f69ec006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:57.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.941+0000 7f69fed9d640 1 -- 172.21.15.45:0/1580183156 reap_dead start 2023-12-08T08:16:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.942+0000 7f69fe59c640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f69ec005ff0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009a90 tx=0x7f69ec007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2399a70feb3cc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f002c680 con 0x7f69ec005bd0 2023-12-08T08:16:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f002c7e0 con 0x7f69ec005bd0 2023-12-08T08:16:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f69fdd9b640 1 -- 172.21.15.45:0/1580183156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f002cb70 con 0x7f69ec005bd0 2023-12-08T08:16:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f6a049e5640 1 -- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 msgr2=0x7f69ec005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f6a049e5640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f69ec005ff0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009a90 tx=0x7f69ec007a00 comp rx=0 tx=0).stop 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f6a049e5640 1 -- 172.21.15.45:0/1580183156 shutdown_connections 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f6a049e5640 1 --2- 172.21.15.45:0/1580183156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f69ec005ff0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.943+0000 7f6a049e5640 1 -- 172.21.15.45:0/1580183156 >> 172.21.15.45:0/1580183156 conn(0x7f6a000661f0 msgr2=0x7f6a00066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.944+0000 7f6a049e5640 1 -- 172.21.15.45:0/1580183156 shutdown_connections 2023-12-08T08:16:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.944+0000 7f6a049e5640 1 -- 172.21.15.45:0/1580183156 wait complete. 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.945+0000 7f6a049e5640 1 Processor -- start 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.945+0000 7f6a049e5640 1 -- start start 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a00072850 0x7f6a0014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a000a7ac0 0x7f6a000a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0014fa30 con 0x7f69ec005bd0 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00071a40 con 0x7f6a00072850 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.946+0000 7f6a049e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a00071d20 con 0x7f6a000a7ac0 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45582/0 (socket says 172.21.15.45:45582) 2023-12-08T08:16:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 -- 172.21.15.45:0/344652299 learned_addr learned my addr 172.21.15.45:0/344652299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 -- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a000a7ac0 msgr2=0x7f6a000a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a000a7ac0 0x7f6a000a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 -- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a00072850 msgr2=0x7f6a0014e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a00072850 0x7f6a0014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 -- 172.21.15.45:0/344652299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a001ea130 con 0x7f69ec005bd0 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.947+0000 7f69fe59c640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f69f002c220 tx=0x7f69f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.948+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0003810 con 0x7f69ec005bd0 2023-12-08T08:16:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.948+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f0003970 con 0x7f69ec005bd0 2023-12-08T08:16:57.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.948+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0003d20 con 0x7f69ec005bd0 2023-12-08T08:16:57.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.948+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a00072000 con 0x7f69ec005bd0 2023-12-08T08:16:57.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.948+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a001ed590 con 0x7f69ec005bd0 2023-12-08T08:16:57.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.949+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00074600 con 0x7f69ec005bd0 2023-12-08T08:16:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.950+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f69f0034440 con 0x7f69ec005bd0 2023-12-08T08:16:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.951+0000 7f69f6ffd640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 0x7f69e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.951+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f69f00abaf0 con 0x7f69ec005bd0 2023-12-08T08:16:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.952+0000 7f69f7fff640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 0x7f69e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.952+0000 7f69f7fff640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 0x7f69e006d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a00072c30 tx=0x7f69e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:57.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:57.956+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69f00768c0 con 0x7f69ec005bd0 2023-12-08T08:16:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.155+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a000c0720 con 0x7f69ec005bd0 2023-12-08T08:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.159+0000 7f69f6ffd640 1 -- 172.21.15.45:0/344652299 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f69f0079ee0 con 0x7f69ec005bd0 2023-12-08T08:16:58.162 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:16:58.162 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 msgr2=0x7f69e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 0x7f69e006d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a00072c30 tx=0x7f69e8009040 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 msgr2=0x7f6a0014f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f69f002c220 tx=0x7f69f0004730 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 shutdown_connections 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f69e006ae40 0x7f69e006d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6a000a7ac0 0x7f6a000a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a00072850 0x7f6a0014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 --2- 172.21.15.45:0/344652299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69ec005bd0 0x7f6a0014f4f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 >> 172.21.15.45:0/344652299 conn(0x7f6a000661f0 msgr2=0x7f6a000c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:58.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 shutdown_connections 2023-12-08T08:16:58.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.162+0000 7f6a049e5640 1 -- 172.21.15.45:0/344652299 wait complete. 2023-12-08T08:16:58.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:16:27.503085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:16:28.455815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:16:43.271897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:16:44.566832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:16:58.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:16:58.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:58.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.408+0000 7efc01bae640 1 Processor -- start 2023-12-08T08:16:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.409+0000 7efc01bae640 1 -- start start 2023-12-08T08:16:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efc01bae640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efc01bae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efbfc0c1d60 0x7efbfc06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efc01bae640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0c16b0 con 0x7efbfc0c4d30 2023-12-08T08:16:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efc01bae640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0a8b30 con 0x7efbfc0c1d60 2023-12-08T08:16:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efc01bae640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0c65d0 con 0x7efbfc151ec0 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.410+0000 7efbfbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efbfc0c1d60 0x7efbfc06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efbfc0c1d60 0x7efbfc06ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45592/0 (socket says 172.21.15.45:45592) 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 -- 172.21.15.45:0/2790239396 learned_addr learned my addr 172.21.15.45:0/2790239396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efc00bac640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 -- 172.21.15.45:0/2790239396 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 msgr2=0x7efbfc0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc0c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 -- 172.21.15.45:0/2790239396 >> v1:172.21.15.114:6789/0 conn(0x7efbfc0c4d30 legacy=0x7efbfc06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.411+0000 7efbfbfff640 1 -- 172.21.15.45:0/2790239396 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0c5810 con 0x7efbfc0c1d60 2023-12-08T08:16:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.412+0000 7efbfbfff640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c1d60 0x7efbfc06ba10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c778c90277e5b30 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.413+0000 7efbfb7fe640 1 -- 172.21.15.45:0/2790239396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0031640 con 0x7efbfc0c1d60 2023-12-08T08:16:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.413+0000 7efbfb7fe640 1 -- 172.21.15.45:0/2790239396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00317a0 con 0x7efbfc0c1d60 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.413+0000 7efbfb7fe640 1 -- 172.21.15.45:0/2790239396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0031b30 con 0x7efbfc0c1d60 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.413+0000 7efc01bae640 1 -- 172.21.15.45:0/2790239396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c1d60 msgr2=0x7efbfc06ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.413+0000 7efc01bae640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c1d60 0x7efbfc06ba10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009870 tx=0x7efbf002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 -- 172.21.15.45:0/2790239396 shutdown_connections 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c1d60 0x7efbfc06ba10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 --2- 172.21.15.45:0/2790239396 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc0c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 -- 172.21.15.45:0/2790239396 >> 172.21.15.45:0/2790239396 conn(0x7efbfc066ce0 msgr2=0x7efbfc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 -- 172.21.15.45:0/2790239396 shutdown_connections 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.414+0000 7efc01bae640 1 -- 172.21.15.45:0/2790239396 wait complete. 2023-12-08T08:16:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.415+0000 7efc01bae640 1 Processor -- start 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.416+0000 7efc01bae640 1 -- start start 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.416+0000 7efc01bae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0c1d60 0x7efbfc0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.416+0000 7efc01bae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.416+0000 7efc01bae640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc1ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc01bae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0a7090 con 0x7efbfc0c4d30 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc01bae640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1ee040 con 0x7efbfc0c1d60 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc01bae640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc152740 con 0x7efbfc151ec0 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45598/0 (socket says 172.21.15.45:45598) 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 -- 172.21.15.45:0/654218579 learned_addr learned my addr 172.21.15.45:0/654218579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc00bac640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0c1d60 0x7efbfc0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc013ad640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc1ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 -- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 msgr2=0x7efbfc1ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc1ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 -- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0c1d60 msgr2=0x7efbfc0a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0c1d60 0x7efbfc0a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efbfbfff640 1 -- 172.21.15.45:0/654218579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00094d0 con 0x7efbfc0c4d30 2023-12-08T08:16:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.417+0000 7efc013ad640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc1ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efbfbfff640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf003ac60 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf003adc0 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0044630 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc1edd60 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.418+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1e1290 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.420+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc0a73d0 con 0x7efbfc0c4d30 2023-12-08T08:16:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.421+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efbf002f050 con 0x7efbfc0c4d30 2023-12-08T08:16:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.422+0000 7efbf97fa640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 0x7efbe806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.422+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7efbf00ab970 con 0x7efbfc0c4d30 2023-12-08T08:16:58.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.422+0000 7efc00bac640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 0x7efbe806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.423+0000 7efc00bac640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 0x7efbe806d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efbec006fd0 tx=0x7efbec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.427+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efbf0076570 con 0x7efbfc0c4d30 2023-12-08T08:16:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.620+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efbfc0678c0 con 0x7efbfc0c4d30 2023-12-08T08:16:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.621+0000 7efbf97fa640 1 -- 172.21.15.45:0/654218579 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7efbf0031e60 con 0x7efbfc0c4d30 2023-12-08T08:16:58.624 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:16:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 msgr2=0x7efbe806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 0x7efbe806d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efbec006fd0 tx=0x7efbec008040 comp rx=0 tx=0).stop 2023-12-08T08:16:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 msgr2=0x7efbfc152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf00046c0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 shutdown_connections 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbe806ae40 0x7efbe806d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbfc151ec0 0x7efbfc1ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbfc0c4d30 0x7efbfc152e10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 --2- 172.21.15.45:0/654218579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0c1d60 0x7efbfc0a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.623+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 >> 172.21.15.45:0/654218579 conn(0x7efbfc066ce0 msgr2=0x7efbfc0a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.624+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 shutdown_connections 2023-12-08T08:16:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.624+0000 7efc01bae640 1 -- 172.21.15.45:0/654218579 wait complete. 2023-12-08T08:16:58.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:16:58.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.873+0000 7f8e7e7c9640 1 Processor -- start 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.874+0000 7f8e7e7c9640 1 -- start start 2023-12-08T08:16:58.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.875+0000 7f8e7e7c9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e78158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.875+0000 7f8e7e7c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780c51f0 con 0x7f8e7806d1d0 2023-12-08T08:16:58.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.875+0000 7f8e7e7c9640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780c54d0 con 0x7f8e780c0bf0 2023-12-08T08:16:58.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.875+0000 7f8e7e7c9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780c1ce0 con 0x7f8e780c59e0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.875+0000 7f8e7cfc6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8e7806d1d0 0x7f8e7806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41152/0 (socket says 172.21.15.45:41152) 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e7cfc6640 1 -- 172.21.15.45:0/2149890756 learned_addr learned my addr 172.21.15.45:0/2149890756 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e78158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487572112 0 0) 0x7f8e780c51f0 con 0x7f8e7806d1d0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e64003520 con 0x7f8e7806d1d0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327077930 0 0) 0x7f8e64003520 con 0x7f8e7806d1d0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 msgr2=0x7f8e78158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e78158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.876+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 >> v1:172.21.15.114:6789/0 conn(0x7f8e780c0bf0 legacy=0x7f8e78154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78157ba0 con 0x7f8e7806d1d0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8e68001670 con 0x7f8e7806d1d0 2023-12-08T08:16:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 >> v1:172.21.15.45:6789/0 conn(0x7f8e7806d1d0 legacy=0x7f8e7806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e640039a0 0x7f8e64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640047c0 0x7f8e64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bac0 con 0x7f8e640039a0 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bc30 con 0x7f8e640047c0 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bdf0 con 0x7f8e780c59e0 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e640039a0 0x7f8e64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e7dfc8640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.877+0000 7f8e7cfc6640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640047c0 0x7f8e64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.878+0000 7f8e7d7c7640 1 -- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 msgr2=0x7f8e64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.878+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780c59e0 0x7f8e64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.878+0000 7f8e7d7c7640 1 -- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640047c0 msgr2=0x7f8e64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.878+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640047c0 0x7f8e64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.878+0000 7f8e7d7c7640 1 -- 172.21.15.45:0/2149890756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64003520 con 0x7f8e640039a0 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.879+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e640039a0 0x7f8e64003dc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009f90 tx=0x7f8e640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae3f6aded22c2b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.879+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7402cbd0 con 0x7f8e640039a0 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.879+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7400f040 con 0x7f8e640039a0 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.879+0000 7f8e6ffff640 1 -- 172.21.15.45:0/2149890756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74034440 con 0x7f8e640039a0 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/2149890756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e640039a0 msgr2=0x7f8e64003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/2149890756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e640039a0 0x7f8e64003dc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009f90 tx=0x7f8e640057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7dfc8640 1 -- 172.21.15.45:0/2149890756 reap_dead start 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/2149890756 shutdown_connections 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/2149890756 >> 172.21.15.45:0/2149890756 conn(0x7f8e78066ce0 msgr2=0x7f8e780a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/2149890756 shutdown_connections 2023-12-08T08:16:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.880+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/2149890756 wait complete. 2023-12-08T08:16:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.882+0000 7f8e7e7c9640 1 Processor -- start 2023-12-08T08:16:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.882+0000 7f8e7e7c9640 1 -- start start 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640039a0 0x7f8e780a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780a66b0 0x7f8e78071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780703d0 con 0x7f8e780a6230 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e78153660 con 0x7f8e640039a0 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7e7c9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7806f950 con 0x7f8e780a66b0 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7cfc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7cfc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45606/0 (socket says 172.21.15.45:45606) 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7cfc6640 1 -- 172.21.15.45:0/3994948631 learned_addr learned my addr 172.21.15.45:0/3994948631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7dfc8640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780a66b0 0x7f8e78071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.883+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640039a0 0x7f8e780a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 -- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780a66b0 msgr2=0x7f8e78071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780a66b0 0x7f8e78071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 -- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640039a0 msgr2=0x7f8e780a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640039a0 0x7f8e780a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 -- 172.21.15.45:0/3994948631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e781ea0f0 con 0x7f8e780a6230 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7cfc6640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800e790 tx=0x7f8e6800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800eea0 con 0x7f8e780a6230 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800c8d0 con 0x7f8e780a6230 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e781ea390 con 0x7f8e780a6230 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800cc80 con 0x7f8e780a6230 2023-12-08T08:16:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.884+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7806fe80 con 0x7f8e780a6230 2023-12-08T08:16:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.886+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e780678c0 con 0x7f8e780a6230 2023-12-08T08:16:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.887+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e6801d460 con 0x7f8e780a6230 2023-12-08T08:16:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.888+0000 7f8e6dffb640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 0x7f8e5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.888+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8e680899b0 con 0x7f8e780a6230 2023-12-08T08:16:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.888+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 0x7f8e5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.889+0000 7f8e7d7c7640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 0x7f8e5c06d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8e74036000 tx=0x7f8e7402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:58.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:58.893+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e680580e0 con 0x7f8e780a6230 2023-12-08T08:16:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.088+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e780743e0 con 0x7f8e780a6230 2023-12-08T08:16:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.089+0000 7f8e6dffb640 1 -- 172.21.15.45:0/3994948631 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e68087e60 con 0x7f8e780a6230 2023-12-08T08:16:59.092 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:16:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 msgr2=0x7f8e5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 0x7f8e5c06d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8e74036000 tx=0x7f8e7402e000 comp rx=0 tx=0).stop 2023-12-08T08:16:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 msgr2=0x7f8e780717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800e790 tx=0x7f8e6800ec50 comp rx=0 tx=0).stop 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 shutdown_connections 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8e5c06ae40 0x7f8e5c06d300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e780a66b0 0x7f8e78071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e780a6230 0x7f8e780717b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 --2- 172.21.15.45:0/3994948631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e640039a0 0x7f8e780a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.092+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 >> 172.21.15.45:0/3994948631 conn(0x7f8e78066ce0 msgr2=0x7f8e78152bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.093+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 shutdown_connections 2023-12-08T08:16:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.093+0000 7f8e7e7c9640 1 -- 172.21.15.45:0/3994948631 wait complete. 2023-12-08T08:16:59.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:16:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.343+0000 7fa74b59e640 1 Processor -- start 2023-12-08T08:16:59.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.343+0000 7fa74b59e640 1 -- start start 2023-12-08T08:16:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa74b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa74c0a4d10 0x7fa74c155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa74b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0c60c0 con 0x7fa74c0c4970 2023-12-08T08:16:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa74b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c152dc0 con 0x7fa74c14c280 2023-12-08T08:16:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa74b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c1563e0 con 0x7fa74c0a4d10 2023-12-08T08:16:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa743fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa74c0c4970 0x7fa74c155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41156/0 (socket says 172.21.15.45:41156) 2023-12-08T08:16:59.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa743fff640 1 -- 172.21.15.45:0/2082346180 learned_addr learned my addr 172.21.15.45:0/2082346180 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa74ad9d640 1 --2- 172.21.15.45:0/2082346180 >> v2:172.21.15.114:3300/0 conn(0x7fa74c0a4d10 0x7fa74c155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.345+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681934428 0 0) 0x7fa734001110 con 0x7fa74c0c4970 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa738003520 con 0x7fa74c0c4970 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227698181 0 0) 0x7fa738003520 con 0x7fa74c0c4970 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 >> v2:172.21.15.114:3300/0 conn(0x7fa74c0a4d10 msgr2=0x7fa74c155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 --2- 172.21.15.45:0/2082346180 >> v2:172.21.15.114:3300/0 conn(0x7fa74c0a4d10 0x7fa74c155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 >> v1:172.21.15.114:6789/0 conn(0x7fa74c14c280 legacy=0x7fa74c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c1521d0 con 0x7fa74c0c4970 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fa734001800 con 0x7fa74c0c4970 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 >> v1:172.21.15.45:6789/0 conn(0x7fa74c0c4970 legacy=0x7fa74c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa738003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa7380047c0 0x7fa738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7380052a0 0x7fa73800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1563e0 con 0x7fa7380039c0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73800c1c0 con 0x7fa7380052a0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73800c380 con 0x7fa7380047c0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.346+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa738003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74ad9d640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7380052a0 0x7fa73800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa743fff640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa7380047c0 0x7fa738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74a59c640 1 -- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa7380047c0 msgr2=0x7fa738004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa7380047c0 0x7fa738004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74a59c640 1 -- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7380052a0 msgr2=0x7fa73800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:59.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7380052a0 0x7fa73800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74a59c640 1 -- 172.21.15.45:0/2082346180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738003520 con 0x7fa7380039c0 2023-12-08T08:16:59.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa74ad9d640 1 -- 172.21.15.45:0/2082346180 reap_dead start 2023-12-08T08:16:59.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.347+0000 7fa743fff640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa7380047c0 0x7fa738004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.348+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa738003de0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001750 tx=0x7fa7380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc1e1bbf08f2694 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.348+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0052d0 con 0x7fa7380039c0 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.348+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c02e050 con 0x7fa7380039c0 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.348+0000 7fa749d9b640 1 -- 172.21.15.45:0/2082346180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c003830 con 0x7fa7380039c0 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 -- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 msgr2=0x7fa738003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa738003de0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001750 tx=0x7fa7380057f0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 -- 172.21.15.45:0/2082346180 shutdown_connections 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2082346180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa738003de0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 -- 172.21.15.45:0/2082346180 >> 172.21.15.45:0/2082346180 conn(0x7fa74c066ce0 msgr2=0x7fa74c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 -- 172.21.15.45:0/2082346180 shutdown_connections 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.349+0000 7fa74b59e640 1 -- 172.21.15.45:0/2082346180 wait complete. 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.351+0000 7fa74b59e640 1 Processor -- start 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.351+0000 7fa74b59e640 1 -- start start 2023-12-08T08:16:59.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa74c0a6900 0x7fa74c0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa74c0a6d80 0x7fa74c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0a5eb0 con 0x7fa7380039c0 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0a6470 con 0x7fa74c0a6d80 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c071aa0 con 0x7fa74c0a6900 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45622/0 (socket says 172.21.15.45:45622) 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.352+0000 7fa74a59c640 1 -- 172.21.15.45:0/2123077524 learned_addr learned my addr 172.21.15.45:0/2123077524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa743fff640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa74c0a6900 0x7fa74c0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 -- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa74c0a6900 msgr2=0x7fa74c0721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa74c0a6900 0x7fa74c0721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 -- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa74c0a6d80 msgr2=0x7fa74c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa74c0a6d80 0x7fa74c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 -- 172.21.15.45:0/2123077524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0704b0 con 0x7fa7380039c0 2023-12-08T08:16:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa74a59c640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa73c02bc00 tx=0x7fa73c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.353+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c007640 con 0x7fa7380039c0 2023-12-08T08:16:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.354+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0069e0 con 0x7fa7380039c0 2023-12-08T08:16:59.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.354+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c006d70 con 0x7fa7380039c0 2023-12-08T08:16:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.354+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c070790 con 0x7fa7380039c0 2023-12-08T08:16:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.354+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c070140 con 0x7fa7380039c0 2023-12-08T08:16:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.355+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c0678c0 con 0x7fa7380039c0 2023-12-08T08:16:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.356+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa73c0035f0 con 0x7fa7380039c0 2023-12-08T08:16:59.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.357+0000 7fa742ffd640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 0x7fa72c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.357+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fa73c0ab7d0 con 0x7fa7380039c0 2023-12-08T08:16:59.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.357+0000 7fa743fff640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 0x7fa72c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.358+0000 7fa743fff640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 0x7fa72c06d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa734001270 tx=0x7fa734009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.361+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa73c0763d0 con 0x7fa7380039c0 2023-12-08T08:16:59.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.556+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa74c0743e0 con 0x7fa7380039c0 2023-12-08T08:16:59.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.557+0000 7fa742ffd640 1 -- 172.21.15.45:0/2123077524 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa73c0799f0 con 0x7fa7380039c0 2023-12-08T08:16:59.559 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:16:59.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.559+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 msgr2=0x7fa72c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.559+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 0x7fa72c06d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa734001270 tx=0x7fa734009040 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.559+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 msgr2=0x7fa74c153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.559+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa73c02bc00 tx=0x7fa73c001120 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 shutdown_connections 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa72c06ae70 0x7fa72c06d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa74c0a6900 0x7fa74c0721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa74c0a6d80 0x7fa74c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 --2- 172.21.15.45:0/2123077524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7380039c0 0x7fa74c153680 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 >> 172.21.15.45:0/2123077524 conn(0x7fa74c066ce0 msgr2=0x7fa74c148900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 shutdown_connections 2023-12-08T08:16:59.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.560+0000 7fa74b59e640 1 -- 172.21.15.45:0/2123077524 wait complete. 2023-12-08T08:16:59.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:16:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.809+0000 7fd31ebb5640 1 Processor -- start 2023-12-08T08:16:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.809+0000 7fd31ebb5640 1 -- start start 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31ebb5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd3180c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31ebb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3180c4d30 0x7fd31806c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31ebb5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180c16b0 con 0x7fd3180c1d60 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31ebb5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180a8b30 con 0x7fd3180c4d30 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31ebb5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180c65d0 con 0x7fd318151ec0 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31d3b2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd3180c1d60 0x7fd31806ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41162/0 (socket says 172.21.15.45:41162) 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31d3b2640 1 -- 172.21.15.45:0/419162126 learned_addr learned my addr 172.21.15.45:0/419162126 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:16:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31e3b4640 1 --2- 172.21.15.45:0/419162126 >> v2:172.21.15.45:3300/0 conn(0x7fd3180c4d30 0x7fd31806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.811+0000 7fd31dbb3640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd3180c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31cbb1640 1 -- 172.21.15.45:0/419162126 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407560868 0 0) 0x7fd3180c16b0 con 0x7fd3180c1d60 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31cbb1640 1 -- 172.21.15.45:0/419162126 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd304003520 con 0x7fd3180c1d60 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31e3b4640 1 -- 172.21.15.45:0/419162126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 msgr2=0x7fd3180c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31e3b4640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd3180c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31e3b4640 1 -- 172.21.15.45:0/419162126 >> v1:172.21.15.45:6789/0 conn(0x7fd3180c1d60 legacy=0x7fd31806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31e3b4640 1 -- 172.21.15.45:0/419162126 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180c5810 con 0x7fd3180c4d30 2023-12-08T08:16:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.812+0000 7fd31dbb3640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd3180c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:16:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.813+0000 7fd31e3b4640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c4d30 0x7fd31806c120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd310009d90 tx=0x7fd31002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204e94858cb7e387 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.813+0000 7fd31cbb1640 1 -- 172.21.15.45:0/419162126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31002cbd0 con 0x7fd3180c4d30 2023-12-08T08:16:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31cbb1640 1 -- 172.21.15.45:0/419162126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31002cd30 con 0x7fd3180c4d30 2023-12-08T08:16:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31cbb1640 1 -- 172.21.15.45:0/419162126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31002cea0 con 0x7fd3180c4d30 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 -- 172.21.15.45:0/419162126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c4d30 msgr2=0x7fd31806c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c4d30 0x7fd31806c120 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd310009d90 tx=0x7fd31002be20 comp rx=0 tx=0).stop 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 -- 172.21.15.45:0/419162126 shutdown_connections 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c4d30 0x7fd31806c120 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/419162126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd3180c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 -- 172.21.15.45:0/419162126 >> 172.21.15.45:0/419162126 conn(0x7fd318066ce0 msgr2=0x7fd3180a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 -- 172.21.15.45:0/419162126 shutdown_connections 2023-12-08T08:16:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.814+0000 7fd31ebb5640 1 -- 172.21.15.45:0/419162126 wait complete. 2023-12-08T08:16:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.816+0000 7fd31ebb5640 1 Processor -- start 2023-12-08T08:16:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.816+0000 7fd31ebb5640 1 -- start start 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3180c4d30 0x7fd3181eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd318148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31814a6b0 con 0x7fd3180c1d60 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31814c820 con 0x7fd3180c4d30 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31ebb5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31814a8c0 con 0x7fd318151ec0 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.817+0000 7fd31dbb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45634/0 (socket says 172.21.15.45:45634) 2023-12-08T08:16:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 -- 172.21.15.45:0/3151941670 learned_addr learned my addr 172.21.15.45:0/3151941670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:16:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 -- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 msgr2=0x7fd318148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd318148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 -- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3180c4d30 msgr2=0x7fd3181eabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3180c4d30 0x7fd3181eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 -- 172.21.15.45:0/3151941670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009a70 con 0x7fd3180c1d60 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd31dbb3640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd31400e7e0 tx=0x7fd31400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.818+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314004030 con 0x7fd3180c1d60 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.819+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314004190 con 0x7fd3180c1d60 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.819+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400c6d0 con 0x7fd3180c1d60 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.819+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31814aba0 con 0x7fd3180c1d60 2023-12-08T08:16:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.819+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31814c440 con 0x7fd3180c1d60 2023-12-08T08:16:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.820+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3180678c0 con 0x7fd3180c1d60 2023-12-08T08:16:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.821+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd31400c830 con 0x7fd3180c1d60 2023-12-08T08:16:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.822+0000 7fd30e7fc640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 0x7fd2fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:16:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.822+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd314089810 con 0x7fd3180c1d60 2023-12-08T08:16:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.822+0000 7fd31d3b2640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 0x7fd2fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:16:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.823+0000 7fd31d3b2640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 0x7fd2fc06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd318073270 tx=0x7fd308007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:16:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:16:59.826+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd314057e10 con 0x7fd3180c1d60 2023-12-08T08:17:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.020+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3180743e0 con 0x7fd3180c1d60 2023-12-08T08:17:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.021+0000 7fd30e7fc640 1 -- 172.21.15.45:0/3151941670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd3140579a0 con 0x7fd3180c1d60 2023-12-08T08:17:00.024 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 msgr2=0x7fd2fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 0x7fd2fc06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd318073270 tx=0x7fd308007930 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 msgr2=0x7fd31814b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd31400e7e0 tx=0x7fd31400eca0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 shutdown_connections 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd2fc06ae70 0x7fd2fc06d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd318151ec0 0x7fd318148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3180c4d30 0x7fd3181eabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 --2- 172.21.15.45:0/3151941670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180c1d60 0x7fd31814b3a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 >> 172.21.15.45:0/3151941670 conn(0x7fd318066ce0 msgr2=0x7fd31806ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:00.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 shutdown_connections 2023-12-08T08:17:00.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.024+0000 7fd31ebb5640 1 -- 172.21.15.45:0/3151941670 wait complete. 2023-12-08T08:17:00.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:17:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.269+0000 7f3dd5b06640 1 Processor -- start 2023-12-08T08:17:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.269+0000 7f3dd5b06640 1 -- start start 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.270+0000 7f3dd5b06640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dd014c280 0x7f3dd00a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.270+0000 7f3dd5b06640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00c60c0 con 0x7f3dd0155790 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.270+0000 7f3dd5b06640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd0152dc0 con 0x7f3dd00c4970 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.270+0000 7f3dd5b06640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd01521d0 con 0x7f3dd014c280 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.271+0000 7f3dd5305640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3dd0155790 0x7f3dd0155ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41166/0 (socket says 172.21.15.45:41166) 2023-12-08T08:17:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.271+0000 7f3dd5305640 1 -- 172.21.15.45:0/853639088 learned_addr learned my addr 172.21.15.45:0/853639088 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.271+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723132435 0 0) 0x7f3dc8001490 con 0x7f3dd0155790 2023-12-08T08:17:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.271+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc0003520 con 0x7f3dd0155790 2023-12-08T08:17:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.271+0000 7f3dd4b04640 1 --2- 172.21.15.45:0/853639088 >> v2:172.21.15.114:3300/0 conn(0x7f3dd014c280 0x7f3dd00a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 12253936 0 0) 0x7f3dc0003520 con 0x7f3dd0155790 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 >> v2:172.21.15.114:3300/0 conn(0x7f3dd014c280 msgr2=0x7f3dd00a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 --2- 172.21.15.45:0/853639088 >> v2:172.21.15.114:3300/0 conn(0x7f3dd014c280 0x7f3dd00a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 >> v1:172.21.15.114:6789/0 conn(0x7f3dd00c4970 legacy=0x7f3dd006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd014c660 con 0x7f3dd0155790 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f3dc8001b80 con 0x7f3dd0155790 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 >> v1:172.21.15.45:6789/0 conn(0x7f3dd0155790 legacy=0x7f3dd0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc0003970 0x7f3dc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dc00047c0 0x7f3dc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01521d0 con 0x7f3dc00052a0 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc000c170 con 0x7f3dc0003970 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc000c330 con 0x7f3dc00047c0 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.272+0000 7f3dd5305640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd4b04640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc0003970 0x7f3dc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dcffff640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dc00047c0 0x7f3dc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd5305640 1 -- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dc00047c0 msgr2=0x7f3dc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd5305640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dc00047c0 0x7f3dc0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd5305640 1 -- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc0003970 msgr2=0x7f3dc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd5305640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc0003970 0x7f3dc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.273+0000 7f3dd5305640 1 -- 172.21.15.45:0/853639088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0003520 con 0x7f3dc00052a0 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.274+0000 7f3dd5305640 1 -- 172.21.15.45:0/853639088 reap_dead start 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.274+0000 7f3dd5305640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dc000b980 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800a800 tx=0x7f3dc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e408e0fbf5b5b8e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.274+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8034630 con 0x7f3dc00052a0 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.274+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802f070 con 0x7f3dc00052a0 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.274+0000 7f3dcf7fe640 1 -- 172.21.15.45:0/853639088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80349f0 con 0x7f3dc00052a0 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 -- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 msgr2=0x7f3dc000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dc000b980 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800a800 tx=0x7f3dc00057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 -- 172.21.15.45:0/853639088 shutdown_connections 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/853639088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dc000b980 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 -- 172.21.15.45:0/853639088 >> 172.21.15.45:0/853639088 conn(0x7f3dd0066ce0 msgr2=0x7f3dd00a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 -- 172.21.15.45:0/853639088 shutdown_connections 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.275+0000 7f3dd5b06640 1 -- 172.21.15.45:0/853639088 wait complete. 2023-12-08T08:17:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.277+0000 7f3dd5b06640 1 Processor -- start 2023-12-08T08:17:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.277+0000 7f3dd5b06640 1 -- start start 2023-12-08T08:17:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd0151bd0 0x7f3dd00c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dd00c17a0 0x7f3dd01e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0072610 con 0x7f3dc00052a0 2023-12-08T08:17:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00a54a0 con 0x7f3dd0151bd0 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd5b06640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd014b7c0 con 0x7f3dd00c17a0 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd4b04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd4b04640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45652/0 (socket says 172.21.15.45:45652) 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.278+0000 7f3dd4b04640 1 -- 172.21.15.45:0/4006986477 learned_addr learned my addr 172.21.15.45:0/4006986477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 -- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dd00c17a0 msgr2=0x7f3dd01e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dd00c17a0 0x7f3dd01e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 -- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd0151bd0 msgr2=0x7f3dd00c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd0151bd0 0x7f3dd00c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 -- 172.21.15.45:0/4006986477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00a56f0 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd4b04640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400f5e0 tx=0x7f3dc400faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4013810 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc4013970 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4013ce0 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.279+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd014b450 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.280+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd014ab40 con 0x7f3dc00052a0 2023-12-08T08:17:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.281+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00678c0 con 0x7f3dc00052a0 2023-12-08T08:17:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.282+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dc401f460 con 0x7f3dc00052a0 2023-12-08T08:17:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.283+0000 7f3dcd7fa640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 0x7f3db406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.283+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3dc4089e10 con 0x7f3dc00052a0 2023-12-08T08:17:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.283+0000 7f3dcffff640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 0x7f3db406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.284+0000 7f3dcffff640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 0x7f3db406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc000f60 tx=0x7f3dbc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.287+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dc408d030 con 0x7f3dc00052a0 2023-12-08T08:17:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.482+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3dd00743e0 con 0x7f3dc00052a0 2023-12-08T08:17:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.483+0000 7f3dcd7fa640 1 -- 172.21.15.45:0/4006986477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3dc40584a0 con 0x7f3dc00052a0 2023-12-08T08:17:00.486 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 msgr2=0x7f3db406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 0x7f3db406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc000f60 tx=0x7f3dbc009040 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 msgr2=0x7f3dd00720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400f5e0 tx=0x7f3dc400faa0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 shutdown_connections 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3db406ae70 0x7f3db406d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dd00c17a0 0x7f3dd01e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd0151bd0 0x7f3dd00c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 --2- 172.21.15.45:0/4006986477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dc00052a0 0x7f3dd00720d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 >> 172.21.15.45:0/4006986477 conn(0x7f3dd0066ce0 msgr2=0x7f3dd006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 shutdown_connections 2023-12-08T08:17:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.486+0000 7f3dd5b06640 1 -- 172.21.15.45:0/4006986477 wait complete. 2023-12-08T08:17:00.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:17:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.717+0000 7f7aced75640 1 Processor -- start 2023-12-08T08:17:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.717+0000 7f7aced75640 1 -- start start 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac814e220 0x7f7ac80c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac806c260 0x7f7ac80c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 0x7f7ac806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80c58c0 con 0x7f7ac814e220 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8154d00 con 0x7f7ac80c8140 2023-12-08T08:17:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7aced75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac81543a0 con 0x7f7ac806c260 2023-12-08T08:17:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.719+0000 7f7acdd73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac814e220 0x7f7ac80c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac814e220 0x7f7ac80c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45658/0 (socket says 172.21.15.45:45658) 2023-12-08T08:17:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 -- 172.21.15.45:0/2214787678 learned_addr learned my addr 172.21.15.45:0/2214787678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acd572640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac806c260 0x7f7ac80c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7ace574640 1 --2- 172.21.15.45:0/2214787678 >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 0x7f7ac806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 -- 172.21.15.45:0/2214787678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac806c260 msgr2=0x7f7ac80c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac806c260 0x7f7ac80c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 -- 172.21.15.45:0/2214787678 >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 msgr2=0x7f7ac806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 --2- 172.21.15.45:0/2214787678 >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 0x7f7ac806ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7acdd73640 1 -- 172.21.15.45:0/2214787678 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8155120 con 0x7f7ac814e220 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.720+0000 7f7ace574640 1 --2- 172.21.15.45:0/2214787678 >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 0x7f7ac806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.722+0000 7f7acdd73640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac814e220 0x7f7ac80c4460 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808bd10 tx=0x7f7ac402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949a1c6d511aa420 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.722+0000 7f7accd71640 1 -- 172.21.15.45:0/2214787678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031860 con 0x7f7ac814e220 2023-12-08T08:17:00.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.722+0000 7f7accd71640 1 -- 172.21.15.45:0/2214787678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40319c0 con 0x7f7ac814e220 2023-12-08T08:17:00.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.722+0000 7f7accd71640 1 -- 172.21.15.45:0/2214787678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031d50 con 0x7f7ac814e220 2023-12-08T08:17:00.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 -- 172.21.15.45:0/2214787678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac814e220 msgr2=0x7f7ac80c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac814e220 0x7f7ac80c4460 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808bd10 tx=0x7f7ac402b900 comp rx=0 tx=0).stop 2023-12-08T08:17:00.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 -- 172.21.15.45:0/2214787678 shutdown_connections 2023-12-08T08:17:00.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 --2- 172.21.15.45:0/2214787678 >> v2:172.21.15.114:3300/0 conn(0x7f7ac80c8140 0x7f7ac806ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac806c260 0x7f7ac80c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 --2- 172.21.15.45:0/2214787678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac814e220 0x7f7ac80c4460 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 -- 172.21.15.45:0/2214787678 >> 172.21.15.45:0/2214787678 conn(0x7f7ac80ab6d0 msgr2=0x7f7ac80abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 -- 172.21.15.45:0/2214787678 shutdown_connections 2023-12-08T08:17:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.723+0000 7f7aced75640 1 -- 172.21.15.45:0/2214787678 wait complete. 2023-12-08T08:17:00.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.725+0000 7f7aced75640 1 Processor -- start 2023-12-08T08:17:00.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.725+0000 7f7aced75640 1 -- start start 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ac80c8140 0x7f7ac814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac814e220 0x7f7ac8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8148890 con 0x7f7ac806c260 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac81495d0 con 0x7f7ac80c8140 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7aced75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac81498b0 con 0x7f7ac814e220 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.726+0000 7f7acdd73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45672/0 (socket says 172.21.15.45:45672) 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 -- 172.21.15.45:0/1491856198 learned_addr learned my addr 172.21.15.45:0/1491856198 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acd572640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ac80c8140 0x7f7ac814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7ace574640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac814e220 0x7f7ac8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 -- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac814e220 msgr2=0x7f7ac8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac814e220 0x7f7ac8156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 -- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ac80c8140 msgr2=0x7f7ac814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ac80c8140 0x7f7ac814b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.727+0000 7f7acdd73640 1 -- 172.21.15.45:0/1491856198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40094d0 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7acdd73640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ac402b940 tx=0x7f7ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac403ad30 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40443f0 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40447a0 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8148520 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.728+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac8158680 con 0x7f7ac806c260 2023-12-08T08:17:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.730+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac80743e0 con 0x7f7ac806c260 2023-12-08T08:17:00.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.730+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ac404d450 con 0x7f7ac806c260 2023-12-08T08:17:00.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.731+0000 7f7abe7fc640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:00.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.731+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7ac40abff0 con 0x7f7ac806c260 2023-12-08T08:17:00.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.732+0000 7f7acd572640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:00.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.732+0000 7f7acd572640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 0x7f7aac06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80c32c0 tx=0x7f7ab8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:00.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.736+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ac4076c70 con 0x7f7ac806c260 2023-12-08T08:17:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.947+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ac80c79e0 con 0x7f7ac806c260 2023-12-08T08:17:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.948+0000 7f7abe7fc640 1 -- 172.21.15.45:0/1491856198 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ac4035020 con 0x7f7ac806c260 2023-12-08T08:17:00.951 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:17:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 msgr2=0x7f7aac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 0x7f7aac06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80c32c0 tx=0x7f7ab8008040 comp rx=0 tx=0).stop 2023-12-08T08:17:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 msgr2=0x7f7ac8158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ac402b940 tx=0x7f7ac40046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 shutdown_connections 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7ac814e220 0x7f7ac8156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ac80c8140 0x7f7ac814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 --2- 172.21.15.45:0/1491856198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac806c260 0x7f7ac8158140 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.950+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 >> 172.21.15.45:0/1491856198 conn(0x7f7ac80ab6d0 msgr2=0x7f7ac814d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.951+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 shutdown_connections 2023-12-08T08:17:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:00.951+0000 7f7aced75640 1 -- 172.21.15.45:0/1491856198 wait complete. 2023-12-08T08:17:00.974 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:17:00.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:00.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:01.074 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:17:01.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:01.074 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:17:01.134 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:17:01.134 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:01.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:17:01.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:17:01.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.402+0000 7f163b547640 1 Processor -- start 2023-12-08T08:17:01.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.402+0000 7f163b547640 1 -- start start 2023-12-08T08:17:01.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.403+0000 7f163b547640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16340beb30 0x7f16341542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.403+0000 7f163b547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16340a7770 0x7f16340a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.403+0000 7f163b547640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340a7300 con 0x7f163414e260 2023-12-08T08:17:01.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.403+0000 7f163b547640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340bfb90 con 0x7f16340a7770 2023-12-08T08:17:01.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.403+0000 7f163b547640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16340bf010 con 0x7f16340beb30 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16340a7770 0x7f16340a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f1639d44640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16340beb30 0x7f16341542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16340a7770 0x7f16340a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45680/0 (socket says 172.21.15.45:45680) 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163a545640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f163414e260 0x7f163406c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:57644/0 (socket says 172.21.15.45:57644) 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 -- 172.21.15.45:0/1629299690 learned_addr learned my addr 172.21.15.45:0/1629299690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 -- 172.21.15.45:0/1629299690 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16340beb30 msgr2=0x7f16341542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:01.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 --2- 172.21.15.45:0/1629299690 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16340beb30 0x7f16341542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 -- 172.21.15.45:0/1629299690 >> v1:172.21.15.114:6789/0 conn(0x7f163414e260 legacy=0x7f163406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.404+0000 7f163ad46640 1 -- 172.21.15.45:0/1629299690 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340bf2f0 con 0x7f16340a7770 2023-12-08T08:17:01.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f163ad46640 1 --2- 172.21.15.45:0/1629299690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340a7770 0x7f16340a7ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f162c009e50 tx=0x7f162c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bdc2986d700ba0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:01.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f1639543640 1 -- 172.21.15.45:0/1629299690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c02cb00 con 0x7f16340a7770 2023-12-08T08:17:01.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f1639543640 1 -- 172.21.15.45:0/1629299690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c02cc60 con 0x7f16340a7770 2023-12-08T08:17:01.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f1639543640 1 -- 172.21.15.45:0/1629299690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0343f0 con 0x7f16340a7770 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f163b547640 1 -- 172.21.15.45:0/1629299690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340a7770 msgr2=0x7f16340a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.406+0000 7f163b547640 1 --2- 172.21.15.45:0/1629299690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340a7770 0x7f16340a7ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f162c009e50 tx=0x7f162c02bf60 comp rx=0 tx=0).stop 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 -- 172.21.15.45:0/1629299690 shutdown_connections 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 --2- 172.21.15.45:0/1629299690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340a7770 0x7f16340a7ba0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 --2- 172.21.15.45:0/1629299690 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16340beb30 0x7f16341542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 -- 172.21.15.45:0/1629299690 >> 172.21.15.45:0/1629299690 conn(0x7f16340c5780 msgr2=0x7f16340c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 -- 172.21.15.45:0/1629299690 shutdown_connections 2023-12-08T08:17:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.407+0000 7f163b547640 1 -- 172.21.15.45:0/1629299690 wait complete. 2023-12-08T08:17:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.408+0000 7f163b547640 1 Processor -- start 2023-12-08T08:17:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 -- start start 2023-12-08T08:17:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 0x7f16340c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f163414e260 0x7f1634143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c52e0 con 0x7f16340beb30 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1634154340 con 0x7f16340a7770 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.409+0000 7f163b547640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634154620 con 0x7f163414e260 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45694/0 (socket says 172.21.15.45:45694) 2023-12-08T08:17:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 -- 172.21.15.45:0/4183087255 learned_addr learned my addr 172.21.15.45:0/4183087255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 -- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f163414e260 msgr2=0x7f1634143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f163414e260 0x7f1634143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f163a545640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 0x7f16340c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 -- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 msgr2=0x7f16340c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 0x7f16340c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f1639d44640 1 -- 172.21.15.45:0/4183087255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c009b30 con 0x7f16340beb30 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.410+0000 7f163a545640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 0x7f16340c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f1639d44640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f162400e9b0 tx=0x7f162400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624009670 con 0x7f16340beb30 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162400c9a0 con 0x7f16340beb30 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400cd50 con 0x7f16340beb30 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1634154900 con 0x7f16340beb30 2023-12-08T08:17:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.411+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341511f0 con 0x7f16340beb30 2023-12-08T08:17:01.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.412+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340743e0 con 0x7f16340beb30 2023-12-08T08:17:01.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.413+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1624013470 con 0x7f16340beb30 2023-12-08T08:17:01.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.414+0000 7f162affd640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 0x7f161806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:01.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.415+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1624089e00 con 0x7f16340beb30 2023-12-08T08:17:01.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.415+0000 7f163a545640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 0x7f161806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:01.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.415+0000 7f163a545640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 0x7f161806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1630000f60 tx=0x7f1630009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.419+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1624054970 con 0x7f16340beb30 2023-12-08T08:17:01.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.652+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f163406d650 con 0x7f16340beb30 2023-12-08T08:17:01.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.654+0000 7f162affd640 1 -- 172.21.15.45:0/4183087255 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f16240210b0 con 0x7f16340beb30 2023-12-08T08:17:01.656 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:17:01.656 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:17:01.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.655+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 msgr2=0x7f161806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.655+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 0x7f161806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1630000f60 tx=0x7f1630009040 comp rx=0 tx=0).stop 2023-12-08T08:17:01.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.655+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 msgr2=0x7f1634143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.655+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f162400e9b0 tx=0x7f162400ee70 comp rx=0 tx=0).stop 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 shutdown_connections 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f161806ae40 0x7f161806d300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f163414e260 0x7f1634143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16340beb30 0x7f1634143a70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 --2- 172.21.15.45:0/4183087255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16340a7770 0x7f16340c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 >> 172.21.15.45:0/4183087255 conn(0x7f16340c5780 msgr2=0x7f16340a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 shutdown_connections 2023-12-08T08:17:01.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:01.657+0000 7f163b547640 1 -- 172.21.15.45:0/4183087255 wait complete. 2023-12-08T08:17:01.676 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:17:01.676 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:17:01.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:17:01.676 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:17:01.677 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:01.677 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:17:01.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:17:01.677 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.fQ5KfaSy4u 2023-12-08T08:17:01.677 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:17:01.729 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.JefZBDAYfd 2023-12-08T08:17:01.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /tmp/tmp.fQ5KfaSy4u /tmp/tmp.JefZBDAYfd 2023-12-08T08:17:01.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.JefZBDAYfd 2023-12-08T08:17:01.977 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.JefZBDAYfd is 185B 2023-12-08T08:17:02.045 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.JefZBDAYfd 2023-12-08T08:17:02.100 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:17:02.100 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:17:02.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.100 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:17:02.152 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:17:02.152 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:17:02.152 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:17:02.153 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42010sec preferred_lft 42010sec 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:17:02.154 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:17:02.155 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:02.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.156 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:17:02.251 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:17:02.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.256 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:17:02.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:17:02.318 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:17:02.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.516 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:17:02.573 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:17:02.573 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:17:02.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:17:02.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:02.678 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:02.737 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:17:02.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:02.738 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:02.794 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:17:02.795 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/tmp/tmp.fQ5KfaSy4u of=/dev/stdout 2023-12-08T08:17:02.848 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:17:02.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:02.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:02.992 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:02.993 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:02.993 INFO:teuthology.orchestra.run.smithi045.stdout:keyring.get_secret failed 2023-12-08T08:17:03.028 INFO:teuthology.orchestra.run.smithi045.stderr:mount.ceph: kernel BUG! 2023-12-08T08:17:03.029 INFO:teuthology.orchestra.run.smithi045.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-08T08:17:03.029 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:03.029 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:03.030 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:17:03.030 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: testuser@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:17:03.030 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:17:03.036 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-08T08:17:03.036 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-08T08:17:03.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:17:03.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:17:03.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:17:03.277 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:17:03.277 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:17:03.277 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:03.339 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:17:03.340 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:17:03.340 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:03.399 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:17:03.399 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:03.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.685+0000 7f0771d2e640 1 Processor -- start 2023-12-08T08:17:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.686+0000 7f0771d2e640 1 -- start start 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f0771d2e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 0x7f076c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f0771d2e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f076c1521b0 0x7f076c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f0771d2e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c155850 con 0x7f076c0c1dc0 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f0771d2e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0c0890 con 0x7f076c1521b0 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f0771d2e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0c0b70 con 0x7f076c0a7910 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.687+0000 7f077152d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f076c1521b0 0x7f076c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f076c1521b0 0x7f076c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45704/0 (socket says 172.21.15.45:45704) 2023-12-08T08:17:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 -- 172.21.15.45:0/4089029018 learned_addr learned my addr 172.21.15.45:0/4089029018 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 -- 172.21.15.45:0/4089029018 >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 msgr2=0x7f076c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f0770d2c640 1 --2- 172.21.15.45:0/4089029018 >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 0x7f076c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 --2- 172.21.15.45:0/4089029018 >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 0x7f076c0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 -- 172.21.15.45:0/4089029018 >> v1:172.21.15.114:6789/0 conn(0x7f076c0c1dc0 legacy=0x7f076c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f077152d640 1 -- 172.21.15.45:0/4089029018 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0c0e50 con 0x7f076c1521b0 2023-12-08T08:17:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.688+0000 7f0770d2c640 1 --2- 172.21.15.45:0/4089029018 >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 0x7f076c0c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.689+0000 7f077152d640 1 --2- 172.21.15.45:0/4089029018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c155ce0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f076c06ac30 tx=0x7f076402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc93712df5c0604 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f076b7fe640 1 -- 172.21.15.45:0/4089029018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076402c9f0 con 0x7f076c1521b0 2023-12-08T08:17:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f076b7fe640 1 -- 172.21.15.45:0/4089029018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076402cb50 con 0x7f076c1521b0 2023-12-08T08:17:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f076b7fe640 1 -- 172.21.15.45:0/4089029018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640343f0 con 0x7f076c1521b0 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 -- 172.21.15.45:0/4089029018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 msgr2=0x7f076c155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 --2- 172.21.15.45:0/4089029018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c155ce0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f076c06ac30 tx=0x7f076402be50 comp rx=0 tx=0).stop 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 -- 172.21.15.45:0/4089029018 shutdown_connections 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 --2- 172.21.15.45:0/4089029018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c155ce0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 --2- 172.21.15.45:0/4089029018 >> v2:172.21.15.114:3300/0 conn(0x7f076c0a7910 0x7f076c0c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 -- 172.21.15.45:0/4089029018 >> 172.21.15.45:0/4089029018 conn(0x7f076c0c5780 msgr2=0x7f076c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 -- 172.21.15.45:0/4089029018 shutdown_connections 2023-12-08T08:17:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.690+0000 7f0771d2e640 1 -- 172.21.15.45:0/4089029018 wait complete. 2023-12-08T08:17:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.692+0000 7f0771d2e640 1 Processor -- start 2023-12-08T08:17:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.692+0000 7f0771d2e640 1 -- start start 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f076c0a7910 0x7f076c0a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f076c0c1dc0 0x7f076c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1edcb0 con 0x7f076c1521b0 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1ed030 con 0x7f076c0a7910 2023-12-08T08:17:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f0771d2e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1ed310 con 0x7f076c0c1dc0 2023-12-08T08:17:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f077152d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.693+0000 7f077152d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45718/0 (socket says 172.21.15.45:45718) 2023-12-08T08:17:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 -- 172.21.15.45:0/2886034103 learned_addr learned my addr 172.21.15.45:0/2886034103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 -- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f076c0c1dc0 msgr2=0x7f076c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f076bfff640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f076c0c1dc0 0x7f076c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f0770d2c640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f076c0a7910 0x7f076c0a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f076c0c1dc0 0x7f076c154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 -- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f076c0a7910 msgr2=0x7f076c0a5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f076c0a7910 0x7f076c0a5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 -- 172.21.15.45:0/2886034103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009b30 con 0x7f076c1521b0 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.694+0000 7f077152d640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0764009f40 tx=0x7f0764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.695+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076403e450 con 0x7f076c1521b0 2023-12-08T08:17:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.695+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076403e5d0 con 0x7f076c1521b0 2023-12-08T08:17:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.695+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076403e980 con 0x7f076c1521b0 2023-12-08T08:17:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.695+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c1ed5f0 con 0x7f076c1521b0 2023-12-08T08:17:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.695+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c155050 con 0x7f076c1521b0 2023-12-08T08:17:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.696+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c0743e0 con 0x7f076c1521b0 2023-12-08T08:17:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.697+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f076403eae0 con 0x7f076c1521b0 2023-12-08T08:17:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.698+0000 7f07697fa640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 0x7f075006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.698+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f07640aca60 con 0x7f076c1521b0 2023-12-08T08:17:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.698+0000 7f0770d2c640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 0x7f075006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.699+0000 7f0770d2c640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 0x7f075006d350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f076c0c3a70 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.702+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07640776e0 con 0x7f076c1521b0 2023-12-08T08:17:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.900+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f076c0a4f30 con 0x7f076c1521b0 2023-12-08T08:17:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.902+0000 7f07697fa640 1 -- 172.21.15.45:0/2886034103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f076407ad00 con 0x7f076c1521b0 2023-12-08T08:17:03.905 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:03.905 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.905+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 msgr2=0x7f075006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.905+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 0x7f075006d350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f076c0c3a70 tx=0x7f0760008040 comp rx=0 tx=0).stop 2023-12-08T08:17:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.905+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 msgr2=0x7f076c14ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.905+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0764009f40 tx=0x7f0764004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 shutdown_connections 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f075006ae90 0x7f075006d350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f076c0c1dc0 0x7f076c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f076c1521b0 0x7f076c14ba80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 --2- 172.21.15.45:0/2886034103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f076c0a7910 0x7f076c0a5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 >> 172.21.15.45:0/2886034103 conn(0x7f076c0c5780 msgr2=0x7f076c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 shutdown_connections 2023-12-08T08:17:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:03.906+0000 7f0771d2e640 1 -- 172.21.15.45:0/2886034103 wait complete. 2023-12-08T08:17:03.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:16:27.503085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:16:28.455815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:16:43.271897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:16:44.566832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:03.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.157+0000 7f6c05775640 1 Processor -- start 2023-12-08T08:17:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.157+0000 7f6c05775640 1 -- start start 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c05775640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c0006a730 0x7f6c00152d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c05775640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c00153240 0x7f6c0015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c05775640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0006d9e0 con 0x7f6c000c4790 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c05775640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000c5c20 con 0x7f6c00153240 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c05775640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000c3b20 con 0x7f6c0006a730 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6bff7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6c000c4790 0x7f6c0006e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41168/0 (socket says 172.21.15.45:41168) 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6bff7fe640 1 -- 172.21.15.45:0/2463900790 learned_addr learned my addr 172.21.15.45:0/2463900790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6c04f74640 1 --2- 172.21.15.45:0/2463900790 >> v2:172.21.15.45:3300/0 conn(0x7f6c00153240 0x7f6c0015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.159+0000 7f6bfffff640 1 --2- 172.21.15.45:0/2463900790 >> v2:172.21.15.114:3300/0 conn(0x7f6c0006a730 0x7f6c00152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6bfeffd640 1 -- 172.21.15.45:0/2463900790 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992544076 0 0) 0x7f6c0006d9e0 con 0x7f6c000c4790 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6bfeffd640 1 -- 172.21.15.45:0/2463900790 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be8003520 con 0x7f6c000c4790 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6c04f74640 1 -- 172.21.15.45:0/2463900790 >> v2:172.21.15.114:3300/0 conn(0x7f6c0006a730 msgr2=0x7f6c00152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6c04f74640 1 --2- 172.21.15.45:0/2463900790 >> v2:172.21.15.114:3300/0 conn(0x7f6c0006a730 0x7f6c00152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6c04f74640 1 -- 172.21.15.45:0/2463900790 >> v1:172.21.15.45:6789/0 conn(0x7f6c000c4790 legacy=0x7f6c0006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.160+0000 7f6c04f74640 1 -- 172.21.15.45:0/2463900790 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000c3e00 con 0x7f6c00153240 2023-12-08T08:17:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.161+0000 7f6c04f74640 1 --2- 172.21.15.45:0/2463900790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0015ccf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6c00067250 tx=0x7f6bf802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56a74fb8aa5de30 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.161+0000 7f6bfeffd640 1 -- 172.21.15.45:0/2463900790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8031520 con 0x7f6c00153240 2023-12-08T08:17:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.161+0000 7f6bfeffd640 1 -- 172.21.15.45:0/2463900790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8031680 con 0x7f6c00153240 2023-12-08T08:17:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.161+0000 7f6bfeffd640 1 -- 172.21.15.45:0/2463900790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8031a10 con 0x7f6c00153240 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 -- 172.21.15.45:0/2463900790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 msgr2=0x7f6c0015ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 --2- 172.21.15.45:0/2463900790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0015ccf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6c00067250 tx=0x7f6bf802b7c0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 -- 172.21.15.45:0/2463900790 shutdown_connections 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 --2- 172.21.15.45:0/2463900790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0015ccf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 --2- 172.21.15.45:0/2463900790 >> v2:172.21.15.114:3300/0 conn(0x7f6c0006a730 0x7f6c00152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 -- 172.21.15.45:0/2463900790 >> 172.21.15.45:0/2463900790 conn(0x7f6c0006cea0 msgr2=0x7f6c000661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 -- 172.21.15.45:0/2463900790 shutdown_connections 2023-12-08T08:17:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.162+0000 7f6c05775640 1 -- 172.21.15.45:0/2463900790 wait complete. 2023-12-08T08:17:04.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.164+0000 7f6c05775640 1 Processor -- start 2023-12-08T08:17:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.164+0000 7f6c05775640 1 -- start start 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 0x7f6c001e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 0x7f6c000bece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000ab3d0 con 0x7f6c00153240 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000bba20 con 0x7f6c0006a730 2023-12-08T08:17:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c05775640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c001e8780 con 0x7f6c000c4790 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.165+0000 7f6c04f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45728/0 (socket says 172.21.15.45:45728) 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 -- 172.21.15.45:0/1564428277 learned_addr learned my addr 172.21.15.45:0/1564428277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6bfffff640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 0x7f6c001e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6bff7fe640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 0x7f6c000bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 -- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 msgr2=0x7f6c000bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 0x7f6c000bece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 -- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 msgr2=0x7f6c001e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 0x7f6c001e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 -- 172.21.15.45:0/1564428277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009400 con 0x7f6c00153240 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6bfffff640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 0x7f6c001e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6bff7fe640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 0x7f6c000bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.166+0000 7f6c04f74640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8036040 tx=0x7f6bf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.167+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8031520 con 0x7f6c00153240 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.167+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8033bf0 con 0x7f6c00153240 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.167+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf803c400 con 0x7f6c00153240 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.167+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000aab30 con 0x7f6c00153240 2023-12-08T08:17:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.167+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c000ab0f0 con 0x7f6c00153240 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.168+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c000bb810 con 0x7f6c00153240 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.169+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bf803a040 con 0x7f6c00153240 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.170+0000 7f6bfcff9640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 0x7f6bec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.170+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6bf80ab380 con 0x7f6c00153240 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.170+0000 7f6bfffff640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 0x7f6bec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.171+0000 7f6bfffff640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 0x7f6bec06d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006fd0 tx=0x7f6bf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.174+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bf80760a0 con 0x7f6c00153240 2023-12-08T08:17:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.367+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c000673e0 con 0x7f6c00153240 2023-12-08T08:17:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.369+0000 7f6bfcff9640 1 -- 172.21.15.45:0/1564428277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bf80796c0 con 0x7f6c00153240 2023-12-08T08:17:04.370 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 msgr2=0x7f6bec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 0x7f6bec06d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006fd0 tx=0x7f6bf0008040 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 msgr2=0x7f6c0014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8036040 tx=0x7f6bf80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 shutdown_connections 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6bec06ae40 0x7f6bec06d300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6c000c4790 0x7f6c000bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c00153240 0x7f6c0014ec20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 --2- 172.21.15.45:0/1564428277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c0006a730 0x7f6c001e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 >> 172.21.15.45:0/1564428277 conn(0x7f6c0006cea0 msgr2=0x7f6c00153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.371+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 shutdown_connections 2023-12-08T08:17:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.372+0000 7f6c05775640 1 -- 172.21.15.45:0/1564428277 wait complete. 2023-12-08T08:17:04.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:17:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.621+0000 7fd234a08640 1 Processor -- start 2023-12-08T08:17:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.621+0000 7fd234a08640 1 -- start start 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.622+0000 7fd234a08640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd23014c280 0x7fd2300a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd234a08640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd230155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd234a08640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300c60c0 con 0x7fd2300c4970 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd234a08640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230152dc0 con 0x7fd23014c280 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd234a08640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301521d0 con 0x7fd230155790 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd227fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2300c4970 0x7fd23006cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41184/0 (socket says 172.21.15.45:41184) 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd227fff640 1 -- 172.21.15.45:0/4201325887 learned_addr learned my addr 172.21.15.45:0/4201325887 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd22ed9d640 1 --2- 172.21.15.45:0/4201325887 >> v2:172.21.15.114:3300/0 conn(0x7fd23014c280 0x7fd2300a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd22f59e640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd230155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105639023 0 0) 0x7fd218001110 con 0x7fd2300c4970 2023-12-08T08:17:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.623+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c003520 con 0x7fd2300c4970 2023-12-08T08:17:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393104648 0 0) 0x7fd21c003520 con 0x7fd2300c4970 2023-12-08T08:17:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 msgr2=0x7fd230155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd230155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 >> v2:172.21.15.114:3300/0 conn(0x7fd23014c280 msgr2=0x7fd2300a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 --2- 172.21.15.45:0/4201325887 >> v2:172.21.15.114:3300/0 conn(0x7fd23014c280 0x7fd2300a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23014c660 con 0x7fd2300c4970 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd218001800 con 0x7fd2300c4970 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 >> v1:172.21.15.45:6789/0 conn(0x7fd2300c4970 legacy=0x7fd23006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd21c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd21c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230152dc0 con 0x7fd21c0047c0 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301521d0 con 0x7fd21c003970 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c00b980 con 0x7fd230155790 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.624+0000 7fd227fff640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd21c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd22ed9d640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd22f59e640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd21c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd227fff640 1 -- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 msgr2=0x7fd21c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd227fff640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd230155790 0x7fd21c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd227fff640 1 -- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c003970 msgr2=0x7fd21c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd227fff640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.625+0000 7fd227fff640 1 -- 172.21.15.45:0/4201325887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c003520 con 0x7fd21c0047c0 2023-12-08T08:17:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.626+0000 7fd227fff640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd21c004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd21800c240 tx=0x7fd21c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f614068d614c861 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.626+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218005ad0 con 0x7fd21c0047c0 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.626+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd218005c50 con 0x7fd21c0047c0 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.626+0000 7fd22e59c640 1 -- 172.21.15.45:0/4201325887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21802c8d0 con 0x7fd21c0047c0 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 -- 172.21.15.45:0/4201325887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 msgr2=0x7fd21c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 --2- 172.21.15.45:0/4201325887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd21c004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd21800c240 tx=0x7fd21c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd22f59e640 1 -- 172.21.15.45:0/4201325887 reap_dead start 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 -- 172.21.15.45:0/4201325887 shutdown_connections 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 -- 172.21.15.45:0/4201325887 >> 172.21.15.45:0/4201325887 conn(0x7fd230066ce0 msgr2=0x7fd2300a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 -- 172.21.15.45:0/4201325887 shutdown_connections 2023-12-08T08:17:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.627+0000 7fd234a08640 1 -- 172.21.15.45:0/4201325887 wait complete. 2023-12-08T08:17:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.629+0000 7fd234a08640 1 Processor -- start 2023-12-08T08:17:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.629+0000 7fd234a08640 1 -- start start 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 0x7fd2301ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2301ea5a0 0x7fd230145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301edfe0 con 0x7fd21c0047c0 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301eaa20 con 0x7fd2301ea5a0 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd234a08640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23006fe70 con 0x7fd23014b820 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd22ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd22ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45756/0 (socket says 172.21.15.45:45756) 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd22ed9d640 1 -- 172.21.15.45:0/1963861449 learned_addr learned my addr 172.21.15.45:0/1963861449 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd227fff640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 0x7fd2301ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.630+0000 7fd22f59e640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2301ea5a0 0x7fd230145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 -- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 msgr2=0x7fd2301ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 0x7fd2301ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 -- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2301ea5a0 msgr2=0x7fd230145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2301ea5a0 0x7fd230145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 -- 172.21.15.45:0/1963861449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23014b390 con 0x7fd21c0047c0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd227fff640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 0x7fd2301ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd22ed9d640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd220011570 tx=0x7fd220011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220015930 con 0x7fd21c0047c0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220015a90 con 0x7fd21c0047c0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220015e60 con 0x7fd21c0047c0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2301ee4a0 con 0x7fd21c0047c0 2023-12-08T08:17:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.631+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23014b020 con 0x7fd21c0047c0 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.633+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2300678c0 con 0x7fd21c0047c0 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.634+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd22000f460 con 0x7fd21c0047c0 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.635+0000 7fd2277fe640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.635+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd22008a2b0 con 0x7fd21c0047c0 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.635+0000 7fd227fff640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.636+0000 7fd227fff640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 0x7fd21006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd218034000 tx=0x7fd218007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.640+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd220054f50 con 0x7fd21c0047c0 2023-12-08T08:17:04.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.832+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd230146700 con 0x7fd21c0047c0 2023-12-08T08:17:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.833+0000 7fd2277fe640 1 -- 172.21.15.45:0/1963861449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd220058570 con 0x7fd21c0047c0 2023-12-08T08:17:04.835 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:04.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.835+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 msgr2=0x7fd21006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.835+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 0x7fd21006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd218034000 tx=0x7fd218007000 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.835+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 msgr2=0x7fd2300c13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.835+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd220011570 tx=0x7fd220011a30 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 shutdown_connections 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd21006ae40 0x7fd21006d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd23014b820 0x7fd2301ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2301ea5a0 0x7fd230145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 --2- 172.21.15.45:0/1963861449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd21c0047c0 0x7fd2300c13a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 >> 172.21.15.45:0/1963861449 conn(0x7fd230066ce0 msgr2=0x7fd230148270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 shutdown_connections 2023-12-08T08:17:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:04.836+0000 7fd234a08640 1 -- 172.21.15.45:0/1963861449 wait complete. 2023-12-08T08:17:04.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:17:05.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.072+0000 7f4f69947640 1 Processor -- start 2023-12-08T08:17:05.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.072+0000 7f4f69947640 1 -- start start 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f69947640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f641591c0 0x7f4f640c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f69947640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6406d2d0 con 0x7f4f64155e40 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f69947640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640c5470 con 0x7f4f6406ba10 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f69947640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f641597a0 con 0x7f4f641591c0 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f68945640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f64155e40 0x7f4f640c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45332/0 (socket says 172.21.15.45:45332) 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f68945640 1 -- 172.21.15.45:0/2028107790 learned_addr learned my addr 172.21.15.45:0/2028107790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.073+0000 7f4f69146640 1 --2- 172.21.15.45:0/2028107790 >> v2:172.21.15.45:3300/0 conn(0x7f4f641591c0 0x7f4f640c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.074+0000 7f4f69146640 1 -- 172.21.15.45:0/2028107790 >> v1:172.21.15.114:6789/0 conn(0x7f4f6406ba10 legacy=0x7f4f640c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.074+0000 7f4f69146640 1 -- 172.21.15.45:0/2028107790 >> v1:172.21.15.45:6789/0 conn(0x7f4f64155e40 legacy=0x7f4f640c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.074+0000 7f4f69146640 1 -- 172.21.15.45:0/2028107790 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640c4d00 con 0x7f4f641591c0 2023-12-08T08:17:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.074+0000 7f4f637fe640 1 -- 172.21.15.45:0/2028107790 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039486826 0 0) 0x7f4f6406d2d0 con 0x7f4f64155e40 2023-12-08T08:17:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.075+0000 7f4f69146640 1 --2- 172.21.15.45:0/2028107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f641591c0 0x7f4f640c3df0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009d90 tx=0x7f4f5c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f0bb1af178b3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.075+0000 7f4f637fe640 1 -- 172.21.15.45:0/2028107790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c02cc60 con 0x7f4f641591c0 2023-12-08T08:17:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.075+0000 7f4f637fe640 1 -- 172.21.15.45:0/2028107790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c02cdc0 con 0x7f4f641591c0 2023-12-08T08:17:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.075+0000 7f4f637fe640 1 -- 172.21.15.45:0/2028107790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c034660 con 0x7f4f641591c0 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 -- 172.21.15.45:0/2028107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f641591c0 msgr2=0x7f4f640c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 --2- 172.21.15.45:0/2028107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f641591c0 0x7f4f640c3df0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009d90 tx=0x7f4f5c02beb0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 -- 172.21.15.45:0/2028107790 shutdown_connections 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 --2- 172.21.15.45:0/2028107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f641591c0 0x7f4f640c3df0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 -- 172.21.15.45:0/2028107790 >> 172.21.15.45:0/2028107790 conn(0x7f4f64066ce0 msgr2=0x7f4f640a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 -- 172.21.15.45:0/2028107790 shutdown_connections 2023-12-08T08:17:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.076+0000 7f4f69947640 1 -- 172.21.15.45:0/2028107790 wait complete. 2023-12-08T08:17:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.079+0000 7f4f69947640 1 Processor -- start 2023-12-08T08:17:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.079+0000 7f4f69947640 1 -- start start 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f64155e40 0x7f4f640a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f641591c0 0x7f4f640a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64157620 con 0x7f4f6406ba10 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64157e10 con 0x7f4f641591c0 2023-12-08T08:17:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f69947640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f641580f0 con 0x7f4f64155e40 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.080+0000 7f4f68945640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33214/0 (socket says 172.21.15.45:33214) 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 -- 172.21.15.45:0/1760871172 learned_addr learned my addr 172.21.15.45:0/1760871172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f63fff640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f64155e40 0x7f4f640a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f69146640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f641591c0 0x7f4f640a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 -- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f64155e40 msgr2=0x7f4f640a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f64155e40 0x7f4f640a2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 -- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f641591c0 msgr2=0x7f4f640a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f641591c0 0x7f4f640a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 -- 172.21.15.45:0/1760871172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c009a70 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.081+0000 7f4f68945640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c4d0 tx=0x7f4f5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.082+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580074e0 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.082+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f58007660 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.082+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f64157060 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.082+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58004a20 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.082+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f641586a0 con 0x7f4f6406ba10 2023-12-08T08:17:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.083+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f640678c0 con 0x7f4f6406ba10 2023-12-08T08:17:05.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.085+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f58004b80 con 0x7f4f6406ba10 2023-12-08T08:17:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.085+0000 7f4f617fa640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.086+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f4f58088ca0 con 0x7f4f6406ba10 2023-12-08T08:17:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.086+0000 7f4f63fff640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.086+0000 7f4f63fff640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 0x7f4f5006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006fd0 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.090+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f58053890 con 0x7f4f6406ba10 2023-12-08T08:17:05.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.274+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f64158890 con 0x7f4f6406ba10 2023-12-08T08:17:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.274+0000 7f4f617fa640 1 -- 172.21.15.45:0/1760871172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f58018020 con 0x7f4f6406ba10 2023-12-08T08:17:05.276 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 msgr2=0x7f4f5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 0x7f4f5006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006fd0 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 msgr2=0x7f4f640a96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c4d0 tx=0x7f4f5800c990 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 shutdown_connections 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f5006ae70 0x7f4f5006d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f64155e40 0x7f4f640a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f641591c0 0x7f4f640a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 --2- 172.21.15.45:0/1760871172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6406ba10 0x7f4f640a96b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 >> 172.21.15.45:0/1760871172 conn(0x7f4f64066ce0 msgr2=0x7f4f640a5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 shutdown_connections 2023-12-08T08:17:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.277+0000 7f4f69947640 1 -- 172.21.15.45:0/1760871172 wait complete. 2023-12-08T08:17:05.295 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:17:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.509+0000 7f594b59e640 1 Processor -- start 2023-12-08T08:17:05.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.510+0000 7f594b59e640 1 -- start start 2023-12-08T08:17:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.511+0000 7f594b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 0x7f594c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.511+0000 7f594b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f594c0ca610 0x7f594c155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.511+0000 7f594b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c151eb0 con 0x7f594c157a20 2023-12-08T08:17:05.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.511+0000 7f594b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594c0c56a0 con 0x7f594c0ca610 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.511+0000 7f594b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0c80d0 con 0x7f594c151ad0 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f5941d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f594c157a20 0x7f594c154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45334/0 (socket says 172.21.15.45:45334) 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f5941d9b640 1 -- 172.21.15.45:0/139131745 learned_addr learned my addr 172.21.15.45:0/139131745 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594ad9d640 1 --2- 172.21.15.45:0/139131745 >> v2:172.21.15.45:3300/0 conn(0x7f594c0ca610 0x7f594c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594a59c640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 0x7f594c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f5949d9b640 1 -- 172.21.15.45:0/139131745 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269436877 0 0) 0x7f594c151eb0 con 0x7f594c157a20 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f5949d9b640 1 -- 172.21.15.45:0/139131745 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5938003520 con 0x7f594c157a20 2023-12-08T08:17:05.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594ad9d640 1 -- 172.21.15.45:0/139131745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 msgr2=0x7f594c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:05.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594ad9d640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 0x7f594c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594ad9d640 1 -- 172.21.15.45:0/139131745 >> v1:172.21.15.45:6789/0 conn(0x7f594c157a20 legacy=0x7f594c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594ad9d640 1 -- 172.21.15.45:0/139131745 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c154430 con 0x7f594c0ca610 2023-12-08T08:17:05.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.512+0000 7f594a59c640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 0x7f594c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f594ad9d640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c155040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5944009d90 tx=0x7f594402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa8100694cda4a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f5949d9b640 1 -- 172.21.15.45:0/139131745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594402cc60 con 0x7f594c0ca610 2023-12-08T08:17:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f5949d9b640 1 -- 172.21.15.45:0/139131745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594402cdc0 con 0x7f594c0ca610 2023-12-08T08:17:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f5949d9b640 1 -- 172.21.15.45:0/139131745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944034660 con 0x7f594c0ca610 2023-12-08T08:17:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f594b59e640 1 -- 172.21.15.45:0/139131745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 msgr2=0x7f594c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.514+0000 7f594b59e640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c155040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5944009d90 tx=0x7f594402beb0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 -- 172.21.15.45:0/139131745 shutdown_connections 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c155040 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 --2- 172.21.15.45:0/139131745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c151ad0 0x7f594c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 -- 172.21.15.45:0/139131745 >> 172.21.15.45:0/139131745 conn(0x7f594c066610 msgr2=0x7f594c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 -- 172.21.15.45:0/139131745 shutdown_connections 2023-12-08T08:17:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.515+0000 7f594b59e640 1 -- 172.21.15.45:0/139131745 wait complete. 2023-12-08T08:17:05.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.516+0000 7f594b59e640 1 Processor -- start 2023-12-08T08:17:05.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.516+0000 7f594b59e640 1 -- start start 2023-12-08T08:17:05.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f594c151ad0 0x7f594c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c157a20 0x7f594c14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0c0320 con 0x7f594c0ca610 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0c0930 con 0x7f594c151ad0 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c0c0650 con 0x7f594c157a20 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.517+0000 7f594a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33244/0 (socket says 172.21.15.45:33244) 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 -- 172.21.15.45:0/1623815910 learned_addr learned my addr 172.21.15.45:0/1623815910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 -- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c157a20 msgr2=0x7f594c14cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c157a20 0x7f594c14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f5941d9b640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f594c151ad0 0x7f594c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 -- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f594c151ad0 msgr2=0x7f594c1ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f594c151ad0 0x7f594c1ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 -- 172.21.15.45:0/1623815910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009a70 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.518+0000 7f594a59c640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f593c00e7e0 tx=0x7f593c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.519+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c004030 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.519+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c004190 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.519+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c004520 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.519+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c1edc60 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.519+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c1ed960 con 0x7f594c0ca610 2023-12-08T08:17:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.520+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c0743e0 con 0x7f594c0ca610 2023-12-08T08:17:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.521+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f593c00c6d0 con 0x7f594c0ca610 2023-12-08T08:17:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.522+0000 7f59437fe640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 0x7f592c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.522+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f593c089760 con 0x7f594c0ca610 2023-12-08T08:17:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.522+0000 7f5941d9b640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 0x7f592c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.523+0000 7f5941d9b640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 0x7f592c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f594c0c3d10 tx=0x7f5934009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.526+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f593c054400 con 0x7f594c0ca610 2023-12-08T08:17:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.719+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f594c0c7a40 con 0x7f594c0ca610 2023-12-08T08:17:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.720+0000 7f59437fe640 1 -- 172.21.15.45:0/1623815910 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f593c057a20 con 0x7f594c0ca610 2023-12-08T08:17:05.722 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:05.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 msgr2=0x7f592c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 0x7f592c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f594c0c3d10 tx=0x7f5934009040 comp rx=0 tx=0).stop 2023-12-08T08:17:05.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 msgr2=0x7f594c0c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f593c00e7e0 tx=0x7f593c00eca0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 shutdown_connections 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f592c06ae40 0x7f592c06d300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f594c157a20 0x7f594c14cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f594c151ad0 0x7f594c1ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 --2- 172.21.15.45:0/1623815910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f594c0ca610 0x7f594c0c1620 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.722+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 >> 172.21.15.45:0/1623815910 conn(0x7f594c066610 msgr2=0x7f594c14b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.723+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 shutdown_connections 2023-12-08T08:17:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.723+0000 7f594b59e640 1 -- 172.21.15.45:0/1623815910 wait complete. 2023-12-08T08:17:05.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:17:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.957+0000 7f05fd375640 1 Processor -- start 2023-12-08T08:17:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.957+0000 7f05fd375640 1 -- start start 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05fd375640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f8151ec0 0x7f05f80c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05fd375640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 0x7f05f806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05fd375640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80c16b0 con 0x7f05f80c4d30 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05fd375640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f80a8b30 con 0x7f05f8151ec0 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05fd375640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80c65d0 con 0x7f05f80c1d60 2023-12-08T08:17:05.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f8151ec0 0x7f05f80c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f8151ec0 0x7f05f80c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33246/0 (socket says 172.21.15.45:33246) 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f7fff640 1 -- 172.21.15.45:0/3039834566 learned_addr learned my addr 172.21.15.45:0/3039834566 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f77fe640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 0x7f05f806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f7fff640 1 -- 172.21.15.45:0/3039834566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 msgr2=0x7f05f806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.959+0000 7f05f7fff640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 0x7f05f806ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.960+0000 7f05f7fff640 1 -- 172.21.15.45:0/3039834566 >> v1:172.21.15.114:6789/0 conn(0x7f05f80c4d30 legacy=0x7f05f806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.960+0000 7f05f7fff640 1 -- 172.21.15.45:0/3039834566 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80c5810 con 0x7f05f8151ec0 2023-12-08T08:17:05.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.960+0000 7f05f77fe640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 0x7f05f806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:05.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.961+0000 7f05f7fff640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f8151ec0 0x7f05f80c47f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bcb94d6761a5ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.961+0000 7f05f6ffd640 1 -- 172.21.15.45:0/3039834566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e80317c0 con 0x7f05f8151ec0 2023-12-08T08:17:05.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.961+0000 7f05f6ffd640 1 -- 172.21.15.45:0/3039834566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8031920 con 0x7f05f8151ec0 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.961+0000 7f05f6ffd640 1 -- 172.21.15.45:0/3039834566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8031cb0 con 0x7f05f8151ec0 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 -- 172.21.15.45:0/3039834566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f8151ec0 msgr2=0x7f05f80c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f8151ec0 0x7f05f80c47f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009870 tx=0x7f05e802b860 comp rx=0 tx=0).stop 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 -- 172.21.15.45:0/3039834566 shutdown_connections 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f80c1d60 0x7f05f806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 --2- 172.21.15.45:0/3039834566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f8151ec0 0x7f05f80c47f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 -- 172.21.15.45:0/3039834566 >> 172.21.15.45:0/3039834566 conn(0x7f05f8066ce0 msgr2=0x7f05f80a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 -- 172.21.15.45:0/3039834566 shutdown_connections 2023-12-08T08:17:05.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.962+0000 7f05fd375640 1 -- 172.21.15.45:0/3039834566 wait complete. 2023-12-08T08:17:05.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.964+0000 7f05fd375640 1 Processor -- start 2023-12-08T08:17:05.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.964+0000 7f05fd375640 1 -- start start 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 0x7f05f8148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f8151ec0 0x7f05f80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f81507a0 con 0x7f05f80c4d30 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f8070360 con 0x7f05f80c1d60 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fd375640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f81495a0 con 0x7f05f8151ec0 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33254/0 (socket says 172.21.15.45:33254) 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 -- 172.21.15.45:0/227581258 learned_addr learned my addr 172.21.15.45:0/227581258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05fcb74640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f8151ec0 0x7f05f80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f7fff640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 0x7f05f8148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 -- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f8151ec0 msgr2=0x7f05f80707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f8151ec0 0x7f05f80707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 -- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 msgr2=0x7f05f8148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.965+0000 7f05f77fe640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 0x7f05f8148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f77fe640 1 -- 172.21.15.45:0/227581258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e80094d0 con 0x7f05f80c4d30 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f7fff640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 0x7f05f8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f77fe640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00c7c0 tx=0x7f05ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec007820 con 0x7f05f80c4d30 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec007980 con 0x7f05f80c4d30 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec007d10 con 0x7f05f80c4d30 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f8072130 con 0x7f05f80c4d30 2023-12-08T08:17:05.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.966+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80726f0 con 0x7f05f80c4d30 2023-12-08T08:17:05.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.967+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f80678c0 con 0x7f05f80c4d30 2023-12-08T08:17:05.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.968+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05ec0113f0 con 0x7f05f80c4d30 2023-12-08T08:17:05.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.969+0000 7f05f4ff9640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:05.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.969+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f05ec089b00 con 0x7f05f80c4d30 2023-12-08T08:17:05.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.969+0000 7f05f7fff640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:05.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.970+0000 7f05f7fff640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 0x7f05e406d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f05e8036000 tx=0x7f05e803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:05.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:05.974+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05ec08be60 con 0x7f05f80c4d30 2023-12-08T08:17:06.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.168+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f05f806cdc0 con 0x7f05f80c4d30 2023-12-08T08:17:06.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.169+0000 7f05f4ff9640 1 -- 172.21.15.45:0/227581258 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f05ec054700 con 0x7f05f80c4d30 2023-12-08T08:17:06.171 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:06.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.171+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 msgr2=0x7f05e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.171+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 0x7f05e406d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f05e8036000 tx=0x7f05e803d040 comp rx=0 tx=0).stop 2023-12-08T08:17:06.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.171+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 msgr2=0x7f05f81485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.171+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00c7c0 tx=0x7f05ec00cc80 comp rx=0 tx=0).stop 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 shutdown_connections 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f05e406ae40 0x7f05e406d300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f05f8151ec0 0x7f05f80707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f80c4d30 0x7f05f81485b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 --2- 172.21.15.45:0/227581258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05f80c1d60 0x7f05f8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 >> 172.21.15.45:0/227581258 conn(0x7f05f8066ce0 msgr2=0x7f05f806ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 shutdown_connections 2023-12-08T08:17:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.172+0000 7f05fd375640 1 -- 172.21.15.45:0/227581258 wait complete. 2023-12-08T08:17:06.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:17:06.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.412+0000 7fd9bf553640 1 Processor -- start 2023-12-08T08:17:06.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.412+0000 7fd9bf553640 1 -- start start 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bf553640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9b8152240 0x7fd9b80c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bf553640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b806bc90 con 0x7fd9b806c120 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bf553640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80aa940 con 0x7fd9b80c4bb0 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bf553640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b80aa0a0 con 0x7fd9b8152240 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bdaf0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9b806c120 0x7fd9b806c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45336/0 (socket says 172.21.15.45:45336) 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.414+0000 7fd9bdaf0640 1 -- 172.21.15.45:0/3993802326 learned_addr learned my addr 172.21.15.45:0/3993802326 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9bcaee640 1 --2- 172.21.15.45:0/3993802326 >> v2:172.21.15.114:3300/0 conn(0x7fd9b8152240 0x7fd9b80c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679088645 0 0) 0x7fd9b806bc90 con 0x7fd9b806c120 2023-12-08T08:17:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a4005730 con 0x7fd9b806c120 2023-12-08T08:17:06.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910010759 0 0) 0x7fd9a4005730 con 0x7fd9b806c120 2023-12-08T08:17:06.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 >> v2:172.21.15.114:3300/0 conn(0x7fd9b8152240 msgr2=0x7fd9b80c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:06.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 --2- 172.21.15.45:0/3993802326 >> v2:172.21.15.114:3300/0 conn(0x7fd9b8152240 0x7fd9b80c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.415+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 >> v1:172.21.15.114:6789/0 conn(0x7fd9b80c4bb0 legacy=0x7fd9b8151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80aa380 con 0x7fd9b806c120 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd9b00019f0 con 0x7fd9b806c120 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9bcaee640 1 --2- 172.21.15.45:0/3993802326 >> v2:172.21.15.114:3300/0 conn(0x7fd9b8152240 0x7fd9b80c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 >> v1:172.21.15.45:6789/0 conn(0x7fd9b806c120 legacy=0x7fd9b806c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 0x7fd9a4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a40069d0 0x7fd9a4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9a40073e0 0x7fd9a400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80aa0a0 con 0x7fd9a4005bd0 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a400e330 con 0x7fd9a40069d0 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a400e4f0 con 0x7fd9a40073e0 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 0x7fd9a4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9bd2ef640 1 -- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9a40073e0 msgr2=0x7fd9a400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.416+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9a40073e0 0x7fd9a400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.417+0000 7fd9bd2ef640 1 -- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a40069d0 msgr2=0x7fd9a4006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.417+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a40069d0 0x7fd9a4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.417+0000 7fd9bd2ef640 1 -- 172.21.15.45:0/3993802326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4005730 con 0x7fd9a4005bd0 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.417+0000 7fd9bdaf0640 1 -- 172.21.15.45:0/3993802326 reap_dead start 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 0x7fd9a4005ff0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4001720 tx=0x7fd9a4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b730998a52a10aa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40052d0 con 0x7fd9a4005bd0 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b402e050 con 0x7fd9a4005bd0 2023-12-08T08:17:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9affff640 1 -- 172.21.15.45:0/3993802326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4003830 con 0x7fd9a4005bd0 2023-12-08T08:17:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9bf553640 1 -- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 msgr2=0x7fd9a4005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9bf553640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 0x7fd9a4005ff0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4001720 tx=0x7fd9a4007a00 comp rx=0 tx=0).stop 2023-12-08T08:17:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9bf553640 1 -- 172.21.15.45:0/3993802326 shutdown_connections 2023-12-08T08:17:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.418+0000 7fd9bf553640 1 --2- 172.21.15.45:0/3993802326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9a4005bd0 0x7fd9a4005ff0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.419+0000 7fd9bf553640 1 -- 172.21.15.45:0/3993802326 >> 172.21.15.45:0/3993802326 conn(0x7fd9b8066db0 msgr2=0x7fd9b80c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.419+0000 7fd9bf553640 1 -- 172.21.15.45:0/3993802326 shutdown_connections 2023-12-08T08:17:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.419+0000 7fd9bf553640 1 -- 172.21.15.45:0/3993802326 wait complete. 2023-12-08T08:17:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.420+0000 7fd9bf553640 1 Processor -- start 2023-12-08T08:17:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 -- start start 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 0x7fd9b81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b814af80 0x7fd9b814b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81537d0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80a61d0 con 0x7fd9a4005bd0 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.421+0000 7fd9bf553640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81534f0 con 0x7fd9b814af80 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33282/0 (socket says 172.21.15.45:33282) 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 -- 172.21.15.45:0/2995769638 learned_addr learned my addr 172.21.15.45:0/2995769638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 0x7fd9b81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bdaf0640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b814af80 0x7fd9b814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 -- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b814af80 msgr2=0x7fd9b814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b814af80 0x7fd9b814b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 -- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 msgr2=0x7fd9b81547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 0x7fd9b81547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bcaee640 1 -- 172.21.15.45:0/2995769638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8155090 con 0x7fd9b80a5d70 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.422+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 0x7fd9b81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9bcaee640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800eb60 tx=0x7fd9a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8009750 con 0x7fd9b80a5d70 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a800ce40 con 0x7fd9b80a5d70 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b8155370 con 0x7fd9b80a5d70 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a800ee90 con 0x7fd9b80a5d70 2023-12-08T08:17:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.423+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b814b970 con 0x7fd9b80a5d70 2023-12-08T08:17:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.424+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8154ef0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.425+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9a8013470 con 0x7fd9b80a5d70 2023-12-08T08:17:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.426+0000 7fd9adffb640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 0x7fd99c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.427+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd9a808a0c0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.427+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 0x7fd99c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.427+0000 7fd9bd2ef640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 0x7fd99c06d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4033000 tx=0x7fd9b4009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.431+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9b8154ef0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.636+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9b8154ef0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.637+0000 7fd9adffb640 1 -- 172.21.15.45:0/2995769638 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9b8154ef0 con 0x7fd9b80a5d70 2023-12-08T08:17:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:17:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 msgr2=0x7fd99c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 0x7fd99c06d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4033000 tx=0x7fd9b4009030 comp rx=0 tx=0).stop 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 msgr2=0x7fd9b80c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800eb60 tx=0x7fd9a800c520 comp rx=0 tx=0).stop 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 shutdown_connections 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd99c06ae40 0x7fd99c06d300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9b814af80 0x7fd9b814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9b80a5d70 0x7fd9b80c0eb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 --2- 172.21.15.45:0/2995769638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9a4005bd0 0x7fd9b81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:06.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 >> 172.21.15.45:0/2995769638 conn(0x7fd9b8066db0 msgr2=0x7fd9b8151030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:06.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 shutdown_connections 2023-12-08T08:17:06.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:06.640+0000 7fd9bf553640 1 -- 172.21.15.45:0/2995769638 wait complete. 2023-12-08T08:17:06.662 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:17:06.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:06.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:17:06.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:17:06.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:06.783 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:17:06.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.075+0000 7f1cfab9e640 1 Processor -- start 2023-12-08T08:17:07.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.076+0000 7f1cfab9e640 1 -- start start 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf40a7910 0x7f1cf40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1cf41521b0 0x7f1cf4155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf4155850 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40c0890 con 0x7f1cf41521b0 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cfab9e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c0b70 con 0x7f1cf40a7910 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.077+0000 7f1cf939b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33288/0 (socket says 172.21.15.45:33288) 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 -- 172.21.15.45:0/3877253856 learned_addr learned my addr 172.21.15.45:0/3877253856 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 -- 172.21.15.45:0/3877253856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf40a7910 msgr2=0x7f1cf40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 --2- 172.21.15.45:0/3877253856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf40a7910 0x7f1cf40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 -- 172.21.15.45:0/3877253856 >> v2:172.21.15.114:3300/0 conn(0x7f1cf41521b0 msgr2=0x7f1cf4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 --2- 172.21.15.45:0/3877253856 >> v2:172.21.15.114:3300/0 conn(0x7f1cf41521b0 0x7f1cf4155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.078+0000 7f1cf939b640 1 -- 172.21.15.45:0/3877253856 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40c0e50 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.079+0000 7f1cf939b640 1 --2- 172.21.15.45:0/3877253856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40a5460 tx=0x7f1ce402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d1a62c2aa42f0b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.079+0000 7f1cf8b9a640 1 -- 172.21.15.45:0/3877253856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4031800 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cf8b9a640 1 -- 172.21.15.45:0/3877253856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4031960 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cf8b9a640 1 -- 172.21.15.45:0/3877253856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4031cf0 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 -- 172.21.15.45:0/3877253856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 msgr2=0x7f1cf414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/3877253856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40a5460 tx=0x7f1ce402b8a0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 -- 172.21.15.45:0/3877253856 shutdown_connections 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/3877253856 >> v2:172.21.15.114:3300/0 conn(0x7f1cf41521b0 0x7f1cf4155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/3877253856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf414f5e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/3877253856 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf40a7910 0x7f1cf40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 -- 172.21.15.45:0/3877253856 >> 172.21.15.45:0/3877253856 conn(0x7f1cf40c5780 msgr2=0x7f1cf40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:07.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 -- 172.21.15.45:0/3877253856 shutdown_connections 2023-12-08T08:17:07.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.080+0000 7f1cfab9e640 1 -- 172.21.15.45:0/3877253856 wait complete. 2023-12-08T08:17:07.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.082+0000 7f1cfab9e640 1 Processor -- start 2023-12-08T08:17:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.082+0000 7f1cfab9e640 1 -- start start 2023-12-08T08:17:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40a7910 0x7f1cf414f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf41521b0 0x7f1cf41df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40a5f60 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c4e00 con 0x7f1cf40a7910 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cfab9e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c34f0 con 0x7f1cf41521b0 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cf939b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cf939b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33294/0 (socket says 172.21.15.45:33294) 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.083+0000 7f1cf939b640 1 -- 172.21.15.45:0/2876315462 learned_addr learned my addr 172.21.15.45:0/2876315462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cfa39d640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf41521b0 0x7f1cf41df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf9b9c640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40a7910 0x7f1cf414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 -- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf41521b0 msgr2=0x7f1cf41df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf41521b0 0x7f1cf41df8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 -- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40a7910 msgr2=0x7f1cf414f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40a7910 0x7f1cf414f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 -- 172.21.15.45:0/2876315462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40094d0 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.084+0000 7f1cf939b640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.085+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce403ad30 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.085+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce403ae90 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.085+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf40c3790 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.085+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4044630 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.085+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf41edb90 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.086+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40c4f70 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.087+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ce404d450 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.088+0000 7f1cea7fc640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 0x7f1cd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.088+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f1ce402e070 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.088+0000 7f1cf9b9c640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 0x7f1cd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.089+0000 7f1cf9b9c640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 0x7f1cd806d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009f20 tx=0x7f1cf00094f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.092+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ce4076bd0 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.330+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cf41edd50 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.331+0000 7f1cea7fc640 1 -- 172.21.15.45:0/2876315462 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6121 (secure 0 0 0) 0x7f1cf41edd50 con 0x7f1cf40c1dc0 2023-12-08T08:17:07.333 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 msgr2=0x7f1cd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 0x7f1cd806d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009f20 tx=0x7f1cf00094f0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 msgr2=0x7f1cf41dcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce40046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 shutdown_connections 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1cd806ae40 0x7f1cd806d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1cf41521b0 0x7f1cf41df8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40c1dc0 0x7f1cf41dcf90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 --2- 172.21.15.45:0/2876315462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf40a7910 0x7f1cf414f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.334+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 >> 172.21.15.45:0/2876315462 conn(0x7f1cf40c5780 msgr2=0x7f1cf40a9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.335+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 shutdown_connections 2023-12-08T08:17:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.335+0000 7f1cfab9e640 1 -- 172.21.15.45:0/2876315462 wait complete. 2023-12-08T08:17:07.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.580+0000 7f8c37311640 1 Processor -- start 2023-12-08T08:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.580+0000 7f8c37311640 1 -- start start 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c37311640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c301584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c37311640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c300c7a50 0x7f8c300ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c37311640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c300c4a00 con 0x7f8c300c44d0 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c37311640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300c4ce0 con 0x7f8c300c7a50 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c37311640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301579e0 con 0x7f8c301519c0 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c35b0e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8c300c44d0 0x7f8c30154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45350/0 (socket says 172.21.15.45:45350) 2023-12-08T08:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.582+0000 7f8c35b0e640 1 -- 172.21.15.45:0/104318339 learned_addr learned my addr 172.21.15.45:0/104318339 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c36b10640 1 --2- 172.21.15.45:0/104318339 >> v2:172.21.15.114:3300/0 conn(0x7f8c300c7a50 0x7f8c300ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3630f640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c301584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252629567 0 0) 0x7f8c300c4a00 con 0x7f8c300c44d0 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c1c003520 con 0x7f8c300c44d0 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288410150 0 0) 0x7f8c1c003520 con 0x7f8c300c44d0 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 msgr2=0x7f8c301584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c301584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 >> v2:172.21.15.114:3300/0 conn(0x7f8c300c7a50 msgr2=0x7f8c300ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 --2- 172.21.15.45:0/104318339 >> v2:172.21.15.114:3300/0 conn(0x7f8c300c7a50 0x7f8c300ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30157cc0 con 0x7f8c300c44d0 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8c20001670 con 0x7f8c300c44d0 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 >> v1:172.21.15.45:6789/0 conn(0x7f8c300c44d0 legacy=0x7f8c30154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c003970 0x7f8c1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c0047c0 0x7f8c1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.583+0000 7f8c3530d640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300c4ce0 con 0x7f8c1c003970 2023-12-08T08:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301579e0 con 0x7f8c1c0047c0 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c00b9d0 con 0x7f8c301519c0 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c003970 0x7f8c1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c35b0e640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c0047c0 0x7f8c1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c36b10640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 -- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 msgr2=0x7f8c1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 -- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c0047c0 msgr2=0x7f8c1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c0047c0 0x7f8c1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c3630f640 1 -- 172.21.15.45:0/104318339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c003520 con 0x7f8c1c003970 2023-12-08T08:17:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.584+0000 7f8c36b10640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c301519c0 0x7f8c1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.585+0000 7f8c3630f640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c003970 0x7f8c1c003d90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009af0 tx=0x7f8c1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fed343a3c760ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02c6b0 con 0x7f8c1c003970 2023-12-08T08:17:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c02c810 con 0x7f8c1c003970 2023-12-08T08:17:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c3530d640 1 -- 172.21.15.45:0/104318339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02cba0 con 0x7f8c1c003970 2023-12-08T08:17:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 -- 172.21.15.45:0/104318339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c003970 msgr2=0x7f8c1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 --2- 172.21.15.45:0/104318339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c003970 0x7f8c1c003d90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009af0 tx=0x7f8c1c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c36b10640 1 -- 172.21.15.45:0/104318339 reap_dead start 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 -- 172.21.15.45:0/104318339 shutdown_connections 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 -- 172.21.15.45:0/104318339 >> 172.21.15.45:0/104318339 conn(0x7f8c300661f0 msgr2=0x7f8c30066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 -- 172.21.15.45:0/104318339 shutdown_connections 2023-12-08T08:17:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.586+0000 7f8c37311640 1 -- 172.21.15.45:0/104318339 wait complete. 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.588+0000 7f8c37311640 1 Processor -- start 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.588+0000 7f8c37311640 1 -- start start 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c003970 0x7f8c3014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c300c0fe0 0x7f8c301ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301ede50 con 0x7f8c301ed830 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3014e640 con 0x7f8c1c003970 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c37311640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3014e920 con 0x7f8c300c0fe0 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.589+0000 7f8c36b10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33314/0 (socket says 172.21.15.45:33314) 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 -- 172.21.15.45:0/2852022606 learned_addr learned my addr 172.21.15.45:0/2852022606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c3630f640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c003970 0x7f8c3014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c35b0e640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c300c0fe0 0x7f8c301ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 -- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c300c0fe0 msgr2=0x7f8c301ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c300c0fe0 0x7f8c301ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 -- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c003970 msgr2=0x7f8c3014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c003970 0x7f8c3014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 -- 172.21.15.45:0/2852022606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3014c670 con 0x7f8c301ed830 2023-12-08T08:17:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.590+0000 7f8c36b10640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8c300c6cb0 tx=0x7f8c2800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.591+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28017400 con 0x7f8c301ed830 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.591+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28011040 con 0x7f8c301ed830 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.591+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28017780 con 0x7f8c301ed830 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.591+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3014c950 con 0x7f8c301ed830 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.591+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c300c16c0 con 0x7f8c301ed830 2023-12-08T08:17:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.592+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3014cb40 con 0x7f8c301ed830 2023-12-08T08:17:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.593+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c280203b0 con 0x7f8c301ed830 2023-12-08T08:17:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.594+0000 7f8c26ffd640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 0x7f8c1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.594+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8c28089de0 con 0x7f8c301ed830 2023-12-08T08:17:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.594+0000 7f8c3630f640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 0x7f8c1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.595+0000 7f8c3630f640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 0x7f8c1406d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036000 tx=0x7f8c2c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:07.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.598+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c280549e0 con 0x7f8c301ed830 2023-12-08T08:17:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.800+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c300743e0 con 0x7f8c301ed830 2023-12-08T08:17:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.803+0000 7f8c26ffd640 1 -- 172.21.15.45:0/2852022606 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f8c28058000 con 0x7f8c301ed830 2023-12-08T08:17:07.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:07.805 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:07.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 msgr2=0x7f8c1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 0x7f8c1406d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c036000 tx=0x7f8c2c030000 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 msgr2=0x7f8c3014ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8c300c6cb0 tx=0x7f8c2800f4a0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 shutdown_connections 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c1406ae40 0x7f8c1406d300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c300c0fe0 0x7f8c301ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c301ed830 0x7f8c3014ce70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 --2- 172.21.15.45:0/2852022606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c1c003970 0x7f8c3014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 >> 172.21.15.45:0/2852022606 conn(0x7f8c300661f0 msgr2=0x7f8c30153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 shutdown_connections 2023-12-08T08:17:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:07.806+0000 7f8c37311640 1 -- 172.21.15.45:0/2852022606 wait complete. 2023-12-08T08:17:07.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:16:27.503085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:16:28.455815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:16:43.271897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:16:44.566832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:07.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.063+0000 7fe4e1e83640 1 Processor -- start 2023-12-08T08:17:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.063+0000 7fe4e1e83640 1 -- start start 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.064+0000 7fe4e1e83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4dc1552d0 0x7fe4dc158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.064+0000 7fe4e1e83640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0c51f0 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.064+0000 7fe4e1e83640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0c54d0 con 0x7fe4dc06d1d0 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.064+0000 7fe4e1e83640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0c1ce0 con 0x7fe4dc1552d0 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.065+0000 7fe4e0e81640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe4dc0c59e0 0x7fe4dc06bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45366/0 (socket says 172.21.15.45:45366) 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.065+0000 7fe4e0e81640 1 -- 172.21.15.45:0/2475017639 learned_addr learned my addr 172.21.15.45:0/2475017639 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.065+0000 7fe4e1682640 1 --2- 172.21.15.45:0/2475017639 >> v2:172.21.15.114:3300/0 conn(0x7fe4dc1552d0 0x7fe4dc158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.065+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887513734 0 0) 0x7fe4dc0c51f0 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.065+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4cc003520 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629598425 0 0) 0x7fe4cc003520 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 >> v2:172.21.15.114:3300/0 conn(0x7fe4dc1552d0 msgr2=0x7fe4dc158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 --2- 172.21.15.45:0/2475017639 >> v2:172.21.15.114:3300/0 conn(0x7fe4dc1552d0 0x7fe4dc158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 >> v1:172.21.15.114:6789/0 conn(0x7fe4dc06d1d0 legacy=0x7fe4dc154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc157ba0 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe4d0001670 con 0x7fe4dc0c59e0 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 >> v1:172.21.15.45:6789/0 conn(0x7fe4dc0c59e0 legacy=0x7fe4dc06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 0x7fe4cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0047c0 0x7fe4cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc005180 0x7fe4cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc00c030 con 0x7fe4cc0039c0 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc00c1a0 con 0x7fe4cc0047c0 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc00c360 con 0x7fe4cc005180 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.066+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 0x7fe4cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4dbfff640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0047c0 0x7fe4cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e0e81640 1 -- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc005180 msgr2=0x7fe4cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc005180 0x7fe4cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e0e81640 1 -- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0047c0 msgr2=0x7fe4cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0047c0 0x7fe4cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e0e81640 1 -- 172.21.15.45:0/2475017639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc003520 con 0x7fe4cc0039c0 2023-12-08T08:17:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4dbfff640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0047c0 0x7fe4cc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.067+0000 7fe4e1682640 1 -- 172.21.15.45:0/2475017639 reap_dead start 2023-12-08T08:17:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.068+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 0x7fe4cc003de0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c0e0 tx=0x7fe4cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd27bbaf028aa365 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.068+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0005ad0 con 0x7fe4cc0039c0 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.068+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0005c30 con 0x7fe4cc0039c0 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.068+0000 7fe4db7fe640 1 -- 172.21.15.45:0/2475017639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d002ca00 con 0x7fe4cc0039c0 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 -- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 msgr2=0x7fe4cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 0x7fe4cc003de0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c0e0 tx=0x7fe4cc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 -- 172.21.15.45:0/2475017639 shutdown_connections 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/2475017639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4cc0039c0 0x7fe4cc003de0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 -- 172.21.15.45:0/2475017639 >> 172.21.15.45:0/2475017639 conn(0x7fe4dc066ce0 msgr2=0x7fe4dc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 -- 172.21.15.45:0/2475017639 shutdown_connections 2023-12-08T08:17:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.069+0000 7fe4e1e83640 1 -- 172.21.15.45:0/2475017639 wait complete. 2023-12-08T08:17:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.071+0000 7fe4e1e83640 1 Processor -- start 2023-12-08T08:17:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.071+0000 7fe4e1e83640 1 -- start start 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc0039c0 0x7fe4dc14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4dc0a5400 0x7fe4dc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a6460 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a58e0 con 0x7fe4dc0a5400 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1e83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a5bc0 con 0x7fe4cc0039c0 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33320/0 (socket says 172.21.15.45:33320) 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 -- 172.21.15.45:0/3473937514 learned_addr learned my addr 172.21.15.45:0/3473937514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4dbfff640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4dc0a5400 0x7fe4dc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc0039c0 0x7fe4dc14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 -- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc0039c0 msgr2=0x7fe4dc14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc0039c0 0x7fe4dc14f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 -- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4dc0a5400 msgr2=0x7fe4dc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4dc0a5400 0x7fe4dc0aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.072+0000 7fe4e1682640 1 -- 172.21.15.45:0/3473937514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0a5ea0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4e1682640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc06b5d0 tx=0x7fe4d400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4010040 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d400bce0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4014640 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc0a6180 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.073+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc0aabd0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.075+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc0678c0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.075+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4d40147a0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.076+0000 7fe4d97fa640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.076+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe4d4089f70 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.077+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.078+0000 7fe4e0e81640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 0x7fe4c006d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0034000 tx=0x7fe4d0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.081+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4d4054b80 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.275+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4dc0743e0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.276+0000 7fe4d97fa640 1 -- 172.21.15.45:0/3473937514 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4d40581a0 con 0x7fe4dc14d4d0 2023-12-08T08:17:08.278 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 msgr2=0x7fe4c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 0x7fe4c006d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0034000 tx=0x7fe4d0009030 comp rx=0 tx=0).stop 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 msgr2=0x7fe4dc0aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc06b5d0 tx=0x7fe4d400b480 comp rx=0 tx=0).stop 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 shutdown_connections 2023-12-08T08:17:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe4c006ae70 0x7fe4c006d330 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4dc14d4d0 0x7fe4dc0aa690 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4dc0a5400 0x7fe4dc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 --2- 172.21.15.45:0/3473937514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4cc0039c0 0x7fe4dc14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.279+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 >> 172.21.15.45:0/3473937514 conn(0x7fe4dc066ce0 msgr2=0x7fe4dc06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.280+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 shutdown_connections 2023-12-08T08:17:08.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.280+0000 7fe4e1e83640 1 -- 172.21.15.45:0/3473937514 wait complete. 2023-12-08T08:17:08.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:17:08.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.528+0000 7f2bbb59e640 1 Processor -- start 2023-12-08T08:17:08.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.529+0000 7f2bbb59e640 1 -- start start 2023-12-08T08:17:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.530+0000 7f2bbb59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bbc157a20 0x7f2bbc154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.530+0000 7f2bbb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2bbc06c230 0x7f2bbc154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.530+0000 7f2bbb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc151eb0 con 0x7f2bbc151ad0 2023-12-08T08:17:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.530+0000 7f2bbb59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c56a0 con 0x7f2bbc157a20 2023-12-08T08:17:08.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.530+0000 7f2bbb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c80d0 con 0x7f2bbc06c230 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bba59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2bbc151ad0 0x7f2bbc0ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45378/0 (socket says 172.21.15.45:45378) 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bba59c640 1 -- 172.21.15.45:0/3909403830 learned_addr learned my addr 172.21.15.45:0/3909403830 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bb9d9b640 1 --2- 172.21.15.45:0/3909403830 >> v2:172.21.15.45:3300/0 conn(0x7f2bbc157a20 0x7f2bbc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bbad9d640 1 --2- 172.21.15.45:0/3909403830 >> v2:172.21.15.114:3300/0 conn(0x7f2bbc06c230 0x7f2bbc154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bb9d9b640 1 -- 172.21.15.45:0/3909403830 >> v2:172.21.15.114:3300/0 conn(0x7f2bbc06c230 msgr2=0x7f2bbc154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:08.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bb9d9b640 1 --2- 172.21.15.45:0/3909403830 >> v2:172.21.15.114:3300/0 conn(0x7f2bbc06c230 0x7f2bbc154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bb9d9b640 1 -- 172.21.15.45:0/3909403830 >> v1:172.21.15.45:6789/0 conn(0x7f2bbc151ad0 legacy=0x7f2bbc0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.531+0000 7f2bb9d9b640 1 -- 172.21.15.45:0/3909403830 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc154430 con 0x7f2bbc157a20 2023-12-08T08:17:08.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.532+0000 7f2bb9d9b640 1 --2- 172.21.15.45:0/3909403830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc154930 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc06bca0 tx=0x7f2ba402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295471762878dbcd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.533+0000 7f2bb959a640 1 -- 172.21.15.45:0/3909403830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4031830 con 0x7f2bbc157a20 2023-12-08T08:17:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.533+0000 7f2bb959a640 1 -- 172.21.15.45:0/3909403830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba4031990 con 0x7f2bbc157a20 2023-12-08T08:17:08.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.533+0000 7f2bb959a640 1 -- 172.21.15.45:0/3909403830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4031d20 con 0x7f2bbc157a20 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.533+0000 7f2bbb59e640 1 -- 172.21.15.45:0/3909403830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 msgr2=0x7f2bbc154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.533+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/3909403830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc154930 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc06bca0 tx=0x7f2ba402b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 -- 172.21.15.45:0/3909403830 shutdown_connections 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/3909403830 >> v2:172.21.15.114:3300/0 conn(0x7f2bbc06c230 0x7f2bbc154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/3909403830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc154930 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 -- 172.21.15.45:0/3909403830 >> 172.21.15.45:0/3909403830 conn(0x7f2bbc066610 msgr2=0x7f2bbc066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 -- 172.21.15.45:0/3909403830 shutdown_connections 2023-12-08T08:17:08.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.534+0000 7f2bbb59e640 1 -- 172.21.15.45:0/3909403830 wait complete. 2023-12-08T08:17:08.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.535+0000 7f2bbb59e640 1 Processor -- start 2023-12-08T08:17:08.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.536+0000 7f2bbb59e640 1 -- start start 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.536+0000 7f2bbb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc06c230 0x7f2bbc14f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2bbc151ad0 0x7f2bbc0c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c3450 con 0x7f2bbc157a20 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0abe30 con 0x7f2bbc06c230 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0c0810 con 0x7f2bbc151ad0 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33344/0 (socket says 172.21.15.45:33344) 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 -- 172.21.15.45:0/528255985 learned_addr learned my addr 172.21.15.45:0/528255985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bb9d9b640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2bbc151ad0 0x7f2bbc0c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bba59c640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc06c230 0x7f2bbc14f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 -- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2bbc151ad0 msgr2=0x7f2bbc0c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2bbc151ad0 0x7f2bbc0c22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 -- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc06c230 msgr2=0x7f2bbc14f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc06c230 0x7f2bbc14f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.537+0000 7f2bbad9d640 1 -- 172.21.15.45:0/528255985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009400 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bbad9d640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d800 tx=0x7f2bb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400b6c0 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400b840 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400bbf0 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc0c2d40 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.538+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc1ea450 con 0x7f2bbc157a20 2023-12-08T08:17:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.539+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc0743e0 con 0x7f2bbc157a20 2023-12-08T08:17:08.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.540+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bb400bd50 con 0x7f2bbc157a20 2023-12-08T08:17:08.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.541+0000 7f2bb2ffd640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 0x7f2b9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.541+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f2bb4089ff0 con 0x7f2bbc157a20 2023-12-08T08:17:08.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.542+0000 7f2bba59c640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 0x7f2b9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.542+0000 7f2bba59c640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 0x7f2b9c06d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bac005c00 tx=0x7f2bac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.546+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2bb4054bf0 con 0x7f2bbc157a20 2023-12-08T08:17:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.739+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bbc0c7a40 con 0x7f2bbc157a20 2023-12-08T08:17:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.739+0000 7f2bb2ffd640 1 -- 172.21.15.45:0/528255985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bb4058210 con 0x7f2bbc157a20 2023-12-08T08:17:08.741 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 msgr2=0x7f2b9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 0x7f2b9c06d330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2bac005c00 tx=0x7f2bac009040 comp rx=0 tx=0).stop 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 msgr2=0x7f2bbc0c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400d800 tx=0x7f2bb400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 shutdown_connections 2023-12-08T08:17:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b9c06ae70 0x7f2b9c06d330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2bbc151ad0 0x7f2bbc0c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bbc157a20 0x7f2bbc0c2800 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 --2- 172.21.15.45:0/528255985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc06c230 0x7f2bbc14f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.742+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 >> 172.21.15.45:0/528255985 conn(0x7f2bbc066610 msgr2=0x7f2bbc152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.743+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 shutdown_connections 2023-12-08T08:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.743+0000 7f2bbb59e640 1 -- 172.21.15.45:0/528255985 wait complete. 2023-12-08T08:17:08.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:17:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.982+0000 7f8fd28bb640 1 Processor -- start 2023-12-08T08:17:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.982+0000 7f8fd28bb640 1 -- start start 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd28bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd28bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc151eb0 con 0x7f8fcc157a20 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd28bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0c80d0 con 0x7f8fcc0ca610 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd28bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc0c56a0 con 0x7f8fcc151ad0 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd18b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd18b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33348/0 (socket says 172.21.15.45:33348) 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd18b9640 1 -- 172.21.15.45:0/2393960493 learned_addr learned my addr 172.21.15.45:0/2393960493 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.984+0000 7f8fd10b8640 1 --1- 172.21.15.45:0/2393960493 >> v1:172.21.15.45:6789/0 conn(0x7f8fcc157a20 0x7f8fcc154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45380/0 (socket says 172.21.15.45:45380) 2023-12-08T08:17:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.985+0000 7f8fd18b9640 1 -- 172.21.15.45:0/2393960493 >> v1:172.21.15.114:6789/0 conn(0x7f8fcc0ca610 legacy=0x7f8fcc15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.985+0000 7f8fd18b9640 1 -- 172.21.15.45:0/2393960493 >> v1:172.21.15.45:6789/0 conn(0x7f8fcc157a20 legacy=0x7f8fcc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.985+0000 7f8fd18b9640 1 -- 172.21.15.45:0/2393960493 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc154430 con 0x7f8fcc151ad0 2023-12-08T08:17:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.986+0000 7f8fd18b9640 1 --2- 172.21.15.45:0/2393960493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009870 tx=0x7f8fc802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9564c177be22b979 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.986+0000 7f8fd08b7640 1 -- 172.21.15.45:0/2393960493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8030860 con 0x7f8fcc151ad0 2023-12-08T08:17:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.986+0000 7f8fd08b7640 1 -- 172.21.15.45:0/2393960493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc80309c0 con 0x7f8fcc151ad0 2023-12-08T08:17:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.986+0000 7f8fd08b7640 1 -- 172.21.15.45:0/2393960493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8030d50 con 0x7f8fcc151ad0 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2393960493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 msgr2=0x7f8fcc0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2393960493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009870 tx=0x7f8fc802b9a0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2393960493 shutdown_connections 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2393960493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0ca0d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2393960493 >> 172.21.15.45:0/2393960493 conn(0x7f8fcc066610 msgr2=0x7f8fcc066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2393960493 shutdown_connections 2023-12-08T08:17:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.987+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2393960493 wait complete. 2023-12-08T08:17:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.989+0000 7f8fd28bb640 1 Processor -- start 2023-12-08T08:17:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.989+0000 7f8fd28bb640 1 -- start start 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8fcc0ca610 0x7f8fcc0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 0x7f8fcc146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0ab190 con 0x7f8fcc151ad0 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc156bf0 con 0x7f8fcc157a20 2023-12-08T08:17:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd28bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0ac240 con 0x7f8fcc0ca610 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd10b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd10b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33356/0 (socket says 172.21.15.45:33356) 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.990+0000 7f8fd10b8640 1 -- 172.21.15.45:0/2414276161 learned_addr learned my addr 172.21.15.45:0/2414276161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd18b9640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8fcc0ca610 0x7f8fcc0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd20ba640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 0x7f8fcc146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 -- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8fcc0ca610 msgr2=0x7f8fcc0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8fcc0ca610 0x7f8fcc0c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 -- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 msgr2=0x7f8fcc146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 0x7f8fcc146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 -- 172.21.15.45:0/2414276161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80094d0 con 0x7f8fcc151ad0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd20ba640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 0x7f8fcc146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.991+0000 7f8fd10b8640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c3c0 tx=0x7f8fbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.992+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0074e0 con 0x7f8fcc151ad0 2023-12-08T08:17:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.992+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc007640 con 0x7f8fcc151ad0 2023-12-08T08:17:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.992+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc004a00 con 0x7f8fcc151ad0 2023-12-08T08:17:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.992+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc156e40 con 0x7f8fcc151ad0 2023-12-08T08:17:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.992+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc157400 con 0x7f8fcc151ad0 2023-12-08T08:17:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.993+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc157820 con 0x7f8fcc151ad0 2023-12-08T08:17:08.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.994+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fbc004b60 con 0x7f8fcc151ad0 2023-12-08T08:17:08.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.995+0000 7f8fc27fc640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 0x7f8fb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:08.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.995+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8fbc089550 con 0x7f8fcc151ad0 2023-12-08T08:17:08.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.995+0000 7f8fd18b9640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 0x7f8fb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:08.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.996+0000 7f8fd18b9640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 0x7f8fb006d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8036000 tx=0x7f8fc803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:08.999+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8fbc0540c0 con 0x7f8fcc151ad0 2023-12-08T08:17:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.199+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fcc0743e0 con 0x7f8fcc151ad0 2023-12-08T08:17:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.199+0000 7f8fc27fc640 1 -- 172.21.15.45:0/2414276161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fbc0576e0 con 0x7f8fcc151ad0 2023-12-08T08:17:09.201 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 msgr2=0x7f8fb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 0x7f8fb006d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8036000 tx=0x7f8fc803b040 comp rx=0 tx=0).stop 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 msgr2=0x7f8fcc0c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c3c0 tx=0x7f8fbc00c880 comp rx=0 tx=0).stop 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 shutdown_connections 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8fb006ae40 0x7f8fb006d300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fcc157a20 0x7f8fcc146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fcc151ad0 0x7f8fcc0c4630 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 --2- 172.21.15.45:0/2414276161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8fcc0ca610 0x7f8fcc0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 >> 172.21.15.45:0/2414276161 conn(0x7f8fcc066610 msgr2=0x7f8fcc0669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.202+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 shutdown_connections 2023-12-08T08:17:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.203+0000 7f8fd28bb640 1 -- 172.21.15.45:0/2414276161 wait complete. 2023-12-08T08:17:09.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:17:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.450+0000 7f7169b67640 1 Processor -- start 2023-12-08T08:17:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.451+0000 7f7169b67640 1 -- start start 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7169b67640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71640c4970 0x7f71640a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7169b67640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71640c60c0 con 0x7f716414c280 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7169b67640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7164152dc0 con 0x7f7164155790 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7169b67640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71641521d0 con 0x7f71640c4970 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7163fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71640c4970 0x7f71640a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7168b65640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f716414c280 0x7f716406cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45384/0 (socket says 172.21.15.45:45384) 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7168b65640 1 -- 172.21.15.45:0/2041361119 learned_addr learned my addr 172.21.15.45:0/2041361119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.452+0000 7f7163fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71640c4970 0x7f71640a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33368/0 (socket says 172.21.15.45:33368) 2023-12-08T08:17:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.453+0000 7f7163fff640 1 -- 172.21.15.45:0/2041361119 >> v1:172.21.15.114:6789/0 conn(0x7f7164155790 legacy=0x7f7164155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.453+0000 7f7163fff640 1 -- 172.21.15.45:0/2041361119 >> v1:172.21.15.45:6789/0 conn(0x7f716414c280 legacy=0x7f716406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.453+0000 7f7163fff640 1 -- 172.21.15.45:0/2041361119 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716414c660 con 0x7f71640c4970 2023-12-08T08:17:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.454+0000 7f7163fff640 1 --2- 172.21.15.45:0/2041361119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71640c4970 0x7f71640a4d10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f71500097a0 tx=0x7f715002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e29935bbe7fa4c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.454+0000 7f71637fe640 1 -- 172.21.15.45:0/2041361119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715002e070 con 0x7f71640c4970 2023-12-08T08:17:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f71637fe640 1 -- 172.21.15.45:0/2041361119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71500315a0 con 0x7f71640c4970 2023-12-08T08:17:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f71637fe640 1 -- 172.21.15.45:0/2041361119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7150031930 con 0x7f71640c4970 2023-12-08T08:17:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 -- 172.21.15.45:0/2041361119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71640c4970 msgr2=0x7f71640a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 --2- 172.21.15.45:0/2041361119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71640c4970 0x7f71640a4d10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f71500097a0 tx=0x7f715002b840 comp rx=0 tx=0).stop 2023-12-08T08:17:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 -- 172.21.15.45:0/2041361119 shutdown_connections 2023-12-08T08:17:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 --2- 172.21.15.45:0/2041361119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71640c4970 0x7f71640a4d10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 -- 172.21.15.45:0/2041361119 >> 172.21.15.45:0/2041361119 conn(0x7f7164066ce0 msgr2=0x7f71640a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.455+0000 7f7169b67640 1 -- 172.21.15.45:0/2041361119 shutdown_connections 2023-12-08T08:17:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.456+0000 7f7169b67640 1 -- 172.21.15.45:0/2041361119 wait complete. 2023-12-08T08:17:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.458+0000 7f7169b67640 1 Processor -- start 2023-12-08T08:17:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.458+0000 7f7169b67640 1 -- start start 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 0x7f7164150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 0x7f71640c0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71640c0f50 con 0x7f7164155790 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164150040 con 0x7f71640c4970 2023-12-08T08:17:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.459+0000 7f7169b67640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7164145b00 con 0x7f716414c280 2023-12-08T08:17:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33370/0 (socket says 172.21.15.45:33370) 2023-12-08T08:17:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 -- 172.21.15.45:0/1512534436 learned_addr learned my addr 172.21.15.45:0/1512534436 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7168b65640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 0x7f7164150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7163fff640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 0x7f71640c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 -- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 msgr2=0x7f71640c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 0x7f71640c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 -- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 msgr2=0x7f7164150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 0x7f7164150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 -- 172.21.15.45:0/1512534436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150009400 con 0x7f7164155790 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7163fff640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 0x7f71640c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7168b65640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 0x7f7164150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.460+0000 7f7169366640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c7b0 tx=0x7f715c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.461+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c003d80 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.461+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c005070 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.461+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71640a8880 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.461+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c005420 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.461+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7164145890 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.462+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71640a8a10 con 0x7f7164155790 2023-12-08T08:17:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.463+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f715c005580 con 0x7f7164155790 2023-12-08T08:17:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.464+0000 7f71617fa640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 0x7f714806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.464+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f715c088f90 con 0x7f7164155790 2023-12-08T08:17:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.465+0000 7f7168b65640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 0x7f714806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.465+0000 7f7168b65640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 0x7f714806d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7158007fd0 tx=0x7f7158009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.468+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f715c053b90 con 0x7f7164155790 2023-12-08T08:17:09.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.664+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71640678c0 con 0x7f7164155790 2023-12-08T08:17:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.665+0000 7f71617fa640 1 -- 172.21.15.45:0/1512534436 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v44) v1 ==== 105+0+11 (secure 0 0 0) 0x7f715c017020 con 0x7f7164155790 2023-12-08T08:17:09.667 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 msgr2=0x7f714806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 0x7f714806d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7158007fd0 tx=0x7f7158009040 comp rx=0 tx=0).stop 2023-12-08T08:17:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 msgr2=0x7f71640a8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c7b0 tx=0x7f715c00cc70 comp rx=0 tx=0).stop 2023-12-08T08:17:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 shutdown_connections 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f714806ae40 0x7f714806d300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f716414c280 0x7f71640c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7164155790 0x7f71640a8d10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 --2- 172.21.15.45:0/1512534436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71640c4970 0x7f7164150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 >> 172.21.15.45:0/1512534436 conn(0x7f7164066ce0 msgr2=0x7f7164146690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 shutdown_connections 2023-12-08T08:17:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.668+0000 7f7169b67640 1 -- 172.21.15.45:0/1512534436 wait complete. 2023-12-08T08:17:09.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:17:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.920+0000 7f68759b6640 1 Processor -- start 2023-12-08T08:17:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.920+0000 7f68759b6640 1 -- start start 2023-12-08T08:17:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.921+0000 7f68759b6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6870151d70 0x7f6870155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.921+0000 7f68759b6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f687006ca50 0x7f68700bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.921+0000 7f68759b6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700c5670 con 0x7f68700c4a60 2023-12-08T08:17:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.921+0000 7f68759b6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6870158120 con 0x7f687006ca50 2023-12-08T08:17:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.921+0000 7f68759b6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a4f60 con 0x7f6870151d70 2023-12-08T08:17:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f687006ca50 0x7f68700bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68700c4a60 0x7f6870158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45398/0 (socket says 172.21.15.45:45398) 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686e7fc640 1 -- 172.21.15.45:0/705298644 learned_addr learned my addr 172.21.15.45:0/705298644 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f687006ca50 0x7f68700bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33382/0 (socket says 172.21.15.45:33382) 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686effd640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6870151d70 0x7f6870155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 -- 172.21.15.45:0/705298644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6870151d70 msgr2=0x7f6870155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6870151d70 0x7f6870155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 -- 172.21.15.45:0/705298644 >> v1:172.21.15.45:6789/0 conn(0x7f68700c4a60 legacy=0x7f6870158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686f7fe640 1 -- 172.21.15.45:0/705298644 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700a5240 con 0x7f687006ca50 2023-12-08T08:17:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.922+0000 7f686dffb640 1 -- 172.21.15.45:0/705298644 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793021614 0 0) 0x7f68700c5670 con 0x7f68700c4a60 2023-12-08T08:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.923+0000 7f686f7fe640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f687006ca50 0x7f68700bed60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a43ffcf83c5261 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f686dffb640 1 -- 172.21.15.45:0/705298644 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686802cb30 con 0x7f687006ca50 2023-12-08T08:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f686dffb640 1 -- 172.21.15.45:0/705298644 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686802cc90 con 0x7f687006ca50 2023-12-08T08:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f686dffb640 1 -- 172.21.15.45:0/705298644 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868034440 con 0x7f687006ca50 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 -- 172.21.15.45:0/705298644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f687006ca50 msgr2=0x7f68700bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f687006ca50 0x7f68700bed60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802bd80 comp rx=0 tx=0).stop 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 -- 172.21.15.45:0/705298644 shutdown_connections 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f687006ca50 0x7f68700bed60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 --2- 172.21.15.45:0/705298644 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6870151d70 0x7f6870155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.924+0000 7f68759b6640 1 -- 172.21.15.45:0/705298644 >> 172.21.15.45:0/705298644 conn(0x7f68700c2430 msgr2=0x7f68700c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.925+0000 7f68759b6640 1 -- 172.21.15.45:0/705298644 shutdown_connections 2023-12-08T08:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.925+0000 7f68759b6640 1 -- 172.21.15.45:0/705298644 wait complete. 2023-12-08T08:17:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.926+0000 7f68759b6640 1 Processor -- start 2023-12-08T08:17:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.926+0000 7f68759b6640 1 -- start start 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f687006ca50 0x7f68701e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6870151d70 0x7f687014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a7430 con 0x7f68700c4a60 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870070e70 con 0x7f6870151d70 2023-12-08T08:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.927+0000 7f68759b6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870155010 con 0x7f687006ca50 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33390/0 (socket says 172.21.15.45:33390) 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 -- 172.21.15.45:0/832653965 learned_addr learned my addr 172.21.15.45:0/832653965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 -- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f687006ca50 msgr2=0x7f68701e9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f687006ca50 0x7f68701e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 -- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6870151d70 msgr2=0x7f687014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6870151d70 0x7f687014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.928+0000 7f686e7fc640 1 -- 172.21.15.45:0/832653965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009a70 con 0x7f68700c4a60 2023-12-08T08:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f686e7fc640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f685800c500 tx=0x7f685800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858007560 con 0x7f68700c4a60 2023-12-08T08:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580047e0 con 0x7f68700c4a60 2023-12-08T08:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858004b90 con 0x7f68700c4a60 2023-12-08T08:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68700a7160 con 0x7f68700c4a60 2023-12-08T08:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.929+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6870157760 con 0x7f68700c4a60 2023-12-08T08:17:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.930+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870074670 con 0x7f68700c4a60 2023-12-08T08:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.931+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6858004cf0 con 0x7f68700c4a60 2023-12-08T08:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.932+0000 7f6867fff640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 0x7f685006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.932+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6858088b40 con 0x7f68700c4a60 2023-12-08T08:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.932+0000 7f686effd640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 0x7f685006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.933+0000 7f686effd640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 0x7f685006d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6860006fd0 tx=0x7f6860008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:09.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:09.936+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68580537e0 con 0x7f68700c4a60 2023-12-08T08:17:10.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.140+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6870070fe0 con 0x7f68700c4a60 2023-12-08T08:17:10.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.141+0000 7f6867fff640 1 -- 172.21.15.45:0/832653965 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v44) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6870070fe0 con 0x7f68700c4a60 2023-12-08T08:17:10.142 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 msgr2=0x7f685006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 0x7f685006d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6860006fd0 tx=0x7f6860008040 comp rx=0 tx=0).stop 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 msgr2=0x7f68700a6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f685800c500 tx=0x7f685800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 shutdown_connections 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f685006ae70 0x7f685006d330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6870151d70 0x7f687014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c4a60 0x7f68700a6c20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 --2- 172.21.15.45:0/832653965 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f687006ca50 0x7f68701e9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 >> 172.21.15.45:0/832653965 conn(0x7f68700c2430 msgr2=0x7f6870158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:10.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.143+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 shutdown_connections 2023-12-08T08:17:10.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.144+0000 7f68759b6640 1 -- 172.21.15.45:0/832653965 wait complete. 2023-12-08T08:17:10.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.378+0000 7f522d02e640 1 Processor -- start 2023-12-08T08:17:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.379+0000 7f522d02e640 1 -- start start 2023-12-08T08:17:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52281519c0 0x7f52281584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f52280c44d0 0x7f5228154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52280c7a50 0x7f52280ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52281553b0 con 0x7f52280c7a50 2023-12-08T08:17:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280c4a00 con 0x7f52280c44d0 2023-12-08T08:17:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.380+0000 7f522d02e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c4ce0 con 0x7f52281519c0 2023-12-08T08:17:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52280c7a50 0x7f52280ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52280c7a50 0x7f52280ab6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33402/0 (socket says 172.21.15.45:33402) 2023-12-08T08:17:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 -- 172.21.15.45:0/1248452677 learned_addr learned my addr 172.21.15.45:0/1248452677 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f5227fff640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52281519c0 0x7f52281584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f52277fe640 1 --2- 172.21.15.45:0/1248452677 >> v2:172.21.15.114:3300/0 conn(0x7f52280c44d0 0x7f5228154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 -- 172.21.15.45:0/1248452677 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52281519c0 msgr2=0x7f52281584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52281519c0 0x7f52281584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 -- 172.21.15.45:0/1248452677 >> v2:172.21.15.114:3300/0 conn(0x7f52280c44d0 msgr2=0x7f5228154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 --2- 172.21.15.45:0/1248452677 >> v2:172.21.15.114:3300/0 conn(0x7f52280c44d0 0x7f5228154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.381+0000 7f522c82d640 1 -- 172.21.15.45:0/1248452677 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52281579e0 con 0x7f52280c7a50 2023-12-08T08:17:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.383+0000 7f522c82d640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c7a50 0x7f52280ab6b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f52280cabf0 tx=0x7f522002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fe4245ff6c59eb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.383+0000 7f5226ffd640 1 -- 172.21.15.45:0/1248452677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200317e0 con 0x7f52280c7a50 2023-12-08T08:17:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.383+0000 7f5226ffd640 1 -- 172.21.15.45:0/1248452677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220031940 con 0x7f52280c7a50 2023-12-08T08:17:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f5226ffd640 1 -- 172.21.15.45:0/1248452677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220031cd0 con 0x7f52280c7a50 2023-12-08T08:17:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 -- 172.21.15.45:0/1248452677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c7a50 msgr2=0x7f52280ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c7a50 0x7f52280ab6b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f52280cabf0 tx=0x7f522002b880 comp rx=0 tx=0).stop 2023-12-08T08:17:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 -- 172.21.15.45:0/1248452677 shutdown_connections 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 --2- 172.21.15.45:0/1248452677 >> v2:172.21.15.114:3300/0 conn(0x7f52280c44d0 0x7f5228154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c7a50 0x7f52280ab6b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 --2- 172.21.15.45:0/1248452677 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52281519c0 0x7f52281584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.384+0000 7f522d02e640 1 -- 172.21.15.45:0/1248452677 >> 172.21.15.45:0/1248452677 conn(0x7f52280661f0 msgr2=0x7f5228066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.385+0000 7f522d02e640 1 -- 172.21.15.45:0/1248452677 shutdown_connections 2023-12-08T08:17:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.385+0000 7f522d02e640 1 -- 172.21.15.45:0/1248452677 wait complete. 2023-12-08T08:17:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.386+0000 7f522d02e640 1 Processor -- start 2023-12-08T08:17:10.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.386+0000 7f522d02e640 1 -- start start 2023-12-08T08:17:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 0x7f5228155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 0x7f5228156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52281ede20 con 0x7f52280c44d0 2023-12-08T08:17:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52281ed1e0 con 0x7f52281519c0 2023-12-08T08:17:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.387+0000 7f522d02e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52281ed480 con 0x7f52280c7a50 2023-12-08T08:17:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33406/0 (socket says 172.21.15.45:33406) 2023-12-08T08:17:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 -- 172.21.15.45:0/4162206006 learned_addr learned my addr 172.21.15.45:0/4162206006 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f52277fe640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 0x7f5228155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f522c82d640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 0x7f5228156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 -- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 msgr2=0x7f5228155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 0x7f5228155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 -- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 msgr2=0x7f5228156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 0x7f5228156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f5227fff640 1 -- 172.21.15.45:0/4162206006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094d0 con 0x7f52280c44d0 2023-12-08T08:17:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f522c82d640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 0x7f5228156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.388+0000 7f52277fe640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 0x7f5228155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f5227fff640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5218007ef0 tx=0x7f521800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218014620 con 0x7f52280c44d0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218014780 con 0x7f52280c44d0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218014b30 con 0x7f52280c44d0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52281ed760 con 0x7f52280c44d0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.389+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5228150530 con 0x7f52280c44d0 2023-12-08T08:17:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.390+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52280743e0 con 0x7f52280c44d0 2023-12-08T08:17:10.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.391+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5218014c90 con 0x7f52280c44d0 2023-12-08T08:17:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.392+0000 7f5224ff9640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.392+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f521808a4c0 con 0x7f52280c44d0 2023-12-08T08:17:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.392+0000 7f52277fe640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.393+0000 7f52277fe640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 0x7f520806d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5210006fd0 tx=0x7f5210008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.396+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52180550c0 con 0x7f52280c44d0 2023-12-08T08:17:10.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.631+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52280c9240 con 0x7f52280c44d0 2023-12-08T08:17:10.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.632+0000 7f5224ff9640 1 -- 172.21.15.45:0/4162206006 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6121 (secure 0 0 0) 0x7f52180586e0 con 0x7f52280c44d0 2023-12-08T08:17:10.634 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:10.635 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-08T08:17:10.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.634+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 msgr2=0x7f520806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.634+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 0x7f520806d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5210006fd0 tx=0x7f5210008040 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 msgr2=0x7f522814fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5218007ef0 tx=0x7f521800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 shutdown_connections 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f520806ae40 0x7f520806d300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f52280c7a50 0x7f5228155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52281519c0 0x7f5228156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 --2- 172.21.15.45:0/4162206006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52280c44d0 0x7f522814fff0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 >> 172.21.15.45:0/4162206006 conn(0x7f52280661f0 msgr2=0x7f52280ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 shutdown_connections 2023-12-08T08:17:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.635+0000 7f522d02e640 1 -- 172.21.15.45:0/4162206006 wait complete. 2023-12-08T08:17:10.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:10.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.873+0000 7f7a3d941640 1 Processor -- start 2023-12-08T08:17:10.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.874+0000 7f7a3d941640 1 -- start start 2023-12-08T08:17:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.875+0000 7f7a3d941640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a380a4d10 0x7f7a38156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.875+0000 7f7a3d941640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3814c880 con 0x7f7a3814c4a0 2023-12-08T08:17:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.875+0000 7f7a3d941640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a380c63b0 con 0x7f7a38153880 2023-12-08T08:17:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.875+0000 7f7a3d941640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380c4730 con 0x7f7a380a4d10 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a380a4d10 0x7f7a38156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a380a4d10 0x7f7a38156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33410/0 (socket says 172.21.15.45:33410) 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 -- 172.21.15.45:0/1323883075 learned_addr learned my addr 172.21.15.45:0/1323883075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 -- 172.21.15.45:0/1323883075 >> v1:172.21.15.114:6789/0 conn(0x7f7a38153880 legacy=0x7f7a38153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 -- 172.21.15.45:0/1323883075 >> v1:172.21.15.45:6789/0 conn(0x7f7a3814c4a0 legacy=0x7f7a38155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.876+0000 7f7a367fc640 1 -- 172.21.15.45:0/1323883075 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380a5210 con 0x7f7a380a4d10 2023-12-08T08:17:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.878+0000 7f7a367fc640 1 --2- 172.21.15.45:0/1323883075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a380a4d10 0x7f7a38156490 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5e3d80b6b72a11 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.878+0000 7f7a35ffb640 1 -- 172.21.15.45:0/1323883075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20030860 con 0x7f7a380a4d10 2023-12-08T08:17:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.878+0000 7f7a35ffb640 1 -- 172.21.15.45:0/1323883075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a200309c0 con 0x7f7a380a4d10 2023-12-08T08:17:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.878+0000 7f7a35ffb640 1 -- 172.21.15.45:0/1323883075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20030d50 con 0x7f7a380a4d10 2023-12-08T08:17:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 -- 172.21.15.45:0/1323883075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a380a4d10 msgr2=0x7f7a38156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1323883075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a380a4d10 0x7f7a38156490 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2002b9a0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 -- 172.21.15.45:0/1323883075 shutdown_connections 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1323883075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a380a4d10 0x7f7a38156490 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 -- 172.21.15.45:0/1323883075 >> 172.21.15.45:0/1323883075 conn(0x7f7a380661f0 msgr2=0x7f7a38066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 -- 172.21.15.45:0/1323883075 shutdown_connections 2023-12-08T08:17:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.879+0000 7f7a3d941640 1 -- 172.21.15.45:0/1323883075 wait complete. 2023-12-08T08:17:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.880+0000 7f7a3d941640 1 Processor -- start 2023-12-08T08:17:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.881+0000 7f7a3d941640 1 -- start start 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 0x7f7a380aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3814c4a0 0x7f7a381ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a38145b80 con 0x7f7a38153880 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381ead90 con 0x7f7a3814c4a0 2023-12-08T08:17:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a3d941640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381e77c0 con 0x7f7a380a4d10 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33422/0 (socket says 172.21.15.45:33422) 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 -- 172.21.15.45:0/1981516879 learned_addr learned my addr 172.21.15.45:0/1981516879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a367fc640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3814c4a0 0x7f7a381ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a36ffd640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 0x7f7a380aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 -- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 msgr2=0x7f7a380aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 0x7f7a380aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 -- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3814c4a0 msgr2=0x7f7a381ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.882+0000 7f7a377fe640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3814c4a0 0x7f7a381ea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a377fe640 1 -- 172.21.15.45:0/1981516879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200094d0 con 0x7f7a38153880 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a36ffd640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 0x7f7a380aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a377fe640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7a30001eb0 tx=0x7f7a3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a300052d0 con 0x7f7a38153880 2023-12-08T08:17:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30005430 con 0x7f7a38153880 2023-12-08T08:17:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30003810 con 0x7f7a38153880 2023-12-08T08:17:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a380c0640 con 0x7f7a38153880 2023-12-08T08:17:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.883+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a380a9cb0 con 0x7f7a38153880 2023-12-08T08:17:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.884+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a380a9830 con 0x7f7a38153880 2023-12-08T08:17:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.886+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a30003970 con 0x7f7a38153880 2023-12-08T08:17:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.886+0000 7f7a2ffff640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 0x7f7a1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.887+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7a30089100 con 0x7f7a38153880 2023-12-08T08:17:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.887+0000 7f7a36ffd640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 0x7f7a1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.887+0000 7f7a36ffd640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 0x7f7a1806d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a381482e0 tx=0x7f7a28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:10.891+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a380a9830 con 0x7f7a38153880 2023-12-08T08:17:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.085+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a380a9830 con 0x7f7a38153880 2023-12-08T08:17:11.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.090+0000 7f7a2ffff640 1 -- 172.21.15.45:0/1981516879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f7a380a9830 con 0x7f7a38153880 2023-12-08T08:17:11.092 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:11.092 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:11.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 msgr2=0x7f7a1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 0x7f7a1806d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a381482e0 tx=0x7f7a28009040 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 msgr2=0x7f7a381e7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7a30001eb0 tx=0x7f7a3000c890 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 shutdown_connections 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7a1806ae40 0x7f7a1806d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a38153880 0x7f7a381e7280 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a3814c4a0 0x7f7a381ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 --2- 172.21.15.45:0/1981516879 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7a380a4d10 0x7f7a380aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 >> 172.21.15.45:0/1981516879 conn(0x7f7a380661f0 msgr2=0x7f7a38147440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:11.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 shutdown_connections 2023-12-08T08:17:11.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.093+0000 7f7a3d941640 1 -- 172.21.15.45:0/1981516879 wait complete. 2023-12-08T08:17:11.114 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:17:11.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:11.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.342+0000 7f463e672640 1 Processor -- start 2023-12-08T08:17:11.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.343+0000 7f463e672640 1 -- start start 2023-12-08T08:17:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.344+0000 7f463e672640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.344+0000 7f463e672640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 0x7f46381584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.344+0000 7f463e672640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380c8470 con 0x7f46380c7d50 2023-12-08T08:17:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.344+0000 7f463e672640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463806cb30 con 0x7f46380ca6d0 2023-12-08T08:17:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.344+0000 7f463e672640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463806c320 con 0x7f46380af290 2023-12-08T08:17:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.345+0000 7f463de71640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 0x7f46381584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.345+0000 7f463d670640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.345+0000 7f463d670640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:40544/0 (socket says 172.21.15.45:40544) 2023-12-08T08:17:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.345+0000 7f463d670640 1 -- 172.21.15.45:0/2678415333 learned_addr learned my addr 172.21.15.45:0/2678415333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f462ffff640 1 -- 172.21.15.45:0/2678415333 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763049990 0 0) 0x7f46380c8470 con 0x7f46380c7d50 2023-12-08T08:17:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f463d670640 1 -- 172.21.15.45:0/2678415333 >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 msgr2=0x7f46381584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f463d670640 1 --2- 172.21.15.45:0/2678415333 >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 0x7f46381584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f463d670640 1 -- 172.21.15.45:0/2678415333 >> v1:172.21.15.114:6789/0 conn(0x7f46380c7d50 legacy=0x7f4638157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f463d670640 1 -- 172.21.15.45:0/2678415333 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380c4fd0 con 0x7f46380af290 2023-12-08T08:17:11.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.346+0000 7f463de71640 1 --2- 172.21.15.45:0/2678415333 >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 0x7f46381584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.348+0000 7f463d670640 1 --2- 172.21.15.45:0/2678415333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4deee40bc5f9d0b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.348+0000 7f462ffff640 1 -- 172.21.15.45:0/2678415333 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340317c0 con 0x7f46380af290 2023-12-08T08:17:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.348+0000 7f462ffff640 1 -- 172.21.15.45:0/2678415333 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634031920 con 0x7f46380af290 2023-12-08T08:17:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.348+0000 7f462ffff640 1 -- 172.21.15.45:0/2678415333 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634031cb0 con 0x7f46380af290 2023-12-08T08:17:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 -- 172.21.15.45:0/2678415333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 msgr2=0x7f46380ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 --2- 172.21.15.45:0/2678415333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463402b860 comp rx=0 tx=0).stop 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 -- 172.21.15.45:0/2678415333 shutdown_connections 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 --2- 172.21.15.45:0/2678415333 >> v2:172.21.15.114:3300/0 conn(0x7f46380ca6d0 0x7f46381584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 --2- 172.21.15.45:0/2678415333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46380ca190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 -- 172.21.15.45:0/2678415333 >> 172.21.15.45:0/2678415333 conn(0x7f46380663d0 msgr2=0x7f46380667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 -- 172.21.15.45:0/2678415333 shutdown_connections 2023-12-08T08:17:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.349+0000 7f463e672640 1 -- 172.21.15.45:0/2678415333 wait complete. 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.351+0000 7f463e672640 1 Processor -- start 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.351+0000 7f463e672640 1 -- start start 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46380c7d50 0x7f46381ec410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381ee050 con 0x7f46380ca6d0 2023-12-08T08:17:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381ece90 con 0x7f46380c7d50 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463e672640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463814db00 con 0x7f46380af290 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463de71640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463de71640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33434/0 (socket says 172.21.15.45:33434) 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463de71640 1 -- 172.21.15.45:0/876606826 learned_addr learned my addr 172.21.15.45:0/876606826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463d670640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.352+0000 7f463ce6f640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46380c7d50 0x7f46381ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 -- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 msgr2=0x7f46381566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46381566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 -- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46380c7d50 msgr2=0x7f46381ec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46380c7d50 0x7f46381ec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 -- 172.21.15.45:0/876606826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009a70 con 0x7f46380ca6d0 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463de71640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4630009f00 tx=0x7f463000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630009d70 con 0x7f46380ca6d0 2023-12-08T08:17:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000f040 con 0x7f46380ca6d0 2023-12-08T08:17:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630003bb0 con 0x7f46380ca6d0 2023-12-08T08:17:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.353+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46340094d0 con 0x7f46380ca6d0 2023-12-08T08:17:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.354+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463814b3a0 con 0x7f46380ca6d0 2023-12-08T08:17:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.355+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380743e0 con 0x7f46380ca6d0 2023-12-08T08:17:11.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.356+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4630014480 con 0x7f46380ca6d0 2023-12-08T08:17:11.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.357+0000 7f462dffb640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 0x7f461c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.357+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f463008a6b0 con 0x7f46380ca6d0 2023-12-08T08:17:11.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.357+0000 7f463d670640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 0x7f461c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.358+0000 7f463d670640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 0x7f461c06d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4634036000 tx=0x7f463403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.361+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46300552b0 con 0x7f46380ca6d0 2023-12-08T08:17:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.592+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46380734f0 con 0x7f46380ca6d0 2023-12-08T08:17:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.594+0000 7f462dffb640 1 -- 172.21.15.45:0/876606826 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6121 (secure 0 0 0) 0x7f46300588d0 con 0x7f46380ca6d0 2023-12-08T08:17:11.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:11.598 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 msgr2=0x7f461c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 0x7f461c06d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4634036000 tx=0x7f463403d040 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 msgr2=0x7f46381ec950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4630009f00 tx=0x7f463000c490 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 shutdown_connections 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f461c06ae70 0x7f461c06d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46380ca6d0 0x7f46381ec950 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46380c7d50 0x7f46381ec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 --2- 172.21.15.45:0/876606826 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f46380af290 0x7f46381566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.596+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 >> 172.21.15.45:0/876606826 conn(0x7f46380663d0 msgr2=0x7f46380acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.597+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 shutdown_connections 2023-12-08T08:17:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.597+0000 7f463e672640 1 -- 172.21.15.45:0/876606826 wait complete. 2023-12-08T08:17:11.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:11.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.834+0000 7f71a5dc5640 1 Processor -- start 2023-12-08T08:17:11.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.834+0000 7f71a5dc5640 1 -- start start 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f71a5dc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71a014c4a0 0x7f71a0156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f71a5dc5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a014c880 con 0x7f71a0153880 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f71a5dc5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a00c63b0 con 0x7f71a00a4d10 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f71a5dc5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00c4730 con 0x7f71a014c4a0 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f719f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71a014c4a0 0x7f71a0156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f719ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71a0153880 0x7f71a0153c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45408/0 (socket says 172.21.15.45:45408) 2023-12-08T08:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.836+0000 7f719ffff640 1 -- 172.21.15.45:0/3334595124 learned_addr learned my addr 172.21.15.45:0/3334595124 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.837+0000 7f719f7fe640 1 -- 172.21.15.45:0/3334595124 >> v1:172.21.15.114:6789/0 conn(0x7f71a00a4d10 legacy=0x7f71a0155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.837+0000 7f719f7fe640 1 -- 172.21.15.45:0/3334595124 >> v1:172.21.15.45:6789/0 conn(0x7f71a0153880 legacy=0x7f71a0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.837+0000 7f719f7fe640 1 -- 172.21.15.45:0/3334595124 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a00a5210 con 0x7f71a014c4a0 2023-12-08T08:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.838+0000 7f719f7fe640 1 --2- 172.21.15.45:0/3334595124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0156490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71900097a0 tx=0x7f719002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8bd297012ed7b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.838+0000 7f719e7fc640 1 -- 172.21.15.45:0/3334595124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719002e070 con 0x7f71a014c4a0 2023-12-08T08:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.838+0000 7f719e7fc640 1 -- 172.21.15.45:0/3334595124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900315a0 con 0x7f71a014c4a0 2023-12-08T08:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.838+0000 7f719e7fc640 1 -- 172.21.15.45:0/3334595124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190031930 con 0x7f71a014c4a0 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 -- 172.21.15.45:0/3334595124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 msgr2=0x7f71a0156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/3334595124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0156490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f71900097a0 tx=0x7f719002b840 comp rx=0 tx=0).stop 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 -- 172.21.15.45:0/3334595124 shutdown_connections 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/3334595124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0156490 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 -- 172.21.15.45:0/3334595124 >> 172.21.15.45:0/3334595124 conn(0x7f71a00661f0 msgr2=0x7f71a0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 -- 172.21.15.45:0/3334595124 shutdown_connections 2023-12-08T08:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.839+0000 7f71a5dc5640 1 -- 172.21.15.45:0/3334595124 wait complete. 2023-12-08T08:17:11.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.841+0000 7f71a5dc5640 1 Processor -- start 2023-12-08T08:17:11.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.841+0000 7f71a5dc5640 1 -- start start 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71a00a4d10 0x7f71a0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 0x7f71a01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00716f0 con 0x7f71a014c4a0 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00711c0 con 0x7f71a0153880 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f71a5dc5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0071410 con 0x7f71a00a4d10 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f719effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f719effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33454/0 (socket says 172.21.15.45:33454) 2023-12-08T08:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.842+0000 7f719effd640 1 -- 172.21.15.45:0/1080760126 learned_addr learned my addr 172.21.15.45:0/1080760126 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719f7fe640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71a00a4d10 0x7f71a0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719ffff640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 0x7f71a01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 -- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71a00a4d10 msgr2=0x7f71a0150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71a00a4d10 0x7f71a0150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 -- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 msgr2=0x7f71a01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 0x7f71a01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 -- 172.21.15.45:0/1080760126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190009400 con 0x7f71a014c4a0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719ffff640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 0x7f71a01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f719effd640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f719400b3f0 tx=0x7f719400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194011830 con 0x7f71a014c4a0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194011990 con 0x7f71a014c4a0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a0150330 con 0x7f71a014c4a0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194011d40 con 0x7f71a014c4a0 2023-12-08T08:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.843+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a0151df0 con 0x7f71a014c4a0 2023-12-08T08:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.844+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0151bc0 con 0x7f71a014c4a0 2023-12-08T08:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.845+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f719401a400 con 0x7f71a014c4a0 2023-12-08T08:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.846+0000 7f7187fff640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 0x7f718c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.846+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f71940898e0 con 0x7f71a014c4a0 2023-12-08T08:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.847+0000 7f719f7fe640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 0x7f718c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.847+0000 7f719f7fe640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 0x7f718c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7190036000 tx=0x7f719003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:11.850+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71a0151bc0 con 0x7f71a014c4a0 2023-12-08T08:17:12.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.080+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71a0070ee0 con 0x7f71a014c4a0 2023-12-08T08:17:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.081+0000 7f7187fff640 1 -- 172.21.15.45:0/1080760126 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6121 (secure 0 0 0) 0x7f71a0070ee0 con 0x7f71a014c4a0 2023-12-08T08:17:12.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:12.084 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:29.411749+0000","modified":"2023-12-08T08:16:32.505404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2643055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2643055},{"type":"v1","addr":"172.21.15.45:6837","nonce":2643055}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-08T08:17:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 msgr2=0x7f718c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 0x7f718c06d330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7190036000 tx=0x7f719003d040 comp rx=0 tx=0).stop 2023-12-08T08:17:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 msgr2=0x7f71a0150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f719400b3f0 tx=0x7f719400b8b0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 shutdown_connections 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f718c06ae70 0x7f718c06d330 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7190036000 tx=0x7f719003d040 comp rx=0 tx=0).stop 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0153880 0x7f71a01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71a014c4a0 0x7f71a0150c90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 --2- 172.21.15.45:0/1080760126 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f71a00a4d10 0x7f71a0150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.084+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 >> 172.21.15.45:0/1080760126 conn(0x7f71a00661f0 msgr2=0x7f71a0147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.085+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 shutdown_connections 2023-12-08T08:17:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.085+0000 7f71a5dc5640 1 -- 172.21.15.45:0/1080760126 wait complete. 2023-12-08T08:17:12.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.327+0000 7f134bfff640 1 Processor -- start 2023-12-08T08:17:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.328+0000 7f134bfff640 1 -- start start 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.329+0000 7f134bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f134c151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c151ea0 con 0x7f134c0c1670 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c154850 con 0x7f134c0c1210 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c14ec20 con 0x7f134c14e840 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f134c0c1670 0x7f134c0aa590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45422/0 (socket says 172.21.15.45:45422) 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134b7fe640 1 -- 172.21.15.45:0/2289328392 learned_addr learned my addr 172.21.15.45:0/2289328392 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.330+0000 7f134affd640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f134c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788677114 0 0) 0x7f134c151ea0 con 0x7f134c0c1670 2023-12-08T08:17:12.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1338003520 con 0x7f134c0c1670 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382012741 0 0) 0x7f1338003520 con 0x7f134c0c1670 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 msgr2=0x7f134c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f134c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 >> v1:172.21.15.114:6789/0 conn(0x7f134c0c1210 legacy=0x7f134c0a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c154b30 con 0x7f134c0c1670 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f1344001670 con 0x7f134c0c1670 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 >> v1:172.21.15.45:6789/0 conn(0x7f134c0c1670 legacy=0x7f134c0aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13380039a0 0x7f1338003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f13380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1338004d00 0x7f1338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c14ec20 con 0x7f13380039a0 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133800bb40 con 0x7f1338004d00 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.331+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133800bd00 con 0x7f134c14e840 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13380039a0 0x7f1338003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134b7fe640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1338004d00 0x7f1338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f13427fc640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f13380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 -- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 msgr2=0x7f13380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c14e840 0x7f13380047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 -- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1338004d00 msgr2=0x7f1338005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1338004d00 0x7f1338005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.332+0000 7f134affd640 1 -- 172.21.15.45:0/2289328392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338003520 con 0x7f13380039a0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.333+0000 7f134affd640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13380039a0 0x7f1338003dc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f133c009fc0 tx=0x7f13380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2047c2b00e495e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.333+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c02cc20 con 0x7f13380039a0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00f040 con 0x7f13380039a0 2023-12-08T08:17:12.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134a7fc640 1 -- 172.21.15.45:0/2289328392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c034440 con 0x7f13380039a0 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 -- 172.21.15.45:0/2289328392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13380039a0 msgr2=0x7f1338003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 --2- 172.21.15.45:0/2289328392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13380039a0 0x7f1338003dc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f133c009fc0 tx=0x7f13380057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134b7fe640 1 -- 172.21.15.45:0/2289328392 reap_dead start 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 -- 172.21.15.45:0/2289328392 shutdown_connections 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 -- 172.21.15.45:0/2289328392 >> 172.21.15.45:0/2289328392 conn(0x7f134c0c5780 msgr2=0x7f134c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 -- 172.21.15.45:0/2289328392 shutdown_connections 2023-12-08T08:17:12.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.334+0000 7f134bfff640 1 -- 172.21.15.45:0/2289328392 wait complete. 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.336+0000 7f134bfff640 1 Processor -- start 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.336+0000 7f134bfff640 1 -- start start 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13380039a0 0x7f134c1e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 0x7f134c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c14eda0 con 0x7f134c14fe50 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c1502d0 con 0x7f13380039a0 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c14f2d0 con 0x7f134c06fb30 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33486/0 (socket says 172.21.15.45:33486) 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.337+0000 7f134b7fe640 1 -- 172.21.15.45:0/2870717252 learned_addr learned my addr 172.21.15.45:0/2870717252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134affd640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13380039a0 0x7f134c1e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f13427fc640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 0x7f134c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 -- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 msgr2=0x7f134c14f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 0x7f134c14f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 -- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13380039a0 msgr2=0x7f134c1e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13380039a0 0x7f134c1e09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 -- 172.21.15.45:0/2870717252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c14eff0 con 0x7f134c14fe50 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f13427fc640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 0x7f134c14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f134b7fe640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13440010e0 tx=0x7f134400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.338+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400c610 con 0x7f134c14fe50 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.339+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c0c3e90 con 0x7f134c14fe50 2023-12-08T08:17:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.339+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400c770 con 0x7f134c14fe50 2023-12-08T08:17:12.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.339+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400cb20 con 0x7f134c14fe50 2023-12-08T08:17:12.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.339+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c0c4e30 con 0x7f134c14fe50 2023-12-08T08:17:12.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.340+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c0743e0 con 0x7f134c14fe50 2023-12-08T08:17:12.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.341+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f134400cc80 con 0x7f134c14fe50 2023-12-08T08:17:12.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.342+0000 7f1343fff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 0x7f132c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.342+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f13440898a0 con 0x7f134c14fe50 2023-12-08T08:17:12.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.342+0000 7f134affd640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 0x7f132c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.343+0000 7f134affd640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 0x7f132c06d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f133c036000 tx=0x7f133c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.346+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1344054440 con 0x7f134c14fe50 2023-12-08T08:17:12.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.540+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f134c154470 con 0x7f134c14fe50 2023-12-08T08:17:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.544+0000 7f1343fff640 1 -- 172.21.15.45:0/2870717252 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+20466 (secure 0 0 0) 0x7f1344057a60 con 0x7f134c14fe50 2023-12-08T08:17:12.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:12.547 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:16:46.670342+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:16:27.503085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:16:28.455815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.547+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 msgr2=0x7f132c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.547+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 0x7f132c06d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f133c036000 tx=0x7f133c02e000 comp rx=0 tx=0).stop 2023-12-08T08:17:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.547+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 msgr2=0x7f134c1ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.547+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13440010e0 tx=0x7f134400eb90 comp rx=0 tx=0).stop 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 shutdown_connections 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f132c06ae40 0x7f132c06d300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f134c06fb30 0x7f134c14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134c14fe50 0x7f134c1ecc50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 --2- 172.21.15.45:0/2870717252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13380039a0 0x7f134c1e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 >> 172.21.15.45:0/2870717252 conn(0x7f134c0c5780 msgr2=0x7f134c06c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:12.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 shutdown_connections 2023-12-08T08:17:12.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.548+0000 7f134bfff640 1 -- 172.21.15.45:0/2870717252 wait complete. 2023-12-08T08:17:12.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:17:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.787+0000 7f726ffff640 1 Processor -- start 2023-12-08T08:17:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.787+0000 7f726ffff640 1 -- start start 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7270155dd0 0x7f727006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72701521e0 con 0x7f72700c5600 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726ffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72701524c0 con 0x7f72700c50b0 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726ffff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7270152b80 con 0x7f7270155dd0 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72700c5600 0x7f72701556c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45438/0 (socket says 172.21.15.45:45438) 2023-12-08T08:17:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.789+0000 7f726effd640 1 -- 172.21.15.45:0/1287224313 learned_addr learned my addr 172.21.15.45:0/1287224313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726f7fe640 1 --2- 172.21.15.45:0/1287224313 >> v2:172.21.15.114:3300/0 conn(0x7f7270155dd0 0x7f727006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801611925 0 0) 0x7f72701521e0 con 0x7f72700c5600 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f725c003520 con 0x7f72700c5600 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206301464 0 0) 0x7f725c003520 con 0x7f72700c5600 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 >> v2:172.21.15.114:3300/0 conn(0x7f7270155dd0 msgr2=0x7f727006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 --2- 172.21.15.45:0/1287224313 >> v2:172.21.15.114:3300/0 conn(0x7f7270155dd0 0x7f727006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 >> v1:172.21.15.114:6789/0 conn(0x7f72700c50b0 legacy=0x7f727015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72701527a0 con 0x7f72700c5600 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f7260001670 con 0x7f72700c5600 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 >> v1:172.21.15.45:6789/0 conn(0x7f72700c5600 legacy=0x7f72701556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 0x7f725c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0047c0 0x7f725c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f725c0051d0 0x7f725c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270152b80 con 0x7f725c0039c0 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c00c120 con 0x7f725c0051d0 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.790+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c00c2e0 con 0x7f725c0047c0 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 0x7f725c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 -- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0047c0 msgr2=0x7f725c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0047c0 0x7f725c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 -- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f725c0051d0 msgr2=0x7f725c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f725c0051d0 0x7f725c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726effd640 1 -- 172.21.15.45:0/1287224313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c003520 con 0x7f725c0039c0 2023-12-08T08:17:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.791+0000 7f726f7fe640 1 -- 172.21.15.45:0/1287224313 reap_dead start 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.792+0000 7f726effd640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 0x7f725c003de0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7260001eb0 tx=0x7f725c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f690f1b3742c9b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.792+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260005ad0 con 0x7f725c0039c0 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.792+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260005c50 con 0x7f725c0039c0 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.792+0000 7f726e7fc640 1 -- 172.21.15.45:0/1287224313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726002c7c0 con 0x7f725c0039c0 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 -- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 msgr2=0x7f725c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 0x7f725c003de0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7260001eb0 tx=0x7f725c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 -- 172.21.15.45:0/1287224313 shutdown_connections 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 --2- 172.21.15.45:0/1287224313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f725c0039c0 0x7f725c003de0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 -- 172.21.15.45:0/1287224313 >> 172.21.15.45:0/1287224313 conn(0x7f72700a7600 msgr2=0x7f72700a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 -- 172.21.15.45:0/1287224313 shutdown_connections 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.793+0000 7f726ffff640 1 -- 172.21.15.45:0/1287224313 wait complete. 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.795+0000 7f726ffff640 1 Processor -- start 2023-12-08T08:17:12.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.795+0000 7f726ffff640 1 -- start start 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0039c0 0x7f7270154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72701eb8a0 0x7f727014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727006f930 con 0x7f72701548a0 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270153ed0 con 0x7f72701eb8a0 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f726ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7270154d20 con 0x7f725c0039c0 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f7267fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f7267fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33504/0 (socket says 172.21.15.45:33504) 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.796+0000 7f7267fff640 1 -- 172.21.15.45:0/4259788700 learned_addr learned my addr 172.21.15.45:0/4259788700 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f726effd640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0039c0 0x7f7270154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f726f7fe640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72701eb8a0 0x7f727014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 -- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0039c0 msgr2=0x7f7270154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0039c0 0x7f7270154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 -- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72701eb8a0 msgr2=0x7f727014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72701eb8a0 0x7f727014e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 -- 172.21.15.45:0/4259788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700bb4d0 con 0x7f72701548a0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f7267fff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f725800c430 tx=0x7f725800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580052d0 con 0x7f72701548a0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258005450 con 0x7f72701548a0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258003830 con 0x7f72701548a0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.797+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727014f240 con 0x7f72701548a0 2023-12-08T08:17:12.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.798+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727006fe60 con 0x7f72701548a0 2023-12-08T08:17:12.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.799+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72700bb250 con 0x7f72701548a0 2023-12-08T08:17:12.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.800+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7258003990 con 0x7f72701548a0 2023-12-08T08:17:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.801+0000 7f72677fe640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 0x7f725006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.801+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7258088b20 con 0x7f72701548a0 2023-12-08T08:17:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.801+0000 7f726effd640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 0x7f725006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:12.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.802+0000 7f726effd640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 0x7f725006d330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7260034000 tx=0x7f7260009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:12.805+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72700bb250 con 0x7f72701548a0 2023-12-08T08:17:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.044+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f72700bb250 con 0x7f72701548a0 2023-12-08T08:17:13.047 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:17:13.045+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:17:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.049+0000 7f72677fe640 1 -- 172.21.15.45:0/4259788700 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f72700bb250 con 0x7f72701548a0 2023-12-08T08:17:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:17:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 msgr2=0x7f725006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 0x7f725006d330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7260034000 tx=0x7f7260009030 comp rx=0 tx=0).stop 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 msgr2=0x7f72701eb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f725800c430 tx=0x7f725800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 shutdown_connections 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f725006ae70 0x7f725006d330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72701eb8a0 0x7f727014e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72701548a0 0x7f72701eb360 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 --2- 172.21.15.45:0/4259788700 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f725c0039c0 0x7f7270154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 >> 172.21.15.45:0/4259788700 conn(0x7f72700a7600 msgr2=0x7f72701500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.052+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 shutdown_connections 2023-12-08T08:17:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.053+0000 7f726ffff640 1 -- 172.21.15.45:0/4259788700 wait complete. 2023-12-08T08:17:13.061 INFO:tasks.ceph.mds.c.smithi045.stderr: -3097> 2023-12-08T08:16:32.906+0000 7f415f2dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:17:13.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:17:13.117 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:17:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.262+0000 7f37cb59e640 1 Processor -- start 2023-12-08T08:17:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.262+0000 7f37cb59e640 1 -- start start 2023-12-08T08:17:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37cc0c4970 0x7f37cc0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cb59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc0c60c0 con 0x7f37cc14c280 2023-12-08T08:17:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc152dc0 con 0x7f37cc0c4970 2023-12-08T08:17:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc1521d0 con 0x7f37cc155790 2023-12-08T08:17:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37c9d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37cc0c4970 0x7f37cc0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37cad9d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37c9d9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37cc0c4970 0x7f37cc0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:50630/0 (socket says 172.21.15.45:50630) 2023-12-08T08:17:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.264+0000 7f37c9d9b640 1 -- 172.21.15.45:0/3136495033 learned_addr learned my addr 172.21.15.45:0/3136495033 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.265+0000 7f37c9d9b640 1 -- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 msgr2=0x7f37cc155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.265+0000 7f37c9d9b640 1 --2- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.265+0000 7f37c9d9b640 1 -- 172.21.15.45:0/3136495033 >> v1:172.21.15.114:6789/0 conn(0x7f37cc14c280 legacy=0x7f37cc06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.265+0000 7f37c9d9b640 1 -- 172.21.15.45:0/3136495033 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc14c660 con 0x7f37cc0c4970 2023-12-08T08:17:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.267+0000 7f37c9d9b640 1 --2- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0a4d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e50 tx=0x7f37b402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12765b6fe756fc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.267+0000 7f37c959a640 1 -- 172.21.15.45:0/3136495033 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b402ca80 con 0x7f37cc0c4970 2023-12-08T08:17:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37c959a640 1 -- 172.21.15.45:0/3136495033 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b402cbe0 con 0x7f37cc0c4970 2023-12-08T08:17:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37c959a640 1 -- 172.21.15.45:0/3136495033 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40343f0 con 0x7f37cc0c4970 2023-12-08T08:17:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 -- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 msgr2=0x7f37cc0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 --2- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0a4d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e50 tx=0x7f37b402bee0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 -- 172.21.15.45:0/3136495033 shutdown_connections 2023-12-08T08:17:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 --2- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 --2- 172.21.15.45:0/3136495033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0a4d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 -- 172.21.15.45:0/3136495033 >> 172.21.15.45:0/3136495033 conn(0x7f37cc066ce0 msgr2=0x7f37cc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:13.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 -- 172.21.15.45:0/3136495033 shutdown_connections 2023-12-08T08:17:13.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.268+0000 7f37cb59e640 1 -- 172.21.15.45:0/3136495033 wait complete. 2023-12-08T08:17:13.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.270+0000 7f37cb59e640 1 Processor -- start 2023-12-08T08:17:13.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.270+0000 7f37cb59e640 1 -- start start 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc1ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc1e9b20 con 0x7f37cc14c280 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0a8e90 con 0x7f37cc0c4970 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37cb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc154ef0 con 0x7f37cc155790 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37c9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37c9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33526/0 (socket says 172.21.15.45:33526) 2023-12-08T08:17:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.271+0000 7f37c9d9b640 1 -- 172.21.15.45:0/1897089678 learned_addr learned my addr 172.21.15.45:0/1897089678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37cad9d640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc1ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 -- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 msgr2=0x7f37cc1ea510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc1ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 -- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 msgr2=0x7f37cc0bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 -- 172.21.15.45:0/1897089678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009b30 con 0x7f37cc14c280 2023-12-08T08:17:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c9d9b640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f80 tx=0x7f37b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4009510 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b403e450 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b403e800 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.272+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37cc1551d0 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.273+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc1554b0 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.273+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc0678c0 con 0x7f37cc14c280 2023-12-08T08:17:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.275+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37b402cd50 con 0x7f37cc14c280 2023-12-08T08:17:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.275+0000 7f37c2ffd640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 0x7f37ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.276+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f37b40ac620 con 0x7f37cc14c280 2023-12-08T08:17:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.276+0000 7f37ca59c640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 0x7f37ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.276+0000 7f37ca59c640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 0x7f37ac06d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc0079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:13.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.280+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37b4077270 con 0x7f37cc14c280 2023-12-08T08:17:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:13.514+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37cc0743e0 con 0x7f37cc14c280 2023-12-08T08:17:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.051+0000 7f37c2ffd640 1 -- 172.21.15.45:0/1897089678 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37b407a890 con 0x7f37cc14c280 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 msgr2=0x7f37ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 0x7f37ac06d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f37bc000f60 tx=0x7f37bc0079b0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 msgr2=0x7f37cc1e9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f37b4000f80 tx=0x7f37b4004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 shutdown_connections 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37ac06ae40 0x7f37ac06d300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37cc155790 0x7f37cc1ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37cc14c280 0x7f37cc1e9fd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 --2- 172.21.15.45:0/1897089678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37cc0c4970 0x7f37cc0bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 >> 172.21.15.45:0/1897089678 conn(0x7f37cc066ce0 msgr2=0x7f37cc146b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 shutdown_connections 2023-12-08T08:17:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.057+0000 7f37cb59e640 1 -- 172.21.15.45:0/1897089678 wait complete. 2023-12-08T08:17:14.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:17:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.352+0000 7f9b68927640 1 Processor -- start 2023-12-08T08:17:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.352+0000 7f9b68927640 1 -- start start 2023-12-08T08:17:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b68927640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b640a4da0 0x7f9b640aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b68927640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6406db60 con 0x7f9b640ab150 2023-12-08T08:17:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b68927640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6406d330 con 0x7f9b6414faf0 2023-12-08T08:17:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b68927640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6406c3f0 con 0x7f9b640a4da0 2023-12-08T08:17:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b62ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b640a4da0 0x7f9b640aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b63fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b640ab150 0x7f9b640c0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45454/0 (socket says 172.21.15.45:45454) 2023-12-08T08:17:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.354+0000 7f9b63fff640 1 -- 172.21.15.45:0/3897298308 learned_addr learned my addr 172.21.15.45:0/3897298308 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.355+0000 7f9b62ffd640 1 -- 172.21.15.45:0/3897298308 >> v1:172.21.15.114:6789/0 conn(0x7f9b6414faf0 legacy=0x7f9b64156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.355+0000 7f9b62ffd640 1 -- 172.21.15.45:0/3897298308 >> v1:172.21.15.45:6789/0 conn(0x7f9b640ab150 legacy=0x7f9b640c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.355+0000 7f9b62ffd640 1 -- 172.21.15.45:0/3897298308 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6406d5a0 con 0x7f9b640a4da0 2023-12-08T08:17:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.356+0000 7f9b62ffd640 1 --2- 172.21.15.45:0/3897298308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640aac10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097a0 tx=0x7f9b5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbe246ed19dc062 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.356+0000 7f9b627fc640 1 -- 172.21.15.45:0/3897298308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5802e070 con 0x7f9b640a4da0 2023-12-08T08:17:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.356+0000 7f9b627fc640 1 -- 172.21.15.45:0/3897298308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580315a0 con 0x7f9b640a4da0 2023-12-08T08:17:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.356+0000 7f9b627fc640 1 -- 172.21.15.45:0/3897298308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58031930 con 0x7f9b640a4da0 2023-12-08T08:17:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 -- 172.21.15.45:0/3897298308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 msgr2=0x7f9b640aac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 --2- 172.21.15.45:0/3897298308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640aac10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097a0 tx=0x7f9b5802b840 comp rx=0 tx=0).stop 2023-12-08T08:17:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 -- 172.21.15.45:0/3897298308 shutdown_connections 2023-12-08T08:17:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 --2- 172.21.15.45:0/3897298308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640aac10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 -- 172.21.15.45:0/3897298308 >> 172.21.15.45:0/3897298308 conn(0x7f9b640c6010 msgr2=0x7f9b640a7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 -- 172.21.15.45:0/3897298308 shutdown_connections 2023-12-08T08:17:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.357+0000 7f9b68927640 1 -- 172.21.15.45:0/3897298308 wait complete. 2023-12-08T08:17:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.359+0000 7f9b68927640 1 Processor -- start 2023-12-08T08:17:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.360+0000 7f9b68927640 1 -- start start 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b640ab150 0x7f9b641ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 0x7f9b641ea730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b641e9d60 con 0x7f9b640a4da0 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b641ee070 con 0x7f9b6414faf0 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b68927640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6414b890 con 0x7f9b640ab150 2023-12-08T08:17:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33542/0 (socket says 172.21.15.45:33542) 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.361+0000 7f9b637fe640 1 -- 172.21.15.45:0/3043543941 learned_addr learned my addr 172.21.15.45:0/3043543941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b62ffd640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b640ab150 0x7f9b641ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 -- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b640ab150 msgr2=0x7f9b641ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b640ab150 0x7f9b641ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 -- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 msgr2=0x7f9b641ea730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b63fff640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 0x7f9b641ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 0x7f9b641ea730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 -- 172.21.15.45:0/3043543941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009400 con 0x7f9b640a4da0 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b63fff640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 0x7f9b641ea730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b637fe640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c450 tx=0x7f9b5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540052d0 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54005430 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54012870 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.362+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6414bb70 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.363+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b640bf430 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.364+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b640a7d90 con 0x7f9b640a4da0 2023-12-08T08:17:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.365+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b540129d0 con 0x7f9b640a4da0 2023-12-08T08:17:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.366+0000 7f9b4bfff640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 0x7f9b5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.366+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6971+0+0 (secure 0 0 0) 0x7f9b54089730 con 0x7f9b640a4da0 2023-12-08T08:17:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.366+0000 7f9b62ffd640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 0x7f9b5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.367+0000 7f9b62ffd640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 0x7f9b5006d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b58036000 tx=0x7f9b5803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.371+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b540541c0 con 0x7f9b640a4da0 2023-12-08T08:17:14.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:14.565+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b64074450 con 0x7f9b640a4da0 2023-12-08T08:17:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.062+0000 7f9b4bfff640 1 -- 172.21.15.45:0/3043543941 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9b540577e0 con 0x7f9b640a4da0 2023-12-08T08:17:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:17:15.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 msgr2=0x7f9b5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 0x7f9b5006d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b58036000 tx=0x7f9b5803d040 comp rx=0 tx=0).stop 2023-12-08T08:17:15.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 msgr2=0x7f9b640beef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c450 tx=0x7f9b5400c910 comp rx=0 tx=0).stop 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 shutdown_connections 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b5006ae70 0x7f9b5006d330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b640ab150 0x7f9b641ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b6414faf0 0x7f9b641ea730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 --2- 172.21.15.45:0/3043543941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b640a4da0 0x7f9b640beef0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.067+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 >> 172.21.15.45:0/3043543941 conn(0x7f9b640c6010 msgr2=0x7f9b640c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:15.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.069+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 shutdown_connections 2023-12-08T08:17:15.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.069+0000 7f9b68927640 1 -- 172.21.15.45:0/3043543941 wait complete. 2023-12-08T08:17:15.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:17:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.322+0000 7fcc86639640 1 Processor -- start 2023-12-08T08:17:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.323+0000 7fcc86639640 1 -- start start 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc86639640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc80151e30 0x7fcc800c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc86639640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800c8780 con 0x7fcc800c7b10 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc86639640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800c4630 con 0x7fcc80151a50 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc86639640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800c6f60 con 0x7fcc80151e30 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc84e36640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcc800c7b10 0x7fcc80157c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59116/0 (socket says 172.21.15.45:59116) 2023-12-08T08:17:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.324+0000 7fcc84e36640 1 -- 172.21.15.45:0/864634588 learned_addr learned my addr 172.21.15.45:0/864634588 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc85e38640 1 --2- 172.21.15.45:0/864634588 >> v2:172.21.15.114:3300/0 conn(0x7fcc80151e30 0x7fcc800c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282597307 0 0) 0x7fcc74001110 con 0x7fcc800c7b10 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc68003520 con 0x7fcc800c7b10 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 331301486 0 0) 0x7fcc68003520 con 0x7fcc800c7b10 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 >> v2:172.21.15.114:3300/0 conn(0x7fcc80151e30 msgr2=0x7fcc800c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 --2- 172.21.15.45:0/864634588 >> v2:172.21.15.114:3300/0 conn(0x7fcc80151e30 0x7fcc800c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 >> v1:172.21.15.114:6789/0 conn(0x7fcc80151a50 legacy=0x7fcc800c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800c7160 con 0x7fcc800c7b10 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fcc74001800 con 0x7fcc800c7b10 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.325+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 >> v1:172.21.15.45:6789/0 conn(0x7fcc800c7b10 legacy=0x7fcc80157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc68003970 0x7fcc68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 0x7fcc68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc68005180 0x7fcc6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800c6f60 con 0x7fcc680047c0 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6800c120 con 0x7fcc68003970 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6800c2e0 con 0x7fcc68005180 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 0x7fcc68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc85637640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc68003970 0x7fcc68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc85e38640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc68005180 0x7fcc6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 -- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc68005180 msgr2=0x7fcc6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc68005180 0x7fcc6800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 -- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc68003970 msgr2=0x7fcc68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc68003970 0x7fcc68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc84e36640 1 -- 172.21.15.45:0/864634588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68003520 con 0x7fcc680047c0 2023-12-08T08:17:15.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.326+0000 7fcc85e38640 1 -- 172.21.15.45:0/864634588 reap_dead start 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.327+0000 7fcc84e36640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 0x7fcc68004c40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcc800c7f10 tx=0x7fcc680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a9a3abb3ca66de server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74005ad0 con 0x7fcc680047c0 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74005c50 con 0x7fcc680047c0 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc7ffff640 1 -- 172.21.15.45:0/864634588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7402c7c0 con 0x7fcc680047c0 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc86639640 1 -- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 msgr2=0x7fcc68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc86639640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 0x7fcc68004c40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcc800c7f10 tx=0x7fcc680057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc86639640 1 -- 172.21.15.45:0/864634588 shutdown_connections 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc86639640 1 --2- 172.21.15.45:0/864634588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc680047c0 0x7fcc68004c40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.328+0000 7fcc86639640 1 -- 172.21.15.45:0/864634588 >> 172.21.15.45:0/864634588 conn(0x7fcc8006b850 msgr2=0x7fcc8006bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.329+0000 7fcc86639640 1 -- 172.21.15.45:0/864634588 shutdown_connections 2023-12-08T08:17:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.329+0000 7fcc86639640 1 -- 172.21.15.45:0/864634588 wait complete. 2023-12-08T08:17:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.330+0000 7fcc86639640 1 Processor -- start 2023-12-08T08:17:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.330+0000 7fcc86639640 1 -- start start 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc680047c0 0x7fcc801ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc8014b660 0x7fcc80145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800c11d0 con 0x7fcc80145d70 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801ee3e0 con 0x7fcc8014b660 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.331+0000 7fcc86639640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800c0e60 con 0x7fcc680047c0 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56576/0 (socket says 172.21.15.45:56576) 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 -- 172.21.15.45:0/1435986245 learned_addr learned my addr 172.21.15.45:0/1435986245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc85637640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc680047c0 0x7fcc801ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc85e38640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc8014b660 0x7fcc80145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 -- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc680047c0 msgr2=0x7fcc801ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc680047c0 0x7fcc801ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 -- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc8014b660 msgr2=0x7fcc80145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc8014b660 0x7fcc80145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:15.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.332+0000 7fcc84e36640 1 -- 172.21.15.45:0/1435986245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80152600 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc84e36640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcc7402c360 tx=0x7fcc7402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7403c040 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7402cbd0 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74007070 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc801527f0 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.333+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc801ee080 con 0x7fcc80145d70 2023-12-08T08:17:15.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.334+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800c0cc0 con 0x7fcc80145d70 2023-12-08T08:17:15.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.336+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc74032070 con 0x7fcc80145d70 2023-12-08T08:17:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.337+0000 7fcc7dffb640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 0x7fcc6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.337+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6533+0+0 (secure 0 0 0) 0x7fcc740aa990 con 0x7fcc80145d70 2023-12-08T08:17:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.337+0000 7fcc85637640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 0x7fcc6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.338+0000 7fcc85637640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 0x7fcc6c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc8014d780 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.341+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc800c0cc0 con 0x7fcc80145d70 2023-12-08T08:17:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:15.534+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc800c8780 con 0x7fcc80145d70 2023-12-08T08:17:16.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.074+0000 7fcc7dffb640 1 -- 172.21.15.45:0/1435986245 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc800c8780 con 0x7fcc80145d70 2023-12-08T08:17:16.077 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-08T08:17:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 msgr2=0x7fcc6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 0x7fcc6c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc8014d780 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2023-12-08T08:17:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 msgr2=0x7fcc800c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcc7402c360 tx=0x7fcc7402e070 comp rx=0 tx=0).stop 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 shutdown_connections 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc6c06ae40 0x7fcc6c06d300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc8014b660 0x7fcc80145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.077+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc80145d70 0x7fcc800c34d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.078+0000 7fcc86639640 1 --2- 172.21.15.45:0/1435986245 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc680047c0 0x7fcc801ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.078+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 >> 172.21.15.45:0/1435986245 conn(0x7fcc8006b850 msgr2=0x7fcc8006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.078+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 shutdown_connections 2023-12-08T08:17:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.078+0000 7fcc86639640 1 -- 172.21.15.45:0/1435986245 wait complete. 2023-12-08T08:17:16.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.311+0000 7f59c5fe5640 1 Processor -- start 2023-12-08T08:17:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.312+0000 7f59c5fe5640 1 -- start start 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.313+0000 7f59c5fe5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59c00c6580 0x7f59c006a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.313+0000 7f59c5fe5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c0155580 con 0x7f59c0151ff0 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.313+0000 7f59c5fe5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c0154970 con 0x7f59c006a4c0 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.313+0000 7f59c5fe5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c0154c50 con 0x7f59c00c6580 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.314+0000 7f59bffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f59c0151ff0 0x7f59c00c0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59132/0 (socket says 172.21.15.45:59132) 2023-12-08T08:17:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.314+0000 7f59bffff640 1 -- 172.21.15.45:0/392978699 learned_addr learned my addr 172.21.15.45:0/392978699 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.314+0000 7f59b6ffd640 1 --2- 172.21.15.45:0/392978699 >> v2:172.21.15.114:3300/0 conn(0x7f59c00c6580 0x7f59c006a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.314+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231621179 0 0) 0x7f59c0155580 con 0x7f59c0151ff0 2023-12-08T08:17:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.314+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ac003520 con 0x7f59c0151ff0 2023-12-08T08:17:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.315+0000 7f59b6ffd640 1 -- 172.21.15.45:0/392978699 >> v1:172.21.15.114:6789/0 conn(0x7f59c006a4c0 legacy=0x7f59c01518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.315+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927342230 0 0) 0x7f59ac003520 con 0x7f59c0151ff0 2023-12-08T08:17:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.315+0000 7f59b6ffd640 1 -- 172.21.15.45:0/392978699 >> v1:172.21.15.45:6789/0 conn(0x7f59c0151ff0 legacy=0x7f59c00c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.315+0000 7f59b6ffd640 1 -- 172.21.15.45:0/392978699 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0154f30 con 0x7f59c00c6580 2023-12-08T08:17:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.316+0000 7f59b6ffd640 1 --2- 172.21.15.45:0/392978699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c00c6580 0x7f59c006a8a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59a80097a0 tx=0x7f59a802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f74780bb11a3ffb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80019f0 con 0x7f59c00c6580 2023-12-08T08:17:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a802e050 con 0x7f59c00c6580 2023-12-08T08:17:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59beffd640 1 -- 172.21.15.45:0/392978699 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8030730 con 0x7f59c00c6580 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 -- 172.21.15.45:0/392978699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c00c6580 msgr2=0x7f59c006a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/392978699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c00c6580 0x7f59c006a8a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59a80097a0 tx=0x7f59a802b710 comp rx=0 tx=0).stop 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 -- 172.21.15.45:0/392978699 shutdown_connections 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/392978699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c00c6580 0x7f59c006a8a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 -- 172.21.15.45:0/392978699 >> 172.21.15.45:0/392978699 conn(0x7f59c00a8960 msgr2=0x7f59c00a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.317+0000 7f59c5fe5640 1 -- 172.21.15.45:0/392978699 shutdown_connections 2023-12-08T08:17:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.318+0000 7f59c5fe5640 1 -- 172.21.15.45:0/392978699 wait complete. 2023-12-08T08:17:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.319+0000 7f59c5fe5640 1 Processor -- start 2023-12-08T08:17:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.319+0000 7f59c5fe5640 1 -- start start 2023-12-08T08:17:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59c00c6580 0x7f59c00a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 0x7f59c00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01ea690 con 0x7f59c006a4c0 2023-12-08T08:17:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00a9e90 con 0x7f59c0151ff0 2023-12-08T08:17:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.320+0000 7f59c5fe5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c0099ac0 con 0x7f59c00c6580 2023-12-08T08:17:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56592/0 (socket says 172.21.15.45:56592) 2023-12-08T08:17:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 -- 172.21.15.45:0/1397605546 learned_addr learned my addr 172.21.15.45:0/1397605546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59b6ffd640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59c00c6580 0x7f59c00a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bffff640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 0x7f59c00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 -- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59c00c6580 msgr2=0x7f59c00a5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59c00c6580 0x7f59c00a5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 -- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 msgr2=0x7f59c00a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 0x7f59c00a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bf7fe640 1 -- 172.21.15.45:0/1397605546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8009400 con 0x7f59c006a4c0 2023-12-08T08:17:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.321+0000 7f59bffff640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 0x7f59c00a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59bf7fe640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c450 tx=0x7f59b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00052d0 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b0005430 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0012870 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c01eab50 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.322+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c00a9b20 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.323+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c00c0030 con 0x7f59c006a4c0 2023-12-08T08:17:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.324+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59b00129d0 con 0x7f59c006a4c0 2023-12-08T08:17:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.325+0000 7f59bcff9640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 0x7f59a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.325+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f59b00892c0 con 0x7f59c006a4c0 2023-12-08T08:17:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.326+0000 7f59b6ffd640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 0x7f59a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.326+0000 7f59b6ffd640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 0x7f59a006d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59a8034000 tx=0x7f59a8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.330+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59b00541c0 con 0x7f59c006a4c0 2023-12-08T08:17:16.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.527+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c00a9cb0 con 0x7f59c006a4c0 2023-12-08T08:17:16.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.530+0000 7f59bcff9640 1 -- 172.21.15.45:0/1397605546 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16877 (secure 0 0 0) 0x7f59b00577e0 con 0x7f59c006a4c0 2023-12-08T08:17:16.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:16.533 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:16.064397+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2643055":"2023-12-09T08:17:13.045069+0000","172.21.15.45:6836/2643055":"2023-12-09T08:17:13.045069+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:16.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.532+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 msgr2=0x7f59a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.532+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 0x7f59a006d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59a8034000 tx=0x7f59a8008030 comp rx=0 tx=0).stop 2023-12-08T08:17:16.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.532+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 msgr2=0x7f59c0099f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.532+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c450 tx=0x7f59b000c910 comp rx=0 tx=0).stop 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 shutdown_connections 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f59a006ae40 0x7f59a006d300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59c00c6580 0x7f59c00a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59c0151ff0 0x7f59c00a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 --2- 172.21.15.45:0/1397605546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c006a4c0 0x7f59c0099f20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 >> 172.21.15.45:0/1397605546 conn(0x7f59c00a8960 msgr2=0x7f59c00a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 shutdown_connections 2023-12-08T08:17:16.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.533+0000 7f59c5fe5640 1 -- 172.21.15.45:0/1397605546 wait complete. 2023-12-08T08:17:16.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:16:43.271897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:16:44.566832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:16.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.785+0000 7fc921639640 1 Processor -- start 2023-12-08T08:17:16.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.785+0000 7fc921639640 1 -- start start 2023-12-08T08:17:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.786+0000 7fc921639640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc91c14c280 0x7fc91c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.786+0000 7fc921639640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c0c4970 0x7fc91c06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.786+0000 7fc921639640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0c60c0 con 0x7fc91c06d3e0 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc921639640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c152dc0 con 0x7fc91c14c280 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc921639640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1521d0 con 0x7fc91c0c4970 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc91bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc91c14c280 0x7fc91c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc91bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc91c14c280 0x7fc91c0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:56296/0 (socket says 172.21.15.45:56296) 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc91bfff640 1 -- 172.21.15.45:0/1446428266 learned_addr learned my addr 172.21.15.45:0/1446428266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.787+0000 7fc913fff640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c0c4970 0x7fc91c06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.788+0000 7fc91bfff640 1 -- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c0c4970 msgr2=0x7fc91c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.788+0000 7fc91bfff640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c0c4970 0x7fc91c06cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.788+0000 7fc91bfff640 1 -- 172.21.15.45:0/1446428266 >> v1:172.21.15.114:6789/0 conn(0x7fc91c06d3e0 legacy=0x7fc91c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.788+0000 7fc91bfff640 1 -- 172.21.15.45:0/1446428266 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c14c660 con 0x7fc91c14c280 2023-12-08T08:17:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.789+0000 7fc91bfff640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c14c280 0x7fc91c0a4d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0c75f419fa0dee server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.790+0000 7fc91b7fe640 1 -- 172.21.15.45:0/1446428266 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c031640 con 0x7fc91c14c280 2023-12-08T08:17:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.790+0000 7fc91b7fe640 1 -- 172.21.15.45:0/1446428266 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c0317a0 con 0x7fc91c14c280 2023-12-08T08:17:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.790+0000 7fc91b7fe640 1 -- 172.21.15.45:0/1446428266 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c031b30 con 0x7fc91c14c280 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 -- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c14c280 msgr2=0x7fc91c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c14c280 0x7fc91c0a4d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 -- 172.21.15.45:0/1446428266 shutdown_connections 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c0c4970 0x7fc91c06cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 --2- 172.21.15.45:0/1446428266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c14c280 0x7fc91c0a4d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 -- 172.21.15.45:0/1446428266 >> 172.21.15.45:0/1446428266 conn(0x7fc91c066ce0 msgr2=0x7fc91c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 -- 172.21.15.45:0/1446428266 shutdown_connections 2023-12-08T08:17:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.791+0000 7fc921639640 1 -- 172.21.15.45:0/1446428266 wait complete. 2023-12-08T08:17:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.793+0000 7fc921639640 1 Processor -- start 2023-12-08T08:17:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.793+0000 7fc921639640 1 -- start start 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c0c4970 0x7fc91c145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c14c280 0x7fc91c145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0a78b0 con 0x7fc91c06d3e0 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1464c0 con 0x7fc91c0c4970 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc921639640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0a72f0 con 0x7fc91c14c280 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56600/0 (socket says 172.21.15.45:56600) 2023-12-08T08:17:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc91bfff640 1 -- 172.21.15.45:0/3546085381 learned_addr learned my addr 172.21.15.45:0/3546085381 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc913fff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c0c4970 0x7fc91c145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.795+0000 7fc920e38640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c14c280 0x7fc91c145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 -- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c14c280 msgr2=0x7fc91c145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c14c280 0x7fc91c145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 -- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c0c4970 msgr2=0x7fc91c145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c0c4970 0x7fc91c145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 -- 172.21.15.45:0/3546085381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094d0 con 0x7fc91c06d3e0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.796+0000 7fc91bfff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc90c02b930 tx=0x7fc90c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.797+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c03a930 con 0x7fc91c06d3e0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.797+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c03aa90 con 0x7fc91c06d3e0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.797+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c03ae40 con 0x7fc91c06d3e0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.797+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c0a75d0 con 0x7fc91c06d3e0 2023-12-08T08:17:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.797+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c14cd60 con 0x7fc91c06d3e0 2023-12-08T08:17:16.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.798+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c1ea920 con 0x7fc91c06d3e0 2023-12-08T08:17:16.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.800+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc90c02f050 con 0x7fc91c06d3e0 2023-12-08T08:17:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.800+0000 7fc9197fa640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 0x7fc8fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.801+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fc90c0ab4c0 con 0x7fc91c06d3e0 2023-12-08T08:17:16.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.801+0000 7fc913fff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 0x7fc8fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.802+0000 7fc913fff640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 0x7fc8fc06d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc91c14fd10 tx=0x7fc904008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:16.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:16.807+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc91c1ea920 con 0x7fc91c06d3e0 2023-12-08T08:17:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.009+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc91c1ea920 con 0x7fc91c06d3e0 2023-12-08T08:17:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.010+0000 7fc9197fa640 1 -- 172.21.15.45:0/3546085381 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc91c1ea920 con 0x7fc91c06d3e0 2023-12-08T08:17:17.013 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:17.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.012+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 msgr2=0x7fc8fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.012+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 0x7fc8fc06d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc91c14fd10 tx=0x7fc904008040 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.012+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 msgr2=0x7fc91c14d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.012+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc90c02b930 tx=0x7fc90c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.012+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 shutdown_connections 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc8fc06ae40 0x7fc8fc06d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc91c14c280 0x7fc91c145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc91c0c4970 0x7fc91c145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 --2- 172.21.15.45:0/3546085381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc91c06d3e0 0x7fc91c14d020 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 >> 172.21.15.45:0/3546085381 conn(0x7fc91c066ce0 msgr2=0x7fc91c0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 shutdown_connections 2023-12-08T08:17:17.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.013+0000 7fc921639640 1 -- 172.21.15.45:0/3546085381 wait complete. 2023-12-08T08:17:17.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:17:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.262+0000 7f0ce6452640 1 Processor -- start 2023-12-08T08:17:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.262+0000 7f0ce6452640 1 -- start start 2023-12-08T08:17:17.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce6452640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce006d1d0 0x7f0ce0158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce6452640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce0154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce6452640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00c51f0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce6452640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00c1ce0 con 0x7f0ce006d1d0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce6452640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c54d0 con 0x7f0ce00c0bf0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce4c4f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce006d1d0 0x7f0ce0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce4c4f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ce006d1d0 0x7f0ce0158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56602/0 (socket says 172.21.15.45:56602) 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.264+0000 7f0ce4c4f640 1 -- 172.21.15.45:0/4042244198 learned_addr learned my addr 172.21.15.45:0/4042244198 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce5c51640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce0154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce4c4f640 1 -- 172.21.15.45:0/4042244198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 msgr2=0x7f0ce0154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce4c4f640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce0154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce4c4f640 1 -- 172.21.15.45:0/4042244198 >> v1:172.21.15.114:6789/0 conn(0x7f0ce00c59e0 legacy=0x7f0ce006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce4c4f640 1 -- 172.21.15.45:0/4042244198 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0157ba0 con 0x7f0ce006d1d0 2023-12-08T08:17:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.265+0000 7f0ce5c51640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce0154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.266+0000 7f0ce4c4f640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce006d1d0 0x7f0ce0158680 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6999678c865688ad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0cd7fff640 1 -- 172.21.15.45:0/4042244198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0030840 con 0x7f0ce006d1d0 2023-12-08T08:17:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0cd7fff640 1 -- 172.21.15.45:0/4042244198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00309a0 con 0x7f0ce006d1d0 2023-12-08T08:17:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0cd7fff640 1 -- 172.21.15.45:0/4042244198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0030d30 con 0x7f0ce006d1d0 2023-12-08T08:17:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 -- 172.21.15.45:0/4042244198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce006d1d0 msgr2=0x7f0ce0158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce006d1d0 0x7f0ce0158680 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd002b980 comp rx=0 tx=0).stop 2023-12-08T08:17:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 -- 172.21.15.45:0/4042244198 shutdown_connections 2023-12-08T08:17:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce0154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 --2- 172.21.15.45:0/4042244198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce006d1d0 0x7f0ce0158680 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.267+0000 7f0ce6452640 1 -- 172.21.15.45:0/4042244198 >> 172.21.15.45:0/4042244198 conn(0x7f0ce0066ce0 msgr2=0x7f0ce00a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.268+0000 7f0ce6452640 1 -- 172.21.15.45:0/4042244198 shutdown_connections 2023-12-08T08:17:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.268+0000 7f0ce6452640 1 -- 172.21.15.45:0/4042244198 wait complete. 2023-12-08T08:17:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.269+0000 7f0ce6452640 1 Processor -- start 2023-12-08T08:17:17.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.269+0000 7f0ce6452640 1 -- start start 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ce006d1d0 0x7f0ce00a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce01ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0070be0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0157690 con 0x7f0ce006d1d0 2023-12-08T08:17:17.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.270+0000 7f0ce6452640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00a95c0 con 0x7f0ce00c0bf0 2023-12-08T08:17:17.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56618/0 (socket says 172.21.15.45:56618) 2023-12-08T08:17:17.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 -- 172.21.15.45:0/2258490671 learned_addr learned my addr 172.21.15.45:0/2258490671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce4c4f640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce01ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5450640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ce006d1d0 0x7f0ce00a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 -- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 msgr2=0x7f0ce01ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce01ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 -- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ce006d1d0 msgr2=0x7f0ce00a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ce006d1d0 0x7f0ce00a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 -- 172.21.15.45:0/2258490671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094d0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce4c4f640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce01ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.271+0000 7f0ce5c51640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800cf20 tx=0x7f0cd800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.272+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800d840 con 0x7f0ce00c59e0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.272+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800d9a0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.272+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800dd50 con 0x7f0ce00c59e0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.272+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce0072b20 con 0x7f0ce00c59e0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.272+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce006fd20 con 0x7f0ce00c59e0 2023-12-08T08:17:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.273+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00a8da0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.274+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cd801e3b0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.275+0000 7f0cd5ffb640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 0x7f0cc406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.275+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f0cd808a240 con 0x7f0ce00c59e0 2023-12-08T08:17:17.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.275+0000 7f0ce5450640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 0x7f0cc406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.276+0000 7f0ce5450640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 0x7f0cc406d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00a750 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.280+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ce00a8da0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.481+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ce00a8da0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.483+0000 7f0cd5ffb640 1 -- 172.21.15.45:0/2258490671 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v47) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0ce00a8da0 con 0x7f0ce00c59e0 2023-12-08T08:17:17.486 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.485+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 msgr2=0x7f0cc406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.485+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 0x7f0cc406d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00a750 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 msgr2=0x7f0ce0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800cf20 tx=0x7f0cd800a7d0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 shutdown_connections 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0cc406ae40 0x7f0cc406d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0ce00c0bf0 0x7f0ce01ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ce00c59e0 0x7f0ce0156cd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 --2- 172.21.15.45:0/2258490671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ce006d1d0 0x7f0ce00a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 >> 172.21.15.45:0/2258490671 conn(0x7f0ce0066ce0 msgr2=0x7f0ce00bf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:17.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 shutdown_connections 2023-12-08T08:17:17.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.486+0000 7f0ce6452640 1 -- 172.21.15.45:0/2258490671 wait complete. 2023-12-08T08:17:17.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:17:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.738+0000 7f7453ac2640 1 Processor -- start 2023-12-08T08:17:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.739+0000 7f7453ac2640 1 -- start start 2023-12-08T08:17:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.740+0000 7f7453ac2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 0x7f744c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.740+0000 7f7453ac2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.740+0000 7f7453ac2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c154cf0 con 0x7f744c0c8000 2023-12-08T08:17:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.740+0000 7f7453ac2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c151e50 con 0x7f744c0c1630 2023-12-08T08:17:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.740+0000 7f7453ac2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1543e0 con 0x7f744c151a70 2023-12-08T08:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.741+0000 7f745205f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.741+0000 7f745185e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 0x7f744c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.741+0000 7f745205f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:56316/0 (socket says 172.21.15.45:56316) 2023-12-08T08:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.741+0000 7f745205f640 1 -- 172.21.15.45:0/1785859799 learned_addr learned my addr 172.21.15.45:0/1785859799 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.742+0000 7f745185e640 1 -- 172.21.15.45:0/1785859799 >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 msgr2=0x7f744c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.742+0000 7f745185e640 1 --2- 172.21.15.45:0/1785859799 >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.742+0000 7f745185e640 1 -- 172.21.15.45:0/1785859799 >> v1:172.21.15.114:6789/0 conn(0x7f744c0c8000 legacy=0x7f744c0c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.742+0000 7f745185e640 1 -- 172.21.15.45:0/1785859799 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0a7440 con 0x7f744c151a70 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.742+0000 7f745205f640 1 --2- 172.21.15.45:0/1785859799 >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.743+0000 7f745185e640 1 --2- 172.21.15.45:0/1785859799 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 0x7f744c0c7ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f743c009d90 tx=0x7f743c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf197030a1eec67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f745085c640 1 -- 172.21.15.45:0/1785859799 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c02cb30 con 0x7f744c151a70 2023-12-08T08:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f745085c640 1 -- 172.21.15.45:0/1785859799 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c02cc90 con 0x7f744c151a70 2023-12-08T08:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f745085c640 1 -- 172.21.15.45:0/1785859799 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c034440 con 0x7f744c151a70 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 -- 172.21.15.45:0/1785859799 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 msgr2=0x7f744c0c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 --2- 172.21.15.45:0/1785859799 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 0x7f744c0c7ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f743c009d90 tx=0x7f743c02bd80 comp rx=0 tx=0).stop 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 -- 172.21.15.45:0/1785859799 shutdown_connections 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 --2- 172.21.15.45:0/1785859799 >> v2:172.21.15.114:3300/0 conn(0x7f744c0c1630 0x7f744c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 --2- 172.21.15.45:0/1785859799 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c151a70 0x7f744c0c7ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 -- 172.21.15.45:0/1785859799 >> 172.21.15.45:0/1785859799 conn(0x7f744c0a98a0 msgr2=0x7f744c0a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.744+0000 7f7453ac2640 1 -- 172.21.15.45:0/1785859799 shutdown_connections 2023-12-08T08:17:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.745+0000 7f7453ac2640 1 -- 172.21.15.45:0/1785859799 wait complete. 2023-12-08T08:17:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.746+0000 7f7453ac2640 1 Processor -- start 2023-12-08T08:17:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.747+0000 7f7453ac2640 1 -- start start 2023-12-08T08:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c0c8000 0x7f744c1ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c1df9e0 0x7f744c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c156100 con 0x7f744c1edb10 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1ee2a0 con 0x7f744c1df9e0 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f7453ac2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c155870 con 0x7f744c0c8000 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f745105d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f745105d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56634/0 (socket says 172.21.15.45:56634) 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f745105d640 1 -- 172.21.15.45:0/3236029662 learned_addr learned my addr 172.21.15.45:0/3236029662 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f745205f640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c1df9e0 0x7f744c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.748+0000 7f745185e640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c0c8000 0x7f744c1ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 -- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c0c8000 msgr2=0x7f744c1ed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c0c8000 0x7f744c1ed5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 -- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c1df9e0 msgr2=0x7f744c14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c1df9e0 0x7f744c14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 -- 172.21.15.45:0/3236029662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440094d0 con 0x7f744c1edb10 2023-12-08T08:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f745105d640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f744000c450 tx=0x7f744000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400052d0 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440005430 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440012870 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c009a70 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.749+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c1edfc0 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.751+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c155d90 con 0x7f744c1edb10 2023-12-08T08:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.752+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74400129d0 con 0x7f744c1edb10 2023-12-08T08:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.753+0000 7f744a7fc640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.753+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f7440089390 con 0x7f744c1edb10 2023-12-08T08:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.753+0000 7f745185e640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.754+0000 7f745185e640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 0x7f743806d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f743c036000 tx=0x7f743c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:17.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.758+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7440054200 con 0x7f744c1edb10 2023-12-08T08:17:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.952+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f744c155160 con 0x7f744c1edb10 2023-12-08T08:17:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.953+0000 7f744a7fc640 1 -- 172.21.15.45:0/3236029662 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v47) v1 ==== 101+0+11 (secure 0 0 0) 0x7f744c155160 con 0x7f744c1edb10 2023-12-08T08:17:17.958 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 msgr2=0x7f743806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 0x7f743806d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f743c036000 tx=0x7f743c030000 comp rx=0 tx=0).stop 2023-12-08T08:17:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 msgr2=0x7f744c1df4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f744000c450 tx=0x7f744000c910 comp rx=0 tx=0).stop 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 shutdown_connections 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c1df9e0 0x7f744c14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f744c1edb10 0x7f744c1df4a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 --2- 172.21.15.45:0/3236029662 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f744c0c8000 0x7f744c1ed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.955+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 >> 172.21.15.45:0/3236029662 conn(0x7f744c0a98a0 msgr2=0x7f744c06f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.956+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 shutdown_connections 2023-12-08T08:17:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:17.956+0000 7f7453ac2640 1 -- 172.21.15.45:0/3236029662 wait complete. 2023-12-08T08:17:17.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.205+0000 7f8e0759e640 1 Processor -- start 2023-12-08T08:17:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.206+0000 7f8e0759e640 1 -- start start 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.207+0000 7f8e0759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e081519c0 0x7f8e081584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.207+0000 7f8e0759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e080c44d0 0x7f8e08154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.207+0000 7f8e0759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e081553b0 con 0x7f8e080c7a50 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e0759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080c4a00 con 0x7f8e080c44d0 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e0759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e080c4ce0 con 0x7f8e081519c0 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e080c44d0 0x7f8e08154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e080c44d0 0x7f8e08154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56644/0 (socket says 172.21.15.45:56644) 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 -- 172.21.15.45:0/4121306180 learned_addr learned my addr 172.21.15.45:0/4121306180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e0659c640 1 --2- 172.21.15.45:0/4121306180 >> v2:172.21.15.114:3300/0 conn(0x7f8e081519c0 0x7f8e081584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 -- 172.21.15.45:0/4121306180 >> v2:172.21.15.114:3300/0 conn(0x7f8e081519c0 msgr2=0x7f8e081584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 --2- 172.21.15.45:0/4121306180 >> v2:172.21.15.114:3300/0 conn(0x7f8e081519c0 0x7f8e081584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 -- 172.21.15.45:0/4121306180 >> v1:172.21.15.114:6789/0 conn(0x7f8e080c7a50 legacy=0x7f8e080ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.208+0000 7f8e05d9b640 1 -- 172.21.15.45:0/4121306180 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e081579e0 con 0x7f8e080c44d0 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.209+0000 7f8e05d9b640 1 --2- 172.21.15.45:0/4121306180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e08154e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8e080c6cb0 tx=0x7f8df002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709362ff76451813 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.210+0000 7f8e0559a640 1 -- 172.21.15.45:0/4121306180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0031750 con 0x7f8e080c44d0 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.210+0000 7f8e0559a640 1 -- 172.21.15.45:0/4121306180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df00318b0 con 0x7f8e080c44d0 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.210+0000 7f8e0559a640 1 -- 172.21.15.45:0/4121306180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0031c40 con 0x7f8e080c44d0 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.210+0000 7f8e0759e640 1 -- 172.21.15.45:0/4121306180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 msgr2=0x7f8e08154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.210+0000 7f8e0759e640 1 --2- 172.21.15.45:0/4121306180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e08154e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8e080c6cb0 tx=0x7f8df002b7f0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 -- 172.21.15.45:0/4121306180 shutdown_connections 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 --2- 172.21.15.45:0/4121306180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e08154e70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 --2- 172.21.15.45:0/4121306180 >> v2:172.21.15.114:3300/0 conn(0x7f8e081519c0 0x7f8e081584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 -- 172.21.15.45:0/4121306180 >> 172.21.15.45:0/4121306180 conn(0x7f8e080661f0 msgr2=0x7f8e08066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 -- 172.21.15.45:0/4121306180 shutdown_connections 2023-12-08T08:17:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.211+0000 7f8e0759e640 1 -- 172.21.15.45:0/4121306180 wait complete. 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.212+0000 7f8e0759e640 1 Processor -- start 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 -- start start 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e080c7a50 0x7f8e08149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e081519c0 0x7f8e080aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080aa110 con 0x7f8e080c44d0 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c3be0 con 0x7f8e080c7a50 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.213+0000 7f8e0759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e080c32f0 con 0x7f8e081519c0 2023-12-08T08:17:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56654/0 (socket says 172.21.15.45:56654) 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 -- 172.21.15.45:0/1533398570 learned_addr learned my addr 172.21.15.45:0/1533398570 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 -- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e081519c0 msgr2=0x7f8e080aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e081519c0 0x7f8e080aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 -- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e080c7a50 msgr2=0x7f8e08149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e080c7a50 0x7f8e08149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.214+0000 7f8e0659c640 1 -- 172.21.15.45:0/1533398570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00094d0 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8e0659c640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8df8007e40 tx=0x7f8df800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8014620 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800ee90 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80149c0 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e080c3590 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.215+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e080aa340 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.216+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e080743e0 con 0x7f8e080c44d0 2023-12-08T08:17:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.217+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8df8014b20 con 0x7f8e080c44d0 2023-12-08T08:17:18.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.218+0000 7f8dfeffd640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 0x7f8de806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.218+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f8df808a180 con 0x7f8e080c44d0 2023-12-08T08:17:18.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.218+0000 7f8e05d9b640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 0x7f8de806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.219+0000 7f8e05d9b640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 0x7f8de806d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8df0035000 tx=0x7f8df0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.223+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8df8054ff0 con 0x7f8e080c44d0 2023-12-08T08:17:18.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.459+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e08152040 con 0x7f8e080c44d0 2023-12-08T08:17:18.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.460+0000 7f8dfeffd640 1 -- 172.21.15.45:0/1533398570 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f8df8058610 con 0x7f8e080c44d0 2023-12-08T08:17:18.463 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:18.463 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2632584195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2632584195},{"type":"v1","addr":"172.21.15.45:6837","nonce":2632584195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-12-08T08:17:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.463+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 msgr2=0x7f8de806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.463+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 0x7f8de806d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8df0035000 tx=0x7f8df0030000 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.463+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 msgr2=0x7f8e080a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.463+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8df8007e40 tx=0x7f8df800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 shutdown_connections 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8de806ae70 0x7f8de806d330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8e081519c0 0x7f8e080aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e080c7a50 0x7f8e08149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 --2- 172.21.15.45:0/1533398570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e080c44d0 0x7f8e080a9bd0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 >> 172.21.15.45:0/1533398570 conn(0x7f8e080661f0 msgr2=0x7f8e080665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 shutdown_connections 2023-12-08T08:17:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.464+0000 7f8e0759e640 1 -- 172.21.15.45:0/1533398570 wait complete. 2023-12-08T08:17:18.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.708+0000 7f6b28bbc640 1 Processor -- start 2023-12-08T08:17:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.708+0000 7f6b28bbc640 1 -- start start 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.709+0000 7f6b28bbc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b2414e260 0x7f6b241542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b28bbc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b240a7770 0x7f6b240a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b28bbc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b240a7300 con 0x7f6b240beb30 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b28bbc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240bfb90 con 0x7f6b2414e260 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b28bbc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240bf010 con 0x7f6b240a7770 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b2414e260 0x7f6b241542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b2414e260 0x7f6b241542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56666/0 (socket says 172.21.15.45:56666) 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 -- 172.21.15.45:0/482019204 learned_addr learned my addr 172.21.15.45:0/482019204 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 -- 172.21.15.45:0/482019204 >> v2:172.21.15.114:3300/0 conn(0x7f6b240a7770 msgr2=0x7f6b240a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 --2- 172.21.15.45:0/482019204 >> v2:172.21.15.114:3300/0 conn(0x7f6b240a7770 0x7f6b240a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 -- 172.21.15.45:0/482019204 >> v1:172.21.15.114:6789/0 conn(0x7f6b240beb30 legacy=0x7f6b2406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.710+0000 7f6b237fe640 1 -- 172.21.15.45:0/482019204 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240bf2f0 con 0x7f6b2414e260 2023-12-08T08:17:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.711+0000 7f6b237fe640 1 --2- 172.21.15.45:0/482019204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241542a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b240a6840 tx=0x7f6b1402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f7e730c2fb130 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.712+0000 7f6b22ffd640 1 -- 172.21.15.45:0/482019204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14031870 con 0x7f6b2414e260 2023-12-08T08:17:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.712+0000 7f6b22ffd640 1 -- 172.21.15.45:0/482019204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b140319d0 con 0x7f6b2414e260 2023-12-08T08:17:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.712+0000 7f6b22ffd640 1 -- 172.21.15.45:0/482019204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14031d60 con 0x7f6b2414e260 2023-12-08T08:17:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.712+0000 7f6b28bbc640 1 -- 172.21.15.45:0/482019204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 msgr2=0x7f6b241542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.712+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/482019204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241542a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b240a6840 tx=0x7f6b1402b910 comp rx=0 tx=0).stop 2023-12-08T08:17:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 -- 172.21.15.45:0/482019204 shutdown_connections 2023-12-08T08:17:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/482019204 >> v2:172.21.15.114:3300/0 conn(0x7f6b240a7770 0x7f6b240a7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/482019204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241542a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 -- 172.21.15.45:0/482019204 >> 172.21.15.45:0/482019204 conn(0x7f6b240c5780 msgr2=0x7f6b240c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 -- 172.21.15.45:0/482019204 shutdown_connections 2023-12-08T08:17:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.713+0000 7f6b28bbc640 1 -- 172.21.15.45:0/482019204 wait complete. 2023-12-08T08:17:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.715+0000 7f6b28bbc640 1 Processor -- start 2023-12-08T08:17:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.715+0000 7f6b28bbc640 1 -- start start 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b240a7770 0x7f6b24150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b240beb30 0x7f6b241ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241ea110 con 0x7f6b2414e260 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b240a7be0 con 0x7f6b240beb30 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b28bbc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2414ea50 con 0x7f6b240a7770 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b23fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b23fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56676/0 (socket says 172.21.15.45:56676) 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b23fff640 1 -- 172.21.15.45:0/353447552 learned_addr learned my addr 172.21.15.45:0/353447552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b237fe640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b240a7770 0x7f6b24150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.716+0000 7f6b1affd640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b240beb30 0x7f6b241ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 -- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b240a7770 msgr2=0x7f6b24150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b240a7770 0x7f6b24150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 -- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b240beb30 msgr2=0x7f6b241ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b240beb30 0x7f6b241ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 -- 172.21.15.45:0/353447552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140094d0 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b23fff640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00b970 tx=0x7f6b1c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00cb40 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00ccc0 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c014680 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2414f030 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.717+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2414f280 con 0x7f6b2414e260 2023-12-08T08:17:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.719+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b241ea260 con 0x7f6b2414e260 2023-12-08T08:17:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.719+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b1c01d3b0 con 0x7f6b2414e260 2023-12-08T08:17:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.720+0000 7f6b20ff9640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 0x7f6b0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.720+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f6b1c089770 con 0x7f6b2414e260 2023-12-08T08:17:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.721+0000 7f6b237fe640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 0x7f6b0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.721+0000 7f6b237fe640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 0x7f6b0406d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b14036000 tx=0x7f6b1403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.725+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b1c054670 con 0x7f6b2414e260 2023-12-08T08:17:18.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.921+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b24149470 con 0x7f6b2414e260 2023-12-08T08:17:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.923+0000 7f6b20ff9640 1 -- 172.21.15.45:0/353447552 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16877 (secure 0 0 0) 0x7f6b1c057c90 con 0x7f6b2414e260 2023-12-08T08:17:18.927 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:18.927 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:16.064397+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2643055":"2023-12-09T08:17:13.045069+0000","172.21.15.45:6836/2643055":"2023-12-09T08:17:13.045069+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 msgr2=0x7f6b0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 0x7f6b0406d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b14036000 tx=0x7f6b1403c040 comp rx=0 tx=0).stop 2023-12-08T08:17:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 msgr2=0x7f6b241eaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00b970 tx=0x7f6b1c00be30 comp rx=0 tx=0).stop 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 shutdown_connections 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b0406ae40 0x7f6b0406d300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b2414e260 0x7f6b241eaa80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b240beb30 0x7f6b241ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 --2- 172.21.15.45:0/353447552 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b240a7770 0x7f6b24150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.926+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 >> 172.21.15.45:0/353447552 conn(0x7f6b240c5780 msgr2=0x7f6b24149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.927+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 shutdown_connections 2023-12-08T08:17:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:18.927+0000 7f6b28bbc640 1 -- 172.21.15.45:0/353447552 wait complete. 2023-12-08T08:17:18.947 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:17:18.947 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.162+0000 7f36197cf640 1 Processor -- start 2023-12-08T08:17:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.162+0000 7f36197cf640 1 -- start start 2023-12-08T08:17:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.163+0000 7f36197cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36140a5140 0x7f3614153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.163+0000 7f36197cf640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.163+0000 7f36197cf640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36140a59a0 con 0x7f361406d450 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.163+0000 7f36197cf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3614150840 con 0x7f36140a5140 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.163+0000 7f36197cf640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3614154b40 con 0x7f361414d7f0 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36140a5140 0x7f3614153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36140a5140 0x7f3614153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56684/0 (socket says 172.21.15.45:56684) 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 -- 172.21.15.45:0/3275946292 learned_addr learned my addr 172.21.15.45:0/3275946292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f3618fce640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 -- 172.21.15.45:0/3275946292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 msgr2=0x7f361414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 -- 172.21.15.45:0/3275946292 >> v1:172.21.15.114:6789/0 conn(0x7f361406d450 legacy=0x7f3614150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f360bfff640 1 -- 172.21.15.45:0/3275946292 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36141542a0 con 0x7f36140a5140 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.164+0000 7f3618fce640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.165+0000 7f360bfff640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614153bc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6f20686bb5878f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36137fe640 1 -- 172.21.15.45:0/3275946292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0317c0 con 0x7f36140a5140 2023-12-08T08:17:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36137fe640 1 -- 172.21.15.45:0/3275946292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc031920 con 0x7f36140a5140 2023-12-08T08:17:19.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36137fe640 1 -- 172.21.15.45:0/3275946292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc031cb0 con 0x7f36140a5140 2023-12-08T08:17:19.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 -- 172.21.15.45:0/3275946292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 msgr2=0x7f3614153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614153bc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc02b860 comp rx=0 tx=0).stop 2023-12-08T08:17:19.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 -- 172.21.15.45:0/3275946292 shutdown_connections 2023-12-08T08:17:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 --2- 172.21.15.45:0/3275946292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614153bc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.166+0000 7f36197cf640 1 -- 172.21.15.45:0/3275946292 >> 172.21.15.45:0/3275946292 conn(0x7f36140c5780 msgr2=0x7f36140c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.167+0000 7f36197cf640 1 -- 172.21.15.45:0/3275946292 shutdown_connections 2023-12-08T08:17:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.167+0000 7f36197cf640 1 -- 172.21.15.45:0/3275946292 wait complete. 2023-12-08T08:17:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.168+0000 7f36197cf640 1 Processor -- start 2023-12-08T08:17:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.168+0000 7f36197cf640 1 -- start start 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361406d450 0x7f36141469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361414b640 con 0x7f36140a5140 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361414aa50 con 0x7f361406d450 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f36197cf640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361414aca0 con 0x7f361414d7f0 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f360bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.169+0000 7f360bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56696/0 (socket says 172.21.15.45:56696) 2023-12-08T08:17:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 -- 172.21.15.45:0/795855828 learned_addr learned my addr 172.21.15.45:0/795855828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f3613fff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361406d450 0x7f36141469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f3618fce640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 -- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 msgr2=0x7f361414ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 -- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361406d450 msgr2=0x7f36141469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361406d450 0x7f36141469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 -- 172.21.15.45:0/795855828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0094d0 con 0x7f36140a5140 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f3618fce640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.170+0000 7f360bfff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.171+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc032960 con 0x7f36140a5140 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.171+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc032ac0 con 0x7f36140a5140 2023-12-08T08:17:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.171+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361414af80 con 0x7f36140a5140 2023-12-08T08:17:19.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.171+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc032e70 con 0x7f36140a5140 2023-12-08T08:17:19.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.171+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3614148500 con 0x7f36140a5140 2023-12-08T08:17:19.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.172+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36140743e0 con 0x7f36140a5140 2023-12-08T08:17:19.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.173+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35fc04e450 con 0x7f36140a5140 2023-12-08T08:17:19.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.174+0000 7f36117fa640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 0x7f35f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.174+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f35fc0abb90 con 0x7f36140a5140 2023-12-08T08:17:19.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.174+0000 7f3613fff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 0x7f35f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.175+0000 7f3613fff640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 0x7f35f406d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3604004ea0 tx=0x7f3604009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.178+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35fc076a90 con 0x7f36140a5140 2023-12-08T08:17:19.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.410+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36140bfee0 con 0x7f36140a5140 2023-12-08T08:17:19.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.411+0000 7f36117fa640 1 -- 172.21.15.45:0/795855828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f35fc07a0b0 con 0x7f36140a5140 2023-12-08T08:17:19.414 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:19.414 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2632584195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2632584195},{"type":"v1","addr":"172.21.15.45:6837","nonce":2632584195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:19.414 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 msgr2=0x7f35f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 0x7f35f406d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3604004ea0 tx=0x7f3604009040 comp rx=0 tx=0).stop 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 msgr2=0x7f3614147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009870 tx=0x7f35fc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 shutdown_connections 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f35f406ae40 0x7f35f406d300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f361414d7f0 0x7f361414ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36140a5140 0x7f3614147fc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 --2- 172.21.15.45:0/795855828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361406d450 0x7f36141469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 >> 172.21.15.45:0/795855828 conn(0x7f36140c5780 msgr2=0x7f361414cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 shutdown_connections 2023-12-08T08:17:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.414+0000 7f36197cf640 1 -- 172.21.15.45:0/795855828 wait complete. 2023-12-08T08:17:19.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.667+0000 7f4f71d83640 1 Processor -- start 2023-12-08T08:17:19.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.667+0000 7f4f71d83640 1 -- start start 2023-12-08T08:17:19.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.668+0000 7f4f71d83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f6c14c4a0 0x7f4f6c156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.668+0000 7f4f71d83640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f6c0a4d10 0x7f4f6c155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.668+0000 7f4f71d83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 0x7f4f6c153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f71d83640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c4730 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f71d83640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c56e0 con 0x7f4f6c14c4a0 2023-12-08T08:17:19.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f71d83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0a54f0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f63fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f6c0a4d10 0x7f4f6c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f63fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f6c0a4d10 0x7f4f6c155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56706/0 (socket says 172.21.15.45:56706) 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f63fff640 1 -- 172.21.15.45:0/3097808228 learned_addr learned my addr 172.21.15.45:0/3097808228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f6bfff640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 0x7f4f6c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.669+0000 7f4f6b7fe640 1 --2- 172.21.15.45:0/3097808228 >> v2:172.21.15.114:3300/0 conn(0x7f4f6c14c4a0 0x7f4f6c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f63fff640 1 -- 172.21.15.45:0/3097808228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 msgr2=0x7f4f6c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f63fff640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 0x7f4f6c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f63fff640 1 -- 172.21.15.45:0/3097808228 >> v2:172.21.15.114:3300/0 conn(0x7f4f6c14c4a0 msgr2=0x7f4f6c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f63fff640 1 --2- 172.21.15.45:0/3097808228 >> v2:172.21.15.114:3300/0 conn(0x7f4f6c14c4a0 0x7f4f6c156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f63fff640 1 -- 172.21.15.45:0/3097808228 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c14c880 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.670+0000 7f4f6bfff640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 0x7f4f6c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.671+0000 7f4f63fff640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c0a4d10 0x7f4f6c155980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0aae70 tx=0x7f4f5402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84644f7499a9e885 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.671+0000 7f4f6affd640 1 -- 172.21.15.45:0/3097808228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540317e0 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.671+0000 7f4f6affd640 1 -- 172.21.15.45:0/3097808228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54031940 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.671+0000 7f4f6affd640 1 -- 172.21.15.45:0/3097808228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031cd0 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 -- 172.21.15.45:0/3097808228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c0a4d10 msgr2=0x7f4f6c155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c0a4d10 0x7f4f6c155980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0aae70 tx=0x7f4f5402b880 comp rx=0 tx=0).stop 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 -- 172.21.15.45:0/3097808228 shutdown_connections 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c155ec0 0x7f4f6c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 --2- 172.21.15.45:0/3097808228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c0a4d10 0x7f4f6c155980 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 --2- 172.21.15.45:0/3097808228 >> v2:172.21.15.114:3300/0 conn(0x7f4f6c14c4a0 0x7f4f6c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 -- 172.21.15.45:0/3097808228 >> 172.21.15.45:0/3097808228 conn(0x7f4f6c0661f0 msgr2=0x7f4f6c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 -- 172.21.15.45:0/3097808228 shutdown_connections 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.672+0000 7f4f71d83640 1 -- 172.21.15.45:0/3097808228 wait complete. 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.673+0000 7f4f71d83640 1 Processor -- start 2023-12-08T08:17:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.674+0000 7f4f71d83640 1 -- start start 2023-12-08T08:17:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.674+0000 7f4f71d83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c0a4d10 0x7f4f6c072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.674+0000 7f4f71d83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6c14c4a0 0x7f4f6c0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.674+0000 7f4f71d83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f71d83640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c06fae0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f71d83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c070340 con 0x7f4f6c14c4a0 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f71d83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c1e8500 con 0x7f4f6c0a4d10 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56712/0 (socket says 172.21.15.45:56712) 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 -- 172.21.15.45:0/1514307353 learned_addr learned my addr 172.21.15.45:0/1514307353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6b7fe640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c0a4d10 0x7f4f6c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f63fff640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6c14c4a0 0x7f4f6c0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 -- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c0a4d10 msgr2=0x7f4f6c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c0a4d10 0x7f4f6c072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 -- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6c14c4a0 msgr2=0x7f4f6c0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6c14c4a0 0x7f4f6c0c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.675+0000 7f4f6bfff640 1 -- 172.21.15.45:0/1514307353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540094d0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f6bfff640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007df0 tx=0x7f4f6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64003990 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6400f040 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c1e87e0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64003d30 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.676+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c06ffd0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.677+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c074600 con 0x7f4f6c155ec0 2023-12-08T08:17:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.678+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f64004030 con 0x7f4f6c155ec0 2023-12-08T08:17:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.679+0000 7f4f68ff9640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 0x7f4f4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.679+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f4f64089b70 con 0x7f4f6c155ec0 2023-12-08T08:17:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.680+0000 7f4f6b7fe640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 0x7f4f4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.680+0000 7f4f6b7fe640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 0x7f4f4c06d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006fd0 tx=0x7f4f5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.684+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f640549e0 con 0x7f4f6c155ec0 2023-12-08T08:17:19.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.908+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f6c070480 con 0x7f4f6c155ec0 2023-12-08T08:17:19.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.909+0000 7f4f68ff9640 1 -- 172.21.15.45:0/1514307353 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f4f6401a090 con 0x7f4f6c155ec0 2023-12-08T08:17:19.912 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:19.912 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2632584195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2632584195},{"type":"v1","addr":"172.21.15.45:6837","nonce":2632584195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:16:45.557103+0000","modified":"2023-12-08T08:16:48.620814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6834/3655888531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3655888531},{"type":"v1","addr":"172.21.15.114:6834","nonce":3655888531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:17:19.913 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 msgr2=0x7f4f4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 0x7f4f4c06d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c006fd0 tx=0x7f4f5c008040 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 msgr2=0x7f4f6c0c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007df0 tx=0x7f4f6400d4a0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 shutdown_connections 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4f4c06ae40 0x7f4f4c06d300 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f6c155ec0 0x7f4f6c0c2390 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f6c14c4a0 0x7f4f6c0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 --2- 172.21.15.45:0/1514307353 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f6c0a4d10 0x7f4f6c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 >> 172.21.15.45:0/1514307353 conn(0x7f4f6c0661f0 msgr2=0x7f4f6c1550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 shutdown_connections 2023-12-08T08:17:19.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:19.912+0000 7f4f71d83640 1 -- 172.21.15.45:0/1514307353 wait complete. 2023-12-08T08:17:19.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.132+0000 7f10a2652640 1 Processor -- start 2023-12-08T08:17:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.132+0000 7f10a2652640 1 -- start start 2023-12-08T08:17:20.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a2652640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 0x7f109c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a2652640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f109c148d10 0x7f109c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a2652640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c0c3750 con 0x7f109c06ce90 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a2652640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c0c3a30 con 0x7f109c148d10 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a2652640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c06d390 con 0x7f109c0c2550 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a0e4f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f109c06ce90 0x7f109c148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59142/0 (socket says 172.21.15.45:59142) 2023-12-08T08:17:20.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a0e4f640 1 -- 172.21.15.45:0/325238903 learned_addr learned my addr 172.21.15.45:0/325238903 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a1650640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 0x7f109c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.134+0000 7f10a1e51640 1 --2- 172.21.15.45:0/325238903 >> v2:172.21.15.114:3300/0 conn(0x7f109c148d10 0x7f109c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486104651 0 0) 0x7f109c0c3750 con 0x7f109c06ce90 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1088003520 con 0x7f109c06ce90 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909510301 0 0) 0x7f1088003520 con 0x7f109c06ce90 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 msgr2=0x7f109c152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 0x7f109c152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 >> v2:172.21.15.114:3300/0 conn(0x7f109c148d10 msgr2=0x7f109c0c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 --2- 172.21.15.45:0/325238903 >> v2:172.21.15.114:3300/0 conn(0x7f109c148d10 0x7f109c0c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c06d670 con 0x7f109c06ce90 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f108c001670 con 0x7f109c06ce90 2023-12-08T08:17:20.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 >> v1:172.21.15.45:6789/0 conn(0x7f109c06ce90 legacy=0x7f109c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1088003970 0x7f1088003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 0x7f10880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088004d00 0x7f1088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0c3a30 con 0x7f1088003970 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c06d390 con 0x7f1088004d00 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.135+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108800b980 con 0x7f109c0c2550 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1088003970 0x7f1088003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 -- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 msgr2=0x7f10880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f109c0c2550 0x7f10880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1e51640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088004d00 0x7f1088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 -- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088004d00 msgr2=0x7f1088005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1088004d00 0x7f1088005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.136+0000 7f10a1650640 1 -- 172.21.15.45:0/325238903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088003520 con 0x7f1088003970 2023-12-08T08:17:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.137+0000 7f10a1650640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1088003970 0x7f1088003d90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1098009ac0 tx=0x7f10880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4974fa04187f67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.137+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109802c710 con 0x7f1088003970 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.137+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109802c870 con 0x7f1088003970 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.137+0000 7f1093fff640 1 -- 172.21.15.45:0/325238903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109802cc00 con 0x7f1088003970 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 -- 172.21.15.45:0/325238903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1088003970 msgr2=0x7f1088003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 --2- 172.21.15.45:0/325238903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1088003970 0x7f1088003d90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1098009ac0 tx=0x7f10880057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a1e51640 1 -- 172.21.15.45:0/325238903 reap_dead start 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 -- 172.21.15.45:0/325238903 shutdown_connections 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 -- 172.21.15.45:0/325238903 >> 172.21.15.45:0/325238903 conn(0x7f109c066d40 msgr2=0x7f109c0c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 -- 172.21.15.45:0/325238903 shutdown_connections 2023-12-08T08:17:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.138+0000 7f10a2652640 1 -- 172.21.15.45:0/325238903 wait complete. 2023-12-08T08:17:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.140+0000 7f10a2652640 1 Processor -- start 2023-12-08T08:17:20.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.140+0000 7f10a2652640 1 -- start start 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1088003970 0x7f109c1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109c1ed430 0x7f109c14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c1ed8b0 con 0x7f109c147e70 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c151d80 con 0x7f109c1ed430 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a2652640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c147730 con 0x7f1088003970 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a0e4f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a0e4f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56728/0 (socket says 172.21.15.45:56728) 2023-12-08T08:17:20.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.141+0000 7f10a0e4f640 1 -- 172.21.15.45:0/1246535920 learned_addr learned my addr 172.21.15.45:0/1246535920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a1650640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1088003970 0x7f109c1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a1e51640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109c1ed430 0x7f109c14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 -- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1088003970 msgr2=0x7f109c1471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1088003970 0x7f109c1471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 -- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109c1ed430 msgr2=0x7f109c14ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109c1ed430 0x7f109c14ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 -- 172.21.15.45:0/1246535920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c153890 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a0e4f640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c700 tx=0x7f108c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0072d0 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c007450 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0047e0 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.142+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c1edaa0 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.143+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c1edd80 con 0x7f109c147e70 2023-12-08T08:17:20.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.144+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c0c2150 con 0x7f109c147e70 2023-12-08T08:17:20.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.144+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f108c004960 con 0x7f109c147e70 2023-12-08T08:17:20.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.145+0000 7f1091ffb640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 0x7f108006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.146+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f108c088bf0 con 0x7f109c147e70 2023-12-08T08:17:20.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.146+0000 7f10a1650640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 0x7f108006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.146+0000 7f10a1650640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 0x7f108006d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1098036000 tx=0x7f1098030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.149+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f108c053b00 con 0x7f109c147e70 2023-12-08T08:17:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.342+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f109c153d70 con 0x7f109c147e70 2023-12-08T08:17:20.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.344+0000 7f1091ffb640 1 -- 172.21.15.45:0/1246535920 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16877 (secure 0 0 0) 0x7f109c153d70 con 0x7f109c147e70 2023-12-08T08:17:20.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:20.347 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:16.064397+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:16:43.271897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:16:44.566832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2643055":"2023-12-09T08:17:13.045069+0000","172.21.15.45:6836/2643055":"2023-12-09T08:17:13.045069+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 msgr2=0x7f108006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 0x7f108006d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1098036000 tx=0x7f1098030000 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 msgr2=0x7f109c1ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c700 tx=0x7f108c00cbc0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 shutdown_connections 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f108006ae70 0x7f108006d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109c1ed430 0x7f109c14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c147e70 0x7f109c1ecef0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 --2- 172.21.15.45:0/1246535920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1088003970 0x7f109c1471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 >> 172.21.15.45:0/1246535920 conn(0x7f109c066d40 msgr2=0x7f109c0bec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 shutdown_connections 2023-12-08T08:17:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.347+0000 7f10a2652640 1 -- 172.21.15.45:0/1246535920 wait complete. 2023-12-08T08:17:20.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.585+0000 7f3740ad7640 1 Processor -- start 2023-12-08T08:17:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.585+0000 7f3740ad7640 1 -- start start 2023-12-08T08:17:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.586+0000 7f3740ad7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 0x7f373c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.586+0000 7f3740ad7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c154b90 con 0x7f373c14ea60 2023-12-08T08:17:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.586+0000 7f3740ad7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c154e70 con 0x7f373c14e680 2023-12-08T08:17:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.586+0000 7f3740ad7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c155150 con 0x7f373c06d820 2023-12-08T08:17:20.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.587+0000 7f3733fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f373c14ea60 0x7f373c06c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59154/0 (socket says 172.21.15.45:59154) 2023-12-08T08:17:20.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.587+0000 7f3733fff640 1 -- 172.21.15.45:0/3745184087 learned_addr learned my addr 172.21.15.45:0/3745184087 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:20.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.587+0000 7f373bfff640 1 --2- 172.21.15.45:0/3745184087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 0x7f373c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.587+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240204727 0 0) 0x7f373c154b90 con 0x7f373c14ea60 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.587+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3728005730 con 0x7f373c14ea60 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898859307 0 0) 0x7f373c154e70 con 0x7f373c14e680 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c154b90 con 0x7f373c14e680 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413951185 0 0) 0x7f3728005730 con 0x7f373c14ea60 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373bfff640 1 -- 172.21.15.45:0/3745184087 >> v1:172.21.15.114:6789/0 conn(0x7f373c14e680 legacy=0x7f373c0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373bfff640 1 -- 172.21.15.45:0/3745184087 >> v1:172.21.15.45:6789/0 conn(0x7f373c14ea60 legacy=0x7f373c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.588+0000 7f373bfff640 1 -- 172.21.15.45:0/3745184087 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c155430 con 0x7f373c06d820 2023-12-08T08:17:20.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.589+0000 7f373bfff640 1 --2- 172.21.15.45:0/3745184087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 0x7f373c1545b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3734009dc0 tx=0x7f373402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24eed7bc65703986 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724001670 con 0x7f373c06d820 2023-12-08T08:17:20.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373402c880 con 0x7f373c06d820 2023-12-08T08:17:20.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f373affd640 1 -- 172.21.15.45:0/3745184087 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373402cbf0 con 0x7f373c06d820 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f3740ad7640 1 -- 172.21.15.45:0/3745184087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 msgr2=0x7f373c1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3745184087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 0x7f373c1545b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3734009dc0 tx=0x7f373402bd50 comp rx=0 tx=0).stop 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f3740ad7640 1 -- 172.21.15.45:0/3745184087 shutdown_connections 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3745184087 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c06d820 0x7f373c1545b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.590+0000 7f3740ad7640 1 -- 172.21.15.45:0/3745184087 >> 172.21.15.45:0/3745184087 conn(0x7f373c0a7600 msgr2=0x7f373c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.591+0000 7f3740ad7640 1 -- 172.21.15.45:0/3745184087 shutdown_connections 2023-12-08T08:17:20.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.591+0000 7f3740ad7640 1 -- 172.21.15.45:0/3745184087 wait complete. 2023-12-08T08:17:20.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.592+0000 7f3740ad7640 1 Processor -- start 2023-12-08T08:17:20.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.593+0000 7f3740ad7640 1 -- start start 2023-12-08T08:17:20.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c06d820 0x7f373c0a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c14e680 0x7f373c070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1ea150 con 0x7f373c14ea60 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c09b4a0 con 0x7f373c06d820 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3740ad7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1e9560 con 0x7f373c14e680 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f373bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f373bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56732/0 (socket says 172.21.15.45:56732) 2023-12-08T08:17:20.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f373bfff640 1 -- 172.21.15.45:0/3520796574 learned_addr learned my addr 172.21.15.45:0/3520796574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:20.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f3733fff640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c14e680 0x7f373c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.594+0000 7f373b7fe640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c06d820 0x7f373c0a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 -- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c14e680 msgr2=0x7f373c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c14e680 0x7f373c070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 -- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c06d820 msgr2=0x7f373c0a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c06d820 0x7f373c0a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 -- 172.21.15.45:0/3520796574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009a70 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f373bfff640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3734009eb0 tx=0x7f3734004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373402de80 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734009450 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.595+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c1e9820 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.596+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734004450 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.596+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c1e9de0 con 0x7f373c14ea60 2023-12-08T08:17:20.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.597+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c1ea300 con 0x7f373c14ea60 2023-12-08T08:17:20.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.598+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f373403b070 con 0x7f373c14ea60 2023-12-08T08:17:20.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.599+0000 7f3738ff9640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 0x7f371c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:20.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.599+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f37340aba00 con 0x7f373c14ea60 2023-12-08T08:17:20.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.599+0000 7f373b7fe640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 0x7f371c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:20.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.600+0000 7f373b7fe640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 0x7f371c06d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f372c0011e0 tx=0x7f372c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:20.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.603+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f373c1ea300 con 0x7f373c14ea60 2023-12-08T08:17:20.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.836+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f373c1ea300 con 0x7f373c14ea60 2023-12-08T08:17:20.839 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:17:20.837+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:17:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.840+0000 7f3738ff9640 1 -- 172.21.15.45:0/3520796574 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f373c1ea300 con 0x7f373c14ea60 2023-12-08T08:17:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 msgr2=0x7f371c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 0x7f371c06d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f372c0011e0 tx=0x7f372c009040 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 msgr2=0x7f373c1ecb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3734009eb0 tx=0x7f3734004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 shutdown_connections 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f371c06ae40 0x7f371c06d300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f373c14e680 0x7f373c070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f373c14ea60 0x7f373c1ecb50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 --2- 172.21.15.45:0/3520796574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f373c06d820 0x7f373c0a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 >> 172.21.15.45:0/3520796574 conn(0x7f373c0a7600 msgr2=0x7f373c0c0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 shutdown_connections 2023-12-08T08:17:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:20.844+0000 7f3740ad7640 1 -- 172.21.15.45:0/3520796574 wait complete. 2023-12-08T08:17:20.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:17:20.868 INFO:tasks.ceph.mds.d.smithi114.stderr: -2294> 2023-12-08T08:16:47.914+0000 7faff64aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:17:20.961 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:17:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.070+0000 7fe917fff640 1 Processor -- start 2023-12-08T08:17:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.070+0000 7fe917fff640 1 -- start start 2023-12-08T08:17:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe917fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9180c4970 0x7fe9180a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe917fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180c60c0 con 0x7fe918155790 2023-12-08T08:17:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe917fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe918152dc0 con 0x7fe91814c280 2023-12-08T08:17:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe917fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9181521d0 con 0x7fe9180c4970 2023-12-08T08:17:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe9177fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe918155790 0x7fe918155ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59164/0 (socket says 172.21.15.45:59164) 2023-12-08T08:17:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe9177fe640 1 -- 172.21.15.45:0/1515809816 learned_addr learned my addr 172.21.15.45:0/1515809816 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.072+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1515809816 >> v2:172.21.15.114:3300/0 conn(0x7fe9180c4970 0x7fe9180a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721731712 0 0) 0x7fe910001110 con 0x7fe918155790 2023-12-08T08:17:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe904003520 con 0x7fe918155790 2023-12-08T08:17:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3246049165 0 0) 0x7fe904003520 con 0x7fe918155790 2023-12-08T08:17:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 >> v2:172.21.15.114:3300/0 conn(0x7fe9180c4970 msgr2=0x7fe9180a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 --2- 172.21.15.45:0/1515809816 >> v2:172.21.15.114:3300/0 conn(0x7fe9180c4970 0x7fe9180a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 >> v1:172.21.15.114:6789/0 conn(0x7fe91814c280 legacy=0x7fe91806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91814c660 con 0x7fe918155790 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe910001800 con 0x7fe918155790 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 >> v1:172.21.15.45:6789/0 conn(0x7fe918155790 legacy=0x7fe918155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 0x7fe904003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040051d0 0x7fe90400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181521d0 con 0x7fe9040039c0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90400c120 con 0x7fe9040051d0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.073+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90400c2e0 con 0x7fe9040047c0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 0x7fe904003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe9177fe640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040051d0 0x7fe90400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 -- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9040047c0 msgr2=0x7fe904004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 -- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040051d0 msgr2=0x7fe90400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040051d0 0x7fe90400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe916ffd640 1 -- 172.21.15.45:0/1515809816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe904003520 con 0x7fe9040039c0 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9040047c0 0x7fe904004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe9177fe640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040051d0 0x7fe90400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:21.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.074+0000 7fe9177fe640 1 -- 172.21.15.45:0/1515809816 reap_dead start 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.075+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 0x7fe904003de0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe908001e20 tx=0x7fe9040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e702d153380702f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908003b70 con 0x7fe9040039c0 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908003cd0 con 0x7fe9040039c0 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe9167fc640 1 -- 172.21.15.45:0/1515809816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908005310 con 0x7fe9040039c0 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 -- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 msgr2=0x7fe904003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 0x7fe904003de0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe908001e20 tx=0x7fe9040057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 -- 172.21.15.45:0/1515809816 shutdown_connections 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 --2- 172.21.15.45:0/1515809816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9040039c0 0x7fe904003de0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 -- 172.21.15.45:0/1515809816 >> 172.21.15.45:0/1515809816 conn(0x7fe918066ce0 msgr2=0x7fe9180a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:21.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 -- 172.21.15.45:0/1515809816 shutdown_connections 2023-12-08T08:17:21.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.076+0000 7fe917fff640 1 -- 172.21.15.45:0/1515809816 wait complete. 2023-12-08T08:17:21.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.078+0000 7fe917fff640 1 Processor -- start 2023-12-08T08:17:21.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.078+0000 7fe917fff640 1 -- start start 2023-12-08T08:17:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040039c0 0x7fe9181516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9180a6f50 0x7fe9180aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181edf70 con 0x7fe91814b630 2023-12-08T08:17:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180aa650 con 0x7fe9040039c0 2023-12-08T08:17:21.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe917fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9181ed360 con 0x7fe9180a6f50 2023-12-08T08:17:21.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.079+0000 7fe90e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56752/0 (socket says 172.21.15.45:56752) 2023-12-08T08:17:21.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 -- 172.21.15.45:0/1346574097 learned_addr learned my addr 172.21.15.45:0/1346574097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:21.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040039c0 0x7fe9181516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 -- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9180a6f50 msgr2=0x7fe9180aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9180a6f50 0x7fe9180aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 -- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040039c0 msgr2=0x7fe9181516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040039c0 0x7fe9181516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 -- 172.21.15.45:0/1346574097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9181ed640 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90e7fc640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe9000107f0 tx=0x7fe900010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000eb60 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000ecc0 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90001c400 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.080+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9181ed920 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.081+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe918151c30 con 0x7fe91814b630 2023-12-08T08:17:21.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.082+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9180678c0 con 0x7fe91814b630 2023-12-08T08:17:21.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.083+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe90001c580 con 0x7fe91814b630 2023-12-08T08:17:21.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.084+0000 7fe90ffff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 0x7fe8f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:21.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.084+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fe900089c20 con 0x7fe91814b630 2023-12-08T08:17:21.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.084+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 0x7fe8f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:21.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.085+0000 7fe916ffd640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 0x7fe8f806d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe908034000 tx=0x7fe908009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:21.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.089+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe900054b80 con 0x7fe91814b630 2023-12-08T08:17:21.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.318+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9180743e0 con 0x7fe91814b630 2023-12-08T08:17:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.844+0000 7fe90ffff640 1 -- 172.21.15.45:0/1346574097 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe9000581a0 con 0x7fe91814b630 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 msgr2=0x7fe8f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 0x7fe8f806d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe908034000 tx=0x7fe908009030 comp rx=0 tx=0).stop 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 msgr2=0x7fe9180a9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe9000107f0 tx=0x7fe900010cb0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 shutdown_connections 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe8f806ae40 0x7fe8f806d300 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9180a6f50 0x7fe9180aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91814b630 0x7fe9180a9bd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 --2- 172.21.15.45:0/1346574097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9040039c0 0x7fe9181516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 >> 172.21.15.45:0/1346574097 conn(0x7fe918066ce0 msgr2=0x7fe9180bf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 shutdown_connections 2023-12-08T08:17:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:21.849+0000 7fe917fff640 1 -- 172.21.15.45:0/1346574097 wait complete. 2023-12-08T08:17:21.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:17:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.105+0000 7f936696c640 1 Processor -- start 2023-12-08T08:17:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.106+0000 7f936696c640 1 -- start start 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936696c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9360154d20 0x7f9360158430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936696c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9360157890 con 0x7f93600c44e0 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936696c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93600c7f70 con 0x7f93600c7a60 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936696c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9360155300 con 0x7f9360154d20 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936596a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93600c44e0 0x7f9360157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59168/0 (socket says 172.21.15.45:59168) 2023-12-08T08:17:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.107+0000 7f936596a640 1 -- 172.21.15.45:0/2604214852 learned_addr learned my addr 172.21.15.45:0/2604214852 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f936616b640 1 --2- 172.21.15.45:0/2604214852 >> v2:172.21.15.114:3300/0 conn(0x7f9360154d20 0x7f9360158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788426495 0 0) 0x7f9360157890 con 0x7f93600c44e0 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934c003520 con 0x7f93600c44e0 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134623070 0 0) 0x7f934c003520 con 0x7f93600c44e0 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 >> v2:172.21.15.114:3300/0 conn(0x7f9360154d20 msgr2=0x7f9360158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 --2- 172.21.15.45:0/2604214852 >> v2:172.21.15.114:3300/0 conn(0x7f9360154d20 0x7f9360158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 >> v1:172.21.15.114:6789/0 conn(0x7f93600c7a60 legacy=0x7f936015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600ca040 con 0x7f93600c44e0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f935c001670 con 0x7f93600c44e0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 >> v1:172.21.15.45:6789/0 conn(0x7f93600c44e0 legacy=0x7f9360157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0039c0 0x7f934c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f934c0047c0 0x7f934c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 0x7f934c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9360155300 con 0x7f934c0052a0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c00c1a0 con 0x7f934c0039c0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.108+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c00c360 con 0x7f934c0047c0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 0x7f934c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936596a640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0039c0 0x7f934c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 -- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f934c0047c0 msgr2=0x7f934c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f934c0047c0 0x7f934c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 -- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0039c0 msgr2=0x7f934c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0039c0 0x7f934c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936616b640 1 -- 172.21.15.45:0/2604214852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c003520 con 0x7f934c0052a0 2023-12-08T08:17:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.109+0000 7f936596a640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0039c0 0x7f934c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.110+0000 7f936616b640 1 -- 172.21.15.45:0/2604214852 reap_dead start 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.110+0000 7f936616b640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 0x7f934c00b980 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9358009f90 tx=0x7f934c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30dfa20490b61b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935802cc20 con 0x7f934c0052a0 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935800f040 con 0x7f934c0052a0 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f9364968640 1 -- 172.21.15.45:0/2604214852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358003990 con 0x7f934c0052a0 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 -- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 msgr2=0x7f934c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 0x7f934c00b980 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9358009f90 tx=0x7f934c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 -- 172.21.15.45:0/2604214852 shutdown_connections 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 --2- 172.21.15.45:0/2604214852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f934c0052a0 0x7f934c00b980 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 -- 172.21.15.45:0/2604214852 >> 172.21.15.45:0/2604214852 conn(0x7f93600663d0 msgr2=0x7f93600667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 -- 172.21.15.45:0/2604214852 shutdown_connections 2023-12-08T08:17:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.111+0000 7f936696c640 1 -- 172.21.15.45:0/2604214852 wait complete. 2023-12-08T08:17:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.113+0000 7f936696c640 1 Processor -- start 2023-12-08T08:17:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.113+0000 7f936696c640 1 -- start start 2023-12-08T08:17:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 0x7f93601edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9360145090 0x7f936014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93601ee4b0 con 0x7f936014d3b0 2023-12-08T08:17:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93600acc80 con 0x7f934c0052a0 2023-12-08T08:17:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.114+0000 7f936696c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9360156f70 con 0x7f9360145090 2023-12-08T08:17:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56772/0 (socket says 172.21.15.45:56772) 2023-12-08T08:17:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 -- 172.21.15.45:0/2241403439 learned_addr learned my addr 172.21.15.45:0/2241403439 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 -- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9360145090 msgr2=0x7f936014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936596a640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 0x7f93601edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f9365169640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9360145090 0x7f936014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9360145090 0x7f936014ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 -- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 msgr2=0x7f93601edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 0x7f93601edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936616b640 1 -- 172.21.15.45:0/2241403439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360157250 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.115+0000 7f936596a640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 0x7f93601edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f936616b640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f935802c690 tx=0x7f9358009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358003da0 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9358035950 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9358035ce0 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360157530 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.116+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93600c01e0 con 0x7f936014d3b0 2023-12-08T08:17:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.117+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93600673e0 con 0x7f936014d3b0 2023-12-08T08:17:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.118+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9358004030 con 0x7f936014d3b0 2023-12-08T08:17:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.119+0000 7f93567fc640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 0x7f934406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.119+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f93580ac4d0 con 0x7f936014d3b0 2023-12-08T08:17:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.119+0000 7f936596a640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 0x7f934406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.120+0000 7f936596a640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 0x7f934406d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f935c0078d0 tx=0x7f935c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.124+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9358077410 con 0x7f936014d3b0 2023-12-08T08:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:22.318+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f936014ba40 con 0x7f936014d3b0 2023-12-08T08:17:23.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.124+0000 7f93567fc640 1 -- 172.21.15.45:0/2241403439 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7f935807aa30 con 0x7f936014d3b0 2023-12-08T08:17:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:17:23.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.129+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 msgr2=0x7f934406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.129+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 0x7f934406d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f935c0078d0 tx=0x7f935c009040 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.129+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 msgr2=0x7f93600ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.129+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f935802c690 tx=0x7f9358009750 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 shutdown_connections 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f934406ae40 0x7f934406d300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9360145090 0x7f936014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f936014d3b0 0x7f93600ad460 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 --2- 172.21.15.45:0/2241403439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f934c0052a0 0x7f93601edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 >> 172.21.15.45:0/2241403439 conn(0x7f93600663d0 msgr2=0x7f93600667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 shutdown_connections 2023-12-08T08:17:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.130+0000 7f936696c640 1 -- 172.21.15.45:0/2241403439 wait complete. 2023-12-08T08:17:23.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:17:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.383+0000 7fbb5efb5640 1 Processor -- start 2023-12-08T08:17:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.383+0000 7fbb5efb5640 1 -- start start 2023-12-08T08:17:23.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.384+0000 7fbb5efb5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 0x7fbb5806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.384+0000 7fbb5efb5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580c4680 con 0x7fbb580c5870 2023-12-08T08:17:23.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.384+0000 7fbb5efb5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580c6360 con 0x7fbb580c41f0 2023-12-08T08:17:23.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.384+0000 7fbb5efb5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58158940 con 0x7fbb58155380 2023-12-08T08:17:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5dfb3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb580c5870 0x7fbb580c5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59184/0 (socket says 172.21.15.45:59184) 2023-12-08T08:17:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5dfb3640 1 -- 172.21.15.45:0/1404430287 learned_addr learned my addr 172.21.15.45:0/1404430287 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5e7b4640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 0x7fbb5806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703788230 0 0) 0x7fbb580c4680 con 0x7fbb580c5870 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb44003520 con 0x7fbb580c5870 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181277058 0 0) 0x7fbb44003520 con 0x7fbb580c5870 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 msgr2=0x7fbb5806bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 0x7fbb5806bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 >> v1:172.21.15.114:6789/0 conn(0x7fbb580c41f0 legacy=0x7fbb58154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58157cc0 con 0x7fbb580c5870 2023-12-08T08:17:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.385+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fbb54001670 con 0x7fbb580c5870 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 >> v1:172.21.15.45:6789/0 conn(0x7fbb580c5870 legacy=0x7fbb580c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb440039a0 0x7fbb44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 0x7fbb440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb44004d00 0x7fbb44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58158940 con 0x7fbb440039a0 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400bc30 con 0x7fbb44004d00 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400bdf0 con 0x7fbb58155380 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb440039a0 0x7fbb44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5e7b4640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb44004d00 0x7fbb44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 -- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 msgr2=0x7fbb440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:23.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb58155380 0x7fbb440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 -- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb44004d00 msgr2=0x7fbb44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:23.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb44004d00 0x7fbb44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.386+0000 7fbb5dfb3640 1 -- 172.21.15.45:0/1404430287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44003520 con 0x7fbb440039a0 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb440039a0 0x7fbb44003dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c0e0 tx=0x7fbb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60eefd8c511f34 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54005ad0 con 0x7fbb440039a0 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb54005c30 con 0x7fbb440039a0 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5cfb1640 1 -- 172.21.15.45:0/1404430287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5402c810 con 0x7fbb440039a0 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5efb5640 1 -- 172.21.15.45:0/1404430287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb440039a0 msgr2=0x7fbb44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/1404430287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb440039a0 0x7fbb44003dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c0e0 tx=0x7fbb440057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5e7b4640 1 -- 172.21.15.45:0/1404430287 reap_dead start 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5efb5640 1 -- 172.21.15.45:0/1404430287 shutdown_connections 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.388+0000 7fbb5efb5640 1 -- 172.21.15.45:0/1404430287 >> 172.21.15.45:0/1404430287 conn(0x7fbb58066df0 msgr2=0x7fbb580a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.389+0000 7fbb5efb5640 1 -- 172.21.15.45:0/1404430287 shutdown_connections 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.389+0000 7fbb5efb5640 1 -- 172.21.15.45:0/1404430287 wait complete. 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.390+0000 7fbb5efb5640 1 Processor -- start 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.390+0000 7fbb5efb5640 1 -- start start 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb440039a0 0x7fbb581ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb581577b0 0x7fbb58150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581568f0 con 0x7fbb5814d120 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5814d630 con 0x7fbb440039a0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.391+0000 7fbb5efb5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5814d910 con 0x7fbb581577b0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56800/0 (socket says 172.21.15.45:56800) 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 -- 172.21.15.45:0/2619630980 learned_addr learned my addr 172.21.15.45:0/2619630980 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb440039a0 0x7fbb581ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5d7b2640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb581577b0 0x7fbb58150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 -- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb581577b0 msgr2=0x7fbb58150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb581577b0 0x7fbb58150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 -- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb440039a0 msgr2=0x7fbb581ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb440039a0 0x7fbb581ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.392+0000 7fbb5e7b4640 1 -- 172.21.15.45:0/2619630980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb581e9a60 con 0x7fbb5814d120 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb5e7b4640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e090 tx=0x7fbb50007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50009cf0 con 0x7fbb5814d120 2023-12-08T08:17:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50009e70 con 0x7fbb5814d120 2023-12-08T08:17:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb581e9d40 con 0x7fbb5814d120 2023-12-08T08:17:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50014620 con 0x7fbb5814d120 2023-12-08T08:17:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.393+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb580bf940 con 0x7fbb5814d120 2023-12-08T08:17:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.394+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58067900 con 0x7fbb5814d120 2023-12-08T08:17:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.395+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb5001d3b0 con 0x7fbb5814d120 2023-12-08T08:17:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.396+0000 7fbb4e7fc640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.396+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fbb500894d0 con 0x7fbb5814d120 2023-12-08T08:17:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.397+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.397+0000 7fbb5dfb3640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 0x7fbb3c06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbb54034000 tx=0x7fbb54009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.401+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb500545d0 con 0x7fbb5814d120 2023-12-08T08:17:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:23.594+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb581ea260 con 0x7fbb5814d120 2023-12-08T08:17:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.135+0000 7fbb4e7fc640 1 -- 172.21.15.45:0/2619630980 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v50) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbb581ea260 con 0x7fbb5814d120 2023-12-08T08:17:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' removed 2023-12-08T08:17:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 msgr2=0x7fbb3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 0x7fbb3c06d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbb54034000 tx=0x7fbb54009030 comp rx=0 tx=0).stop 2023-12-08T08:17:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 msgr2=0x7fbb581ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806e090 tx=0x7fbb50007700 comp rx=0 tx=0).stop 2023-12-08T08:17:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 shutdown_connections 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb581577b0 0x7fbb58150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5814d120 0x7fbb581ecf40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 --2- 172.21.15.45:0/2619630980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb440039a0 0x7fbb581ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.138+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 >> 172.21.15.45:0/2619630980 conn(0x7fbb58066df0 msgr2=0x7fbb581521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.139+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 shutdown_connections 2023-12-08T08:17:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.139+0000 7fbb5efb5640 1 -- 172.21.15.45:0/2619630980 wait complete. 2023-12-08T08:17:24.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:17:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.390+0000 7f7cf9ef1640 1 Processor -- start 2023-12-08T08:17:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.390+0000 7f7cf9ef1640 1 -- start start 2023-12-08T08:17:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.391+0000 7f7cf9ef1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7cf40c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.391+0000 7f7cf9ef1640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cf40c1d60 0x7f7cf406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.391+0000 7f7cf9ef1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40c16b0 con 0x7f7cf40c4d30 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.391+0000 7f7cf9ef1640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40a8b30 con 0x7f7cf40c1d60 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.391+0000 7f7cf9ef1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c65d0 con 0x7f7cf4151ec0 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf96f0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7cf40c4d30 0x7f7cf406bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59200/0 (socket says 172.21.15.45:59200) 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf96f0640 1 -- 172.21.15.45:0/1229730018 learned_addr learned my addr 172.21.15.45:0/1229730018 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> v2:172.21.15.114:3300/0 conn(0x7f7cf40c1d60 0x7f7cf406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf8eef640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7cf40c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650867144 0 0) 0x7f7cf40c16b0 con 0x7f7cf40c4d30 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce4003520 con 0x7f7cf40c4d30 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830587559 0 0) 0x7f7ce4003520 con 0x7f7cf40c4d30 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 msgr2=0x7f7cf40c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.392+0000 7f7cf37fe640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7cf40c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 >> v2:172.21.15.114:3300/0 conn(0x7f7cf40c1d60 msgr2=0x7f7cf406ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 --2- 172.21.15.45:0/1229730018 >> v2:172.21.15.114:3300/0 conn(0x7f7cf40c1d60 0x7f7cf406ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40c5810 con 0x7f7cf40c4d30 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f7cec0019f0 con 0x7f7cf40c4d30 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 >> v1:172.21.15.45:6789/0 conn(0x7f7cf40c4d30 legacy=0x7f7cf406bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7ce4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ce4003fa0 0x7f7ce40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4004d00 0x7f7ce4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40a8b30 con 0x7f7ce4003fa0 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c65d0 con 0x7f7ce4004d00 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce400dd50 con 0x7f7cf4151ec0 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> v2:172.21.15.114:3300/0 conn(0x7f7cf40c1d60 0x7f7cf406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ce4003fa0 0x7f7ce40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf8eef640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7ce4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.393+0000 7f7cf96f0640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4004d00 0x7f7ce4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.394+0000 7f7cf3fff640 1 -- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 msgr2=0x7f7ce4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.394+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4151ec0 0x7f7ce4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.394+0000 7f7cf3fff640 1 -- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4004d00 msgr2=0x7f7ce4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.394+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4004d00 0x7f7ce4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.394+0000 7f7cf3fff640 1 -- 172.21.15.45:0/1229730018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4003520 con 0x7f7ce4003fa0 2023-12-08T08:17:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.395+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ce4003fa0 0x7f7ce40047c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40c2180 tx=0x7f7ce40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97b1490f91de68b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.395+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0030660 con 0x7f7ce4003fa0 2023-12-08T08:17:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.395+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00307c0 con 0x7f7ce4003fa0 2023-12-08T08:17:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.395+0000 7f7cf37fe640 1 -- 172.21.15.45:0/1229730018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0030b30 con 0x7f7ce4003fa0 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/1229730018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ce4003fa0 msgr2=0x7f7ce40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/1229730018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ce4003fa0 0x7f7ce40047c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40c2180 tx=0x7f7ce40057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf96f0640 1 -- 172.21.15.45:0/1229730018 reap_dead start 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/1229730018 shutdown_connections 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/1229730018 >> 172.21.15.45:0/1229730018 conn(0x7f7cf4066ce0 msgr2=0x7f7cf40a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/1229730018 shutdown_connections 2023-12-08T08:17:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.396+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/1229730018 wait complete. 2023-12-08T08:17:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.398+0000 7f7cf9ef1640 1 Processor -- start 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.398+0000 7f7cf9ef1640 1 -- start start 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4003fa0 0x7f7cf40bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4152bc0 0x7f7cf41ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c40b0 con 0x7f7cf4099a50 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4154cb0 con 0x7f7ce4003fa0 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.399+0000 7f7cf9ef1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4154f70 con 0x7f7cf4152bc0 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56816/0 (socket says 172.21.15.45:56816) 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 -- 172.21.15.45:0/2426042727 learned_addr learned my addr 172.21.15.45:0/2426042727 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf8eef640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4003fa0 0x7f7cf40bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf96f0640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4152bc0 0x7f7cf41ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 -- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4152bc0 msgr2=0x7f7cf41ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4152bc0 0x7f7cf41ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 -- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4003fa0 msgr2=0x7f7cf40bee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4003fa0 0x7f7cf40bee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.400+0000 7f7cf3fff640 1 -- 172.21.15.45:0/2426042727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4155250 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf3fff640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7ce002bef0 tx=0x7f7ce0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0039a20 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce003f040 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0039dc0 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4155530 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.401+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf414f970 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.402+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf40678c0 con 0x7f7cf4099a50 2023-12-08T08:17:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.403+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ce004c400 con 0x7f7cf4099a50 2023-12-08T08:17:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.404+0000 7f7cf17fa640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 0x7f7cd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.404+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7ce00abb70 con 0x7f7cf4099a50 2023-12-08T08:17:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.405+0000 7f7cf8eef640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 0x7f7cd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.405+0000 7f7cf8eef640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 0x7f7cd806d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8006fd0 tx=0x7f7ce8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.409+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ce0076d90 con 0x7f7cf4099a50 2023-12-08T08:17:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.604+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7cf4155720 con 0x7f7cf4099a50 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.611+0000 7f7cf17fa640 1 -- 172.21.15.45:0/2426042727 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ce0034020 con 0x7f7cf4099a50 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 msgr2=0x7f7cd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 0x7f7cd806d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8006fd0 tx=0x7f7ce8008040 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 msgr2=0x7f7cf4152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7ce002bef0 tx=0x7f7ce0004730 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 shutdown_connections 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7cd806ae40 0x7f7cd806d300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7cf4152bc0 0x7f7cf41ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf4099a50 0x7f7cf4152680 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 --2- 172.21.15.45:0/2426042727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ce4003fa0 0x7f7cf40bee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 >> 172.21.15.45:0/2426042727 conn(0x7f7cf4066ce0 msgr2=0x7f7cf4150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 shutdown_connections 2023-12-08T08:17:24.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.614+0000 7f7cf9ef1640 1 -- 172.21.15.45:0/2426042727 wait complete. 2023-12-08T08:17:24.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-08T08:17:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.850+0000 7f6b58e31640 1 Processor -- start 2023-12-08T08:17:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.851+0000 7f6b58e31640 1 -- start start 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b5414c4a0 0x7f6b54156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b540a4d10 0x7f6b54155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b54153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b540c4730 con 0x7f6b540a4d10 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b540c56e0 con 0x7f6b5414c4a0 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.852+0000 7f6b58e31640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540a54f0 con 0x7f6b54155ec0 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b540a4d10 0x7f6b54155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b540a4d10 0x7f6b54155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56818/0 (socket says 172.21.15.45:56818) 2023-12-08T08:17:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 -- 172.21.15.45:0/1370102659 learned_addr learned my addr 172.21.15.45:0/1370102659 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b5259c640 1 --2- 172.21.15.45:0/1370102659 >> v2:172.21.15.114:3300/0 conn(0x7f6b5414c4a0 0x7f6b54156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b52d9d640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b54153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 -- 172.21.15.45:0/1370102659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 msgr2=0x7f6b54153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b54153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 -- 172.21.15.45:0/1370102659 >> v2:172.21.15.114:3300/0 conn(0x7f6b5414c4a0 msgr2=0x7f6b54156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 --2- 172.21.15.45:0/1370102659 >> v2:172.21.15.114:3300/0 conn(0x7f6b5414c4a0 0x7f6b54156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b4bfff640 1 -- 172.21.15.45:0/1370102659 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5414c880 con 0x7f6b540a4d10 2023-12-08T08:17:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.853+0000 7f6b52d9d640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b54153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.854+0000 7f6b4bfff640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b54155980 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6b540aae70 tx=0x7f6b3c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2df33f52c1ecc9c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b51d9b640 1 -- 172.21.15.45:0/1370102659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0317e0 con 0x7f6b540a4d10 2023-12-08T08:17:24.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b51d9b640 1 -- 172.21.15.45:0/1370102659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c031940 con 0x7f6b540a4d10 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b51d9b640 1 -- 172.21.15.45:0/1370102659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c031cd0 con 0x7f6b540a4d10 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 -- 172.21.15.45:0/1370102659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 msgr2=0x7f6b54155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b54155980 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6b540aae70 tx=0x7f6b3c02b880 comp rx=0 tx=0).stop 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 -- 172.21.15.45:0/1370102659 shutdown_connections 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b54153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1370102659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b54155980 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1370102659 >> v2:172.21.15.114:3300/0 conn(0x7f6b5414c4a0 0x7f6b54156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 -- 172.21.15.45:0/1370102659 >> 172.21.15.45:0/1370102659 conn(0x7f6b540661f0 msgr2=0x7f6b54066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 -- 172.21.15.45:0/1370102659 shutdown_connections 2023-12-08T08:17:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.855+0000 7f6b58e31640 1 -- 172.21.15.45:0/1370102659 wait complete. 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.857+0000 7f6b58e31640 1 Processor -- start 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.857+0000 7f6b58e31640 1 -- start start 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5414c4a0 0x7f6b541ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b541ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5406fe10 con 0x7f6b540a4d10 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540aa4b0 con 0x7f6b5414c4a0 2023-12-08T08:17:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b58e31640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540c32a0 con 0x7f6b54155ec0 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56820/0 (socket says 172.21.15.45:56820) 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.858+0000 7f6b5259c640 1 -- 172.21.15.45:0/1107011140 learned_addr learned my addr 172.21.15.45:0/1107011140 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 -- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 msgr2=0x7f6b541ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b541ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 -- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5414c4a0 msgr2=0x7f6b541ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5414c4a0 0x7f6b541ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 -- 172.21.15.45:0/1107011140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0094d0 con 0x7f6b540a4d10 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b5259c640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400d800 tx=0x7f6b4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44009640 con 0x7f6b540a4d10 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b440097a0 con 0x7f6b540a4d10 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44009b30 con 0x7f6b540a4d10 2023-12-08T08:17:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.859+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b54144830 con 0x7f6b540a4d10 2023-12-08T08:17:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.860+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540aa9a0 con 0x7f6b540a4d10 2023-12-08T08:17:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.861+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b540aab90 con 0x7f6b540a4d10 2023-12-08T08:17:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.861+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b44009c90 con 0x7f6b540a4d10 2023-12-08T08:17:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.862+0000 7f6b4affd640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 0x7f6b3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.862+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6b44089940 con 0x7f6b540a4d10 2023-12-08T08:17:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.863+0000 7f6b4bfff640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 0x7f6b3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:24.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.863+0000 7f6b4bfff640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 0x7f6b3406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c036000 tx=0x7f6b3c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:24.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:24.868+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b44054b50 con 0x7f6b540a4d10 2023-12-08T08:17:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.134+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f6b54074600 con 0x7f6b540a4d10 2023-12-08T08:17:25.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.137+0000 7f6b4affd640 1 -- 172.21.15.45:0/1107011140 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v153) v1 ==== 159+0+0 (secure 0 0 0) 0x7f6b4400b440 con 0x7f6b540a4d10 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 msgr2=0x7f6b3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 0x7f6b3406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c036000 tx=0x7f6b3c030000 comp rx=0 tx=0).stop 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 msgr2=0x7f6b540bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400d800 tx=0x7f6b4400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 shutdown_connections 2023-12-08T08:17:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6b3406ae40 0x7f6b3406d300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6b54155ec0 0x7f6b541ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5414c4a0 0x7f6b541ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 --2- 172.21.15.45:0/1107011140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b540a4d10 0x7f6b540bf550 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.143+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 >> 172.21.15.45:0/1107011140 conn(0x7f6b540661f0 msgr2=0x7f6b541468d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.144+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 shutdown_connections 2023-12-08T08:17:25.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.144+0000 7f6b58e31640 1 -- 172.21.15.45:0/1107011140 wait complete. 2023-12-08T08:17:25.166 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-08T08:17:25.166 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-08T08:17:25.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.372+0000 7efefb59e640 1 Processor -- start 2023-12-08T08:17:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.372+0000 7efefb59e640 1 -- start start 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 0x7efefc151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 0x7efefc0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efefc0a9e80 0x7efefc0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc14ec20 con 0x7efefc0a9e80 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc151ea0 con 0x7efefc0c1210 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc154850 con 0x7efefc14e840 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efefc0a9e80 0x7efefc0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efefc0a9e80 0x7efefc0aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52250/0 (socket says 172.21.15.45:52250) 2023-12-08T08:17:25.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.374+0000 7efefad9d640 1 -- 172.21.15.45:0/2405177325 learned_addr learned my addr 172.21.15.45:0/2405177325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efef9d9b640 1 --2- 172.21.15.45:0/2405177325 >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 0x7efefc0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefad9d640 1 -- 172.21.15.45:0/2405177325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 msgr2=0x7efefc151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefa59c640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 0x7efefc151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefad9d640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 0x7efefc151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefad9d640 1 -- 172.21.15.45:0/2405177325 >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 msgr2=0x7efefc0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefad9d640 1 --2- 172.21.15.45:0/2405177325 >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 0x7efefc0c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefad9d640 1 -- 172.21.15.45:0/2405177325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc154b30 con 0x7efefc0a9e80 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efef9d9b640 1 --2- 172.21.15.45:0/2405177325 >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 0x7efefc0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.375+0000 7efefa59c640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 0x7efefc151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.376+0000 7efefad9d640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc0aa310 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efefc06ac60 tx=0x7efef402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e767deed0b30b2b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.376+0000 7efef959a640 1 -- 172.21.15.45:0/2405177325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef402c9f0 con 0x7efefc0a9e80 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.376+0000 7efef959a640 1 -- 172.21.15.45:0/2405177325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef402cb50 con 0x7efefc0a9e80 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.376+0000 7efef959a640 1 -- 172.21.15.45:0/2405177325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40343f0 con 0x7efefc0a9e80 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 -- 172.21.15.45:0/2405177325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 msgr2=0x7efefc0aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc0aa310 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7efefc06ac60 tx=0x7efef402be50 comp rx=0 tx=0).stop 2023-12-08T08:17:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 -- 172.21.15.45:0/2405177325 shutdown_connections 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 --2- 172.21.15.45:0/2405177325 >> v2:172.21.15.114:3300/0 conn(0x7efefc0c1210 0x7efefc0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc0aa310 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 --2- 172.21.15.45:0/2405177325 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc14e840 0x7efefc151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 -- 172.21.15.45:0/2405177325 >> 172.21.15.45:0/2405177325 conn(0x7efefc0c5780 msgr2=0x7efefc0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 -- 172.21.15.45:0/2405177325 shutdown_connections 2023-12-08T08:17:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.377+0000 7efefb59e640 1 -- 172.21.15.45:0/2405177325 wait complete. 2023-12-08T08:17:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.379+0000 7efefb59e640 1 Processor -- start 2023-12-08T08:17:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.379+0000 7efefb59e640 1 -- start start 2023-12-08T08:17:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc0c1210 0x7efefc1ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efefc14e840 0x7efefc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0c39b0 con 0x7efefc0a9e80 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc142d90 con 0x7efefc14e840 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc147cc0 con 0x7efefc0c1210 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52262/0 (socket says 172.21.15.45:52262) 2023-12-08T08:17:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 -- 172.21.15.45:0/555625572 learned_addr learned my addr 172.21.15.45:0/555625572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efef9d9b640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc0c1210 0x7efefc1ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefad9d640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efefc14e840 0x7efefc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 -- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc0c1210 msgr2=0x7efefc1ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc0c1210 0x7efefc1ed8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 -- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efefc14e840 msgr2=0x7efefc1532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efefc14e840 0x7efefc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.380+0000 7efefa59c640 1 -- 172.21.15.45:0/555625572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4009b30 con 0x7efefc0a9e80 2023-12-08T08:17:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efefa59c640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c7f0 tx=0x7efeec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec007820 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec007980 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec007cf0 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc1484d0 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.381+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc1ecf00 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.382+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc1544c0 con 0x7efefc0a9e80 2023-12-08T08:17:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.383+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efeec0113f0 con 0x7efefc0a9e80 2023-12-08T08:17:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.384+0000 7efeeaffd640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 0x7efedc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.384+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7efeec089770 con 0x7efefc0a9e80 2023-12-08T08:17:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.384+0000 7efef9d9b640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 0x7efedc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.385+0000 7efef9d9b640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 0x7efedc06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efef0006fd0 tx=0x7efef0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.388+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efeec054970 con 0x7efefc0a9e80 2023-12-08T08:17:25.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.576+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efefc0743e0 con 0x7efefc0a9e80 2023-12-08T08:17:25.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.578+0000 7efeeaffd640 1 -- 172.21.15.45:0/555625572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13293 (secure 0 0 0) 0x7efeec057f90 con 0x7efefc0a9e80 2023-12-08T08:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:24.126584+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6834/3655888531":"2023-12-09T08:17:20.837977+0000","172.21.15.114:6832/3655888531":"2023-12-09T08:17:20.837977+0000","172.21.15.45:6837/2643055":"2023-12-09T08:17:13.045069+0000","172.21.15.45:6836/2643055":"2023-12-09T08:17:13.045069+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:25.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 msgr2=0x7efedc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 0x7efedc06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efef0006fd0 tx=0x7efef0008040 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 msgr2=0x7efefc1ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c7f0 tx=0x7efeec00ccb0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 shutdown_connections 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efedc06ae70 0x7efedc06d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efefc0c1210 0x7efefc1ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efefc14e840 0x7efefc1532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 --2- 172.21.15.45:0/555625572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efefc0a9e80 0x7efefc1ed390 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 >> 172.21.15.45:0/555625572 conn(0x7efefc0c5780 msgr2=0x7efefc0c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 shutdown_connections 2023-12-08T08:17:25.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.581+0000 7efefb59e640 1 -- 172.21.15.45:0/555625572 wait complete. 2023-12-08T08:17:25.603 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:25.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:25.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.818+0000 7f6dc20d7640 1 Processor -- start 2023-12-08T08:17:25.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.819+0000 7f6dc20d7640 1 -- start start 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc20d7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6dbc157a20 0x7f6dbc154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc20d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6dbc06c230 0x7f6dbc154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc20d7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc151eb0 con 0x7f6dbc151ad0 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc20d7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c56a0 con 0x7f6dbc157a20 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc20d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c80d0 con 0x7f6dbc06c230 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.820+0000 7f6dc08d4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6dbc157a20 0x7f6dbc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6dbc157a20 0x7f6dbc154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52266/0 (socket says 172.21.15.45:52266) 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 -- 172.21.15.45:0/86391712 learned_addr learned my addr 172.21.15.45:0/86391712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc18d6640 1 --2- 172.21.15.45:0/86391712 >> v2:172.21.15.114:3300/0 conn(0x7f6dbc06c230 0x7f6dbc154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 -- 172.21.15.45:0/86391712 >> v2:172.21.15.114:3300/0 conn(0x7f6dbc06c230 msgr2=0x7f6dbc154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 --2- 172.21.15.45:0/86391712 >> v2:172.21.15.114:3300/0 conn(0x7f6dbc06c230 0x7f6dbc154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 -- 172.21.15.45:0/86391712 >> v1:172.21.15.114:6789/0 conn(0x7f6dbc151ad0 legacy=0x7f6dbc0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.821+0000 7f6dc08d4640 1 -- 172.21.15.45:0/86391712 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc154430 con 0x7f6dbc157a20 2023-12-08T08:17:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.822+0000 7f6dc08d4640 1 --2- 172.21.15.45:0/86391712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc157a20 0x7f6dbc154930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc06bca0 tx=0x7f6db002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdbd80b151c7349 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.823+0000 7f6dbbfff640 1 -- 172.21.15.45:0/86391712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0031870 con 0x7f6dbc157a20 2023-12-08T08:17:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.823+0000 7f6dbbfff640 1 -- 172.21.15.45:0/86391712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db00319d0 con 0x7f6dbc157a20 2023-12-08T08:17:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.823+0000 7f6dbbfff640 1 -- 172.21.15.45:0/86391712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0031d60 con 0x7f6dbc157a20 2023-12-08T08:17:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.823+0000 7f6dc20d7640 1 -- 172.21.15.45:0/86391712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc157a20 msgr2=0x7f6dbc154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.823+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/86391712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc157a20 0x7f6dbc154930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc06bca0 tx=0x7f6db002b910 comp rx=0 tx=0).stop 2023-12-08T08:17:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 -- 172.21.15.45:0/86391712 shutdown_connections 2023-12-08T08:17:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/86391712 >> v2:172.21.15.114:3300/0 conn(0x7f6dbc06c230 0x7f6dbc154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/86391712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc157a20 0x7f6dbc154930 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 -- 172.21.15.45:0/86391712 >> 172.21.15.45:0/86391712 conn(0x7f6dbc066610 msgr2=0x7f6dbc066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 -- 172.21.15.45:0/86391712 shutdown_connections 2023-12-08T08:17:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.824+0000 7f6dc20d7640 1 -- 172.21.15.45:0/86391712 wait complete. 2023-12-08T08:17:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.826+0000 7f6dc20d7640 1 Processor -- start 2023-12-08T08:17:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.826+0000 7f6dc20d7640 1 -- start start 2023-12-08T08:17:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 0x7f6dbc0c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dbc157a20 0x7f6dbc0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc1eab90 con 0x7f6dbc151ad0 2023-12-08T08:17:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc152da0 con 0x7f6dbc06c230 2023-12-08T08:17:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.827+0000 7f6dc20d7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c0480 con 0x7f6dbc157a20 2023-12-08T08:17:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52280/0 (socket says 172.21.15.45:52280) 2023-12-08T08:17:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 -- 172.21.15.45:0/3966635496 learned_addr learned my addr 172.21.15.45:0/3966635496 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc10d5640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 0x7f6dbc0c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 -- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dbc157a20 msgr2=0x7f6dbc0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dbc157a20 0x7f6dbc0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 -- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 msgr2=0x7f6dbc0c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 0x7f6dbc0c11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 -- 172.21.15.45:0/3966635496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00094d0 con 0x7f6dbc151ad0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc10d5640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 0x7f6dbc0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.828+0000 7f6dc08d4640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6db002b950 tx=0x7f6db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.829+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db003acb0 con 0x7f6dbc151ad0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.829+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db003ae10 con 0x7f6dbc151ad0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.829+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0044630 con 0x7f6dbc151ad0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.829+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc1eae30 con 0x7f6dbc151ad0 2023-12-08T08:17:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.829+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc0c0760 con 0x7f6dbc151ad0 2023-12-08T08:17:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.830+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc0aac40 con 0x7f6dbc151ad0 2023-12-08T08:17:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.831+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6db004d450 con 0x7f6dbc151ad0 2023-12-08T08:17:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.832+0000 7f6db9ffb640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 0x7f6da806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.832+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6db002d040 con 0x7f6dbc151ad0 2023-12-08T08:17:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.832+0000 7f6dc10d5640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 0x7f6da806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:25.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.833+0000 7f6dc10d5640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 0x7f6da806d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc157980 tx=0x7f6dac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:25.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:25.838+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dbc0aac40 con 0x7f6dbc151ad0 2023-12-08T08:17:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.031+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dbc0aac40 con 0x7f6dbc151ad0 2023-12-08T08:17:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.032+0000 7f6db9ffb640 1 -- 172.21.15.45:0/3966635496 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dbc0aac40 con 0x7f6dbc151ad0 2023-12-08T08:17:26.035 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:26.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 msgr2=0x7f6da806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 0x7f6da806d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc157980 tx=0x7f6dac009040 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 msgr2=0x7f6dbc0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6db002b950 tx=0x7f6db00046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 shutdown_connections 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6da806ae40 0x7f6da806d300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.034+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6dbc157a20 0x7f6dbc0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.035+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dbc151ad0 0x7f6dbc0c1700 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.035+0000 7f6dc20d7640 1 --2- 172.21.15.45:0/3966635496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6dbc06c230 0x7f6dbc0c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.035+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 >> 172.21.15.45:0/3966635496 conn(0x7f6dbc066610 msgr2=0x7f6dbc0c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.035+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 shutdown_connections 2023-12-08T08:17:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.035+0000 7f6dc20d7640 1 -- 172.21.15.45:0/3966635496 wait complete. 2023-12-08T08:17:26.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-08T08:17:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.278+0000 7fce01553640 1 Processor -- start 2023-12-08T08:17:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.278+0000 7fce01553640 1 -- start start 2023-12-08T08:17:26.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.279+0000 7fce01553640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcdfc14c4a0 0x7fcdfc156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.279+0000 7fce01553640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcdfc153880 0x7fcdfc153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.279+0000 7fce01553640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc14c880 con 0x7fcdfc0a4d10 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fce01553640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c4730 con 0x7fcdfc153880 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fce01553640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c56e0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdfa7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcdfc0a4d10 0x7fcdfc155980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51236/0 (socket says 172.21.15.45:51236) 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdfa7fc640 1 -- 172.21.15.45:0/3492719176 learned_addr learned my addr 172.21.15.45:0/3492719176 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdfb7fe640 1 --2- 172.21.15.45:0/3492719176 >> v2:172.21.15.45:3300/0 conn(0x7fcdfc153880 0x7fcdfc153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/3492719176 >> v2:172.21.15.114:3300/0 conn(0x7fcdfc14c4a0 0x7fcdfc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdf9ffb640 1 -- 172.21.15.45:0/3492719176 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743895371 0 0) 0x7fcdfc14c880 con 0x7fcdfc0a4d10 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.280+0000 7fcdf9ffb640 1 -- 172.21.15.45:0/3492719176 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8003520 con 0x7fcdfc0a4d10 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.281+0000 7fcdfb7fe640 1 -- 172.21.15.45:0/3492719176 >> v2:172.21.15.114:3300/0 conn(0x7fcdfc14c4a0 msgr2=0x7fcdfc156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.281+0000 7fcdfb7fe640 1 --2- 172.21.15.45:0/3492719176 >> v2:172.21.15.114:3300/0 conn(0x7fcdfc14c4a0 0x7fcdfc156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.281+0000 7fcdfb7fe640 1 -- 172.21.15.45:0/3492719176 >> v1:172.21.15.45:6789/0 conn(0x7fcdfc0a4d10 legacy=0x7fcdfc155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.281+0000 7fcdfb7fe640 1 -- 172.21.15.45:0/3492719176 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0c63b0 con 0x7fcdfc153880 2023-12-08T08:17:26.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.282+0000 7fcdfb7fe640 1 --2- 172.21.15.45:0/3492719176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc153880 0x7fcdfc153c90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0aae70 tx=0x7fcdf402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48eb70a80eb5d9f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:26.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.282+0000 7fcdf9ffb640 1 -- 172.21.15.45:0/3492719176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf402e070 con 0x7fcdfc153880 2023-12-08T08:17:26.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.282+0000 7fcdf9ffb640 1 -- 172.21.15.45:0/3492719176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40315a0 con 0x7fcdfc153880 2023-12-08T08:17:26.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.282+0000 7fcdf9ffb640 1 -- 172.21.15.45:0/3492719176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4031930 con 0x7fcdfc153880 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 -- 172.21.15.45:0/3492719176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc153880 msgr2=0x7fcdfc153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 --2- 172.21.15.45:0/3492719176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc153880 0x7fcdfc153c90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0aae70 tx=0x7fcdf402b840 comp rx=0 tx=0).stop 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 -- 172.21.15.45:0/3492719176 shutdown_connections 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 --2- 172.21.15.45:0/3492719176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc153880 0x7fcdfc153c90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 --2- 172.21.15.45:0/3492719176 >> v2:172.21.15.114:3300/0 conn(0x7fcdfc14c4a0 0x7fcdfc156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 -- 172.21.15.45:0/3492719176 >> 172.21.15.45:0/3492719176 conn(0x7fcdfc0661f0 msgr2=0x7fcdfc066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 -- 172.21.15.45:0/3492719176 shutdown_connections 2023-12-08T08:17:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.283+0000 7fce01553640 1 -- 172.21.15.45:0/3492719176 wait complete. 2023-12-08T08:17:26.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.285+0000 7fce01553640 1 Processor -- start 2023-12-08T08:17:26.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.285+0000 7fce01553640 1 -- start start 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 0x7fcdfc14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcdfc153880 0x7fcdfc070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c1fe0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c2b60 con 0x7fcdfc0a4d10 2023-12-08T08:17:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fce01553640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc14ba30 con 0x7fcdfc153880 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fcdfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fcdfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52294/0 (socket says 172.21.15.45:52294) 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.286+0000 7fcdfa7fc640 1 -- 172.21.15.45:0/4260975073 learned_addr learned my addr 172.21.15.45:0/4260975073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 0x7fcdfc14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 -- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcdfc153880 msgr2=0x7fcdfc070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfb7fe640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcdfc153880 0x7fcdfc070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcdfc153880 0x7fcdfc070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 -- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 msgr2=0x7fcdfc14b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 0x7fcdfc14b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 -- 172.21.15.45:0/4260975073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4009400 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 0x7fcdfc14b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdfa7fc640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c500 tx=0x7fcde400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4005ce0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4005e40 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40072f0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.287+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc0c2230 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.288+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc0c27f0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.289+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc146940 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.290+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcde4007450 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.291+0000 7fcdf37fe640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.291+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcde4088a10 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.291+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.292+0000 7fcdfaffd640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 0x7fcddc06d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcdec007330 tx=0x7fcdec00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:26.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.295+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcde4053cc0 con 0x7fcdfc14c4a0 2023-12-08T08:17:26.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:26.556+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fcdfc0673e0 con 0x7fcdfc14c4a0 2023-12-08T08:17:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.143+0000 7fcdf37fe640 1 -- 172.21.15.45:0/4260975073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v155) v1 ==== 187+0+0 (secure 0 0 0) 0x7fcde4017020 con 0x7fcdfc14c4a0 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 msgr2=0x7fcddc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 0x7fcddc06d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcdec007330 tx=0x7fcdec00b040 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 msgr2=0x7fcdfc06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c500 tx=0x7fcde400c9c0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 shutdown_connections 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcddc06ae70 0x7fcddc06d330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcdfc153880 0x7fcdfc070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdfc14c4a0 0x7fcdfc06fae0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 --2- 172.21.15.45:0/4260975073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdfc0a4d10 0x7fcdfc14b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 >> 172.21.15.45:0/4260975073 conn(0x7fcdfc0661f0 msgr2=0x7fcdfc0bedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:27.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 shutdown_connections 2023-12-08T08:17:27.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.147+0000 7fce01553640 1 -- 172.21.15.45:0/4260975073 wait complete. 2023-12-08T08:17:27.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:17:27.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.402+0000 7efc13597640 1 Processor -- start 2023-12-08T08:17:27.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.402+0000 7efc13597640 1 -- start start 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc13597640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efc0c0c38a0 0x7efc0c0a9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc13597640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c0abbb0 con 0x7efc0c0c0690 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc13597640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c14fe30 con 0x7efc0c14fa50 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc13597640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c1526a0 con 0x7efc0c0c38a0 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc11b34640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc0c0c0690 0x7efc0c152ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51242/0 (socket says 172.21.15.45:51242) 2023-12-08T08:17:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.404+0000 7efc11b34640 1 -- 172.21.15.45:0/231332863 learned_addr learned my addr 172.21.15.45:0/231332863 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc10b32640 1 --2- 172.21.15.45:0/231332863 >> v2:172.21.15.114:3300/0 conn(0x7efc0c0c38a0 0x7efc0c0a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816075858 0 0) 0x7efc0c0abbb0 con 0x7efc0c0c0690 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf8003520 con 0x7efc0c0c0690 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765761241 0 0) 0x7efbf8003520 con 0x7efc0c0c0690 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 >> v2:172.21.15.114:3300/0 conn(0x7efc0c0c38a0 msgr2=0x7efc0c0a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 --2- 172.21.15.45:0/231332863 >> v2:172.21.15.114:3300/0 conn(0x7efc0c0c38a0 0x7efc0c0a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 >> v1:172.21.15.114:6789/0 conn(0x7efc0c14fa50 legacy=0x7efc0c0c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0a9af0 con 0x7efc0c0c0690 2023-12-08T08:17:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7efc040019f0 con 0x7efc0c0c0690 2023-12-08T08:17:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 >> v1:172.21.15.45:6789/0 conn(0x7efc0c0c0690 legacy=0x7efc0c152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8003970 0x7efbf8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf80047c0 0x7efbf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.405+0000 7efc03fff640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efbf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1526a0 con 0x7efbf8005180 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf800c0d0 con 0x7efbf8003970 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf800c290 con 0x7efbf80047c0 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efbf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11333640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8003970 0x7efbf8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc10b32640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf80047c0 0x7efbf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 -- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf80047c0 msgr2=0x7efbf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efbf80047c0 0x7efbf8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 -- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8003970 msgr2=0x7efbf8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbf8003970 0x7efbf8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.406+0000 7efc11b34640 1 -- 172.21.15.45:0/231332863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8003520 con 0x7efbf8005180 2023-12-08T08:17:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.407+0000 7efc11b34640 1 -- 172.21.15.45:0/231332863 reap_dead start 2023-12-08T08:17:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.407+0000 7efc11b34640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efbf800b980 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a810 tx=0x7efbf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c52323f7f8e085 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04034630 con 0x7efbf8005180 2023-12-08T08:17:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0402f070 con 0x7efbf8005180 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc03fff640 1 -- 172.21.15.45:0/231332863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc040349d0 con 0x7efbf8005180 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc13597640 1 -- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 msgr2=0x7efbf800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc13597640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efbf800b980 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a810 tx=0x7efbf80057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc13597640 1 -- 172.21.15.45:0/231332863 shutdown_connections 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc13597640 1 --2- 172.21.15.45:0/231332863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efbf800b980 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.408+0000 7efc13597640 1 -- 172.21.15.45:0/231332863 >> 172.21.15.45:0/231332863 conn(0x7efc0c0a7750 msgr2=0x7efc0c0a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.409+0000 7efc13597640 1 -- 172.21.15.45:0/231332863 shutdown_connections 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.409+0000 7efc13597640 1 -- 172.21.15.45:0/231332863 wait complete. 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.411+0000 7efc13597640 1 Processor -- start 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.411+0000 7efc13597640 1 -- start start 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc0c1ea310 0x7efc0c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c1ed960 0x7efc0c14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1ea880 con 0x7efbf8005180 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0726a0 con 0x7efc0c1ed960 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc13597640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c071660 con 0x7efc0c1ea310 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc11333640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc11333640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52312/0 (socket says 172.21.15.45:52312) 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.412+0000 7efc11333640 1 -- 172.21.15.45:0/4230980535 learned_addr learned my addr 172.21.15.45:0/4230980535 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 -- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc0c1ea310 msgr2=0x7efc0c1ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc0c1ea310 0x7efc0c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 -- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c1ed960 msgr2=0x7efc0c14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c1ed960 0x7efc0c14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 -- 172.21.15.45:0/4230980535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c1ede10 con 0x7efbf8005180 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc11333640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e5a0 tx=0x7efc0800ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080052e0 con 0x7efbf8005180 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08005440 con 0x7efbf8005180 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c1ecf90 con 0x7efbf8005180 2023-12-08T08:17:27.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.413+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08003810 con 0x7efbf8005180 2023-12-08T08:17:27.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.414+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c155780 con 0x7efbf8005180 2023-12-08T08:17:27.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.415+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c067900 con 0x7efbf8005180 2023-12-08T08:17:27.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.416+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc08003970 con 0x7efbf8005180 2023-12-08T08:17:27.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.416+0000 7efc01ffb640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 0x7efbf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:27.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.417+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7efc08089070 con 0x7efbf8005180 2023-12-08T08:17:27.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.417+0000 7efc10b32640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 0x7efbf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.418+0000 7efc10b32640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 0x7efbf006d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0a4f90 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:27.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.421+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc080bbe90 con 0x7efbf8005180 2023-12-08T08:17:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.615+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efc0c1eddb0 con 0x7efbf8005180 2023-12-08T08:17:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.620+0000 7efc01ffb640 1 -- 172.21.15.45:0/4230980535 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7efc08054270 con 0x7efbf8005180 2023-12-08T08:17:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 msgr2=0x7efbf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 0x7efbf006d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0a4f90 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2023-12-08T08:17:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 msgr2=0x7efc0c0a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e5a0 tx=0x7efc0800ea60 comp rx=0 tx=0).stop 2023-12-08T08:17:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 shutdown_connections 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efbf006ae70 0x7efbf006d330 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc0c1ea310 0x7efc0c1ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c1ed960 0x7efc0c14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 --2- 172.21.15.45:0/4230980535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efbf8005180 0x7efc0c0a6900 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.623+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 >> 172.21.15.45:0/4230980535 conn(0x7efc0c0a7750 msgr2=0x7efc0c0c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.624+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 shutdown_connections 2023-12-08T08:17:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:27.624+0000 7efc13597640 1 -- 172.21.15.45:0/4230980535 wait complete. 2023-12-08T08:17:27.647 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:17:27.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:17:27.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:17:27.897 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:17:27.897 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:17:27.897 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:27.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:17:27.962 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:17:27.962 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:28.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:17:28.021 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:17:28.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.257+0000 7fdf5e632640 1 Processor -- start 2023-12-08T08:17:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.257+0000 7fdf5e632640 1 -- start start 2023-12-08T08:17:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 0x7fdf580c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580c1dc0 0x7fdf5814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf581521b0 0x7fdf58155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf58155850 con 0x7fdf581521b0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580c0890 con 0x7fdf580a7910 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5e632640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580c0b70 con 0x7fdf580c1dc0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5de31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf581521b0 0x7fdf58155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5de31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf581521b0 0x7fdf58155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52326/0 (socket says 172.21.15.45:52326) 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.259+0000 7fdf5de31640 1 -- 172.21.15.45:0/720967226 learned_addr learned my addr 172.21.15.45:0/720967226 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5ce2f640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580c1dc0 0x7fdf5814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5d630640 1 --2- 172.21.15.45:0/720967226 >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 0x7fdf580c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5de31640 1 -- 172.21.15.45:0/720967226 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580c1dc0 msgr2=0x7fdf5814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5de31640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580c1dc0 0x7fdf5814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5de31640 1 -- 172.21.15.45:0/720967226 >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 msgr2=0x7fdf580c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5de31640 1 --2- 172.21.15.45:0/720967226 >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 0x7fdf580c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5de31640 1 -- 172.21.15.45:0/720967226 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580c0e50 con 0x7fdf581521b0 2023-12-08T08:17:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.260+0000 7fdf5d630640 1 --2- 172.21.15.45:0/720967226 >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 0x7fdf580c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.261+0000 7fdf5de31640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf581521b0 0x7fdf58155ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806ac30 tx=0x7fdf5002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a130a5ba7e73e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.261+0000 7fdf4ffff640 1 -- 172.21.15.45:0/720967226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5002c9e0 con 0x7fdf581521b0 2023-12-08T08:17:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.261+0000 7fdf4ffff640 1 -- 172.21.15.45:0/720967226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5002cb40 con 0x7fdf581521b0 2023-12-08T08:17:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.261+0000 7fdf4ffff640 1 -- 172.21.15.45:0/720967226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500343f0 con 0x7fdf581521b0 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 -- 172.21.15.45:0/720967226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf581521b0 msgr2=0x7fdf58155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf581521b0 0x7fdf58155ce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdf5806ac30 tx=0x7fdf5002be40 comp rx=0 tx=0).stop 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 -- 172.21.15.45:0/720967226 shutdown_connections 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf581521b0 0x7fdf58155ce0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 --2- 172.21.15.45:0/720967226 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580c1dc0 0x7fdf5814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 --2- 172.21.15.45:0/720967226 >> v2:172.21.15.114:3300/0 conn(0x7fdf580a7910 0x7fdf580c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 -- 172.21.15.45:0/720967226 >> 172.21.15.45:0/720967226 conn(0x7fdf580c5780 msgr2=0x7fdf580c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 -- 172.21.15.45:0/720967226 shutdown_connections 2023-12-08T08:17:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.262+0000 7fdf5e632640 1 -- 172.21.15.45:0/720967226 wait complete. 2023-12-08T08:17:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.264+0000 7fdf5e632640 1 Processor -- start 2023-12-08T08:17:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.264+0000 7fdf5e632640 1 -- start start 2023-12-08T08:17:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580a7910 0x7fdf580c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581521b0 0x7fdf5814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581e0140 con 0x7fdf580c1dc0 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581df560 con 0x7fdf581521b0 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.265+0000 7fdf5e632640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581dfe60 con 0x7fdf580a7910 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52334/0 (socket says 172.21.15.45:52334) 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 -- 172.21.15.45:0/2825578948 learned_addr learned my addr 172.21.15.45:0/2825578948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5de31640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581521b0 0x7fdf5814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5d630640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580a7910 0x7fdf580c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 -- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580a7910 msgr2=0x7fdf580c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580a7910 0x7fdf580c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 -- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581521b0 msgr2=0x7fdf5814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581521b0 0x7fdf5814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.266+0000 7fdf5ce2f640 1 -- 172.21.15.45:0/2825578948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50009b30 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf5ce2f640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800d7d0 tx=0x7fdf4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800b6c0 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4800b840 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800bbf0 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf581df280 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.267+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf58151df0 con 0x7fdf580c1dc0 2023-12-08T08:17:28.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.268+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf580743e0 con 0x7fdf580c1dc0 2023-12-08T08:17:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.269+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf4800bd50 con 0x7fdf580c1dc0 2023-12-08T08:17:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.271+0000 7fdf4dffb640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.271+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdf48089a50 con 0x7fdf580c1dc0 2023-12-08T08:17:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.271+0000 7fdf5d630640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.272+0000 7fdf5d630640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdf54006b10 tx=0x7fdf54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.275+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf48054c50 con 0x7fdf580c1dc0 2023-12-08T08:17:28.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.507+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf580bf5e0 con 0x7fdf580c1dc0 2023-12-08T08:17:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.508+0000 7fdf4dffb640 1 -- 172.21.15.45:0/2825578948 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fdf48058270 con 0x7fdf580c1dc0 2023-12-08T08:17:28.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:28.511 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/533917005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":533917005},{"type":"v1","addr":"172.21.15.45:6835","nonce":533917005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/980613308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":980613308},{"type":"v1","addr":"172.21.15.114:6835","nonce":980613308}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1523023588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1523023588},{"type":"v1","addr":"172.21.15.114:6834","nonce":1523023588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2632584195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2632584195},{"type":"v1","addr":"172.21.15.45:6837","nonce":2632584195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-12-08T08:17:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 26 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 msgr2=0x7fdf3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdf54006b10 tx=0x7fdf54008040 comp rx=0 tx=0).stop 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 msgr2=0x7fdf581518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800d7d0 tx=0x7fdf4800dc90 comp rx=0 tx=0).stop 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 shutdown_connections 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581521b0 0x7fdf5814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf580c1dc0 0x7fdf581518b0 secure :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800d7d0 tx=0x7fdf4800dc90 comp rx=0 tx=0).stop 2023-12-08T08:17:28.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 --2- 172.21.15.45:0/2825578948 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf580a7910 0x7fdf580c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:28.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 >> 172.21.15.45:0/2825578948 conn(0x7fdf580c5780 msgr2=0x7fdf580c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:28.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 shutdown_connections 2023-12-08T08:17:28.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:28.511+0000 7fdf5e632640 1 -- 172.21.15.45:0/2825578948 wait complete. 2023-12-08T08:17:28.533 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:17:28.533 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:17:28.533 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:17:28.533 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:17:28.534 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:17:28.534 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:17:28.534 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:17:28.534 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:17:28.534 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:17:28.534 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:17:28.534 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:17:28.535 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:17:28.535 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:17:28.535 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:17:28.535 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:17:28.535 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:17:28.553 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:17:28.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:17:28.554 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:17:28.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:17:28.555 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:17:28.556 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:17:28.564 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:28.603 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:17:28.603 DEBUG:teuthology.parallel:result is None 2023-12-08T08:17:28.604 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:17:28.604 DEBUG:teuthology.parallel:result is None 2023-12-08T08:17:28.613 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:17:28.613 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:28.614 DEBUG:teuthology.parallel:result is None 2023-12-08T08:17:28.768 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:17:28.771 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:17:28.771 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:17:32.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-08T08:17:34.555 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:17:34.556 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:17:34.565 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:17:34.565 DEBUG:teuthology.parallel:result is None 2023-12-08T08:17:34.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:17:34.749 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-12-08T08:17:34.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.800+0000 7f957eb73640 1 Processor -- start 2023-12-08T08:17:34.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.800+0000 7f957eb73640 1 -- start start 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.801+0000 7f957eb73640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95780c4c70 0x7f95780c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.801+0000 7f957eb73640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95780c2f10 con 0x7f95780c0fb0 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.801+0000 7f957eb73640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9578150970 con 0x7f95780c3830 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.801+0000 7f957eb73640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95780c1ba0 con 0x7f95780c4c70 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f9577fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95780c0fb0 0x7f957806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51268/0 (socket says 172.21.15.45:51268) 2023-12-08T08:17:34.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f9577fff640 1 -- 172.21.15.45:0/4233532480 learned_addr learned my addr 172.21.15.45:0/4233532480 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f957c90f640 1 --2- 172.21.15.45:0/4233532480 >> v2:172.21.15.114:3300/0 conn(0x7f95780c4c70 0x7f95780c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f95777fe640 1 -- 172.21.15.45:0/4233532480 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389454343 0 0) 0x7f95780c2f10 con 0x7f95780c0fb0 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f95777fe640 1 -- 172.21.15.45:0/4233532480 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9564003520 con 0x7f95780c0fb0 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f957c90f640 1 -- 172.21.15.45:0/4233532480 >> v1:172.21.15.114:6789/0 conn(0x7f95780c3830 legacy=0x7f957815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f957c90f640 1 -- 172.21.15.45:0/4233532480 >> v1:172.21.15.45:6789/0 conn(0x7f95780c0fb0 legacy=0x7f957806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.802+0000 7f957c90f640 1 -- 172.21.15.45:0/4233532480 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578150c30 con 0x7f95780c4c70 2023-12-08T08:17:34.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.804+0000 7f957c90f640 1 --2- 172.21.15.45:0/4233532480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780c15c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb103c45418f506 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.804+0000 7f95777fe640 1 -- 172.21.15.45:0/4233532480 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956802cc60 con 0x7f95780c4c70 2023-12-08T08:17:34.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.804+0000 7f95777fe640 1 -- 172.21.15.45:0/4233532480 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956802cdc0 con 0x7f95780c4c70 2023-12-08T08:17:34.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.804+0000 7f95777fe640 1 -- 172.21.15.45:0/4233532480 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568034640 con 0x7f95780c4c70 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 -- 172.21.15.45:0/4233532480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 msgr2=0x7f95780c15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 --2- 172.21.15.45:0/4233532480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780c15c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802beb0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 -- 172.21.15.45:0/4233532480 shutdown_connections 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 --2- 172.21.15.45:0/4233532480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780c15c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 -- 172.21.15.45:0/4233532480 >> 172.21.15.45:0/4233532480 conn(0x7f9578066db0 msgr2=0x7f95780c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 -- 172.21.15.45:0/4233532480 shutdown_connections 2023-12-08T08:17:34.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.805+0000 7f957eb73640 1 -- 172.21.15.45:0/4233532480 wait complete. 2023-12-08T08:17:34.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.807+0000 7f957eb73640 1 Processor -- start 2023-12-08T08:17:34.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.807+0000 7f957eb73640 1 -- start start 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.807+0000 7f957eb73640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95780c0fb0 0x7f95780bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957eb73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957eb73640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957eb73640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95781480c0 con 0x7f95780c3830 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957eb73640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9578147940 con 0x7f95780c4c70 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957eb73640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9578070290 con 0x7f95780c0fb0 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52362/0 (socket says 172.21.15.45:52362) 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 -- 172.21.15.45:0/3330997917 learned_addr learned my addr 172.21.15.45:0/3330997917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957c90f640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95780c0fb0 0x7f95780bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f957d110640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 -- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95780c0fb0 msgr2=0x7f95780bbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95780c0fb0 0x7f95780bbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 -- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 msgr2=0x7f95780a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.808+0000 7f9577fff640 1 -- 172.21.15.45:0/3330997917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009a70 con 0x7f95780c3830 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f9577fff640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f956000c410 tx=0x7f956000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560005ce0 con 0x7f95780c3830 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560005e40 con 0x7f95780c3830 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600072f0 con 0x7f95780c3830 2023-12-08T08:17:34.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9578147de0 con 0x7f95780c3830 2023-12-08T08:17:34.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.809+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957806ff20 con 0x7f95780c3830 2023-12-08T08:17:34.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.810+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957806faa0 con 0x7f95780c3830 2023-12-08T08:17:34.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.811+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9560007510 con 0x7f95780c3830 2023-12-08T08:17:34.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.812+0000 7f95757fa640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.812+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9560088a90 con 0x7f95780c3830 2023-12-08T08:17:34.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.812+0000 7f957c90f640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.813+0000 7f957c90f640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 0x7f955806d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9568036000 tx=0x7f9568030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:34.817+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f957806faa0 con 0x7f95780c3830 2023-12-08T08:17:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:35.027+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f957806faa0 con 0x7f95780c3830 2023-12-08T08:17:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.690+0000 7f95757fa640 1 -- 172.21.15.45:0/3330997917 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f957806faa0 con 0x7f95780c3830 2023-12-08T08:17:36.693 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 msgr2=0x7f955806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 0x7f955806d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9568036000 tx=0x7f9568030000 comp rx=0 tx=0).stop 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 msgr2=0x7f95780babc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f956000c410 tx=0x7f956000c8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 shutdown_connections 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f955806ae40 0x7f955806d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95780c4c70 0x7f95780a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780c3830 0x7f95780babc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 --2- 172.21.15.45:0/3330997917 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95780c0fb0 0x7f95780bbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 >> 172.21.15.45:0/3330997917 conn(0x7f9578066db0 msgr2=0x7f9578152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 shutdown_connections 2023-12-08T08:17:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.695+0000 7f957eb73640 1 -- 172.21.15.45:0/3330997917 wait complete. 2023-12-08T08:17:36.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:17:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.940+0000 7fc40fdd7640 1 Processor -- start 2023-12-08T08:17:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.940+0000 7fc40fdd7640 1 -- start start 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.941+0000 7fc40fdd7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc40814c4a0 0x7fc408156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.941+0000 7fc40fdd7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4080a4d10 0x7fc408155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.941+0000 7fc40fdd7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40814c880 con 0x7fc408155ec0 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40fdd7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080c4730 con 0x7fc4080a4d10 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40fdd7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080c56e0 con 0x7fc40814c4a0 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4080a4d10 0x7fc408155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4080a4d10 0x7fc408155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60902/0 (socket says 172.21.15.45:60902) 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 -- 172.21.15.45:0/2356483908 learned_addr learned my addr 172.21.15.45:0/2356483908 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40db73640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc40814c4a0 0x7fc408156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 -- 172.21.15.45:0/2356483908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc40814c4a0 msgr2=0x7fc408156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc40814c4a0 0x7fc408156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 -- 172.21.15.45:0/2356483908 >> v1:172.21.15.114:6789/0 conn(0x7fc408155ec0 legacy=0x7fc408153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.942+0000 7fc40d372640 1 -- 172.21.15.45:0/2356483908 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080c63b0 con 0x7fc4080a4d10 2023-12-08T08:17:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.944+0000 7fc40d372640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4080a4d10 0x7fc408155980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098a0 tx=0x7fc3fc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d2b4a32f5a839 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.944+0000 7fc40cb71640 1 -- 172.21.15.45:0/2356483908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0317c0 con 0x7fc4080a4d10 2023-12-08T08:17:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.944+0000 7fc40cb71640 1 -- 172.21.15.45:0/2356483908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc031920 con 0x7fc4080a4d10 2023-12-08T08:17:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.944+0000 7fc40cb71640 1 -- 172.21.15.45:0/2356483908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc031cb0 con 0x7fc4080a4d10 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 -- 172.21.15.45:0/2356483908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4080a4d10 msgr2=0x7fc408155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4080a4d10 0x7fc408155980 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098a0 tx=0x7fc3fc02b860 comp rx=0 tx=0).stop 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 -- 172.21.15.45:0/2356483908 shutdown_connections 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4080a4d10 0x7fc408155980 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/2356483908 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc40814c4a0 0x7fc408156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 -- 172.21.15.45:0/2356483908 >> 172.21.15.45:0/2356483908 conn(0x7fc4080661f0 msgr2=0x7fc408066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:36.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 -- 172.21.15.45:0/2356483908 shutdown_connections 2023-12-08T08:17:36.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.945+0000 7fc40fdd7640 1 -- 172.21.15.45:0/2356483908 wait complete. 2023-12-08T08:17:36.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.947+0000 7fc40fdd7640 1 Processor -- start 2023-12-08T08:17:36.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.947+0000 7fc40fdd7640 1 -- start start 2023-12-08T08:17:36.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080a4d10 0x7fc4081edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40814c4a0 0x7fc408071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4081ee420 con 0x7fc408155ec0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080715b0 con 0x7fc40814c4a0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.948+0000 7fc40fdd7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc408143bf0 con 0x7fc4080a4d10 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60906/0 (socket says 172.21.15.45:60906) 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 -- 172.21.15.45:0/4237579075 learned_addr learned my addr 172.21.15.45:0/4237579075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40db73640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080a4d10 0x7fc4081edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40d372640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40814c4a0 0x7fc408071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 -- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080a4d10 msgr2=0x7fc4081edee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080a4d10 0x7fc4081edee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 -- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40814c4a0 msgr2=0x7fc408071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40814c4a0 0x7fc408071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 -- 172.21.15.45:0/4237579075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0094d0 con 0x7fc408155ec0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.949+0000 7fc40e374640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c780 tx=0x7fc40000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:36.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.950+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400004b60 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.950+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40000ce90 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.950+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40000a850 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.950+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc408143ed0 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.950+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4081ea070 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.951+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408074600 con 0x7fc408155ec0 2023-12-08T08:17:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.952+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc40000a9b0 con 0x7fc408155ec0 2023-12-08T08:17:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.953+0000 7fc3fa7fc640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 0x7fc3ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.954+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4000895d0 con 0x7fc408155ec0 2023-12-08T08:17:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.954+0000 7fc40db73640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 0x7fc3ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.954+0000 7fc40db73640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 0x7fc3ec06d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:36.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:36.958+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc400054880 con 0x7fc408155ec0 2023-12-08T08:17:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.226+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc4080c0080 con 0x7fc408155ec0 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.227+0000 7fc3fa7fc640 1 -- 172.21.15.45:0/4237579075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fc400057ea0 con 0x7fc408155ec0 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJla7GwKRAABCs1sRB3k9+U2d+Nv+6Qsg==", 2023-12-08T08:17:37.230 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlUl35EBAAKLS/fMIt6G9vqde16uAsoA==", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:17:37.231 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlkimAOhAARjxtAqp4aGMJAk9pQEuEcg==", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-08T08:17:37.232 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlhY+rIRAAOcH5Vdj4eehrPUQuDuwLRw==", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBN0HJlen9oARAAcqoG1WYSzpUAuVNvDa1mKg==", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.233 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBQ0HJlEsRmGxAAfml/gGZ8vfNzJsUlDsTbyg==", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBU0HJl+ct7CBAAEuBM0fSR04+8zaRtqq8k/g==", 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.234 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBX0HJlVnwVExAAFxt0oSVa42WXjwm+S9Ts6Q==", 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.235 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBe0HJlqX4IGBAAoSzK53JRumPJ10WGo1EjYA==", 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.236 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBh0HJlA6GSMRAAqOCPmn8QGJzAco8jgWd3zQ==", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBl0HJlXY8/ABAAXD0SJ5TMILJDA/sXMzLSRA==", 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.237 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBo0HJlBOSzCRAA8e0cUSeNL2bCJyy587oT2Q==", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.238 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg==", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA==", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-08T08:17:37.239 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBI0HJlPJ/uHBAAJP4PeCgGIkF9JZ0ruG0wGQ==", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.testuser", 2023-12-08T08:17:37.240 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD50HJl2nDcGBAAnsMeEUn72Iftcxp4qNJMNg==", 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow rw fsname=cephfs", 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r fsname=cephfs", 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJl/rIKHRAAaJjZUtDXcmEgavGZvjHxow==", 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.241 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:37.242 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlKZgvERAAL98Wtoye5tepo7AlBftDNg==", 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-08T08:17:37.244 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 msgr2=0x7fc3ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 0x7fc3ec06d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc404006fd0 tx=0x7fc404008040 comp rx=0 tx=0).stop 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 msgr2=0x7fc40814a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c780 tx=0x7fc40000cc40 comp rx=0 tx=0).stop 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 shutdown_connections 2023-12-08T08:17:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc3ec06ae40 0x7fc3ec06d300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc408155ec0 0x7fc40814a760 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40814c4a0 0x7fc408071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 --2- 172.21.15.45:0/4237579075 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc4080a4d10 0x7fc4081edee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 >> 172.21.15.45:0/4237579075 conn(0x7fc4080661f0 msgr2=0x7fc408156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.230+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 shutdown_connections 2023-12-08T08:17:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.231+0000 7fc40fdd7640 1 -- 172.21.15.45:0/4237579075 wait complete. 2023-12-08T08:17:37.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-08T08:17:37.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.478+0000 7f0de9cbb640 1 Processor -- start 2023-12-08T08:17:37.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.478+0000 7f0de9cbb640 1 -- start start 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de9cbb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0de4155d40 0x7f0de40c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de9cbb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0de40c5d20 0x7f0de41630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de9cbb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40aa8e0 con 0x7f0de4159500 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de9cbb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de40a9780 con 0x7f0de4155d40 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de9cbb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de4158760 con 0x7f0de40c5d20 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de8cb9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0de4155d40 0x7f0de40c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de8cb9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0de4155d40 0x7f0de40c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60922/0 (socket says 172.21.15.45:60922) 2023-12-08T08:17:37.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de8cb9640 1 -- 172.21.15.45:0/2735306648 learned_addr learned my addr 172.21.15.45:0/2735306648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:37.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.480+0000 7f0de8cb9640 1 -- 172.21.15.45:0/2735306648 >> v2:172.21.15.114:3300/0 conn(0x7f0de40c5d20 msgr2=0x7f0de41630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:37.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.481+0000 7f0de8cb9640 1 --2- 172.21.15.45:0/2735306648 >> v2:172.21.15.114:3300/0 conn(0x7f0de40c5d20 0x7f0de41630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.481+0000 7f0de8cb9640 1 -- 172.21.15.45:0/2735306648 >> v1:172.21.15.114:6789/0 conn(0x7f0de4159500 legacy=0x7f0de40c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:37.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.481+0000 7f0de8cb9640 1 -- 172.21.15.45:0/2735306648 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40c5010 con 0x7f0de4155d40 2023-12-08T08:17:37.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.482+0000 7f0de8cb9640 1 --2- 172.21.15.45:0/2735306648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de4155d40 0x7f0de40c57e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0de40c0650 tx=0x7f0dd802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3be31fc28922296 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:37.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.482+0000 7f0de37fe640 1 -- 172.21.15.45:0/2735306648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80317e0 con 0x7f0de4155d40 2023-12-08T08:17:37.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.482+0000 7f0de37fe640 1 -- 172.21.15.45:0/2735306648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd8031940 con 0x7f0de4155d40 2023-12-08T08:17:37.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.482+0000 7f0de37fe640 1 -- 172.21.15.45:0/2735306648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031cd0 con 0x7f0de4155d40 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 -- 172.21.15.45:0/2735306648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de4155d40 msgr2=0x7f0de40c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/2735306648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de4155d40 0x7f0de40c57e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0de40c0650 tx=0x7f0dd802b880 comp rx=0 tx=0).stop 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 -- 172.21.15.45:0/2735306648 shutdown_connections 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/2735306648 >> v2:172.21.15.114:3300/0 conn(0x7f0de40c5d20 0x7f0de41630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/2735306648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de4155d40 0x7f0de40c57e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 -- 172.21.15.45:0/2735306648 >> 172.21.15.45:0/2735306648 conn(0x7f0de40a7600 msgr2=0x7f0de40a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:37.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 -- 172.21.15.45:0/2735306648 shutdown_connections 2023-12-08T08:17:37.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.483+0000 7f0de9cbb640 1 -- 172.21.15.45:0/2735306648 wait complete. 2023-12-08T08:17:37.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.485+0000 7f0de9cbb640 1 Processor -- start 2023-12-08T08:17:37.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.485+0000 7f0de9cbb640 1 -- start start 2023-12-08T08:17:37.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 0x7f0de4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 0x7f0de415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40a24e0 con 0x7f0de40c5d20 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41ef040 con 0x7f0de4159500 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de9cbb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41ee4c0 con 0x7f0de4155d40 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de8cb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de8cb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60928/0 (socket says 172.21.15.45:60928) 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.486+0000 7f0de8cb9640 1 -- 172.21.15.45:0/1187656594 learned_addr learned my addr 172.21.15.45:0/1187656594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de94ba640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 0x7f0de415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de3fff640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 0x7f0de4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 -- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 msgr2=0x7f0de4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 0x7f0de4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 -- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 msgr2=0x7f0de415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 0x7f0de415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 -- 172.21.15.45:0/1187656594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80094d0 con 0x7f0de40c5d20 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de94ba640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 0x7f0de415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:37.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de3fff640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 0x7f0de4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:37.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de8cb9640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0dd802b8c0 tx=0x7f0dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:37.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8032940 con 0x7f0de40c5d20 2023-12-08T08:17:37.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd8032aa0 con 0x7f0de40c5d20 2023-12-08T08:17:37.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.487+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8032e50 con 0x7f0de40c5d20 2023-12-08T08:17:37.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.488+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de41ee7a0 con 0x7f0de40c5d20 2023-12-08T08:17:37.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.488+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de41eed60 con 0x7f0de40c5d20 2023-12-08T08:17:37.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.489+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de4159be0 con 0x7f0de40c5d20 2023-12-08T08:17:37.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.490+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dd804e450 con 0x7f0de40c5d20 2023-12-08T08:17:37.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.491+0000 7f0de17fa640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 0x7f0dc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:37.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.491+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0dd80ab670 con 0x7f0de40c5d20 2023-12-08T08:17:37.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.491+0000 7f0de3fff640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 0x7f0dc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:37.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.492+0000 7f0de3fff640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 0x7f0dc806d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0de40a9a80 tx=0x7f0dd0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:37.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.495+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0de4159be0 con 0x7f0de40c5d20 2023-12-08T08:17:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.761+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f0de4159be0 con 0x7f0de40c5d20 2023-12-08T08:17:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.766+0000 7f0de17fa640 1 -- 172.21.15.45:0/1187656594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7f0de4159be0 con 0x7f0de40c5d20 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 msgr2=0x7f0dc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 0x7f0dc806d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0de40a9a80 tx=0x7f0dd0008040 comp rx=0 tx=0).stop 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 msgr2=0x7f0de40a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0dd802b8c0 tx=0x7f0dd80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 shutdown_connections 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0dc806ae40 0x7f0dc806d300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de4155d40 0x7f0de4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de4159500 0x7f0de415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 --2- 172.21.15.45:0/1187656594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de40c5d20 0x7f0de40a49f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 >> 172.21.15.45:0/1187656594 conn(0x7f0de40a7600 msgr2=0x7f0de40bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 shutdown_connections 2023-12-08T08:17:37.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:37.769+0000 7f0de9cbb640 1 -- 172.21.15.45:0/1187656594 wait complete. 2023-12-08T08:17:37.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:38.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.015+0000 7f30e694c640 1 Processor -- start 2023-12-08T08:17:38.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.016+0000 7f30e694c640 1 -- start start 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30e694c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30e00a6140 0x7f30e00a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30e694c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e00abb40 0x7f30e01547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30e694c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e014ed00 con 0x7f30e0151ae0 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30e694c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00a6520 con 0x7f30e00a6140 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30e694c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0155030 con 0x7f30e00abb40 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.017+0000 7f30dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30e00a6140 0x7f30e00a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30e00a6140 0x7f30e00a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60936/0 (socket says 172.21.15.45:60936) 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 -- 172.21.15.45:0/79301830 learned_addr learned my addr 172.21.15.45:0/79301830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30df7fe640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e00abb40 0x7f30e01547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 -- 172.21.15.45:0/79301830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e00abb40 msgr2=0x7f30e01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e00abb40 0x7f30e01547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 -- 172.21.15.45:0/79301830 >> v1:172.21.15.114:6789/0 conn(0x7f30e0151ae0 legacy=0x7f30e0070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.018+0000 7f30dffff640 1 -- 172.21.15.45:0/79301830 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0155310 con 0x7f30e00a6140 2023-12-08T08:17:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.019+0000 7f30dffff640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e00a9a80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac85e27de19cb094 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30deffd640 1 -- 172.21.15.45:0/79301830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002c950 con 0x7f30e00a6140 2023-12-08T08:17:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30deffd640 1 -- 172.21.15.45:0/79301830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d002cab0 con 0x7f30e00a6140 2023-12-08T08:17:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30deffd640 1 -- 172.21.15.45:0/79301830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002ce40 con 0x7f30e00a6140 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 -- 172.21.15.45:0/79301830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 msgr2=0x7f30e00a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e00a9a80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d002bdb0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 -- 172.21.15.45:0/79301830 shutdown_connections 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e00abb40 0x7f30e01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 --2- 172.21.15.45:0/79301830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e00a9a80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.020+0000 7f30e694c640 1 -- 172.21.15.45:0/79301830 >> 172.21.15.45:0/79301830 conn(0x7f30e00a8960 msgr2=0x7f30e00a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.021+0000 7f30e694c640 1 -- 172.21.15.45:0/79301830 shutdown_connections 2023-12-08T08:17:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.021+0000 7f30e694c640 1 -- 172.21.15.45:0/79301830 wait complete. 2023-12-08T08:17:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.022+0000 7f30e694c640 1 Processor -- start 2023-12-08T08:17:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.022+0000 7f30e694c640 1 -- start start 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 0x7f30e0145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e0151ae0 0x7f30e0147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e006e860 con 0x7f30e00a6140 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0143380 con 0x7f30e00abb40 2023-12-08T08:17:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.023+0000 7f30e694c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e01458d0 con 0x7f30e0151ae0 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60950/0 (socket says 172.21.15.45:60950) 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 -- 172.21.15.45:0/3309250379 learned_addr learned my addr 172.21.15.45:0/3309250379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30df7fe640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 0x7f30e0145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30e4ee9640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e0151ae0 0x7f30e0147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 -- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e0151ae0 msgr2=0x7f30e0147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e0151ae0 0x7f30e0147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 -- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 msgr2=0x7f30e0145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 0x7f30e0145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30dffff640 1 -- 172.21.15.45:0/3309250379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009b30 con 0x7f30e00a6140 2023-12-08T08:17:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.024+0000 7f30df7fe640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 0x7f30e0145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30dffff640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f30d0036040 tx=0x7f30d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d003e450 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d003e5f0 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d003e9a0 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e006d5c0 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.025+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e006db40 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.026+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e01434c0 con 0x7f30e00a6140 2023-12-08T08:17:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.027+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30d003eb00 con 0x7f30e00a6140 2023-12-08T08:17:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.028+0000 7f30dcff9640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.028+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f30d00ac050 con 0x7f30e00a6140 2023-12-08T08:17:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.029+0000 7f30df7fe640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.029+0000 7f30df7fe640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 0x7f30cc06d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f30e01448f0 tx=0x7f30d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.032+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30d00dee90 con 0x7f30e00a6140 2023-12-08T08:17:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.227+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30e0154d00 con 0x7f30e00a6140 2023-12-08T08:17:38.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.229+0000 7f30dcff9640 1 -- 172.21.15.45:0/3309250379 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+13038 (secure 0 0 0) 0x7f30e0154d00 con 0x7f30e00a6140 2023-12-08T08:17:38.232 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:38.232 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":55,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:36.687955+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:38.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.231+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 msgr2=0x7f30cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.231+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 0x7f30cc06d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f30e01448f0 tx=0x7f30d4008040 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.231+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 msgr2=0x7f30e0144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.231+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f30d0036040 tx=0x7f30d0004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 shutdown_connections 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f30cc06ae70 0x7f30cc06d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f30e0151ae0 0x7f30e0147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30e00abb40 0x7f30e0145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 --2- 172.21.15.45:0/3309250379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00a6140 0x7f30e0144e50 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 >> 172.21.15.45:0/3309250379 conn(0x7f30e00a8960 msgr2=0x7f30e00c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 shutdown_connections 2023-12-08T08:17:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.232+0000 7f30e694c640 1 -- 172.21.15.45:0/3309250379 wait complete. 2023-12-08T08:17:38.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:38.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.481+0000 7f14ef0ff640 1 Processor -- start 2023-12-08T08:17:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.481+0000 7f14ef0ff640 1 -- start start 2023-12-08T08:17:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.482+0000 7f14ef0ff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14e8151ad0 0x7f14e80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.482+0000 7f14ef0ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14e8155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.482+0000 7f14ef0ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e8151eb0 con 0x7f14e8157a20 2023-12-08T08:17:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.482+0000 7f14ef0ff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80c56a0 con 0x7f14e8151ad0 2023-12-08T08:17:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ef0ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c80d0 con 0x7f14e80ca610 2023-12-08T08:17:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ed8fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14e8157a20 0x7f14e8154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35240/0 (socket says 172.21.15.45:35240) 2023-12-08T08:17:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ed8fc640 1 -- 172.21.15.45:0/3406273920 learned_addr learned my addr 172.21.15.45:0/3406273920 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:38.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14e8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/3406273920 >> v2:172.21.15.114:3300/0 conn(0x7f14e8151ad0 0x7f14e80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957564439 0 0) 0x7f14e8151eb0 con 0x7f14e8157a20 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.483+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d4003520 con 0x7f14e8157a20 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867043964 0 0) 0x7f14d4003520 con 0x7f14e8157a20 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 msgr2=0x7f14e8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14e8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 >> v2:172.21.15.114:3300/0 conn(0x7f14e8151ad0 msgr2=0x7f14e80ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 --2- 172.21.15.45:0/3406273920 >> v2:172.21.15.114:3300/0 conn(0x7f14e8151ad0 0x7f14e80ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e8154430 con 0x7f14e8157a20 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f14d8001670 con 0x7f14e8157a20 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 >> v1:172.21.15.45:6789/0 conn(0x7f14e8157a20 legacy=0x7f14e8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14d4003990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14d4003f60 0x7f14d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c80d0 con 0x7f14d4004d00 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400b980 con 0x7f14d4003f60 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d400baf0 con 0x7f14e80ca610 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.484+0000 7f14ed8fc640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14d4003f60 0x7f14d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14d4003990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee8fe640 1 -- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 msgr2=0x7f14d4003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14d4003990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee8fe640 1 -- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14d4003f60 msgr2=0x7f14d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14d4003f60 0x7f14d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee8fe640 1 -- 172.21.15.45:0/3406273920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4003520 con 0x7f14d4004d00 2023-12-08T08:17:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.485+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80ca610 0x7f14d4003990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.486+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14d4005180 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009fc0 tx=0x7f14d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f735df1d06c22518 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.486+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e002cbf0 con 0x7f14d4004d00 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.486+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000f040 con 0x7f14d4004d00 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.486+0000 7f14ed0fb640 1 -- 172.21.15.45:0/3406273920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0034440 con 0x7f14d4004d00 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 -- 172.21.15.45:0/3406273920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 msgr2=0x7f14d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/3406273920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14d4005180 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009fc0 tx=0x7f14d40057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ee8fe640 1 -- 172.21.15.45:0/3406273920 reap_dead start 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 -- 172.21.15.45:0/3406273920 shutdown_connections 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 -- 172.21.15.45:0/3406273920 >> 172.21.15.45:0/3406273920 conn(0x7f14e8066610 msgr2=0x7f14e8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 -- 172.21.15.45:0/3406273920 shutdown_connections 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.487+0000 7f14ef0ff640 1 -- 172.21.15.45:0/3406273920 wait complete. 2023-12-08T08:17:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.489+0000 7f14ef0ff640 1 Processor -- start 2023-12-08T08:17:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.489+0000 7f14ef0ff640 1 -- start start 2023-12-08T08:17:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80c01e0 0x7f14e80aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e80af3e0 0x7f14e80c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81ecf60 con 0x7f14d4004d00 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80af860 con 0x7f14e80af3e0 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ef0ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81ed1b0 con 0x7f14e80c01e0 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ee0fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ee0fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60966/0 (socket says 172.21.15.45:60966) 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ee0fd640 1 -- 172.21.15.45:0/1158187044 learned_addr learned my addr 172.21.15.45:0/1158187044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.490+0000 7f14ed8fc640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80c01e0 0x7f14e80aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee8fe640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e80af3e0 0x7f14e80c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 -- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80c01e0 msgr2=0x7f14e80aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80c01e0 0x7f14e80aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 -- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e80af3e0 msgr2=0x7f14e80c11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e80af3e0 0x7f14e80c11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 -- 172.21.15.45:0/1158187044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e81ed490 con 0x7f14d4004d00 2023-12-08T08:17:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ee0fd640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f14e40109d0 tx=0x7f14e4010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400ec20 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400ed80 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e401c620 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.491+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e81ed770 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.492+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e81edd30 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.493+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e80743e0 con 0x7f14d4004d00 2023-12-08T08:17:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.494+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14e401c780 con 0x7f14d4004d00 2023-12-08T08:17:38.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.495+0000 7f14deffd640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 0x7f14cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.495+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f14e4089ae0 con 0x7f14d4004d00 2023-12-08T08:17:38.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.495+0000 7f14ed8fc640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 0x7f14cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.496+0000 7f14ed8fc640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 0x7f14cc06d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14e8150860 tx=0x7f14d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.499+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14e4054db0 con 0x7f14d4004d00 2023-12-08T08:17:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.691+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14e806b7a0 con 0x7f14d4004d00 2023-12-08T08:17:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.692+0000 7f14deffd640 1 -- 172.21.15.45:0/1158187044 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14e40583d0 con 0x7f14d4004d00 2023-12-08T08:17:38.695 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 msgr2=0x7f14cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 0x7f14cc06d330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14e8150860 tx=0x7f14d8009040 comp rx=0 tx=0).stop 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 msgr2=0x7f14e8157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f14e40109d0 tx=0x7f14e4010e90 comp rx=0 tx=0).stop 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 shutdown_connections 2023-12-08T08:17:38.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f14cc06ae70 0x7f14cc06d330 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14e80c01e0 0x7f14e80aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e80af3e0 0x7f14e80c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 --2- 172.21.15.45:0/1158187044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d4004d00 0x7f14e8157080 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 >> 172.21.15.45:0/1158187044 conn(0x7f14e8066610 msgr2=0x7f14e80c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 shutdown_connections 2023-12-08T08:17:38.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.695+0000 7f14ef0ff640 1 -- 172.21.15.45:0/1158187044 wait complete. 2023-12-08T08:17:38.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:17:38.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.933+0000 7fd2582da640 1 Processor -- start 2023-12-08T08:17:38.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.934+0000 7fd2582da640 1 -- start start 2023-12-08T08:17:38.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.935+0000 7fd2582da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd250155bf0 0x7fd250156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.935+0000 7fd2582da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd250159eb0 0x7fd25015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.935+0000 7fd2582da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25006d230 con 0x7fd25015c220 2023-12-08T08:17:38.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.935+0000 7fd2582da640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500c6090 con 0x7fd250159eb0 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.935+0000 7fd2582da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c46c0 con 0x7fd250155bf0 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd250159eb0 0x7fd25015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd250159eb0 0x7fd25015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60982/0 (socket says 172.21.15.45:60982) 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 -- 172.21.15.45:0/2545728073 learned_addr learned my addr 172.21.15.45:0/2545728073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd255875640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd250155bf0 0x7fd250156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 -- 172.21.15.45:0/2545728073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd250155bf0 msgr2=0x7fd250156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd250155bf0 0x7fd250156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 -- 172.21.15.45:0/2545728073 >> v1:172.21.15.114:6789/0 conn(0x7fd25015c220 legacy=0x7fd25015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.936+0000 7fd256877640 1 -- 172.21.15.45:0/2545728073 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25015cd10 con 0x7fd250159eb0 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.937+0000 7fd256877640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd25015a2e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd248009e50 tx=0x7fd24802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbfd36c16a4678e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd255074640 1 -- 172.21.15.45:0/2545728073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24802ca70 con 0x7fd250159eb0 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd255074640 1 -- 172.21.15.45:0/2545728073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24802cbd0 con 0x7fd250159eb0 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd255074640 1 -- 172.21.15.45:0/2545728073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480343f0 con 0x7fd250159eb0 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd2582da640 1 -- 172.21.15.45:0/2545728073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 msgr2=0x7fd25015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd2582da640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd25015a2e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd248009e50 tx=0x7fd24802bed0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.938+0000 7fd2582da640 1 -- 172.21.15.45:0/2545728073 shutdown_connections 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.939+0000 7fd2582da640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd25015a2e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.939+0000 7fd2582da640 1 --2- 172.21.15.45:0/2545728073 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd250155bf0 0x7fd250156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.939+0000 7fd2582da640 1 -- 172.21.15.45:0/2545728073 >> 172.21.15.45:0/2545728073 conn(0x7fd2500661f0 msgr2=0x7fd250066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:38.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.939+0000 7fd2582da640 1 -- 172.21.15.45:0/2545728073 shutdown_connections 2023-12-08T08:17:38.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.939+0000 7fd2582da640 1 -- 172.21.15.45:0/2545728073 wait complete. 2023-12-08T08:17:38.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.940+0000 7fd2582da640 1 Processor -- start 2023-12-08T08:17:38.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 -- start start 2023-12-08T08:17:38.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 0x7fd2501ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd25015c220 0x7fd2501f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2501f1e90 con 0x7fd250159eb0 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500a4470 con 0x7fd250155bf0 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.941+0000 7fd2582da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500a4750 con 0x7fd25015c220 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60994/0 (socket says 172.21.15.45:60994) 2023-12-08T08:17:38.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 -- 172.21.15.45:0/1091882747 learned_addr learned my addr 172.21.15.45:0/1091882747 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:38.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 -- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd25015c220 msgr2=0x7fd2501f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd25015c220 0x7fd2501f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 -- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 msgr2=0x7fd2501ee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:38.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd256076640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 0x7fd2501ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 0x7fd2501ee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd255875640 1 -- 172.21.15.45:0/1091882747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009b30 con 0x7fd250159eb0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.942+0000 7fd256076640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 0x7fd2501ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd255875640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd24000d5f0 tx=0x7fd24000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400125f0 con 0x7fd250159eb0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240012750 con 0x7fd250159eb0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012b00 con 0x7fd250159eb0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500a4a30 con 0x7fd250159eb0 2023-12-08T08:17:38.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.943+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500aab40 con 0x7fd250159eb0 2023-12-08T08:17:38.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.944+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2500c59b0 con 0x7fd250159eb0 2023-12-08T08:17:38.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.945+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd240012c60 con 0x7fd250159eb0 2023-12-08T08:17:38.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.946+0000 7fd246ffd640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 0x7fd23406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:38.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.946+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd240089800 con 0x7fd250159eb0 2023-12-08T08:17:38.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.947+0000 7fd256076640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 0x7fd23406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:38.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.947+0000 7fd256076640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 0x7fd23406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd250066a90 tx=0x7fd24c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:38.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:38.951+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2500c59b0 con 0x7fd250159eb0 2023-12-08T08:17:38.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-08T08:17:39.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.148+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd2500c59b0 con 0x7fd250159eb0 2023-12-08T08:17:39.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.149+0000 7fd246ffd640 1 -- 172.21.15.45:0/1091882747 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd2500c59b0 con 0x7fd250159eb0 2023-12-08T08:17:39.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:39.151 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:17:39.151 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:39.151 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:17:39.152 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:17:39.152 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:39.152 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:17:39.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 msgr2=0x7fd23406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 0x7fd23406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd250066a90 tx=0x7fd24c009040 comp rx=0 tx=0).stop 2023-12-08T08:17:39.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 msgr2=0x7fd2500aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd24000d5f0 tx=0x7fd24000dab0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 shutdown_connections 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd23406ae40 0x7fd23406d300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd25015c220 0x7fd2501f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd250159eb0 0x7fd2500aa600 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 --2- 172.21.15.45:0/1091882747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd250155bf0 0x7fd2501ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.151+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 >> 172.21.15.45:0/1091882747 conn(0x7fd2500661f0 msgr2=0x7fd2500730c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.152+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 shutdown_connections 2023-12-08T08:17:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.152+0000 7fd2582da640 1 -- 172.21.15.45:0/1091882747 wait complete. 2023-12-08T08:17:39.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:17:39.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:17:39.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.404+0000 7f028e49f640 1 Processor -- start 2023-12-08T08:17:39.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.405+0000 7f028e49f640 1 -- start start 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028e49f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0288151a50 0x7f0288151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028e49f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 0x7f02880c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028e49f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02880c8780 con 0x7f02880c9010 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028e49f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02880c6f60 con 0x7f0288151a50 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028e49f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c4630 con 0x7f02880c7b10 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028d49d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0288151a50 0x7f0288151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028d49d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0288151a50 0x7f0288151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32778/0 (socket says 172.21.15.45:32778) 2023-12-08T08:17:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.406+0000 7f028d49d640 1 -- 172.21.15.45:0/1199539135 learned_addr learned my addr 172.21.15.45:0/1199539135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028cc9c640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 0x7f02880c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028d49d640 1 -- 172.21.15.45:0/1199539135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 msgr2=0x7f02880c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028d49d640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 0x7f02880c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028d49d640 1 -- 172.21.15.45:0/1199539135 >> v1:172.21.15.114:6789/0 conn(0x7f02880c9010 legacy=0x7f0288157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028d49d640 1 -- 172.21.15.45:0/1199539135 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880c7160 con 0x7f0288151a50 2023-12-08T08:17:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.407+0000 7f028cc9c640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 0x7f02880c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.408+0000 7f028d49d640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0288151a50 0x7f0288151e30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0284009e50 tx=0x7f028402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a5c5d9542b936f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.408+0000 7f027ffff640 1 -- 172.21.15.45:0/1199539135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028402c9f0 con 0x7f0288151a50 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.408+0000 7f027ffff640 1 -- 172.21.15.45:0/1199539135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028402cb50 con 0x7f0288151a50 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.408+0000 7f027ffff640 1 -- 172.21.15.45:0/1199539135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840343f0 con 0x7f0288151a50 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 -- 172.21.15.45:0/1199539135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0288151a50 msgr2=0x7f0288151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0288151a50 0x7f0288151e30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0284009e50 tx=0x7f028402be50 comp rx=0 tx=0).stop 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 -- 172.21.15.45:0/1199539135 shutdown_connections 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02880c7b10 0x7f02880c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 --2- 172.21.15.45:0/1199539135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0288151a50 0x7f0288151e30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 -- 172.21.15.45:0/1199539135 >> 172.21.15.45:0/1199539135 conn(0x7f028806b850 msgr2=0x7f028806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 -- 172.21.15.45:0/1199539135 shutdown_connections 2023-12-08T08:17:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.409+0000 7f028e49f640 1 -- 172.21.15.45:0/1199539135 wait complete. 2023-12-08T08:17:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.411+0000 7f028e49f640 1 Processor -- start 2023-12-08T08:17:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.411+0000 7f028e49f640 1 -- start start 2023-12-08T08:17:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 0x7f02880c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 0x7f028814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288154ad0 con 0x7f02880c9010 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288154640 con 0x7f02880c7b10 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028e49f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02881551b0 con 0x7f0288151a50 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32788/0 (socket says 172.21.15.45:32788) 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 -- 172.21.15.45:0/115093372 learned_addr learned my addr 172.21.15.45:0/115093372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028d49d640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 0x7f02880c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028dc9e640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 0x7f028814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 -- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 msgr2=0x7f028814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 0x7f028814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 -- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 msgr2=0x7f02880c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 0x7f02880c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028cc9c640 1 -- 172.21.15.45:0/115093372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009b30 con 0x7f02880c9010 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028dc9e640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 0x7f028814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.412+0000 7f028d49d640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 0x7f02880c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f028cc9c640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f027800c820 tx=0x7f027800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278007a30 con 0x7f02880c9010 2023-12-08T08:17:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278007b90 con 0x7f02880c9010 2023-12-08T08:17:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780113f0 con 0x7f02880c9010 2023-12-08T08:17:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0288153d10 con 0x7f02880c9010 2023-12-08T08:17:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.413+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02881542d0 con 0x7f02880c9010 2023-12-08T08:17:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.414+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880678c0 con 0x7f02880c9010 2023-12-08T08:17:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.415+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0278011550 con 0x7f02880c9010 2023-12-08T08:17:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.416+0000 7f027dffb640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.416+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f02780895e0 con 0x7f02880c9010 2023-12-08T08:17:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.417+0000 7f028d49d640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.418+0000 7f028d49d640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 0x7f026c06d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0284035000 tx=0x7f0284030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:39.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.421+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0278054890 con 0x7f02880c9010 2023-12-08T08:17:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.613+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f02880743e0 con 0x7f02880c9010 2023-12-08T08:17:39.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.742+0000 7f027dffb640 1 -- 172.21.15.45:0/115093372 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0278057eb0 con 0x7f02880c9010 2023-12-08T08:17:39.745 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-08T08:17:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.748+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 msgr2=0x7f026c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.748+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 0x7f026c06d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0284035000 tx=0x7f0284030000 comp rx=0 tx=0).stop 2023-12-08T08:17:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.748+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 msgr2=0x7f028814a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.748+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f027800c820 tx=0x7f027800cce0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 shutdown_connections 2023-12-08T08:17:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f026c06ae40 0x7f026c06d300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0288151a50 0x7f028814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02880c9010 0x7f028814a0e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 --2- 172.21.15.45:0/115093372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02880c7b10 0x7f02880c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.749+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 >> 172.21.15.45:0/115093372 conn(0x7f028806b850 msgr2=0x7f028806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.750+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 shutdown_connections 2023-12-08T08:17:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.750+0000 7f028e49f640 1 -- 172.21.15.45:0/115093372 wait complete. 2023-12-08T08:17:39.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:17:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.995+0000 7fb1ffb90640 1 Processor -- start 2023-12-08T08:17:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.995+0000 7fb1ffb90640 1 -- start start 2023-12-08T08:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1ffb90640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1f806d960 0x7fb1f80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1ffb90640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f8152660 con 0x7fb1f80c1930 2023-12-08T08:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1ffb90640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f8153200 con 0x7fb1f80aaf60 2023-12-08T08:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1ffb90640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80a4d10 con 0x7fb1f806d960 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1fd12b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1f806d960 0x7fb1f80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1fe12d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1f80c1930 0x7fb1f815cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35246/0 (socket says 172.21.15.45:35246) 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.997+0000 7fb1fe12d640 1 -- 172.21.15.45:0/3474668067 learned_addr learned my addr 172.21.15.45:0/3474668067 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.998+0000 7fb1fd12b640 1 -- 172.21.15.45:0/3474668067 >> v1:172.21.15.114:6789/0 conn(0x7fb1f80aaf60 legacy=0x7fb1f8152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.998+0000 7fb1fd12b640 1 -- 172.21.15.45:0/3474668067 >> v1:172.21.15.45:6789/0 conn(0x7fb1f80c1930 legacy=0x7fb1f815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.998+0000 7fb1fd12b640 1 -- 172.21.15.45:0/3474668067 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80c3310 con 0x7fb1f806d960 2023-12-08T08:17:40.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.998+0000 7fb1fc92a640 1 -- 172.21.15.45:0/3474668067 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990914545 0 0) 0x7fb1f8152660 con 0x7fb1f80c1930 2023-12-08T08:17:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.999+0000 7fb1fd12b640 1 --2- 172.21.15.45:0/3474668067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f806d960 0x7fb1f80c3830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80097a0 tx=0x7fb1e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6b75f1d46ca569 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.999+0000 7fb1fc92a640 1 -- 172.21.15.45:0/3474668067 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031830 con 0x7fb1f806d960 2023-12-08T08:17:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.999+0000 7fb1fc92a640 1 -- 172.21.15.45:0/3474668067 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8031990 con 0x7fb1f806d960 2023-12-08T08:17:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:39.999+0000 7fb1fc92a640 1 -- 172.21.15.45:0/3474668067 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031d20 con 0x7fb1f806d960 2023-12-08T08:17:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 -- 172.21.15.45:0/3474668067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f806d960 msgr2=0x7fb1f80c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/3474668067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f806d960 0x7fb1f80c3830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80097a0 tx=0x7fb1e802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 -- 172.21.15.45:0/3474668067 shutdown_connections 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/3474668067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f806d960 0x7fb1f80c3830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 -- 172.21.15.45:0/3474668067 >> 172.21.15.45:0/3474668067 conn(0x7fb1f80c2430 msgr2=0x7fb1f80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 -- 172.21.15.45:0/3474668067 shutdown_connections 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.000+0000 7fb1ffb90640 1 -- 172.21.15.45:0/3474668067 wait complete. 2023-12-08T08:17:40.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.003+0000 7fb1ffb90640 1 Processor -- start 2023-12-08T08:17:40.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.003+0000 7fb1ffb90640 1 -- start start 2023-12-08T08:17:40.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 0x7fb1f8147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 0x7fb1f8072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81483a0 con 0x7fb1f80aaf60 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80710c0 con 0x7fb1f80c1930 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1ffb90640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80713a0 con 0x7fb1f806d960 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fd12b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fd12b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32804/0 (socket says 172.21.15.45:32804) 2023-12-08T08:17:40.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fd12b640 1 -- 172.21.15.45:0/459899877 learned_addr learned my addr 172.21.15.45:0/459899877 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:40.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fd12b640 1 -- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 msgr2=0x7fb1f8147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fe12d640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 0x7fb1f8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.005+0000 7fb1fd92c640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 0x7fb1f8147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd12b640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 0x7fb1f8147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd12b640 1 -- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 msgr2=0x7fb1f8072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd12b640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 0x7fb1f8072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd12b640 1 -- 172.21.15.45:0/459899877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8009400 con 0x7fb1f80aaf60 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fe12d640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 0x7fb1f8072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd92c640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 0x7fb1f8147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1fd12b640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8034040 tx=0x7fb1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e803aa60 con 0x7fb1f80aaf60 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e803abe0 con 0x7fb1f80aaf60 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f8071680 con 0x7fb1f80aaf60 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.006+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8044400 con 0x7fb1f80aaf60 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.007+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f8071c40 con 0x7fb1f80aaf60 2023-12-08T08:17:40.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.008+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f80c4bc0 con 0x7fb1f80aaf60 2023-12-08T08:17:40.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.009+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1e804d440 con 0x7fb1f80aaf60 2023-12-08T08:17:40.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.010+0000 7fb1ee7fc640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 0x7fb1dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.010+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fb1e80ab8b0 con 0x7fb1f80aaf60 2023-12-08T08:17:40.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.011+0000 7fb1fd92c640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 0x7fb1dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.011+0000 7fb1fd92c640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 0x7fb1dc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000f60 tx=0x7fb1f4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:40.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.016+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1e8076960 con 0x7fb1f80aaf60 2023-12-08T08:17:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.213+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb1f8074670 con 0x7fb1f80aaf60 2023-12-08T08:17:40.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.749+0000 7fb1ee7fc640 1 -- 172.21.15.45:0/459899877 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb1e80350d0 con 0x7fb1f80aaf60 2023-12-08T08:17:40.752 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-08T08:17:40.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 msgr2=0x7fb1dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 0x7fb1dc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000f60 tx=0x7fb1f4009040 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 msgr2=0x7fb1f80bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8034040 tx=0x7fb1e80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 shutdown_connections 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1dc06ae40 0x7fb1dc06d300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1f80c1930 0x7fb1f8072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1f80aaf60 0x7fb1f80bfd40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 --2- 172.21.15.45:0/459899877 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1f806d960 0x7fb1f8147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.752+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 >> 172.21.15.45:0/459899877 conn(0x7fb1f80c2430 msgr2=0x7fb1f8072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.753+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 shutdown_connections 2023-12-08T08:17:40.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.753+0000 7fb1ffb90640 1 -- 172.21.15.45:0/459899877 wait complete. 2023-12-08T08:17:40.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:17:40.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.979+0000 7f16ffb78640 1 Processor -- start 2023-12-08T08:17:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.980+0000 7f16ffb78640 1 -- start start 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.981+0000 7f16ffb78640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16f8072190 0x7f16f8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.981+0000 7f16ffb78640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 0x7f16f81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.981+0000 7f16ffb78640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f80c1ff0 con 0x7f16f806a730 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.981+0000 7f16ffb78640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f80c5bf0 con 0x7f16f8072190 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.981+0000 7f16ffb78640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80c1d50 con 0x7f16f80c13d0 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fd914640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16f806a730 0x7f16f8154ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35252/0 (socket says 172.21.15.45:35252) 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fd914640 1 -- 172.21.15.45:0/538836896 learned_addr learned my addr 172.21.15.45:0/538836896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fd113640 1 --2- 172.21.15.45:0/538836896 >> v2:172.21.15.114:3300/0 conn(0x7f16f8072190 0x7f16f8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fe115640 1 --2- 172.21.15.45:0/538836896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 0x7f16f81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fc912640 1 -- 172.21.15.45:0/538836896 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151633312 0 0) 0x7f16f80c1ff0 con 0x7f16f806a730 2023-12-08T08:17:40.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.982+0000 7f16fc912640 1 -- 172.21.15.45:0/538836896 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e0003520 con 0x7f16f806a730 2023-12-08T08:17:40.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.983+0000 7f16fe115640 1 -- 172.21.15.45:0/538836896 >> v2:172.21.15.114:3300/0 conn(0x7f16f8072190 msgr2=0x7f16f8157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:40.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.983+0000 7f16fe115640 1 --2- 172.21.15.45:0/538836896 >> v2:172.21.15.114:3300/0 conn(0x7f16f8072190 0x7f16f8157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.983+0000 7f16fe115640 1 -- 172.21.15.45:0/538836896 >> v1:172.21.15.45:6789/0 conn(0x7f16f806a730 legacy=0x7f16f8154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.983+0000 7f16fe115640 1 -- 172.21.15.45:0/538836896 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f80c5910 con 0x7f16f80c13d0 2023-12-08T08:17:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.984+0000 7f16fe115640 1 --2- 172.21.15.45:0/538836896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 0x7f16f81581a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16f00097a0 tx=0x7f16f002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ad16aee4a574f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16fc912640 1 -- 172.21.15.45:0/538836896 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f002e070 con 0x7f16f80c13d0 2023-12-08T08:17:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16fc912640 1 -- 172.21.15.45:0/538836896 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00315a0 con 0x7f16f80c13d0 2023-12-08T08:17:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16fc912640 1 -- 172.21.15.45:0/538836896 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0031930 con 0x7f16f80c13d0 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 -- 172.21.15.45:0/538836896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 msgr2=0x7f16f81581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 --2- 172.21.15.45:0/538836896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 0x7f16f81581a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f16f00097a0 tx=0x7f16f002b840 comp rx=0 tx=0).stop 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 -- 172.21.15.45:0/538836896 shutdown_connections 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 --2- 172.21.15.45:0/538836896 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f80c13d0 0x7f16f81581a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 --2- 172.21.15.45:0/538836896 >> v2:172.21.15.114:3300/0 conn(0x7f16f8072190 0x7f16f8157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 -- 172.21.15.45:0/538836896 >> 172.21.15.45:0/538836896 conn(0x7f16f80c34d0 msgr2=0x7f16f80c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 -- 172.21.15.45:0/538836896 shutdown_connections 2023-12-08T08:17:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.985+0000 7f16ffb78640 1 -- 172.21.15.45:0/538836896 wait complete. 2023-12-08T08:17:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.987+0000 7f16ffb78640 1 Processor -- start 2023-12-08T08:17:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.987+0000 7f16ffb78640 1 -- start start 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f806a730 0x7f16f80ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16f80c13d0 0x7f16f81ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f806eb60 con 0x7f16f8072190 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f814f960 con 0x7f16f80c13d0 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.988+0000 7f16ffb78640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8156440 con 0x7f16f806a730 2023-12-08T08:17:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32820/0 (socket says 172.21.15.45:32820) 2023-12-08T08:17:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 -- 172.21.15.45:0/4083313397 learned_addr learned my addr 172.21.15.45:0/4083313397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd914640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f806a730 0x7f16f80ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fe115640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16f80c13d0 0x7f16f81ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 -- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f806a730 msgr2=0x7f16f80ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f806a730 0x7f16f80ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 -- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16f80c13d0 msgr2=0x7f16f81ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16f80c13d0 0x7f16f81ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.989+0000 7f16fd113640 1 -- 172.21.15.45:0/4083313397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009400 con 0x7f16f8072190 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16fd113640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e9b0 tx=0x7f16ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec009670 con 0x7f16f8072190 2023-12-08T08:17:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f8155730 con 0x7f16f8072190 2023-12-08T08:17:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00c9a0 con 0x7f16f8072190 2023-12-08T08:17:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00cd50 con 0x7f16f8072190 2023-12-08T08:17:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.990+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f8158990 con 0x7f16f8072190 2023-12-08T08:17:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.992+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f80a63f0 con 0x7f16f8072190 2023-12-08T08:17:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.993+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16ec013470 con 0x7f16f8072190 2023-12-08T08:17:40.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.993+0000 7f16f67fc640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 0x7f16e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:40.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.994+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f16ec0899d0 con 0x7f16f8072190 2023-12-08T08:17:40.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.994+0000 7f16fd914640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 0x7f16e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:40.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.995+0000 7f16fd914640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 0x7f16e406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005c00 tx=0x7f16e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:41.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:40.999+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16ec054910 con 0x7f16f8072190 2023-12-08T08:17:41.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.234+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f16f8074670 con 0x7f16f8072190 2023-12-08T08:17:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.791+0000 7f16f67fc640 1 -- 172.21.15.45:0/4083313397 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) v1 ==== 173+0+0 (secure 0 0 0) 0x7f16ec057f30 con 0x7f16f8072190 2023-12-08T08:17:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 9 and data pool 10 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 msgr2=0x7f16e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 0x7f16e406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005c00 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 msgr2=0x7f16f80c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e9b0 tx=0x7f16ec00ee70 comp rx=0 tx=0).stop 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 shutdown_connections 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f16e406ae40 0x7f16e406d300 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005c00 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2023-12-08T08:17:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16f80c13d0 0x7f16f81ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f8072190 0x7f16f80c6b10 secure :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e9b0 tx=0x7f16ec00ee70 comp rx=0 tx=0).stop 2023-12-08T08:17:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 --2- 172.21.15.45:0/4083313397 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f16f806a730 0x7f16f80ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.798+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 >> 172.21.15.45:0/4083313397 conn(0x7f16f80c34d0 msgr2=0x7f16f806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.802+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 shutdown_connections 2023-12-08T08:17:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:41.802+0000 7f16ffb78640 1 -- 172.21.15.45:0/4083313397 wait complete. 2023-12-08T08:17:41.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.025+0000 7f5b27fff640 1 Processor -- start 2023-12-08T08:17:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.025+0000 7f5b27fff640 1 -- start start 2023-12-08T08:17:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.026+0000 7f5b27fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b281542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.026+0000 7f5b27fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b280a7770 0x7f5b280a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b27fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b280a7300 con 0x7f5b2814e260 2023-12-08T08:17:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b27fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280bfb90 con 0x7f5b280a7770 2023-12-08T08:17:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b27fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280bf010 con 0x7f5b280beb30 2023-12-08T08:17:42.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b26ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5b2814e260 0x7f5b2806c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35256/0 (socket says 172.21.15.45:35256) 2023-12-08T08:17:42.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b26ffd640 1 -- 172.21.15.45:0/2693536852 learned_addr learned my addr 172.21.15.45:0/2693536852 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688604687 0 0) 0x7f5b280a7300 con 0x7f5b2814e260 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b14003520 con 0x7f5b2814e260 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.027+0000 7f5b277fe640 1 --2- 172.21.15.45:0/2693536852 >> v2:172.21.15.114:3300/0 conn(0x7f5b280a7770 0x7f5b280a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b281542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321193296 0 0) 0x7f5b14003520 con 0x7f5b2814e260 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 msgr2=0x7f5b281542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b281542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 >> v2:172.21.15.114:3300/0 conn(0x7f5b280a7770 msgr2=0x7f5b280a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 --2- 172.21.15.45:0/2693536852 >> v2:172.21.15.114:3300/0 conn(0x7f5b280a7770 0x7f5b280a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280bf2f0 con 0x7f5b2814e260 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5b18001670 con 0x7f5b2814e260 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 >> v1:172.21.15.45:6789/0 conn(0x7f5b2814e260 legacy=0x7f5b2806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b14003fa0 0x7f5b140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b14004d00 0x7f5b14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280bfb90 con 0x7f5b14003fa0 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280bf010 con 0x7f5b14004d00 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1400ba80 con 0x7f5b280beb30 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.028+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b14003fa0 0x7f5b140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b26ffd640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b277fe640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b14004d00 0x7f5b14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b1ffff640 1 -- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 msgr2=0x7f5b14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b280beb30 0x7f5b14003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b1ffff640 1 -- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b14004d00 msgr2=0x7f5b14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b14004d00 0x7f5b14005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.029+0000 7f5b1ffff640 1 -- 172.21.15.45:0/2693536852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14003520 con 0x7f5b14003fa0 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.030+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b14003fa0 0x7f5b140047c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000ba30 tx=0x7f5b140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8168d8c40f69a22 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.030+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10032640 con 0x7f5b14003fa0 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.030+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b100327a0 con 0x7f5b14003fa0 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.030+0000 7f5b267fc640 1 -- 172.21.15.45:0/2693536852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10032b30 con 0x7f5b14003fa0 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 -- 172.21.15.45:0/2693536852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b14003fa0 msgr2=0x7f5b140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 --2- 172.21.15.45:0/2693536852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b14003fa0 0x7f5b140047c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000ba30 tx=0x7f5b140057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b277fe640 1 -- 172.21.15.45:0/2693536852 reap_dead start 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 -- 172.21.15.45:0/2693536852 shutdown_connections 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 -- 172.21.15.45:0/2693536852 >> 172.21.15.45:0/2693536852 conn(0x7f5b280c5780 msgr2=0x7f5b280c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 -- 172.21.15.45:0/2693536852 shutdown_connections 2023-12-08T08:17:42.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.031+0000 7f5b27fff640 1 -- 172.21.15.45:0/2693536852 wait complete. 2023-12-08T08:17:42.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.033+0000 7f5b27fff640 1 Processor -- start 2023-12-08T08:17:42.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.033+0000 7f5b27fff640 1 -- start start 2023-12-08T08:17:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b14003fa0 0x7f5b281ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b28157260 0x7f5b28070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2806ff00 con 0x7f5b28071c10 2023-12-08T08:17:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b281eda90 con 0x7f5b28157260 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b27fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b28153cd0 con 0x7f5b14003fa0 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32834/0 (socket says 172.21.15.45:32834) 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.034+0000 7f5b1ffff640 1 -- 172.21.15.45:0/786029697 learned_addr learned my addr 172.21.15.45:0/786029697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b26ffd640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b14003fa0 0x7f5b281ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 -- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b14003fa0 msgr2=0x7f5b281ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b14003fa0 0x7f5b281ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 -- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b28157260 msgr2=0x7f5b28070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b277fe640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b28157260 0x7f5b28070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b28157260 0x7f5b28070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 -- 172.21.15.45:0/786029697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28153fb0 con 0x7f5b28071c10 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1ffff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5b1002bec0 tx=0x7f5b10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1003ba70 con 0x7f5b28071c10 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1003bbd0 con 0x7f5b28071c10 2023-12-08T08:17:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10030410 con 0x7f5b28071c10 2023-12-08T08:17:42.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.035+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2806f840 con 0x7f5b28071c10 2023-12-08T08:17:42.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.036+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b28155770 con 0x7f5b28071c10 2023-12-08T08:17:42.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.037+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b280743e0 con 0x7f5b28071c10 2023-12-08T08:17:42.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.038+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b10030570 con 0x7f5b28071c10 2023-12-08T08:17:42.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.039+0000 7f5b1f7fe640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 0x7f5b0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.039+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b100abee0 con 0x7f5b28071c10 2023-12-08T08:17:42.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.039+0000 7f5b26ffd640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 0x7f5b0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.040+0000 7f5b26ffd640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 0x7f5b0806d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5b281e7410 tx=0x7f5b18001d70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.043+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b10076e40 con 0x7f5b28071c10 2023-12-08T08:17:42.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.237+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b2806d650 con 0x7f5b28071c10 2023-12-08T08:17:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.240+0000 7f5b1f7fe640 1 -- 172.21.15.45:0/786029697 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16705 (secure 0 0 0) 0x7f5b10036020 con 0x7f5b28071c10 2023-12-08T08:17:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:42.243 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:41.236326+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:42.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 msgr2=0x7f5b0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 0x7f5b0806d330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5b281e7410 tx=0x7f5b18001d70 comp rx=0 tx=0).stop 2023-12-08T08:17:42.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 msgr2=0x7f5b28156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5b1002bec0 tx=0x7f5b10004730 comp rx=0 tx=0).stop 2023-12-08T08:17:42.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 shutdown_connections 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b0806ae70 0x7f5b0806d330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b28157260 0x7f5b28070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b28071c10 0x7f5b28156d20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.242+0000 7f5b27fff640 1 --2- 172.21.15.45:0/786029697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b14003fa0 0x7f5b281ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.243+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 >> 172.21.15.45:0/786029697 conn(0x7f5b280c5780 msgr2=0x7f5b280c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.243+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 shutdown_connections 2023-12-08T08:17:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.243+0000 7f5b27fff640 1 -- 172.21.15.45:0/786029697 wait complete. 2023-12-08T08:17:42.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:42.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.483+0000 7fec321bc640 1 Processor -- start 2023-12-08T08:17:42.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.483+0000 7fec321bc640 1 -- start start 2023-12-08T08:17:42.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.484+0000 7fec321bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec2c1519c0 0x7fec2c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.484+0000 7fec321bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0c4a00 con 0x7fec2c0c7a50 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.484+0000 7fec321bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0c4ce0 con 0x7fec2c0c44d0 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.484+0000 7fec321bc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c1579e0 con 0x7fec2c1519c0 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.485+0000 7fec311ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec2c1519c0 0x7fec2c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.485+0000 7fec311ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec2c1519c0 0x7fec2c1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32840/0 (socket says 172.21.15.45:32840) 2023-12-08T08:17:42.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.485+0000 7fec311ba640 1 -- 172.21.15.45:0/1314510374 learned_addr learned my addr 172.21.15.45:0/1314510374 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:42.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.485+0000 7fec311ba640 1 -- 172.21.15.45:0/1314510374 >> v1:172.21.15.114:6789/0 conn(0x7fec2c0c44d0 legacy=0x7fec2c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.485+0000 7fec311ba640 1 -- 172.21.15.45:0/1314510374 >> v1:172.21.15.45:6789/0 conn(0x7fec2c0c7a50 legacy=0x7fec2c0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.486+0000 7fec311ba640 1 -- 172.21.15.45:0/1314510374 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c157cc0 con 0x7fec2c1519c0 2023-12-08T08:17:42.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.486+0000 7fec23fff640 1 -- 172.21.15.45:0/1314510374 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168585923 0 0) 0x7fec2c0c4a00 con 0x7fec2c0c7a50 2023-12-08T08:17:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.487+0000 7fec311ba640 1 --2- 172.21.15.45:0/1314510374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1584c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f6b87431b66aac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.487+0000 7fec23fff640 1 -- 172.21.15.45:0/1314510374 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28031870 con 0x7fec2c1519c0 2023-12-08T08:17:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.487+0000 7fec23fff640 1 -- 172.21.15.45:0/1314510374 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280319d0 con 0x7fec2c1519c0 2023-12-08T08:17:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.487+0000 7fec23fff640 1 -- 172.21.15.45:0/1314510374 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28031d60 con 0x7fec2c1519c0 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 -- 172.21.15.45:0/1314510374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 msgr2=0x7fec2c1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 --2- 172.21.15.45:0/1314510374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1584c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2802b910 comp rx=0 tx=0).stop 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 -- 172.21.15.45:0/1314510374 shutdown_connections 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 --2- 172.21.15.45:0/1314510374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1584c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 -- 172.21.15.45:0/1314510374 >> 172.21.15.45:0/1314510374 conn(0x7fec2c0661f0 msgr2=0x7fec2c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 -- 172.21.15.45:0/1314510374 shutdown_connections 2023-12-08T08:17:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.488+0000 7fec321bc640 1 -- 172.21.15.45:0/1314510374 wait complete. 2023-12-08T08:17:42.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.490+0000 7fec321bc640 1 Processor -- start 2023-12-08T08:17:42.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.490+0000 7fec321bc640 1 -- start start 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec2c0c44d0 0x7fec2c14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec2c0c7a50 0x7fec2c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c14a700 con 0x7fec2c1519c0 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c14b120 con 0x7fec2c0c7a50 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec321bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0c9600 con 0x7fec2c0c44d0 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32850/0 (socket says 172.21.15.45:32850) 2023-12-08T08:17:42.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 -- 172.21.15.45:0/1926200533 learned_addr learned my addr 172.21.15.45:0/1926200533 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 -- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec2c0c44d0 msgr2=0x7fec2c14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec2c0c44d0 0x7fec2c14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 -- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec2c0c7a50 msgr2=0x7fec2c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec2c0c7a50 0x7fec2c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.491+0000 7fec319bb640 1 -- 172.21.15.45:0/1926200533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280094d0 con 0x7fec2c1519c0 2023-12-08T08:17:42.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec319bb640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fec24001560 tx=0x7fec2400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24003da0 con 0x7fec2c1519c0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24005070 con 0x7fec2c1519c0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24005420 con 0x7fec2c1519c0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c1edb80 con 0x7fec2c1519c0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.492+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0c36e0 con 0x7fec2c1519c0 2023-12-08T08:17:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.493+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c0743e0 con 0x7fec2c1519c0 2023-12-08T08:17:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.494+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec24005580 con 0x7fec2c1519c0 2023-12-08T08:17:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.495+0000 7fec21ffb640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 0x7fec1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.495+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec24088ff0 con 0x7fec2c1519c0 2023-12-08T08:17:42.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.496+0000 7fec311ba640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 0x7fec1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.497+0000 7fec311ba640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 0x7fec1006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec28036000 tx=0x7fec28030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.500+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec24053f50 con 0x7fec2c1519c0 2023-12-08T08:17:42.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.697+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec2c0c7190 con 0x7fec2c1519c0 2023-12-08T08:17:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.701+0000 7fec21ffb640 1 -- 172.21.15.45:0/1926200533 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fec24017070 con 0x7fec2c1519c0 2023-12-08T08:17:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:42.704 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:41.236326+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:42.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 msgr2=0x7fec1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 0x7fec1006d330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec28036000 tx=0x7fec28030000 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 msgr2=0x7fec2c1ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fec24001560 tx=0x7fec2400cc70 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 shutdown_connections 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec1006ae70 0x7fec1006d330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec2c1519c0 0x7fec2c1ed220 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec2c0c7a50 0x7fec2c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 --2- 172.21.15.45:0/1926200533 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec2c0c44d0 0x7fec2c14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.703+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 >> 172.21.15.45:0/1926200533 conn(0x7fec2c0661f0 msgr2=0x7fec2c1504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.704+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 shutdown_connections 2023-12-08T08:17:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.704+0000 7fec321bc640 1 -- 172.21.15.45:0/1926200533 wait complete. 2023-12-08T08:17:42.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:17:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.949+0000 7f585759e640 1 Processor -- start 2023-12-08T08:17:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.949+0000 7f585759e640 1 -- start start 2023-12-08T08:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f585806d1d0 0x7f5858158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580c51f0 con 0x7f58580c59e0 2023-12-08T08:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580c54d0 con 0x7f58580c0bf0 2023-12-08T08:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580c1ce0 con 0x7f585806d1d0 2023-12-08T08:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58580c59e0 0x7f585806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35282/0 (socket says 172.21.15.45:35282) 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585659c640 1 -- 172.21.15.45:0/3739604139 learned_addr learned my addr 172.21.15.45:0/3739604139 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709146452 0 0) 0x7f58580c51f0 con 0x7f58580c59e0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.951+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5840003520 con 0x7f58580c59e0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f5855d9b640 1 --2- 172.21.15.45:0/3739604139 >> v2:172.21.15.114:3300/0 conn(0x7f585806d1d0 0x7f5858158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653461483 0 0) 0x7f5840003520 con 0x7f58580c59e0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 >> v2:172.21.15.114:3300/0 conn(0x7f585806d1d0 msgr2=0x7f5858158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 --2- 172.21.15.45:0/3739604139 >> v2:172.21.15.114:3300/0 conn(0x7f585806d1d0 0x7f5858158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 >> v1:172.21.15.114:6789/0 conn(0x7f58580c0bf0 legacy=0x7f5858154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858157ba0 con 0x7f58580c59e0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5848001670 con 0x7f58580c59e0 2023-12-08T08:17:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 >> v1:172.21.15.45:6789/0 conn(0x7f58580c59e0 legacy=0x7f585806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5840003970 0x7f5840003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58400047c0 0x7f5840004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 0x7f584000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584000c160 con 0x7f58400052a0 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584000c2d0 con 0x7f58400047c0 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584000c490 con 0x7f5840003970 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f5855d9b640 1 --2- 172.21.15.45:0/3739604139 >> v2:172.21.15.114:3300/0 conn(0x7f585806d1d0 0x7f5858158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.952+0000 7f5856d9d640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 0x7f584000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5855d9b640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58400047c0 0x7f5840004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f585659c640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5840003970 0x7f5840003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5856d9d640 1 -- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5840003970 msgr2=0x7f5840003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5856d9d640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5840003970 0x7f5840003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5856d9d640 1 -- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58400047c0 msgr2=0x7f5840004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5856d9d640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58400047c0 0x7f5840004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f5856d9d640 1 -- 172.21.15.45:0/3739604139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840003520 con 0x7f58400052a0 2023-12-08T08:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.953+0000 7f585659c640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5840003970 0x7f5840003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.954+0000 7f5856d9d640 1 -- 172.21.15.45:0/3739604139 reap_dead start 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.954+0000 7f5856d9d640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 0x7f584000b980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5850001e50 tx=0x7f58400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4714a51d9c772289 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.954+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850003b70 con 0x7f58400052a0 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.954+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850003d10 con 0x7f58400052a0 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.954+0000 7f585559a640 1 -- 172.21.15.45:0/3739604139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850005310 con 0x7f58400052a0 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 -- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 msgr2=0x7f584000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 0x7f584000b980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5850001e50 tx=0x7f58400057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 -- 172.21.15.45:0/3739604139 shutdown_connections 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 --2- 172.21.15.45:0/3739604139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58400052a0 0x7f584000b980 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 -- 172.21.15.45:0/3739604139 >> 172.21.15.45:0/3739604139 conn(0x7f5858066ce0 msgr2=0x7f58580a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 -- 172.21.15.45:0/3739604139 shutdown_connections 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.955+0000 7f585759e640 1 -- 172.21.15.45:0/3739604139 wait complete. 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.957+0000 7f585759e640 1 Processor -- start 2023-12-08T08:17:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.957+0000 7f585759e640 1 -- start start 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58400052a0 0x7f58581ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58580722c0 0x7f58580a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5858071e30 con 0x7f58580a5590 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580a63e0 con 0x7f58580722c0 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f585759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585806fa80 con 0x7f58400052a0 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f5856d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.958+0000 7f5856d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32864/0 (socket says 172.21.15.45:32864) 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 -- 172.21.15.45:0/2140815697 learned_addr learned my addr 172.21.15.45:0/2140815697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f585659c640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58400052a0 0x7f58581ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5855d9b640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58580722c0 0x7f58580a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 -- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58400052a0 msgr2=0x7f58581ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58400052a0 0x7f58581ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 -- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58580722c0 msgr2=0x7f58580a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58580722c0 0x7f58580a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 -- 172.21.15.45:0/2140815697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585806fd60 con 0x7f58580a5590 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.959+0000 7f5856d9d640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f585002c060 tx=0x7f58500014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.960+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850006d50 con 0x7f58580a5590 2023-12-08T08:17:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.960+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850003b80 con 0x7f58580a5590 2023-12-08T08:17:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.960+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500396a0 con 0x7f58580a5590 2023-12-08T08:17:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.960+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58581ed760 con 0x7f58580a5590 2023-12-08T08:17:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.960+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58581ed460 con 0x7f58580a5590 2023-12-08T08:17:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.961+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5858071fe0 con 0x7f58580a5590 2023-12-08T08:17:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.962+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5850039800 con 0x7f58580a5590 2023-12-08T08:17:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.963+0000 7f5846ffd640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.964+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f58500ab1c0 con 0x7f58580a5590 2023-12-08T08:17:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.964+0000 7f585659c640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.964+0000 7f585659c640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:42.968+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5858071fe0 con 0x7f58580a5590 2023-12-08T08:17:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.207+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5858071fe0 con 0x7f58580a5590 2023-12-08T08:17:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.808+0000 7f5846ffd640 1 -- 172.21.15.45:0/2140815697 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5858071fe0 con 0x7f58580a5590 2023-12-08T08:17:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.811+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 msgr2=0x7f583806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848009040 comp rx=0 tx=0).stop 2023-12-08T08:17:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 msgr2=0x7f58580a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f585002c060 tx=0x7f58500014a0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 shutdown_connections 2023-12-08T08:17:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58580a5590 0x7f58580a6b20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58580722c0 0x7f58580a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 --2- 172.21.15.45:0/2140815697 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58400052a0 0x7f58581ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 >> 172.21.15.45:0/2140815697 conn(0x7f5858066ce0 msgr2=0x7f5858150830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 shutdown_connections 2023-12-08T08:17:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:43.812+0000 7f585759e640 1 -- 172.21.15.45:0/2140815697 wait complete. 2023-12-08T08:17:43.837 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:17:43.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:17:44.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.067+0000 7fa51902b640 1 Processor -- start 2023-12-08T08:17:44.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.067+0000 7fa51902b640 1 -- start start 2023-12-08T08:17:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.068+0000 7fa51902b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5140c51d0 0x7fa514154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.068+0000 7fa51902b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5140c0d40 con 0x7fa514147bb0 2023-12-08T08:17:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.068+0000 7fa51902b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5141555c0 con 0x7fa5140c1ff0 2023-12-08T08:17:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.068+0000 7fa51902b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140a4d10 con 0x7fa5140c51d0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.069+0000 7fa512d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa514147bb0 0x7fa5140c11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35294/0 (socket says 172.21.15.45:35294) 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.069+0000 7fa512d9d640 1 -- 172.21.15.45:0/1423171622 learned_addr learned my addr 172.21.15.45:0/1423171622 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.069+0000 7fa51359e640 1 --2- 172.21.15.45:0/1423171622 >> v2:172.21.15.114:3300/0 conn(0x7fa5140c51d0 0x7fa514154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.069+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211521089 0 0) 0x7fa5140c0d40 con 0x7fa514147bb0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.069+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa500003520 con 0x7fa514147bb0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488297735 0 0) 0x7fa500003520 con 0x7fa514147bb0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 >> v2:172.21.15.114:3300/0 conn(0x7fa5140c51d0 msgr2=0x7fa514154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 --2- 172.21.15.45:0/1423171622 >> v2:172.21.15.114:3300/0 conn(0x7fa5140c51d0 0x7fa514154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 >> v1:172.21.15.114:6789/0 conn(0x7fa5140c1ff0 legacy=0x7fa514154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140a4ff0 con 0x7fa514147bb0 2023-12-08T08:17:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fa504001670 con 0x7fa514147bb0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 >> v1:172.21.15.45:6789/0 conn(0x7fa514147bb0 legacy=0x7fa5140c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5000047c0 0x7fa500004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000051d0 0x7fa50000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140a4d10 con 0x7fa5000039c0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500010530 con 0x7fa5000047c0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000106f0 con 0x7fa5000051d0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.070+0000 7fa512d9d640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa51359e640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000051d0 0x7fa50000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa50bfff640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5000047c0 0x7fa500004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa512d9d640 1 -- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000051d0 msgr2=0x7fa50000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa512d9d640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000051d0 0x7fa50000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa512d9d640 1 -- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5000047c0 msgr2=0x7fa500004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa512d9d640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5000047c0 0x7fa500004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa512d9d640 1 -- 172.21.15.45:0/1423171622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500003520 con 0x7fa5000039c0 2023-12-08T08:17:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa51359e640 1 -- 172.21.15.45:0/1423171622 reap_dead start 2023-12-08T08:17:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.071+0000 7fa50bfff640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5000047c0 0x7fa500004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.072+0000 7fa512d9d640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa504001eb0 tx=0x7fa5000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d31e33ef7b65367 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.072+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa504005ad0 con 0x7fa5000039c0 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.072+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504005c30 con 0x7fa5000039c0 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.072+0000 7fa51259c640 1 -- 172.21.15.45:0/1423171622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040072b0 con 0x7fa5000039c0 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 -- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 msgr2=0x7fa500003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa504001eb0 tx=0x7fa5000057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 -- 172.21.15.45:0/1423171622 shutdown_connections 2023-12-08T08:17:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 --2- 172.21.15.45:0/1423171622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5000039c0 0x7fa500003de0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 -- 172.21.15.45:0/1423171622 >> 172.21.15.45:0/1423171622 conn(0x7fa5140c2430 msgr2=0x7fa5140c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 -- 172.21.15.45:0/1423171622 shutdown_connections 2023-12-08T08:17:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.073+0000 7fa51902b640 1 -- 172.21.15.45:0/1423171622 wait complete. 2023-12-08T08:17:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.075+0000 7fa51902b640 1 Processor -- start 2023-12-08T08:17:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.075+0000 7fa51902b640 1 -- start start 2023-12-08T08:17:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000039c0 0x7fa514070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5141e96b0 0x7fa514142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514145b60 con 0x7fa514144e40 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514070120 con 0x7fa5141e96b0 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa51902b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa514071470 con 0x7fa5000039c0 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32882/0 (socket says 172.21.15.45:32882) 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.076+0000 7fa50bfff640 1 -- 172.21.15.45:0/3583032432 learned_addr learned my addr 172.21.15.45:0/3583032432 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa512d9d640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000039c0 0x7fa514070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa51359e640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5141e96b0 0x7fa514142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 -- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000039c0 msgr2=0x7fa514070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000039c0 0x7fa514070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 -- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5141e96b0 msgr2=0x7fa514142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5141e96b0 0x7fa514142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 -- 172.21.15.45:0/3583032432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51414bc70 con 0x7fa514144e40 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50bfff640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00d480 tx=0x7fa4fc00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.077+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc005480 con 0x7fa514144e40 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.078+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc003610 con 0x7fa514144e40 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.078+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0039c0 con 0x7fa514144e40 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.078+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51414bf50 con 0x7fa514144e40 2023-12-08T08:17:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.078+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa514144920 con 0x7fa514144e40 2023-12-08T08:17:44.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.079+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514144ab0 con 0x7fa514144e40 2023-12-08T08:17:44.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.080+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4fc003b20 con 0x7fa514144e40 2023-12-08T08:17:44.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.081+0000 7fa50b7fe640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:44.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.081+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa4fc089520 con 0x7fa514144e40 2023-12-08T08:17:44.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.082+0000 7fa512d9d640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.082+0000 7fa512d9d640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 0x7fa4f406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa504034000 tx=0x7fa504009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.086+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4fc054520 con 0x7fa514144e40 2023-12-08T08:17:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.321+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa514074670 con 0x7fa514144e40 2023-12-08T08:17:44.643 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-08T08:17:44.640+0000 7f4c0b8d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:17:44.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.818+0000 7fa50b7fe640 1 -- 172.21.15.45:0/3583032432 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4fc057b40 con 0x7fa514144e40 2023-12-08T08:17:44.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 msgr2=0x7fa4f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 0x7fa4f406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa504034000 tx=0x7fa504009030 comp rx=0 tx=0).stop 2023-12-08T08:17:44.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 msgr2=0x7fa5141e9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:44.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00d480 tx=0x7fa4fc00d940 comp rx=0 tx=0).stop 2023-12-08T08:17:44.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 shutdown_connections 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa4f406ae70 0x7fa4f406d330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5141e96b0 0x7fa514142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa514144e40 0x7fa5141e9170 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 --2- 172.21.15.45:0/3583032432 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5000039c0 0x7fa514070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 >> 172.21.15.45:0/3583032432 conn(0x7fa5140c2430 msgr2=0x7fa51406cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 shutdown_connections 2023-12-08T08:17:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:44.822+0000 7fa51902b640 1 -- 172.21.15.45:0/3583032432 wait complete. 2023-12-08T08:17:44.882 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:17:44.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:45.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.115+0000 7f997d03d640 1 Processor -- start 2023-12-08T08:17:45.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.115+0000 7f997d03d640 1 -- start start 2023-12-08T08:17:45.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f997d03d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f997814c4a0 0x7f9978156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f997d03d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997814c880 con 0x7f99780a4d10 2023-12-08T08:17:45.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f997d03d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99780c63b0 con 0x7f9978153880 2023-12-08T08:17:45.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f997d03d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780c4730 con 0x7f997814c4a0 2023-12-08T08:17:45.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f996ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99780a4d10 0x7f9978155980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57014/0 (socket says 172.21.15.45:57014) 2023-12-08T08:17:45.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f996ffff640 1 -- 172.21.15.45:0/396262885 learned_addr learned my addr 172.21.15.45:0/396262885 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.117+0000 7f9976d9d640 1 --2- 172.21.15.45:0/396262885 >> v2:172.21.15.114:3300/0 conn(0x7f997814c4a0 0x7f9978156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969948582 0 0) 0x7f997814c880 con 0x7f99780a4d10 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9964003520 con 0x7f99780a4d10 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212986501 0 0) 0x7f9964003520 con 0x7f99780a4d10 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 >> v2:172.21.15.114:3300/0 conn(0x7f997814c4a0 msgr2=0x7f9978156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 --2- 172.21.15.45:0/396262885 >> v2:172.21.15.114:3300/0 conn(0x7f997814c4a0 0x7f9978156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 >> v1:172.21.15.114:6789/0 conn(0x7f9978153880 legacy=0x7f9978153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780a5210 con 0x7f99780a4d10 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9960001670 con 0x7f99780a4d10 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 >> v1:172.21.15.45:6789/0 conn(0x7f99780a4d10 legacy=0x7f9978155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640039c0 0x7f9964003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 0x7f996400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780c4730 con 0x7f99640051d0 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996400c120 con 0x7f99640039c0 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.118+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996400c2e0 con 0x7f99640047c0 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 0x7f996400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f9976d9d640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640039c0 0x7f9964003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f996ffff640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 -- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640047c0 msgr2=0x7f9964004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:45.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640047c0 0x7f9964004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 -- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640039c0 msgr2=0x7f9964003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640039c0 0x7f9964003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f997759e640 1 -- 172.21.15.45:0/396262885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964003520 con 0x7f99640051d0 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.119+0000 7f9976d9d640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640039c0 0x7f9964003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.120+0000 7f997759e640 1 -- 172.21.15.45:0/396262885 reap_dead start 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.120+0000 7f997759e640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 0x7f996400b980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9970001e20 tx=0x7f99640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27cc083ee96fd06 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970003b70 con 0x7f99640051d0 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9970003cd0 con 0x7f99640051d0 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997659c640 1 -- 172.21.15.45:0/396262885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700052f0 con 0x7f99640051d0 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997d03d640 1 -- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 msgr2=0x7f996400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997d03d640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 0x7f996400b980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9970001e20 tx=0x7f99640057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997d03d640 1 -- 172.21.15.45:0/396262885 shutdown_connections 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997d03d640 1 --2- 172.21.15.45:0/396262885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640051d0 0x7f996400b980 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.121+0000 7f997d03d640 1 -- 172.21.15.45:0/396262885 >> 172.21.15.45:0/396262885 conn(0x7f99780661f0 msgr2=0x7f9978066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:45.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.122+0000 7f997d03d640 1 -- 172.21.15.45:0/396262885 shutdown_connections 2023-12-08T08:17:45.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.122+0000 7f997d03d640 1 -- 172.21.15.45:0/396262885 wait complete. 2023-12-08T08:17:45.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.123+0000 7f997d03d640 1 Processor -- start 2023-12-08T08:17:45.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.123+0000 7f997d03d640 1 -- start start 2023-12-08T08:17:45.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640051d0 0x7f99781ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99780c1730 0x7f99780bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99781ee6e0 con 0x7f99781eab30 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780aaa50 con 0x7f99780c1730 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.124+0000 7f997d03d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780aa490 con 0x7f99640051d0 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43014/0 (socket says 172.21.15.45:43014) 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 -- 172.21.15.45:0/153521924 learned_addr learned my addr 172.21.15.45:0/153521924 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f996ffff640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99780c1730 0x7f99780bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f9976d9d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640051d0 0x7f99781ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 -- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640051d0 msgr2=0x7f99781ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640051d0 0x7f99781ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 -- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99780c1730 msgr2=0x7f99780bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99780c1730 0x7f99780bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.125+0000 7f997759e640 1 -- 172.21.15.45:0/153521924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780aa770 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f997759e640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9970001f40 tx=0x7f99700014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970006d50 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9970007020 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970007390 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99781ea330 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.126+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99780bf580 con 0x7f99781eab30 2023-12-08T08:17:45.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.127+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99781ee6e0 con 0x7f99781eab30 2023-12-08T08:17:45.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.128+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f997003f030 con 0x7f99781eab30 2023-12-08T08:17:45.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.129+0000 7f996f7fe640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 0x7f995806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.129+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9970003e40 con 0x7f99781eab30 2023-12-08T08:17:45.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.129+0000 7f9976d9d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 0x7f995806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.130+0000 7f9976d9d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 0x7f995806d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9968009990 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.134+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99781ee6e0 con 0x7f99781eab30 2023-12-08T08:17:45.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.373+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99781ea850 con 0x7f99781eab30 2023-12-08T08:17:45.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.374+0000 7f996f7fe640 1 -- 172.21.15.45:0/153521924 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f99781ea850 con 0x7f99781eab30 2023-12-08T08:17:45.377 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:45.377 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-08T08:17:45.378 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-12-08T08:17:45.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.376+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 msgr2=0x7f995806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.376+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 0x7f995806d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9968009990 tx=0x7f9968008040 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 msgr2=0x7f99780a8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9970001f40 tx=0x7f99700014a0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 shutdown_connections 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f995806ae40 0x7f995806d300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99781eab30 0x7f99780a8b50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99780c1730 0x7f99780bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 --2- 172.21.15.45:0/153521924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99640051d0 0x7f99781ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 >> 172.21.15.45:0/153521924 conn(0x7f99780661f0 msgr2=0x7f99781558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 shutdown_connections 2023-12-08T08:17:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.377+0000 7f997d03d640 1 -- 172.21.15.45:0/153521924 wait complete. 2023-12-08T08:17:45.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.627+0000 7faaaf66b640 1 Processor -- start 2023-12-08T08:17:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.627+0000 7faaaf66b640 1 -- start start 2023-12-08T08:17:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaaf66b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faaa814c4a0 0x7faaa8156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaaf66b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 0x7faaa8155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaaf66b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa814c880 con 0x7faaa8155ec0 2023-12-08T08:17:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaaf66b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa80c4730 con 0x7faaa814c4a0 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaaf66b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa80c56e0 con 0x7faaa80a4d10 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaad407640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faaa814c4a0 0x7faaa8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaad407640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faaa814c4a0 0x7faaa8156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43020/0 (socket says 172.21.15.45:43020) 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.629+0000 7faaad407640 1 -- 172.21.15.45:0/2015390863 learned_addr learned my addr 172.21.15.45:0/2015390863 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaacc06640 1 --2- 172.21.15.45:0/2015390863 >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 0x7faaa8155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaad407640 1 -- 172.21.15.45:0/2015390863 >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 msgr2=0x7faaa8155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaad407640 1 --2- 172.21.15.45:0/2015390863 >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 0x7faaa8155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaad407640 1 -- 172.21.15.45:0/2015390863 >> v1:172.21.15.114:6789/0 conn(0x7faaa8155ec0 legacy=0x7faaa8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaad407640 1 -- 172.21.15.45:0/2015390863 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80c63b0 con 0x7faaa814c4a0 2023-12-08T08:17:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.630+0000 7faaacc06640 1 --2- 172.21.15.45:0/2015390863 >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 0x7faaa8155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.631+0000 7faaad407640 1 --2- 172.21.15.45:0/2015390863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa8156490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7faaa80c3540 tx=0x7faaa402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126510c708cd030b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.631+0000 7faa9ffff640 1 -- 172.21.15.45:0/2015390863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40317e0 con 0x7faaa814c4a0 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.631+0000 7faa9ffff640 1 -- 172.21.15.45:0/2015390863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4031940 con 0x7faaa814c4a0 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.631+0000 7faa9ffff640 1 -- 172.21.15.45:0/2015390863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4031cd0 con 0x7faaa814c4a0 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 -- 172.21.15.45:0/2015390863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 msgr2=0x7faaa8156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 --2- 172.21.15.45:0/2015390863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa8156490 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7faaa80c3540 tx=0x7faaa402b880 comp rx=0 tx=0).stop 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 -- 172.21.15.45:0/2015390863 shutdown_connections 2023-12-08T08:17:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 --2- 172.21.15.45:0/2015390863 >> v2:172.21.15.114:3300/0 conn(0x7faaa80a4d10 0x7faaa8155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 --2- 172.21.15.45:0/2015390863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa8156490 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 -- 172.21.15.45:0/2015390863 >> 172.21.15.45:0/2015390863 conn(0x7faaa80661f0 msgr2=0x7faaa8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 -- 172.21.15.45:0/2015390863 shutdown_connections 2023-12-08T08:17:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.632+0000 7faaaf66b640 1 -- 172.21.15.45:0/2015390863 wait complete. 2023-12-08T08:17:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.634+0000 7faaaf66b640 1 Processor -- start 2023-12-08T08:17:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.634+0000 7faaaf66b640 1 -- start start 2023-12-08T08:17:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa80a4d10 0x7faaa80bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa8155ec0 0x7faaa80a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81ea0a0 con 0x7faaa814c4a0 2023-12-08T08:17:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81ea340 con 0x7faaa8155ec0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.635+0000 7faaaf66b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa814ad00 con 0x7faaa80a4d10 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43032/0 (socket says 172.21.15.45:43032) 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 -- 172.21.15.45:0/3929868986 learned_addr learned my addr 172.21.15.45:0/3929868986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaad407640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa80a4d10 0x7faaa80bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 -- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa80a4d10 msgr2=0x7faaa80bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa80a4d10 0x7faaa80bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 -- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa8155ec0 msgr2=0x7faaa80a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa8155ec0 0x7faaa80a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 -- 172.21.15.45:0/3929868986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40094d0 con 0x7faaa814c4a0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.636+0000 7faaacc06640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c7f0 tx=0x7faa9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.637+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800cea0 con 0x7faaa814c4a0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.637+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98007a30 con 0x7faaa814c4a0 2023-12-08T08:17:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.637+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98007dc0 con 0x7faaa814c4a0 2023-12-08T08:17:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.637+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa814afe0 con 0x7faaa814c4a0 2023-12-08T08:17:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.637+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa80bf580 con 0x7faaa814c4a0 2023-12-08T08:17:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.638+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa81ea4f0 con 0x7faaa814c4a0 2023-12-08T08:17:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.639+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa980113f0 con 0x7faaa814c4a0 2023-12-08T08:17:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.640+0000 7faa9dffb640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 0x7faa8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.640+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa980898b0 con 0x7faaa814c4a0 2023-12-08T08:17:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.640+0000 7faaad407640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 0x7faa8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.641+0000 7faaad407640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 0x7faa8c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faaa4036000 tx=0x7faaa403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.644+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faaa81ea4f0 con 0x7faaa814c4a0 2023-12-08T08:17:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.842+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa814b500 con 0x7faaa814c4a0 2023-12-08T08:17:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.844+0000 7faa9dffb640 1 -- 172.21.15.45:0/3929868986 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16692 (secure 0 0 0) 0x7faa9801f090 con 0x7faaa814c4a0 2023-12-08T08:17:45.847 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:45.848 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:42.771596+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 msgr2=0x7faa8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 0x7faa8c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faaa4036000 tx=0x7faaa403d040 comp rx=0 tx=0).stop 2023-12-08T08:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 msgr2=0x7faaa81ea7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c7f0 tx=0x7faa9800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 shutdown_connections 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faa8c06ae70 0x7faa8c06d330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaa8155ec0 0x7faaa80a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa814c4a0 0x7faaa81ea7d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.847+0000 7faaaf66b640 1 --2- 172.21.15.45:0/3929868986 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faaa80a4d10 0x7faaa80bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.848+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 >> 172.21.15.45:0/3929868986 conn(0x7faaa80661f0 msgr2=0x7faaa8144be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.848+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 shutdown_connections 2023-12-08T08:17:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:45.848+0000 7faaaf66b640 1 -- 172.21.15.45:0/3929868986 wait complete. 2023-12-08T08:17:45.869 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:17:45.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:17:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.082+0000 7fb2ba259640 1 Processor -- start 2023-12-08T08:17:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.083+0000 7fb2ba259640 1 -- start start 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 0x7fb2b41584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2b40c44d0 0x7fb2b4154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b40c7a50 0x7fb2b40ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b41553b0 con 0x7fb2b40c44d0 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40c4a00 con 0x7fb2b41519c0 2023-12-08T08:17:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.084+0000 7fb2ba259640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40c4ce0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2b40c44d0 0x7fb2b4154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2b40c44d0 0x7fb2b4154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43042/0 (socket says 172.21.15.45:43042) 2023-12-08T08:17:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 -- 172.21.15.45:0/4222395998 learned_addr learned my addr 172.21.15.45:0/4222395998 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b9a58640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b40c7a50 0x7fb2b40ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b9257640 1 --2- 172.21.15.45:0/4222395998 >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 0x7fb2b41584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 -- 172.21.15.45:0/4222395998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b40c7a50 msgr2=0x7fb2b40ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b40c7a50 0x7fb2b40ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 -- 172.21.15.45:0/4222395998 >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 msgr2=0x7fb2b41584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/4222395998 >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 0x7fb2b41584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b8a56640 1 -- 172.21.15.45:0/4222395998 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b41579e0 con 0x7fb2b40c44d0 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.085+0000 7fb2b9257640 1 --2- 172.21.15.45:0/4222395998 >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 0x7fb2b41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.087+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c44d0 0x7fb2b4154e70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40c6cb0 tx=0x7fb2a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9cdfdc55e7f1dc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.087+0000 7fb2abfff640 1 -- 172.21.15.45:0/4222395998 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40317e0 con 0x7fb2b40c44d0 2023-12-08T08:17:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.087+0000 7fb2abfff640 1 -- 172.21.15.45:0/4222395998 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4031940 con 0x7fb2b40c44d0 2023-12-08T08:17:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.087+0000 7fb2abfff640 1 -- 172.21.15.45:0/4222395998 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4031cd0 con 0x7fb2b40c44d0 2023-12-08T08:17:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 -- 172.21.15.45:0/4222395998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c44d0 msgr2=0x7fb2b4154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c44d0 0x7fb2b4154e70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40c6cb0 tx=0x7fb2a402b880 comp rx=0 tx=0).stop 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 -- 172.21.15.45:0/4222395998 shutdown_connections 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b40c7a50 0x7fb2b40ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 --2- 172.21.15.45:0/4222395998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c44d0 0x7fb2b4154e70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 --2- 172.21.15.45:0/4222395998 >> v2:172.21.15.114:3300/0 conn(0x7fb2b41519c0 0x7fb2b41584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 -- 172.21.15.45:0/4222395998 >> 172.21.15.45:0/4222395998 conn(0x7fb2b40661f0 msgr2=0x7fb2b4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 -- 172.21.15.45:0/4222395998 shutdown_connections 2023-12-08T08:17:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.088+0000 7fb2ba259640 1 -- 172.21.15.45:0/4222395998 wait complete. 2023-12-08T08:17:46.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.090+0000 7fb2ba259640 1 Processor -- start 2023-12-08T08:17:46.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.090+0000 7fb2ba259640 1 -- start start 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 0x7fb2b41e95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b41519c0 0x7fb2b4150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41ea590 con 0x7fb2b40c7a50 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41e9ae0 con 0x7fb2b40c44d0 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2ba259640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b414d1a0 con 0x7fb2b41519c0 2023-12-08T08:17:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43048/0 (socket says 172.21.15.45:43048) 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 -- 172.21.15.45:0/3084956923 learned_addr learned my addr 172.21.15.45:0/3084956923 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b9257640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 0x7fb2b41e95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 -- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b41519c0 msgr2=0x7fb2b4150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b41519c0 0x7fb2b4150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 -- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 msgr2=0x7fb2b41e95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 0x7fb2b41e95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b8a56640 1 -- 172.21.15.45:0/3084956923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40094d0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.091+0000 7fb2b9257640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 0x7fb2b41e95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:46.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2b8a56640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4032880 con 0x7fb2b40c7a50 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4032a20 con 0x7fb2b40c7a50 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b414be90 con 0x7fb2b40c7a50 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4032dd0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.092+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41e9cf0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.093+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b414c020 con 0x7fb2b40c7a50 2023-12-08T08:17:46.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.094+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2a404e450 con 0x7fb2b40c7a50 2023-12-08T08:17:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.096+0000 7fb2a9ffb640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 0x7fb29806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.096+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2a40ab8a0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.096+0000 7fb2b9257640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 0x7fb29806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.097+0000 7fb2b9257640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 0x7fb29806d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40c8c50 tx=0x7fb2b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.101+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2a40768c0 con 0x7fb2b40c7a50 2023-12-08T08:17:46.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.292+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2b4151da0 con 0x7fb29806ae40 2023-12-08T08:17:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.306+0000 7fb2a9ffb640 1 -- 172.21.15.45:0/3084956923 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7fb2b0009d70 con 0x7fb29806ae40 2023-12-08T08:17:46.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:46.317 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 msgr2=0x7fb29806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 0x7fb29806d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40c8c50 tx=0x7fb2b0008040 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 msgr2=0x7fb2b414b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a40046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 shutdown_connections 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb29806ae40 0x7fb29806d300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb2b41519c0 0x7fb2b4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b40c7a50 0x7fb2b414b1a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 --2- 172.21.15.45:0/3084956923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b40c44d0 0x7fb2b41e95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 >> 172.21.15.45:0/3084956923 conn(0x7fb2b40661f0 msgr2=0x7fb2b40c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.312+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 shutdown_connections 2023-12-08T08:17:46.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.313+0000 7fb2ba259640 1 -- 172.21.15.45:0/3084956923 wait complete. 2023-12-08T08:17:46.336 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-12-08T08:17:45.757331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239524,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735196,"statfs":{"total":773094113280,"available":772848840704,"internally_reserved":0,"allocated":6823936,"data_stored":3696876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002188"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802758+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:41.802758+0000","last_peered":"2023-12-08T08:17:41.802758+0000","last_clean":"2023-12-08T08:17:41.802758+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:41.802758+0000","last_undegraded":"2023-12-08T08:17:41.802758+0000","last_fullsized":"2023-12-08T08:17:41.802758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:30:58.910606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.825238+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:41.825238+0000","last_peered":"2023-12-08T08:17:41.825238+0000","last_clean":"2023-12-08T08:17:41.825238+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:41.825238+0000","last_undegraded":"2023-12-08T08:17:41.825238+0000","last_fullsized":"2023-12-08T08:17:41.825238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:35:46.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822026+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:41.822026+0000","last_peered":"2023-12-08T08:17:41.822026+0000","last_clean":"2023-12-08T08:17:41.822026+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:41.822026+0000","last_undegraded":"2023-12-08T08:17:41.822026+0000","last_fullsized":"2023-12-08T08:17:41.822026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:43.637773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819790+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:41.819790+0000","last_peered":"2023-12-08T08:17:41.819790+0000","last_clean":"2023-12-08T08:17:41.819790+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:41.819790+0000","last_undegraded":"2023-12-08T08:17:41.819790+0000","last_fullsized":"2023-12-08T08:17:41.819790+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:42.214449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818124+0000","last_change":"2023-12-08T08:17:41.811943+0000","last_active":"2023-12-08T08:17:41.818124+0000","last_peered":"2023-12-08T08:17:41.818124+0000","last_clean":"2023-12-08T08:17:41.818124+0000","last_became_active":"2023-12-08T08:17:41.811666+0000","last_became_peered":"2023-12-08T08:17:41.811666+0000","last_unstale":"2023-12-08T08:17:41.818124+0000","last_undegraded":"2023-12-08T08:17:41.818124+0000","last_fullsized":"2023-12-08T08:17:41.818124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.817093+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:41.817093+0000","last_peered":"2023-12-08T08:17:41.817093+0000","last_clean":"2023-12-08T08:17:41.817093+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:41.817093+0000","last_undegraded":"2023-12-08T08:17:41.817093+0000","last_fullsized":"2023-12-08T08:17:41.817093+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818534+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:41.818534+0000","last_peered":"2023-12-08T08:17:41.818534+0000","last_clean":"2023-12-08T08:17:41.818534+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:41.818534+0000","last_undegraded":"2023-12-08T08:17:41.818534+0000","last_fullsized":"2023-12-08T08:17:41.818534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:25.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815761+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:41.815761+0000","last_peered":"2023-12-08T08:17:41.815761+0000","last_clean":"2023-12-08T08:17:41.815761+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:41.815761+0000","last_undegraded":"2023-12-08T08:17:41.815761+0000","last_fullsized":"2023-12-08T08:17:41.815761+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819789+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:41.819789+0000","last_peered":"2023-12-08T08:17:41.819789+0000","last_clean":"2023-12-08T08:17:41.819789+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:41.819789+0000","last_undegraded":"2023-12-08T08:17:41.819789+0000","last_fullsized":"2023-12-08T08:17:41.819789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:15.804413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819730+0000","last_change":"2023-12-08T08:17:41.817319+0000","last_active":"2023-12-08T08:17:41.819730+0000","last_peered":"2023-12-08T08:17:41.819730+0000","last_clean":"2023-12-08T08:17:41.819730+0000","last_became_active":"2023-12-08T08:17:41.816145+0000","last_became_peered":"2023-12-08T08:17:41.816145+0000","last_unstale":"2023-12-08T08:17:41.819730+0000","last_undegraded":"2023-12-08T08:17:41.819730+0000","last_fullsized":"2023-12-08T08:17:41.819730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:06.732423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.806413+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:41.806413+0000","last_peered":"2023-12-08T08:17:41.806413+0000","last_clean":"2023-12-08T08:17:41.806413+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:41.806413+0000","last_undegraded":"2023-12-08T08:17:41.806413+0000","last_fullsized":"2023-12-08T08:17:41.806413+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:08.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816037+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:41.816037+0000","last_peered":"2023-12-08T08:17:41.816037+0000","last_clean":"2023-12-08T08:17:41.816037+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:41.816037+0000","last_undegraded":"2023-12-08T08:17:41.816037+0000","last_fullsized":"2023-12-08T08:17:41.816037+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:43.637773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815231+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:41.815231+0000","last_peered":"2023-12-08T08:17:41.815231+0000","last_clean":"2023-12-08T08:17:41.815231+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:41.815231+0000","last_undegraded":"2023-12-08T08:17:41.815231+0000","last_fullsized":"2023-12-08T08:17:41.815231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.821007+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:41.821007+0000","last_peered":"2023-12-08T08:17:41.821007+0000","last_clean":"2023-12-08T08:17:41.821007+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:41.821007+0000","last_undegraded":"2023-12-08T08:17:41.821007+0000","last_fullsized":"2023-12-08T08:17:41.821007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820522+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:41.820522+0000","last_peered":"2023-12-08T08:17:41.820522+0000","last_clean":"2023-12-08T08:17:41.820522+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:41.820522+0000","last_undegraded":"2023-12-08T08:17:41.820522+0000","last_fullsized":"2023-12-08T08:17:41.820522+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:00:40.431715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.813765+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:41.813765+0000","last_peered":"2023-12-08T08:17:41.813765+0000","last_clean":"2023-12-08T08:17:41.813765+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:41.813765+0000","last_undegraded":"2023-12-08T08:17:41.813765+0000","last_fullsized":"2023-12-08T08:17:41.813765+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:03.992051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802739+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:41.802739+0000","last_peered":"2023-12-08T08:17:41.802739+0000","last_clean":"2023-12-08T08:17:41.802739+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:41.802739+0000","last_undegraded":"2023-12-08T08:17:41.802739+0000","last_fullsized":"2023-12-08T08:17:41.802739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:10.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819131+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:41.819131+0000","last_peered":"2023-12-08T08:17:41.819131+0000","last_clean":"2023-12-08T08:17:41.819131+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:41.819131+0000","last_undegraded":"2023-12-08T08:17:41.819131+0000","last_fullsized":"2023-12-08T08:17:41.819131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:34:48.331626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810999+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:41.810999+0000","last_peered":"2023-12-08T08:17:41.810999+0000","last_clean":"2023-12-08T08:17:41.810999+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:41.810999+0000","last_undegraded":"2023-12-08T08:17:41.810999+0000","last_fullsized":"2023-12-08T08:17:41.810999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:58:25.732536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810701+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:41.810701+0000","last_peered":"2023-12-08T08:17:41.810701+0000","last_clean":"2023-12-08T08:17:41.810701+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:41.810701+0000","last_undegraded":"2023-12-08T08:17:41.810701+0000","last_fullsized":"2023-12-08T08:17:41.810701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.807066+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:41.807066+0000","last_peered":"2023-12-08T08:17:41.807066+0000","last_clean":"2023-12-08T08:17:41.807066+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:41.807066+0000","last_undegraded":"2023-12-08T08:17:41.807066+0000","last_fullsized":"2023-12-08T08:17:41.807066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820374+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:41.820374+0000","last_peered":"2023-12-08T08:17:41.820374+0000","last_clean":"2023-12-08T08:17:41.820374+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:41.820374+0000","last_undegraded":"2023-12-08T08:17:41.820374+0000","last_fullsized":"2023-12-08T08:17:41.820374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816254+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:41.816254+0000","last_peered":"2023-12-08T08:17:41.816254+0000","last_clean":"2023-12-08T08:17:41.816254+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:41.816254+0000","last_undegraded":"2023-12-08T08:17:41.816254+0000","last_fullsized":"2023-12-08T08:17:41.816254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823497+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:41.823497+0000","last_peered":"2023-12-08T08:17:41.823497+0000","last_clean":"2023-12-08T08:17:41.823497+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:41.823497+0000","last_undegraded":"2023-12-08T08:17:41.823497+0000","last_fullsized":"2023-12-08T08:17:41.823497+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810343+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:41.810343+0000","last_peered":"2023-12-08T08:17:41.810343+0000","last_clean":"2023-12-08T08:17:41.810343+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:41.810343+0000","last_undegraded":"2023-12-08T08:17:41.810343+0000","last_fullsized":"2023-12-08T08:17:41.810343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:08.203457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.814760+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:41.814760+0000","last_peered":"2023-12-08T08:17:41.814760+0000","last_clean":"2023-12-08T08:17:41.814760+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:41.814760+0000","last_undegraded":"2023-12-08T08:17:41.814760+0000","last_fullsized":"2023-12-08T08:17:41.814760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810147+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:41.810147+0000","last_peered":"2023-12-08T08:17:41.810147+0000","last_clean":"2023-12-08T08:17:41.810147+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:41.810147+0000","last_undegraded":"2023-12-08T08:17:41.810147+0000","last_fullsized":"2023-12-08T08:17:41.810147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:23.878325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815028+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:41.815028+0000","last_peered":"2023-12-08T08:17:41.815028+0000","last_clean":"2023-12-08T08:17:41.815028+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:41.815028+0000","last_undegraded":"2023-12-08T08:17:41.815028+0000","last_fullsized":"2023-12-08T08:17:41.815028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:43:18.320731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820505+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:41.820505+0000","last_peered":"2023-12-08T08:17:41.820505+0000","last_clean":"2023-12-08T08:17:41.820505+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:41.820505+0000","last_undegraded":"2023-12-08T08:17:41.820505+0000","last_fullsized":"2023-12-08T08:17:41.820505+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815926+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:41.815926+0000","last_peered":"2023-12-08T08:17:41.815926+0000","last_clean":"2023-12-08T08:17:41.815926+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:41.815926+0000","last_undegraded":"2023-12-08T08:17:41.815926+0000","last_fullsized":"2023-12-08T08:17:41.815926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.808077+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:41.808077+0000","last_peered":"2023-12-08T08:17:41.808077+0000","last_clean":"2023-12-08T08:17:41.808077+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:41.808077+0000","last_undegraded":"2023-12-08T08:17:41.808077+0000","last_fullsized":"2023-12-08T08:17:41.808077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:20.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820900+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:41.820900+0000","last_peered":"2023-12-08T08:17:41.820900+0000","last_clean":"2023-12-08T08:17:41.820900+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:41.820900+0000","last_undegraded":"2023-12-08T08:17:41.820900+0000","last_fullsized":"2023-12-08T08:17:41.820900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818994+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:41.818994+0000","last_peered":"2023-12-08T08:17:41.818994+0000","last_clean":"2023-12-08T08:17:41.818994+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:41.818994+0000","last_undegraded":"2023-12-08T08:17:41.818994+0000","last_fullsized":"2023-12-08T08:17:41.818994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:48.344411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833816+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:41.833816+0000","last_peered":"2023-12-08T08:17:41.833816+0000","last_clean":"2023-12-08T08:17:41.833816+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:41.833816+0000","last_undegraded":"2023-12-08T08:17:41.833816+0000","last_fullsized":"2023-12-08T08:17:41.833816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816361+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:41.816361+0000","last_peered":"2023-12-08T08:17:41.816361+0000","last_clean":"2023-12-08T08:17:41.816361+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:41.816361+0000","last_undegraded":"2023-12-08T08:17:41.816361+0000","last_fullsized":"2023-12-08T08:17:41.816361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:25.607717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.830015+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:41.830015+0000","last_peered":"2023-12-08T08:17:41.830015+0000","last_clean":"2023-12-08T08:17:41.830015+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:41.830015+0000","last_undegraded":"2023-12-08T08:17:41.830015+0000","last_fullsized":"2023-12-08T08:17:41.830015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.821384+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:41.821384+0000","last_peered":"2023-12-08T08:17:41.821384+0000","last_clean":"2023-12-08T08:17:41.821384+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:41.821384+0000","last_undegraded":"2023-12-08T08:17:41.821384+0000","last_fullsized":"2023-12-08T08:17:41.821384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.828623+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:41.828623+0000","last_peered":"2023-12-08T08:17:41.828623+0000","last_clean":"2023-12-08T08:17:41.828623+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:41.828623+0000","last_undegraded":"2023-12-08T08:17:41.828623+0000","last_fullsized":"2023-12-08T08:17:41.828623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819767+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:41.819767+0000","last_peered":"2023-12-08T08:17:41.819767+0000","last_clean":"2023-12-08T08:17:41.819767+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:41.819767+0000","last_undegraded":"2023-12-08T08:17:41.819767+0000","last_fullsized":"2023-12-08T08:17:41.819767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:26.918764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829168+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:41.829168+0000","last_peered":"2023-12-08T08:17:41.829168+0000","last_clean":"2023-12-08T08:17:41.829168+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:41.829168+0000","last_undegraded":"2023-12-08T08:17:41.829168+0000","last_fullsized":"2023-12-08T08:17:41.829168+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.811729+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:41.811729+0000","last_peered":"2023-12-08T08:17:41.811729+0000","last_clean":"2023-12-08T08:17:41.811729+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:41.811729+0000","last_undegraded":"2023-12-08T08:17:41.811729+0000","last_fullsized":"2023-12-08T08:17:41.811729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:01.021719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829969+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:41.829969+0000","last_peered":"2023-12-08T08:17:41.829969+0000","last_clean":"2023-12-08T08:17:41.829969+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:41.829969+0000","last_undegraded":"2023-12-08T08:17:41.829969+0000","last_fullsized":"2023-12-08T08:17:41.829969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.796889+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:41.796889+0000","last_peered":"2023-12-08T08:17:41.796889+0000","last_clean":"2023-12-08T08:17:41.796889+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:41.796889+0000","last_undegraded":"2023-12-08T08:17:41.796889+0000","last_fullsized":"2023-12-08T08:17:41.796889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:26:30.123324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.830406+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:41.830406+0000","last_peered":"2023-12-08T08:17:41.830406+0000","last_clean":"2023-12-08T08:17:41.830406+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:41.830406+0000","last_undegraded":"2023-12-08T08:17:41.830406+0000","last_fullsized":"2023-12-08T08:17:41.830406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823513+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:41.823513+0000","last_peered":"2023-12-08T08:17:41.823513+0000","last_clean":"2023-12-08T08:17:41.823513+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:41.823513+0000","last_undegraded":"2023-12-08T08:17:41.823513+0000","last_fullsized":"2023-12-08T08:17:41.823513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:23.878325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791159+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:41.791159+0000","last_peered":"2023-12-08T08:17:41.791159+0000","last_clean":"2023-12-08T08:17:41.791159+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:41.791159+0000","last_undegraded":"2023-12-08T08:17:41.791159+0000","last_fullsized":"2023-12-08T08:17:41.791159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816893+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:41.816893+0000","last_peered":"2023-12-08T08:17:41.816893+0000","last_clean":"2023-12-08T08:17:41.816893+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:41.816893+0000","last_undegraded":"2023-12-08T08:17:41.816893+0000","last_fullsized":"2023-12-08T08:17:41.816893+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.799250+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:41.799250+0000","last_peered":"2023-12-08T08:17:41.799250+0000","last_clean":"2023-12-08T08:17:41.799250+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:41.799250+0000","last_undegraded":"2023-12-08T08:17:41.799250+0000","last_fullsized":"2023-12-08T08:17:41.799250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819394+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:41.819394+0000","last_peered":"2023-12-08T08:17:41.819394+0000","last_clean":"2023-12-08T08:17:41.819394+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:41.819394+0000","last_undegraded":"2023-12-08T08:17:41.819394+0000","last_fullsized":"2023-12-08T08:17:41.819394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:12.056755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.806531+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:41.806531+0000","last_peered":"2023-12-08T08:17:41.806531+0000","last_clean":"2023-12-08T08:17:41.806531+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:41.806531+0000","last_undegraded":"2023-12-08T08:17:41.806531+0000","last_fullsized":"2023-12-08T08:17:41.806531+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810631+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:41.810631+0000","last_peered":"2023-12-08T08:17:41.810631+0000","last_clean":"2023-12-08T08:17:41.810631+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:41.810631+0000","last_undegraded":"2023-12-08T08:17:41.810631+0000","last_fullsized":"2023-12-08T08:17:41.810631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:05.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.782935+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:41.782935+0000","last_peered":"2023-12-08T08:17:41.782935+0000","last_clean":"2023-12-08T08:17:41.782935+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:41.782935+0000","last_undegraded":"2023-12-08T08:17:41.782935+0000","last_fullsized":"2023-12-08T08:17:41.782935+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816888+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:41.816888+0000","last_peered":"2023-12-08T08:17:41.816888+0000","last_clean":"2023-12-08T08:17:41.816888+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:41.816888+0000","last_undegraded":"2023-12-08T08:17:41.816888+0000","last_fullsized":"2023-12-08T08:17:41.816888+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833683+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:41.833683+0000","last_peered":"2023-12-08T08:17:41.833683+0000","last_clean":"2023-12-08T08:17:41.833683+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:41.833683+0000","last_undegraded":"2023-12-08T08:17:41.833683+0000","last_fullsized":"2023-12-08T08:17:41.833683+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.805738+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:41.805738+0000","last_peered":"2023-12-08T08:17:41.805738+0000","last_clean":"2023-12-08T08:17:41.805738+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:41.805738+0000","last_undegraded":"2023-12-08T08:17:41.805738+0000","last_fullsized":"2023-12-08T08:17:41.805738+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:28.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"58'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.834043+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:41.834043+0000","last_peered":"2023-12-08T08:17:41.834043+0000","last_clean":"2023-12-08T08:17:41.834043+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:41.834043+0000","last_undegraded":"2023-12-08T08:17:41.834043+0000","last_fullsized":"2023-12-08T08:17:41.834043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819165+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:41.819165+0000","last_peered":"2023-12-08T08:17:41.819165+0000","last_clean":"2023-12-08T08:17:41.819165+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:41.819165+0000","last_undegraded":"2023-12-08T08:17:41.819165+0000","last_fullsized":"2023-12-08T08:17:41.819165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:15.551917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833501+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:41.833501+0000","last_peered":"2023-12-08T08:17:41.833501+0000","last_clean":"2023-12-08T08:17:41.833501+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:41.833501+0000","last_undegraded":"2023-12-08T08:17:41.833501+0000","last_fullsized":"2023-12-08T08:17:41.833501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822633+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:41.822633+0000","last_peered":"2023-12-08T08:17:41.822633+0000","last_clean":"2023-12-08T08:17:41.822633+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:41.822633+0000","last_undegraded":"2023-12-08T08:17:41.822633+0000","last_fullsized":"2023-12-08T08:17:41.822633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791182+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:41.791182+0000","last_peered":"2023-12-08T08:17:41.791182+0000","last_clean":"2023-12-08T08:17:41.791182+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:41.791182+0000","last_undegraded":"2023-12-08T08:17:41.791182+0000","last_fullsized":"2023-12-08T08:17:41.791182+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815798+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:41.815798+0000","last_peered":"2023-12-08T08:17:41.815798+0000","last_clean":"2023-12-08T08:17:41.815798+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:41.815798+0000","last_undegraded":"2023-12-08T08:17:41.815798+0000","last_fullsized":"2023-12-08T08:17:41.815798+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:08.622694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.804862+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:41.804862+0000","last_peered":"2023-12-08T08:17:41.804862+0000","last_clean":"2023-12-08T08:17:41.804862+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:41.804862+0000","last_undegraded":"2023-12-08T08:17:41.804862+0000","last_fullsized":"2023-12-08T08:17:41.804862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815217+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:41.815217+0000","last_peered":"2023-12-08T08:17:41.815217+0000","last_clean":"2023-12-08T08:17:41.815217+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:41.815217+0000","last_undegraded":"2023-12-08T08:17:41.815217+0000","last_fullsized":"2023-12-08T08:17:41.815217+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:11.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.836370+0000","last_change":"2023-12-08T08:17:40.785017+0000","last_active":"2023-12-08T08:17:41.836370+0000","last_peered":"2023-12-08T08:17:41.836370+0000","last_clean":"2023-12-08T08:17:41.836370+0000","last_became_active":"2023-12-08T08:17:40.784751+0000","last_became_peered":"2023-12-08T08:17:40.784751+0000","last_unstale":"2023-12-08T08:17:41.836370+0000","last_undegraded":"2023-12-08T08:17:41.836370+0000","last_fullsized":"2023-12-08T08:17:41.836370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:56.448134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819794+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:41.819794+0000","last_peered":"2023-12-08T08:17:41.819794+0000","last_clean":"2023-12-08T08:17:41.819794+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:41.819794+0000","last_undegraded":"2023-12-08T08:17:41.819794+0000","last_fullsized":"2023-12-08T08:17:41.819794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:08.203457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829266+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:41.829266+0000","last_peered":"2023-12-08T08:17:41.829266+0000","last_clean":"2023-12-08T08:17:41.829266+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:41.829266+0000","last_undegraded":"2023-12-08T08:17:41.829266+0000","last_fullsized":"2023-12-08T08:17:41.829266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818094+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:41.818094+0000","last_peered":"2023-12-08T08:17:41.818094+0000","last_clean":"2023-12-08T08:17:41.818094+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:41.818094+0000","last_undegraded":"2023-12-08T08:17:41.818094+0000","last_fullsized":"2023-12-08T08:17:41.818094+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833563+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:41.833563+0000","last_peered":"2023-12-08T08:17:41.833563+0000","last_clean":"2023-12-08T08:17:41.833563+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:41.833563+0000","last_undegraded":"2023-12-08T08:17:41.833563+0000","last_fullsized":"2023-12-08T08:17:41.833563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818239+0000","last_change":"2023-12-08T08:17:41.813667+0000","last_active":"2023-12-08T08:17:41.818239+0000","last_peered":"2023-12-08T08:17:41.818239+0000","last_clean":"2023-12-08T08:17:41.818239+0000","last_became_active":"2023-12-08T08:17:41.811674+0000","last_became_peered":"2023-12-08T08:17:41.811674+0000","last_unstale":"2023-12-08T08:17:41.818239+0000","last_undegraded":"2023-12-08T08:17:41.818239+0000","last_fullsized":"2023-12-08T08:17:41.818239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:00.629728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833606+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:41.833606+0000","last_peered":"2023-12-08T08:17:41.833606+0000","last_clean":"2023-12-08T08:17:41.833606+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:41.833606+0000","last_undegraded":"2023-12-08T08:17:41.833606+0000","last_fullsized":"2023-12-08T08:17:41.833606+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818162+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:41.818162+0000","last_peered":"2023-12-08T08:17:41.818162+0000","last_clean":"2023-12-08T08:17:41.818162+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:41.818162+0000","last_undegraded":"2023-12-08T08:17:41.818162+0000","last_fullsized":"2023-12-08T08:17:41.818162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:00.629728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.795140+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:41.795140+0000","last_peered":"2023-12-08T08:17:41.795140+0000","last_clean":"2023-12-08T08:17:41.795140+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:41.795140+0000","last_undegraded":"2023-12-08T08:17:41.795140+0000","last_fullsized":"2023-12-08T08:17:41.795140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820881+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:41.820881+0000","last_peered":"2023-12-08T08:17:41.820881+0000","last_clean":"2023-12-08T08:17:41.820881+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:41.820881+0000","last_undegraded":"2023-12-08T08:17:41.820881+0000","last_fullsized":"2023-12-08T08:17:41.820881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829268+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:41.829268+0000","last_peered":"2023-12-08T08:17:41.829268+0000","last_clean":"2023-12-08T08:17:41.829268+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:41.829268+0000","last_undegraded":"2023-12-08T08:17:41.829268+0000","last_fullsized":"2023-12-08T08:17:41.829268+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.814987+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:41.814987+0000","last_peered":"2023-12-08T08:17:41.814987+0000","last_clean":"2023-12-08T08:17:41.814987+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:41.814987+0000","last_undegraded":"2023-12-08T08:17:41.814987+0000","last_fullsized":"2023-12-08T08:17:41.814987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:26.918764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791572+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:41.791572+0000","last_peered":"2023-12-08T08:17:41.791572+0000","last_clean":"2023-12-08T08:17:41.791572+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:41.791572+0000","last_undegraded":"2023-12-08T08:17:41.791572+0000","last_fullsized":"2023-12-08T08:17:41.791572+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823493+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:41.823493+0000","last_peered":"2023-12-08T08:17:41.823493+0000","last_clean":"2023-12-08T08:17:41.823493+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:41.823493+0000","last_undegraded":"2023-12-08T08:17:41.823493+0000","last_fullsized":"2023-12-08T08:17:41.823493+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:34:48.331626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791537+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:41.791537+0000","last_peered":"2023-12-08T08:17:41.791537+0000","last_clean":"2023-12-08T08:17:41.791537+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:41.791537+0000","last_undegraded":"2023-12-08T08:17:41.791537+0000","last_fullsized":"2023-12-08T08:17:41.791537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.817419+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:41.817419+0000","last_peered":"2023-12-08T08:17:41.817419+0000","last_clean":"2023-12-08T08:17:41.817419+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:41.817419+0000","last_undegraded":"2023-12-08T08:17:41.817419+0000","last_fullsized":"2023-12-08T08:17:41.817419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:05.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.827292+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:41.827292+0000","last_peered":"2023-12-08T08:17:41.827292+0000","last_clean":"2023-12-08T08:17:41.827292+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:41.827292+0000","last_undegraded":"2023-12-08T08:17:41.827292+0000","last_fullsized":"2023-12-08T08:17:41.827292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.825552+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:41.825552+0000","last_peered":"2023-12-08T08:17:41.825552+0000","last_clean":"2023-12-08T08:17:41.825552+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:41.825552+0000","last_undegraded":"2023-12-08T08:17:41.825552+0000","last_fullsized":"2023-12-08T08:17:41.825552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:52.725670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791293+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:41.791293+0000","last_peered":"2023-12-08T08:17:41.791293+0000","last_clean":"2023-12-08T08:17:41.791293+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:41.791293+0000","last_undegraded":"2023-12-08T08:17:41.791293+0000","last_fullsized":"2023-12-08T08:17:41.791293+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822616+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:41.822616+0000","last_peered":"2023-12-08T08:17:41.822616+0000","last_clean":"2023-12-08T08:17:41.822616+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:41.822616+0000","last_undegraded":"2023-12-08T08:17:41.822616+0000","last_fullsized":"2023-12-08T08:17:41.822616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.789579+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:41.789579+0000","last_peered":"2023-12-08T08:17:41.789579+0000","last_clean":"2023-12-08T08:17:41.789579+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:41.789579+0000","last_undegraded":"2023-12-08T08:17:41.789579+0000","last_fullsized":"2023-12-08T08:17:41.789579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818143+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:41.818143+0000","last_peered":"2023-12-08T08:17:41.818143+0000","last_clean":"2023-12-08T08:17:41.818143+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:41.818143+0000","last_undegraded":"2023-12-08T08:17:41.818143+0000","last_fullsized":"2023-12-08T08:17:41.818143+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:57.462443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.778950+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:41.778950+0000","last_peered":"2023-12-08T08:17:41.778950+0000","last_clean":"2023-12-08T08:17:41.778950+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:41.778950+0000","last_undegraded":"2023-12-08T08:17:41.778950+0000","last_fullsized":"2023-12-08T08:17:41.778950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.807041+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:41.807041+0000","last_peered":"2023-12-08T08:17:41.807041+0000","last_clean":"2023-12-08T08:17:41.807041+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:41.807041+0000","last_undegraded":"2023-12-08T08:17:41.807041+0000","last_fullsized":"2023-12-08T08:17:41.807041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:28.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802785+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:41.802785+0000","last_peered":"2023-12-08T08:17:41.802785+0000","last_clean":"2023-12-08T08:17:41.802785+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:41.802785+0000","last_undegraded":"2023-12-08T08:17:41.802785+0000","last_fullsized":"2023-12-08T08:17:41.802785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816400+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:41.816400+0000","last_peered":"2023-12-08T08:17:41.816400+0000","last_clean":"2023-12-08T08:17:41.816400+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:41.816400+0000","last_undegraded":"2023-12-08T08:17:41.816400+0000","last_fullsized":"2023-12-08T08:17:41.816400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:48.344411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.790889+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:41.790889+0000","last_peered":"2023-12-08T08:17:41.790889+0000","last_clean":"2023-12-08T08:17:41.790889+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:41.790889+0000","last_undegraded":"2023-12-08T08:17:41.790889+0000","last_fullsized":"2023-12-08T08:17:41.790889+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.801369+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:41.801369+0000","last_peered":"2023-12-08T08:17:41.801369+0000","last_clean":"2023-12-08T08:17:41.801369+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:41.801369+0000","last_undegraded":"2023-12-08T08:17:41.801369+0000","last_fullsized":"2023-12-08T08:17:41.801369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:18.496367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791550+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:41.791550+0000","last_peered":"2023-12-08T08:17:41.791550+0000","last_clean":"2023-12-08T08:17:41.791550+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:41.791550+0000","last_undegraded":"2023-12-08T08:17:41.791550+0000","last_fullsized":"2023-12-08T08:17:41.791550+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819904+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:41.819904+0000","last_peered":"2023-12-08T08:17:41.819904+0000","last_clean":"2023-12-08T08:17:41.819904+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:41.819904+0000","last_undegraded":"2023-12-08T08:17:41.819904+0000","last_fullsized":"2023-12-08T08:17:41.819904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:20.719389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.776887+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:41.776887+0000","last_peered":"2023-12-08T08:17:41.776887+0000","last_clean":"2023-12-08T08:17:41.776887+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:41.776887+0000","last_undegraded":"2023-12-08T08:17:41.776887+0000","last_fullsized":"2023-12-08T08:17:41.776887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819068+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:41.819068+0000","last_peered":"2023-12-08T08:17:41.819068+0000","last_clean":"2023-12-08T08:17:41.819068+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:41.819068+0000","last_undegraded":"2023-12-08T08:17:41.819068+0000","last_fullsized":"2023-12-08T08:17:41.819068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:08.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.794158+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:41.794158+0000","last_peered":"2023-12-08T08:17:41.794158+0000","last_clean":"2023-12-08T08:17:41.794158+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:41.794158+0000","last_undegraded":"2023-12-08T08:17:41.794158+0000","last_fullsized":"2023-12-08T08:17:41.794158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-08T08:17:40.776562+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:40.776562+0000","last_peered":"2023-12-08T08:17:40.776562+0000","last_clean":"2023-12-08T08:17:40.776562+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:40.776562+0000","last_undegraded":"2023-12-08T08:17:40.776562+0000","last_fullsized":"2023-12-08T08:17:40.776562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1306624,"data_stored":905059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.58599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3600000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.0800000000000001},"min":{"1min":0.73999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.153,"15min":1.159},"min":{"1min":0.71099999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.351},{"interface":"front","average":{"1min":1.131,"5min":1.224,"15min":1.24},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.175,"15min":1.177},"min":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.474,"5min":1.863,"15min":1.863},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.325,"15min":1.333},"min":{"1min":0.86199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.6040000000000001,"5min":1.855,"15min":1.855},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.405,"15min":1.419},"min":{"1min":0.92900000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.671,"5min":3.524,"15min":3.524},"last":1.4530000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.393,"15min":1.407},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.702,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3600000000000001,"15min":1.353},"min":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.754,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":0.98799999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.9239999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.415},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.508,"15min":1.504},"min":{"1min":0.91500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0009999999999999,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.3}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.6419999999999999,"15min":1.6559999999999999},"min":{"1min":0.99299999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9019999999999999,"5min":2.609,"15min":2.609},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":1.01,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.101,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4850000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":313949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.75,"15min":1.857},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4770000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.845,"15min":1.978},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.365,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.131,"15min":1.111},"min":{"1min":0.95099999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4830000000000001,"5min":1.762,"15min":1.762},"last":1.016},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2250000000000001,"15min":1.2370000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5229999999999999,"5min":2.141,"15min":2.141},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5680000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.397,"15min":1.425},"min":{"1min":0.77800000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5600000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8640000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.4379999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.341,"15min":1.349},"min":{"1min":0.98199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.401,"15min":1.4139999999999999},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6759999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.484,"15min":1.4990000000000001},"min":{"1min":1.089,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.972,"5min":2.96,"15min":2.96},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.208,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7809999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.6819999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.478,"15min":1.484},"min":{"1min":1.2270000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7410000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.595,"15min":1.6140000000000001},"min":{"1min":1.0600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0760000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.538}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":313937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0980000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.64500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.224,"15min":1.238},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.1859999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.294,"15min":1.306},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3560000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6299999999999999,"5min":1.96,"15min":1.96},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4239999999999999,"15min":1.4299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.2}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2909999999999999,"15min":1.2969999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.248},{"interface":"front","average":{"1min":1.337,"5min":1.365,"15min":1.3700000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.73,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4099999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.389,"15min":1.3959999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.425,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.468}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.4710000000000001,"15min":1.4650000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.54,"5min":1.516,"15min":1.512},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.6339999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":315527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.012,"15min":1.004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.141,"15min":1.1539999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5009999999999999,"5min":2.335,"15min":2.335},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.097},{"interface":"front","average":{"1min":1.046,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.458}]},{"osd":2,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5429999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.393,"15min":1.409},"min":{"1min":0.74099999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2109999999999999,"5min":2.456,"15min":2.456},"last":1.518}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2050000000000001,"15min":1.2090000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.397},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.431}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4650000000000001,"15min":1.4830000000000001},"min":{"1min":0.58699999999999997,"5min":0.501,"15min":0.501},"max":{"1min":2.081,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.159},{"interface":"front","average":{"1min":1.262,"5min":1.413,"15min":1.4379999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6859999999999999,"5min":2.137,"15min":2.137},"last":1.286}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4750000000000001,"15min":1.5049999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.776,"5min":3.016,"15min":3.016},"last":1.329},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.5620000000000001,"15min":1.5860000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.5760000000000001,"15min":1.599},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.827,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.585},{"interface":"front","average":{"1min":1.544,"5min":1.6679999999999999,"15min":1.6879999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1600000000000001,"5min":3.141,"15min":3.141},"last":1.204}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":313915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.95599999999999996,"15min":0.96599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.464},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.03,"15min":1.044},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5459999999999998,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.014}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.99299999999999999,"15min":0.99199999999999999},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.091}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.53300000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.835,"5min":1.97,"15min":1.97},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.84399999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3420000000000001,"15min":1.363},"min":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.458,"15min":1.494},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0209999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.649},{"interface":"front","average":{"1min":1.375,"5min":1.3819999999999999,"15min":1.383},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.202}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4279999999999999,"15min":1.4430000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9550000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.52},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5569999999999999,"15min":1.5840000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1930000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.7549999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.478,"15min":1.49},"min":{"1min":0.94199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.476,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.444},{"interface":"front","average":{"1min":1.466,"5min":1.5960000000000001,"15min":1.6180000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.2330000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6020000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":313915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.749},{"interface":"front","average":{"1min":1.075,"5min":0.92300000000000004,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.95399999999999996,"15min":0.94799999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.61399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.476,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.226}]},{"osd":4,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3180000000000001,"15min":1.3160000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.385,"15min":1.397},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.994,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3520000000000001,"15min":1.369},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3029999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.399,"15min":1.4059999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.4259999999999999,"15min":1.431},"min":{"1min":0.91600000000000004,"5min":0.879,"15min":0.879},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.399,"15min":1.413},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.478,"15min":1.466},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.546},{"interface":"front","average":{"1min":1.518,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":0.91500000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.504}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":316291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.88},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.306,"5min":1.585,"15min":1.585},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.97399999999999998,"15min":0.98399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.877,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.329,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5429999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.55000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.764,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.1259999999999999,"15min":1.1399999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1669999999999998,"5min":2.327,"15min":2.327},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6559999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.464,"15min":1.504},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.5089999999999999,"5min":2.552,"15min":2.552},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.4670000000000001,"15min":1.5009999999999999},"min":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3900000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.425,"15min":1.4570000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6220000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.097}]},{"osd":6,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.581,"15min":1.609},"min":{"1min":0.76000000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2989999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.546,"15min":1.5800000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.843,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.571,"15min":1.601},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.016,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.675,"15min":1.6850000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.0149999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":904283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.44400000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.228,"5min":2.194,"15min":2.194},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0669999999999999,"15min":1.093},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.538,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.149,"15min":1.1679999999999999},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.77,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1599999999999999,"15min":1.179},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.859,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.014}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.091,"15min":1.121},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5229999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.29,"15min":1.3129999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.764,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.5189999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4690000000000001,"15min":1.5069999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9610000000000001,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.466},{"interface":"front","average":{"1min":1.181,"5min":1.321,"15min":1.3440000000000001},"min":{"1min":0.77300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.5149999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.204}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4330000000000001,"15min":1.4530000000000001},"min":{"1min":0.80600000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.609,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3979999999999999,"15min":1.4039999999999999},"min":{"1min":0.82299999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.679,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.716}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.53,"15min":1.5449999999999999},"min":{"1min":0.89400000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7649999999999999,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.823},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5800000000000001,"15min":1.6140000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0419999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.304}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":0.94499999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1179999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.641},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0190000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3340000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:17:46.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:17:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.610+0000 7efc60d2c640 1 Processor -- start 2023-12-08T08:17:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.610+0000 7efc60d2c640 1 -- start start 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc60d2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc5c15c220 0x7efc5c15c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc60d2c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efc5c155bf0 0x7efc5c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc60d2c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c06d230 con 0x7efc5c159eb0 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc60d2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0c6090 con 0x7efc5c15c220 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc60d2c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0c46c0 con 0x7efc5c155bf0 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc5a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc5c15c220 0x7efc5c15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc5a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc5c15c220 0x7efc5c15c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43054/0 (socket says 172.21.15.45:43054) 2023-12-08T08:17:46.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.612+0000 7efc5a59c640 1 -- 172.21.15.45:0/1347924284 learned_addr learned my addr 172.21.15.45:0/1347924284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:46.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.613+0000 7efc5a59c640 1 -- 172.21.15.45:0/1347924284 >> v2:172.21.15.114:3300/0 conn(0x7efc5c155bf0 msgr2=0x7efc5c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:46.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.613+0000 7efc5a59c640 1 --2- 172.21.15.45:0/1347924284 >> v2:172.21.15.114:3300/0 conn(0x7efc5c155bf0 0x7efc5c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.613+0000 7efc5a59c640 1 -- 172.21.15.45:0/1347924284 >> v1:172.21.15.114:6789/0 conn(0x7efc5c159eb0 legacy=0x7efc5c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:46.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.613+0000 7efc5a59c640 1 -- 172.21.15.45:0/1347924284 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c06d480 con 0x7efc5c15c220 2023-12-08T08:17:46.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.614+0000 7efc5a59c640 1 --2- 172.21.15.45:0/1347924284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c15c220 0x7efc5c15c600 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efc5c06cfb0 tx=0x7efc4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca6e7dd30e6c42a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.614+0000 7efc59d9b640 1 -- 172.21.15.45:0/1347924284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0317e0 con 0x7efc5c15c220 2023-12-08T08:17:46.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.614+0000 7efc59d9b640 1 -- 172.21.15.45:0/1347924284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c031940 con 0x7efc5c15c220 2023-12-08T08:17:46.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.614+0000 7efc59d9b640 1 -- 172.21.15.45:0/1347924284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c031cd0 con 0x7efc5c15c220 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 -- 172.21.15.45:0/1347924284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c15c220 msgr2=0x7efc5c15c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 --2- 172.21.15.45:0/1347924284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c15c220 0x7efc5c15c600 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efc5c06cfb0 tx=0x7efc4c02b880 comp rx=0 tx=0).stop 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 -- 172.21.15.45:0/1347924284 shutdown_connections 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 --2- 172.21.15.45:0/1347924284 >> v2:172.21.15.114:3300/0 conn(0x7efc5c155bf0 0x7efc5c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 --2- 172.21.15.45:0/1347924284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c15c220 0x7efc5c15c600 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 -- 172.21.15.45:0/1347924284 >> 172.21.15.45:0/1347924284 conn(0x7efc5c0661f0 msgr2=0x7efc5c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:46.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 -- 172.21.15.45:0/1347924284 shutdown_connections 2023-12-08T08:17:46.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.615+0000 7efc60d2c640 1 -- 172.21.15.45:0/1347924284 wait complete. 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.617+0000 7efc60d2c640 1 Processor -- start 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.617+0000 7efc60d2c640 1 -- start start 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc5c155bf0 0x7efc5c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc5c15c220 0x7efc5c1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0a2260 con 0x7efc5c159eb0 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1f29d0 con 0x7efc5c155bf0 2023-12-08T08:17:46.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc60d2c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0a2790 con 0x7efc5c15c220 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43056/0 (socket says 172.21.15.45:43056) 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc53fff640 1 -- 172.21.15.45:0/179229598 learned_addr learned my addr 172.21.15.45:0/179229598 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.618+0000 7efc5a59c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc5c155bf0 0x7efc5c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc5ad9d640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc5c15c220 0x7efc5c1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 -- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc5c15c220 msgr2=0x7efc5c1f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc5c15c220 0x7efc5c1f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 -- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc5c155bf0 msgr2=0x7efc5c1f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc5c155bf0 0x7efc5c1f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 -- 172.21.15.45:0/179229598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c0094d0 con 0x7efc5c159eb0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc53fff640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7efc4400b410 tx=0x7efc4400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011830 con 0x7efc5c159eb0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440119b0 con 0x7efc5c159eb0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011d60 con 0x7efc5c159eb0 2023-12-08T08:17:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.619+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c1f2c40 con 0x7efc5c159eb0 2023-12-08T08:17:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.620+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c071ce0 con 0x7efc5c159eb0 2023-12-08T08:17:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.621+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c1efee0 con 0x7efc5c159eb0 2023-12-08T08:17:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.622+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc4401a400 con 0x7efc5c159eb0 2023-12-08T08:17:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.622+0000 7efc52ffd640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 0x7efc3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.623+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc44089840 con 0x7efc5c159eb0 2023-12-08T08:17:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.623+0000 7efc5a59c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 0x7efc3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.624+0000 7efc5a59c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 0x7efc3c06d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc4c036000 tx=0x7efc4c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:46.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.627+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc5c1efee0 con 0x7efc5c159eb0 2023-12-08T08:17:46.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.828+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc5c0c5cb0 con 0x7efc3c06ae40 2023-12-08T08:17:46.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.858+0000 7efc52ffd640 1 -- 172.21.15.45:0/179229598 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7efc4c031c30 con 0x7efc3c06ae40 2023-12-08T08:17:46.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:46.866 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:17:46.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 msgr2=0x7efc3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 0x7efc3c06d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc4c036000 tx=0x7efc4c03d040 comp rx=0 tx=0).stop 2023-12-08T08:17:46.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 msgr2=0x7efc5c1f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:46.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7efc4400b410 tx=0x7efc4400b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 shutdown_connections 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efc3c06ae40 0x7efc3c06d300 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efc5c15c220 0x7efc5c1f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c159eb0 0x7efc5c1f1f50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 --2- 172.21.15.45:0/179229598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc5c155bf0 0x7efc5c1f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 >> 172.21.15.45:0/179229598 conn(0x7efc5c0661f0 msgr2=0x7efc5c15c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:46.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 shutdown_connections 2023-12-08T08:17:46.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:46.865+0000 7efc60d2c640 1 -- 172.21.15.45:0/179229598 wait complete. 2023-12-08T08:17:46.889 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-12-08T08:17:45.757331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239524,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735196,"statfs":{"total":773094113280,"available":772848840704,"internally_reserved":0,"allocated":6823936,"data_stored":3696876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002188"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802758+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:41.802758+0000","last_peered":"2023-12-08T08:17:41.802758+0000","last_clean":"2023-12-08T08:17:41.802758+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:41.802758+0000","last_undegraded":"2023-12-08T08:17:41.802758+0000","last_fullsized":"2023-12-08T08:17:41.802758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:30:58.910606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.825238+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:41.825238+0000","last_peered":"2023-12-08T08:17:41.825238+0000","last_clean":"2023-12-08T08:17:41.825238+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:41.825238+0000","last_undegraded":"2023-12-08T08:17:41.825238+0000","last_fullsized":"2023-12-08T08:17:41.825238+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:35:46.389579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822026+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:41.822026+0000","last_peered":"2023-12-08T08:17:41.822026+0000","last_clean":"2023-12-08T08:17:41.822026+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:41.822026+0000","last_undegraded":"2023-12-08T08:17:41.822026+0000","last_fullsized":"2023-12-08T08:17:41.822026+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:43.637773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819790+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:41.819790+0000","last_peered":"2023-12-08T08:17:41.819790+0000","last_clean":"2023-12-08T08:17:41.819790+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:41.819790+0000","last_undegraded":"2023-12-08T08:17:41.819790+0000","last_fullsized":"2023-12-08T08:17:41.819790+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:42.214449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818124+0000","last_change":"2023-12-08T08:17:41.811943+0000","last_active":"2023-12-08T08:17:41.818124+0000","last_peered":"2023-12-08T08:17:41.818124+0000","last_clean":"2023-12-08T08:17:41.818124+0000","last_became_active":"2023-12-08T08:17:41.811666+0000","last_became_peered":"2023-12-08T08:17:41.811666+0000","last_unstale":"2023-12-08T08:17:41.818124+0000","last_undegraded":"2023-12-08T08:17:41.818124+0000","last_fullsized":"2023-12-08T08:17:41.818124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.817093+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:41.817093+0000","last_peered":"2023-12-08T08:17:41.817093+0000","last_clean":"2023-12-08T08:17:41.817093+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:41.817093+0000","last_undegraded":"2023-12-08T08:17:41.817093+0000","last_fullsized":"2023-12-08T08:17:41.817093+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818534+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:41.818534+0000","last_peered":"2023-12-08T08:17:41.818534+0000","last_clean":"2023-12-08T08:17:41.818534+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:41.818534+0000","last_undegraded":"2023-12-08T08:17:41.818534+0000","last_fullsized":"2023-12-08T08:17:41.818534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:32:25.096296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815761+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:41.815761+0000","last_peered":"2023-12-08T08:17:41.815761+0000","last_clean":"2023-12-08T08:17:41.815761+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:41.815761+0000","last_undegraded":"2023-12-08T08:17:41.815761+0000","last_fullsized":"2023-12-08T08:17:41.815761+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819789+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:41.819789+0000","last_peered":"2023-12-08T08:17:41.819789+0000","last_clean":"2023-12-08T08:17:41.819789+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:41.819789+0000","last_undegraded":"2023-12-08T08:17:41.819789+0000","last_fullsized":"2023-12-08T08:17:41.819789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:15.804413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819730+0000","last_change":"2023-12-08T08:17:41.817319+0000","last_active":"2023-12-08T08:17:41.819730+0000","last_peered":"2023-12-08T08:17:41.819730+0000","last_clean":"2023-12-08T08:17:41.819730+0000","last_became_active":"2023-12-08T08:17:41.816145+0000","last_became_peered":"2023-12-08T08:17:41.816145+0000","last_unstale":"2023-12-08T08:17:41.819730+0000","last_undegraded":"2023-12-08T08:17:41.819730+0000","last_fullsized":"2023-12-08T08:17:41.819730+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:06.732423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.806413+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:41.806413+0000","last_peered":"2023-12-08T08:17:41.806413+0000","last_clean":"2023-12-08T08:17:41.806413+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:41.806413+0000","last_undegraded":"2023-12-08T08:17:41.806413+0000","last_fullsized":"2023-12-08T08:17:41.806413+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:08.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816037+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:41.816037+0000","last_peered":"2023-12-08T08:17:41.816037+0000","last_clean":"2023-12-08T08:17:41.816037+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:41.816037+0000","last_undegraded":"2023-12-08T08:17:41.816037+0000","last_fullsized":"2023-12-08T08:17:41.816037+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:43.637773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815231+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:41.815231+0000","last_peered":"2023-12-08T08:17:41.815231+0000","last_clean":"2023-12-08T08:17:41.815231+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:41.815231+0000","last_undegraded":"2023-12-08T08:17:41.815231+0000","last_fullsized":"2023-12-08T08:17:41.815231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.821007+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:41.821007+0000","last_peered":"2023-12-08T08:17:41.821007+0000","last_clean":"2023-12-08T08:17:41.821007+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:41.821007+0000","last_undegraded":"2023-12-08T08:17:41.821007+0000","last_fullsized":"2023-12-08T08:17:41.821007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820522+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:41.820522+0000","last_peered":"2023-12-08T08:17:41.820522+0000","last_clean":"2023-12-08T08:17:41.820522+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:41.820522+0000","last_undegraded":"2023-12-08T08:17:41.820522+0000","last_fullsized":"2023-12-08T08:17:41.820522+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:00:40.431715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.813765+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:41.813765+0000","last_peered":"2023-12-08T08:17:41.813765+0000","last_clean":"2023-12-08T08:17:41.813765+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:41.813765+0000","last_undegraded":"2023-12-08T08:17:41.813765+0000","last_fullsized":"2023-12-08T08:17:41.813765+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:10:03.992051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802739+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:41.802739+0000","last_peered":"2023-12-08T08:17:41.802739+0000","last_clean":"2023-12-08T08:17:41.802739+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:41.802739+0000","last_undegraded":"2023-12-08T08:17:41.802739+0000","last_fullsized":"2023-12-08T08:17:41.802739+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:10.995539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819131+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:41.819131+0000","last_peered":"2023-12-08T08:17:41.819131+0000","last_clean":"2023-12-08T08:17:41.819131+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:41.819131+0000","last_undegraded":"2023-12-08T08:17:41.819131+0000","last_fullsized":"2023-12-08T08:17:41.819131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:34:48.331626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810999+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:41.810999+0000","last_peered":"2023-12-08T08:17:41.810999+0000","last_clean":"2023-12-08T08:17:41.810999+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:41.810999+0000","last_undegraded":"2023-12-08T08:17:41.810999+0000","last_fullsized":"2023-12-08T08:17:41.810999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:58:25.732536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810701+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:41.810701+0000","last_peered":"2023-12-08T08:17:41.810701+0000","last_clean":"2023-12-08T08:17:41.810701+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:41.810701+0000","last_undegraded":"2023-12-08T08:17:41.810701+0000","last_fullsized":"2023-12-08T08:17:41.810701+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.807066+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:41.807066+0000","last_peered":"2023-12-08T08:17:41.807066+0000","last_clean":"2023-12-08T08:17:41.807066+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:41.807066+0000","last_undegraded":"2023-12-08T08:17:41.807066+0000","last_fullsized":"2023-12-08T08:17:41.807066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820374+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:41.820374+0000","last_peered":"2023-12-08T08:17:41.820374+0000","last_clean":"2023-12-08T08:17:41.820374+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:41.820374+0000","last_undegraded":"2023-12-08T08:17:41.820374+0000","last_fullsized":"2023-12-08T08:17:41.820374+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816254+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:41.816254+0000","last_peered":"2023-12-08T08:17:41.816254+0000","last_clean":"2023-12-08T08:17:41.816254+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:41.816254+0000","last_undegraded":"2023-12-08T08:17:41.816254+0000","last_fullsized":"2023-12-08T08:17:41.816254+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823497+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:41.823497+0000","last_peered":"2023-12-08T08:17:41.823497+0000","last_clean":"2023-12-08T08:17:41.823497+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:41.823497+0000","last_undegraded":"2023-12-08T08:17:41.823497+0000","last_fullsized":"2023-12-08T08:17:41.823497+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810343+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:41.810343+0000","last_peered":"2023-12-08T08:17:41.810343+0000","last_clean":"2023-12-08T08:17:41.810343+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:41.810343+0000","last_undegraded":"2023-12-08T08:17:41.810343+0000","last_fullsized":"2023-12-08T08:17:41.810343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:08.203457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.814760+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:41.814760+0000","last_peered":"2023-12-08T08:17:41.814760+0000","last_clean":"2023-12-08T08:17:41.814760+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:41.814760+0000","last_undegraded":"2023-12-08T08:17:41.814760+0000","last_fullsized":"2023-12-08T08:17:41.814760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810147+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:41.810147+0000","last_peered":"2023-12-08T08:17:41.810147+0000","last_clean":"2023-12-08T08:17:41.810147+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:41.810147+0000","last_undegraded":"2023-12-08T08:17:41.810147+0000","last_fullsized":"2023-12-08T08:17:41.810147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:23.878325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815028+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:41.815028+0000","last_peered":"2023-12-08T08:17:41.815028+0000","last_clean":"2023-12-08T08:17:41.815028+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:41.815028+0000","last_undegraded":"2023-12-08T08:17:41.815028+0000","last_fullsized":"2023-12-08T08:17:41.815028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:43:18.320731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820505+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:41.820505+0000","last_peered":"2023-12-08T08:17:41.820505+0000","last_clean":"2023-12-08T08:17:41.820505+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:41.820505+0000","last_undegraded":"2023-12-08T08:17:41.820505+0000","last_fullsized":"2023-12-08T08:17:41.820505+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815926+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:41.815926+0000","last_peered":"2023-12-08T08:17:41.815926+0000","last_clean":"2023-12-08T08:17:41.815926+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:41.815926+0000","last_undegraded":"2023-12-08T08:17:41.815926+0000","last_fullsized":"2023-12-08T08:17:41.815926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.808077+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:41.808077+0000","last_peered":"2023-12-08T08:17:41.808077+0000","last_clean":"2023-12-08T08:17:41.808077+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:41.808077+0000","last_undegraded":"2023-12-08T08:17:41.808077+0000","last_fullsized":"2023-12-08T08:17:41.808077+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:20.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820900+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:41.820900+0000","last_peered":"2023-12-08T08:17:41.820900+0000","last_clean":"2023-12-08T08:17:41.820900+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:41.820900+0000","last_undegraded":"2023-12-08T08:17:41.820900+0000","last_fullsized":"2023-12-08T08:17:41.820900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818994+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:41.818994+0000","last_peered":"2023-12-08T08:17:41.818994+0000","last_clean":"2023-12-08T08:17:41.818994+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:41.818994+0000","last_undegraded":"2023-12-08T08:17:41.818994+0000","last_fullsized":"2023-12-08T08:17:41.818994+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:48.344411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833816+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:41.833816+0000","last_peered":"2023-12-08T08:17:41.833816+0000","last_clean":"2023-12-08T08:17:41.833816+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:41.833816+0000","last_undegraded":"2023-12-08T08:17:41.833816+0000","last_fullsized":"2023-12-08T08:17:41.833816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816361+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:41.816361+0000","last_peered":"2023-12-08T08:17:41.816361+0000","last_clean":"2023-12-08T08:17:41.816361+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:41.816361+0000","last_undegraded":"2023-12-08T08:17:41.816361+0000","last_fullsized":"2023-12-08T08:17:41.816361+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:25.607717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.830015+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:41.830015+0000","last_peered":"2023-12-08T08:17:41.830015+0000","last_clean":"2023-12-08T08:17:41.830015+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:41.830015+0000","last_undegraded":"2023-12-08T08:17:41.830015+0000","last_fullsized":"2023-12-08T08:17:41.830015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.821384+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:41.821384+0000","last_peered":"2023-12-08T08:17:41.821384+0000","last_clean":"2023-12-08T08:17:41.821384+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:41.821384+0000","last_undegraded":"2023-12-08T08:17:41.821384+0000","last_fullsized":"2023-12-08T08:17:41.821384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.828623+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:41.828623+0000","last_peered":"2023-12-08T08:17:41.828623+0000","last_clean":"2023-12-08T08:17:41.828623+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:41.828623+0000","last_undegraded":"2023-12-08T08:17:41.828623+0000","last_fullsized":"2023-12-08T08:17:41.828623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819767+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:41.819767+0000","last_peered":"2023-12-08T08:17:41.819767+0000","last_clean":"2023-12-08T08:17:41.819767+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:41.819767+0000","last_undegraded":"2023-12-08T08:17:41.819767+0000","last_fullsized":"2023-12-08T08:17:41.819767+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:26.918764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829168+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:41.829168+0000","last_peered":"2023-12-08T08:17:41.829168+0000","last_clean":"2023-12-08T08:17:41.829168+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:41.829168+0000","last_undegraded":"2023-12-08T08:17:41.829168+0000","last_fullsized":"2023-12-08T08:17:41.829168+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.811729+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:41.811729+0000","last_peered":"2023-12-08T08:17:41.811729+0000","last_clean":"2023-12-08T08:17:41.811729+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:41.811729+0000","last_undegraded":"2023-12-08T08:17:41.811729+0000","last_fullsized":"2023-12-08T08:17:41.811729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:24:01.021719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829969+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:41.829969+0000","last_peered":"2023-12-08T08:17:41.829969+0000","last_clean":"2023-12-08T08:17:41.829969+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:41.829969+0000","last_undegraded":"2023-12-08T08:17:41.829969+0000","last_fullsized":"2023-12-08T08:17:41.829969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.796889+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:41.796889+0000","last_peered":"2023-12-08T08:17:41.796889+0000","last_clean":"2023-12-08T08:17:41.796889+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:41.796889+0000","last_undegraded":"2023-12-08T08:17:41.796889+0000","last_fullsized":"2023-12-08T08:17:41.796889+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:26:30.123324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.830406+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:41.830406+0000","last_peered":"2023-12-08T08:17:41.830406+0000","last_clean":"2023-12-08T08:17:41.830406+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:41.830406+0000","last_undegraded":"2023-12-08T08:17:41.830406+0000","last_fullsized":"2023-12-08T08:17:41.830406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823513+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:41.823513+0000","last_peered":"2023-12-08T08:17:41.823513+0000","last_clean":"2023-12-08T08:17:41.823513+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:41.823513+0000","last_undegraded":"2023-12-08T08:17:41.823513+0000","last_fullsized":"2023-12-08T08:17:41.823513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:23.878325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791159+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:41.791159+0000","last_peered":"2023-12-08T08:17:41.791159+0000","last_clean":"2023-12-08T08:17:41.791159+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:41.791159+0000","last_undegraded":"2023-12-08T08:17:41.791159+0000","last_fullsized":"2023-12-08T08:17:41.791159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816893+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:41.816893+0000","last_peered":"2023-12-08T08:17:41.816893+0000","last_clean":"2023-12-08T08:17:41.816893+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:41.816893+0000","last_undegraded":"2023-12-08T08:17:41.816893+0000","last_fullsized":"2023-12-08T08:17:41.816893+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.799250+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:41.799250+0000","last_peered":"2023-12-08T08:17:41.799250+0000","last_clean":"2023-12-08T08:17:41.799250+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:41.799250+0000","last_undegraded":"2023-12-08T08:17:41.799250+0000","last_fullsized":"2023-12-08T08:17:41.799250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819394+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:41.819394+0000","last_peered":"2023-12-08T08:17:41.819394+0000","last_clean":"2023-12-08T08:17:41.819394+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:41.819394+0000","last_undegraded":"2023-12-08T08:17:41.819394+0000","last_fullsized":"2023-12-08T08:17:41.819394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:12.056755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.806531+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:41.806531+0000","last_peered":"2023-12-08T08:17:41.806531+0000","last_clean":"2023-12-08T08:17:41.806531+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:41.806531+0000","last_undegraded":"2023-12-08T08:17:41.806531+0000","last_fullsized":"2023-12-08T08:17:41.806531+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.810631+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:41.810631+0000","last_peered":"2023-12-08T08:17:41.810631+0000","last_clean":"2023-12-08T08:17:41.810631+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:41.810631+0000","last_undegraded":"2023-12-08T08:17:41.810631+0000","last_fullsized":"2023-12-08T08:17:41.810631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:05.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.782935+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:41.782935+0000","last_peered":"2023-12-08T08:17:41.782935+0000","last_clean":"2023-12-08T08:17:41.782935+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:41.782935+0000","last_undegraded":"2023-12-08T08:17:41.782935+0000","last_fullsized":"2023-12-08T08:17:41.782935+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816888+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:41.816888+0000","last_peered":"2023-12-08T08:17:41.816888+0000","last_clean":"2023-12-08T08:17:41.816888+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:41.816888+0000","last_undegraded":"2023-12-08T08:17:41.816888+0000","last_fullsized":"2023-12-08T08:17:41.816888+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833683+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:41.833683+0000","last_peered":"2023-12-08T08:17:41.833683+0000","last_clean":"2023-12-08T08:17:41.833683+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:41.833683+0000","last_undegraded":"2023-12-08T08:17:41.833683+0000","last_fullsized":"2023-12-08T08:17:41.833683+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.805738+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:41.805738+0000","last_peered":"2023-12-08T08:17:41.805738+0000","last_clean":"2023-12-08T08:17:41.805738+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:41.805738+0000","last_undegraded":"2023-12-08T08:17:41.805738+0000","last_fullsized":"2023-12-08T08:17:41.805738+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:28.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"58'6","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.834043+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:41.834043+0000","last_peered":"2023-12-08T08:17:41.834043+0000","last_clean":"2023-12-08T08:17:41.834043+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:41.834043+0000","last_undegraded":"2023-12-08T08:17:41.834043+0000","last_fullsized":"2023-12-08T08:17:41.834043+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819165+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:41.819165+0000","last_peered":"2023-12-08T08:17:41.819165+0000","last_clean":"2023-12-08T08:17:41.819165+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:41.819165+0000","last_undegraded":"2023-12-08T08:17:41.819165+0000","last_fullsized":"2023-12-08T08:17:41.819165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:15.551917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833501+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:41.833501+0000","last_peered":"2023-12-08T08:17:41.833501+0000","last_clean":"2023-12-08T08:17:41.833501+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:41.833501+0000","last_undegraded":"2023-12-08T08:17:41.833501+0000","last_fullsized":"2023-12-08T08:17:41.833501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822633+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:41.822633+0000","last_peered":"2023-12-08T08:17:41.822633+0000","last_clean":"2023-12-08T08:17:41.822633+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:41.822633+0000","last_undegraded":"2023-12-08T08:17:41.822633+0000","last_fullsized":"2023-12-08T08:17:41.822633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791182+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:41.791182+0000","last_peered":"2023-12-08T08:17:41.791182+0000","last_clean":"2023-12-08T08:17:41.791182+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:41.791182+0000","last_undegraded":"2023-12-08T08:17:41.791182+0000","last_fullsized":"2023-12-08T08:17:41.791182+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815798+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:41.815798+0000","last_peered":"2023-12-08T08:17:41.815798+0000","last_clean":"2023-12-08T08:17:41.815798+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:41.815798+0000","last_undegraded":"2023-12-08T08:17:41.815798+0000","last_fullsized":"2023-12-08T08:17:41.815798+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:08.622694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.804862+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:41.804862+0000","last_peered":"2023-12-08T08:17:41.804862+0000","last_clean":"2023-12-08T08:17:41.804862+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:41.804862+0000","last_undegraded":"2023-12-08T08:17:41.804862+0000","last_fullsized":"2023-12-08T08:17:41.804862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.815217+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:41.815217+0000","last_peered":"2023-12-08T08:17:41.815217+0000","last_clean":"2023-12-08T08:17:41.815217+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:41.815217+0000","last_undegraded":"2023-12-08T08:17:41.815217+0000","last_fullsized":"2023-12-08T08:17:41.815217+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:27:11.978039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.836370+0000","last_change":"2023-12-08T08:17:40.785017+0000","last_active":"2023-12-08T08:17:41.836370+0000","last_peered":"2023-12-08T08:17:41.836370+0000","last_clean":"2023-12-08T08:17:41.836370+0000","last_became_active":"2023-12-08T08:17:40.784751+0000","last_became_peered":"2023-12-08T08:17:40.784751+0000","last_unstale":"2023-12-08T08:17:41.836370+0000","last_undegraded":"2023-12-08T08:17:41.836370+0000","last_fullsized":"2023-12-08T08:17:41.836370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:56.448134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819794+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:41.819794+0000","last_peered":"2023-12-08T08:17:41.819794+0000","last_clean":"2023-12-08T08:17:41.819794+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:41.819794+0000","last_undegraded":"2023-12-08T08:17:41.819794+0000","last_fullsized":"2023-12-08T08:17:41.819794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:08.203457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829266+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:41.829266+0000","last_peered":"2023-12-08T08:17:41.829266+0000","last_clean":"2023-12-08T08:17:41.829266+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:41.829266+0000","last_undegraded":"2023-12-08T08:17:41.829266+0000","last_fullsized":"2023-12-08T08:17:41.829266+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818094+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:41.818094+0000","last_peered":"2023-12-08T08:17:41.818094+0000","last_clean":"2023-12-08T08:17:41.818094+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:41.818094+0000","last_undegraded":"2023-12-08T08:17:41.818094+0000","last_fullsized":"2023-12-08T08:17:41.818094+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833563+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:41.833563+0000","last_peered":"2023-12-08T08:17:41.833563+0000","last_clean":"2023-12-08T08:17:41.833563+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:41.833563+0000","last_undegraded":"2023-12-08T08:17:41.833563+0000","last_fullsized":"2023-12-08T08:17:41.833563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818239+0000","last_change":"2023-12-08T08:17:41.813667+0000","last_active":"2023-12-08T08:17:41.818239+0000","last_peered":"2023-12-08T08:17:41.818239+0000","last_clean":"2023-12-08T08:17:41.818239+0000","last_became_active":"2023-12-08T08:17:41.811674+0000","last_became_peered":"2023-12-08T08:17:41.811674+0000","last_unstale":"2023-12-08T08:17:41.818239+0000","last_undegraded":"2023-12-08T08:17:41.818239+0000","last_fullsized":"2023-12-08T08:17:41.818239+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:00.629728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.833606+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:41.833606+0000","last_peered":"2023-12-08T08:17:41.833606+0000","last_clean":"2023-12-08T08:17:41.833606+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:41.833606+0000","last_undegraded":"2023-12-08T08:17:41.833606+0000","last_fullsized":"2023-12-08T08:17:41.833606+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818162+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:41.818162+0000","last_peered":"2023-12-08T08:17:41.818162+0000","last_clean":"2023-12-08T08:17:41.818162+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:41.818162+0000","last_undegraded":"2023-12-08T08:17:41.818162+0000","last_fullsized":"2023-12-08T08:17:41.818162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:00.629728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.795140+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:41.795140+0000","last_peered":"2023-12-08T08:17:41.795140+0000","last_clean":"2023-12-08T08:17:41.795140+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:41.795140+0000","last_undegraded":"2023-12-08T08:17:41.795140+0000","last_fullsized":"2023-12-08T08:17:41.795140+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.820881+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:41.820881+0000","last_peered":"2023-12-08T08:17:41.820881+0000","last_clean":"2023-12-08T08:17:41.820881+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:41.820881+0000","last_undegraded":"2023-12-08T08:17:41.820881+0000","last_fullsized":"2023-12-08T08:17:41.820881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.829268+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:41.829268+0000","last_peered":"2023-12-08T08:17:41.829268+0000","last_clean":"2023-12-08T08:17:41.829268+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:41.829268+0000","last_undegraded":"2023-12-08T08:17:41.829268+0000","last_fullsized":"2023-12-08T08:17:41.829268+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.814987+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:41.814987+0000","last_peered":"2023-12-08T08:17:41.814987+0000","last_clean":"2023-12-08T08:17:41.814987+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:41.814987+0000","last_undegraded":"2023-12-08T08:17:41.814987+0000","last_fullsized":"2023-12-08T08:17:41.814987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:26.918764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791572+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:41.791572+0000","last_peered":"2023-12-08T08:17:41.791572+0000","last_clean":"2023-12-08T08:17:41.791572+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:41.791572+0000","last_undegraded":"2023-12-08T08:17:41.791572+0000","last_fullsized":"2023-12-08T08:17:41.791572+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.823493+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:41.823493+0000","last_peered":"2023-12-08T08:17:41.823493+0000","last_clean":"2023-12-08T08:17:41.823493+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:41.823493+0000","last_undegraded":"2023-12-08T08:17:41.823493+0000","last_fullsized":"2023-12-08T08:17:41.823493+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:34:48.331626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791537+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:41.791537+0000","last_peered":"2023-12-08T08:17:41.791537+0000","last_clean":"2023-12-08T08:17:41.791537+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:41.791537+0000","last_undegraded":"2023-12-08T08:17:41.791537+0000","last_fullsized":"2023-12-08T08:17:41.791537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.817419+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:41.817419+0000","last_peered":"2023-12-08T08:17:41.817419+0000","last_clean":"2023-12-08T08:17:41.817419+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:41.817419+0000","last_undegraded":"2023-12-08T08:17:41.817419+0000","last_fullsized":"2023-12-08T08:17:41.817419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:05.345700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.827292+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:41.827292+0000","last_peered":"2023-12-08T08:17:41.827292+0000","last_clean":"2023-12-08T08:17:41.827292+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:41.827292+0000","last_undegraded":"2023-12-08T08:17:41.827292+0000","last_fullsized":"2023-12-08T08:17:41.827292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.825552+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:41.825552+0000","last_peered":"2023-12-08T08:17:41.825552+0000","last_clean":"2023-12-08T08:17:41.825552+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:41.825552+0000","last_undegraded":"2023-12-08T08:17:41.825552+0000","last_fullsized":"2023-12-08T08:17:41.825552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:46:52.725670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791293+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:41.791293+0000","last_peered":"2023-12-08T08:17:41.791293+0000","last_clean":"2023-12-08T08:17:41.791293+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:41.791293+0000","last_undegraded":"2023-12-08T08:17:41.791293+0000","last_fullsized":"2023-12-08T08:17:41.791293+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.822616+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:41.822616+0000","last_peered":"2023-12-08T08:17:41.822616+0000","last_clean":"2023-12-08T08:17:41.822616+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:41.822616+0000","last_undegraded":"2023-12-08T08:17:41.822616+0000","last_fullsized":"2023-12-08T08:17:41.822616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.789579+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:41.789579+0000","last_peered":"2023-12-08T08:17:41.789579+0000","last_clean":"2023-12-08T08:17:41.789579+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:41.789579+0000","last_undegraded":"2023-12-08T08:17:41.789579+0000","last_fullsized":"2023-12-08T08:17:41.789579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.818143+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:41.818143+0000","last_peered":"2023-12-08T08:17:41.818143+0000","last_clean":"2023-12-08T08:17:41.818143+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:41.818143+0000","last_undegraded":"2023-12-08T08:17:41.818143+0000","last_fullsized":"2023-12-08T08:17:41.818143+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:35:57.462443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.778950+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:41.778950+0000","last_peered":"2023-12-08T08:17:41.778950+0000","last_clean":"2023-12-08T08:17:41.778950+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:41.778950+0000","last_undegraded":"2023-12-08T08:17:41.778950+0000","last_fullsized":"2023-12-08T08:17:41.778950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.807041+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:41.807041+0000","last_peered":"2023-12-08T08:17:41.807041+0000","last_clean":"2023-12-08T08:17:41.807041+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:41.807041+0000","last_undegraded":"2023-12-08T08:17:41.807041+0000","last_fullsized":"2023-12-08T08:17:41.807041+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:28.307579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.802785+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:41.802785+0000","last_peered":"2023-12-08T08:17:41.802785+0000","last_clean":"2023-12-08T08:17:41.802785+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:41.802785+0000","last_undegraded":"2023-12-08T08:17:41.802785+0000","last_fullsized":"2023-12-08T08:17:41.802785+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.816400+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:41.816400+0000","last_peered":"2023-12-08T08:17:41.816400+0000","last_clean":"2023-12-08T08:17:41.816400+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:41.816400+0000","last_undegraded":"2023-12-08T08:17:41.816400+0000","last_fullsized":"2023-12-08T08:17:41.816400+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:48.344411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.790889+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:41.790889+0000","last_peered":"2023-12-08T08:17:41.790889+0000","last_clean":"2023-12-08T08:17:41.790889+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:41.790889+0000","last_undegraded":"2023-12-08T08:17:41.790889+0000","last_fullsized":"2023-12-08T08:17:41.790889+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.801369+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:41.801369+0000","last_peered":"2023-12-08T08:17:41.801369+0000","last_clean":"2023-12-08T08:17:41.801369+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:41.801369+0000","last_undegraded":"2023-12-08T08:17:41.801369+0000","last_fullsized":"2023-12-08T08:17:41.801369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:50:18.496367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.791550+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:41.791550+0000","last_peered":"2023-12-08T08:17:41.791550+0000","last_clean":"2023-12-08T08:17:41.791550+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:41.791550+0000","last_undegraded":"2023-12-08T08:17:41.791550+0000","last_fullsized":"2023-12-08T08:17:41.791550+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819904+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:41.819904+0000","last_peered":"2023-12-08T08:17:41.819904+0000","last_clean":"2023-12-08T08:17:41.819904+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:41.819904+0000","last_undegraded":"2023-12-08T08:17:41.819904+0000","last_fullsized":"2023-12-08T08:17:41.819904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:20.719389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.776887+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:41.776887+0000","last_peered":"2023-12-08T08:17:41.776887+0000","last_clean":"2023-12-08T08:17:41.776887+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:41.776887+0000","last_undegraded":"2023-12-08T08:17:41.776887+0000","last_fullsized":"2023-12-08T08:17:41.776887+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.819068+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:41.819068+0000","last_peered":"2023-12-08T08:17:41.819068+0000","last_clean":"2023-12-08T08:17:41.819068+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:41.819068+0000","last_undegraded":"2023-12-08T08:17:41.819068+0000","last_fullsized":"2023-12-08T08:17:41.819068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:08.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:17:41.794158+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:41.794158+0000","last_peered":"2023-12-08T08:17:41.794158+0000","last_clean":"2023-12-08T08:17:41.794158+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:41.794158+0000","last_undegraded":"2023-12-08T08:17:41.794158+0000","last_fullsized":"2023-12-08T08:17:41.794158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-08T08:17:40.776562+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:40.776562+0000","last_peered":"2023-12-08T08:17:40.776562+0000","last_clean":"2023-12-08T08:17:40.776562+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:40.776562+0000","last_undegraded":"2023-12-08T08:17:40.776562+0000","last_fullsized":"2023-12-08T08:17:40.776562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1306624,"data_stored":905059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.58599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3600000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.0800000000000001},"min":{"1min":0.73999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.153,"15min":1.159},"min":{"1min":0.71099999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.351},{"interface":"front","average":{"1min":1.131,"5min":1.224,"15min":1.24},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.175,"15min":1.177},"min":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.474,"5min":1.863,"15min":1.863},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.325,"15min":1.333},"min":{"1min":0.86199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.6040000000000001,"5min":1.855,"15min":1.855},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.405,"15min":1.419},"min":{"1min":0.92900000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.671,"5min":3.524,"15min":3.524},"last":1.4530000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.393,"15min":1.407},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.702,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3600000000000001,"15min":1.353},"min":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.754,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":0.98799999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.9239999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.415},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.508,"15min":1.504},"min":{"1min":0.91500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0009999999999999,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.3}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.6419999999999999,"15min":1.6559999999999999},"min":{"1min":0.99299999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9019999999999999,"5min":2.609,"15min":2.609},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":1.01,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.101,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4850000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":313949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.75,"15min":1.857},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4770000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.845,"15min":1.978},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.365,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.86099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.131,"15min":1.111},"min":{"1min":0.95099999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4830000000000001,"5min":1.762,"15min":1.762},"last":1.016},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2250000000000001,"15min":1.2370000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5229999999999999,"5min":2.141,"15min":2.141},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5680000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.5940000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.397,"15min":1.425},"min":{"1min":0.77800000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5600000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8640000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.4379999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.341,"15min":1.349},"min":{"1min":0.98199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.401,"15min":1.4139999999999999},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6759999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.0780000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.484,"15min":1.4990000000000001},"min":{"1min":1.089,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.972,"5min":2.96,"15min":2.96},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.208,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7809999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.6819999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.478,"15min":1.484},"min":{"1min":1.2270000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7410000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.595,"15min":1.6140000000000001},"min":{"1min":1.0600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0760000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.538}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":700416,"data_stored":313937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.95299999999999996,"15min":0.94499999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0189999999999999,"15min":1.026},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0980000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0189999999999999,"15min":1.0029999999999999},"min":{"1min":0.64500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.224,"15min":1.238},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1739999999999999,"15min":1.1859999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.294,"15min":1.306},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3560000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.3360000000000001,"15min":1.3500000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6299999999999999,"5min":1.96,"15min":1.96},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4239999999999999,"15min":1.4299999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.2}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2909999999999999,"15min":1.2969999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.248},{"interface":"front","average":{"1min":1.337,"5min":1.365,"15min":1.3700000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.73,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.4099999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.389,"15min":1.3959999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.425,"15min":1.431},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.468}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.4710000000000001,"15min":1.4650000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.54,"5min":1.516,"15min":1.512},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.6339999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":315527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.012,"15min":1.004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.141,"15min":1.1539999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5009999999999999,"5min":2.335,"15min":2.335},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1870000000000001,"15min":1.1990000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.097},{"interface":"front","average":{"1min":1.046,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.458}]},{"osd":2,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.2210000000000001,"15min":1.2430000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5429999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.393,"15min":1.409},"min":{"1min":0.74099999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.2109999999999999,"5min":2.456,"15min":2.456},"last":1.518}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2050000000000001,"15min":1.2090000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.397},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.431}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.4650000000000001,"15min":1.4830000000000001},"min":{"1min":0.58699999999999997,"5min":0.501,"15min":0.501},"max":{"1min":2.081,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.159},{"interface":"front","average":{"1min":1.262,"5min":1.413,"15min":1.4379999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6859999999999999,"5min":2.137,"15min":2.137},"last":1.286}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.4750000000000001,"15min":1.5049999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.776,"5min":3.016,"15min":3.016},"last":1.329},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.5620000000000001,"15min":1.5860000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.5760000000000001,"15min":1.599},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.827,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.585},{"interface":"front","average":{"1min":1.544,"5min":1.6679999999999999,"15min":1.6879999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1600000000000001,"5min":3.141,"15min":3.141},"last":1.204}]}]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":313915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.95599999999999996,"15min":0.96599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.464},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.03,"15min":1.044},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5459999999999998,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.014}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.99299999999999999,"15min":0.99199999999999999},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.091}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.53300000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.835,"5min":1.97,"15min":1.97},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.84399999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3420000000000001,"15min":1.363},"min":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3999999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.458,"15min":1.494},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0209999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.649},{"interface":"front","average":{"1min":1.375,"5min":1.3819999999999999,"15min":1.383},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.202}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4279999999999999,"15min":1.4430000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9550000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.52},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5569999999999999,"15min":1.5840000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1930000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.7549999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.478,"15min":1.49},"min":{"1min":0.94199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.476,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.444},{"interface":"front","average":{"1min":1.466,"5min":1.5960000000000001,"15min":1.6180000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.2330000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6020000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":696320,"data_stored":313915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.749},{"interface":"front","average":{"1min":1.075,"5min":0.92300000000000004,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.95399999999999996,"15min":0.94799999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.996,"5min":2.996,"15min":2.996},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.95399999999999996,"15min":0.95199999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"min":{"1min":0.61399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.476,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.226}]},{"osd":4,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3180000000000001,"15min":1.3160000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.385,"15min":1.397},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.994,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.1799999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3520000000000001,"15min":1.369},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3029999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.399,"15min":1.4059999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.4259999999999999,"15min":1.431},"min":{"1min":0.91600000000000004,"5min":0.879,"15min":0.879},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.399,"15min":1.413},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.478,"15min":1.466},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.546},{"interface":"front","average":{"1min":1.518,"5min":1.5089999999999999,"15min":1.5069999999999999},"min":{"1min":0.91500000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.504}]}]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":316291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.88},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.306,"5min":1.585,"15min":1.585},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.97399999999999998,"15min":0.98399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.877,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.329,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5429999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.55000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.764,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.1259999999999999,"15min":1.1399999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1669999999999998,"5min":2.327,"15min":2.327},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6559999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.464,"15min":1.504},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.5089999999999999,"5min":2.552,"15min":2.552},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.4670000000000001,"15min":1.5009999999999999},"min":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3900000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.425,"15min":1.4570000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6220000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.097}]},{"osd":6,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.581,"15min":1.609},"min":{"1min":0.76000000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2989999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.546,"15min":1.5800000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.843,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.571,"15min":1.601},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.016,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.675,"15min":1.6850000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.0149999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542180,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":904283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.44400000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.228,"5min":2.194,"15min":2.194},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":1.0669999999999999,"15min":1.093},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.538,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.149,"15min":1.1679999999999999},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.77,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1599999999999999,"15min":1.179},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.859,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.014}]},{"osd":3,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.091,"15min":1.121},"min":{"1min":0.45300000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5229999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.29,"15min":1.3129999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.764,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.5189999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.4690000000000001,"15min":1.5069999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9610000000000001,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.466},{"interface":"front","average":{"1min":1.181,"5min":1.321,"15min":1.3440000000000001},"min":{"1min":0.77300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.5149999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.204}]},{"osd":5,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4330000000000001,"15min":1.4530000000000001},"min":{"1min":0.80600000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.609,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3979999999999999,"15min":1.4039999999999999},"min":{"1min":0.82299999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.679,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.716}]},{"osd":6,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.53,"15min":1.5449999999999999},"min":{"1min":0.89400000000000002,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.7649999999999999,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.823},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5800000000000001,"15min":1.6140000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0419999999999998,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.304}]},{"osd":7,"last update":"Fri Dec 8 08:16:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.653,"15min":1.6830000000000001},"min":{"1min":0.94499999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1179999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.641},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.5509999999999999,"15min":1.5669999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.0190000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3340000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:17:46.894 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:17:46.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:17:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.172+0000 7fe4229a7640 1 Processor -- start 2023-12-08T08:17:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.172+0000 7fe4229a7640 1 -- start start 2023-12-08T08:17:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4229a7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe41c0c5760 0x7fe41c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4229a7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c1542a0 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4229a7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0c3a70 con 0x7fe41c154a80 2023-12-08T08:17:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4229a7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0c3d50 con 0x7fe41c0c5760 2023-12-08T08:17:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4211a4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe41c0c0cb0 0x7fe41c1582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57020/0 (socket says 172.21.15.45:57020) 2023-12-08T08:17:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.174+0000 7fe4211a4640 1 -- 172.21.15.45:0/3349186874 learned_addr learned my addr 172.21.15.45:0/3349186874 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3349186874 >> v2:172.21.15.114:3300/0 conn(0x7fe41c0c5760 0x7fe41c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825703011 0 0) 0x7fe41c1542a0 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe408003520 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1538231681 0 0) 0x7fe408003520 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 >> v2:172.21.15.114:3300/0 conn(0x7fe41c0c5760 msgr2=0x7fe41c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:47.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 --2- 172.21.15.45:0/3349186874 >> v2:172.21.15.114:3300/0 conn(0x7fe41c0c5760 0x7fe41c0c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 >> v1:172.21.15.114:6789/0 conn(0x7fe41c154a80 legacy=0x7fe41c15ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0c4030 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe40c001670 con 0x7fe41c0c0cb0 2023-12-08T08:17:47.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 >> v1:172.21.15.45:6789/0 conn(0x7fe41c0c0cb0 legacy=0x7fe41c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.175+0000 7fe4209a3640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408003970 0x7fe408003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4209a3640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe408004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4209a3640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4080052a0 0x7fe40800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0c3d50 con 0x7fe4080047c0 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40800c170 con 0x7fe408003970 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40800c330 con 0x7fe4080052a0 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe408004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408003970 0x7fe408003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 -- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4080052a0 msgr2=0x7fe40800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4221a6640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4080052a0 0x7fe40800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4080052a0 0x7fe40800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 -- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408003970 msgr2=0x7fe408003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408003970 0x7fe408003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4211a4640 1 -- 172.21.15.45:0/3349186874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408003520 con 0x7fe4080047c0 2023-12-08T08:17:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe408003970 0x7fe408003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.176+0000 7fe4221a6640 1 -- 172.21.15.45:0/3349186874 reap_dead start 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.177+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe408004c40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe41c1589b0 tx=0x7fe4080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7c4d108d6129e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c005ad0 con 0x7fe4080047c0 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c005c50 con 0x7fe4080047c0 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4209a3640 1 -- 172.21.15.45:0/3349186874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c02c830 con 0x7fe4080047c0 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4229a7640 1 -- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 msgr2=0x7fe408004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe408004c40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe41c1589b0 tx=0x7fe4080057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4229a7640 1 -- 172.21.15.45:0/3349186874 shutdown_connections 2023-12-08T08:17:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3349186874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe408004c40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.178+0000 7fe4229a7640 1 -- 172.21.15.45:0/3349186874 >> 172.21.15.45:0/3349186874 conn(0x7fe41c066df0 msgr2=0x7fe41c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.179+0000 7fe4229a7640 1 -- 172.21.15.45:0/3349186874 shutdown_connections 2023-12-08T08:17:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.179+0000 7fe4229a7640 1 -- 172.21.15.45:0/3349186874 wait complete. 2023-12-08T08:17:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.180+0000 7fe4229a7640 1 Processor -- start 2023-12-08T08:17:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.180+0000 7fe4229a7640 1 -- start start 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 0x7fe41c0a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe41c0aa220 0x7fe41c14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1ee0a0 con 0x7fe4080047c0 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0a98c0 con 0x7fe41c0aa220 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.181+0000 7fe4229a7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0a8f20 con 0x7fe41c1edb50 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43076/0 (socket says 172.21.15.45:43076) 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 -- 172.21.15.45:0/3717098566 learned_addr learned my addr 172.21.15.45:0/3717098566 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4221a6640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe41c0aa220 0x7fe41c14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 0x7fe41c0a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 -- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 msgr2=0x7fe41c0a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 0x7fe41c0a9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 -- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe41c0aa220 msgr2=0x7fe41c14f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe41c0aa220 0x7fe41c14f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4219a5640 1 -- 172.21.15.45:0/3717098566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0a9200 con 0x7fe4080047c0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.182+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 0x7fe41c0a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4219a5640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe418011510 tx=0x7fe4180119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418015870 con 0x7fe4080047c0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4180159d0 con 0x7fe4080047c0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418015d80 con 0x7fe4080047c0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0a94e0 con 0x7fe4080047c0 2023-12-08T08:17:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.183+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c153a40 con 0x7fe4080047c0 2023-12-08T08:17:47.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.184+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c0743e0 con 0x7fe4080047c0 2023-12-08T08:17:47.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.185+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe41801d400 con 0x7fe4080047c0 2023-12-08T08:17:47.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.186+0000 7fe4127fc640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.186+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fe418089f90 con 0x7fe4080047c0 2023-12-08T08:17:47.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.187+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.187+0000 7fe4211a4640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 0x7fe40006d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe40c034000 tx=0x7fe40c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.191+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe418054de0 con 0x7fe4080047c0 2023-12-08T08:17:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.459+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe41c0c6540 con 0x7fe4080047c0 2023-12-08T08:17:47.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.463+0000 7fe4127fc640 1 -- 172.21.15.45:0/3717098566 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe4180220e0 con 0x7fe4080047c0 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg== 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:17:47.466 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.466+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 msgr2=0x7fe40006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.466+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 0x7fe40006d330 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe40c034000 tx=0x7fe40c009030 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.466+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 msgr2=0x7fe41c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.466+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe418011510 tx=0x7fe4180119d0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 shutdown_connections 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe41c1edb50 0x7fe41c0a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe41c0aa220 0x7fe41c14f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 --2- 172.21.15.45:0/3717098566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4080047c0 0x7fe41c153500 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 >> 172.21.15.45:0/3717098566 conn(0x7fe41c066df0 msgr2=0x7fe41c0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:47.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 shutdown_connections 2023-12-08T08:17:47.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.467+0000 7fe4229a7640 1 -- 172.21.15.45:0/3717098566 wait complete. 2023-12-08T08:17:47.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.715+0000 7f6d70f28640 1 Processor -- start 2023-12-08T08:17:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.716+0000 7f6d70f28640 1 -- start start 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.717+0000 7f6d70f28640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d6c0c16a0 0x7f6d6c0aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.717+0000 7f6d70f28640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c154850 con 0x7f6d6c14e840 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.717+0000 7f6d70f28640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c154b30 con 0x7f6d6c0c1210 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.717+0000 7f6d70f28640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c14ec20 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.717+0000 7f6d6b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6d6c14e840 0x7f6d6c151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57028/0 (socket says 172.21.15.45:57028) 2023-12-08T08:17:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6b7fe640 1 -- 172.21.15.45:0/1962161305 learned_addr learned my addr 172.21.15.45:0/1962161305 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6bfff640 1 --2- 172.21.15.45:0/1962161305 >> v2:172.21.15.45:3300/0 conn(0x7f6d6c0c16a0 0x7f6d6c0aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6bfff640 1 -- 172.21.15.45:0/1962161305 >> v1:172.21.15.114:6789/0 conn(0x7f6d6c0c1210 legacy=0x7f6d6c0a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6bfff640 1 -- 172.21.15.45:0/1962161305 >> v1:172.21.15.45:6789/0 conn(0x7f6d6c14e840 legacy=0x7f6d6c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6bfff640 1 -- 172.21.15.45:0/1962161305 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c154e10 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.718+0000 7f6d6affd640 1 -- 172.21.15.45:0/1962161305 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768279479 0 0) 0x7f6d6c154850 con 0x7f6d6c14e840 2023-12-08T08:17:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.719+0000 7f6d6bfff640 1 --2- 172.21.15.45:0/1962161305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c0c16a0 0x7f6d6c0aa590 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832398bf9f7677ea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d6affd640 1 -- 172.21.15.45:0/1962161305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6402cbd0 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d6affd640 1 -- 172.21.15.45:0/1962161305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6402cd30 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d6affd640 1 -- 172.21.15.45:0/1962161305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6402cea0 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 -- 172.21.15.45:0/1962161305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c0c16a0 msgr2=0x7f6d6c0aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 --2- 172.21.15.45:0/1962161305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c0c16a0 0x7f6d6c0aa590 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6402be20 comp rx=0 tx=0).stop 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 -- 172.21.15.45:0/1962161305 shutdown_connections 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 --2- 172.21.15.45:0/1962161305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c0c16a0 0x7f6d6c0aa590 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 -- 172.21.15.45:0/1962161305 >> 172.21.15.45:0/1962161305 conn(0x7f6d6c0c5780 msgr2=0x7f6d6c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 -- 172.21.15.45:0/1962161305 shutdown_connections 2023-12-08T08:17:47.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.720+0000 7f6d70f28640 1 -- 172.21.15.45:0/1962161305 wait complete. 2023-12-08T08:17:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.722+0000 7f6d70f28640 1 Processor -- start 2023-12-08T08:17:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.722+0000 7f6d70f28640 1 -- start start 2023-12-08T08:17:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 0x7f6d6c1ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d6c0c16a0 0x7f6d6c14cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1eda50 con 0x7f6d6c14e840 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1ed770 con 0x7f6d6c0c1210 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d70f28640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c070c10 con 0x7f6d6c0c16a0 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.723+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43094/0 (socket says 172.21.15.45:43094) 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 -- 172.21.15.45:0/3208843960 learned_addr learned my addr 172.21.15.45:0/3208843960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6b7fe640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 0x7f6d6c1ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 -- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d6c0c16a0 msgr2=0x7f6d6c14cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d63fff640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d6c0c16a0 0x7f6d6c14cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d6c0c16a0 0x7f6d6c14cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 -- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 msgr2=0x7f6d6c1ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 0x7f6d6c1ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 -- 172.21.15.45:0/3208843960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64009a70 con 0x7f6d6c14e840 2023-12-08T08:17:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6b7fe640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 0x7f6d6c1ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.724+0000 7f6d6bfff640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.725+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6402cea0 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.725+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6403e630 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.725+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c070ef0 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.725+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6403e9e0 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.725+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c1507c0 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.726+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0743e0 con 0x7f6d6c14e840 2023-12-08T08:17:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.727+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d6403b050 con 0x7f6d6c14e840 2023-12-08T08:17:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.728+0000 7f6d68ff9640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 0x7f6d4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.728+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f6d640abd60 con 0x7f6d6c14e840 2023-12-08T08:17:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.728+0000 7f6d6b7fe640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 0x7f6d4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.729+0000 7f6d6b7fe640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 0x7f6d4c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c000f60 tx=0x7f6d5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:47.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.732+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d64076ce0 con 0x7f6d6c14e840 2023-12-08T08:17:47.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.973+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d6c071410 con 0x7f6d6c14e840 2023-12-08T08:17:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.974+0000 7f6d68ff9640 1 -- 172.21.15.45:0/3208843960 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f6d64039020 con 0x7f6d6c14e840 2023-12-08T08:17:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:47.977 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-08T08:17:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-12-08T08:17:47.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 msgr2=0x7f6d4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 0x7f6d4c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c000f60 tx=0x7f6d5c009040 comp rx=0 tx=0).stop 2023-12-08T08:17:47.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 msgr2=0x7f6d6c14d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:47.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d64004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:47.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 shutdown_connections 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6d4c06ae70 0x7f6d4c06d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d6c0c16a0 0x7f6d6c14cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6c14e840 0x7f6d6c14d300 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 --2- 172.21.15.45:0/3208843960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d6c0c1210 0x7f6d6c1ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 >> 172.21.15.45:0/3208843960 conn(0x7f6d6c0c5780 msgr2=0x7f6d6c0c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.977+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 shutdown_connections 2023-12-08T08:17:47.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:47.978+0000 7f6d70f28640 1 -- 172.21.15.45:0/3208843960 wait complete. 2023-12-08T08:17:48.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:17:41.237126+0000', 'modified': '2023-12-08T08:17:44.323853+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6024}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6024': {'gid': 6024, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.45:6837/63008111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 63008111}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 63008111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:17:48.403 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:17:48.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-08T08:17:48.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.637+0000 7fa4272df640 1 Processor -- start 2023-12-08T08:17:48.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.637+0000 7fa4272df640 1 -- start start 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa4272df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa42014ea60 0x7fa4201545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa4272df640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa420154b90 con 0x7fa42006d820 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa4272df640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa420154e70 con 0x7fa42014e680 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa4272df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa420155150 con 0x7fa42014ea60 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa426ade640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa42006d820 0x7fa42006c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57036/0 (socket says 172.21.15.45:57036) 2023-12-08T08:17:48.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.638+0000 7fa426ade640 1 -- 172.21.15.45:0/822207587 learned_addr learned my addr 172.21.15.45:0/822207587 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:48.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674257790 0 0) 0x7fa420154b90 con 0x7fa42006d820 2023-12-08T08:17:48.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa425adc640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa42014ea60 0x7fa4201545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa408003520 con 0x7fa42006d820 2023-12-08T08:17:48.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158554682 0 0) 0x7fa408003520 con 0x7fa42006d820 2023-12-08T08:17:48.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa42014ea60 msgr2=0x7fa4201545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa42014ea60 0x7fa4201545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 >> v1:172.21.15.114:6789/0 conn(0x7fa42014e680 legacy=0x7fa4200c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420155430 con 0x7fa42006d820 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fa418001670 con 0x7fa42006d820 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 >> v1:172.21.15.45:6789/0 conn(0x7fa42006d820 legacy=0x7fa42006c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080039a0 0x7fa408003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.639+0000 7fa4252db640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080047c0 0x7fa408004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa4252db640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4080051d0 0x7fa40800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa420155150 con 0x7fa4080051d0 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c0d0 con 0x7fa4080047c0 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c290 con 0x7fa4080039a0 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4080051d0 0x7fa40800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 -- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080039a0 msgr2=0x7fa408003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa4080039a0 0x7fa408003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 -- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080047c0 msgr2=0x7fa408004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080047c0 0x7fa408004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.640+0000 7fa426ade640 1 -- 172.21.15.45:0/822207587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408003520 con 0x7fa4080051d0 2023-12-08T08:17:48.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.641+0000 7fa426ade640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4080051d0 0x7fa40800b980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c190 tx=0x7fa4080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8111885d4812744 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418005ad0 con 0x7fa4080051d0 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418005c30 con 0x7fa4080051d0 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4252db640 1 -- 172.21.15.45:0/822207587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41802cae0 con 0x7fa4080051d0 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4272df640 1 -- 172.21.15.45:0/822207587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4080051d0 msgr2=0x7fa40800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4272df640 1 --2- 172.21.15.45:0/822207587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4080051d0 0x7fa40800b980 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c190 tx=0x7fa4080057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa426ade640 1 -- 172.21.15.45:0/822207587 reap_dead start 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4272df640 1 -- 172.21.15.45:0/822207587 shutdown_connections 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4272df640 1 -- 172.21.15.45:0/822207587 >> 172.21.15.45:0/822207587 conn(0x7fa4200a7600 msgr2=0x7fa4200a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.642+0000 7fa4272df640 1 -- 172.21.15.45:0/822207587 shutdown_connections 2023-12-08T08:17:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.643+0000 7fa4272df640 1 -- 172.21.15.45:0/822207587 wait complete. 2023-12-08T08:17:48.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.644+0000 7fa4272df640 1 Processor -- start 2023-12-08T08:17:48.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.644+0000 7fa4272df640 1 -- start start 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 0x7fa42013cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa420144070 0x7fa4201444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa420154710 con 0x7fa420153df0 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201eb820 con 0x7fa4080051d0 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.645+0000 7fa4272df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa420144a30 con 0x7fa420144070 2023-12-08T08:17:48.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43120/0 (socket says 172.21.15.45:43120) 2023-12-08T08:17:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 -- 172.21.15.45:0/2860467753 learned_addr learned my addr 172.21.15.45:0/2860467753 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa426ade640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa420144070 0x7fa4201444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 0x7fa42013cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 -- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa420144070 msgr2=0x7fa4201444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa420144070 0x7fa4201444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 -- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 msgr2=0x7fa42013cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 0x7fa42013cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa425adc640 1 -- 172.21.15.45:0/2860467753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4201432b0 con 0x7fa420153df0 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.646+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 0x7fa42013cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa425adc640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4140047b0 tx=0x7fa41400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa41effd640 1 -- 172.21.15.45:0/2860467753 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140125f0 con 0x7fa420153df0 2023-12-08T08:17:48.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa41effd640 1 -- 172.21.15.45:0/2860467753 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414012770 con 0x7fa420153df0 2023-12-08T08:17:48.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa41effd640 1 -- 172.21.15.45:0/2860467753 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414012b20 con 0x7fa420153df0 2023-12-08T08:17:48.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa420143590 con 0x7fa420153df0 2023-12-08T08:17:48.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.647+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa420143b50 con 0x7fa420153df0 2023-12-08T08:17:48.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.649+0000 7fa41effd640 1 -- 172.21.15.45:0/2860467753 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa414012c80 con 0x7fa420153df0 2023-12-08T08:17:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.650+0000 7fa41effd640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 0x7fa40c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.650+0000 7fa41effd640 1 -- 172.21.15.45:0/2860467753 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa414089b90 con 0x7fa420153df0 2023-12-08T08:17:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.650+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 0x7fa40c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.651+0000 7fa42b1b4740 1 Processor -- start 2023-12-08T08:17:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.651+0000 7fa42b1b4740 1 -- start start 2023-12-08T08:17:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.651+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 0x7fa40c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa410007fd0 tx=0x7fa410009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde894f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde879450 0x557cde897ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde7b8880 con 0x557cde85b880 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde7c7ae0 con 0x557cde879450 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cde7c51d0 con 0x557cde894b30 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa426ade640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa426ade640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43126/0 (socket says 172.21.15.45:43126) 2023-12-08T08:17:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.652+0000 7fa426ade640 1 -- 172.21.15.45:0/1572356269 learned_addr learned my addr 172.21.15.45:0/1572356269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 -- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 msgr2=0x557cde894f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa4262dd640 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde894f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa425adc640 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde879450 0x557cde897ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde894f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 -- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde879450 msgr2=0x557cde897ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde879450 0x557cde897ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 -- 172.21.15.45:0/1572356269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cde788860 con 0x557cde85b880 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa426ade640 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c280 tx=0x7fa418007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d653b564ca088a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa407fff640 1 -- 172.21.15.45:0/1572356269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418039070 con 0x557cde85b880 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa407fff640 1 -- 172.21.15.45:0/1572356269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41802c8a0 con 0x557cde85b880 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.653+0000 7fa407fff640 1 -- 172.21.15.45:0/1572356269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41803c040 con 0x557cde85b880 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 -- 172.21.15.45:0/1572356269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 msgr2=0x557cde895cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c280 tx=0x7fa418007000 comp rx=0 tx=0).stop 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 -- 172.21.15.45:0/1572356269 shutdown_connections 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde895cb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde879450 0x557cde897ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/1572356269 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde894f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 -- 172.21.15.45:0/1572356269 >> 172.21.15.45:0/1572356269 conn(0x557cde81bc70 msgr2=0x557cde87b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 -- 172.21.15.45:0/1572356269 shutdown_connections 2023-12-08T08:17:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.654+0000 7fa42b1b4740 1 -- 172.21.15.45:0/1572356269 wait complete. 2023-12-08T08:17:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.655+0000 7fa42b1b4740 1 -- start start 2023-12-08T08:17:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.655+0000 7fa42b1b4740 1 Processor -- start 2023-12-08T08:17:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde896c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde7c0ac0 con 0x557cde85b880 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde75d2f0 con 0x557cde878e30 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cde77ac70 con 0x557cde894b30 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.656+0000 7fa42b1b4740 10 client.0 _ll_register_callbacks cb 0x557cde77f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43134/0 (socket says 172.21.15.45:43134) 2023-12-08T08:17:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 -- 172.21.15.45:0/4099644010 learned_addr learned my addr 172.21.15.45:0/4099644010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa425adc640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde896c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 -- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 msgr2=0x557cde896c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa426ade640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde896c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 -- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 msgr2=0x557cde8580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.657+0000 7fa4262dd640 1 -- 172.21.15.45:0/4099644010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408003520 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4262dd640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa41000dbb0 tx=0x7fa4100014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0ed81b0ae1fedd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4057fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410022660 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa41001fb70 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cde7b9aa0 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa41001fd30 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa42b1b4740 10 client.6165 fetch_fsmap learned FSMap version 33 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557cde7bf140 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.658+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557cde7b9aa0 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa41001f350 con 0x557cde85b880 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 10 client.6165 fetch_fsmap finished waiting for FSMap version 33 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 10 client.6165 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 20 client.6165 populate_metadata read hostname 'smithi045' 2023-12-08T08:17:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde8ae1a0 0x557cde8ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 4 client.6165 mds_command: new command op to 6024 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:17:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 --> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cde7b97c0 con 0x557cde8ae1a0 2023-12-08T08:17:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.659+0000 7fa425adc640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde8ae1a0 0x557cde8ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.660+0000 7fa425adc640 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde8ae1a0 0x557cde8ae580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654e4c69d9bdc327 server_cookie=459776bf9f8d9fd6 in_seq=0 out_seq=0 2023-12-08T08:17:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.660+0000 7fa4057fa640 10 client.6165 ms_handle_connect on v2:172.21.15.45:6836/63008111 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.660+0000 7fa4057fa640 1 -- 172.21.15.45:0/4099644010 <== mds.0 v2:172.21.15.45:6836/63008111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x557cde7b97c0 con 0x557cde8ae1a0 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.660+0000 7fa4057fa640 10 client.6165 handle_command_reply: tid=0 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.660+0000 7fa42b1b4740 1 client.6165 shutdown 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 msgr2=0x557cde87e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa41000dbb0 tx=0x7fa4100014a0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 shutdown_connections 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde8ae1a0 0x557cde8ae580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde894b30 0x557cde896c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa4057fa640 0 client.6165 ms_handle_reset on v2:172.21.15.45:6836/63008111 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/4099644010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde87e5e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 >> 172.21.15.45:0/4099644010 conn(0x557cde81bc70 msgr2=0x557cde8544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 shutdown_connections 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 1 -- 172.21.15.45:0/4099644010 wait complete. 2023-12-08T08:17:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.661+0000 7fa42b1b4740 20 client.6165 trim_cache size 0 max 16384 2023-12-08T08:17:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.678+0000 7fa42b1b4740 1 Processor -- start 2023-12-08T08:17:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.678+0000 7fa42b1b4740 1 -- start start 2023-12-08T08:17:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde85b880 0x557cde8fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8fd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde523f20 con 0x557cde81bc70 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde8993f0 con 0x557cde878e30 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cde87f850 con 0x557cde85b880 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.679+0000 7fa4262dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43150/0 (socket says 172.21.15.45:43150) 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 -- 172.21.15.45:0/2134006383 learned_addr learned my addr 172.21.15.45:0/2134006383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 -- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde85b880 msgr2=0x557cde8fd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde85b880 0x557cde8fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 -- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 msgr2=0x557cde8fd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8fd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 -- 172.21.15.45:0/2134006383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cde75cb80 con 0x557cde81bc70 2023-12-08T08:17:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa4100059a0 tx=0x7fa410014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4e726593390b3d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.680+0000 7fa41cff9640 1 -- 172.21.15.45:0/2134006383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41001f810 con 0x557cde81bc70 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa41cff9640 1 -- 172.21.15.45:0/2134006383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41001fb10 con 0x557cde81bc70 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa41cff9640 1 -- 172.21.15.45:0/2134006383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41001f990 con 0x557cde81bc70 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2134006383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 msgr2=0x557cde8b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa4100059a0 tx=0x7fa410014000 comp rx=0 tx=0).stop 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2134006383 shutdown_connections 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde85b880 0x557cde8fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde878e30 0x557cde8fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2134006383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde81bc70 0x557cde8b47a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2134006383 >> 172.21.15.45:0/2134006383 conn(0x557cde893b90 msgr2=0x557cde87dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2134006383 shutdown_connections 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.681+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2134006383 wait complete. 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.682+0000 7fa42b1b4740 1 -- start start 2023-12-08T08:17:48.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.682+0000 7fa42b1b4740 1 Processor -- start 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 0x557cde8541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde878e30 0x557cde8fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde854d40 con 0x557cde85b880 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cde909730 con 0x557cde81bc70 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cde9092a0 con 0x557cde878e30 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.683+0000 7fa42b1b4740 10 client.0 _ll_register_callbacks cb 0x7fa410003dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:17:48.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43152/0 (socket says 172.21.15.45:43152) 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 -- 172.21.15.45:0/2226767155 learned_addr learned my addr 172.21.15.45:0/2226767155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa426ade640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde878e30 0x557cde8fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 0x557cde8541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 -- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde878e30 msgr2=0x557cde8fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde878e30 0x557cde8fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 -- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 msgr2=0x557cde8541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 0x557cde8541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 -- 172.21.15.45:0/2226767155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cde7bf140 con 0x557cde85b880 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 0x557cde8541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa425adc640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa414054ba0 tx=0x7fa41405c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f639e4dad00205 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.684+0000 7fa4057fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414057b90 con 0x557cde85b880 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa414057cf0 con 0x557cde85b880 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa41802c8a0 con 0x557cde85b880 2023-12-08T08:17:48.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa414060510 con 0x557cde85b880 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 10 client.6171 fetch_fsmap learned FSMap version 33 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557cde782170 con 0x557cde85b880 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41802c8a0 con 0x557cde85b880 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa414054490 con 0x557cde85b880 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 10 client.6171 fetch_fsmap finished waiting for FSMap version 33 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 10 client.6171 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 20 client.6171 populate_metadata read hostname 'smithi045' 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde894b30 0x557cde8a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 4 client.6171 mds_command: new command op to 6024 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.685+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 --> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557cde4c16c0 con 0x557cde894b30 2023-12-08T08:17:48.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde894b30 0x557cde8a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa4262dd640 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde894b30 0x557cde8a73b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29fde666104b79db server_cookie=e2eb9f93aac85609 in_seq=0 out_seq=0 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa4057fa640 10 client.6171 ms_handle_connect on v2:172.21.15.45:6836/63008111 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa4057fa640 1 -- 172.21.15.45:0/2226767155 <== mds.0 v2:172.21.15.45:6836/63008111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557cde4c16c0 con 0x557cde894b30 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa4057fa640 10 client.6171 handle_command_reply: tid=0 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.686+0000 7fa42b1b4740 1 client.6171 shutdown 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 msgr2=0x557cde908d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa414054ba0 tx=0x7fa41405c920 comp rx=0 tx=0).stop 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 shutdown_connections 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:6836/63008111,v1:172.21.15.45:6837/63008111] conn(0x557cde894b30 0x557cde8a73b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x557cde878e30 0x557cde8fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557cde85b880 0x557cde908d60 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 --2- 172.21.15.45:0/2226767155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557cde81bc70 0x557cde8541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa4057fa640 0 client.6171 ms_handle_reset on v2:172.21.15.45:6836/63008111 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 >> 172.21.15.45:0/2226767155 conn(0x557cde893b90 msgr2=0x557cde8b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 shutdown_connections 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 1 -- 172.21.15.45:0/2226767155 wait complete. 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.687+0000 7fa42b1b4740 20 client.6171 trim_cache size 0 max 16384 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2", 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6024, 2023-12-08T08:17:48.693 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.8930684849999997, 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 33, 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 61, 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 59, 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 19.912265644000001 2023-12-08T08:17:48.694 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 msgr2=0x7fa40c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 0x7fa40c06d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa410007fd0 tx=0x7fa410009040 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 msgr2=0x7fa42013d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4140047b0 tx=0x7fa41400d9e0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 shutdown_connections 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa40c06ae70 0x7fa40c06d330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa420144070 0x7fa4201444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa420153df0 0x7fa42013d4b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 --2- 172.21.15.45:0/2860467753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4080051d0 0x7fa42013cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 >> 172.21.15.45:0/2860467753 conn(0x7fa4200a7600 msgr2=0x7fa4200c4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 shutdown_connections 2023-12-08T08:17:48.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.688+0000 7fa4272df640 1 -- 172.21.15.45:0/2860467753 wait complete. 2023-12-08T08:17:48.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:17:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.920+0000 7f49bdc91640 1 Processor -- start 2023-12-08T08:17:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.920+0000 7f49bdc91640 1 -- start start 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49b80a7910 0x7f49b80c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 0x7f49b814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b81521b0 0x7f49b8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b8155850 con 0x7f49b80a7910 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b80c0890 con 0x7f49b80c1dc0 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bdc91640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c0b70 con 0x7f49b81521b0 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bcc8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49b80a7910 0x7f49b80c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bcc8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49b80a7910 0x7f49b80c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43156/0 (socket says 172.21.15.45:43156) 2023-12-08T08:17:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.922+0000 7f49bcc8f640 1 -- 172.21.15.45:0/808557838 learned_addr learned my addr 172.21.15.45:0/808557838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bcc8f640 1 -- 172.21.15.45:0/808557838 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b81521b0 msgr2=0x7f49b8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bd490640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b81521b0 0x7f49b8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49b7fff640 1 --2- 172.21.15.45:0/808557838 >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 0x7f49b814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b81521b0 0x7f49b8155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bcc8f640 1 -- 172.21.15.45:0/808557838 >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 msgr2=0x7f49b814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/808557838 >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 0x7f49b814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49bcc8f640 1 -- 172.21.15.45:0/808557838 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80c0e50 con 0x7f49b80a7910 2023-12-08T08:17:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.923+0000 7f49b7fff640 1 --2- 172.21.15.45:0/808557838 >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 0x7f49b814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.924+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b80c1880 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f49b80c6560 tx=0x7f49ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8c0a1553a5a354 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.924+0000 7f49b77fe640 1 -- 172.21.15.45:0/808557838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0317e0 con 0x7f49b80a7910 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.924+0000 7f49b77fe640 1 -- 172.21.15.45:0/808557838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac031940 con 0x7f49b80a7910 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.924+0000 7f49b77fe640 1 -- 172.21.15.45:0/808557838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac031cd0 con 0x7f49b80a7910 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 -- 172.21.15.45:0/808557838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 msgr2=0x7f49b80c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b80c1880 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f49b80c6560 tx=0x7f49ac02b880 comp rx=0 tx=0).stop 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 -- 172.21.15.45:0/808557838 shutdown_connections 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 --2- 172.21.15.45:0/808557838 >> v2:172.21.15.114:3300/0 conn(0x7f49b80c1dc0 0x7f49b814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b81521b0 0x7f49b8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 --2- 172.21.15.45:0/808557838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b80c1880 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 -- 172.21.15.45:0/808557838 >> 172.21.15.45:0/808557838 conn(0x7f49b80c5780 msgr2=0x7f49b80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 -- 172.21.15.45:0/808557838 shutdown_connections 2023-12-08T08:17:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.925+0000 7f49bdc91640 1 -- 172.21.15.45:0/808557838 wait complete. 2023-12-08T08:17:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.927+0000 7f49bdc91640 1 Processor -- start 2023-12-08T08:17:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.927+0000 7f49bdc91640 1 -- start start 2023-12-08T08:17:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b80c1dc0 0x7f49b81ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b81521b0 0x7f49b81ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b80c4220 con 0x7f49b80a7910 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81df660 con 0x7f49b81521b0 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bdc91640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81df330 con 0x7f49b80c1dc0 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bcc8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bcc8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43158/0 (socket says 172.21.15.45:43158) 2023-12-08T08:17:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49bcc8f640 1 -- 172.21.15.45:0/2971367769 learned_addr learned my addr 172.21.15.45:0/2971367769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.928+0000 7f49b7fff640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b80c1dc0 0x7f49b81ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bd490640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b81521b0 0x7f49b81ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 -- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b80c1dc0 msgr2=0x7f49b81ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b80c1dc0 0x7f49b81ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 -- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b81521b0 msgr2=0x7f49b81ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b81521b0 0x7f49b81ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 -- 172.21.15.45:0/2971367769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0094d0 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bcc8f640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f49ac000c00 tx=0x7f49ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac032980 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac032b00 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac0453f0 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.929+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b80c5460 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.930+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8151120 con 0x7f49b80a7910 2023-12-08T08:17:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.931+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b80bf5e0 con 0x7f49b80a7910 2023-12-08T08:17:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.932+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49ac045550 con 0x7f49b80a7910 2023-12-08T08:17:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.933+0000 7f49b57fa640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 0x7f499c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.933+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f49ac0abb80 con 0x7f49b80a7910 2023-12-08T08:17:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.933+0000 7f49b7fff640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 0x7f499c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.934+0000 7f49b7fff640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 0x7f499c06d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49b814f3e0 tx=0x7f49a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:48.938+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49ac076c20 con 0x7f49b80a7910 2023-12-08T08:17:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.170+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49b806ae00 con 0x7f49b80a7910 2023-12-08T08:17:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.171+0000 7f49b57fa640 1 -- 172.21.15.45:0/2971367769 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49ac07a240 con 0x7f49b80a7910 2023-12-08T08:17:49.174 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 msgr2=0x7f499c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 0x7f499c06d330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f49b814f3e0 tx=0x7f49a4008040 comp rx=0 tx=0).stop 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 msgr2=0x7f49b8150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f49ac000c00 tx=0x7f49ac0046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 shutdown_connections 2023-12-08T08:17:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f499c06ae70 0x7f499c06d330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49b80c1dc0 0x7f49b81ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49b81521b0 0x7f49b81ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 --2- 172.21.15.45:0/2971367769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49b80a7910 0x7f49b8150be0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 >> 172.21.15.45:0/2971367769 conn(0x7f49b80c5780 msgr2=0x7f49b80a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 shutdown_connections 2023-12-08T08:17:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:49.174+0000 7f49bdc91640 1 -- 172.21.15.45:0/2971367769 wait complete. 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:17:49.197 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:17:49.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.198 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:17:49.253 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:17:49.253 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:17:49.253 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:17:49.253 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.253 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41963sec preferred_lft 41963sec 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:17:49.254 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:17:49.255 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:49.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.256 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:17:49.351 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:17:49.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.356 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:17:49.417 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:17:49.417 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:17:49.417 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:17:49.417 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:17:49.417 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:17:49.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:17:49.419 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:17:49.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.616 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:17:49.675 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:17:49.675 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:17:49.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:17:49.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:49.782 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:49.844 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:49.844 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:49.899 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:17:49.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:49.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:50.046 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:50.047 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:17:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:17:50.083 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:17:50.086 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-08T08:17:50.086 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:17:50.086 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:17:50.086 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:17:50.087 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:17:50.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:17:50.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:50.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:17:50.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:50.180 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:17:50.247 INFO:teuthology.orchestra.run.smithi045.stdout:client4985 2023-12-08T08:17:50.248 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:17:50.248 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:50.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:17:50.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.530+0000 7f6746409640 1 Processor -- start 2023-12-08T08:17:50.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.530+0000 7f6746409640 1 -- start start 2023-12-08T08:17:50.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.531+0000 7f6746409640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6740073d20 0x7f67400c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.531+0000 7f6746409640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400c2890 con 0x7f674014f860 2023-12-08T08:17:50.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.531+0000 7f6746409640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674014fc40 con 0x7f674006d270 2023-12-08T08:17:50.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.531+0000 7f6746409640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67401525f0 con 0x7f6740073d20 2023-12-08T08:17:50.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.532+0000 7f6745407640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f674014f860 0x7f67400c0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57048/0 (socket says 172.21.15.45:57048) 2023-12-08T08:17:50.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.532+0000 7f6745407640 1 -- 172.21.15.45:0/2149493448 learned_addr learned my addr 172.21.15.45:0/2149493448 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.532+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632070295 0 0) 0x7f67400c2890 con 0x7f674014f860 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.532+0000 7f6744c06640 1 --2- 172.21.15.45:0/2149493448 >> v2:172.21.15.114:3300/0 conn(0x7f6740073d20 0x7f67400c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.532+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c003520 con 0x7f674014f860 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766228964 0 0) 0x7f672c003520 con 0x7f674014f860 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 >> v2:172.21.15.114:3300/0 conn(0x7f6740073d20 msgr2=0x7f67400c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 --2- 172.21.15.45:0/2149493448 >> v2:172.21.15.114:3300/0 conn(0x7f6740073d20 0x7f67400c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 >> v1:172.21.15.114:6789/0 conn(0x7f674006d270 legacy=0x7f67400c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740152310 con 0x7f674014f860 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f673c0019f0 con 0x7f674014f860 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 >> v1:172.21.15.45:6789/0 conn(0x7f674014f860 legacy=0x7f67400c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c0039c0 0x7f672c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c0047c0 0x7f672c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f672c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67401525f0 con 0x7f672c0051d0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c00c120 con 0x7f672c0039c0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c00c2e0 con 0x7f672c0047c0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6745c08640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f672c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.533+0000 7f6745407640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c0039c0 0x7f672c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6744c06640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c0047c0 0x7f672c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6745c08640 1 -- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c0047c0 msgr2=0x7f672c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6745c08640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f672c0047c0 0x7f672c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6745c08640 1 -- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c0039c0 msgr2=0x7f672c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6745c08640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f672c0039c0 0x7f672c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.534+0000 7f6745c08640 1 -- 172.21.15.45:0/2149493448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c003520 con 0x7f672c0051d0 2023-12-08T08:17:50.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.535+0000 7f6745c08640 1 -- 172.21.15.45:0/2149493448 reap_dead start 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.535+0000 7f6745c08640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f672c00b980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6738001720 tx=0x7f672c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c94e17d127e465 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.535+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380052d0 con 0x7f672c0051d0 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.535+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673802e050 con 0x7f672c0051d0 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.535+0000 7f6737fff640 1 -- 172.21.15.45:0/2149493448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380035f0 con 0x7f672c0051d0 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 -- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 msgr2=0x7f672c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f672c00b980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6738001720 tx=0x7f672c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 -- 172.21.15.45:0/2149493448 shutdown_connections 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 --2- 172.21.15.45:0/2149493448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f672c00b980 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 -- 172.21.15.45:0/2149493448 >> 172.21.15.45:0/2149493448 conn(0x7f674006c220 msgr2=0x7f674006c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 -- 172.21.15.45:0/2149493448 shutdown_connections 2023-12-08T08:17:50.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.536+0000 7f6746409640 1 -- 172.21.15.45:0/2149493448 wait complete. 2023-12-08T08:17:50.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.538+0000 7f6746409640 1 Processor -- start 2023-12-08T08:17:50.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.538+0000 7f6746409640 1 -- start start 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67401edcb0 0x7f6740149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 0x7f674014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c6000 con 0x7f672c0051d0 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67401ee1b0 con 0x7f67400a9ae0 2023-12-08T08:17:50.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6746409640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740156250 con 0x7f67401edcb0 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43174/0 (socket says 172.21.15.45:43174) 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 -- 172.21.15.45:0/1666661372 learned_addr learned my addr 172.21.15.45:0/1666661372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6744c06640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67401edcb0 0x7f6740149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745c08640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 0x7f674014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 -- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67401edcb0 msgr2=0x7f6740149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67401edcb0 0x7f6740149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 -- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 msgr2=0x7f674014a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 0x7f674014a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745407640 1 -- 172.21.15.45:0/1666661372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740156530 con 0x7f672c0051d0 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.540+0000 7f6745c08640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 0x7f674014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:50.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6745407640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f673c0079a0 tx=0x7f673c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c007a90 con 0x7f672c0051d0 2023-12-08T08:17:50.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c0133f0 con 0x7f672c0051d0 2023-12-08T08:17:50.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67401545c0 con 0x7f672c0051d0 2023-12-08T08:17:50.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c013780 con 0x7f672c0051d0 2023-12-08T08:17:50.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.541+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674014a740 con 0x7f672c0051d0 2023-12-08T08:17:50.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.542+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740154ae0 con 0x7f672c0051d0 2023-12-08T08:17:50.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.543+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f673c0138e0 con 0x7f672c0051d0 2023-12-08T08:17:50.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.544+0000 7f6735ffb640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 0x7f672406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.544+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f673c08a3f0 con 0x7f672c0051d0 2023-12-08T08:17:50.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.545+0000 7f6744c06640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 0x7f672406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.545+0000 7f6744c06640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 0x7f672406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67400c19a0 tx=0x7f6730008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.549+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6740154ae0 con 0x7f672c0051d0 2023-12-08T08:17:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.783+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6740154ae0 con 0x7f672c0051d0 2023-12-08T08:17:50.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.784+0000 7f6735ffb640 1 -- 172.21.15.45:0/1666661372 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f673c017060 con 0x7f672c0051d0 2023-12-08T08:17:50.787 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:17:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 msgr2=0x7f672406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 0x7f672406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67400c19a0 tx=0x7f6730008040 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 msgr2=0x7f67400710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f673c0079a0 tx=0x7f673c00a640 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 shutdown_connections 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f672406ae40 0x7f672406d300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f67401edcb0 0x7f6740149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400a9ae0 0x7f674014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 --2- 172.21.15.45:0/1666661372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0051d0 0x7f67400710f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 >> 172.21.15.45:0/1666661372 conn(0x7f674006c220 msgr2=0x7f67400c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 shutdown_connections 2023-12-08T08:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:50.787+0000 7f6746409640 1 -- 172.21.15.45:0/1666661372 wait complete. 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:17:50.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:17:50.811 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:17:50.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:17:50.811 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:17:50.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:50.811 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:17:50.871 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:17:50.872 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41944sec preferred_lft 41944sec 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.873 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:17:50.874 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:17:50.874 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:17:50.874 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:17:50.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:50.875 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:17:50.966 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:17:50.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:50.970 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:17:51.027 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:17:51.028 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:17:51.028 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:17:51.028 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:17:51.028 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:17:51.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.028 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:17:51.028 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:17:51.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:17:51.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:17:51.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:17:51.029 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:17:51.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.210 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:17:51.259 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:17:51.259 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:17:51.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:17:51.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:51.340 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:17:51.389 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:17:51.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:17:51.390 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:17:51.440 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:17:51.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:51.576 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:51.576 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:51.610 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:17:51.610 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:17:51.610 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:17:51.610 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:17:51.610 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:17:51.612 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:17:51.612 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:17:51.612 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:17:51.612 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:17:51.612 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:17:51.617 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:17:51.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:17:51.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:17:51.703 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:17:51.756 INFO:teuthology.orchestra.run.smithi114.stdout:client5377 2023-12-08T08:17:51.757 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:17:51.757 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:17:51.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:17:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.037+0000 7fc6c135c640 1 Processor -- start 2023-12-08T08:17:52.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.038+0000 7fc6c135c640 1 -- start start 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.039+0000 7fc6c135c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6bc154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.039+0000 7fc6c135c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc158060 con 0x7fc6bc1547d0 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.039+0000 7fc6c135c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc151d00 con 0x7fc6bc151920 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.039+0000 7fc6c135c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc157800 con 0x7fc6bc0c9e10 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.039+0000 7fc6c0b5b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc6bc1547d0 0x7fc6bc15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57052/0 (socket says 172.21.15.45:57052) 2023-12-08T08:17:52.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6c0b5b640 1 -- 172.21.15.45:0/4037291031 learned_addr learned my addr 172.21.15.45:0/4037291031 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6bb7fe640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6bc154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012462876 0 0) 0x7fc6bc158060 con 0x7fc6bc1547d0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a8003520 con 0x7fc6bc1547d0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3508437345 0 0) 0x7fc6a8003520 con 0x7fc6bc1547d0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 msgr2=0x7fc6bc154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6bc154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 >> v1:172.21.15.114:6789/0 conn(0x7fc6bc151920 legacy=0x7fc6bc0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc06c150 con 0x7fc6bc1547d0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.040+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fc6b4001670 con 0x7fc6bc1547d0 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 >> v1:172.21.15.45:6789/0 conn(0x7fc6bc1547d0 legacy=0x7fc6bc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6a80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a8003f20 0x7fc6a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8004d00 0x7fc6a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc157800 con 0x7fc6a8004d00 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800ba60 con 0x7fc6a8003f20 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a800bc20 con 0x7fc6bc0c9e10 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8004d00 0x7fc6a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6bb7fe640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a8003f20 0x7fc6a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6a80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 -- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 msgr2=0x7fc6a80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6a80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 -- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a8003f20 msgr2=0x7fc6a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6a8003f20 0x7fc6a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.041+0000 7fc6c0b5b640 1 -- 172.21.15.45:0/4037291031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8003520 con 0x7fc6a8004d00 2023-12-08T08:17:52.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.042+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc0c9e10 0x7fc6a80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:52.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6c0b5b640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8004d00 0x7fc6a8005180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c240 tx=0x7fc6a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b84d32bec75f331 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4005ad0 con 0x7fc6a8004d00 2023-12-08T08:17:52.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4005c30 con 0x7fc6a8004d00 2023-12-08T08:17:52.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6baffd640 1 -- 172.21.15.45:0/4037291031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b402caf0 con 0x7fc6a8004d00 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6c135c640 1 -- 172.21.15.45:0/4037291031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8004d00 msgr2=0x7fc6a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.043+0000 7fc6c135c640 1 --2- 172.21.15.45:0/4037291031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8004d00 0x7fc6a8005180 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c240 tx=0x7fc6a80057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.044+0000 7fc6c0b5b640 1 -- 172.21.15.45:0/4037291031 reap_dead start 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.044+0000 7fc6c135c640 1 -- 172.21.15.45:0/4037291031 shutdown_connections 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.044+0000 7fc6c135c640 1 -- 172.21.15.45:0/4037291031 >> 172.21.15.45:0/4037291031 conn(0x7fc6bc0663d0 msgr2=0x7fc6bc0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.044+0000 7fc6c135c640 1 -- 172.21.15.45:0/4037291031 shutdown_connections 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.044+0000 7fc6c135c640 1 -- 172.21.15.45:0/4037291031 wait complete. 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.045+0000 7fc6c135c640 1 Processor -- start 2023-12-08T08:17:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.046+0000 7fc6c135c640 1 -- start start 2023-12-08T08:17:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.046+0000 7fc6c135c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 0x7fc6bc152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.046+0000 7fc6c135c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6c135c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6bc1ecdc0 0x7fc6bc1ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6c135c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc146430 con 0x7fc6bc145a70 2023-12-08T08:17:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6c135c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc154670 con 0x7fc6bc1ecdc0 2023-12-08T08:17:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6c135c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0a9bf0 con 0x7fc6bc14c980 2023-12-08T08:17:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43204/0 (socket says 172.21.15.45:43204) 2023-12-08T08:17:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 -- 172.21.15.45:0/2639322489 learned_addr learned my addr 172.21.15.45:0/2639322489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 0x7fc6bc152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6c0b5b640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6bc1ecdc0 0x7fc6bc1ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 -- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 msgr2=0x7fc6bc152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 0x7fc6bc152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 -- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6bc1ecdc0 msgr2=0x7fc6bc1ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6bc1ecdc0 0x7fc6bc1ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bb7fe640 1 -- 172.21.15.45:0/2639322489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc1ea1d0 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.047+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 0x7fc6bc152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6bb7fe640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4011630 tx=0x7fc6a4011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400f920 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a400fa80 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400fdf0 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc0a95a0 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.048+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1ea470 con 0x7fc6bc145a70 2023-12-08T08:17:52.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.049+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc1ecb80 con 0x7fc6bc145a70 2023-12-08T08:17:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.050+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6a4015460 con 0x7fc6bc145a70 2023-12-08T08:17:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.051+0000 7fc6b8ff9640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 0x7fc69c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.051+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fc6a4089c40 con 0x7fc6bc145a70 2023-12-08T08:17:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.052+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 0x7fc69c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.052+0000 7fc6bbfff640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 0x7fc69c06d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac007fd0 tx=0x7fc6ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.056+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6a4054bc0 con 0x7fc6bc145a70 2023-12-08T08:17:52.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.322+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fc6bc0673e0 con 0x7fc6bc145a70 2023-12-08T08:17:52.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.323+0000 7fc6b8ff9640 1 -- 172.21.15.45:0/2639322489 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7fc6a4022090 con 0x7fc6bc145a70 2023-12-08T08:17:52.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 msgr2=0x7fc69c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 0x7fc69c06d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac007fd0 tx=0x7fc6ac009040 comp rx=0 tx=0).stop 2023-12-08T08:17:52.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 msgr2=0x7fc6bc145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4011630 tx=0x7fc6a4011af0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 shutdown_connections 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc69c06ae40 0x7fc69c06d300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6bc1ecdc0 0x7fc6bc1ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6bc145a70 0x7fc6bc145ef0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 --2- 172.21.15.45:0/2639322489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6bc14c980 0x7fc6bc152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 >> 172.21.15.45:0/2639322489 conn(0x7fc6bc0663d0 msgr2=0x7fc6bc149dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.326+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 shutdown_connections 2023-12-08T08:17:52.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.327+0000 7fc6c135c640 1 -- 172.21.15.45:0/2639322489 wait complete. 2023-12-08T08:17:52.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:52.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.573+0000 7faee4bf4640 1 Processor -- start 2023-12-08T08:17:52.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.573+0000 7faee4bf4640 1 -- start start 2023-12-08T08:17:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.574+0000 7faee4bf4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faee01542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.574+0000 7faee4bf4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00a7300 con 0x7faee00a7770 2023-12-08T08:17:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.574+0000 7faee4bf4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00bf010 con 0x7faee00beb30 2023-12-08T08:17:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.574+0000 7faee4bf4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00bfb90 con 0x7faee014e260 2023-12-08T08:17:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.575+0000 7faedffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faee00a7770 0x7faee00a7ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57068/0 (socket says 172.21.15.45:57068) 2023-12-08T08:17:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.575+0000 7faedffff640 1 -- 172.21.15.45:0/1708353695 learned_addr learned my addr 172.21.15.45:0/1708353695 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.575+0000 7faedf7fe640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faee01542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.575+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983431330 0 0) 0x7faee00a7300 con 0x7faee00a7770 2023-12-08T08:17:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.575+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc003520 con 0x7faee00a7770 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617456332 0 0) 0x7faecc003520 con 0x7faee00a7770 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 msgr2=0x7faee01542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faee01542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 >> v1:172.21.15.114:6789/0 conn(0x7faee00beb30 legacy=0x7faee006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00bf2f0 con 0x7faee00a7770 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7faed80019f0 con 0x7faee00a7770 2023-12-08T08:17:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 >> v1:172.21.15.45:6789/0 conn(0x7faee00a7770 legacy=0x7faee00a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faecc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faecc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faecc004d00 0x7faecc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00bfb90 con 0x7faecc003f70 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00bac0 con 0x7faecc004d00 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00bc80 con 0x7faee014e260 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.576+0000 7faed7fff640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faecc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faedf7fe640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faecc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faedffff640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faecc004d00 0x7faecc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faed7fff640 1 -- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 msgr2=0x7faecc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faed7fff640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faecc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faed7fff640 1 -- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faecc004d00 msgr2=0x7faecc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faed7fff640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faecc004d00 0x7faecc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faed7fff640 1 -- 172.21.15.45:0/1708353695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc003520 con 0x7faecc003f70 2023-12-08T08:17:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.577+0000 7faedf7fe640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee014e260 0x7faecc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.578+0000 7faed7fff640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faecc0047c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faec8001750 tx=0x7faecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67389539caed919 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.578+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80052d0 con 0x7faecc003f70 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.578+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec802e050 con 0x7faecc003f70 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.578+0000 7faedeffd640 1 -- 172.21.15.45:0/1708353695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8003830 con 0x7faecc003f70 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 -- 172.21.15.45:0/1708353695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 msgr2=0x7faecc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 --2- 172.21.15.45:0/1708353695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faecc0047c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faec8001750 tx=0x7faecc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faedffff640 1 -- 172.21.15.45:0/1708353695 reap_dead start 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 -- 172.21.15.45:0/1708353695 shutdown_connections 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 -- 172.21.15.45:0/1708353695 >> 172.21.15.45:0/1708353695 conn(0x7faee00c5780 msgr2=0x7faee00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 -- 172.21.15.45:0/1708353695 shutdown_connections 2023-12-08T08:17:52.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.579+0000 7faee4bf4640 1 -- 172.21.15.45:0/1708353695 wait complete. 2023-12-08T08:17:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.581+0000 7faee4bf4640 1 Processor -- start 2023-12-08T08:17:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.581+0000 7faee4bf4640 1 -- start start 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 0x7faee01e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faee01ed830 0x7faee01eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0158040 con 0x7faecc003f70 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01edd70 con 0x7faee01ed830 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faee4bf4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee0157280 con 0x7faee01522b0 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43226/0 (socket says 172.21.15.45:43226) 2023-12-08T08:17:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedf7fe640 1 -- 172.21.15.45:0/2862816089 learned_addr learned my addr 172.21.15.45:0/2862816089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:52.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faed7fff640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 0x7faee01e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedf7fe640 1 -- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 msgr2=0x7faee01e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedf7fe640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 0x7faee01e6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.582+0000 7faedffff640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faee01ed830 0x7faee01eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedf7fe640 1 -- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faee01ed830 msgr2=0x7faee01eaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedf7fe640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faee01ed830 0x7faee01eaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedf7fe640 1 -- 172.21.15.45:0/2862816089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee0157560 con 0x7faecc003f70 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faed7fff640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 0x7faee01e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedf7fe640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faed00108b0 tx=0x7faed0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed000eb60 con 0x7faecc003f70 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000ecc0 con 0x7faecc003f70 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed001c400 con 0x7faecc003f70 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0157840 con 0x7faecc003f70 2023-12-08T08:17:52.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.583+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01e7640 con 0x7faecc003f70 2023-12-08T08:17:52.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.584+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee0148e70 con 0x7faecc003f70 2023-12-08T08:17:52.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.585+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faed001c560 con 0x7faecc003f70 2023-12-08T08:17:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.586+0000 7faedcff9640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 0x7faec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.586+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7faed0089e90 con 0x7faecc003f70 2023-12-08T08:17:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.587+0000 7faed7fff640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 0x7faec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.588+0000 7faed7fff640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 0x7faec006d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faec8033000 tx=0x7faec8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.591+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faed0054e20 con 0x7faecc003f70 2023-12-08T08:17:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.788+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee00743e0 con 0x7faecc003f70 2023-12-08T08:17:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.789+0000 7faedcff9640 1 -- 172.21.15.45:0/2862816089 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16884 (secure 0 0 0) 0x7faed0058440 con 0x7faecc003f70 2023-12-08T08:17:52.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:52.792 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":61,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:47.834738+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 msgr2=0x7faec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 0x7faec006d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faec8033000 tx=0x7faec8009030 comp rx=0 tx=0).stop 2023-12-08T08:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 msgr2=0x7faee01ed2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faed00108b0 tx=0x7faed0010d70 comp rx=0 tx=0).stop 2023-12-08T08:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 shutdown_connections 2023-12-08T08:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faec006ae40 0x7faec006d300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faee01522b0 0x7faee01e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faee01ed830 0x7faee01eaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 --2- 172.21.15.45:0/2862816089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003f70 0x7faee01ed2f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 >> 172.21.15.45:0/2862816089 conn(0x7faee00c5780 msgr2=0x7faee0149e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.792+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 shutdown_connections 2023-12-08T08:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:52.793+0000 7faee4bf4640 1 -- 172.21.15.45:0/2862816089 wait complete. 2023-12-08T08:17:52.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:39.667136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:40.266994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:52.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:53.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.039+0000 7f62f661a640 1 Processor -- start 2023-12-08T08:17:53.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.039+0000 7f62f661a640 1 -- start start 2023-12-08T08:17:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.040+0000 7f62f661a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62f0152e00 0x7f62f006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.040+0000 7f62f661a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62f00c6fb0 0x7f62f00a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.040+0000 7f62f661a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f014fbb0 con 0x7f62f00c3e50 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.040+0000 7f62f661a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f0152110 con 0x7f62f00c6fb0 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.040+0000 7f62f661a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f00c7520 con 0x7f62f0152e00 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62f00c6fb0 0x7f62f00a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62f00c6fb0 0x7f62f00a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43234/0 (socket says 172.21.15.45:43234) 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 -- 172.21.15.45:0/1337668373 learned_addr learned my addr 172.21.15.45:0/1337668373 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f4e17640 1 --2- 172.21.15.45:0/1337668373 >> v2:172.21.15.114:3300/0 conn(0x7f62f0152e00 0x7f62f006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 -- 172.21.15.45:0/1337668373 >> v2:172.21.15.114:3300/0 conn(0x7f62f0152e00 msgr2=0x7f62f006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 --2- 172.21.15.45:0/1337668373 >> v2:172.21.15.114:3300/0 conn(0x7f62f0152e00 0x7f62f006f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 -- 172.21.15.45:0/1337668373 >> v1:172.21.15.114:6789/0 conn(0x7f62f00c3e50 legacy=0x7f62f0155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.041+0000 7f62f5e19640 1 -- 172.21.15.45:0/1337668373 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0152320 con 0x7f62f00c6fb0 2023-12-08T08:17:53.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.042+0000 7f62f5e19640 1 --2- 172.21.15.45:0/1337668373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c6fb0 0x7f62f00a9c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f62f006b2e0 tx=0x7f62e802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ce3c7b4c9167aa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62e7fff640 1 -- 172.21.15.45:0/1337668373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e802c9c0 con 0x7f62f00c6fb0 2023-12-08T08:17:53.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62e7fff640 1 -- 172.21.15.45:0/1337668373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e802cb20 con 0x7f62f00c6fb0 2023-12-08T08:17:53.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62e7fff640 1 -- 172.21.15.45:0/1337668373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e80343f0 con 0x7f62f00c6fb0 2023-12-08T08:17:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 -- 172.21.15.45:0/1337668373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c6fb0 msgr2=0x7f62f00a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 --2- 172.21.15.45:0/1337668373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c6fb0 0x7f62f00a9c50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f62f006b2e0 tx=0x7f62e802be20 comp rx=0 tx=0).stop 2023-12-08T08:17:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 -- 172.21.15.45:0/1337668373 shutdown_connections 2023-12-08T08:17:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 --2- 172.21.15.45:0/1337668373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c6fb0 0x7f62f00a9c50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 --2- 172.21.15.45:0/1337668373 >> v2:172.21.15.114:3300/0 conn(0x7f62f0152e00 0x7f62f006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.043+0000 7f62f661a640 1 -- 172.21.15.45:0/1337668373 >> 172.21.15.45:0/1337668373 conn(0x7f62f00c4840 msgr2=0x7f62f00c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.044+0000 7f62f661a640 1 -- 172.21.15.45:0/1337668373 shutdown_connections 2023-12-08T08:17:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.044+0000 7f62f661a640 1 -- 172.21.15.45:0/1337668373 wait complete. 2023-12-08T08:17:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.045+0000 7f62f661a640 1 Processor -- start 2023-12-08T08:17:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.045+0000 7f62f661a640 1 -- start start 2023-12-08T08:17:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 0x7f62f00ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62f0152e00 0x7f62f01ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0153850 con 0x7f62f00c3e50 2023-12-08T08:17:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01ee460 con 0x7f62f00c6fb0 2023-12-08T08:17:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.046+0000 7f62f661a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0154120 con 0x7f62f0152e00 2023-12-08T08:17:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43248/0 (socket says 172.21.15.45:43248) 2023-12-08T08:17:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 -- 172.21.15.45:0/2273196095 learned_addr learned my addr 172.21.15.45:0/2273196095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5e19640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62f0152e00 0x7f62f01ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f4e17640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 0x7f62f00ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 -- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62f0152e00 msgr2=0x7f62f01ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62f0152e00 0x7f62f01ea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 -- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 msgr2=0x7f62f00ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 0x7f62f00ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f5618640 1 -- 172.21.15.45:0/2273196095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8009b30 con 0x7f62f00c3e50 2023-12-08T08:17:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.047+0000 7f62f4e17640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 0x7f62f00ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62f5618640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b3f0 tx=0x7f62ec00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec011830 con 0x7f62f00c3e50 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec011990 con 0x7f62f00c3e50 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec011d40 con 0x7f62f00c3e50 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0154400 con 0x7f62f00c3e50 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.048+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f01ed720 con 0x7f62f00c3e50 2023-12-08T08:17:53.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.050+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0154920 con 0x7f62f00c3e50 2023-12-08T08:17:53.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.050+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62ec01a400 con 0x7f62f00c3e50 2023-12-08T08:17:53.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.051+0000 7f62e5ffb640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 0x7f62d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.051+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f62ec0895f0 con 0x7f62f00c3e50 2023-12-08T08:17:53.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.052+0000 7f62f4e17640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 0x7f62d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.052+0000 7f62f4e17640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 0x7f62d406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62f00adbb0 tx=0x7f62e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.056+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62f0154920 con 0x7f62f00c3e50 2023-12-08T08:17:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.248+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62f0154920 con 0x7f62f00c3e50 2023-12-08T08:17:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.249+0000 7f62e5ffb640 1 -- 172.21.15.45:0/2273196095 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62f0154920 con 0x7f62f00c3e50 2023-12-08T08:17:53.252 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.252+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 msgr2=0x7f62d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.252+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 0x7f62d406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62f00adbb0 tx=0x7f62e0008040 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.252+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 msgr2=0x7f62f01edf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.252+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00b3f0 tx=0x7f62ec00b8b0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 shutdown_connections 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f62d406ae40 0x7f62d406d300 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62f0152e00 0x7f62f01ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c6fb0 0x7f62f00ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 --2- 172.21.15.45:0/2273196095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62f00c3e50 0x7f62f01edf20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 >> 172.21.15.45:0/2273196095 conn(0x7f62f00c4840 msgr2=0x7f62f00c7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 shutdown_connections 2023-12-08T08:17:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.253+0000 7f62f661a640 1 -- 172.21.15.45:0/2273196095 wait complete. 2023-12-08T08:17:53.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:17:53.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.500+0000 7f4d5644b640 1 Processor -- start 2023-12-08T08:17:53.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.500+0000 7f4d5644b640 1 -- start start 2023-12-08T08:17:53.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.501+0000 7f4d5644b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d500c3440 0x7f4d500c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.501+0000 7f4d5644b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d50072480 0x7f4d501512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.501+0000 7f4d5644b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d50154b80 con 0x7f4d5006cb40 2023-12-08T08:17:53.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.501+0000 7f4d5644b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d50155720 con 0x7f4d500c3440 2023-12-08T08:17:53.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.501+0000 7f4d5644b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5014ef30 con 0x7f4d50072480 2023-12-08T08:17:53.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d500c3440 0x7f4d500c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d549e8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4d5006cb40 0x7f4d50155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57080/0 (socket says 172.21.15.45:57080) 2023-12-08T08:17:53.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d549e8640 1 -- 172.21.15.45:0/1971046594 learned_addr learned my addr 172.21.15.45:0/1971046594 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4f7fe640 1 --2- 172.21.15.45:0/1971046594 >> v2:172.21.15.114:3300/0 conn(0x7f4d50072480 0x7f4d501512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4ffff640 1 -- 172.21.15.45:0/1971046594 >> v2:172.21.15.114:3300/0 conn(0x7f4d50072480 msgr2=0x7f4d501512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4ffff640 1 --2- 172.21.15.45:0/1971046594 >> v2:172.21.15.114:3300/0 conn(0x7f4d50072480 0x7f4d501512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4ffff640 1 -- 172.21.15.45:0/1971046594 >> v1:172.21.15.45:6789/0 conn(0x7f4d5006cb40 legacy=0x7f4d50155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4ffff640 1 -- 172.21.15.45:0/1971046594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5006e530 con 0x7f4d500c3440 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.502+0000 7f4d4effd640 1 -- 172.21.15.45:0/1971046594 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343042720 0 0) 0x7f4d50154b80 con 0x7f4d5006cb40 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.503+0000 7f4d4ffff640 1 --2- 172.21.15.45:0/1971046594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d500c3440 0x7f4d500c3820 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4d500a97e0 tx=0x7f4d4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877084983a627268 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.504+0000 7f4d4effd640 1 -- 172.21.15.45:0/1971046594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4002e070 con 0x7f4d500c3440 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.504+0000 7f4d4effd640 1 -- 172.21.15.45:0/1971046594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400315a0 con 0x7f4d500c3440 2023-12-08T08:17:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.504+0000 7f4d4effd640 1 -- 172.21.15.45:0/1971046594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40031930 con 0x7f4d500c3440 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.504+0000 7f4d5644b640 1 -- 172.21.15.45:0/1971046594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d500c3440 msgr2=0x7f4d500c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.504+0000 7f4d5644b640 1 --2- 172.21.15.45:0/1971046594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d500c3440 0x7f4d500c3820 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4d500a97e0 tx=0x7f4d4002b840 comp rx=0 tx=0).stop 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 -- 172.21.15.45:0/1971046594 shutdown_connections 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 --2- 172.21.15.45:0/1971046594 >> v2:172.21.15.114:3300/0 conn(0x7f4d50072480 0x7f4d501512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 --2- 172.21.15.45:0/1971046594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d500c3440 0x7f4d500c3820 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 -- 172.21.15.45:0/1971046594 >> 172.21.15.45:0/1971046594 conn(0x7f4d50066a70 msgr2=0x7f4d500a8760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 -- 172.21.15.45:0/1971046594 shutdown_connections 2023-12-08T08:17:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.505+0000 7f4d5644b640 1 -- 172.21.15.45:0/1971046594 wait complete. 2023-12-08T08:17:53.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.506+0000 7f4d5644b640 1 Processor -- start 2023-12-08T08:17:53.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.507+0000 7f4d5644b640 1 -- start start 2023-12-08T08:17:53.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.507+0000 7f4d5644b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d5006cb40 0x7f4d500a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.507+0000 7f4d5644b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d5644b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 0x7f4d500aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d5644b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500a5fd0 con 0x7f4d50072480 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d5644b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d501e8db0 con 0x7f4d5006cb40 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d5644b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50150070 con 0x7f4d500c3440 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43266/0 (socket says 172.21.15.45:43266) 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 -- 172.21.15.45:0/2597558005 learned_addr learned my addr 172.21.15.45:0/2597558005 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4ffff640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d5006cb40 0x7f4d500a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d549e8640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 0x7f4d500aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 -- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 msgr2=0x7f4d500aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 0x7f4d500aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 -- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d5006cb40 msgr2=0x7f4d500a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d5006cb40 0x7f4d500a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d4f7fe640 1 -- 172.21.15.45:0/2597558005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009400 con 0x7f4d50072480 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.508+0000 7f4d549e8640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 0x7f4d500aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d4f7fe640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007f20 tx=0x7f4d4400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44014620 con 0x7f4d50072480 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44014780 con 0x7f4d50072480 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44014b30 con 0x7f4d50072480 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d501e8a80 con 0x7f4d50072480 2023-12-08T08:17:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.509+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d501514c0 con 0x7f4d50072480 2023-12-08T08:17:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.510+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d50072b80 con 0x7f4d50072480 2023-12-08T08:17:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.511+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d44014c90 con 0x7f4d50072480 2023-12-08T08:17:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.512+0000 7f4d4cff9640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 0x7f4d3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.512+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4d4408a280 con 0x7f4d50072480 2023-12-08T08:17:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.513+0000 7f4d4ffff640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 0x7f4d3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.513+0000 7f4d4ffff640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 0x7f4d3c06d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d40036000 tx=0x7f4d4003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.517+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d440550e0 con 0x7f4d50072480 2023-12-08T08:17:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.710+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d50154790 con 0x7f4d50072480 2023-12-08T08:17:53.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.714+0000 7f4d4cff9640 1 -- 172.21.15.45:0/2597558005 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d44058700 con 0x7f4d50072480 2023-12-08T08:17:53.717 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:17:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.717+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 msgr2=0x7f4d3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.717+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 0x7f4d3c06d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d40036000 tx=0x7f4d4003d040 comp rx=0 tx=0).stop 2023-12-08T08:17:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 msgr2=0x7f4d500c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007f20 tx=0x7f4d4400e570 comp rx=0 tx=0).stop 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 shutdown_connections 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4d3c06ae40 0x7f4d3c06d300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4d500c3440 0x7f4d500aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d50072480 0x7f4d500c5f50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 --2- 172.21.15.45:0/2597558005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d5006cb40 0x7f4d500a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 >> 172.21.15.45:0/2597558005 conn(0x7f4d50066a70 msgr2=0x7f4d50071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 shutdown_connections 2023-12-08T08:17:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.718+0000 7f4d5644b640 1 -- 172.21.15.45:0/2597558005 wait complete. 2023-12-08T08:17:53.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:17:53.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.963+0000 7f814d632640 1 Processor -- start 2023-12-08T08:17:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.964+0000 7f814d632640 1 -- start start 2023-12-08T08:17:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.965+0000 7f814d632640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8148151ad0 0x7f81480ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.965+0000 7f814d632640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8148151eb0 con 0x7f81480ca610 2023-12-08T08:17:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.965+0000 7f814d632640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480c80d0 con 0x7f8148157a20 2023-12-08T08:17:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.965+0000 7f814d632640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480c56a0 con 0x7f8148151ad0 2023-12-08T08:17:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.966+0000 7f814ce31640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81480ca610 0x7f814815edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57092/0 (socket says 172.21.15.45:57092) 2023-12-08T08:17:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.966+0000 7f814ce31640 1 -- 172.21.15.45:0/2652230326 learned_addr learned my addr 172.21.15.45:0/2652230326 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.966+0000 7f8147fff640 1 --2- 172.21.15.45:0/2652230326 >> v2:172.21.15.114:3300/0 conn(0x7f8148151ad0 0x7f81480ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.966+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304105350 0 0) 0x7f8148151eb0 con 0x7f81480ca610 2023-12-08T08:17:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.966+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8134003520 con 0x7f81480ca610 2023-12-08T08:17:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685875592 0 0) 0x7f8134003520 con 0x7f81480ca610 2023-12-08T08:17:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 >> v2:172.21.15.114:3300/0 conn(0x7f8148151ad0 msgr2=0x7f81480ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 --2- 172.21.15.45:0/2652230326 >> v2:172.21.15.114:3300/0 conn(0x7f8148151ad0 0x7f81480ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 >> v1:172.21.15.114:6789/0 conn(0x7f8148157a20 legacy=0x7f8148154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148154430 con 0x7f81480ca610 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f81400019f0 con 0x7f81480ca610 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 >> v1:172.21.15.45:6789/0 conn(0x7f81480ca610 legacy=0x7f814815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f8134003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81340047c0 0x7f8134004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8134005180 0x7f813400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813400c050 con 0x7f81340039c0 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813400c1c0 con 0x7f81340047c0 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813400c380 con 0x7f8134005180 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f8147fff640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f8134003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.967+0000 7f814ce31640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8134005180 0x7f813400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f8147fff640 1 -- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8134005180 msgr2=0x7f813400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f8147fff640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8134005180 0x7f813400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f8147fff640 1 -- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81340047c0 msgr2=0x7f8134004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f8147fff640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81340047c0 0x7f8134004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f8147fff640 1 -- 172.21.15.45:0/2652230326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134003520 con 0x7f81340039c0 2023-12-08T08:17:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.968+0000 7f814ce31640 1 -- 172.21.15.45:0/2652230326 reap_dead start 2023-12-08T08:17:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.969+0000 7f8147fff640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f8134003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8138009ac0 tx=0x7f81340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc1b45ccf4d1c67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.969+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813802c6b0 con 0x7f81340039c0 2023-12-08T08:17:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.969+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813802c810 con 0x7f81340039c0 2023-12-08T08:17:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.969+0000 7f81477fe640 1 -- 172.21.15.45:0/2652230326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813802cba0 con 0x7f81340039c0 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 -- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 msgr2=0x7f8134003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f8134003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8138009ac0 tx=0x7f81340057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 -- 172.21.15.45:0/2652230326 shutdown_connections 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 --2- 172.21.15.45:0/2652230326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f8134003de0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 -- 172.21.15.45:0/2652230326 >> 172.21.15.45:0/2652230326 conn(0x7f8148066610 msgr2=0x7f8148066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 -- 172.21.15.45:0/2652230326 shutdown_connections 2023-12-08T08:17:53.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.970+0000 7f814d632640 1 -- 172.21.15.45:0/2652230326 wait complete. 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.972+0000 7f814d632640 1 Processor -- start 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.972+0000 7f814d632640 1 -- start start 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 0x7f814814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f814814a750 0x7f81480c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814efc0 con 0x7f81340039c0 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814abd0 con 0x7f81480c0590 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814d632640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480736c0 con 0x7f814814a750 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43280/0 (socket says 172.21.15.45:43280) 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 -- 172.21.15.45:0/4225872956 learned_addr learned my addr 172.21.15.45:0/4225872956 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f814ce31640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f814814a750 0x7f81480c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f813ffff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 0x7f814814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 -- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f814814a750 msgr2=0x7f81480c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f814814a750 0x7f81480c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 -- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 msgr2=0x7f814814a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.973+0000 7f8147fff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 0x7f814814a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f8147fff640 1 -- 172.21.15.45:0/4225872956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814814ece0 con 0x7f81340039c0 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f813ffff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 0x7f814814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f8147fff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f813802c250 tx=0x7f8138004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138003810 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138003970 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138003d00 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81480c3650 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.974+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81480abfe0 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.975+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480c34b0 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.976+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8138034440 con 0x7f81340039c0 2023-12-08T08:17:53.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.977+0000 7f81457fa640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 0x7f812806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.977+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f81380aba00 con 0x7f81340039c0 2023-12-08T08:17:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.978+0000 7f813ffff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 0x7f812806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.978+0000 7f813ffff640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 0x7f812806d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8148150960 tx=0x7f8130009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:53.981+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81480c34b0 con 0x7f81340039c0 2023-12-08T08:17:54.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.182+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81480c34b0 con 0x7f81340039c0 2023-12-08T08:17:54.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.183+0000 7f81457fa640 1 -- 172.21.15.45:0/4225872956 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81480c34b0 con 0x7f81340039c0 2023-12-08T08:17:54.186 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:17:54.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 msgr2=0x7f812806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 0x7f812806d330 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8148150960 tx=0x7f8130009040 comp rx=0 tx=0).stop 2023-12-08T08:17:54.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 msgr2=0x7f81480abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f813802c250 tx=0x7f8138004730 comp rx=0 tx=0).stop 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 shutdown_connections 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f812806ae70 0x7f812806d330 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f814814a750 0x7f81480c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81480c0590 0x7f814814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 --2- 172.21.15.45:0/4225872956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81340039c0 0x7f81480abaa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.185+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 >> 172.21.15.45:0/4225872956 conn(0x7f8148066610 msgr2=0x7f81480c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.186+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 shutdown_connections 2023-12-08T08:17:54.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.186+0000 7f814d632640 1 -- 172.21.15.45:0/4225872956 wait complete. 2023-12-08T08:17:54.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:17:54.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.417+0000 7fdda5c39640 1 Processor -- start 2023-12-08T08:17:54.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.417+0000 7fdda5c39640 1 -- start start 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda5c39640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdda00c7d50 0x7fdda0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda5c39640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda00c8470 con 0x7fdda00af290 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda5c39640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda006c320 con 0x7fdda00c47d0 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda5c39640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda006cb30 con 0x7fdda00c7d50 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda4c37640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdda00af290 0x7fdda00ca190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57106/0 (socket says 172.21.15.45:57106) 2023-12-08T08:17:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.419+0000 7fdda4c37640 1 -- 172.21.15.45:0/3864368380 learned_addr learned my addr 172.21.15.45:0/3864368380 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/3864368380 >> v2:172.21.15.114:3300/0 conn(0x7fdda00c7d50 0x7fdda0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695008817 0 0) 0x7fdda00c8470 con 0x7fdda00af290 2023-12-08T08:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd90003520 con 0x7fdda00af290 2023-12-08T08:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283116379 0 0) 0x7fdd90003520 con 0x7fdda00af290 2023-12-08T08:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 >> v2:172.21.15.114:3300/0 conn(0x7fdda00c7d50 msgr2=0x7fdda0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3864368380 >> v2:172.21.15.114:3300/0 conn(0x7fdda00c7d50 0x7fdda0157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 >> v1:172.21.15.114:6789/0 conn(0x7fdda00c47d0 legacy=0x7fdda01582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00c4fd0 con 0x7fdda00af290 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdd94001670 con 0x7fdda00af290 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 >> v1:172.21.15.45:6789/0 conn(0x7fdda00af290 legacy=0x7fdda00ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd900047c0 0x7fdd90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900052a0 0x7fdd9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda006cb30 con 0x7fdd900039c0 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9000c1a0 con 0x7fdd900047c0 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.420+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9000c360 con 0x7fdd900052a0 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 -- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900052a0 msgr2=0x7fdd9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda5438640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900052a0 0x7fdd9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd900047c0 0x7fdd90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900052a0 0x7fdd9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 -- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd900047c0 msgr2=0x7fdd90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd900047c0 0x7fdd90004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda4c37640 1 -- 172.21.15.45:0/3864368380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90003520 con 0x7fdd900039c0 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda5438640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900052a0 0x7fdd9000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.421+0000 7fdda5438640 1 -- 172.21.15.45:0/3864368380 reap_dead start 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.422+0000 7fdda4c37640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 0x7fdd90003de0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c0e0 tx=0x7fdd900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5790d08d6a9611d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94005ad0 con 0x7fdd900039c0 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94005c30 con 0x7fdd900039c0 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdd9f7fe640 1 -- 172.21.15.45:0/3864368380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9402c7d0 con 0x7fdd900039c0 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 -- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 msgr2=0x7fdd90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 0x7fdd90003de0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c0e0 tx=0x7fdd900057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 -- 172.21.15.45:0/3864368380 shutdown_connections 2023-12-08T08:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 --2- 172.21.15.45:0/3864368380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 -- 172.21.15.45:0/3864368380 >> 172.21.15.45:0/3864368380 conn(0x7fdda00663d0 msgr2=0x7fdda00667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 -- 172.21.15.45:0/3864368380 shutdown_connections 2023-12-08T08:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.423+0000 7fdda5c39640 1 -- 172.21.15.45:0/3864368380 wait complete. 2023-12-08T08:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.425+0000 7fdda5c39640 1 Processor -- start 2023-12-08T08:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.425+0000 7fdda5c39640 1 -- start start 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900039c0 0x7fdda0153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 0x7fdda014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00c2ec0 con 0x7fdda00ac5d0 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda014dc10 con 0x7fdda00c26b0 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdda5c39640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00ac1d0 con 0x7fdd900039c0 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.426+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43300/0 (socket says 172.21.15.45:43300) 2023-12-08T08:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 -- 172.21.15.45:0/1156505956 learned_addr learned my addr 172.21.15.45:0/1156505956 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdda4c37640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900039c0 0x7fdda0153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdda5438640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 0x7fdda014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 -- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900039c0 msgr2=0x7fdda0153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900039c0 0x7fdda0153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 -- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 msgr2=0x7fdda014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 0x7fdda014d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 -- 172.21.15.45:0/1156505956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00aa140 con 0x7fdda00ac5d0 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdda5438640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 0x7fdda014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.427+0000 7fdd9ffff640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0108e0 tx=0x7fdd8c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.428+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00eb60 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.428+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00ecc0 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.428+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda00c2be0 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.428+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c01c400 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.428+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda00a9dd0 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.429+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00a9950 con 0x7fdda00ac5d0 2023-12-08T08:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.430+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd8c01c560 con 0x7fdda00ac5d0 2023-12-08T08:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.431+0000 7fdd9d7fa640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 0x7fdd8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.431+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fdd8c089e40 con 0x7fdda00ac5d0 2023-12-08T08:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.431+0000 7fdda4c37640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 0x7fdd8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.432+0000 7fdda4c37640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 0x7fdd8406d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd94034000 tx=0x7fdd94009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.435+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdda00a9950 con 0x7fdda00ac5d0 2023-12-08T08:17:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.631+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdda00a9950 con 0x7fdda00ac5d0 2023-12-08T08:17:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.632+0000 7fdd9d7fa640 1 -- 172.21.15.45:0/1156505956 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+208 (secure 0 0 0) 0x7fdda00a9950 con 0x7fdda00ac5d0 2023-12-08T08:17:54.634 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:54.634 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 9, 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 10, 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_data" 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:17:54.635 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:17:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 msgr2=0x7fdd8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 0x7fdd8406d330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd94034000 tx=0x7fdd94009030 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 msgr2=0x7fdda014d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0108e0 tx=0x7fdd8c010da0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 shutdown_connections 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.634+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd8406ae70 0x7fdd8406d330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda00c26b0 0x7fdda014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdda00ac5d0 0x7fdda014d190 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 --2- 172.21.15.45:0/1156505956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd900039c0 0x7fdda0153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 >> 172.21.15.45:0/1156505956 conn(0x7fdda00663d0 msgr2=0x7fdda01559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 shutdown_connections 2023-12-08T08:17:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.635+0000 7fdda5c39640 1 -- 172.21.15.45:0/1156505956 wait complete. 2023-12-08T08:17:54.657 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:17:54.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:17:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.886+0000 7f27194c3640 1 Processor -- start 2023-12-08T08:17:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.886+0000 7f27194c3640 1 -- start start 2023-12-08T08:17:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.887+0000 7f27194c3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f27140a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.887+0000 7f27194c3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27140aa1e0 0x7f2714151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.887+0000 7f27194c3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140a9810 con 0x7f27140c1640 2023-12-08T08:17:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.887+0000 7f27194c3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140c5ec0 con 0x7f27140aa1e0 2023-12-08T08:17:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f27194c3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140aa670 con 0x7f27140c4dd0 2023-12-08T08:17:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f2713fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f27140c1640 0x7f27140c57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57122/0 (socket says 172.21.15.45:57122) 2023-12-08T08:17:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f2713fff640 1 -- 172.21.15.45:0/1465168417 learned_addr learned my addr 172.21.15.45:0/1465168417 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f270b7fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f27140a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f2718cc2640 1 --2- 172.21.15.45:0/1465168417 >> v2:172.21.15.114:3300/0 conn(0x7f27140aa1e0 0x7f2714151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387968496 0 0) 0x7f27140a9810 con 0x7f27140c1640 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.888+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2700003520 con 0x7f27140c1640 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421200319 0 0) 0x7f2700003520 con 0x7f27140c1640 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 msgr2=0x7f27140a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f27140a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 >> v2:172.21.15.114:3300/0 conn(0x7f27140aa1e0 msgr2=0x7f2714151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 --2- 172.21.15.45:0/1465168417 >> v2:172.21.15.114:3300/0 conn(0x7f27140aa1e0 0x7f2714151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140a5040 con 0x7f27140c1640 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f27040019f0 con 0x7f27140c1640 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 >> v1:172.21.15.45:6789/0 conn(0x7f27140c1640 legacy=0x7f27140c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27000047c0 0x7f2700004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f2700005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c5ec0 con 0x7f27000047c0 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140aa670 con 0x7f2700003970 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270000b980 con 0x7f27140c4dd0 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f270b7fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27000047c0 0x7f2700004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.889+0000 7f2713fff640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f2718cc2640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f2700005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f270b7fe640 1 -- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 msgr2=0x7f2700005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f270b7fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f27140c4dd0 0x7f2700005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f270b7fe640 1 -- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2700003970 msgr2=0x7f2700003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f270b7fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2700003970 0x7f2700003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.890+0000 7f270b7fe640 1 -- 172.21.15.45:0/1465168417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700003520 con 0x7f27000047c0 2023-12-08T08:17:54.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.891+0000 7f270b7fe640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27000047c0 0x7f2700004c40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009ac0 tx=0x7f27000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8908a04706b9105 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.891+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc02c6b0 con 0x7f27000047c0 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.891+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc02c810 con 0x7f27000047c0 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.891+0000 7f27137fe640 1 -- 172.21.15.45:0/1465168417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc02cba0 con 0x7f27000047c0 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 -- 172.21.15.45:0/1465168417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27000047c0 msgr2=0x7f2700004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 --2- 172.21.15.45:0/1465168417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27000047c0 0x7f2700004c40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009ac0 tx=0x7f27000057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f2718cc2640 1 -- 172.21.15.45:0/1465168417 reap_dead start 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 -- 172.21.15.45:0/1465168417 shutdown_connections 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 -- 172.21.15.45:0/1465168417 >> 172.21.15.45:0/1465168417 conn(0x7f2714066df0 msgr2=0x7f27140a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 -- 172.21.15.45:0/1465168417 shutdown_connections 2023-12-08T08:17:54.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.892+0000 7f27194c3640 1 -- 172.21.15.45:0/1465168417 wait complete. 2023-12-08T08:17:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.894+0000 7f27194c3640 1 Processor -- start 2023-12-08T08:17:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.894+0000 7f27194c3640 1 -- start start 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 0x7f2714153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2714070c70 0x7f27140710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714072320 con 0x7f2714154680 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714071ca0 con 0x7f27000047c0 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f27194c3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27141ea800 con 0x7f2714070c70 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f270b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f270b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43314/0 (socket says 172.21.15.45:43314) 2023-12-08T08:17:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f270b7fe640 1 -- 172.21.15.45:0/4288146685 learned_addr learned my addr 172.21.15.45:0/4288146685 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f2713fff640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 0x7f2714153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.895+0000 7f2718cc2640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2714070c70 0x7f27140710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 -- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2714070c70 msgr2=0x7f27140710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2714070c70 0x7f27140710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 -- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 msgr2=0x7f2714153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 0x7f2714153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 -- 172.21.15.45:0/4288146685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714071f40 con 0x7f2714154680 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f2713fff640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 0x7f2714153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f270b7fe640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f26fc02c2b0 tx=0x7f26fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc003810 con 0x7f2714154680 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc003970 con 0x7f2714154680 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc003ce0 con 0x7f2714154680 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.896+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27141eaae0 con 0x7f2714154680 2023-12-08T08:17:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.897+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2714071630 con 0x7f2714154680 2023-12-08T08:17:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.898+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714067900 con 0x7f2714154680 2023-12-08T08:17:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.899+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26fc047450 con 0x7f2714154680 2023-12-08T08:17:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.900+0000 7f27117fa640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 0x7f26f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.900+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f26fc0aba80 con 0x7f2714154680 2023-12-08T08:17:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.900+0000 7f2713fff640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 0x7f26f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.901+0000 7f2713fff640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 0x7f26f406d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2704002230 tx=0x7f27040012f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:54.904+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26fc076980 con 0x7f2714154680 2023-12-08T08:17:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.100+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f27140720d0 con 0x7f2714154680 2023-12-08T08:17:55.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.733+0000 7f27117fa640 1 -- 172.21.15.45:0/4288146685 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v62) v1 ==== 140+0+0 (secure 0 0 0) 0x7f26fc0ab070 con 0x7f2714154680 2023-12-08T08:17:55.737 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:17:55.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 msgr2=0x7f26f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 0x7f26f406d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2704002230 tx=0x7f27040012f0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 msgr2=0x7f27141dc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f26fc02c2b0 tx=0x7f26fc004730 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 shutdown_connections 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f26f406ae40 0x7f26f406d300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2714070c70 0x7f27140710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2714154680 0x7f27141dc750 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 --2- 172.21.15.45:0/4288146685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000047c0 0x7f2714153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.739+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 >> 172.21.15.45:0/4288146685 conn(0x7f2714066df0 msgr2=0x7f27140c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.740+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 shutdown_connections 2023-12-08T08:17:55.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.740+0000 7f27194c3640 1 -- 172.21.15.45:0/4288146685 wait complete. 2023-12-08T08:17:55.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.991+0000 7f5c78dfb640 1 Processor -- start 2023-12-08T08:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.992+0000 7f5c78dfb640 1 -- start start 2023-12-08T08:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.993+0000 7f5c78dfb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c740c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.993+0000 7f5c78dfb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c7406bdc0 0x7f5c740c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.993+0000 7f5c78dfb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c74154970 con 0x7f5c74151970 2023-12-08T08:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.993+0000 7f5c78dfb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740c55e0 con 0x7f5c7406bdc0 2023-12-08T08:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.993+0000 7f5c78dfb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74151d50 con 0x7f5c7406cdd0 2023-12-08T08:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c737fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c74151970 0x7f5c74154260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41854/0 (socket says 172.21.15.45:41854) 2023-12-08T08:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c737fe640 1 -- 172.21.15.45:0/2160771993 learned_addr learned my addr 172.21.15.45:0/2160771993 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c72ffd640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c740c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c73fff640 1 --2- 172.21.15.45:0/2160771993 >> v2:172.21.15.114:3300/0 conn(0x7f5c7406bdc0 0x7f5c740c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367493105 0 0) 0x7f5c64001490 con 0x7f5c74151970 2023-12-08T08:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.994+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c60003520 con 0x7f5c74151970 2023-12-08T08:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 599755431 0 0) 0x7f5c60003520 con 0x7f5c74151970 2023-12-08T08:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 msgr2=0x7f5c740c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c740c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 >> v2:172.21.15.114:3300/0 conn(0x7f5c7406bdc0 msgr2=0x7f5c740c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 --2- 172.21.15.45:0/2160771993 >> v2:172.21.15.114:3300/0 conn(0x7f5c7406bdc0 0x7f5c740c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74154bb0 con 0x7f5c74151970 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5c64001b80 con 0x7f5c74151970 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 >> v1:172.21.15.45:6789/0 conn(0x7f5c74151970 legacy=0x7f5c74154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c600039a0 0x7f5c60003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c60004d00 0x7f5c60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740c55e0 con 0x7f5c600039a0 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6000b980 con 0x7f5c60004d00 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6000baf0 con 0x7f5c7406cdd0 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.995+0000 7f5c737fe640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c600039a0 0x7f5c60003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c73fff640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c60004d00 0x7f5c60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c72ffd640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c737fe640 1 -- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 msgr2=0x7f5c600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c737fe640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c737fe640 1 -- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c60004d00 msgr2=0x7f5c60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c737fe640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c60004d00 0x7f5c60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c737fe640 1 -- 172.21.15.45:0/2160771993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60003520 con 0x7f5c600039a0 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.996+0000 7f5c72ffd640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c7406cdd0 0x7f5c600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.997+0000 7f5c737fe640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c600039a0 0x7f5c60003dc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400a830 tx=0x7f5c600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48b3826edfcf6a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.997+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64034630 con 0x7f5c600039a0 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.997+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6402f070 con 0x7f5c600039a0 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.997+0000 7f5c727fc640 1 -- 172.21.15.45:0/2160771993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640349f0 con 0x7f5c600039a0 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 -- 172.21.15.45:0/2160771993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c600039a0 msgr2=0x7f5c60003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/2160771993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c600039a0 0x7f5c60003dc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400a830 tx=0x7f5c600057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c73fff640 1 -- 172.21.15.45:0/2160771993 reap_dead start 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 -- 172.21.15.45:0/2160771993 shutdown_connections 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 -- 172.21.15.45:0/2160771993 >> 172.21.15.45:0/2160771993 conn(0x7f5c740ab670 msgr2=0x7f5c740aba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 -- 172.21.15.45:0/2160771993 shutdown_connections 2023-12-08T08:17:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:55.998+0000 7f5c78dfb640 1 -- 172.21.15.45:0/2160771993 wait complete. 2023-12-08T08:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.000+0000 7f5c78dfb640 1 Processor -- start 2023-12-08T08:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.000+0000 7f5c78dfb640 1 -- start start 2023-12-08T08:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 0x7f5c740bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c740be340 0x7f5c740beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7414f490 con 0x7f5c7414f920 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7414e8f0 con 0x7f5c600039a0 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c78dfb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7414eb60 con 0x7f5c740be340 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40606/0 (socket says 172.21.15.45:40606) 2023-12-08T08:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.001+0000 7f5c73fff640 1 -- 172.21.15.45:0/3589587263 learned_addr learned my addr 172.21.15.45:0/3589587263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c72ffd640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c740be340 0x7f5c740beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c737fe640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 0x7f5c740bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 -- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c740be340 msgr2=0x7f5c740beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c740be340 0x7f5c740beaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 -- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 msgr2=0x7f5c740bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 0x7f5c740bcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 -- 172.21.15.45:0/3589587263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7414ee40 con 0x7f5c7414f920 2023-12-08T08:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c737fe640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 0x7f5c740bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c73fff640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5c7408bd20 tx=0x7f5c6c0116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.002+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c004440 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.003+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c003610 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.003+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c003a00 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.003+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7414f120 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.003+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c740bf030 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.004+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7414f2e0 con 0x7f5c7414f920 2023-12-08T08:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.005+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c6c003b60 con 0x7f5c7414f920 2023-12-08T08:17:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.006+0000 7f5c6bfff640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 0x7f5c5406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.006+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6516+0+0 (secure 0 0 0) 0x7f5c6c089610 con 0x7f5c7414f920 2023-12-08T08:17:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.006+0000 7f5c737fe640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 0x7f5c5406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.007+0000 7f5c737fe640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 0x7f5c5406d350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5c64034000 tx=0x7f5c6402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.011+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c6c0542e0 con 0x7f5c7414f920 2023-12-08T08:17:56.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.208+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5c740673e0 con 0x7f5c7414f920 2023-12-08T08:17:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.748+0000 7f5c6bfff640 1 -- 172.21.15.45:0/3589587263 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v63) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c6c057900 con 0x7f5c7414f920 2023-12-08T08:17:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' created 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 msgr2=0x7f5c5406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 0x7f5c5406d350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5c64034000 tx=0x7f5c6402f000 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 msgr2=0x7f5c741527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5c7408bd20 tx=0x7f5c6c0116f0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 shutdown_connections 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c5406ae90 0x7f5c5406d350 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c740be340 0x7f5c740beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c7414f920 0x7f5c741527e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 --2- 172.21.15.45:0/3589587263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c600039a0 0x7f5c740bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 >> 172.21.15.45:0/3589587263 conn(0x7f5c740ab670 msgr2=0x7f5c74150080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 shutdown_connections 2023-12-08T08:17:56.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.754+0000 7f5c78dfb640 1 -- 172.21.15.45:0/3589587263 wait complete. 2023-12-08T08:17:56.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:17:56.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.986+0000 7ff0a8368640 1 Processor -- start 2023-12-08T08:17:56.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.986+0000 7ff0a8368640 1 -- start start 2023-12-08T08:17:56.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a8368640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0a0151a70 0x7ff0a00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a8368640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0a00c8000 0x7ff0a00c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a8368640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a0154cf0 con 0x7ff0a00a6ec0 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a8368640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a0151e50 con 0x7ff0a00c8000 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a8368640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a01543e0 con 0x7ff0a0151a70 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a5903640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0a00c8000 0x7ff0a00c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a6905640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0a00a6ec0 0x7ff0a01579d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41858/0 (socket says 172.21.15.45:41858) 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a5903640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0a00c8000 0x7ff0a00c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40608/0 (socket says 172.21.15.45:40608) 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a6905640 1 -- 172.21.15.45:0/780956130 learned_addr learned my addr 172.21.15.45:0/780956130 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.988+0000 7ff0a6104640 1 --2- 172.21.15.45:0/780956130 >> v2:172.21.15.114:3300/0 conn(0x7ff0a0151a70 0x7ff0a00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.989+0000 7ff0a5903640 1 -- 172.21.15.45:0/780956130 >> v2:172.21.15.114:3300/0 conn(0x7ff0a0151a70 msgr2=0x7ff0a00c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.989+0000 7ff0a5903640 1 --2- 172.21.15.45:0/780956130 >> v2:172.21.15.114:3300/0 conn(0x7ff0a0151a70 0x7ff0a00c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.989+0000 7ff0a5903640 1 -- 172.21.15.45:0/780956130 >> v1:172.21.15.45:6789/0 conn(0x7ff0a00a6ec0 legacy=0x7ff0a01579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.989+0000 7ff0a5903640 1 -- 172.21.15.45:0/780956130 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00a7440 con 0x7ff0a00c8000 2023-12-08T08:17:56.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.989+0000 7ff0a5102640 1 -- 172.21.15.45:0/780956130 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893727846 0 0) 0x7ff0a0154cf0 con 0x7ff0a00a6ec0 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.990+0000 7ff0a5903640 1 --2- 172.21.15.45:0/780956130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a00c0f20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00708d0 tx=0x7ff09002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8984f54ac9f65fa3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.990+0000 7ff0a5102640 1 -- 172.21.15.45:0/780956130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090031710 con 0x7ff0a00c8000 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.990+0000 7ff0a5102640 1 -- 172.21.15.45:0/780956130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09002f050 con 0x7ff0a00c8000 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.990+0000 7ff0a5102640 1 -- 172.21.15.45:0/780956130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090031a90 con 0x7ff0a00c8000 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 -- 172.21.15.45:0/780956130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 msgr2=0x7ff0a00c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 --2- 172.21.15.45:0/780956130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a00c0f20 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00708d0 tx=0x7ff09002b7b0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 -- 172.21.15.45:0/780956130 shutdown_connections 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 --2- 172.21.15.45:0/780956130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a00c0f20 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 --2- 172.21.15.45:0/780956130 >> v2:172.21.15.114:3300/0 conn(0x7ff0a0151a70 0x7ff0a00c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 -- 172.21.15.45:0/780956130 >> 172.21.15.45:0/780956130 conn(0x7ff0a00a98a0 msgr2=0x7ff0a00a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:56.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 -- 172.21.15.45:0/780956130 shutdown_connections 2023-12-08T08:17:56.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.991+0000 7ff0a8368640 1 -- 172.21.15.45:0/780956130 wait complete. 2023-12-08T08:17:56.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.993+0000 7ff0a8368640 1 Processor -- start 2023-12-08T08:17:56.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.993+0000 7ff0a8368640 1 -- start start 2023-12-08T08:17:56.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a00a6ec0 0x7ff0a006c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff0a0151a70 0x7ff0a014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a014aab0 con 0x7ff0a00c8000 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00c3130 con 0x7ff0a00a6ec0 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a8368640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a014ad00 con 0x7ff0a0151a70 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a5903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a5903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40624/0 (socket says 172.21.15.45:40624) 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a5903640 1 -- 172.21.15.45:0/832003147 learned_addr learned my addr 172.21.15.45:0/832003147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a5903640 1 -- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff0a0151a70 msgr2=0x7ff0a014a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.994+0000 7ff0a5903640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff0a0151a70 0x7ff0a014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff0a5903640 1 -- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a00a6ec0 msgr2=0x7ff0a006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff0a5903640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a00a6ec0 0x7ff0a006c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff0a5903640 1 -- 172.21.15.45:0/832003147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009400 con 0x7ff0a00c8000 2023-12-08T08:17:56.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff0a5903640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff090009890 tx=0x7ff0900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090004230 con 0x7ff0a00c8000 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0900043b0 con 0x7ff0a00c8000 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090004520 con 0x7ff0a00c8000 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.995+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a00c2800 con 0x7ff0a00c8000 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.996+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a00c2dc0 con 0x7ff0a00c8000 2023-12-08T08:17:57.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.997+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0074670 con 0x7ff0a00c8000 2023-12-08T08:17:57.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.998+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff09003a050 con 0x7ff0a00c8000 2023-12-08T08:17:57.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.999+0000 7ff096ffd640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 0x7ff08406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:57.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.999+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6899+0+0 (secure 0 0 0) 0x7ff0900ab1d0 con 0x7ff0a00c8000 2023-12-08T08:17:57.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:56.999+0000 7ff0a6104640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 0x7ff08406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:57.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.000+0000 7ff0a6104640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 0x7ff08406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0098f0 tx=0x7ff09c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:57.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.004+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff090075dc0 con 0x7ff0a00c8000 2023-12-08T08:17:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.234+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7ff0a00c3270 con 0x7ff0a00c8000 2023-12-08T08:17:57.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.772+0000 7ff096ffd640 1 -- 172.21.15.45:0/832003147 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 11 and data pool 12 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7ff0a00c3270 con 0x7ff0a00c8000 2023-12-08T08:17:57.776 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 11 and data pool 12 2023-12-08T08:17:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.781+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 msgr2=0x7ff08406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.781+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 0x7ff08406d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0098f0 tx=0x7ff09c008040 comp rx=0 tx=0).stop 2023-12-08T08:17:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.781+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 msgr2=0x7ff0a0149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.781+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff090009890 tx=0x7ff0900046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 shutdown_connections 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff08406ae70 0x7ff08406d330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff0a0151a70 0x7ff0a014a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a00c8000 0x7ff0a0149dd0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 --2- 172.21.15.45:0/832003147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0a00a6ec0 0x7ff0a006c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.783+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 >> 172.21.15.45:0/832003147 conn(0x7ff0a00a98a0 msgr2=0x7ff0a014eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.784+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 shutdown_connections 2023-12-08T08:17:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:57.785+0000 7ff0a8368640 1 -- 172.21.15.45:0/832003147 wait complete. 2023-12-08T08:17:57.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:58.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.008+0000 7efda32a3640 1 Processor -- start 2023-12-08T08:17:58.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.008+0000 7efda32a3640 1 -- start start 2023-12-08T08:17:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.009+0000 7efda32a3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd9c15b580 0x7efd9c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.009+0000 7efda32a3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd9c159e50 0x7efd9c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda32a3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c0c0870 con 0x7efd9c0c0100 2023-12-08T08:17:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda32a3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0a79d0 con 0x7efd9c159e50 2023-12-08T08:17:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda32a3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c0c0b50 con 0x7efd9c15b580 2023-12-08T08:17:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda1aa0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efd9c0c0100 0x7efd9c06c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41866/0 (socket says 172.21.15.45:41866) 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda1aa0640 1 -- 172.21.15.45:0/3945673156 learned_addr learned my addr 172.21.15.45:0/3945673156 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda2aa2640 1 --2- 172.21.15.45:0/3945673156 >> v2:172.21.15.45:3300/0 conn(0x7efd9c159e50 0x7efd9c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda22a1640 1 --2- 172.21.15.45:0/3945673156 >> v2:172.21.15.114:3300/0 conn(0x7efd9c15b580 0x7efd9c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.010+0000 7efda129f640 1 -- 172.21.15.45:0/3945673156 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672728844 0 0) 0x7efd9c0c0870 con 0x7efd9c0c0100 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.011+0000 7efda129f640 1 -- 172.21.15.45:0/3945673156 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd88003520 con 0x7efd9c0c0100 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.011+0000 7efda2aa2640 1 -- 172.21.15.45:0/3945673156 >> v2:172.21.15.114:3300/0 conn(0x7efd9c15b580 msgr2=0x7efd9c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.011+0000 7efda2aa2640 1 --2- 172.21.15.45:0/3945673156 >> v2:172.21.15.114:3300/0 conn(0x7efd9c15b580 0x7efd9c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.011+0000 7efda2aa2640 1 -- 172.21.15.45:0/3945673156 >> v1:172.21.15.45:6789/0 conn(0x7efd9c0c0100 legacy=0x7efd9c06c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.011+0000 7efda2aa2640 1 -- 172.21.15.45:0/3945673156 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0c0e30 con 0x7efd9c159e50 2023-12-08T08:17:58.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.012+0000 7efda2aa2640 1 --2- 172.21.15.45:0/3945673156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c15a2a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efd94009d90 tx=0x7efd9402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4f8bfe61a266e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda129f640 1 -- 172.21.15.45:0/3945673156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9402cbd0 con 0x7efd9c159e50 2023-12-08T08:17:58.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda129f640 1 -- 172.21.15.45:0/3945673156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9402cd30 con 0x7efd9c159e50 2023-12-08T08:17:58.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda129f640 1 -- 172.21.15.45:0/3945673156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9402cea0 con 0x7efd9c159e50 2023-12-08T08:17:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 -- 172.21.15.45:0/3945673156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 msgr2=0x7efd9c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 --2- 172.21.15.45:0/3945673156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c15a2a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efd94009d90 tx=0x7efd9402be20 comp rx=0 tx=0).stop 2023-12-08T08:17:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 -- 172.21.15.45:0/3945673156 shutdown_connections 2023-12-08T08:17:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 --2- 172.21.15.45:0/3945673156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c15a2a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 --2- 172.21.15.45:0/3945673156 >> v2:172.21.15.114:3300/0 conn(0x7efd9c15b580 0x7efd9c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 -- 172.21.15.45:0/3945673156 >> 172.21.15.45:0/3945673156 conn(0x7efd9c0c5780 msgr2=0x7efd9c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 -- 172.21.15.45:0/3945673156 shutdown_connections 2023-12-08T08:17:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.013+0000 7efda32a3640 1 -- 172.21.15.45:0/3945673156 wait complete. 2023-12-08T08:17:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.015+0000 7efda32a3640 1 Processor -- start 2023-12-08T08:17:58.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.015+0000 7efda32a3640 1 -- start start 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 0x7efd9c0be760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd9c15b580 0x7efd9c0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c0712f0 con 0x7efd9c159e50 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c072b30 con 0x7efd9c0c0100 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda32a3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1ee190 con 0x7efd9c15b580 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda1aa0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda1aa0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40634/0 (socket says 172.21.15.45:40634) 2023-12-08T08:17:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.016+0000 7efda1aa0640 1 -- 172.21.15.45:0/2107956579 learned_addr learned my addr 172.21.15.45:0/2107956579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda22a1640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 0x7efd9c0be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 -- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd9c15b580 msgr2=0x7efd9c0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda2aa2640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd9c15b580 0x7efd9c0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd9c15b580 0x7efd9c0aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 -- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 msgr2=0x7efd9c0be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 0x7efd9c0be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 -- 172.21.15.45:0/2107956579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94009a70 con 0x7efd9c159e50 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda22a1640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 0x7efd9c0be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efda1aa0640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c500 tx=0x7efd9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.017+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90005ce0 con 0x7efd9c159e50 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.018+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90005e40 con 0x7efd9c159e50 2023-12-08T08:17:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.018+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90007330 con 0x7efd9c159e50 2023-12-08T08:17:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.018+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c1ee680 con 0x7efd9c159e50 2023-12-08T08:17:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.018+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c1ee3a0 con 0x7efd9c159e50 2023-12-08T08:17:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.019+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9c0743e0 con 0x7efd9c159e50 2023-12-08T08:17:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.020+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd90007490 con 0x7efd9c159e50 2023-12-08T08:17:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.021+0000 7efd8effd640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.021+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7efd90089170 con 0x7efd9c159e50 2023-12-08T08:17:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.021+0000 7efda22a1640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.022+0000 7efda22a1640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 0x7efd8006d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd98006fd0 tx=0x7efd98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.026+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd90053dc0 con 0x7efd9c159e50 2023-12-08T08:17:58.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.216+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd9c0a8840 con 0x7efd9c159e50 2023-12-08T08:17:58.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.218+0000 7efd8effd640 1 -- 172.21.15.45:0/2107956579 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20615 (secure 0 0 0) 0x7efd900573e0 con 0x7efd9c159e50 2023-12-08T08:17:58.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:58.221 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":64,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:57.236761+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:58.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 msgr2=0x7efd8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 0x7efd8006d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd98006fd0 tx=0x7efd98008040 comp rx=0 tx=0).stop 2023-12-08T08:17:58.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 msgr2=0x7efd9c0beca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c500 tx=0x7efd9000c9c0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 shutdown_connections 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7efd8006ae70 0x7efd8006d330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7efd9c15b580 0x7efd9c0aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c159e50 0x7efd9c0beca0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 --2- 172.21.15.45:0/2107956579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd9c0c0100 0x7efd9c0be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.221+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 >> 172.21.15.45:0/2107956579 conn(0x7efd9c0c5780 msgr2=0x7efd9c0a6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.222+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 shutdown_connections 2023-12-08T08:17:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.222+0000 7efda32a3640 1 -- 172.21.15.45:0/2107956579 wait complete. 2023-12-08T08:17:58.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:58.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.466+0000 7fb643287640 1 Processor -- start 2023-12-08T08:17:58.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.466+0000 7fb643287640 1 -- start start 2023-12-08T08:17:58.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.467+0000 7fb643287640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb63c14c4a0 0x7fb63c156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.467+0000 7fb643287640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 0x7fb63c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.467+0000 7fb643287640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c14c880 con 0x7fb63c0a4d10 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.467+0000 7fb643287640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0c4730 con 0x7fb63c14c4a0 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.467+0000 7fb643287640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0c56e0 con 0x7fb63c153880 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb63c14c4a0 0x7fb63c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb63c14c4a0 0x7fb63c156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40648/0 (socket says 172.21.15.45:40648) 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 -- 172.21.15.45:0/1984360833 learned_addr learned my addr 172.21.15.45:0/1984360833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641824640 1 --2- 172.21.15.45:0/1984360833 >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 0x7fb63c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 -- 172.21.15.45:0/1984360833 >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 msgr2=0x7fb63c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 --2- 172.21.15.45:0/1984360833 >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 0x7fb63c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 -- 172.21.15.45:0/1984360833 >> v1:172.21.15.114:6789/0 conn(0x7fb63c0a4d10 legacy=0x7fb63c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641023640 1 -- 172.21.15.45:0/1984360833 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0c63b0 con 0x7fb63c14c4a0 2023-12-08T08:17:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.468+0000 7fb641824640 1 --2- 172.21.15.45:0/1984360833 >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 0x7fb63c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.469+0000 7fb641023640 1 --2- 172.21.15.45:0/1984360833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c14c4a0 0x7fb63c156490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb63c14ff60 tx=0x7fb63802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1053d9d7a42cd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb633fff640 1 -- 172.21.15.45:0/1984360833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380317e0 con 0x7fb63c14c4a0 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb633fff640 1 -- 172.21.15.45:0/1984360833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638031940 con 0x7fb63c14c4a0 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb633fff640 1 -- 172.21.15.45:0/1984360833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638031cd0 con 0x7fb63c14c4a0 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 -- 172.21.15.45:0/1984360833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c14c4a0 msgr2=0x7fb63c156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 --2- 172.21.15.45:0/1984360833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c14c4a0 0x7fb63c156490 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb63c14ff60 tx=0x7fb63802b880 comp rx=0 tx=0).stop 2023-12-08T08:17:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 -- 172.21.15.45:0/1984360833 shutdown_connections 2023-12-08T08:17:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 --2- 172.21.15.45:0/1984360833 >> v2:172.21.15.114:3300/0 conn(0x7fb63c153880 0x7fb63c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 --2- 172.21.15.45:0/1984360833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c14c4a0 0x7fb63c156490 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 -- 172.21.15.45:0/1984360833 >> 172.21.15.45:0/1984360833 conn(0x7fb63c0661f0 msgr2=0x7fb63c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.470+0000 7fb643287640 1 -- 172.21.15.45:0/1984360833 shutdown_connections 2023-12-08T08:17:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.471+0000 7fb643287640 1 -- 172.21.15.45:0/1984360833 wait complete. 2023-12-08T08:17:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.472+0000 7fb643287640 1 Processor -- start 2023-12-08T08:17:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.472+0000 7fb643287640 1 -- start start 2023-12-08T08:17:58.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 0x7fb63c1e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb63c153880 0x7fb63c070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0c0d70 con 0x7fb63c0a4d10 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0c0440 con 0x7fb63c14c4a0 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb643287640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0c0720 con 0x7fb63c153880 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb641023640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb641023640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40656/0 (socket says 172.21.15.45:40656) 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.473+0000 7fb641023640 1 -- 172.21.15.45:0/2177798184 learned_addr learned my addr 172.21.15.45:0/2177798184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb640822640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 0x7fb63c1e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641824640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb63c153880 0x7fb63c070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 -- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb63c153880 msgr2=0x7fb63c070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb63c153880 0x7fb63c070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 -- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 msgr2=0x7fb63c1e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 0x7fb63c1e7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 -- 172.21.15.45:0/2177798184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380094d0 con 0x7fb63c0a4d10 2023-12-08T08:17:58.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb640822640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 0x7fb63c1e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.474+0000 7fb641023640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb63802b8c0 tx=0x7fb6380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.475+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380329c0 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.475+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638032b40 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.475+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380453f0 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.475+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c0c0a00 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.475+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c0c1200 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.476+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c074600 con 0x7fb63c0a4d10 2023-12-08T08:17:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.477+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb63804d3f0 con 0x7fb63c0a4d10 2023-12-08T08:17:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.478+0000 7fb631ffb640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 0x7fb62006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.478+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb6380abac0 con 0x7fb63c0a4d10 2023-12-08T08:17:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.478+0000 7fb640822640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 0x7fb62006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.479+0000 7fb640822640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 0x7fb62006d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb63c1569a0 tx=0x7fb62c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.482+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb638076670 con 0x7fb63c0a4d10 2023-12-08T08:17:58.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.677+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb63c0a7470 con 0x7fb63c0a4d10 2023-12-08T08:17:58.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.679+0000 7fb631ffb640 1 -- 172.21.15.45:0/2177798184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+20615 (secure 0 0 0) 0x7fb6380a9e60 con 0x7fb63c0a4d10 2023-12-08T08:17:58.682 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:17:58.683 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":64,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:57.236761+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:58.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.681+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 msgr2=0x7fb62006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.681+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 0x7fb62006d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb63c1569a0 tx=0x7fb62c009040 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.681+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 msgr2=0x7fb63c1ea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.681+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb63802b8c0 tx=0x7fb6380046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 shutdown_connections 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb62006ae40 0x7fb62006d300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb63c153880 0x7fb63c070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63c14c4a0 0x7fb63c1e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 --2- 172.21.15.45:0/2177798184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63c0a4d10 0x7fb63c1ea520 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 >> 172.21.15.45:0/2177798184 conn(0x7fb63c0661f0 msgr2=0x7fb63c145370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 shutdown_connections 2023-12-08T08:17:58.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.682+0000 7fb643287640 1 -- 172.21.15.45:0/2177798184 wait complete. 2023-12-08T08:17:58.702 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:17:58.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:58.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.914+0000 7fe96969b640 1 Processor -- start 2023-12-08T08:17:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.914+0000 7fe96969b640 1 -- start start 2023-12-08T08:17:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe96969b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9640c4a60 0x7fe964155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe96969b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe96406ca50 0x7fe9640bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe96969b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640c5670 con 0x7fe964151d70 2023-12-08T08:17:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe96969b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe964158120 con 0x7fe9640c4a60 2023-12-08T08:17:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe96969b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640a4f60 con 0x7fe96406ca50 2023-12-08T08:17:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe95a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9640c4a60 0x7fe964155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe95a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9640c4a60 0x7fe964155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40670/0 (socket says 172.21.15.45:40670) 2023-12-08T08:17:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.916+0000 7fe95a7fc640 1 -- 172.21.15.45:0/2357230073 learned_addr learned my addr 172.21.15.45:0/2357230073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe9637fe640 1 --2- 172.21.15.45:0/2357230073 >> v2:172.21.15.114:3300/0 conn(0x7fe96406ca50 0x7fe9640bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe95a7fc640 1 -- 172.21.15.45:0/2357230073 >> v2:172.21.15.114:3300/0 conn(0x7fe96406ca50 msgr2=0x7fe9640bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe95a7fc640 1 --2- 172.21.15.45:0/2357230073 >> v2:172.21.15.114:3300/0 conn(0x7fe96406ca50 0x7fe9640bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe95a7fc640 1 -- 172.21.15.45:0/2357230073 >> v1:172.21.15.45:6789/0 conn(0x7fe964151d70 legacy=0x7fe964158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe95a7fc640 1 -- 172.21.15.45:0/2357230073 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640a5240 con 0x7fe9640c4a60 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.917+0000 7fe9627fc640 1 -- 172.21.15.45:0/2357230073 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768133179 0 0) 0x7fe9640c5670 con 0x7fe964151d70 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.918+0000 7fe95a7fc640 1 --2- 172.21.15.45:0/2357230073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe964155050 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c53f0 tx=0x7fe94c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ab452be9ea993e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.918+0000 7fe9627fc640 1 -- 172.21.15.45:0/2357230073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0317e0 con 0x7fe9640c4a60 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe9627fc640 1 -- 172.21.15.45:0/2357230073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c031940 con 0x7fe9640c4a60 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe9627fc640 1 -- 172.21.15.45:0/2357230073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c031cd0 con 0x7fe9640c4a60 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 -- 172.21.15.45:0/2357230073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 msgr2=0x7fe964155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 --2- 172.21.15.45:0/2357230073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe964155050 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c53f0 tx=0x7fe94c02b880 comp rx=0 tx=0).stop 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 -- 172.21.15.45:0/2357230073 shutdown_connections 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 --2- 172.21.15.45:0/2357230073 >> v2:172.21.15.114:3300/0 conn(0x7fe96406ca50 0x7fe9640bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 --2- 172.21.15.45:0/2357230073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe964155050 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 -- 172.21.15.45:0/2357230073 >> 172.21.15.45:0/2357230073 conn(0x7fe9640c2430 msgr2=0x7fe9640c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 -- 172.21.15.45:0/2357230073 shutdown_connections 2023-12-08T08:17:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.919+0000 7fe96969b640 1 -- 172.21.15.45:0/2357230073 wait complete. 2023-12-08T08:17:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.921+0000 7fe96969b640 1 Processor -- start 2023-12-08T08:17:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.921+0000 7fe96969b640 1 -- start start 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe96406ca50 0x7fe9641ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe964151d70 0x7fe96414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640a8c50 con 0x7fe9640c4a60 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641edf80 con 0x7fe96406ca50 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe96969b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641e9bd0 con 0x7fe964151d70 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe95a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe95a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40676/0 (socket says 172.21.15.45:40676) 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.922+0000 7fe95a7fc640 1 -- 172.21.15.45:0/3189717924 learned_addr learned my addr 172.21.15.45:0/3189717924 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe962ffd640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe96406ca50 0x7fe9641ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe9637fe640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe964151d70 0x7fe96414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 -- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe964151d70 msgr2=0x7fe96414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe964151d70 0x7fe96414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 -- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe96406ca50 msgr2=0x7fe9641ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe96406ca50 0x7fe9641ea670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 -- 172.21.15.45:0/3189717924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0094d0 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.923+0000 7fe95a7fc640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe94c034040 tx=0x7fe94c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.924+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c004230 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.924+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0043b0 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.924+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c004520 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.924+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96406fd80 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.924+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9641ea150 con 0x7fe9640c4a60 2023-12-08T08:17:58.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.925+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe964074670 con 0x7fe9640c4a60 2023-12-08T08:17:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.926+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe94c043070 con 0x7fe9640c4a60 2023-12-08T08:17:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.927+0000 7fe95bfff640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 0x7fe94406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.927+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe94c0ab8f0 con 0x7fe9640c4a60 2023-12-08T08:17:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.927+0000 7fe962ffd640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 0x7fe94406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.928+0000 7fe962ffd640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 0x7fe94406d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9540012e0 tx=0x7fe954009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:58.931+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe94c0763f0 con 0x7fe9640c4a60 2023-12-08T08:17:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.162+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9640c4840 con 0x7fe9640c4a60 2023-12-08T08:17:59.644 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-08T08:17:59.641+0000 7f8bb4a6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:17:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.784+0000 7fe95bfff640 1 -- 172.21.15.45:0/3189717924 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 119+0+0 (secure 0 0 0) 0x7fe94c079a10 con 0x7fe9640c4a60 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 msgr2=0x7fe94406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 0x7fe94406d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9540012e0 tx=0x7fe954009040 comp rx=0 tx=0).stop 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 msgr2=0x7fe9641eda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe94c034040 tx=0x7fe94c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 shutdown_connections 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe94406ae40 0x7fe94406d300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe964151d70 0x7fe96414ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9640c4a60 0x7fe9641eda40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 --2- 172.21.15.45:0/3189717924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe96406ca50 0x7fe9641ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 >> 172.21.15.45:0/3189717924 conn(0x7fe9640c2430 msgr2=0x7fe964154c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 shutdown_connections 2023-12-08T08:17:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:17:59.788+0000 7fe96969b640 1 -- 172.21.15.45:0/3189717924 wait complete. 2023-12-08T08:17:59.812 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:17:59.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:18:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.040+0000 7f8753fff640 1 Processor -- start 2023-12-08T08:18:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.040+0000 7f8753fff640 1 -- start start 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8753fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f875414c280 0x7f87540a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8753fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8754155790 0x7f8754155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8753fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540c60c0 con 0x7f87540c4970 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8753fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8754152dc0 con 0x7f875414c280 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8753fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87541521d0 con 0x7f8754155790 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8752ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f875414c280 0x7f87540a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8752ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f875414c280 0x7f87540a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40688/0 (socket says 172.21.15.45:40688) 2023-12-08T08:18:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.042+0000 7f8752ffd640 1 -- 172.21.15.45:0/1048454442 learned_addr learned my addr 172.21.15.45:0/1048454442 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f8752ffd640 1 -- 172.21.15.45:0/1048454442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8754155790 msgr2=0x7f8754155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f87537fe640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8754155790 0x7f8754155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f8752ffd640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8754155790 0x7f8754155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f8752ffd640 1 -- 172.21.15.45:0/1048454442 >> v1:172.21.15.45:6789/0 conn(0x7f87540c4970 legacy=0x7f875406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f8752ffd640 1 -- 172.21.15.45:0/1048454442 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875414c660 con 0x7f875414c280 2023-12-08T08:18:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.043+0000 7f87527fc640 1 -- 172.21.15.45:0/1048454442 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166746888 0 0) 0x7f873c001110 con 0x7f87540c4970 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.044+0000 7f8752ffd640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f875414c280 0x7f87540a4d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276ce5ad9f02d864 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.044+0000 7f87527fc640 1 -- 172.21.15.45:0/1048454442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744031640 con 0x7f875414c280 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.044+0000 7f87527fc640 1 -- 172.21.15.45:0/1048454442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87440317a0 con 0x7f875414c280 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.044+0000 7f87527fc640 1 -- 172.21.15.45:0/1048454442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744031b30 con 0x7f875414c280 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 -- 172.21.15.45:0/1048454442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f875414c280 msgr2=0x7f87540a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f875414c280 0x7f87540a4d10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 -- 172.21.15.45:0/1048454442 shutdown_connections 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8754155790 0x7f8754155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 --2- 172.21.15.45:0/1048454442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f875414c280 0x7f87540a4d10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 -- 172.21.15.45:0/1048454442 >> 172.21.15.45:0/1048454442 conn(0x7f8754066ce0 msgr2=0x7f87540a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 -- 172.21.15.45:0/1048454442 shutdown_connections 2023-12-08T08:18:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.045+0000 7f8753fff640 1 -- 172.21.15.45:0/1048454442 wait complete. 2023-12-08T08:18:00.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.047+0000 7f8753fff640 1 Processor -- start 2023-12-08T08:18:00.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.047+0000 7f8753fff640 1 -- start start 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875414c280 0x7f875414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8754155790 0x7f875414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754146000 con 0x7f87540c4970 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875414b3b0 con 0x7f8754155790 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8753fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540a7610 con 0x7f875414c280 2023-12-08T08:18:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40696/0 (socket says 172.21.15.45:40696) 2023-12-08T08:18:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.048+0000 7f8752ffd640 1 -- 172.21.15.45:0/4076290237 learned_addr learned my addr 172.21.15.45:0/4076290237 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 -- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875414c280 msgr2=0x7f875414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875414c280 0x7f875414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 -- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8754155790 msgr2=0x7f875414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8754155790 0x7f875414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 -- 172.21.15.45:0/4076290237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440094d0 con 0x7f87540c4970 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8752ffd640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f87440090b0 tx=0x7f87440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.049+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744004230 con 0x7f87540c4970 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.050+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744004390 con 0x7f87540c4970 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.050+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87540a78f0 con 0x7f87540c4970 2023-12-08T08:18:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.050+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874403aa90 con 0x7f87540c4970 2023-12-08T08:18:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.050+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87540c18e0 con 0x7f87540c4970 2023-12-08T08:18:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.051+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754149aa0 con 0x7f87540c4970 2023-12-08T08:18:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.052+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8744042070 con 0x7f87540c4970 2023-12-08T08:18:00.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.053+0000 7f8750ff9640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 0x7f873406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:00.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.054+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f87440ab8e0 con 0x7f87540c4970 2023-12-08T08:18:00.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.054+0000 7f874a7fc640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 0x7f873406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.054+0000 7f874a7fc640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 0x7f873406d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f875414ba70 tx=0x7f873c007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.058+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8754149aa0 con 0x7f87540c4970 2023-12-08T08:18:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.296+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8754149e80 con 0x7f87540c4970 2023-12-08T08:18:00.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.788+0000 7f8750ff9640 1 -- 172.21.15.45:0/4076290237 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8754149e80 con 0x7f87540c4970 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 msgr2=0x7f873406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 0x7f873406d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f875414ba70 tx=0x7f873c007930 comp rx=0 tx=0).stop 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 msgr2=0x7f87540c13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f87440090b0 tx=0x7f87440046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 shutdown_connections 2023-12-08T08:18:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f873406ae40 0x7f873406d300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f875414c280 0x7f875414a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8754155790 0x7f875414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 --2- 172.21.15.45:0/4076290237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87540c4970 0x7f87540c13a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 >> 172.21.15.45:0/4076290237 conn(0x7f8754066ce0 msgr2=0x7f8754147660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 shutdown_connections 2023-12-08T08:18:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:00.791+0000 7f8753fff640 1 -- 172.21.15.45:0/4076290237 wait complete. 2023-12-08T08:18:00.821 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:18:00.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.050+0000 7f3e1359e640 1 Processor -- start 2023-12-08T08:18:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.050+0000 7f3e1359e640 1 -- start start 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e140c44d0 0x7f3e141584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 0x7f3e140ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1359e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140c4a00 con 0x7f3e141519c0 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140c4ce0 con 0x7f3e140c44d0 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e141579e0 con 0x7f3e140c7a50 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e0bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e140c44d0 0x7f3e141584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3e141519c0 0x7f3e14154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41896/0 (socket says 172.21.15.45:41896) 2023-12-08T08:18:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.052+0000 7f3e1259c640 1 -- 172.21.15.45:0/1004447571 learned_addr learned my addr 172.21.15.45:0/1004447571 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e12d9d640 1 --2- 172.21.15.45:0/1004447571 >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 0x7f3e140ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e0bfff640 1 -- 172.21.15.45:0/1004447571 >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 msgr2=0x7f3e140ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e0bfff640 1 --2- 172.21.15.45:0/1004447571 >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 0x7f3e140ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e0bfff640 1 -- 172.21.15.45:0/1004447571 >> v1:172.21.15.45:6789/0 conn(0x7f3e141519c0 legacy=0x7f3e14154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e0bfff640 1 -- 172.21.15.45:0/1004447571 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e14157cc0 con 0x7f3e140c44d0 2023-12-08T08:18:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.053+0000 7f3e12d9d640 1 --2- 172.21.15.45:0/1004447571 >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 0x7f3e140ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.054+0000 7f3e0bfff640 1 --2- 172.21.15.45:0/1004447571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e140c44d0 0x7f3e141584c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c3f80 tx=0x7f3dfc02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa9db65a0600115 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.054+0000 7f3e11d9b640 1 -- 172.21.15.45:0/1004447571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc031520 con 0x7f3e140c44d0 2023-12-08T08:18:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.054+0000 7f3e11d9b640 1 -- 172.21.15.45:0/1004447571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc031680 con 0x7f3e140c44d0 2023-12-08T08:18:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.054+0000 7f3e11d9b640 1 -- 172.21.15.45:0/1004447571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc031a10 con 0x7f3e140c44d0 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 -- 172.21.15.45:0/1004447571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e140c44d0 msgr2=0x7f3e141584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 --2- 172.21.15.45:0/1004447571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e140c44d0 0x7f3e141584c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c3f80 tx=0x7f3dfc02b7c0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 -- 172.21.15.45:0/1004447571 shutdown_connections 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 --2- 172.21.15.45:0/1004447571 >> v2:172.21.15.114:3300/0 conn(0x7f3e140c7a50 0x7f3e140ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 --2- 172.21.15.45:0/1004447571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e140c44d0 0x7f3e141584c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 -- 172.21.15.45:0/1004447571 >> 172.21.15.45:0/1004447571 conn(0x7f3e140661f0 msgr2=0x7f3e14066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 -- 172.21.15.45:0/1004447571 shutdown_connections 2023-12-08T08:18:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.055+0000 7f3e1359e640 1 -- 172.21.15.45:0/1004447571 wait complete. 2023-12-08T08:18:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.057+0000 7f3e1359e640 1 Processor -- start 2023-12-08T08:18:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.057+0000 7f3e1359e640 1 -- start start 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e140c44d0 0x7f3e14156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e140c7a50 0x7f3e1414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e141ed240 con 0x7f3e141519c0 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14153fd0 con 0x7f3e140c7a50 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e1359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e141542b0 con 0x7f3e140c44d0 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e12d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e12d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40708/0 (socket says 172.21.15.45:40708) 2023-12-08T08:18:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.058+0000 7f3e12d9d640 1 -- 172.21.15.45:0/934441646 learned_addr learned my addr 172.21.15.45:0/934441646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e0bfff640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e140c7a50 0x7f3e1414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e1259c640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e140c44d0 0x7f3e14156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 -- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e140c44d0 msgr2=0x7f3e14156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e140c44d0 0x7f3e14156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 -- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e140c7a50 msgr2=0x7f3e1414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e140c7a50 0x7f3e1414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 -- 172.21.15.45:0/934441646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc009400 con 0x7f3e141519c0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e12d9d640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00cef0 tx=0x7f3e0c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00d840 con 0x7f3e141519c0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00d9c0 con 0x7f3e141519c0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e14152d10 con 0x7f3e141519c0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.059+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00dd70 con 0x7f3e141519c0 2023-12-08T08:18:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.060+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e140bd710 con 0x7f3e141519c0 2023-12-08T08:18:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.061+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e140743e0 con 0x7f3e141519c0 2023-12-08T08:18:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.062+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e0c01e3b0 con 0x7f3e141519c0 2023-12-08T08:18:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.063+0000 7f3e0affd640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 0x7f3df406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.063+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f3e0c08a530 con 0x7f3e141519c0 2023-12-08T08:18:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.063+0000 7f3e1259c640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 0x7f3df406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.064+0000 7f3e1259c640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 0x7f3df406d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005880 tx=0x7f3e04009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.067+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e0c055220 con 0x7f3e141519c0 2023-12-08T08:18:01.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.298+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e1414b780 con 0x7f3e141519c0 2023-12-08T08:18:01.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.299+0000 7f3e0affd640 1 -- 172.21.15.45:0/934441646 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f3e0c058840 con 0x7f3e141519c0 2023-12-08T08:18:01.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:01.304 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:01.305 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-12-08T08:18:01.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 msgr2=0x7f3df406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 0x7f3df406d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005880 tx=0x7f3e04009040 comp rx=0 tx=0).stop 2023-12-08T08:18:01.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 msgr2=0x7f3e1414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00cef0 tx=0x7f3e0c00a710 comp rx=0 tx=0).stop 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 shutdown_connections 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df406ae40 0x7f3df406d300 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e141519c0 0x7f3e1414b0d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e140c7a50 0x7f3e1414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 --2- 172.21.15.45:0/934441646 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e140c44d0 0x7f3e14156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 >> 172.21.15.45:0/934441646 conn(0x7f3e140661f0 msgr2=0x7f3e140c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 shutdown_connections 2023-12-08T08:18:01.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.302+0000 7f3e1359e640 1 -- 172.21.15.45:0/934441646 wait complete. 2023-12-08T08:18:01.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.546+0000 7eff8ffff640 1 Processor -- start 2023-12-08T08:18:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.546+0000 7eff8ffff640 1 -- start start 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.548+0000 7eff8ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff9014e840 0x7eff90151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.548+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c16a0 0x7eff900aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.548+0000 7eff8ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff90151ea0 con 0x7eff900c1210 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.548+0000 7eff8ffff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9014ec20 con 0x7eff9014e840 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.548+0000 7eff8ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff90154850 con 0x7eff900c16a0 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff9014e840 0x7eff90151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff9014e840 0x7eff90151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40720/0 (socket says 172.21.15.45:40720) 2023-12-08T08:18:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff87fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff900c1210 0x7eff900a9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41912/0 (socket says 172.21.15.45:41912) 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 -- 172.21.15.45:0/413346119 learned_addr learned my addr 172.21.15.45:0/413346119 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 -- 172.21.15.45:0/413346119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c16a0 msgr2=0x7eff900aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 --2- 172.21.15.45:0/413346119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c16a0 0x7eff900aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 -- 172.21.15.45:0/413346119 >> v1:172.21.15.45:6789/0 conn(0x7eff900c1210 legacy=0x7eff900a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8effd640 1 -- 172.21.15.45:0/413346119 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90154b30 con 0x7eff9014e840 2023-12-08T08:18:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.549+0000 7eff8e7fc640 1 -- 172.21.15.45:0/413346119 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569630537 0 0) 0x7eff90151ea0 con 0x7eff900c1210 2023-12-08T08:18:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.550+0000 7eff8effd640 1 --2- 172.21.15.45:0/413346119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff90151960 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7eff80009870 tx=0x7eff8002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e5d29b1b35f0ee server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8e7fc640 1 -- 172.21.15.45:0/413346119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80031640 con 0x7eff9014e840 2023-12-08T08:18:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8e7fc640 1 -- 172.21.15.45:0/413346119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff800317a0 con 0x7eff9014e840 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8e7fc640 1 -- 172.21.15.45:0/413346119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80031b30 con 0x7eff9014e840 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 -- 172.21.15.45:0/413346119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 msgr2=0x7eff90151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 --2- 172.21.15.45:0/413346119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff90151960 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7eff80009870 tx=0x7eff8002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 -- 172.21.15.45:0/413346119 shutdown_connections 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 --2- 172.21.15.45:0/413346119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c16a0 0x7eff900aa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 --2- 172.21.15.45:0/413346119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff90151960 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.551+0000 7eff8ffff640 1 -- 172.21.15.45:0/413346119 >> 172.21.15.45:0/413346119 conn(0x7eff900c5780 msgr2=0x7eff900c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.552+0000 7eff8ffff640 1 -- 172.21.15.45:0/413346119 shutdown_connections 2023-12-08T08:18:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.552+0000 7eff8ffff640 1 -- 172.21.15.45:0/413346119 wait complete. 2023-12-08T08:18:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.553+0000 7eff8ffff640 1 Processor -- start 2023-12-08T08:18:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.553+0000 7eff8ffff640 1 -- start start 2023-12-08T08:18:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c1210 0x7eff901ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff900c16a0 0x7eff901dab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff900701a0 con 0x7eff9014e840 2023-12-08T08:18:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff901ed3e0 con 0x7eff900c16a0 2023-12-08T08:18:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.554+0000 7eff8ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff901ed6c0 con 0x7eff900c1210 2023-12-08T08:18:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40730/0 (socket says 172.21.15.45:40730) 2023-12-08T08:18:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 -- 172.21.15.45:0/3585129947 learned_addr learned my addr 172.21.15.45:0/3585129947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff87fff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff900c16a0 0x7eff901dab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8effd640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c1210 0x7eff901ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 -- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c1210 msgr2=0x7eff901ecb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c1210 0x7eff901ecb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 -- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff900c16a0 msgr2=0x7eff901dab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff900c16a0 0x7eff901dab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.555+0000 7eff8f7fe640 1 -- 172.21.15.45:0/3585129947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800094d0 con 0x7eff9014e840 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8f7fe640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b970 tx=0x7eff8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8800cb40 con 0x7eff9014e840 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8800ccc0 con 0x7eff9014e840 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9006fb50 con 0x7eff9014e840 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88014680 con 0x7eff9014e840 2023-12-08T08:18:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.556+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff901ed050 con 0x7eff9014e840 2023-12-08T08:18:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.557+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff900743e0 con 0x7eff9014e840 2023-12-08T08:18:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.558+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff8801d3b0 con 0x7eff9014e840 2023-12-08T08:18:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.559+0000 7eff8cff9640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.559+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7eff88089ad0 con 0x7eff9014e840 2023-12-08T08:18:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.560+0000 7eff8effd640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.560+0000 7eff8effd640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 0x7eff7006d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff80036000 tx=0x7eff8003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.563+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff88054660 con 0x7eff9014e840 2023-12-08T08:18:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.758+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff900702e0 con 0x7eff9014e840 2023-12-08T08:18:01.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.763+0000 7eff8cff9640 1 -- 172.21.15.45:0/3585129947 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7eff900702e0 con 0x7eff9014e840 2023-12-08T08:18:01.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:01.766 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:01.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.765+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 msgr2=0x7eff7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.765+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 0x7eff7006d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff80036000 tx=0x7eff8003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:01.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.765+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 msgr2=0x7eff901ea8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.765+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7eff8800b970 tx=0x7eff8800be30 comp rx=0 tx=0).stop 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 shutdown_connections 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff9014e840 0x7eff901ea8f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff900c16a0 0x7eff901dab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 --2- 172.21.15.45:0/3585129947 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff900c1210 0x7eff901ecb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 >> 172.21.15.45:0/3585129947 conn(0x7eff900c5780 msgr2=0x7eff90153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 shutdown_connections 2023-12-08T08:18:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:01.766+0000 7eff8ffff640 1 -- 172.21.15.45:0/3585129947 wait complete. 2023-12-08T08:18:01.787 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:18:01.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:02.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.002+0000 7f4b35116640 1 Processor -- start 2023-12-08T08:18:02.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.002+0000 7f4b35116640 1 -- start start 2023-12-08T08:18:02.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014e840 0x7f4b30151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b300c1210 0x7f4b300c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b300a9e80 0x7f4b300aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3014ec20 con 0x7f4b300a9e80 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b30151ea0 con 0x7f4b300c1210 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.003+0000 7f4b35116640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30154850 con 0x7f4b3014e840 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b300a9e80 0x7f4b300aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b300a9e80 0x7f4b300aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40746/0 (socket says 172.21.15.45:40746) 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 -- 172.21.15.45:0/1904967506 learned_addr learned my addr 172.21.15.45:0/1904967506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b27fff640 1 --2- 172.21.15.45:0/1904967506 >> v2:172.21.15.114:3300/0 conn(0x7f4b300c1210 0x7f4b300c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b2ffff640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014e840 0x7f4b30151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 -- 172.21.15.45:0/1904967506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014e840 msgr2=0x7f4b30151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014e840 0x7f4b30151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 -- 172.21.15.45:0/1904967506 >> v2:172.21.15.114:3300/0 conn(0x7f4b300c1210 msgr2=0x7f4b300c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 --2- 172.21.15.45:0/1904967506 >> v2:172.21.15.114:3300/0 conn(0x7f4b300c1210 0x7f4b300c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.004+0000 7f4b34915640 1 -- 172.21.15.45:0/1904967506 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30154b30 con 0x7f4b300a9e80 2023-12-08T08:18:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.006+0000 7f4b34915640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b300aa310 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006ac60 tx=0x7f4b2802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5494e24aa2d6e664 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.006+0000 7f4b2f7fe640 1 -- 172.21.15.45:0/1904967506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2802c9e0 con 0x7f4b300a9e80 2023-12-08T08:18:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.006+0000 7f4b2f7fe640 1 -- 172.21.15.45:0/1904967506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2802cb40 con 0x7f4b300a9e80 2023-12-08T08:18:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.006+0000 7f4b2f7fe640 1 -- 172.21.15.45:0/1904967506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280343f0 con 0x7f4b300a9e80 2023-12-08T08:18:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 -- 172.21.15.45:0/1904967506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 msgr2=0x7f4b300aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b300aa310 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006ac60 tx=0x7f4b2802be40 comp rx=0 tx=0).stop 2023-12-08T08:18:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 -- 172.21.15.45:0/1904967506 shutdown_connections 2023-12-08T08:18:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 --2- 172.21.15.45:0/1904967506 >> v2:172.21.15.114:3300/0 conn(0x7f4b300c1210 0x7f4b300c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b300aa310 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 --2- 172.21.15.45:0/1904967506 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b3014e840 0x7f4b30151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 -- 172.21.15.45:0/1904967506 >> 172.21.15.45:0/1904967506 conn(0x7f4b300c5780 msgr2=0x7f4b300c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 -- 172.21.15.45:0/1904967506 shutdown_connections 2023-12-08T08:18:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.007+0000 7f4b35116640 1 -- 172.21.15.45:0/1904967506 wait complete. 2023-12-08T08:18:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.009+0000 7f4b35116640 1 Processor -- start 2023-12-08T08:18:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.009+0000 7f4b35116640 1 -- start start 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b300c1210 0x7f4b30150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b3014e840 0x7f4b301ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301da730 con 0x7f4b300a9e80 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301eddb0 con 0x7f4b3014e840 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b35116640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30150980 con 0x7f4b300c1210 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b2ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40750/0 (socket says 172.21.15.45:40750) 2023-12-08T08:18:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b2ffff640 1 -- 172.21.15.45:0/3454371246 learned_addr learned my addr 172.21.15.45:0/3454371246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:02.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b34915640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b3014e840 0x7f4b301ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b27fff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b300c1210 0x7f4b30150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b2ffff640 1 -- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b300c1210 msgr2=0x7f4b30150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.010+0000 7f4b2ffff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b300c1210 0x7f4b30150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2ffff640 1 -- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b3014e840 msgr2=0x7f4b301ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2ffff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b3014e840 0x7f4b301ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2ffff640 1 -- 172.21.15.45:0/3454371246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28009b30 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2ffff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000d620 tx=0x7f4b2000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000b620 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000b780 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000bb30 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b301e1220 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.011+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3006fc00 con 0x7f4b300a9e80 2023-12-08T08:18:02.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.012+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b300743e0 con 0x7f4b300a9e80 2023-12-08T08:18:02.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.013+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b2000bc90 con 0x7f4b300a9e80 2023-12-08T08:18:02.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.014+0000 7f4b2d7fa640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 0x7f4b1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.014+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f4b20089fe0 con 0x7f4b300a9e80 2023-12-08T08:18:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.015+0000 7f4b27fff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 0x7f4b1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.016+0000 7f4b27fff640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 0x7f4b1006d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b300729f0 tx=0x7f4b18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.019+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b20054b70 con 0x7f4b300a9e80 2023-12-08T08:18:02.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.209+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b300c1010 con 0x7f4b1006ae40 2023-12-08T08:18:02.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.251+0000 7f4b2d7fa640 1 -- 172.21.15.45:0/3454371246 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522813 (secure 0 0 0) 0x7f4b300c1010 con 0x7f4b1006ae40 2023-12-08T08:18:02.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:02.265 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:02.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 msgr2=0x7f4b1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 0x7f4b1006d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b300729f0 tx=0x7f4b18008040 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 msgr2=0x7f4b30070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000d620 tx=0x7f4b2000dae0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 shutdown_connections 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4b1006ae40 0x7f4b1006d300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4b300c1210 0x7f4b30150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b3014e840 0x7f4b301ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 --2- 172.21.15.45:0/3454371246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b300a9e80 0x7f4b30070ac0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 >> 172.21.15.45:0/3454371246 conn(0x7f4b300c5780 msgr2=0x7f4b300c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 shutdown_connections 2023-12-08T08:18:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.262+0000 7f4b35116640 1 -- 172.21.15.45:0/3454371246 wait complete. 2023-12-08T08:18:02.291 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-12-08T08:18:01.762947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":7315456,"data_stored":3972850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002350"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764361+0000","last_change":"2023-12-08T08:17:57.764361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764361+0000","last_undegraded":"2023-12-08T08:17:57.764361+0000","last_fullsized":"2023-12-08T08:17:57.764361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754978+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:56.754978+0000","last_peered":"2023-12-08T08:17:56.754978+0000","last_clean":"2023-12-08T08:17:56.754978+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:56.754978+0000","last_undegraded":"2023-12-08T08:17:56.754978+0000","last_fullsized":"2023-12-08T08:17:56.754978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:50.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.762419+0000","last_change":"2023-12-08T08:17:57.762419+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.762419+0000","last_undegraded":"2023-12-08T08:17:57.762419+0000","last_fullsized":"2023-12-08T08:17:57.762419+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:16.621830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754008+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:56.754008+0000","last_peered":"2023-12-08T08:17:56.754008+0000","last_clean":"2023-12-08T08:17:56.754008+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:56.754008+0000","last_undegraded":"2023-12-08T08:17:56.754008+0000","last_fullsized":"2023-12-08T08:17:56.754008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:09.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760293+0000","last_change":"2023-12-08T08:17:57.760293+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760293+0000","last_undegraded":"2023-12-08T08:17:57.760293+0000","last_fullsized":"2023-12-08T08:17:57.760293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:41.599819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753415+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:55.753415+0000","last_peered":"2023-12-08T08:17:55.753415+0000","last_clean":"2023-12-08T08:17:55.753415+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:55.753415+0000","last_undegraded":"2023-12-08T08:17:55.753415+0000","last_fullsized":"2023-12-08T08:17:55.753415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.786345+0000","last_change":"2023-12-08T08:17:57.786345+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.786345+0000","last_undegraded":"2023-12-08T08:17:57.786345+0000","last_fullsized":"2023-12-08T08:17:57.786345+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.785598+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:56.785598+0000","last_peered":"2023-12-08T08:17:56.785598+0000","last_clean":"2023-12-08T08:17:56.785598+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:56.785598+0000","last_undegraded":"2023-12-08T08:17:56.785598+0000","last_fullsized":"2023-12-08T08:17:56.785598+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.800058+0000","last_change":"2023-12-08T08:17:57.779371+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.800058+0000","last_undegraded":"2023-12-08T08:17:57.800058+0000","last_fullsized":"2023-12-08T08:17:57.800058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:07.224031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793991+0000","last_change":"2023-12-08T08:17:47.863838+0000","last_active":"2023-12-08T08:17:56.793991+0000","last_peered":"2023-12-08T08:17:56.793991+0000","last_clean":"2023-12-08T08:17:56.793991+0000","last_became_active":"2023-12-08T08:17:47.863177+0000","last_became_peered":"2023-12-08T08:17:47.863177+0000","last_unstale":"2023-12-08T08:17:56.793991+0000","last_undegraded":"2023-12-08T08:17:56.793991+0000","last_fullsized":"2023-12-08T08:17:56.793991+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:35.681140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.762215+0000","last_change":"2023-12-08T08:17:56.762215+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.762215+0000","last_undegraded":"2023-12-08T08:17:56.762215+0000","last_fullsized":"2023-12-08T08:17:56.762215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.770900+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:56.770900+0000","last_peered":"2023-12-08T08:17:56.770900+0000","last_clean":"2023-12-08T08:17:56.770900+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:56.770900+0000","last_undegraded":"2023-12-08T08:17:56.770900+0000","last_fullsized":"2023-12-08T08:17:56.770900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.770685+0000","last_change":"2023-12-08T08:17:56.770685+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.770685+0000","last_undegraded":"2023-12-08T08:17:56.770685+0000","last_fullsized":"2023-12-08T08:17:56.770685+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.762274+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:56.762274+0000","last_peered":"2023-12-08T08:17:56.762274+0000","last_clean":"2023-12-08T08:17:56.762274+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:56.762274+0000","last_undegraded":"2023-12-08T08:17:56.762274+0000","last_fullsized":"2023-12-08T08:17:56.762274+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:26.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767249+0000","last_change":"2023-12-08T08:17:56.767249+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767249+0000","last_undegraded":"2023-12-08T08:17:56.767249+0000","last_fullsized":"2023-12-08T08:17:56.767249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758841+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:55.758841+0000","last_peered":"2023-12-08T08:17:55.758841+0000","last_clean":"2023-12-08T08:17:55.758841+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:55.758841+0000","last_undegraded":"2023-12-08T08:17:55.758841+0000","last_fullsized":"2023-12-08T08:17:55.758841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:43.683652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780942+0000","last_change":"2023-12-08T08:17:57.780942+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780942+0000","last_undegraded":"2023-12-08T08:17:57.780942+0000","last_fullsized":"2023-12-08T08:17:57.780942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:13.633709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756676+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:55.756676+0000","last_peered":"2023-12-08T08:17:55.756676+0000","last_clean":"2023-12-08T08:17:55.756676+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:55.756676+0000","last_undegraded":"2023-12-08T08:17:55.756676+0000","last_fullsized":"2023-12-08T08:17:55.756676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779115+0000","last_change":"2023-12-08T08:17:57.779115+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779115+0000","last_undegraded":"2023-12-08T08:17:57.779115+0000","last_fullsized":"2023-12-08T08:17:57.779115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774612+0000","last_change":"2023-12-08T08:17:48.251716+0000","last_active":"2023-12-08T08:17:56.774612+0000","last_peered":"2023-12-08T08:17:56.774612+0000","last_clean":"2023-12-08T08:17:56.774612+0000","last_became_active":"2023-12-08T08:17:48.250928+0000","last_became_peered":"2023-12-08T08:17:48.250928+0000","last_unstale":"2023-12-08T08:17:56.774612+0000","last_undegraded":"2023-12-08T08:17:56.774612+0000","last_fullsized":"2023-12-08T08:17:56.774612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763848+0000","last_change":"2023-12-08T08:17:57.763848+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763848+0000","last_undegraded":"2023-12-08T08:17:57.763848+0000","last_fullsized":"2023-12-08T08:17:57.763848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:36.597031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784305+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:56.784305+0000","last_peered":"2023-12-08T08:17:56.784305+0000","last_clean":"2023-12-08T08:17:56.784305+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:56.784305+0000","last_undegraded":"2023-12-08T08:17:56.784305+0000","last_fullsized":"2023-12-08T08:17:56.784305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779114+0000","last_change":"2023-12-08T08:17:57.779114+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779114+0000","last_undegraded":"2023-12-08T08:17:57.779114+0000","last_fullsized":"2023-12-08T08:17:57.779114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759000+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:55.759000+0000","last_peered":"2023-12-08T08:17:55.759000+0000","last_clean":"2023-12-08T08:17:55.759000+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:55.759000+0000","last_undegraded":"2023-12-08T08:17:55.759000+0000","last_fullsized":"2023-12-08T08:17:55.759000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.765929+0000","last_change":"2023-12-08T08:17:56.765929+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.765929+0000","last_undegraded":"2023-12-08T08:17:56.765929+0000","last_fullsized":"2023-12-08T08:17:56.765929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761411+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:55.761411+0000","last_peered":"2023-12-08T08:17:55.761411+0000","last_clean":"2023-12-08T08:17:55.761411+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:55.761411+0000","last_undegraded":"2023-12-08T08:17:55.761411+0000","last_fullsized":"2023-12-08T08:17:55.761411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:38.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.761100+0000","last_change":"2023-12-08T08:17:56.761100+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.761100+0000","last_undegraded":"2023-12-08T08:17:56.761100+0000","last_fullsized":"2023-12-08T08:17:56.761100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752722+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:55.752722+0000","last_peered":"2023-12-08T08:17:55.752722+0000","last_clean":"2023-12-08T08:17:55.752722+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:55.752722+0000","last_undegraded":"2023-12-08T08:17:55.752722+0000","last_fullsized":"2023-12-08T08:17:55.752722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779324+0000","last_change":"2023-12-08T08:17:57.779324+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779324+0000","last_undegraded":"2023-12-08T08:17:57.779324+0000","last_fullsized":"2023-12-08T08:17:57.779324+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:36.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780196+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:56.780196+0000","last_peered":"2023-12-08T08:17:56.780196+0000","last_clean":"2023-12-08T08:17:56.780196+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:56.780196+0000","last_undegraded":"2023-12-08T08:17:56.780196+0000","last_fullsized":"2023-12-08T08:17:56.780196+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:07.769792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.763333+0000","last_change":"2023-12-08T08:17:56.763333+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.763333+0000","last_undegraded":"2023-12-08T08:17:56.763333+0000","last_fullsized":"2023-12-08T08:17:56.763333+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765778+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:56.765778+0000","last_peered":"2023-12-08T08:17:56.765778+0000","last_clean":"2023-12-08T08:17:56.765778+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:56.765778+0000","last_undegraded":"2023-12-08T08:17:56.765778+0000","last_fullsized":"2023-12-08T08:17:56.765778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:48.031268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776869+0000","last_change":"2023-12-08T08:17:57.776869+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776869+0000","last_undegraded":"2023-12-08T08:17:57.776869+0000","last_fullsized":"2023-12-08T08:17:57.776869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:22.724525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755071+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:56.755071+0000","last_peered":"2023-12-08T08:17:56.755071+0000","last_clean":"2023-12-08T08:17:56.755071+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:56.755071+0000","last_undegraded":"2023-12-08T08:17:56.755071+0000","last_fullsized":"2023-12-08T08:17:56.755071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:53.659318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775535+0000","last_change":"2023-12-08T08:17:57.775535+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775535+0000","last_undegraded":"2023-12-08T08:17:57.775535+0000","last_fullsized":"2023-12-08T08:17:57.775535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784584+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:56.784584+0000","last_peered":"2023-12-08T08:17:56.784584+0000","last_clean":"2023-12-08T08:17:56.784584+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:56.784584+0000","last_undegraded":"2023-12-08T08:17:56.784584+0000","last_fullsized":"2023-12-08T08:17:56.784584+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778888+0000","last_change":"2023-12-08T08:17:57.778888+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778888+0000","last_undegraded":"2023-12-08T08:17:57.778888+0000","last_fullsized":"2023-12-08T08:17:57.778888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:24.195559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795162+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:56.795162+0000","last_peered":"2023-12-08T08:17:56.795162+0000","last_clean":"2023-12-08T08:17:56.795162+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:56.795162+0000","last_undegraded":"2023-12-08T08:17:56.795162+0000","last_fullsized":"2023-12-08T08:17:56.795162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760361+0000","last_change":"2023-12-08T08:17:57.760361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760361+0000","last_undegraded":"2023-12-08T08:17:57.760361+0000","last_fullsized":"2023-12-08T08:17:57.760361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:41.070452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773011+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:56.773011+0000","last_peered":"2023-12-08T08:17:56.773011+0000","last_clean":"2023-12-08T08:17:56.773011+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:56.773011+0000","last_undegraded":"2023-12-08T08:17:56.773011+0000","last_fullsized":"2023-12-08T08:17:56.773011+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790074+0000","last_change":"2023-12-08T08:17:57.790074+0000","last_active":"2023-12-08T08:17:57.790074+0000","last_peered":"2023-12-08T08:17:57.790074+0000","last_clean":"2023-12-08T08:17:57.790074+0000","last_became_active":"2023-12-08T08:17:57.789798+0000","last_became_peered":"2023-12-08T08:17:57.789798+0000","last_unstale":"2023-12-08T08:17:57.790074+0000","last_undegraded":"2023-12-08T08:17:57.790074+0000","last_fullsized":"2023-12-08T08:17:57.790074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759411+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:55.759411+0000","last_peered":"2023-12-08T08:17:55.759411+0000","last_clean":"2023-12-08T08:17:55.759411+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:55.759411+0000","last_undegraded":"2023-12-08T08:17:55.759411+0000","last_fullsized":"2023-12-08T08:17:55.759411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765064+0000","last_change":"2023-12-08T08:17:57.765064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765064+0000","last_undegraded":"2023-12-08T08:17:57.765064+0000","last_fullsized":"2023-12-08T08:17:57.765064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:24.223268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772444+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:56.772444+0000","last_peered":"2023-12-08T08:17:56.772444+0000","last_clean":"2023-12-08T08:17:56.772444+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:56.772444+0000","last_undegraded":"2023-12-08T08:17:56.772444+0000","last_fullsized":"2023-12-08T08:17:56.772444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:45.955555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777534+0000","last_change":"2023-12-08T08:17:57.777534+0000","last_active":"2023-12-08T08:17:57.777534+0000","last_peered":"2023-12-08T08:17:57.777534+0000","last_clean":"2023-12-08T08:17:57.777534+0000","last_became_active":"2023-12-08T08:17:57.777268+0000","last_became_peered":"2023-12-08T08:17:57.777268+0000","last_unstale":"2023-12-08T08:17:57.777534+0000","last_undegraded":"2023-12-08T08:17:57.777534+0000","last_fullsized":"2023-12-08T08:17:57.777534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:04.336513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771357+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:56.771357+0000","last_peered":"2023-12-08T08:17:56.771357+0000","last_clean":"2023-12-08T08:17:56.771357+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:56.771357+0000","last_undegraded":"2023-12-08T08:17:56.771357+0000","last_fullsized":"2023-12-08T08:17:56.771357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:27.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.803290+0000","last_change":"2023-12-08T08:17:57.803290+0000","last_active":"2023-12-08T08:17:57.803290+0000","last_peered":"2023-12-08T08:17:57.803290+0000","last_clean":"2023-12-08T08:17:57.803290+0000","last_became_active":"2023-12-08T08:17:57.802999+0000","last_became_peered":"2023-12-08T08:17:57.802999+0000","last_unstale":"2023-12-08T08:17:57.803290+0000","last_undegraded":"2023-12-08T08:17:57.803290+0000","last_fullsized":"2023-12-08T08:17:57.803290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:01:45.610748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779207+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:56.779207+0000","last_peered":"2023-12-08T08:17:56.779207+0000","last_clean":"2023-12-08T08:17:56.779207+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:56.779207+0000","last_undegraded":"2023-12-08T08:17:56.779207+0000","last_fullsized":"2023-12-08T08:17:56.779207+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775244+0000","last_change":"2023-12-08T08:17:57.775244+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775244+0000","last_undegraded":"2023-12-08T08:17:57.775244+0000","last_fullsized":"2023-12-08T08:17:57.775244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:15.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762344+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:55.762344+0000","last_peered":"2023-12-08T08:17:55.762344+0000","last_clean":"2023-12-08T08:17:55.762344+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:55.762344+0000","last_undegraded":"2023-12-08T08:17:55.762344+0000","last_fullsized":"2023-12-08T08:17:55.762344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777744+0000","last_change":"2023-12-08T08:17:57.777744+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777744+0000","last_undegraded":"2023-12-08T08:17:57.777744+0000","last_fullsized":"2023-12-08T08:17:57.777744+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761646+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:55.761646+0000","last_peered":"2023-12-08T08:17:55.761646+0000","last_clean":"2023-12-08T08:17:55.761646+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:55.761646+0000","last_undegraded":"2023-12-08T08:17:55.761646+0000","last_fullsized":"2023-12-08T08:17:55.761646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767468+0000","last_change":"2023-12-08T08:17:56.767468+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767468+0000","last_undegraded":"2023-12-08T08:17:56.767468+0000","last_fullsized":"2023-12-08T08:17:56.767468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784391+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:56.784391+0000","last_peered":"2023-12-08T08:17:56.784391+0000","last_clean":"2023-12-08T08:17:56.784391+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:56.784391+0000","last_undegraded":"2023-12-08T08:17:56.784391+0000","last_fullsized":"2023-12-08T08:17:56.784391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777837+0000","last_change":"2023-12-08T08:17:57.777837+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777837+0000","last_undegraded":"2023-12-08T08:17:57.777837+0000","last_fullsized":"2023-12-08T08:17:57.777837+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754291+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:56.754291+0000","last_peered":"2023-12-08T08:17:56.754291+0000","last_clean":"2023-12-08T08:17:56.754291+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:56.754291+0000","last_undegraded":"2023-12-08T08:17:56.754291+0000","last_fullsized":"2023-12-08T08:17:56.754291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:11:24.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.771678+0000","last_change":"2023-12-08T08:17:56.771678+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.771678+0000","last_undegraded":"2023-12-08T08:17:56.771678+0000","last_fullsized":"2023-12-08T08:17:56.771678+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752706+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:55.752706+0000","last_peered":"2023-12-08T08:17:55.752706+0000","last_clean":"2023-12-08T08:17:55.752706+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:55.752706+0000","last_undegraded":"2023-12-08T08:17:55.752706+0000","last_fullsized":"2023-12-08T08:17:55.752706+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760042+0000","last_change":"2023-12-08T08:17:57.760042+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760042+0000","last_undegraded":"2023-12-08T08:17:57.760042+0000","last_fullsized":"2023-12-08T08:17:57.760042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:58.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760113+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:55.760113+0000","last_peered":"2023-12-08T08:17:55.760113+0000","last_clean":"2023-12-08T08:17:55.760113+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:55.760113+0000","last_undegraded":"2023-12-08T08:17:55.760113+0000","last_fullsized":"2023-12-08T08:17:55.760113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.782317+0000","last_change":"2023-12-08T08:17:57.782317+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.782317+0000","last_undegraded":"2023-12-08T08:17:57.782317+0000","last_fullsized":"2023-12-08T08:17:57.782317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784456+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:56.784456+0000","last_peered":"2023-12-08T08:17:56.784456+0000","last_clean":"2023-12-08T08:17:56.784456+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:56.784456+0000","last_undegraded":"2023-12-08T08:17:56.784456+0000","last_fullsized":"2023-12-08T08:17:56.784456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.760566+0000","last_change":"2023-12-08T08:17:56.760566+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.760566+0000","last_undegraded":"2023-12-08T08:17:56.760566+0000","last_fullsized":"2023-12-08T08:17:56.760566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769710+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:56.769710+0000","last_peered":"2023-12-08T08:17:56.769710+0000","last_clean":"2023-12-08T08:17:56.769710+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:56.769710+0000","last_undegraded":"2023-12-08T08:17:56.769710+0000","last_fullsized":"2023-12-08T08:17:56.769710+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783622+0000","last_change":"2023-12-08T08:17:57.783622+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783622+0000","last_undegraded":"2023-12-08T08:17:57.783622+0000","last_fullsized":"2023-12-08T08:17:57.783622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:31.796515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799963+0000","last_change":"2023-12-08T08:17:56.795327+0000","last_active":"2023-12-08T08:17:56.799963+0000","last_peered":"2023-12-08T08:17:56.799963+0000","last_clean":"2023-12-08T08:17:56.799963+0000","last_became_active":"2023-12-08T08:17:56.795056+0000","last_became_peered":"2023-12-08T08:17:56.795056+0000","last_unstale":"2023-12-08T08:17:56.799963+0000","last_undegraded":"2023-12-08T08:17:56.799963+0000","last_fullsized":"2023-12-08T08:17:56.799963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:25.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.796743+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:56.796743+0000","last_peered":"2023-12-08T08:17:56.796743+0000","last_clean":"2023-12-08T08:17:56.796743+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:56.796743+0000","last_undegraded":"2023-12-08T08:17:56.796743+0000","last_fullsized":"2023-12-08T08:17:56.796743+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755302+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:56.755302+0000","last_peered":"2023-12-08T08:17:56.755302+0000","last_clean":"2023-12-08T08:17:56.755302+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:56.755302+0000","last_undegraded":"2023-12-08T08:17:56.755302+0000","last_fullsized":"2023-12-08T08:17:56.755302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784216+0000","last_change":"2023-12-08T08:17:57.784216+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784216+0000","last_undegraded":"2023-12-08T08:17:57.784216+0000","last_fullsized":"2023-12-08T08:17:57.784216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:00:56.423817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767497+0000","last_change":"2023-12-08T08:17:56.798852+0000","last_active":"2023-12-08T08:17:57.767497+0000","last_peered":"2023-12-08T08:17:57.767497+0000","last_clean":"2023-12-08T08:17:57.767497+0000","last_became_active":"2023-12-08T08:17:56.798551+0000","last_became_peered":"2023-12-08T08:17:56.798551+0000","last_unstale":"2023-12-08T08:17:57.767497+0000","last_undegraded":"2023-12-08T08:17:57.767497+0000","last_fullsized":"2023-12-08T08:17:57.767497+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:17.192846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784491+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:56.784491+0000","last_peered":"2023-12-08T08:17:56.784491+0000","last_clean":"2023-12-08T08:17:56.784491+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:56.784491+0000","last_undegraded":"2023-12-08T08:17:56.784491+0000","last_fullsized":"2023-12-08T08:17:56.784491+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757857+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:55.757857+0000","last_peered":"2023-12-08T08:17:55.757857+0000","last_clean":"2023-12-08T08:17:55.757857+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:55.757857+0000","last_undegraded":"2023-12-08T08:17:55.757857+0000","last_fullsized":"2023-12-08T08:17:55.757857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.794889+0000","last_change":"2023-12-08T08:17:57.794889+0000","last_active":"2023-12-08T08:17:57.794889+0000","last_peered":"2023-12-08T08:17:57.794889+0000","last_clean":"2023-12-08T08:17:57.794889+0000","last_became_active":"2023-12-08T08:17:57.794635+0000","last_became_peered":"2023-12-08T08:17:57.794635+0000","last_unstale":"2023-12-08T08:17:57.794889+0000","last_undegraded":"2023-12-08T08:17:57.794889+0000","last_fullsized":"2023-12-08T08:17:57.794889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:24:08.558071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.761744+0000","last_change":"2023-12-08T08:17:56.783004+0000","last_active":"2023-12-08T08:17:57.761744+0000","last_peered":"2023-12-08T08:17:57.761744+0000","last_clean":"2023-12-08T08:17:57.761744+0000","last_became_active":"2023-12-08T08:17:56.780718+0000","last_became_peered":"2023-12-08T08:17:56.780718+0000","last_unstale":"2023-12-08T08:17:57.761744+0000","last_undegraded":"2023-12-08T08:17:57.761744+0000","last_fullsized":"2023-12-08T08:17:57.761744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:03.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757817+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:55.757817+0000","last_peered":"2023-12-08T08:17:55.757817+0000","last_clean":"2023-12-08T08:17:55.757817+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:55.757817+0000","last_undegraded":"2023-12-08T08:17:55.757817+0000","last_fullsized":"2023-12-08T08:17:55.757817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757497+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:55.757497+0000","last_peered":"2023-12-08T08:17:55.757497+0000","last_clean":"2023-12-08T08:17:55.757497+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:55.757497+0000","last_undegraded":"2023-12-08T08:17:55.757497+0000","last_fullsized":"2023-12-08T08:17:55.757497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.772153+0000","last_change":"2023-12-08T08:17:57.772153+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.772153+0000","last_undegraded":"2023-12-08T08:17:57.772153+0000","last_fullsized":"2023-12-08T08:17:57.772153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:37.945325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800046+0000","last_change":"2023-12-08T08:17:56.796020+0000","last_active":"2023-12-08T08:17:56.800046+0000","last_peered":"2023-12-08T08:17:56.800046+0000","last_clean":"2023-12-08T08:17:56.800046+0000","last_became_active":"2023-12-08T08:17:56.795600+0000","last_became_peered":"2023-12-08T08:17:56.795600+0000","last_unstale":"2023-12-08T08:17:56.800046+0000","last_undegraded":"2023-12-08T08:17:56.800046+0000","last_fullsized":"2023-12-08T08:17:56.800046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:30:24.340680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756226+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:55.756226+0000","last_peered":"2023-12-08T08:17:55.756226+0000","last_clean":"2023-12-08T08:17:55.756226+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:55.756226+0000","last_undegraded":"2023-12-08T08:17:55.756226+0000","last_fullsized":"2023-12-08T08:17:55.756226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757057+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:55.757057+0000","last_peered":"2023-12-08T08:17:55.757057+0000","last_clean":"2023-12-08T08:17:55.757057+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:55.757057+0000","last_undegraded":"2023-12-08T08:17:55.757057+0000","last_fullsized":"2023-12-08T08:17:55.757057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777217+0000","last_change":"2023-12-08T08:17:57.777217+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777217+0000","last_undegraded":"2023-12-08T08:17:57.777217+0000","last_fullsized":"2023-12-08T08:17:57.777217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:42.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.781239+0000","last_change":"2023-12-08T08:17:56.785550+0000","last_active":"2023-12-08T08:17:57.781239+0000","last_peered":"2023-12-08T08:17:57.781239+0000","last_clean":"2023-12-08T08:17:57.781239+0000","last_became_active":"2023-12-08T08:17:56.785143+0000","last_became_peered":"2023-12-08T08:17:56.785143+0000","last_unstale":"2023-12-08T08:17:57.781239+0000","last_undegraded":"2023-12-08T08:17:57.781239+0000","last_fullsized":"2023-12-08T08:17:57.781239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:41.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765877+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:56.765877+0000","last_peered":"2023-12-08T08:17:56.765877+0000","last_clean":"2023-12-08T08:17:56.765877+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:56.765877+0000","last_undegraded":"2023-12-08T08:17:56.765877+0000","last_fullsized":"2023-12-08T08:17:56.765877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:50.669464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771471+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:56.771471+0000","last_peered":"2023-12-08T08:17:56.771471+0000","last_clean":"2023-12-08T08:17:56.771471+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:56.771471+0000","last_undegraded":"2023-12-08T08:17:56.771471+0000","last_fullsized":"2023-12-08T08:17:56.771471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765847+0000","last_change":"2023-12-08T08:17:57.765847+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765847+0000","last_undegraded":"2023-12-08T08:17:57.765847+0000","last_fullsized":"2023-12-08T08:17:57.765847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759772+0000","last_change":"2023-12-08T08:17:56.787431+0000","last_active":"2023-12-08T08:17:57.759772+0000","last_peered":"2023-12-08T08:17:57.759772+0000","last_clean":"2023-12-08T08:17:57.759772+0000","last_became_active":"2023-12-08T08:17:56.787150+0000","last_became_peered":"2023-12-08T08:17:56.787150+0000","last_unstale":"2023-12-08T08:17:57.759772+0000","last_undegraded":"2023-12-08T08:17:57.759772+0000","last_fullsized":"2023-12-08T08:17:57.759772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:02.405102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754138+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:56.754138+0000","last_peered":"2023-12-08T08:17:56.754138+0000","last_clean":"2023-12-08T08:17:56.754138+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:56.754138+0000","last_undegraded":"2023-12-08T08:17:56.754138+0000","last_fullsized":"2023-12-08T08:17:56.754138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:49.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772541+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:56.772541+0000","last_peered":"2023-12-08T08:17:56.772541+0000","last_clean":"2023-12-08T08:17:56.772541+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:56.772541+0000","last_undegraded":"2023-12-08T08:17:56.772541+0000","last_fullsized":"2023-12-08T08:17:56.772541+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779412+0000","last_change":"2023-12-08T08:17:57.779412+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779412+0000","last_undegraded":"2023-12-08T08:17:57.779412+0000","last_fullsized":"2023-12-08T08:17:57.779412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:21.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784629+0000","last_change":"2023-12-08T08:17:56.793596+0000","last_active":"2023-12-08T08:17:57.784629+0000","last_peered":"2023-12-08T08:17:57.784629+0000","last_clean":"2023-12-08T08:17:57.784629+0000","last_became_active":"2023-12-08T08:17:56.793096+0000","last_became_peered":"2023-12-08T08:17:56.793096+0000","last_unstale":"2023-12-08T08:17:57.784629+0000","last_undegraded":"2023-12-08T08:17:57.784629+0000","last_fullsized":"2023-12-08T08:17:57.784629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:06.204089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793718+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:56.793718+0000","last_peered":"2023-12-08T08:17:56.793718+0000","last_clean":"2023-12-08T08:17:56.793718+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:56.793718+0000","last_undegraded":"2023-12-08T08:17:56.793718+0000","last_fullsized":"2023-12-08T08:17:56.793718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771450+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:56.771450+0000","last_peered":"2023-12-08T08:17:56.771450+0000","last_clean":"2023-12-08T08:17:56.771450+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:56.771450+0000","last_undegraded":"2023-12-08T08:17:56.771450+0000","last_fullsized":"2023-12-08T08:17:56.771450+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778378+0000","last_change":"2023-12-08T08:17:57.778378+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778378+0000","last_undegraded":"2023-12-08T08:17:57.778378+0000","last_fullsized":"2023-12-08T08:17:57.778378+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776742+0000","last_change":"2023-12-08T08:17:56.772823+0000","last_active":"2023-12-08T08:17:56.776742+0000","last_peered":"2023-12-08T08:17:56.776742+0000","last_clean":"2023-12-08T08:17:56.776742+0000","last_became_active":"2023-12-08T08:17:56.772152+0000","last_became_peered":"2023-12-08T08:17:56.772152+0000","last_unstale":"2023-12-08T08:17:56.776742+0000","last_undegraded":"2023-12-08T08:17:56.776742+0000","last_fullsized":"2023-12-08T08:17:56.776742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:00.732887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773308+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:56.773308+0000","last_peered":"2023-12-08T08:17:56.773308+0000","last_clean":"2023-12-08T08:17:56.773308+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:56.773308+0000","last_undegraded":"2023-12-08T08:17:56.773308+0000","last_fullsized":"2023-12-08T08:17:56.773308+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793563+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:56.793563+0000","last_peered":"2023-12-08T08:17:56.793563+0000","last_clean":"2023-12-08T08:17:56.793563+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:56.793563+0000","last_undegraded":"2023-12-08T08:17:56.793563+0000","last_fullsized":"2023-12-08T08:17:56.793563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778739+0000","last_change":"2023-12-08T08:17:57.778739+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778739+0000","last_undegraded":"2023-12-08T08:17:57.778739+0000","last_fullsized":"2023-12-08T08:17:57.778739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:11.051763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759830+0000","last_change":"2023-12-08T08:17:56.778625+0000","last_active":"2023-12-08T08:17:57.759830+0000","last_peered":"2023-12-08T08:17:57.759830+0000","last_clean":"2023-12-08T08:17:57.759830+0000","last_became_active":"2023-12-08T08:17:56.778322+0000","last_became_peered":"2023-12-08T08:17:56.778322+0000","last_unstale":"2023-12-08T08:17:57.759830+0000","last_undegraded":"2023-12-08T08:17:57.759830+0000","last_fullsized":"2023-12-08T08:17:57.759830+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:15.872633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754380+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:56.754380+0000","last_peered":"2023-12-08T08:17:56.754380+0000","last_clean":"2023-12-08T08:17:56.754380+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:56.754380+0000","last_undegraded":"2023-12-08T08:17:56.754380+0000","last_fullsized":"2023-12-08T08:17:56.754380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:19.234272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758014+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:55.758014+0000","last_peered":"2023-12-08T08:17:55.758014+0000","last_clean":"2023-12-08T08:17:55.758014+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:55.758014+0000","last_undegraded":"2023-12-08T08:17:55.758014+0000","last_fullsized":"2023-12-08T08:17:55.758014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776810+0000","last_change":"2023-12-08T08:17:57.776810+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776810+0000","last_undegraded":"2023-12-08T08:17:57.776810+0000","last_fullsized":"2023-12-08T08:17:57.776810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:29.646735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767848+0000","last_change":"2023-12-08T08:17:56.796421+0000","last_active":"2023-12-08T08:17:57.767848+0000","last_peered":"2023-12-08T08:17:57.767848+0000","last_clean":"2023-12-08T08:17:57.767848+0000","last_became_active":"2023-12-08T08:17:56.795882+0000","last_became_peered":"2023-12-08T08:17:56.795882+0000","last_unstale":"2023-12-08T08:17:57.767848+0000","last_undegraded":"2023-12-08T08:17:57.767848+0000","last_fullsized":"2023-12-08T08:17:57.767848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:20.323825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773753+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:56.773753+0000","last_peered":"2023-12-08T08:17:56.773753+0000","last_clean":"2023-12-08T08:17:56.773753+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:56.773753+0000","last_undegraded":"2023-12-08T08:17:56.773753+0000","last_fullsized":"2023-12-08T08:17:56.773753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.781626+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:56.781626+0000","last_peered":"2023-12-08T08:17:56.781626+0000","last_clean":"2023-12-08T08:17:56.781626+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:56.781626+0000","last_undegraded":"2023-12-08T08:17:56.781626+0000","last_fullsized":"2023-12-08T08:17:56.781626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.770802+0000","last_change":"2023-12-08T08:17:57.770802+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.770802+0000","last_undegraded":"2023-12-08T08:17:57.770802+0000","last_fullsized":"2023-12-08T08:17:57.770802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800011+0000","last_change":"2023-12-08T08:17:56.796029+0000","last_active":"2023-12-08T08:17:56.800011+0000","last_peered":"2023-12-08T08:17:56.800011+0000","last_clean":"2023-12-08T08:17:56.800011+0000","last_became_active":"2023-12-08T08:17:56.795266+0000","last_became_peered":"2023-12-08T08:17:56.795266+0000","last_unstale":"2023-12-08T08:17:56.800011+0000","last_undegraded":"2023-12-08T08:17:56.800011+0000","last_fullsized":"2023-12-08T08:17:56.800011+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:54.839448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795131+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:56.795131+0000","last_peered":"2023-12-08T08:17:56.795131+0000","last_clean":"2023-12-08T08:17:56.795131+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:56.795131+0000","last_undegraded":"2023-12-08T08:17:56.795131+0000","last_fullsized":"2023-12-08T08:17:56.795131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753596+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:55.753596+0000","last_peered":"2023-12-08T08:17:55.753596+0000","last_clean":"2023-12-08T08:17:55.753596+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:55.753596+0000","last_undegraded":"2023-12-08T08:17:55.753596+0000","last_fullsized":"2023-12-08T08:17:55.753596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759400+0000","last_change":"2023-12-08T08:17:56.759400+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759400+0000","last_undegraded":"2023-12-08T08:17:56.759400+0000","last_fullsized":"2023-12-08T08:17:56.759400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.788509+0000","last_change":"2023-12-08T08:17:56.784864+0000","last_active":"2023-12-08T08:17:56.788509+0000","last_peered":"2023-12-08T08:17:56.788509+0000","last_clean":"2023-12-08T08:17:56.788509+0000","last_became_active":"2023-12-08T08:17:56.784452+0000","last_became_peered":"2023-12-08T08:17:56.784452+0000","last_unstale":"2023-12-08T08:17:56.788509+0000","last_undegraded":"2023-12-08T08:17:56.788509+0000","last_fullsized":"2023-12-08T08:17:56.788509+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:34.245758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.745578+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:55.745578+0000","last_peered":"2023-12-08T08:17:55.745578+0000","last_clean":"2023-12-08T08:17:55.745578+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:55.745578+0000","last_undegraded":"2023-12-08T08:17:55.745578+0000","last_fullsized":"2023-12-08T08:17:55.745578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:37.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754545+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:56.754545+0000","last_peered":"2023-12-08T08:17:56.754545+0000","last_clean":"2023-12-08T08:17:56.754545+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:56.754545+0000","last_undegraded":"2023-12-08T08:17:56.754545+0000","last_fullsized":"2023-12-08T08:17:56.754545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763151+0000","last_change":"2023-12-08T08:17:57.763151+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763151+0000","last_undegraded":"2023-12-08T08:17:57.763151+0000","last_fullsized":"2023-12-08T08:17:57.763151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.762324+0000","last_change":"2023-12-08T08:17:56.777484+0000","last_active":"2023-12-08T08:17:57.762324+0000","last_peered":"2023-12-08T08:17:57.762324+0000","last_clean":"2023-12-08T08:17:57.762324+0000","last_became_active":"2023-12-08T08:17:56.776424+0000","last_became_peered":"2023-12-08T08:17:56.776424+0000","last_unstale":"2023-12-08T08:17:57.762324+0000","last_undegraded":"2023-12-08T08:17:57.762324+0000","last_fullsized":"2023-12-08T08:17:57.762324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:23.600820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782758+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:56.782758+0000","last_peered":"2023-12-08T08:17:56.782758+0000","last_clean":"2023-12-08T08:17:56.782758+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:56.782758+0000","last_undegraded":"2023-12-08T08:17:56.782758+0000","last_fullsized":"2023-12-08T08:17:56.782758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752880+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:55.752880+0000","last_peered":"2023-12-08T08:17:55.752880+0000","last_clean":"2023-12-08T08:17:55.752880+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:55.752880+0000","last_undegraded":"2023-12-08T08:17:55.752880+0000","last_fullsized":"2023-12-08T08:17:55.752880+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764868+0000","last_change":"2023-12-08T08:17:57.764868+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764868+0000","last_undegraded":"2023-12-08T08:17:57.764868+0000","last_fullsized":"2023-12-08T08:17:57.764868+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.776109+0000","last_change":"2023-12-08T08:17:56.789756+0000","last_active":"2023-12-08T08:17:57.776109+0000","last_peered":"2023-12-08T08:17:57.776109+0000","last_clean":"2023-12-08T08:17:57.776109+0000","last_became_active":"2023-12-08T08:17:56.789515+0000","last_became_peered":"2023-12-08T08:17:56.789515+0000","last_unstale":"2023-12-08T08:17:57.776109+0000","last_undegraded":"2023-12-08T08:17:57.776109+0000","last_fullsized":"2023-12-08T08:17:57.776109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:10.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760588+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:55.760588+0000","last_peered":"2023-12-08T08:17:55.760588+0000","last_clean":"2023-12-08T08:17:55.760588+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:55.760588+0000","last_undegraded":"2023-12-08T08:17:55.760588+0000","last_fullsized":"2023-12-08T08:17:55.760588+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760270+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:55.760270+0000","last_peered":"2023-12-08T08:17:55.760270+0000","last_clean":"2023-12-08T08:17:55.760270+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:55.760270+0000","last_undegraded":"2023-12-08T08:17:55.760270+0000","last_fullsized":"2023-12-08T08:17:55.760270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759427+0000","last_change":"2023-12-08T08:17:56.759427+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759427+0000","last_undegraded":"2023-12-08T08:17:56.759427+0000","last_fullsized":"2023-12-08T08:17:56.759427+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.789798+0000","last_change":"2023-12-08T08:17:56.788069+0000","last_active":"2023-12-08T08:17:56.789798+0000","last_peered":"2023-12-08T08:17:56.789798+0000","last_clean":"2023-12-08T08:17:56.789798+0000","last_became_active":"2023-12-08T08:17:56.787757+0000","last_became_peered":"2023-12-08T08:17:56.787757+0000","last_unstale":"2023-12-08T08:17:56.789798+0000","last_undegraded":"2023-12-08T08:17:56.789798+0000","last_fullsized":"2023-12-08T08:17:56.789798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793817+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:56.793817+0000","last_peered":"2023-12-08T08:17:56.793817+0000","last_clean":"2023-12-08T08:17:56.793817+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:56.793817+0000","last_undegraded":"2023-12-08T08:17:56.793817+0000","last_fullsized":"2023-12-08T08:17:56.793817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780446+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:56.780446+0000","last_peered":"2023-12-08T08:17:56.780446+0000","last_clean":"2023-12-08T08:17:56.780446+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:56.780446+0000","last_undegraded":"2023-12-08T08:17:56.780446+0000","last_fullsized":"2023-12-08T08:17:56.780446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763263+0000","last_change":"2023-12-08T08:17:57.763263+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763263+0000","last_undegraded":"2023-12-08T08:17:57.763263+0000","last_fullsized":"2023-12-08T08:17:57.763263+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.798221+0000","last_change":"2023-12-08T08:17:56.792597+0000","last_active":"2023-12-08T08:17:56.798221+0000","last_peered":"2023-12-08T08:17:56.798221+0000","last_clean":"2023-12-08T08:17:56.798221+0000","last_became_active":"2023-12-08T08:17:56.792311+0000","last_became_peered":"2023-12-08T08:17:56.792311+0000","last_unstale":"2023-12-08T08:17:56.798221+0000","last_undegraded":"2023-12-08T08:17:56.798221+0000","last_fullsized":"2023-12-08T08:17:56.798221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:39.332501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753989+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:56.753989+0000","last_peered":"2023-12-08T08:17:56.753989+0000","last_clean":"2023-12-08T08:17:56.753989+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:56.753989+0000","last_undegraded":"2023-12-08T08:17:56.753989+0000","last_fullsized":"2023-12-08T08:17:56.753989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:13:24.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782874+0000","last_change":"2023-12-08T08:17:47.914689+0000","last_active":"2023-12-08T08:17:56.782874+0000","last_peered":"2023-12-08T08:17:56.782874+0000","last_clean":"2023-12-08T08:17:56.782874+0000","last_became_active":"2023-12-08T08:17:47.896123+0000","last_became_peered":"2023-12-08T08:17:47.896123+0000","last_unstale":"2023-12-08T08:17:56.782874+0000","last_undegraded":"2023-12-08T08:17:56.782874+0000","last_fullsized":"2023-12-08T08:17:56.782874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:47.568360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763503+0000","last_change":"2023-12-08T08:17:57.763503+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763503+0000","last_undegraded":"2023-12-08T08:17:57.763503+0000","last_fullsized":"2023-12-08T08:17:57.763503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:44.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759949+0000","last_change":"2023-12-08T08:17:56.783471+0000","last_active":"2023-12-08T08:17:57.759949+0000","last_peered":"2023-12-08T08:17:57.759949+0000","last_clean":"2023-12-08T08:17:57.759949+0000","last_became_active":"2023-12-08T08:17:56.782732+0000","last_became_peered":"2023-12-08T08:17:56.782732+0000","last_unstale":"2023-12-08T08:17:57.759949+0000","last_undegraded":"2023-12-08T08:17:57.759949+0000","last_fullsized":"2023-12-08T08:17:57.759949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753330+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:55.753330+0000","last_peered":"2023-12-08T08:17:55.753330+0000","last_clean":"2023-12-08T08:17:55.753330+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:55.753330+0000","last_undegraded":"2023-12-08T08:17:55.753330+0000","last_fullsized":"2023-12-08T08:17:55.753330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761923+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:55.761923+0000","last_peered":"2023-12-08T08:17:55.761923+0000","last_clean":"2023-12-08T08:17:55.761923+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:55.761923+0000","last_undegraded":"2023-12-08T08:17:55.761923+0000","last_fullsized":"2023-12-08T08:17:55.761923+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789814+0000","last_change":"2023-12-08T08:17:57.789814+0000","last_active":"2023-12-08T08:17:57.789814+0000","last_peered":"2023-12-08T08:17:57.789814+0000","last_clean":"2023-12-08T08:17:57.789814+0000","last_became_active":"2023-12-08T08:17:57.789121+0000","last_became_peered":"2023-12-08T08:17:57.789121+0000","last_unstale":"2023-12-08T08:17:57.789814+0000","last_undegraded":"2023-12-08T08:17:57.789814+0000","last_fullsized":"2023-12-08T08:17:57.789814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782602+0000","last_change":"2023-12-08T08:17:56.778284+0000","last_active":"2023-12-08T08:17:57.782602+0000","last_peered":"2023-12-08T08:17:57.782602+0000","last_clean":"2023-12-08T08:17:57.782602+0000","last_became_active":"2023-12-08T08:17:56.777942+0000","last_became_peered":"2023-12-08T08:17:56.777942+0000","last_unstale":"2023-12-08T08:17:57.782602+0000","last_undegraded":"2023-12-08T08:17:57.782602+0000","last_fullsized":"2023-12-08T08:17:57.782602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:35:47.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795227+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:56.795227+0000","last_peered":"2023-12-08T08:17:56.795227+0000","last_clean":"2023-12-08T08:17:56.795227+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:56.795227+0000","last_undegraded":"2023-12-08T08:17:56.795227+0000","last_fullsized":"2023-12-08T08:17:56.795227+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:52.110302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753831+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:55.753831+0000","last_peered":"2023-12-08T08:17:55.753831+0000","last_clean":"2023-12-08T08:17:55.753831+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:55.753831+0000","last_undegraded":"2023-12-08T08:17:55.753831+0000","last_fullsized":"2023-12-08T08:17:55.753831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784018+0000","last_change":"2023-12-08T08:17:57.777499+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784018+0000","last_undegraded":"2023-12-08T08:17:57.784018+0000","last_fullsized":"2023-12-08T08:17:57.784018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800071+0000","last_change":"2023-12-08T08:17:56.796644+0000","last_active":"2023-12-08T08:17:56.800071+0000","last_peered":"2023-12-08T08:17:56.800071+0000","last_clean":"2023-12-08T08:17:56.800071+0000","last_became_active":"2023-12-08T08:17:56.796276+0000","last_became_peered":"2023-12-08T08:17:56.796276+0000","last_unstale":"2023-12-08T08:17:56.800071+0000","last_undegraded":"2023-12-08T08:17:56.800071+0000","last_fullsized":"2023-12-08T08:17:56.800071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:22:28.402168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774697+0000","last_change":"2023-12-08T08:17:47.864253+0000","last_active":"2023-12-08T08:17:56.774697+0000","last_peered":"2023-12-08T08:17:56.774697+0000","last_clean":"2023-12-08T08:17:56.774697+0000","last_became_active":"2023-12-08T08:17:47.863753+0000","last_became_peered":"2023-12-08T08:17:47.863753+0000","last_unstale":"2023-12-08T08:17:56.774697+0000","last_undegraded":"2023-12-08T08:17:56.774697+0000","last_fullsized":"2023-12-08T08:17:56.774697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:12.401320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753774+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:55.753774+0000","last_peered":"2023-12-08T08:17:55.753774+0000","last_clean":"2023-12-08T08:17:55.753774+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:55.753774+0000","last_undegraded":"2023-12-08T08:17:55.753774+0000","last_fullsized":"2023-12-08T08:17:55.753774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777046+0000","last_change":"2023-12-08T08:17:57.777046+0000","last_active":"2023-12-08T08:17:57.777046+0000","last_peered":"2023-12-08T08:17:57.777046+0000","last_clean":"2023-12-08T08:17:57.777046+0000","last_became_active":"2023-12-08T08:17:57.776718+0000","last_became_peered":"2023-12-08T08:17:57.776718+0000","last_unstale":"2023-12-08T08:17:57.777046+0000","last_undegraded":"2023-12-08T08:17:57.777046+0000","last_fullsized":"2023-12-08T08:17:57.777046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:39.870427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787223+0000","last_change":"2023-12-08T08:17:56.780944+0000","last_active":"2023-12-08T08:17:57.787223+0000","last_peered":"2023-12-08T08:17:57.787223+0000","last_clean":"2023-12-08T08:17:57.787223+0000","last_became_active":"2023-12-08T08:17:56.780212+0000","last_became_peered":"2023-12-08T08:17:56.780212+0000","last_unstale":"2023-12-08T08:17:57.787223+0000","last_undegraded":"2023-12-08T08:17:57.787223+0000","last_fullsized":"2023-12-08T08:17:57.787223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:58.661778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794170+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:56.794170+0000","last_peered":"2023-12-08T08:17:56.794170+0000","last_clean":"2023-12-08T08:17:56.794170+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:56.794170+0000","last_undegraded":"2023-12-08T08:17:56.794170+0000","last_fullsized":"2023-12-08T08:17:56.794170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773158+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:56.773158+0000","last_peered":"2023-12-08T08:17:56.773158+0000","last_clean":"2023-12-08T08:17:56.773158+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:56.773158+0000","last_undegraded":"2023-12-08T08:17:56.773158+0000","last_fullsized":"2023-12-08T08:17:56.773158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775811+0000","last_change":"2023-12-08T08:17:57.775811+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775811+0000","last_undegraded":"2023-12-08T08:17:57.775811+0000","last_fullsized":"2023-12-08T08:17:57.775811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:57.978934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783322+0000","last_change":"2023-12-08T08:17:56.792427+0000","last_active":"2023-12-08T08:17:57.783322+0000","last_peered":"2023-12-08T08:17:57.783322+0000","last_clean":"2023-12-08T08:17:57.783322+0000","last_became_active":"2023-12-08T08:17:56.792047+0000","last_became_peered":"2023-12-08T08:17:56.792047+0000","last_unstale":"2023-12-08T08:17:57.783322+0000","last_undegraded":"2023-12-08T08:17:57.783322+0000","last_fullsized":"2023-12-08T08:17:57.783322+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769796+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:56.769796+0000","last_peered":"2023-12-08T08:17:56.769796+0000","last_clean":"2023-12-08T08:17:56.769796+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:56.769796+0000","last_undegraded":"2023-12-08T08:17:56.769796+0000","last_fullsized":"2023-12-08T08:17:56.769796+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:14.424829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756879+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:55.756879+0000","last_peered":"2023-12-08T08:17:55.756879+0000","last_clean":"2023-12-08T08:17:55.756879+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:55.756879+0000","last_undegraded":"2023-12-08T08:17:55.756879+0000","last_fullsized":"2023-12-08T08:17:55.756879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764805+0000","last_change":"2023-12-08T08:17:57.764805+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764805+0000","last_undegraded":"2023-12-08T08:17:57.764805+0000","last_fullsized":"2023-12-08T08:17:57.764805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777848+0000","last_change":"2023-12-08T08:17:56.791954+0000","last_active":"2023-12-08T08:17:57.777848+0000","last_peered":"2023-12-08T08:17:57.777848+0000","last_clean":"2023-12-08T08:17:57.777848+0000","last_became_active":"2023-12-08T08:17:56.791571+0000","last_became_peered":"2023-12-08T08:17:56.791571+0000","last_unstale":"2023-12-08T08:17:57.777848+0000","last_undegraded":"2023-12-08T08:17:57.777848+0000","last_fullsized":"2023-12-08T08:17:57.777848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760839+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:55.760839+0000","last_peered":"2023-12-08T08:17:55.760839+0000","last_clean":"2023-12-08T08:17:55.760839+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:55.760839+0000","last_undegraded":"2023-12-08T08:17:55.760839+0000","last_fullsized":"2023-12-08T08:17:55.760839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760419+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:55.760419+0000","last_peered":"2023-12-08T08:17:55.760419+0000","last_clean":"2023-12-08T08:17:55.760419+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:55.760419+0000","last_undegraded":"2023-12-08T08:17:55.760419+0000","last_fullsized":"2023-12-08T08:17:55.760419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780184+0000","last_change":"2023-12-08T08:17:57.780184+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780184+0000","last_undegraded":"2023-12-08T08:17:57.780184+0000","last_fullsized":"2023-12-08T08:17:57.780184+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774643+0000","last_change":"2023-12-08T08:17:56.777768+0000","last_active":"2023-12-08T08:17:57.774643+0000","last_peered":"2023-12-08T08:17:57.774643+0000","last_clean":"2023-12-08T08:17:57.774643+0000","last_became_active":"2023-12-08T08:17:56.776405+0000","last_became_peered":"2023-12-08T08:17:56.776405+0000","last_unstale":"2023-12-08T08:17:57.774643+0000","last_undegraded":"2023-12-08T08:17:57.774643+0000","last_fullsized":"2023-12-08T08:17:57.774643+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:36.931349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793911+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:56.793911+0000","last_peered":"2023-12-08T08:17:56.793911+0000","last_clean":"2023-12-08T08:17:56.793911+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:56.793911+0000","last_undegraded":"2023-12-08T08:17:56.793911+0000","last_fullsized":"2023-12-08T08:17:56.793911+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756715+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:55.756715+0000","last_peered":"2023-12-08T08:17:55.756715+0000","last_clean":"2023-12-08T08:17:55.756715+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:55.756715+0000","last_undegraded":"2023-12-08T08:17:55.756715+0000","last_fullsized":"2023-12-08T08:17:55.756715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783189+0000","last_change":"2023-12-08T08:17:57.783189+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783189+0000","last_undegraded":"2023-12-08T08:17:57.783189+0000","last_fullsized":"2023-12-08T08:17:57.783189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:59.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.802501+0000","last_change":"2023-12-08T08:17:56.797511+0000","last_active":"2023-12-08T08:17:56.802501+0000","last_peered":"2023-12-08T08:17:56.802501+0000","last_clean":"2023-12-08T08:17:56.802501+0000","last_became_active":"2023-12-08T08:17:56.796361+0000","last_became_peered":"2023-12-08T08:17:56.796361+0000","last_unstale":"2023-12-08T08:17:56.802501+0000","last_undegraded":"2023-12-08T08:17:56.802501+0000","last_fullsized":"2023-12-08T08:17:56.802501+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:04.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756921+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:55.756921+0000","last_peered":"2023-12-08T08:17:55.756921+0000","last_clean":"2023-12-08T08:17:55.756921+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:55.756921+0000","last_undegraded":"2023-12-08T08:17:55.756921+0000","last_fullsized":"2023-12-08T08:17:55.756921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762232+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:55.762232+0000","last_peered":"2023-12-08T08:17:55.762232+0000","last_clean":"2023-12-08T08:17:55.762232+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:55.762232+0000","last_undegraded":"2023-12-08T08:17:55.762232+0000","last_fullsized":"2023-12-08T08:17:55.762232+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.771347+0000","last_change":"2023-12-08T08:17:57.771347+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.771347+0000","last_undegraded":"2023-12-08T08:17:57.771347+0000","last_fullsized":"2023-12-08T08:17:57.771347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799920+0000","last_change":"2023-12-08T08:17:56.795117+0000","last_active":"2023-12-08T08:17:56.799920+0000","last_peered":"2023-12-08T08:17:56.799920+0000","last_clean":"2023-12-08T08:17:56.799920+0000","last_became_active":"2023-12-08T08:17:56.794822+0000","last_became_peered":"2023-12-08T08:17:56.794822+0000","last_unstale":"2023-12-08T08:17:56.799920+0000","last_undegraded":"2023-12-08T08:17:56.799920+0000","last_fullsized":"2023-12-08T08:17:56.799920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:27.379446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769715+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:56.769715+0000","last_peered":"2023-12-08T08:17:56.769715+0000","last_clean":"2023-12-08T08:17:56.769715+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:56.769715+0000","last_undegraded":"2023-12-08T08:17:56.769715+0000","last_fullsized":"2023-12-08T08:17:56.769715+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:26.299694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762079+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:55.762079+0000","last_peered":"2023-12-08T08:17:55.762079+0000","last_clean":"2023-12-08T08:17:55.762079+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:55.762079+0000","last_undegraded":"2023-12-08T08:17:55.762079+0000","last_fullsized":"2023-12-08T08:17:55.762079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776946+0000","last_change":"2023-12-08T08:17:57.776946+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776946+0000","last_undegraded":"2023-12-08T08:17:57.776946+0000","last_fullsized":"2023-12-08T08:17:57.776946+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:51.673242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776553+0000","last_change":"2023-12-08T08:17:56.768920+0000","last_active":"2023-12-08T08:17:56.776553+0000","last_peered":"2023-12-08T08:17:56.776553+0000","last_clean":"2023-12-08T08:17:56.776553+0000","last_became_active":"2023-12-08T08:17:56.768205+0000","last_became_peered":"2023-12-08T08:17:56.768205+0000","last_unstale":"2023-12-08T08:17:56.776553+0000","last_undegraded":"2023-12-08T08:17:56.776553+0000","last_fullsized":"2023-12-08T08:17:56.776553+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:00.933681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761805+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:55.761805+0000","last_peered":"2023-12-08T08:17:55.761805+0000","last_clean":"2023-12-08T08:17:55.761805+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:55.761805+0000","last_undegraded":"2023-12-08T08:17:55.761805+0000","last_fullsized":"2023-12-08T08:17:55.761805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757709+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:55.757709+0000","last_peered":"2023-12-08T08:17:55.757709+0000","last_clean":"2023-12-08T08:17:55.757709+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:55.757709+0000","last_undegraded":"2023-12-08T08:17:55.757709+0000","last_fullsized":"2023-12-08T08:17:55.757709+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763142+0000","last_change":"2023-12-08T08:17:57.763142+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763142+0000","last_undegraded":"2023-12-08T08:17:57.763142+0000","last_fullsized":"2023-12-08T08:17:57.763142+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:59.675754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782767+0000","last_change":"2023-12-08T08:17:56.779410+0000","last_active":"2023-12-08T08:17:56.782767+0000","last_peered":"2023-12-08T08:17:56.782767+0000","last_clean":"2023-12-08T08:17:56.782767+0000","last_became_active":"2023-12-08T08:17:56.779079+0000","last_became_peered":"2023-12-08T08:17:56.779079+0000","last_unstale":"2023-12-08T08:17:56.782767+0000","last_undegraded":"2023-12-08T08:17:56.782767+0000","last_fullsized":"2023-12-08T08:17:56.782767+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:03.830927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795160+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:56.795160+0000","last_peered":"2023-12-08T08:17:56.795160+0000","last_clean":"2023-12-08T08:17:56.795160+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:56.795160+0000","last_undegraded":"2023-12-08T08:17:56.795160+0000","last_fullsized":"2023-12-08T08:17:56.795160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754636+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:56.754636+0000","last_peered":"2023-12-08T08:17:56.754636+0000","last_clean":"2023-12-08T08:17:56.754636+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:56.754636+0000","last_undegraded":"2023-12-08T08:17:56.754636+0000","last_fullsized":"2023-12-08T08:17:56.754636+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778064+0000","last_change":"2023-12-08T08:17:57.778064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778064+0000","last_undegraded":"2023-12-08T08:17:57.778064+0000","last_fullsized":"2023-12-08T08:17:57.778064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:11:16.845352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767289+0000","last_change":"2023-12-08T08:17:56.791471+0000","last_active":"2023-12-08T08:17:57.767289+0000","last_peered":"2023-12-08T08:17:57.767289+0000","last_clean":"2023-12-08T08:17:57.767289+0000","last_became_active":"2023-12-08T08:17:56.791079+0000","last_became_peered":"2023-12-08T08:17:56.791079+0000","last_unstale":"2023-12-08T08:17:57.767289+0000","last_undegraded":"2023-12-08T08:17:57.767289+0000","last_fullsized":"2023-12-08T08:17:57.767289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:22.747918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793570+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:56.793570+0000","last_peered":"2023-12-08T08:17:56.793570+0000","last_clean":"2023-12-08T08:17:56.793570+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:56.793570+0000","last_undegraded":"2023-12-08T08:17:56.793570+0000","last_fullsized":"2023-12-08T08:17:56.793570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753050+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:55.753050+0000","last_peered":"2023-12-08T08:17:55.753050+0000","last_clean":"2023-12-08T08:17:55.753050+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:55.753050+0000","last_undegraded":"2023-12-08T08:17:55.753050+0000","last_fullsized":"2023-12-08T08:17:55.753050+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.805299+0000","last_change":"2023-12-08T08:17:57.797287+0000","last_active":"2023-12-08T08:17:57.805299+0000","last_peered":"2023-12-08T08:17:57.805299+0000","last_clean":"2023-12-08T08:17:57.805299+0000","last_became_active":"2023-12-08T08:17:57.796961+0000","last_became_peered":"2023-12-08T08:17:57.796961+0000","last_unstale":"2023-12-08T08:17:57.805299+0000","last_undegraded":"2023-12-08T08:17:57.805299+0000","last_fullsized":"2023-12-08T08:17:57.805299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:16:05.130558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780644+0000","last_change":"2023-12-08T08:17:56.772809+0000","last_active":"2023-12-08T08:17:57.780644+0000","last_peered":"2023-12-08T08:17:57.780644+0000","last_clean":"2023-12-08T08:17:57.780644+0000","last_became_active":"2023-12-08T08:17:56.772556+0000","last_became_peered":"2023-12-08T08:17:56.772556+0000","last_unstale":"2023-12-08T08:17:57.780644+0000","last_undegraded":"2023-12-08T08:17:57.780644+0000","last_fullsized":"2023-12-08T08:17:57.780644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:48:41.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784572+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:56.784572+0000","last_peered":"2023-12-08T08:17:56.784572+0000","last_clean":"2023-12-08T08:17:56.784572+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:56.784572+0000","last_undegraded":"2023-12-08T08:17:56.784572+0000","last_fullsized":"2023-12-08T08:17:56.784572+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772623+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:56.772623+0000","last_peered":"2023-12-08T08:17:56.772623+0000","last_clean":"2023-12-08T08:17:56.772623+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:56.772623+0000","last_undegraded":"2023-12-08T08:17:56.772623+0000","last_fullsized":"2023-12-08T08:17:56.772623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763212+0000","last_change":"2023-12-08T08:17:57.763212+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763212+0000","last_undegraded":"2023-12-08T08:17:57.763212+0000","last_fullsized":"2023-12-08T08:17:57.763212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767960+0000","last_change":"2023-12-08T08:17:56.798843+0000","last_active":"2023-12-08T08:17:57.767960+0000","last_peered":"2023-12-08T08:17:57.767960+0000","last_clean":"2023-12-08T08:17:57.767960+0000","last_became_active":"2023-12-08T08:17:56.798505+0000","last_became_peered":"2023-12-08T08:17:56.798505+0000","last_unstale":"2023-12-08T08:17:57.767960+0000","last_undegraded":"2023-12-08T08:17:57.767960+0000","last_fullsized":"2023-12-08T08:17:57.767960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753650+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:56.753650+0000","last_peered":"2023-12-08T08:17:56.753650+0000","last_clean":"2023-12-08T08:17:56.753650+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:56.753650+0000","last_undegraded":"2023-12-08T08:17:56.753650+0000","last_fullsized":"2023-12-08T08:17:56.753650+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:02.769189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771534+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:56.771534+0000","last_peered":"2023-12-08T08:17:56.771534+0000","last_clean":"2023-12-08T08:17:56.771534+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:56.771534+0000","last_undegraded":"2023-12-08T08:17:56.771534+0000","last_fullsized":"2023-12-08T08:17:56.771534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763193+0000","last_change":"2023-12-08T08:17:57.763193+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763193+0000","last_undegraded":"2023-12-08T08:17:57.763193+0000","last_fullsized":"2023-12-08T08:17:57.763193+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760454+0000","last_change":"2023-12-08T08:17:56.780631+0000","last_active":"2023-12-08T08:17:57.760454+0000","last_peered":"2023-12-08T08:17:57.760454+0000","last_clean":"2023-12-08T08:17:57.760454+0000","last_became_active":"2023-12-08T08:17:56.780250+0000","last_became_peered":"2023-12-08T08:17:56.780250+0000","last_unstale":"2023-12-08T08:17:57.760454+0000","last_undegraded":"2023-12-08T08:17:57.760454+0000","last_fullsized":"2023-12-08T08:17:57.760454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:36:12.440569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.768685+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:56.768685+0000","last_peered":"2023-12-08T08:17:56.768685+0000","last_clean":"2023-12-08T08:17:56.768685+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:56.768685+0000","last_undegraded":"2023-12-08T08:17:56.768685+0000","last_fullsized":"2023-12-08T08:17:56.768685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:50.672771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753821+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:56.753821+0000","last_peered":"2023-12-08T08:17:56.753821+0000","last_clean":"2023-12-08T08:17:56.753821+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:56.753821+0000","last_undegraded":"2023-12-08T08:17:56.753821+0000","last_fullsized":"2023-12-08T08:17:56.753821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.774154+0000","last_change":"2023-12-08T08:17:56.774154+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.774154+0000","last_undegraded":"2023-12-08T08:17:56.774154+0000","last_fullsized":"2023-12-08T08:17:56.774154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786813+0000","last_change":"2023-12-08T08:17:56.792036+0000","last_active":"2023-12-08T08:17:57.786813+0000","last_peered":"2023-12-08T08:17:57.786813+0000","last_clean":"2023-12-08T08:17:57.786813+0000","last_became_active":"2023-12-08T08:17:56.791709+0000","last_became_peered":"2023-12-08T08:17:56.791709+0000","last_unstale":"2023-12-08T08:17:57.786813+0000","last_undegraded":"2023-12-08T08:17:57.786813+0000","last_fullsized":"2023-12-08T08:17:57.786813+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794039+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:56.794039+0000","last_peered":"2023-12-08T08:17:56.794039+0000","last_clean":"2023-12-08T08:17:56.794039+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:56.794039+0000","last_undegraded":"2023-12-08T08:17:56.794039+0000","last_fullsized":"2023-12-08T08:17:56.794039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771104+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:56.771104+0000","last_peered":"2023-12-08T08:17:56.771104+0000","last_clean":"2023-12-08T08:17:56.771104+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:56.771104+0000","last_undegraded":"2023-12-08T08:17:56.771104+0000","last_fullsized":"2023-12-08T08:17:56.771104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779411+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:56.779411+0000","last_peered":"2023-12-08T08:17:56.779411+0000","last_clean":"2023-12-08T08:17:56.779411+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:56.779411+0000","last_undegraded":"2023-12-08T08:17:56.779411+0000","last_fullsized":"2023-12-08T08:17:56.779411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":939182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.58599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3600000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.0800000000000001},"min":{"1min":0.73999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.153,"15min":1.159},"min":{"1min":0.71099999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.159},{"interface":"front","average":{"1min":1.131,"5min":1.224,"15min":1.24},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.397}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.175,"15min":1.177},"min":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.474,"5min":1.863,"15min":1.863},"last":1.042},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.325,"15min":1.333},"min":{"1min":0.86199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.6040000000000001,"5min":1.855,"15min":1.855},"last":1.361},{"interface":"front","average":{"1min":1.321,"5min":1.405,"15min":1.419},"min":{"1min":0.92900000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.671,"5min":3.524,"15min":3.524},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.393,"15min":1.407},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.702,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3600000000000001,"15min":1.353},"min":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.754,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":0.98799999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.9239999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.508,"15min":1.504},"min":{"1min":0.91500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0009999999999999,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.6419999999999999,"15min":1.6559999999999999},"min":{"1min":0.99299999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9019999999999999,"5min":2.609,"15min":2.609},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":1.01,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.101,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.75,"15min":1.857},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4770000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.845,"15min":1.978},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.365,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.131,"15min":1.111},"min":{"1min":0.95099999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4830000000000001,"5min":1.762,"15min":1.762},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2250000000000001,"15min":1.2370000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5229999999999999,"5min":2.141,"15min":2.141},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5680000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3959999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.397,"15min":1.425},"min":{"1min":0.77800000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5600000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8640000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.048}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.341,"15min":1.349},"min":{"1min":0.98199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.401,"15min":1.4139999999999999},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6759999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.327}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.484,"15min":1.4990000000000001},"min":{"1min":1.089,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.972,"5min":2.96,"15min":2.96},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.208,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7809999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.478,"15min":1.484},"min":{"1min":1.2270000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7410000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.238},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.595,"15min":1.6140000000000001},"min":{"1min":1.0600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0760000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.266}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.5369999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.208}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.337},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4750000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3759999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.3049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":351145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.427},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.286}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.478},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.125}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.381}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.577},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.639}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.95599999999999996,"15min":0.96599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.03,"15min":1.044},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5459999999999998,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.99299999999999999,"15min":0.99199999999999999},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.53300000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.835,"5min":1.97,"15min":1.97},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.84399999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.24},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3420000000000001,"15min":1.363},"min":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.458,"15min":1.494},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0209999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.3819999999999999,"15min":1.383},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4279999999999999,"15min":1.4430000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9550000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5569999999999999,"15min":1.5840000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1930000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.478,"15min":1.49},"min":{"1min":0.94199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.476,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.5960000000000001,"15min":1.6180000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.2330000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.2270000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.431}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":1.496}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.5780000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.131}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":2.121},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.337},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":2.1859999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.544},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4690000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":351909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.88},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.306,"5min":1.585,"15min":1.585},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.97399999999999998,"15min":0.98399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.877,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.329,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5429999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.55000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.764,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.1259999999999999,"15min":1.1399999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1669999999999998,"5min":2.327,"15min":2.327},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6559999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.117},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.464,"15min":1.504},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.5089999999999999,"5min":2.552,"15min":2.552},"last":1.069}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.4670000000000001,"15min":1.5009999999999999},"min":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3900000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.202},{"interface":"front","average":{"1min":1.236,"5min":1.425,"15min":1.4570000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6220000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.042}]},{"osd":6,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.581,"15min":1.609},"min":{"1min":0.76000000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2989999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.546,"15min":1.5800000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.843,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.571,"15min":1.601},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.016,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.675,"15min":1.6850000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.3460000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1351680,"data_stored":938406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.4490000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.329},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.292}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:02.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.563+0000 7fe21914e640 1 Processor -- start 2023-12-08T08:18:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.563+0000 7fe21914e640 1 -- start start 2023-12-08T08:18:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21914e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe2140c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21914e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe214155850 con 0x7fe2141521b0 2023-12-08T08:18:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21914e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2140c0890 con 0x7fe2140c1dc0 2023-12-08T08:18:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21914e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140c0b70 con 0x7fe2140a7910 2023-12-08T08:18:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21894d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe2141521b0 0x7fe214155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41922/0 (socket says 172.21.15.45:41922) 2023-12-08T08:18:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe21894d640 1 -- 172.21.15.45:0/4120133682 learned_addr learned my addr 172.21.15.45:0/4120133682 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.565+0000 7fe213fff640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe2140c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429320581 0 0) 0x7fe214155850 con 0x7fe2141521b0 2023-12-08T08:18:02.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc003520 con 0x7fe2141521b0 2023-12-08T08:18:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866477519 0 0) 0x7fe1fc003520 con 0x7fe2141521b0 2023-12-08T08:18:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 msgr2=0x7fe2140c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe2140c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 >> v1:172.21.15.114:6789/0 conn(0x7fe2140c1dc0 legacy=0x7fe21414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140c0e50 con 0x7fe2141521b0 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe20c0019f0 con 0x7fe2141521b0 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 >> v1:172.21.15.45:6789/0 conn(0x7fe2141521b0 legacy=0x7fe214155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe1fc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1fc003f20 0x7fe1fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc004d00 0x7fe1fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140c0b70 con 0x7fe1fc003f20 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc00bb10 con 0x7fe1fc004d00 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.566+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc00bcd0 con 0x7fe2140a7910 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1fc003f20 0x7fe1fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe21894d640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc004d00 0x7fe1fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe213fff640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe1fc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 -- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 msgr2=0x7fe1fc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2140a7910 0x7fe1fc0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 -- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc004d00 msgr2=0x7fe1fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc004d00 0x7fe1fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.567+0000 7fe2137fe640 1 -- 172.21.15.45:0/4120133682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc003520 con 0x7fe1fc003f20 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.568+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1fc003f20 0x7fe1fc0047c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe208001720 tx=0x7fe1fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426fe0557423a250 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080052d0 con 0x7fe1fc003f20 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20802e050 con 0x7fe1fc003f20 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe212ffd640 1 -- 172.21.15.45:0/4120133682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080035f0 con 0x7fe1fc003f20 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe21914e640 1 -- 172.21.15.45:0/4120133682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1fc003f20 msgr2=0x7fe1fc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe21914e640 1 --2- 172.21.15.45:0/4120133682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1fc003f20 0x7fe1fc0047c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe208001720 tx=0x7fe1fc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe21894d640 1 -- 172.21.15.45:0/4120133682 reap_dead start 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe21914e640 1 -- 172.21.15.45:0/4120133682 shutdown_connections 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.569+0000 7fe21914e640 1 -- 172.21.15.45:0/4120133682 >> 172.21.15.45:0/4120133682 conn(0x7fe2140c5780 msgr2=0x7fe2140c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.570+0000 7fe21914e640 1 -- 172.21.15.45:0/4120133682 shutdown_connections 2023-12-08T08:18:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.570+0000 7fe21914e640 1 -- 172.21.15.45:0/4120133682 wait complete. 2023-12-08T08:18:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.571+0000 7fe21914e640 1 Processor -- start 2023-12-08T08:18:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.572+0000 7fe21914e640 1 -- start start 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.572+0000 7fe21914e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc003f20 0x7fe2141ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21914e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21914e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2141de170 0x7fe2141de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21914e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141db230 con 0x7fe2140c4fc0 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21914e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141dad00 con 0x7fe1fc003f20 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21914e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2141dda40 con 0x7fe2141de170 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40768/0 (socket says 172.21.15.45:40768) 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 -- 172.21.15.45:0/4166416227 learned_addr learned my addr 172.21.15.45:0/4166416227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe213fff640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc003f20 0x7fe2141ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe21894d640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2141de170 0x7fe2141de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 -- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2141de170 msgr2=0x7fe2141de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2141de170 0x7fe2141de620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 -- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc003f20 msgr2=0x7fe2141ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc003f20 0x7fe2141ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.573+0000 7fe2137fe640 1 -- 172.21.15.45:0/4166416227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2141ea7e0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe2137fe640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe20802bbe0 tx=0x7fe208001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2080076c0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208007a30 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2141daf50 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208006be0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.574+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2141eaa80 con 0x7fe2140c4fc0 2023-12-08T08:18:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.575+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2141edac0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.577+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe208006d40 con 0x7fe2140c4fc0 2023-12-08T08:18:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.577+0000 7fe210ff9640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 0x7fe20006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.578+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe2080ab7a0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.578+0000 7fe213fff640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 0x7fe20006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.579+0000 7fe213fff640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 0x7fe20006d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2140a97b0 tx=0x7fe204008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.582+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2080764f0 con 0x7fe2140c4fc0 2023-12-08T08:18:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.771+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2140aad90 con 0x7fe20006ae70 2023-12-08T08:18:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.813+0000 7fe210ff9640 1 -- 172.21.15.45:0/4166416227 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522813 (secure 0 0 0) 0x7fe2140aad90 con 0x7fe20006ae70 2023-12-08T08:18:02.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:02.828 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 msgr2=0x7fe20006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 0x7fe20006d330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2140a97b0 tx=0x7fe204008040 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 msgr2=0x7fe2141df970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe20802bbe0 tx=0x7fe208001120 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 shutdown_connections 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe20006ae70 0x7fe20006d330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe2141de170 0x7fe2141de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2140c4fc0 0x7fe2141df970 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 --2- 172.21.15.45:0/4166416227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1fc003f20 0x7fe2141ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 >> 172.21.15.45:0/4166416227 conn(0x7fe2140c5780 msgr2=0x7fe2140ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 shutdown_connections 2023-12-08T08:18:02.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:02.827+0000 7fe21914e640 1 -- 172.21.15.45:0/4166416227 wait complete. 2023-12-08T08:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-12-08T08:18:01.762947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":7315456,"data_stored":3972850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002350"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764361+0000","last_change":"2023-12-08T08:17:57.764361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764361+0000","last_undegraded":"2023-12-08T08:17:57.764361+0000","last_fullsized":"2023-12-08T08:17:57.764361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754978+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:56.754978+0000","last_peered":"2023-12-08T08:17:56.754978+0000","last_clean":"2023-12-08T08:17:56.754978+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:56.754978+0000","last_undegraded":"2023-12-08T08:17:56.754978+0000","last_fullsized":"2023-12-08T08:17:56.754978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:50.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.762419+0000","last_change":"2023-12-08T08:17:57.762419+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.762419+0000","last_undegraded":"2023-12-08T08:17:57.762419+0000","last_fullsized":"2023-12-08T08:17:57.762419+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:16.621830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754008+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:56.754008+0000","last_peered":"2023-12-08T08:17:56.754008+0000","last_clean":"2023-12-08T08:17:56.754008+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:56.754008+0000","last_undegraded":"2023-12-08T08:17:56.754008+0000","last_fullsized":"2023-12-08T08:17:56.754008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:09.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760293+0000","last_change":"2023-12-08T08:17:57.760293+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760293+0000","last_undegraded":"2023-12-08T08:17:57.760293+0000","last_fullsized":"2023-12-08T08:17:57.760293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:41.599819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753415+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:55.753415+0000","last_peered":"2023-12-08T08:17:55.753415+0000","last_clean":"2023-12-08T08:17:55.753415+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:55.753415+0000","last_undegraded":"2023-12-08T08:17:55.753415+0000","last_fullsized":"2023-12-08T08:17:55.753415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.786345+0000","last_change":"2023-12-08T08:17:57.786345+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.786345+0000","last_undegraded":"2023-12-08T08:17:57.786345+0000","last_fullsized":"2023-12-08T08:17:57.786345+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.785598+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:56.785598+0000","last_peered":"2023-12-08T08:17:56.785598+0000","last_clean":"2023-12-08T08:17:56.785598+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:56.785598+0000","last_undegraded":"2023-12-08T08:17:56.785598+0000","last_fullsized":"2023-12-08T08:17:56.785598+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.800058+0000","last_change":"2023-12-08T08:17:57.779371+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.800058+0000","last_undegraded":"2023-12-08T08:17:57.800058+0000","last_fullsized":"2023-12-08T08:17:57.800058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:07.224031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793991+0000","last_change":"2023-12-08T08:17:47.863838+0000","last_active":"2023-12-08T08:17:56.793991+0000","last_peered":"2023-12-08T08:17:56.793991+0000","last_clean":"2023-12-08T08:17:56.793991+0000","last_became_active":"2023-12-08T08:17:47.863177+0000","last_became_peered":"2023-12-08T08:17:47.863177+0000","last_unstale":"2023-12-08T08:17:56.793991+0000","last_undegraded":"2023-12-08T08:17:56.793991+0000","last_fullsized":"2023-12-08T08:17:56.793991+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:35.681140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.762215+0000","last_change":"2023-12-08T08:17:56.762215+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.762215+0000","last_undegraded":"2023-12-08T08:17:56.762215+0000","last_fullsized":"2023-12-08T08:17:56.762215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.770900+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:56.770900+0000","last_peered":"2023-12-08T08:17:56.770900+0000","last_clean":"2023-12-08T08:17:56.770900+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:56.770900+0000","last_undegraded":"2023-12-08T08:17:56.770900+0000","last_fullsized":"2023-12-08T08:17:56.770900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.770685+0000","last_change":"2023-12-08T08:17:56.770685+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.770685+0000","last_undegraded":"2023-12-08T08:17:56.770685+0000","last_fullsized":"2023-12-08T08:17:56.770685+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.762274+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:56.762274+0000","last_peered":"2023-12-08T08:17:56.762274+0000","last_clean":"2023-12-08T08:17:56.762274+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:56.762274+0000","last_undegraded":"2023-12-08T08:17:56.762274+0000","last_fullsized":"2023-12-08T08:17:56.762274+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:26.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767249+0000","last_change":"2023-12-08T08:17:56.767249+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767249+0000","last_undegraded":"2023-12-08T08:17:56.767249+0000","last_fullsized":"2023-12-08T08:17:56.767249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758841+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:55.758841+0000","last_peered":"2023-12-08T08:17:55.758841+0000","last_clean":"2023-12-08T08:17:55.758841+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:55.758841+0000","last_undegraded":"2023-12-08T08:17:55.758841+0000","last_fullsized":"2023-12-08T08:17:55.758841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:43.683652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780942+0000","last_change":"2023-12-08T08:17:57.780942+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780942+0000","last_undegraded":"2023-12-08T08:17:57.780942+0000","last_fullsized":"2023-12-08T08:17:57.780942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:13.633709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756676+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:55.756676+0000","last_peered":"2023-12-08T08:17:55.756676+0000","last_clean":"2023-12-08T08:17:55.756676+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:55.756676+0000","last_undegraded":"2023-12-08T08:17:55.756676+0000","last_fullsized":"2023-12-08T08:17:55.756676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779115+0000","last_change":"2023-12-08T08:17:57.779115+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779115+0000","last_undegraded":"2023-12-08T08:17:57.779115+0000","last_fullsized":"2023-12-08T08:17:57.779115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774612+0000","last_change":"2023-12-08T08:17:48.251716+0000","last_active":"2023-12-08T08:17:56.774612+0000","last_peered":"2023-12-08T08:17:56.774612+0000","last_clean":"2023-12-08T08:17:56.774612+0000","last_became_active":"2023-12-08T08:17:48.250928+0000","last_became_peered":"2023-12-08T08:17:48.250928+0000","last_unstale":"2023-12-08T08:17:56.774612+0000","last_undegraded":"2023-12-08T08:17:56.774612+0000","last_fullsized":"2023-12-08T08:17:56.774612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763848+0000","last_change":"2023-12-08T08:17:57.763848+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763848+0000","last_undegraded":"2023-12-08T08:17:57.763848+0000","last_fullsized":"2023-12-08T08:17:57.763848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:36.597031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784305+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:56.784305+0000","last_peered":"2023-12-08T08:17:56.784305+0000","last_clean":"2023-12-08T08:17:56.784305+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:56.784305+0000","last_undegraded":"2023-12-08T08:17:56.784305+0000","last_fullsized":"2023-12-08T08:17:56.784305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779114+0000","last_change":"2023-12-08T08:17:57.779114+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779114+0000","last_undegraded":"2023-12-08T08:17:57.779114+0000","last_fullsized":"2023-12-08T08:17:57.779114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759000+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:55.759000+0000","last_peered":"2023-12-08T08:17:55.759000+0000","last_clean":"2023-12-08T08:17:55.759000+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:55.759000+0000","last_undegraded":"2023-12-08T08:17:55.759000+0000","last_fullsized":"2023-12-08T08:17:55.759000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.765929+0000","last_change":"2023-12-08T08:17:56.765929+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.765929+0000","last_undegraded":"2023-12-08T08:17:56.765929+0000","last_fullsized":"2023-12-08T08:17:56.765929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761411+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:55.761411+0000","last_peered":"2023-12-08T08:17:55.761411+0000","last_clean":"2023-12-08T08:17:55.761411+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:55.761411+0000","last_undegraded":"2023-12-08T08:17:55.761411+0000","last_fullsized":"2023-12-08T08:17:55.761411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:38.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.761100+0000","last_change":"2023-12-08T08:17:56.761100+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.761100+0000","last_undegraded":"2023-12-08T08:17:56.761100+0000","last_fullsized":"2023-12-08T08:17:56.761100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752722+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:55.752722+0000","last_peered":"2023-12-08T08:17:55.752722+0000","last_clean":"2023-12-08T08:17:55.752722+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:55.752722+0000","last_undegraded":"2023-12-08T08:17:55.752722+0000","last_fullsized":"2023-12-08T08:17:55.752722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779324+0000","last_change":"2023-12-08T08:17:57.779324+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779324+0000","last_undegraded":"2023-12-08T08:17:57.779324+0000","last_fullsized":"2023-12-08T08:17:57.779324+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:36.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780196+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:56.780196+0000","last_peered":"2023-12-08T08:17:56.780196+0000","last_clean":"2023-12-08T08:17:56.780196+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:56.780196+0000","last_undegraded":"2023-12-08T08:17:56.780196+0000","last_fullsized":"2023-12-08T08:17:56.780196+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:07.769792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.763333+0000","last_change":"2023-12-08T08:17:56.763333+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.763333+0000","last_undegraded":"2023-12-08T08:17:56.763333+0000","last_fullsized":"2023-12-08T08:17:56.763333+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765778+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:56.765778+0000","last_peered":"2023-12-08T08:17:56.765778+0000","last_clean":"2023-12-08T08:17:56.765778+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:56.765778+0000","last_undegraded":"2023-12-08T08:17:56.765778+0000","last_fullsized":"2023-12-08T08:17:56.765778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:48.031268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776869+0000","last_change":"2023-12-08T08:17:57.776869+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776869+0000","last_undegraded":"2023-12-08T08:17:57.776869+0000","last_fullsized":"2023-12-08T08:17:57.776869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:22.724525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755071+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:56.755071+0000","last_peered":"2023-12-08T08:17:56.755071+0000","last_clean":"2023-12-08T08:17:56.755071+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:56.755071+0000","last_undegraded":"2023-12-08T08:17:56.755071+0000","last_fullsized":"2023-12-08T08:17:56.755071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:53.659318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775535+0000","last_change":"2023-12-08T08:17:57.775535+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775535+0000","last_undegraded":"2023-12-08T08:17:57.775535+0000","last_fullsized":"2023-12-08T08:17:57.775535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784584+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:56.784584+0000","last_peered":"2023-12-08T08:17:56.784584+0000","last_clean":"2023-12-08T08:17:56.784584+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:56.784584+0000","last_undegraded":"2023-12-08T08:17:56.784584+0000","last_fullsized":"2023-12-08T08:17:56.784584+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778888+0000","last_change":"2023-12-08T08:17:57.778888+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778888+0000","last_undegraded":"2023-12-08T08:17:57.778888+0000","last_fullsized":"2023-12-08T08:17:57.778888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:24.195559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795162+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:56.795162+0000","last_peered":"2023-12-08T08:17:56.795162+0000","last_clean":"2023-12-08T08:17:56.795162+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:56.795162+0000","last_undegraded":"2023-12-08T08:17:56.795162+0000","last_fullsized":"2023-12-08T08:17:56.795162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760361+0000","last_change":"2023-12-08T08:17:57.760361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760361+0000","last_undegraded":"2023-12-08T08:17:57.760361+0000","last_fullsized":"2023-12-08T08:17:57.760361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:41.070452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773011+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:56.773011+0000","last_peered":"2023-12-08T08:17:56.773011+0000","last_clean":"2023-12-08T08:17:56.773011+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:56.773011+0000","last_undegraded":"2023-12-08T08:17:56.773011+0000","last_fullsized":"2023-12-08T08:17:56.773011+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790074+0000","last_change":"2023-12-08T08:17:57.790074+0000","last_active":"2023-12-08T08:17:57.790074+0000","last_peered":"2023-12-08T08:17:57.790074+0000","last_clean":"2023-12-08T08:17:57.790074+0000","last_became_active":"2023-12-08T08:17:57.789798+0000","last_became_peered":"2023-12-08T08:17:57.789798+0000","last_unstale":"2023-12-08T08:17:57.790074+0000","last_undegraded":"2023-12-08T08:17:57.790074+0000","last_fullsized":"2023-12-08T08:17:57.790074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759411+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:55.759411+0000","last_peered":"2023-12-08T08:17:55.759411+0000","last_clean":"2023-12-08T08:17:55.759411+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:55.759411+0000","last_undegraded":"2023-12-08T08:17:55.759411+0000","last_fullsized":"2023-12-08T08:17:55.759411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765064+0000","last_change":"2023-12-08T08:17:57.765064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765064+0000","last_undegraded":"2023-12-08T08:17:57.765064+0000","last_fullsized":"2023-12-08T08:17:57.765064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:24.223268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772444+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:56.772444+0000","last_peered":"2023-12-08T08:17:56.772444+0000","last_clean":"2023-12-08T08:17:56.772444+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:56.772444+0000","last_undegraded":"2023-12-08T08:17:56.772444+0000","last_fullsized":"2023-12-08T08:17:56.772444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:45.955555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777534+0000","last_change":"2023-12-08T08:17:57.777534+0000","last_active":"2023-12-08T08:17:57.777534+0000","last_peered":"2023-12-08T08:17:57.777534+0000","last_clean":"2023-12-08T08:17:57.777534+0000","last_became_active":"2023-12-08T08:17:57.777268+0000","last_became_peered":"2023-12-08T08:17:57.777268+0000","last_unstale":"2023-12-08T08:17:57.777534+0000","last_undegraded":"2023-12-08T08:17:57.777534+0000","last_fullsized":"2023-12-08T08:17:57.777534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:04.336513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771357+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:56.771357+0000","last_peered":"2023-12-08T08:17:56.771357+0000","last_clean":"2023-12-08T08:17:56.771357+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:56.771357+0000","last_undegraded":"2023-12-08T08:17:56.771357+0000","last_fullsized":"2023-12-08T08:17:56.771357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:27.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.803290+0000","last_change":"2023-12-08T08:17:57.803290+0000","last_active":"2023-12-08T08:17:57.803290+0000","last_peered":"2023-12-08T08:17:57.803290+0000","last_clean":"2023-12-08T08:17:57.803290+0000","last_became_active":"2023-12-08T08:17:57.802999+0000","last_became_peered":"2023-12-08T08:17:57.802999+0000","last_unstale":"2023-12-08T08:17:57.803290+0000","last_undegraded":"2023-12-08T08:17:57.803290+0000","last_fullsized":"2023-12-08T08:17:57.803290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:01:45.610748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779207+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:56.779207+0000","last_peered":"2023-12-08T08:17:56.779207+0000","last_clean":"2023-12-08T08:17:56.779207+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:56.779207+0000","last_undegraded":"2023-12-08T08:17:56.779207+0000","last_fullsized":"2023-12-08T08:17:56.779207+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775244+0000","last_change":"2023-12-08T08:17:57.775244+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775244+0000","last_undegraded":"2023-12-08T08:17:57.775244+0000","last_fullsized":"2023-12-08T08:17:57.775244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:15.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762344+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:55.762344+0000","last_peered":"2023-12-08T08:17:55.762344+0000","last_clean":"2023-12-08T08:17:55.762344+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:55.762344+0000","last_undegraded":"2023-12-08T08:17:55.762344+0000","last_fullsized":"2023-12-08T08:17:55.762344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777744+0000","last_change":"2023-12-08T08:17:57.777744+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777744+0000","last_undegraded":"2023-12-08T08:17:57.777744+0000","last_fullsized":"2023-12-08T08:17:57.777744+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761646+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:55.761646+0000","last_peered":"2023-12-08T08:17:55.761646+0000","last_clean":"2023-12-08T08:17:55.761646+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:55.761646+0000","last_undegraded":"2023-12-08T08:17:55.761646+0000","last_fullsized":"2023-12-08T08:17:55.761646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767468+0000","last_change":"2023-12-08T08:17:56.767468+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767468+0000","last_undegraded":"2023-12-08T08:17:56.767468+0000","last_fullsized":"2023-12-08T08:17:56.767468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784391+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:56.784391+0000","last_peered":"2023-12-08T08:17:56.784391+0000","last_clean":"2023-12-08T08:17:56.784391+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:56.784391+0000","last_undegraded":"2023-12-08T08:17:56.784391+0000","last_fullsized":"2023-12-08T08:17:56.784391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777837+0000","last_change":"2023-12-08T08:17:57.777837+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777837+0000","last_undegraded":"2023-12-08T08:17:57.777837+0000","last_fullsized":"2023-12-08T08:17:57.777837+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754291+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:56.754291+0000","last_peered":"2023-12-08T08:17:56.754291+0000","last_clean":"2023-12-08T08:17:56.754291+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:56.754291+0000","last_undegraded":"2023-12-08T08:17:56.754291+0000","last_fullsized":"2023-12-08T08:17:56.754291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:11:24.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.771678+0000","last_change":"2023-12-08T08:17:56.771678+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.771678+0000","last_undegraded":"2023-12-08T08:17:56.771678+0000","last_fullsized":"2023-12-08T08:17:56.771678+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752706+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:55.752706+0000","last_peered":"2023-12-08T08:17:55.752706+0000","last_clean":"2023-12-08T08:17:55.752706+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:55.752706+0000","last_undegraded":"2023-12-08T08:17:55.752706+0000","last_fullsized":"2023-12-08T08:17:55.752706+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760042+0000","last_change":"2023-12-08T08:17:57.760042+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760042+0000","last_undegraded":"2023-12-08T08:17:57.760042+0000","last_fullsized":"2023-12-08T08:17:57.760042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:58.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760113+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:55.760113+0000","last_peered":"2023-12-08T08:17:55.760113+0000","last_clean":"2023-12-08T08:17:55.760113+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:55.760113+0000","last_undegraded":"2023-12-08T08:17:55.760113+0000","last_fullsized":"2023-12-08T08:17:55.760113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.782317+0000","last_change":"2023-12-08T08:17:57.782317+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.782317+0000","last_undegraded":"2023-12-08T08:17:57.782317+0000","last_fullsized":"2023-12-08T08:17:57.782317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784456+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:56.784456+0000","last_peered":"2023-12-08T08:17:56.784456+0000","last_clean":"2023-12-08T08:17:56.784456+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:56.784456+0000","last_undegraded":"2023-12-08T08:17:56.784456+0000","last_fullsized":"2023-12-08T08:17:56.784456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.760566+0000","last_change":"2023-12-08T08:17:56.760566+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.760566+0000","last_undegraded":"2023-12-08T08:17:56.760566+0000","last_fullsized":"2023-12-08T08:17:56.760566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769710+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:56.769710+0000","last_peered":"2023-12-08T08:17:56.769710+0000","last_clean":"2023-12-08T08:17:56.769710+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:56.769710+0000","last_undegraded":"2023-12-08T08:17:56.769710+0000","last_fullsized":"2023-12-08T08:17:56.769710+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783622+0000","last_change":"2023-12-08T08:17:57.783622+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783622+0000","last_undegraded":"2023-12-08T08:17:57.783622+0000","last_fullsized":"2023-12-08T08:17:57.783622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:31.796515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799963+0000","last_change":"2023-12-08T08:17:56.795327+0000","last_active":"2023-12-08T08:17:56.799963+0000","last_peered":"2023-12-08T08:17:56.799963+0000","last_clean":"2023-12-08T08:17:56.799963+0000","last_became_active":"2023-12-08T08:17:56.795056+0000","last_became_peered":"2023-12-08T08:17:56.795056+0000","last_unstale":"2023-12-08T08:17:56.799963+0000","last_undegraded":"2023-12-08T08:17:56.799963+0000","last_fullsized":"2023-12-08T08:17:56.799963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:25.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.796743+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:56.796743+0000","last_peered":"2023-12-08T08:17:56.796743+0000","last_clean":"2023-12-08T08:17:56.796743+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:56.796743+0000","last_undegraded":"2023-12-08T08:17:56.796743+0000","last_fullsized":"2023-12-08T08:17:56.796743+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755302+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:56.755302+0000","last_peered":"2023-12-08T08:17:56.755302+0000","last_clean":"2023-12-08T08:17:56.755302+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:56.755302+0000","last_undegraded":"2023-12-08T08:17:56.755302+0000","last_fullsized":"2023-12-08T08:17:56.755302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784216+0000","last_change":"2023-12-08T08:17:57.784216+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784216+0000","last_undegraded":"2023-12-08T08:17:57.784216+0000","last_fullsized":"2023-12-08T08:17:57.784216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:00:56.423817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767497+0000","last_change":"2023-12-08T08:17:56.798852+0000","last_active":"2023-12-08T08:17:57.767497+0000","last_peered":"2023-12-08T08:17:57.767497+0000","last_clean":"2023-12-08T08:17:57.767497+0000","last_became_active":"2023-12-08T08:17:56.798551+0000","last_became_peered":"2023-12-08T08:17:56.798551+0000","last_unstale":"2023-12-08T08:17:57.767497+0000","last_undegraded":"2023-12-08T08:17:57.767497+0000","last_fullsized":"2023-12-08T08:17:57.767497+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:17.192846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784491+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:56.784491+0000","last_peered":"2023-12-08T08:17:56.784491+0000","last_clean":"2023-12-08T08:17:56.784491+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:56.784491+0000","last_undegraded":"2023-12-08T08:17:56.784491+0000","last_fullsized":"2023-12-08T08:17:56.784491+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757857+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:55.757857+0000","last_peered":"2023-12-08T08:17:55.757857+0000","last_clean":"2023-12-08T08:17:55.757857+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:55.757857+0000","last_undegraded":"2023-12-08T08:17:55.757857+0000","last_fullsized":"2023-12-08T08:17:55.757857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.794889+0000","last_change":"2023-12-08T08:17:57.794889+0000","last_active":"2023-12-08T08:17:57.794889+0000","last_peered":"2023-12-08T08:17:57.794889+0000","last_clean":"2023-12-08T08:17:57.794889+0000","last_became_active":"2023-12-08T08:17:57.794635+0000","last_became_peered":"2023-12-08T08:17:57.794635+0000","last_unstale":"2023-12-08T08:17:57.794889+0000","last_undegraded":"2023-12-08T08:17:57.794889+0000","last_fullsized":"2023-12-08T08:17:57.794889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:24:08.558071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.761744+0000","last_change":"2023-12-08T08:17:56.783004+0000","last_active":"2023-12-08T08:17:57.761744+0000","last_peered":"2023-12-08T08:17:57.761744+0000","last_clean":"2023-12-08T08:17:57.761744+0000","last_became_active":"2023-12-08T08:17:56.780718+0000","last_became_peered":"2023-12-08T08:17:56.780718+0000","last_unstale":"2023-12-08T08:17:57.761744+0000","last_undegraded":"2023-12-08T08:17:57.761744+0000","last_fullsized":"2023-12-08T08:17:57.761744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:03.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757817+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:55.757817+0000","last_peered":"2023-12-08T08:17:55.757817+0000","last_clean":"2023-12-08T08:17:55.757817+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:55.757817+0000","last_undegraded":"2023-12-08T08:17:55.757817+0000","last_fullsized":"2023-12-08T08:17:55.757817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757497+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:55.757497+0000","last_peered":"2023-12-08T08:17:55.757497+0000","last_clean":"2023-12-08T08:17:55.757497+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:55.757497+0000","last_undegraded":"2023-12-08T08:17:55.757497+0000","last_fullsized":"2023-12-08T08:17:55.757497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.772153+0000","last_change":"2023-12-08T08:17:57.772153+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.772153+0000","last_undegraded":"2023-12-08T08:17:57.772153+0000","last_fullsized":"2023-12-08T08:17:57.772153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:37.945325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800046+0000","last_change":"2023-12-08T08:17:56.796020+0000","last_active":"2023-12-08T08:17:56.800046+0000","last_peered":"2023-12-08T08:17:56.800046+0000","last_clean":"2023-12-08T08:17:56.800046+0000","last_became_active":"2023-12-08T08:17:56.795600+0000","last_became_peered":"2023-12-08T08:17:56.795600+0000","last_unstale":"2023-12-08T08:17:56.800046+0000","last_undegraded":"2023-12-08T08:17:56.800046+0000","last_fullsized":"2023-12-08T08:17:56.800046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:30:24.340680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756226+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:55.756226+0000","last_peered":"2023-12-08T08:17:55.756226+0000","last_clean":"2023-12-08T08:17:55.756226+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:55.756226+0000","last_undegraded":"2023-12-08T08:17:55.756226+0000","last_fullsized":"2023-12-08T08:17:55.756226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757057+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:55.757057+0000","last_peered":"2023-12-08T08:17:55.757057+0000","last_clean":"2023-12-08T08:17:55.757057+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:55.757057+0000","last_undegraded":"2023-12-08T08:17:55.757057+0000","last_fullsized":"2023-12-08T08:17:55.757057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777217+0000","last_change":"2023-12-08T08:17:57.777217+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777217+0000","last_undegraded":"2023-12-08T08:17:57.777217+0000","last_fullsized":"2023-12-08T08:17:57.777217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:42.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.781239+0000","last_change":"2023-12-08T08:17:56.785550+0000","last_active":"2023-12-08T08:17:57.781239+0000","last_peered":"2023-12-08T08:17:57.781239+0000","last_clean":"2023-12-08T08:17:57.781239+0000","last_became_active":"2023-12-08T08:17:56.785143+0000","last_became_peered":"2023-12-08T08:17:56.785143+0000","last_unstale":"2023-12-08T08:17:57.781239+0000","last_undegraded":"2023-12-08T08:17:57.781239+0000","last_fullsized":"2023-12-08T08:17:57.781239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:41.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765877+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:56.765877+0000","last_peered":"2023-12-08T08:17:56.765877+0000","last_clean":"2023-12-08T08:17:56.765877+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:56.765877+0000","last_undegraded":"2023-12-08T08:17:56.765877+0000","last_fullsized":"2023-12-08T08:17:56.765877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:50.669464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771471+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:56.771471+0000","last_peered":"2023-12-08T08:17:56.771471+0000","last_clean":"2023-12-08T08:17:56.771471+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:56.771471+0000","last_undegraded":"2023-12-08T08:17:56.771471+0000","last_fullsized":"2023-12-08T08:17:56.771471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765847+0000","last_change":"2023-12-08T08:17:57.765847+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765847+0000","last_undegraded":"2023-12-08T08:17:57.765847+0000","last_fullsized":"2023-12-08T08:17:57.765847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759772+0000","last_change":"2023-12-08T08:17:56.787431+0000","last_active":"2023-12-08T08:17:57.759772+0000","last_peered":"2023-12-08T08:17:57.759772+0000","last_clean":"2023-12-08T08:17:57.759772+0000","last_became_active":"2023-12-08T08:17:56.787150+0000","last_became_peered":"2023-12-08T08:17:56.787150+0000","last_unstale":"2023-12-08T08:17:57.759772+0000","last_undegraded":"2023-12-08T08:17:57.759772+0000","last_fullsized":"2023-12-08T08:17:57.759772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:02.405102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754138+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:56.754138+0000","last_peered":"2023-12-08T08:17:56.754138+0000","last_clean":"2023-12-08T08:17:56.754138+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:56.754138+0000","last_undegraded":"2023-12-08T08:17:56.754138+0000","last_fullsized":"2023-12-08T08:17:56.754138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:49.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772541+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:56.772541+0000","last_peered":"2023-12-08T08:17:56.772541+0000","last_clean":"2023-12-08T08:17:56.772541+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:56.772541+0000","last_undegraded":"2023-12-08T08:17:56.772541+0000","last_fullsized":"2023-12-08T08:17:56.772541+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779412+0000","last_change":"2023-12-08T08:17:57.779412+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779412+0000","last_undegraded":"2023-12-08T08:17:57.779412+0000","last_fullsized":"2023-12-08T08:17:57.779412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:21.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784629+0000","last_change":"2023-12-08T08:17:56.793596+0000","last_active":"2023-12-08T08:17:57.784629+0000","last_peered":"2023-12-08T08:17:57.784629+0000","last_clean":"2023-12-08T08:17:57.784629+0000","last_became_active":"2023-12-08T08:17:56.793096+0000","last_became_peered":"2023-12-08T08:17:56.793096+0000","last_unstale":"2023-12-08T08:17:57.784629+0000","last_undegraded":"2023-12-08T08:17:57.784629+0000","last_fullsized":"2023-12-08T08:17:57.784629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:06.204089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793718+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:56.793718+0000","last_peered":"2023-12-08T08:17:56.793718+0000","last_clean":"2023-12-08T08:17:56.793718+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:56.793718+0000","last_undegraded":"2023-12-08T08:17:56.793718+0000","last_fullsized":"2023-12-08T08:17:56.793718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771450+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:56.771450+0000","last_peered":"2023-12-08T08:17:56.771450+0000","last_clean":"2023-12-08T08:17:56.771450+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:56.771450+0000","last_undegraded":"2023-12-08T08:17:56.771450+0000","last_fullsized":"2023-12-08T08:17:56.771450+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778378+0000","last_change":"2023-12-08T08:17:57.778378+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778378+0000","last_undegraded":"2023-12-08T08:17:57.778378+0000","last_fullsized":"2023-12-08T08:17:57.778378+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776742+0000","last_change":"2023-12-08T08:17:56.772823+0000","last_active":"2023-12-08T08:17:56.776742+0000","last_peered":"2023-12-08T08:17:56.776742+0000","last_clean":"2023-12-08T08:17:56.776742+0000","last_became_active":"2023-12-08T08:17:56.772152+0000","last_became_peered":"2023-12-08T08:17:56.772152+0000","last_unstale":"2023-12-08T08:17:56.776742+0000","last_undegraded":"2023-12-08T08:17:56.776742+0000","last_fullsized":"2023-12-08T08:17:56.776742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:00.732887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773308+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:56.773308+0000","last_peered":"2023-12-08T08:17:56.773308+0000","last_clean":"2023-12-08T08:17:56.773308+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:56.773308+0000","last_undegraded":"2023-12-08T08:17:56.773308+0000","last_fullsized":"2023-12-08T08:17:56.773308+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793563+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:56.793563+0000","last_peered":"2023-12-08T08:17:56.793563+0000","last_clean":"2023-12-08T08:17:56.793563+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:56.793563+0000","last_undegraded":"2023-12-08T08:17:56.793563+0000","last_fullsized":"2023-12-08T08:17:56.793563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778739+0000","last_change":"2023-12-08T08:17:57.778739+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778739+0000","last_undegraded":"2023-12-08T08:17:57.778739+0000","last_fullsized":"2023-12-08T08:17:57.778739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:11.051763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759830+0000","last_change":"2023-12-08T08:17:56.778625+0000","last_active":"2023-12-08T08:17:57.759830+0000","last_peered":"2023-12-08T08:17:57.759830+0000","last_clean":"2023-12-08T08:17:57.759830+0000","last_became_active":"2023-12-08T08:17:56.778322+0000","last_became_peered":"2023-12-08T08:17:56.778322+0000","last_unstale":"2023-12-08T08:17:57.759830+0000","last_undegraded":"2023-12-08T08:17:57.759830+0000","last_fullsized":"2023-12-08T08:17:57.759830+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:15.872633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754380+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:56.754380+0000","last_peered":"2023-12-08T08:17:56.754380+0000","last_clean":"2023-12-08T08:17:56.754380+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:56.754380+0000","last_undegraded":"2023-12-08T08:17:56.754380+0000","last_fullsized":"2023-12-08T08:17:56.754380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:19.234272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758014+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:55.758014+0000","last_peered":"2023-12-08T08:17:55.758014+0000","last_clean":"2023-12-08T08:17:55.758014+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:55.758014+0000","last_undegraded":"2023-12-08T08:17:55.758014+0000","last_fullsized":"2023-12-08T08:17:55.758014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776810+0000","last_change":"2023-12-08T08:17:57.776810+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776810+0000","last_undegraded":"2023-12-08T08:17:57.776810+0000","last_fullsized":"2023-12-08T08:17:57.776810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:29.646735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767848+0000","last_change":"2023-12-08T08:17:56.796421+0000","last_active":"2023-12-08T08:17:57.767848+0000","last_peered":"2023-12-08T08:17:57.767848+0000","last_clean":"2023-12-08T08:17:57.767848+0000","last_became_active":"2023-12-08T08:17:56.795882+0000","last_became_peered":"2023-12-08T08:17:56.795882+0000","last_unstale":"2023-12-08T08:17:57.767848+0000","last_undegraded":"2023-12-08T08:17:57.767848+0000","last_fullsized":"2023-12-08T08:17:57.767848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:20.323825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773753+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:56.773753+0000","last_peered":"2023-12-08T08:17:56.773753+0000","last_clean":"2023-12-08T08:17:56.773753+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:56.773753+0000","last_undegraded":"2023-12-08T08:17:56.773753+0000","last_fullsized":"2023-12-08T08:17:56.773753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.781626+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:56.781626+0000","last_peered":"2023-12-08T08:17:56.781626+0000","last_clean":"2023-12-08T08:17:56.781626+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:56.781626+0000","last_undegraded":"2023-12-08T08:17:56.781626+0000","last_fullsized":"2023-12-08T08:17:56.781626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.770802+0000","last_change":"2023-12-08T08:17:57.770802+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.770802+0000","last_undegraded":"2023-12-08T08:17:57.770802+0000","last_fullsized":"2023-12-08T08:17:57.770802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800011+0000","last_change":"2023-12-08T08:17:56.796029+0000","last_active":"2023-12-08T08:17:56.800011+0000","last_peered":"2023-12-08T08:17:56.800011+0000","last_clean":"2023-12-08T08:17:56.800011+0000","last_became_active":"2023-12-08T08:17:56.795266+0000","last_became_peered":"2023-12-08T08:17:56.795266+0000","last_unstale":"2023-12-08T08:17:56.800011+0000","last_undegraded":"2023-12-08T08:17:56.800011+0000","last_fullsized":"2023-12-08T08:17:56.800011+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:54.839448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795131+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:56.795131+0000","last_peered":"2023-12-08T08:17:56.795131+0000","last_clean":"2023-12-08T08:17:56.795131+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:56.795131+0000","last_undegraded":"2023-12-08T08:17:56.795131+0000","last_fullsized":"2023-12-08T08:17:56.795131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753596+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:55.753596+0000","last_peered":"2023-12-08T08:17:55.753596+0000","last_clean":"2023-12-08T08:17:55.753596+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:55.753596+0000","last_undegraded":"2023-12-08T08:17:55.753596+0000","last_fullsized":"2023-12-08T08:17:55.753596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759400+0000","last_change":"2023-12-08T08:17:56.759400+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759400+0000","last_undegraded":"2023-12-08T08:17:56.759400+0000","last_fullsized":"2023-12-08T08:17:56.759400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.788509+0000","last_change":"2023-12-08T08:17:56.784864+0000","last_active":"2023-12-08T08:17:56.788509+0000","last_peered":"2023-12-08T08:17:56.788509+0000","last_clean":"2023-12-08T08:17:56.788509+0000","last_became_active":"2023-12-08T08:17:56.784452+0000","last_became_peered":"2023-12-08T08:17:56.784452+0000","last_unstale":"2023-12-08T08:17:56.788509+0000","last_undegraded":"2023-12-08T08:17:56.788509+0000","last_fullsized":"2023-12-08T08:17:56.788509+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:34.245758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.745578+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:55.745578+0000","last_peered":"2023-12-08T08:17:55.745578+0000","last_clean":"2023-12-08T08:17:55.745578+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:55.745578+0000","last_undegraded":"2023-12-08T08:17:55.745578+0000","last_fullsized":"2023-12-08T08:17:55.745578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:37.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754545+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:56.754545+0000","last_peered":"2023-12-08T08:17:56.754545+0000","last_clean":"2023-12-08T08:17:56.754545+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:56.754545+0000","last_undegraded":"2023-12-08T08:17:56.754545+0000","last_fullsized":"2023-12-08T08:17:56.754545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763151+0000","last_change":"2023-12-08T08:17:57.763151+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763151+0000","last_undegraded":"2023-12-08T08:17:57.763151+0000","last_fullsized":"2023-12-08T08:17:57.763151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.762324+0000","last_change":"2023-12-08T08:17:56.777484+0000","last_active":"2023-12-08T08:17:57.762324+0000","last_peered":"2023-12-08T08:17:57.762324+0000","last_clean":"2023-12-08T08:17:57.762324+0000","last_became_active":"2023-12-08T08:17:56.776424+0000","last_became_peered":"2023-12-08T08:17:56.776424+0000","last_unstale":"2023-12-08T08:17:57.762324+0000","last_undegraded":"2023-12-08T08:17:57.762324+0000","last_fullsized":"2023-12-08T08:17:57.762324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:23.600820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782758+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:56.782758+0000","last_peered":"2023-12-08T08:17:56.782758+0000","last_clean":"2023-12-08T08:17:56.782758+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:56.782758+0000","last_undegraded":"2023-12-08T08:17:56.782758+0000","last_fullsized":"2023-12-08T08:17:56.782758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752880+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:55.752880+0000","last_peered":"2023-12-08T08:17:55.752880+0000","last_clean":"2023-12-08T08:17:55.752880+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:55.752880+0000","last_undegraded":"2023-12-08T08:17:55.752880+0000","last_fullsized":"2023-12-08T08:17:55.752880+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764868+0000","last_change":"2023-12-08T08:17:57.764868+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764868+0000","last_undegraded":"2023-12-08T08:17:57.764868+0000","last_fullsized":"2023-12-08T08:17:57.764868+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.776109+0000","last_change":"2023-12-08T08:17:56.789756+0000","last_active":"2023-12-08T08:17:57.776109+0000","last_peered":"2023-12-08T08:17:57.776109+0000","last_clean":"2023-12-08T08:17:57.776109+0000","last_became_active":"2023-12-08T08:17:56.789515+0000","last_became_peered":"2023-12-08T08:17:56.789515+0000","last_unstale":"2023-12-08T08:17:57.776109+0000","last_undegraded":"2023-12-08T08:17:57.776109+0000","last_fullsized":"2023-12-08T08:17:57.776109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:10.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760588+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:55.760588+0000","last_peered":"2023-12-08T08:17:55.760588+0000","last_clean":"2023-12-08T08:17:55.760588+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:55.760588+0000","last_undegraded":"2023-12-08T08:17:55.760588+0000","last_fullsized":"2023-12-08T08:17:55.760588+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760270+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:55.760270+0000","last_peered":"2023-12-08T08:17:55.760270+0000","last_clean":"2023-12-08T08:17:55.760270+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:55.760270+0000","last_undegraded":"2023-12-08T08:17:55.760270+0000","last_fullsized":"2023-12-08T08:17:55.760270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759427+0000","last_change":"2023-12-08T08:17:56.759427+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759427+0000","last_undegraded":"2023-12-08T08:17:56.759427+0000","last_fullsized":"2023-12-08T08:17:56.759427+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.789798+0000","last_change":"2023-12-08T08:17:56.788069+0000","last_active":"2023-12-08T08:17:56.789798+0000","last_peered":"2023-12-08T08:17:56.789798+0000","last_clean":"2023-12-08T08:17:56.789798+0000","last_became_active":"2023-12-08T08:17:56.787757+0000","last_became_peered":"2023-12-08T08:17:56.787757+0000","last_unstale":"2023-12-08T08:17:56.789798+0000","last_undegraded":"2023-12-08T08:17:56.789798+0000","last_fullsized":"2023-12-08T08:17:56.789798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793817+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:56.793817+0000","last_peered":"2023-12-08T08:17:56.793817+0000","last_clean":"2023-12-08T08:17:56.793817+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:56.793817+0000","last_undegraded":"2023-12-08T08:17:56.793817+0000","last_fullsized":"2023-12-08T08:17:56.793817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780446+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:56.780446+0000","last_peered":"2023-12-08T08:17:56.780446+0000","last_clean":"2023-12-08T08:17:56.780446+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:56.780446+0000","last_undegraded":"2023-12-08T08:17:56.780446+0000","last_fullsized":"2023-12-08T08:17:56.780446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763263+0000","last_change":"2023-12-08T08:17:57.763263+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763263+0000","last_undegraded":"2023-12-08T08:17:57.763263+0000","last_fullsized":"2023-12-08T08:17:57.763263+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.798221+0000","last_change":"2023-12-08T08:17:56.792597+0000","last_active":"2023-12-08T08:17:56.798221+0000","last_peered":"2023-12-08T08:17:56.798221+0000","last_clean":"2023-12-08T08:17:56.798221+0000","last_became_active":"2023-12-08T08:17:56.792311+0000","last_became_peered":"2023-12-08T08:17:56.792311+0000","last_unstale":"2023-12-08T08:17:56.798221+0000","last_undegraded":"2023-12-08T08:17:56.798221+0000","last_fullsized":"2023-12-08T08:17:56.798221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:39.332501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753989+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:56.753989+0000","last_peered":"2023-12-08T08:17:56.753989+0000","last_clean":"2023-12-08T08:17:56.753989+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:56.753989+0000","last_undegraded":"2023-12-08T08:17:56.753989+0000","last_fullsized":"2023-12-08T08:17:56.753989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:13:24.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782874+0000","last_change":"2023-12-08T08:17:47.914689+0000","last_active":"2023-12-08T08:17:56.782874+0000","last_peered":"2023-12-08T08:17:56.782874+0000","last_clean":"2023-12-08T08:17:56.782874+0000","last_became_active":"2023-12-08T08:17:47.896123+0000","last_became_peered":"2023-12-08T08:17:47.896123+0000","last_unstale":"2023-12-08T08:17:56.782874+0000","last_undegraded":"2023-12-08T08:17:56.782874+0000","last_fullsized":"2023-12-08T08:17:56.782874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:47.568360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763503+0000","last_change":"2023-12-08T08:17:57.763503+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763503+0000","last_undegraded":"2023-12-08T08:17:57.763503+0000","last_fullsized":"2023-12-08T08:17:57.763503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:44.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759949+0000","last_change":"2023-12-08T08:17:56.783471+0000","last_active":"2023-12-08T08:17:57.759949+0000","last_peered":"2023-12-08T08:17:57.759949+0000","last_clean":"2023-12-08T08:17:57.759949+0000","last_became_active":"2023-12-08T08:17:56.782732+0000","last_became_peered":"2023-12-08T08:17:56.782732+0000","last_unstale":"2023-12-08T08:17:57.759949+0000","last_undegraded":"2023-12-08T08:17:57.759949+0000","last_fullsized":"2023-12-08T08:17:57.759949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753330+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:55.753330+0000","last_peered":"2023-12-08T08:17:55.753330+0000","last_clean":"2023-12-08T08:17:55.753330+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:55.753330+0000","last_undegraded":"2023-12-08T08:17:55.753330+0000","last_fullsized":"2023-12-08T08:17:55.753330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761923+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:55.761923+0000","last_peered":"2023-12-08T08:17:55.761923+0000","last_clean":"2023-12-08T08:17:55.761923+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:55.761923+0000","last_undegraded":"2023-12-08T08:17:55.761923+0000","last_fullsized":"2023-12-08T08:17:55.761923+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789814+0000","last_change":"2023-12-08T08:17:57.789814+0000","last_active":"2023-12-08T08:17:57.789814+0000","last_peered":"2023-12-08T08:17:57.789814+0000","last_clean":"2023-12-08T08:17:57.789814+0000","last_became_active":"2023-12-08T08:17:57.789121+0000","last_became_peered":"2023-12-08T08:17:57.789121+0000","last_unstale":"2023-12-08T08:17:57.789814+0000","last_undegraded":"2023-12-08T08:17:57.789814+0000","last_fullsized":"2023-12-08T08:17:57.789814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782602+0000","last_change":"2023-12-08T08:17:56.778284+0000","last_active":"2023-12-08T08:17:57.782602+0000","last_peered":"2023-12-08T08:17:57.782602+0000","last_clean":"2023-12-08T08:17:57.782602+0000","last_became_active":"2023-12-08T08:17:56.777942+0000","last_became_peered":"2023-12-08T08:17:56.777942+0000","last_unstale":"2023-12-08T08:17:57.782602+0000","last_undegraded":"2023-12-08T08:17:57.782602+0000","last_fullsized":"2023-12-08T08:17:57.782602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:35:47.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795227+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:56.795227+0000","last_peered":"2023-12-08T08:17:56.795227+0000","last_clean":"2023-12-08T08:17:56.795227+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:56.795227+0000","last_undegraded":"2023-12-08T08:17:56.795227+0000","last_fullsized":"2023-12-08T08:17:56.795227+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:52.110302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753831+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:55.753831+0000","last_peered":"2023-12-08T08:17:55.753831+0000","last_clean":"2023-12-08T08:17:55.753831+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:55.753831+0000","last_undegraded":"2023-12-08T08:17:55.753831+0000","last_fullsized":"2023-12-08T08:17:55.753831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784018+0000","last_change":"2023-12-08T08:17:57.777499+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784018+0000","last_undegraded":"2023-12-08T08:17:57.784018+0000","last_fullsized":"2023-12-08T08:17:57.784018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800071+0000","last_change":"2023-12-08T08:17:56.796644+0000","last_active":"2023-12-08T08:17:56.800071+0000","last_peered":"2023-12-08T08:17:56.800071+0000","last_clean":"2023-12-08T08:17:56.800071+0000","last_became_active":"2023-12-08T08:17:56.796276+0000","last_became_peered":"2023-12-08T08:17:56.796276+0000","last_unstale":"2023-12-08T08:17:56.800071+0000","last_undegraded":"2023-12-08T08:17:56.800071+0000","last_fullsized":"2023-12-08T08:17:56.800071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:22:28.402168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774697+0000","last_change":"2023-12-08T08:17:47.864253+0000","last_active":"2023-12-08T08:17:56.774697+0000","last_peered":"2023-12-08T08:17:56.774697+0000","last_clean":"2023-12-08T08:17:56.774697+0000","last_became_active":"2023-12-08T08:17:47.863753+0000","last_became_peered":"2023-12-08T08:17:47.863753+0000","last_unstale":"2023-12-08T08:17:56.774697+0000","last_undegraded":"2023-12-08T08:17:56.774697+0000","last_fullsized":"2023-12-08T08:17:56.774697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:12.401320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753774+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:55.753774+0000","last_peered":"2023-12-08T08:17:55.753774+0000","last_clean":"2023-12-08T08:17:55.753774+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:55.753774+0000","last_undegraded":"2023-12-08T08:17:55.753774+0000","last_fullsized":"2023-12-08T08:17:55.753774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777046+0000","last_change":"2023-12-08T08:17:57.777046+0000","last_active":"2023-12-08T08:17:57.777046+0000","last_peered":"2023-12-08T08:17:57.777046+0000","last_clean":"2023-12-08T08:17:57.777046+0000","last_became_active":"2023-12-08T08:17:57.776718+0000","last_became_peered":"2023-12-08T08:17:57.776718+0000","last_unstale":"2023-12-08T08:17:57.777046+0000","last_undegraded":"2023-12-08T08:17:57.777046+0000","last_fullsized":"2023-12-08T08:17:57.777046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:39.870427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787223+0000","last_change":"2023-12-08T08:17:56.780944+0000","last_active":"2023-12-08T08:17:57.787223+0000","last_peered":"2023-12-08T08:17:57.787223+0000","last_clean":"2023-12-08T08:17:57.787223+0000","last_became_active":"2023-12-08T08:17:56.780212+0000","last_became_peered":"2023-12-08T08:17:56.780212+0000","last_unstale":"2023-12-08T08:17:57.787223+0000","last_undegraded":"2023-12-08T08:17:57.787223+0000","last_fullsized":"2023-12-08T08:17:57.787223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:58.661778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794170+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:56.794170+0000","last_peered":"2023-12-08T08:17:56.794170+0000","last_clean":"2023-12-08T08:17:56.794170+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:56.794170+0000","last_undegraded":"2023-12-08T08:17:56.794170+0000","last_fullsized":"2023-12-08T08:17:56.794170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773158+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:56.773158+0000","last_peered":"2023-12-08T08:17:56.773158+0000","last_clean":"2023-12-08T08:17:56.773158+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:56.773158+0000","last_undegraded":"2023-12-08T08:17:56.773158+0000","last_fullsized":"2023-12-08T08:17:56.773158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775811+0000","last_change":"2023-12-08T08:17:57.775811+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775811+0000","last_undegraded":"2023-12-08T08:17:57.775811+0000","last_fullsized":"2023-12-08T08:17:57.775811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:57.978934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783322+0000","last_change":"2023-12-08T08:17:56.792427+0000","last_active":"2023-12-08T08:17:57.783322+0000","last_peered":"2023-12-08T08:17:57.783322+0000","last_clean":"2023-12-08T08:17:57.783322+0000","last_became_active":"2023-12-08T08:17:56.792047+0000","last_became_peered":"2023-12-08T08:17:56.792047+0000","last_unstale":"2023-12-08T08:17:57.783322+0000","last_undegraded":"2023-12-08T08:17:57.783322+0000","last_fullsized":"2023-12-08T08:17:57.783322+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769796+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:56.769796+0000","last_peered":"2023-12-08T08:17:56.769796+0000","last_clean":"2023-12-08T08:17:56.769796+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:56.769796+0000","last_undegraded":"2023-12-08T08:17:56.769796+0000","last_fullsized":"2023-12-08T08:17:56.769796+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:14.424829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756879+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:55.756879+0000","last_peered":"2023-12-08T08:17:55.756879+0000","last_clean":"2023-12-08T08:17:55.756879+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:55.756879+0000","last_undegraded":"2023-12-08T08:17:55.756879+0000","last_fullsized":"2023-12-08T08:17:55.756879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764805+0000","last_change":"2023-12-08T08:17:57.764805+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764805+0000","last_undegraded":"2023-12-08T08:17:57.764805+0000","last_fullsized":"2023-12-08T08:17:57.764805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777848+0000","last_change":"2023-12-08T08:17:56.791954+0000","last_active":"2023-12-08T08:17:57.777848+0000","last_peered":"2023-12-08T08:17:57.777848+0000","last_clean":"2023-12-08T08:17:57.777848+0000","last_became_active":"2023-12-08T08:17:56.791571+0000","last_became_peered":"2023-12-08T08:17:56.791571+0000","last_unstale":"2023-12-08T08:17:57.777848+0000","last_undegraded":"2023-12-08T08:17:57.777848+0000","last_fullsized":"2023-12-08T08:17:57.777848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760839+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:55.760839+0000","last_peered":"2023-12-08T08:17:55.760839+0000","last_clean":"2023-12-08T08:17:55.760839+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:55.760839+0000","last_undegraded":"2023-12-08T08:17:55.760839+0000","last_fullsized":"2023-12-08T08:17:55.760839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760419+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:55.760419+0000","last_peered":"2023-12-08T08:17:55.760419+0000","last_clean":"2023-12-08T08:17:55.760419+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:55.760419+0000","last_undegraded":"2023-12-08T08:17:55.760419+0000","last_fullsized":"2023-12-08T08:17:55.760419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780184+0000","last_change":"2023-12-08T08:17:57.780184+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780184+0000","last_undegraded":"2023-12-08T08:17:57.780184+0000","last_fullsized":"2023-12-08T08:17:57.780184+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774643+0000","last_change":"2023-12-08T08:17:56.777768+0000","last_active":"2023-12-08T08:17:57.774643+0000","last_peered":"2023-12-08T08:17:57.774643+0000","last_clean":"2023-12-08T08:17:57.774643+0000","last_became_active":"2023-12-08T08:17:56.776405+0000","last_became_peered":"2023-12-08T08:17:56.776405+0000","last_unstale":"2023-12-08T08:17:57.774643+0000","last_undegraded":"2023-12-08T08:17:57.774643+0000","last_fullsized":"2023-12-08T08:17:57.774643+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:36.931349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793911+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:56.793911+0000","last_peered":"2023-12-08T08:17:56.793911+0000","last_clean":"2023-12-08T08:17:56.793911+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:56.793911+0000","last_undegraded":"2023-12-08T08:17:56.793911+0000","last_fullsized":"2023-12-08T08:17:56.793911+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756715+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:55.756715+0000","last_peered":"2023-12-08T08:17:55.756715+0000","last_clean":"2023-12-08T08:17:55.756715+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:55.756715+0000","last_undegraded":"2023-12-08T08:17:55.756715+0000","last_fullsized":"2023-12-08T08:17:55.756715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783189+0000","last_change":"2023-12-08T08:17:57.783189+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783189+0000","last_undegraded":"2023-12-08T08:17:57.783189+0000","last_fullsized":"2023-12-08T08:17:57.783189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:59.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.802501+0000","last_change":"2023-12-08T08:17:56.797511+0000","last_active":"2023-12-08T08:17:56.802501+0000","last_peered":"2023-12-08T08:17:56.802501+0000","last_clean":"2023-12-08T08:17:56.802501+0000","last_became_active":"2023-12-08T08:17:56.796361+0000","last_became_peered":"2023-12-08T08:17:56.796361+0000","last_unstale":"2023-12-08T08:17:56.802501+0000","last_undegraded":"2023-12-08T08:17:56.802501+0000","last_fullsized":"2023-12-08T08:17:56.802501+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:04.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756921+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:55.756921+0000","last_peered":"2023-12-08T08:17:55.756921+0000","last_clean":"2023-12-08T08:17:55.756921+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:55.756921+0000","last_undegraded":"2023-12-08T08:17:55.756921+0000","last_fullsized":"2023-12-08T08:17:55.756921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762232+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:55.762232+0000","last_peered":"2023-12-08T08:17:55.762232+0000","last_clean":"2023-12-08T08:17:55.762232+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:55.762232+0000","last_undegraded":"2023-12-08T08:17:55.762232+0000","last_fullsized":"2023-12-08T08:17:55.762232+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.771347+0000","last_change":"2023-12-08T08:17:57.771347+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.771347+0000","last_undegraded":"2023-12-08T08:17:57.771347+0000","last_fullsized":"2023-12-08T08:17:57.771347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799920+0000","last_change":"2023-12-08T08:17:56.795117+0000","last_active":"2023-12-08T08:17:56.799920+0000","last_peered":"2023-12-08T08:17:56.799920+0000","last_clean":"2023-12-08T08:17:56.799920+0000","last_became_active":"2023-12-08T08:17:56.794822+0000","last_became_peered":"2023-12-08T08:17:56.794822+0000","last_unstale":"2023-12-08T08:17:56.799920+0000","last_undegraded":"2023-12-08T08:17:56.799920+0000","last_fullsized":"2023-12-08T08:17:56.799920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:27.379446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769715+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:56.769715+0000","last_peered":"2023-12-08T08:17:56.769715+0000","last_clean":"2023-12-08T08:17:56.769715+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:56.769715+0000","last_undegraded":"2023-12-08T08:17:56.769715+0000","last_fullsized":"2023-12-08T08:17:56.769715+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:26.299694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762079+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:55.762079+0000","last_peered":"2023-12-08T08:17:55.762079+0000","last_clean":"2023-12-08T08:17:55.762079+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:55.762079+0000","last_undegraded":"2023-12-08T08:17:55.762079+0000","last_fullsized":"2023-12-08T08:17:55.762079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776946+0000","last_change":"2023-12-08T08:17:57.776946+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776946+0000","last_undegraded":"2023-12-08T08:17:57.776946+0000","last_fullsized":"2023-12-08T08:17:57.776946+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:51.673242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776553+0000","last_change":"2023-12-08T08:17:56.768920+0000","last_active":"2023-12-08T08:17:56.776553+0000","last_peered":"2023-12-08T08:17:56.776553+0000","last_clean":"2023-12-08T08:17:56.776553+0000","last_became_active":"2023-12-08T08:17:56.768205+0000","last_became_peered":"2023-12-08T08:17:56.768205+0000","last_unstale":"2023-12-08T08:17:56.776553+0000","last_undegraded":"2023-12-08T08:17:56.776553+0000","last_fullsized":"2023-12-08T08:17:56.776553+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:00.933681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761805+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:55.761805+0000","last_peered":"2023-12-08T08:17:55.761805+0000","last_clean":"2023-12-08T08:17:55.761805+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:55.761805+0000","last_undegraded":"2023-12-08T08:17:55.761805+0000","last_fullsized":"2023-12-08T08:17:55.761805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757709+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:55.757709+0000","last_peered":"2023-12-08T08:17:55.757709+0000","last_clean":"2023-12-08T08:17:55.757709+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:55.757709+0000","last_undegraded":"2023-12-08T08:17:55.757709+0000","last_fullsized":"2023-12-08T08:17:55.757709+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763142+0000","last_change":"2023-12-08T08:17:57.763142+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763142+0000","last_undegraded":"2023-12-08T08:17:57.763142+0000","last_fullsized":"2023-12-08T08:17:57.763142+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:59.675754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782767+0000","last_change":"2023-12-08T08:17:56.779410+0000","last_active":"2023-12-08T08:17:56.782767+0000","last_peered":"2023-12-08T08:17:56.782767+0000","last_clean":"2023-12-08T08:17:56.782767+0000","last_became_active":"2023-12-08T08:17:56.779079+0000","last_became_peered":"2023-12-08T08:17:56.779079+0000","last_unstale":"2023-12-08T08:17:56.782767+0000","last_undegraded":"2023-12-08T08:17:56.782767+0000","last_fullsized":"2023-12-08T08:17:56.782767+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:03.830927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795160+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:56.795160+0000","last_peered":"2023-12-08T08:17:56.795160+0000","last_clean":"2023-12-08T08:17:56.795160+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:56.795160+0000","last_undegraded":"2023-12-08T08:17:56.795160+0000","last_fullsized":"2023-12-08T08:17:56.795160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754636+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:56.754636+0000","last_peered":"2023-12-08T08:17:56.754636+0000","last_clean":"2023-12-08T08:17:56.754636+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:56.754636+0000","last_undegraded":"2023-12-08T08:17:56.754636+0000","last_fullsized":"2023-12-08T08:17:56.754636+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778064+0000","last_change":"2023-12-08T08:17:57.778064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778064+0000","last_undegraded":"2023-12-08T08:17:57.778064+0000","last_fullsized":"2023-12-08T08:17:57.778064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:11:16.845352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767289+0000","last_change":"2023-12-08T08:17:56.791471+0000","last_active":"2023-12-08T08:17:57.767289+0000","last_peered":"2023-12-08T08:17:57.767289+0000","last_clean":"2023-12-08T08:17:57.767289+0000","last_became_active":"2023-12-08T08:17:56.791079+0000","last_became_peered":"2023-12-08T08:17:56.791079+0000","last_unstale":"2023-12-08T08:17:57.767289+0000","last_undegraded":"2023-12-08T08:17:57.767289+0000","last_fullsized":"2023-12-08T08:17:57.767289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:22.747918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793570+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:56.793570+0000","last_peered":"2023-12-08T08:17:56.793570+0000","last_clean":"2023-12-08T08:17:56.793570+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:56.793570+0000","last_undegraded":"2023-12-08T08:17:56.793570+0000","last_fullsized":"2023-12-08T08:17:56.793570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753050+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:55.753050+0000","last_peered":"2023-12-08T08:17:55.753050+0000","last_clean":"2023-12-08T08:17:55.753050+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:55.753050+0000","last_undegraded":"2023-12-08T08:17:55.753050+0000","last_fullsized":"2023-12-08T08:17:55.753050+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.805299+0000","last_change":"2023-12-08T08:17:57.797287+0000","last_active":"2023-12-08T08:17:57.805299+0000","last_peered":"2023-12-08T08:17:57.805299+0000","last_clean":"2023-12-08T08:17:57.805299+0000","last_became_active":"2023-12-08T08:17:57.796961+0000","last_became_peered":"2023-12-08T08:17:57.796961+0000","last_unstale":"2023-12-08T08:17:57.805299+0000","last_undegraded":"2023-12-08T08:17:57.805299+0000","last_fullsized":"2023-12-08T08:17:57.805299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:16:05.130558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780644+0000","last_change":"2023-12-08T08:17:56.772809+0000","last_active":"2023-12-08T08:17:57.780644+0000","last_peered":"2023-12-08T08:17:57.780644+0000","last_clean":"2023-12-08T08:17:57.780644+0000","last_became_active":"2023-12-08T08:17:56.772556+0000","last_became_peered":"2023-12-08T08:17:56.772556+0000","last_unstale":"2023-12-08T08:17:57.780644+0000","last_undegraded":"2023-12-08T08:17:57.780644+0000","last_fullsized":"2023-12-08T08:17:57.780644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:48:41.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784572+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:56.784572+0000","last_peered":"2023-12-08T08:17:56.784572+0000","last_clean":"2023-12-08T08:17:56.784572+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:56.784572+0000","last_undegraded":"2023-12-08T08:17:56.784572+0000","last_fullsized":"2023-12-08T08:17:56.784572+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772623+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:56.772623+0000","last_peered":"2023-12-08T08:17:56.772623+0000","last_clean":"2023-12-08T08:17:56.772623+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:56.772623+0000","last_undegraded":"2023-12-08T08:17:56.772623+0000","last_fullsized":"2023-12-08T08:17:56.772623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763212+0000","last_change":"2023-12-08T08:17:57.763212+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763212+0000","last_undegraded":"2023-12-08T08:17:57.763212+0000","last_fullsized":"2023-12-08T08:17:57.763212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767960+0000","last_change":"2023-12-08T08:17:56.798843+0000","last_active":"2023-12-08T08:17:57.767960+0000","last_peered":"2023-12-08T08:17:57.767960+0000","last_clean":"2023-12-08T08:17:57.767960+0000","last_became_active":"2023-12-08T08:17:56.798505+0000","last_became_peered":"2023-12-08T08:17:56.798505+0000","last_unstale":"2023-12-08T08:17:57.767960+0000","last_undegraded":"2023-12-08T08:17:57.767960+0000","last_fullsized":"2023-12-08T08:17:57.767960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753650+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:56.753650+0000","last_peered":"2023-12-08T08:17:56.753650+0000","last_clean":"2023-12-08T08:17:56.753650+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:56.753650+0000","last_undegraded":"2023-12-08T08:17:56.753650+0000","last_fullsized":"2023-12-08T08:17:56.753650+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:02.769189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771534+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:56.771534+0000","last_peered":"2023-12-08T08:17:56.771534+0000","last_clean":"2023-12-08T08:17:56.771534+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:56.771534+0000","last_undegraded":"2023-12-08T08:17:56.771534+0000","last_fullsized":"2023-12-08T08:17:56.771534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763193+0000","last_change":"2023-12-08T08:17:57.763193+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763193+0000","last_undegraded":"2023-12-08T08:17:57.763193+0000","last_fullsized":"2023-12-08T08:17:57.763193+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760454+0000","last_change":"2023-12-08T08:17:56.780631+0000","last_active":"2023-12-08T08:17:57.760454+0000","last_peered":"2023-12-08T08:17:57.760454+0000","last_clean":"2023-12-08T08:17:57.760454+0000","last_became_active":"2023-12-08T08:17:56.780250+0000","last_became_peered":"2023-12-08T08:17:56.780250+0000","last_unstale":"2023-12-08T08:17:57.760454+0000","last_undegraded":"2023-12-08T08:17:57.760454+0000","last_fullsized":"2023-12-08T08:17:57.760454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:36:12.440569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.768685+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:56.768685+0000","last_peered":"2023-12-08T08:17:56.768685+0000","last_clean":"2023-12-08T08:17:56.768685+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:56.768685+0000","last_undegraded":"2023-12-08T08:17:56.768685+0000","last_fullsized":"2023-12-08T08:17:56.768685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:50.672771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753821+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:56.753821+0000","last_peered":"2023-12-08T08:17:56.753821+0000","last_clean":"2023-12-08T08:17:56.753821+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:56.753821+0000","last_undegraded":"2023-12-08T08:17:56.753821+0000","last_fullsized":"2023-12-08T08:17:56.753821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.774154+0000","last_change":"2023-12-08T08:17:56.774154+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.774154+0000","last_undegraded":"2023-12-08T08:17:56.774154+0000","last_fullsized":"2023-12-08T08:17:56.774154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786813+0000","last_change":"2023-12-08T08:17:56.792036+0000","last_active":"2023-12-08T08:17:57.786813+0000","last_peered":"2023-12-08T08:17:57.786813+0000","last_clean":"2023-12-08T08:17:57.786813+0000","last_became_active":"2023-12-08T08:17:56.791709+0000","last_became_peered":"2023-12-08T08:17:56.791709+0000","last_unstale":"2023-12-08T08:17:57.786813+0000","last_undegraded":"2023-12-08T08:17:57.786813+0000","last_fullsized":"2023-12-08T08:17:57.786813+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794039+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:56.794039+0000","last_peered":"2023-12-08T08:17:56.794039+0000","last_clean":"2023-12-08T08:17:56.794039+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:56.794039+0000","last_undegraded":"2023-12-08T08:17:56.794039+0000","last_fullsized":"2023-12-08T08:17:56.794039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771104+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:56.771104+0000","last_peered":"2023-12-08T08:17:56.771104+0000","last_clean":"2023-12-08T08:17:56.771104+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:56.771104+0000","last_undegraded":"2023-12-08T08:17:56.771104+0000","last_fullsized":"2023-12-08T08:17:56.771104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779411+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:56.779411+0000","last_peered":"2023-12-08T08:17:56.779411+0000","last_clean":"2023-12-08T08:17:56.779411+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:56.779411+0000","last_undegraded":"2023-12-08T08:17:56.779411+0000","last_fullsized":"2023-12-08T08:17:56.779411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":939182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.58599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3600000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.0800000000000001},"min":{"1min":0.73999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.153,"15min":1.159},"min":{"1min":0.71099999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.159},{"interface":"front","average":{"1min":1.131,"5min":1.224,"15min":1.24},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.397}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.175,"15min":1.177},"min":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.474,"5min":1.863,"15min":1.863},"last":1.042},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.325,"15min":1.333},"min":{"1min":0.86199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.6040000000000001,"5min":1.855,"15min":1.855},"last":1.361},{"interface":"front","average":{"1min":1.321,"5min":1.405,"15min":1.419},"min":{"1min":0.92900000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.671,"5min":3.524,"15min":3.524},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.393,"15min":1.407},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.702,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3600000000000001,"15min":1.353},"min":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.754,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":0.98799999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.9239999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.508,"15min":1.504},"min":{"1min":0.91500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0009999999999999,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.6419999999999999,"15min":1.6559999999999999},"min":{"1min":0.99299999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9019999999999999,"5min":2.609,"15min":2.609},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":1.01,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.101,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.75,"15min":1.857},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4770000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.845,"15min":1.978},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.365,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.131,"15min":1.111},"min":{"1min":0.95099999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4830000000000001,"5min":1.762,"15min":1.762},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2250000000000001,"15min":1.2370000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5229999999999999,"5min":2.141,"15min":2.141},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5680000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3959999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.397,"15min":1.425},"min":{"1min":0.77800000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5600000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8640000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.048}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.341,"15min":1.349},"min":{"1min":0.98199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.401,"15min":1.4139999999999999},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6759999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.327}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.484,"15min":1.4990000000000001},"min":{"1min":1.089,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.972,"5min":2.96,"15min":2.96},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.208,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7809999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.478,"15min":1.484},"min":{"1min":1.2270000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7410000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.238},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.595,"15min":1.6140000000000001},"min":{"1min":1.0600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0760000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.266}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.5369999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.208}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.337},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4750000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3759999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.3049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":351145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.427},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.286}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.478},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.125}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.381}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.577},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.639}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.95599999999999996,"15min":0.96599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.03,"15min":1.044},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5459999999999998,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.99299999999999999,"15min":0.99199999999999999},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.53300000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.835,"5min":1.97,"15min":1.97},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.84399999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.24},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3420000000000001,"15min":1.363},"min":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.458,"15min":1.494},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0209999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.3819999999999999,"15min":1.383},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4279999999999999,"15min":1.4430000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9550000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5569999999999999,"15min":1.5840000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1930000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.478,"15min":1.49},"min":{"1min":0.94199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.476,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.5960000000000001,"15min":1.6180000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.2330000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.2270000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.431}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":1.496}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.5780000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.131}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":2.121},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.337},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":2.1859999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.544},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4690000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":351909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.88},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.306,"5min":1.585,"15min":1.585},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.97399999999999998,"15min":0.98399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.877,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.329,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5429999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.55000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.764,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.1259999999999999,"15min":1.1399999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1669999999999998,"5min":2.327,"15min":2.327},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6559999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.117},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.464,"15min":1.504},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.5089999999999999,"5min":2.552,"15min":2.552},"last":1.069}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.4670000000000001,"15min":1.5009999999999999},"min":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3900000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.202},{"interface":"front","average":{"1min":1.236,"5min":1.425,"15min":1.4570000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6220000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.042}]},{"osd":6,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.581,"15min":1.609},"min":{"1min":0.76000000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2989999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.546,"15min":1.5800000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.843,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.571,"15min":1.601},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.016,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.675,"15min":1.6850000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.3460000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1351680,"data_stored":938406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.4490000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.329},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.292}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:02.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:03.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.124+0000 7f8161335640 1 Processor -- start 2023-12-08T08:18:03.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.124+0000 7f8161335640 1 -- start start 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f815c14e840 0x7f815c151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 0x7f815c0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c14ec20 con 0x7f815c14e840 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c151ea0 con 0x7f815c0a9e80 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f8161335640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c154850 con 0x7f815c0c1210 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f815bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f815c14e840 0x7f815c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f815bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f815c14e840 0x7f815c151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40784/0 (socket says 172.21.15.45:40784) 2023-12-08T08:18:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.126+0000 7f815bfff640 1 -- 172.21.15.45:0/3947362933 learned_addr learned my addr 172.21.15.45:0/3947362933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f8160b34640 1 --2- 172.21.15.45:0/3947362933 >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 0x7f815c0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f8153fff640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f815bfff640 1 -- 172.21.15.45:0/3947362933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 msgr2=0x7f815c0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f815bfff640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c0c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f815bfff640 1 -- 172.21.15.45:0/3947362933 >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 msgr2=0x7f815c0aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f815bfff640 1 --2- 172.21.15.45:0/3947362933 >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 0x7f815c0aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f815bfff640 1 -- 172.21.15.45:0/3947362933 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c154b30 con 0x7f815c14e840 2023-12-08T08:18:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f8160b34640 1 --2- 172.21.15.45:0/3947362933 >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 0x7f815c0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.127+0000 7f8153fff640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.128+0000 7f815bfff640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c151960 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f815c0c1ff0 tx=0x7f814c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470c476bd219f70c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.128+0000 7f815b7fe640 1 -- 172.21.15.45:0/3947362933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0317d0 con 0x7f815c14e840 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.128+0000 7f815b7fe640 1 -- 172.21.15.45:0/3947362933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c031930 con 0x7f815c14e840 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.128+0000 7f815b7fe640 1 -- 172.21.15.45:0/3947362933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c031cc0 con 0x7f815c14e840 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 -- 172.21.15.45:0/3947362933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 msgr2=0x7f815c151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c151960 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f815c0c1ff0 tx=0x7f814c02b870 comp rx=0 tx=0).stop 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 -- 172.21.15.45:0/3947362933 shutdown_connections 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 --2- 172.21.15.45:0/3947362933 >> v2:172.21.15.114:3300/0 conn(0x7f815c0a9e80 0x7f815c0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 --2- 172.21.15.45:0/3947362933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c151960 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 -- 172.21.15.45:0/3947362933 >> 172.21.15.45:0/3947362933 conn(0x7f815c0c5780 msgr2=0x7f815c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 -- 172.21.15.45:0/3947362933 shutdown_connections 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.129+0000 7f8161335640 1 -- 172.21.15.45:0/3947362933 wait complete. 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.131+0000 7f8161335640 1 Processor -- start 2023-12-08T08:18:03.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.131+0000 7f8161335640 1 -- start start 2023-12-08T08:18:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 0x7f815c0beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c1ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0a5090 con 0x7f815c14e840 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c145d00 con 0x7f815c0a9e80 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8161335640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0a4db0 con 0x7f815c0c1210 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8160b34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8160b34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40798/0 (socket says 172.21.15.45:40798) 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8160b34640 1 -- 172.21.15.45:0/3169936101 learned_addr learned my addr 172.21.15.45:0/3169936101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f815bfff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 0x7f815c0beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8153fff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c1ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.132+0000 7f8160b34640 1 -- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 msgr2=0x7f815c1ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8160b34640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c1ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8160b34640 1 -- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 msgr2=0x7f815c0beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8160b34640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 0x7f815c0beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8160b34640 1 -- 172.21.15.45:0/3169936101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0094d0 con 0x7f815c14e840 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f815bfff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 0x7f815c0beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8153fff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c1ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8160b34640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f815400cef0 tx=0x7f815400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400d840 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815400d9a0 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400dd50 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c0a73a0 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.133+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c145a00 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.135+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c0a78c0 con 0x7f815c14e840 2023-12-08T08:18:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.135+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f815401d360 con 0x7f815c14e840 2023-12-08T08:18:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.136+0000 7f81597fa640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 0x7f813c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.137+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f815408a590 con 0x7f815c14e840 2023-12-08T08:18:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.137+0000 7f815bfff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 0x7f813c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.137+0000 7f815bfff640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 0x7f813c06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f814c036000 tx=0x7f814c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.141+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f815c0a78c0 con 0x7f815c14e840 2023-12-08T08:18:03.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.333+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f815c154520 con 0x7f813c06ae40 2023-12-08T08:18:03.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.349+0000 7f81597fa640 1 -- 172.21.15.45:0/3169936101 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+522813 (secure 0 0 0) 0x7f814c031aa0 con 0x7f813c06ae40 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:03.362 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.357+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 msgr2=0x7f813c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.357+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 0x7f813c06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f814c036000 tx=0x7f814c03d040 comp rx=0 tx=0).stop 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.357+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 msgr2=0x7f815c1ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.357+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f815400cef0 tx=0x7f815400a710 comp rx=0 tx=0).stop 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 shutdown_connections 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f813c06ae40 0x7f813c06d300 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f815c0c1210 0x7f815c1ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f815c14e840 0x7f815c1ecf20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 --2- 172.21.15.45:0/3169936101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f815c0a9e80 0x7f815c0beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 >> 172.21.15.45:0/3169936101 conn(0x7f815c0c5780 msgr2=0x7f815c152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 shutdown_connections 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.358+0000 7f8161335640 1 -- 172.21.15.45:0/3169936101 wait complete. 2023-12-08T08:18:03.381 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-12-08T08:18:01.762947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239976,"kb_used_data":7144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734744,"statfs":{"total":773094113280,"available":772848377856,"internally_reserved":0,"allocated":7315456,"data_stored":3972850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002350"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764361+0000","last_change":"2023-12-08T08:17:57.764361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764361+0000","last_undegraded":"2023-12-08T08:17:57.764361+0000","last_fullsized":"2023-12-08T08:17:57.764361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754978+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:56.754978+0000","last_peered":"2023-12-08T08:17:56.754978+0000","last_clean":"2023-12-08T08:17:56.754978+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:56.754978+0000","last_undegraded":"2023-12-08T08:17:56.754978+0000","last_fullsized":"2023-12-08T08:17:56.754978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:50.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.762419+0000","last_change":"2023-12-08T08:17:57.762419+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.762419+0000","last_undegraded":"2023-12-08T08:17:57.762419+0000","last_fullsized":"2023-12-08T08:17:57.762419+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:16.621830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754008+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:56.754008+0000","last_peered":"2023-12-08T08:17:56.754008+0000","last_clean":"2023-12-08T08:17:56.754008+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:56.754008+0000","last_undegraded":"2023-12-08T08:17:56.754008+0000","last_fullsized":"2023-12-08T08:17:56.754008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:09.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760293+0000","last_change":"2023-12-08T08:17:57.760293+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760293+0000","last_undegraded":"2023-12-08T08:17:57.760293+0000","last_fullsized":"2023-12-08T08:17:57.760293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:41.599819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753415+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:55.753415+0000","last_peered":"2023-12-08T08:17:55.753415+0000","last_clean":"2023-12-08T08:17:55.753415+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:55.753415+0000","last_undegraded":"2023-12-08T08:17:55.753415+0000","last_fullsized":"2023-12-08T08:17:55.753415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.786345+0000","last_change":"2023-12-08T08:17:57.786345+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.786345+0000","last_undegraded":"2023-12-08T08:17:57.786345+0000","last_fullsized":"2023-12-08T08:17:57.786345+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.785598+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:56.785598+0000","last_peered":"2023-12-08T08:17:56.785598+0000","last_clean":"2023-12-08T08:17:56.785598+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:56.785598+0000","last_undegraded":"2023-12-08T08:17:56.785598+0000","last_fullsized":"2023-12-08T08:17:56.785598+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.800058+0000","last_change":"2023-12-08T08:17:57.779371+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.800058+0000","last_undegraded":"2023-12-08T08:17:57.800058+0000","last_fullsized":"2023-12-08T08:17:57.800058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:07.224031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":23,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793991+0000","last_change":"2023-12-08T08:17:47.863838+0000","last_active":"2023-12-08T08:17:56.793991+0000","last_peered":"2023-12-08T08:17:56.793991+0000","last_clean":"2023-12-08T08:17:56.793991+0000","last_became_active":"2023-12-08T08:17:47.863177+0000","last_became_peered":"2023-12-08T08:17:47.863177+0000","last_unstale":"2023-12-08T08:17:56.793991+0000","last_undegraded":"2023-12-08T08:17:56.793991+0000","last_fullsized":"2023-12-08T08:17:56.793991+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:35.681140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.762215+0000","last_change":"2023-12-08T08:17:56.762215+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.762215+0000","last_undegraded":"2023-12-08T08:17:56.762215+0000","last_fullsized":"2023-12-08T08:17:56.762215+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.770900+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:56.770900+0000","last_peered":"2023-12-08T08:17:56.770900+0000","last_clean":"2023-12-08T08:17:56.770900+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:56.770900+0000","last_undegraded":"2023-12-08T08:17:56.770900+0000","last_fullsized":"2023-12-08T08:17:56.770900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.770685+0000","last_change":"2023-12-08T08:17:56.770685+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.770685+0000","last_undegraded":"2023-12-08T08:17:56.770685+0000","last_fullsized":"2023-12-08T08:17:56.770685+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.762274+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:56.762274+0000","last_peered":"2023-12-08T08:17:56.762274+0000","last_clean":"2023-12-08T08:17:56.762274+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:56.762274+0000","last_undegraded":"2023-12-08T08:17:56.762274+0000","last_fullsized":"2023-12-08T08:17:56.762274+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:26.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767249+0000","last_change":"2023-12-08T08:17:56.767249+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767249+0000","last_undegraded":"2023-12-08T08:17:56.767249+0000","last_fullsized":"2023-12-08T08:17:56.767249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758841+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:55.758841+0000","last_peered":"2023-12-08T08:17:55.758841+0000","last_clean":"2023-12-08T08:17:55.758841+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:55.758841+0000","last_undegraded":"2023-12-08T08:17:55.758841+0000","last_fullsized":"2023-12-08T08:17:55.758841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:43.683652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780942+0000","last_change":"2023-12-08T08:17:57.780942+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780942+0000","last_undegraded":"2023-12-08T08:17:57.780942+0000","last_fullsized":"2023-12-08T08:17:57.780942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:13.633709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756676+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:55.756676+0000","last_peered":"2023-12-08T08:17:55.756676+0000","last_clean":"2023-12-08T08:17:55.756676+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:55.756676+0000","last_undegraded":"2023-12-08T08:17:55.756676+0000","last_fullsized":"2023-12-08T08:17:55.756676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779115+0000","last_change":"2023-12-08T08:17:57.779115+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779115+0000","last_undegraded":"2023-12-08T08:17:57.779115+0000","last_fullsized":"2023-12-08T08:17:57.779115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774612+0000","last_change":"2023-12-08T08:17:48.251716+0000","last_active":"2023-12-08T08:17:56.774612+0000","last_peered":"2023-12-08T08:17:56.774612+0000","last_clean":"2023-12-08T08:17:56.774612+0000","last_became_active":"2023-12-08T08:17:48.250928+0000","last_became_peered":"2023-12-08T08:17:48.250928+0000","last_unstale":"2023-12-08T08:17:56.774612+0000","last_undegraded":"2023-12-08T08:17:56.774612+0000","last_fullsized":"2023-12-08T08:17:56.774612+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763848+0000","last_change":"2023-12-08T08:17:57.763848+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763848+0000","last_undegraded":"2023-12-08T08:17:57.763848+0000","last_fullsized":"2023-12-08T08:17:57.763848+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:36.597031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784305+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:56.784305+0000","last_peered":"2023-12-08T08:17:56.784305+0000","last_clean":"2023-12-08T08:17:56.784305+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:56.784305+0000","last_undegraded":"2023-12-08T08:17:56.784305+0000","last_fullsized":"2023-12-08T08:17:56.784305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779114+0000","last_change":"2023-12-08T08:17:57.779114+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779114+0000","last_undegraded":"2023-12-08T08:17:57.779114+0000","last_fullsized":"2023-12-08T08:17:57.779114+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759000+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:55.759000+0000","last_peered":"2023-12-08T08:17:55.759000+0000","last_clean":"2023-12-08T08:17:55.759000+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:55.759000+0000","last_undegraded":"2023-12-08T08:17:55.759000+0000","last_fullsized":"2023-12-08T08:17:55.759000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.765929+0000","last_change":"2023-12-08T08:17:56.765929+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.765929+0000","last_undegraded":"2023-12-08T08:17:56.765929+0000","last_fullsized":"2023-12-08T08:17:56.765929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761411+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:55.761411+0000","last_peered":"2023-12-08T08:17:55.761411+0000","last_clean":"2023-12-08T08:17:55.761411+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:55.761411+0000","last_undegraded":"2023-12-08T08:17:55.761411+0000","last_fullsized":"2023-12-08T08:17:55.761411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:38.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.761100+0000","last_change":"2023-12-08T08:17:56.761100+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.761100+0000","last_undegraded":"2023-12-08T08:17:56.761100+0000","last_fullsized":"2023-12-08T08:17:56.761100+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752722+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:55.752722+0000","last_peered":"2023-12-08T08:17:55.752722+0000","last_clean":"2023-12-08T08:17:55.752722+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:55.752722+0000","last_undegraded":"2023-12-08T08:17:55.752722+0000","last_fullsized":"2023-12-08T08:17:55.752722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779324+0000","last_change":"2023-12-08T08:17:57.779324+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779324+0000","last_undegraded":"2023-12-08T08:17:57.779324+0000","last_fullsized":"2023-12-08T08:17:57.779324+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:36.537524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780196+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:56.780196+0000","last_peered":"2023-12-08T08:17:56.780196+0000","last_clean":"2023-12-08T08:17:56.780196+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:56.780196+0000","last_undegraded":"2023-12-08T08:17:56.780196+0000","last_fullsized":"2023-12-08T08:17:56.780196+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:07.769792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.763333+0000","last_change":"2023-12-08T08:17:56.763333+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.763333+0000","last_undegraded":"2023-12-08T08:17:56.763333+0000","last_fullsized":"2023-12-08T08:17:56.763333+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765778+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:56.765778+0000","last_peered":"2023-12-08T08:17:56.765778+0000","last_clean":"2023-12-08T08:17:56.765778+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:56.765778+0000","last_undegraded":"2023-12-08T08:17:56.765778+0000","last_fullsized":"2023-12-08T08:17:56.765778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:48.031268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776869+0000","last_change":"2023-12-08T08:17:57.776869+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776869+0000","last_undegraded":"2023-12-08T08:17:57.776869+0000","last_fullsized":"2023-12-08T08:17:57.776869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:22.724525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755071+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:56.755071+0000","last_peered":"2023-12-08T08:17:56.755071+0000","last_clean":"2023-12-08T08:17:56.755071+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:56.755071+0000","last_undegraded":"2023-12-08T08:17:56.755071+0000","last_fullsized":"2023-12-08T08:17:56.755071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:53.659318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775535+0000","last_change":"2023-12-08T08:17:57.775535+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775535+0000","last_undegraded":"2023-12-08T08:17:57.775535+0000","last_fullsized":"2023-12-08T08:17:57.775535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784584+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:56.784584+0000","last_peered":"2023-12-08T08:17:56.784584+0000","last_clean":"2023-12-08T08:17:56.784584+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:56.784584+0000","last_undegraded":"2023-12-08T08:17:56.784584+0000","last_fullsized":"2023-12-08T08:17:56.784584+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778888+0000","last_change":"2023-12-08T08:17:57.778888+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778888+0000","last_undegraded":"2023-12-08T08:17:57.778888+0000","last_fullsized":"2023-12-08T08:17:57.778888+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:15:24.195559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795162+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:56.795162+0000","last_peered":"2023-12-08T08:17:56.795162+0000","last_clean":"2023-12-08T08:17:56.795162+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:56.795162+0000","last_undegraded":"2023-12-08T08:17:56.795162+0000","last_fullsized":"2023-12-08T08:17:56.795162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760361+0000","last_change":"2023-12-08T08:17:57.760361+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760361+0000","last_undegraded":"2023-12-08T08:17:57.760361+0000","last_fullsized":"2023-12-08T08:17:57.760361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:01:41.070452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773011+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:56.773011+0000","last_peered":"2023-12-08T08:17:56.773011+0000","last_clean":"2023-12-08T08:17:56.773011+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:56.773011+0000","last_undegraded":"2023-12-08T08:17:56.773011+0000","last_fullsized":"2023-12-08T08:17:56.773011+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790074+0000","last_change":"2023-12-08T08:17:57.790074+0000","last_active":"2023-12-08T08:17:57.790074+0000","last_peered":"2023-12-08T08:17:57.790074+0000","last_clean":"2023-12-08T08:17:57.790074+0000","last_became_active":"2023-12-08T08:17:57.789798+0000","last_became_peered":"2023-12-08T08:17:57.789798+0000","last_unstale":"2023-12-08T08:17:57.790074+0000","last_undegraded":"2023-12-08T08:17:57.790074+0000","last_fullsized":"2023-12-08T08:17:57.790074+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.759411+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:55.759411+0000","last_peered":"2023-12-08T08:17:55.759411+0000","last_clean":"2023-12-08T08:17:55.759411+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:55.759411+0000","last_undegraded":"2023-12-08T08:17:55.759411+0000","last_fullsized":"2023-12-08T08:17:55.759411+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765064+0000","last_change":"2023-12-08T08:17:57.765064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765064+0000","last_undegraded":"2023-12-08T08:17:57.765064+0000","last_fullsized":"2023-12-08T08:17:57.765064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:34:24.223268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772444+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:56.772444+0000","last_peered":"2023-12-08T08:17:56.772444+0000","last_clean":"2023-12-08T08:17:56.772444+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:56.772444+0000","last_undegraded":"2023-12-08T08:17:56.772444+0000","last_fullsized":"2023-12-08T08:17:56.772444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:45.955555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777534+0000","last_change":"2023-12-08T08:17:57.777534+0000","last_active":"2023-12-08T08:17:57.777534+0000","last_peered":"2023-12-08T08:17:57.777534+0000","last_clean":"2023-12-08T08:17:57.777534+0000","last_became_active":"2023-12-08T08:17:57.777268+0000","last_became_peered":"2023-12-08T08:17:57.777268+0000","last_unstale":"2023-12-08T08:17:57.777534+0000","last_undegraded":"2023-12-08T08:17:57.777534+0000","last_fullsized":"2023-12-08T08:17:57.777534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:20:04.336513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771357+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:56.771357+0000","last_peered":"2023-12-08T08:17:56.771357+0000","last_clean":"2023-12-08T08:17:56.771357+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:56.771357+0000","last_undegraded":"2023-12-08T08:17:56.771357+0000","last_fullsized":"2023-12-08T08:17:56.771357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:27.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.803290+0000","last_change":"2023-12-08T08:17:57.803290+0000","last_active":"2023-12-08T08:17:57.803290+0000","last_peered":"2023-12-08T08:17:57.803290+0000","last_clean":"2023-12-08T08:17:57.803290+0000","last_became_active":"2023-12-08T08:17:57.802999+0000","last_became_peered":"2023-12-08T08:17:57.802999+0000","last_unstale":"2023-12-08T08:17:57.803290+0000","last_undegraded":"2023-12-08T08:17:57.803290+0000","last_fullsized":"2023-12-08T08:17:57.803290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:01:45.610748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779207+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:56.779207+0000","last_peered":"2023-12-08T08:17:56.779207+0000","last_clean":"2023-12-08T08:17:56.779207+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:56.779207+0000","last_undegraded":"2023-12-08T08:17:56.779207+0000","last_fullsized":"2023-12-08T08:17:56.779207+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775244+0000","last_change":"2023-12-08T08:17:57.775244+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775244+0000","last_undegraded":"2023-12-08T08:17:57.775244+0000","last_fullsized":"2023-12-08T08:17:57.775244+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:15.750669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762344+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:55.762344+0000","last_peered":"2023-12-08T08:17:55.762344+0000","last_clean":"2023-12-08T08:17:55.762344+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:55.762344+0000","last_undegraded":"2023-12-08T08:17:55.762344+0000","last_fullsized":"2023-12-08T08:17:55.762344+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777744+0000","last_change":"2023-12-08T08:17:57.777744+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777744+0000","last_undegraded":"2023-12-08T08:17:57.777744+0000","last_fullsized":"2023-12-08T08:17:57.777744+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761646+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:55.761646+0000","last_peered":"2023-12-08T08:17:55.761646+0000","last_clean":"2023-12-08T08:17:55.761646+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:55.761646+0000","last_undegraded":"2023-12-08T08:17:55.761646+0000","last_fullsized":"2023-12-08T08:17:55.761646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.767468+0000","last_change":"2023-12-08T08:17:56.767468+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.767468+0000","last_undegraded":"2023-12-08T08:17:56.767468+0000","last_fullsized":"2023-12-08T08:17:56.767468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784391+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:56.784391+0000","last_peered":"2023-12-08T08:17:56.784391+0000","last_clean":"2023-12-08T08:17:56.784391+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:56.784391+0000","last_undegraded":"2023-12-08T08:17:56.784391+0000","last_fullsized":"2023-12-08T08:17:56.784391+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777837+0000","last_change":"2023-12-08T08:17:57.777837+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777837+0000","last_undegraded":"2023-12-08T08:17:57.777837+0000","last_fullsized":"2023-12-08T08:17:57.777837+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754291+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:56.754291+0000","last_peered":"2023-12-08T08:17:56.754291+0000","last_clean":"2023-12-08T08:17:56.754291+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:56.754291+0000","last_undegraded":"2023-12-08T08:17:56.754291+0000","last_fullsized":"2023-12-08T08:17:56.754291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:11:24.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.771678+0000","last_change":"2023-12-08T08:17:56.771678+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.771678+0000","last_undegraded":"2023-12-08T08:17:56.771678+0000","last_fullsized":"2023-12-08T08:17:56.771678+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752706+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:55.752706+0000","last_peered":"2023-12-08T08:17:55.752706+0000","last_clean":"2023-12-08T08:17:55.752706+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:55.752706+0000","last_undegraded":"2023-12-08T08:17:55.752706+0000","last_fullsized":"2023-12-08T08:17:55.752706+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.760042+0000","last_change":"2023-12-08T08:17:57.760042+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.760042+0000","last_undegraded":"2023-12-08T08:17:57.760042+0000","last_fullsized":"2023-12-08T08:17:57.760042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:58.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760113+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:55.760113+0000","last_peered":"2023-12-08T08:17:55.760113+0000","last_clean":"2023-12-08T08:17:55.760113+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:55.760113+0000","last_undegraded":"2023-12-08T08:17:55.760113+0000","last_fullsized":"2023-12-08T08:17:55.760113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.782317+0000","last_change":"2023-12-08T08:17:57.782317+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.782317+0000","last_undegraded":"2023-12-08T08:17:57.782317+0000","last_fullsized":"2023-12-08T08:17:57.782317+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784456+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:56.784456+0000","last_peered":"2023-12-08T08:17:56.784456+0000","last_clean":"2023-12-08T08:17:56.784456+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:56.784456+0000","last_undegraded":"2023-12-08T08:17:56.784456+0000","last_fullsized":"2023-12-08T08:17:56.784456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.760566+0000","last_change":"2023-12-08T08:17:56.760566+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.760566+0000","last_undegraded":"2023-12-08T08:17:56.760566+0000","last_fullsized":"2023-12-08T08:17:56.760566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769710+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:56.769710+0000","last_peered":"2023-12-08T08:17:56.769710+0000","last_clean":"2023-12-08T08:17:56.769710+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:56.769710+0000","last_undegraded":"2023-12-08T08:17:56.769710+0000","last_fullsized":"2023-12-08T08:17:56.769710+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783622+0000","last_change":"2023-12-08T08:17:57.783622+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783622+0000","last_undegraded":"2023-12-08T08:17:57.783622+0000","last_fullsized":"2023-12-08T08:17:57.783622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:31.796515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799963+0000","last_change":"2023-12-08T08:17:56.795327+0000","last_active":"2023-12-08T08:17:56.799963+0000","last_peered":"2023-12-08T08:17:56.799963+0000","last_clean":"2023-12-08T08:17:56.799963+0000","last_became_active":"2023-12-08T08:17:56.795056+0000","last_became_peered":"2023-12-08T08:17:56.795056+0000","last_unstale":"2023-12-08T08:17:56.799963+0000","last_undegraded":"2023-12-08T08:17:56.799963+0000","last_fullsized":"2023-12-08T08:17:56.799963+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:25.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.796743+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:56.796743+0000","last_peered":"2023-12-08T08:17:56.796743+0000","last_clean":"2023-12-08T08:17:56.796743+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:56.796743+0000","last_undegraded":"2023-12-08T08:17:56.796743+0000","last_fullsized":"2023-12-08T08:17:56.796743+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":21,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.755302+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:56.755302+0000","last_peered":"2023-12-08T08:17:56.755302+0000","last_clean":"2023-12-08T08:17:56.755302+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:56.755302+0000","last_undegraded":"2023-12-08T08:17:56.755302+0000","last_fullsized":"2023-12-08T08:17:56.755302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784216+0000","last_change":"2023-12-08T08:17:57.784216+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784216+0000","last_undegraded":"2023-12-08T08:17:57.784216+0000","last_fullsized":"2023-12-08T08:17:57.784216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:00:56.423817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767497+0000","last_change":"2023-12-08T08:17:56.798852+0000","last_active":"2023-12-08T08:17:57.767497+0000","last_peered":"2023-12-08T08:17:57.767497+0000","last_clean":"2023-12-08T08:17:57.767497+0000","last_became_active":"2023-12-08T08:17:56.798551+0000","last_became_peered":"2023-12-08T08:17:56.798551+0000","last_unstale":"2023-12-08T08:17:57.767497+0000","last_undegraded":"2023-12-08T08:17:57.767497+0000","last_fullsized":"2023-12-08T08:17:57.767497+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:17.192846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784491+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:56.784491+0000","last_peered":"2023-12-08T08:17:56.784491+0000","last_clean":"2023-12-08T08:17:56.784491+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:56.784491+0000","last_undegraded":"2023-12-08T08:17:56.784491+0000","last_fullsized":"2023-12-08T08:17:56.784491+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757857+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:55.757857+0000","last_peered":"2023-12-08T08:17:55.757857+0000","last_clean":"2023-12-08T08:17:55.757857+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:55.757857+0000","last_undegraded":"2023-12-08T08:17:55.757857+0000","last_fullsized":"2023-12-08T08:17:55.757857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.794889+0000","last_change":"2023-12-08T08:17:57.794889+0000","last_active":"2023-12-08T08:17:57.794889+0000","last_peered":"2023-12-08T08:17:57.794889+0000","last_clean":"2023-12-08T08:17:57.794889+0000","last_became_active":"2023-12-08T08:17:57.794635+0000","last_became_peered":"2023-12-08T08:17:57.794635+0000","last_unstale":"2023-12-08T08:17:57.794889+0000","last_undegraded":"2023-12-08T08:17:57.794889+0000","last_fullsized":"2023-12-08T08:17:57.794889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:24:08.558071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.761744+0000","last_change":"2023-12-08T08:17:56.783004+0000","last_active":"2023-12-08T08:17:57.761744+0000","last_peered":"2023-12-08T08:17:57.761744+0000","last_clean":"2023-12-08T08:17:57.761744+0000","last_became_active":"2023-12-08T08:17:56.780718+0000","last_became_peered":"2023-12-08T08:17:56.780718+0000","last_unstale":"2023-12-08T08:17:57.761744+0000","last_undegraded":"2023-12-08T08:17:57.761744+0000","last_fullsized":"2023-12-08T08:17:57.761744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:03.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757817+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:55.757817+0000","last_peered":"2023-12-08T08:17:55.757817+0000","last_clean":"2023-12-08T08:17:55.757817+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:55.757817+0000","last_undegraded":"2023-12-08T08:17:55.757817+0000","last_fullsized":"2023-12-08T08:17:55.757817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757497+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:55.757497+0000","last_peered":"2023-12-08T08:17:55.757497+0000","last_clean":"2023-12-08T08:17:55.757497+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:55.757497+0000","last_undegraded":"2023-12-08T08:17:55.757497+0000","last_fullsized":"2023-12-08T08:17:55.757497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.772153+0000","last_change":"2023-12-08T08:17:57.772153+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.772153+0000","last_undegraded":"2023-12-08T08:17:57.772153+0000","last_fullsized":"2023-12-08T08:17:57.772153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:37.945325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800046+0000","last_change":"2023-12-08T08:17:56.796020+0000","last_active":"2023-12-08T08:17:56.800046+0000","last_peered":"2023-12-08T08:17:56.800046+0000","last_clean":"2023-12-08T08:17:56.800046+0000","last_became_active":"2023-12-08T08:17:56.795600+0000","last_became_peered":"2023-12-08T08:17:56.795600+0000","last_unstale":"2023-12-08T08:17:56.800046+0000","last_undegraded":"2023-12-08T08:17:56.800046+0000","last_fullsized":"2023-12-08T08:17:56.800046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:30:24.340680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756226+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:55.756226+0000","last_peered":"2023-12-08T08:17:55.756226+0000","last_clean":"2023-12-08T08:17:55.756226+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:55.756226+0000","last_undegraded":"2023-12-08T08:17:55.756226+0000","last_fullsized":"2023-12-08T08:17:55.756226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757057+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:55.757057+0000","last_peered":"2023-12-08T08:17:55.757057+0000","last_clean":"2023-12-08T08:17:55.757057+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:55.757057+0000","last_undegraded":"2023-12-08T08:17:55.757057+0000","last_fullsized":"2023-12-08T08:17:55.757057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.777217+0000","last_change":"2023-12-08T08:17:57.777217+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.777217+0000","last_undegraded":"2023-12-08T08:17:57.777217+0000","last_fullsized":"2023-12-08T08:17:57.777217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:28:42.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.781239+0000","last_change":"2023-12-08T08:17:56.785550+0000","last_active":"2023-12-08T08:17:57.781239+0000","last_peered":"2023-12-08T08:17:57.781239+0000","last_clean":"2023-12-08T08:17:57.781239+0000","last_became_active":"2023-12-08T08:17:56.785143+0000","last_became_peered":"2023-12-08T08:17:56.785143+0000","last_unstale":"2023-12-08T08:17:57.781239+0000","last_undegraded":"2023-12-08T08:17:57.781239+0000","last_fullsized":"2023-12-08T08:17:57.781239+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:41.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.765877+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:56.765877+0000","last_peered":"2023-12-08T08:17:56.765877+0000","last_clean":"2023-12-08T08:17:56.765877+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:56.765877+0000","last_undegraded":"2023-12-08T08:17:56.765877+0000","last_fullsized":"2023-12-08T08:17:56.765877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:50.669464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771471+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:56.771471+0000","last_peered":"2023-12-08T08:17:56.771471+0000","last_clean":"2023-12-08T08:17:56.771471+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:56.771471+0000","last_undegraded":"2023-12-08T08:17:56.771471+0000","last_fullsized":"2023-12-08T08:17:56.771471+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.765847+0000","last_change":"2023-12-08T08:17:57.765847+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.765847+0000","last_undegraded":"2023-12-08T08:17:57.765847+0000","last_fullsized":"2023-12-08T08:17:57.765847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759772+0000","last_change":"2023-12-08T08:17:56.787431+0000","last_active":"2023-12-08T08:17:57.759772+0000","last_peered":"2023-12-08T08:17:57.759772+0000","last_clean":"2023-12-08T08:17:57.759772+0000","last_became_active":"2023-12-08T08:17:56.787150+0000","last_became_peered":"2023-12-08T08:17:56.787150+0000","last_unstale":"2023-12-08T08:17:57.759772+0000","last_undegraded":"2023-12-08T08:17:57.759772+0000","last_fullsized":"2023-12-08T08:17:57.759772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:02.405102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754138+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:56.754138+0000","last_peered":"2023-12-08T08:17:56.754138+0000","last_clean":"2023-12-08T08:17:56.754138+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:56.754138+0000","last_undegraded":"2023-12-08T08:17:56.754138+0000","last_fullsized":"2023-12-08T08:17:56.754138+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:49.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772541+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:56.772541+0000","last_peered":"2023-12-08T08:17:56.772541+0000","last_clean":"2023-12-08T08:17:56.772541+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:56.772541+0000","last_undegraded":"2023-12-08T08:17:56.772541+0000","last_fullsized":"2023-12-08T08:17:56.772541+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.779412+0000","last_change":"2023-12-08T08:17:57.779412+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.779412+0000","last_undegraded":"2023-12-08T08:17:57.779412+0000","last_fullsized":"2023-12-08T08:17:57.779412+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:21.091888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784629+0000","last_change":"2023-12-08T08:17:56.793596+0000","last_active":"2023-12-08T08:17:57.784629+0000","last_peered":"2023-12-08T08:17:57.784629+0000","last_clean":"2023-12-08T08:17:57.784629+0000","last_became_active":"2023-12-08T08:17:56.793096+0000","last_became_peered":"2023-12-08T08:17:56.793096+0000","last_unstale":"2023-12-08T08:17:57.784629+0000","last_undegraded":"2023-12-08T08:17:57.784629+0000","last_fullsized":"2023-12-08T08:17:57.784629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:06.204089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793718+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:56.793718+0000","last_peered":"2023-12-08T08:17:56.793718+0000","last_clean":"2023-12-08T08:17:56.793718+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:56.793718+0000","last_undegraded":"2023-12-08T08:17:56.793718+0000","last_fullsized":"2023-12-08T08:17:56.793718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771450+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:56.771450+0000","last_peered":"2023-12-08T08:17:56.771450+0000","last_clean":"2023-12-08T08:17:56.771450+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:56.771450+0000","last_undegraded":"2023-12-08T08:17:56.771450+0000","last_fullsized":"2023-12-08T08:17:56.771450+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778378+0000","last_change":"2023-12-08T08:17:57.778378+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778378+0000","last_undegraded":"2023-12-08T08:17:57.778378+0000","last_fullsized":"2023-12-08T08:17:57.778378+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776742+0000","last_change":"2023-12-08T08:17:56.772823+0000","last_active":"2023-12-08T08:17:56.776742+0000","last_peered":"2023-12-08T08:17:56.776742+0000","last_clean":"2023-12-08T08:17:56.776742+0000","last_became_active":"2023-12-08T08:17:56.772152+0000","last_became_peered":"2023-12-08T08:17:56.772152+0000","last_unstale":"2023-12-08T08:17:56.776742+0000","last_undegraded":"2023-12-08T08:17:56.776742+0000","last_fullsized":"2023-12-08T08:17:56.776742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:00.732887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773308+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:56.773308+0000","last_peered":"2023-12-08T08:17:56.773308+0000","last_clean":"2023-12-08T08:17:56.773308+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:56.773308+0000","last_undegraded":"2023-12-08T08:17:56.773308+0000","last_fullsized":"2023-12-08T08:17:56.773308+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793563+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:56.793563+0000","last_peered":"2023-12-08T08:17:56.793563+0000","last_clean":"2023-12-08T08:17:56.793563+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:56.793563+0000","last_undegraded":"2023-12-08T08:17:56.793563+0000","last_fullsized":"2023-12-08T08:17:56.793563+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778739+0000","last_change":"2023-12-08T08:17:57.778739+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778739+0000","last_undegraded":"2023-12-08T08:17:57.778739+0000","last_fullsized":"2023-12-08T08:17:57.778739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:11.051763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759830+0000","last_change":"2023-12-08T08:17:56.778625+0000","last_active":"2023-12-08T08:17:57.759830+0000","last_peered":"2023-12-08T08:17:57.759830+0000","last_clean":"2023-12-08T08:17:57.759830+0000","last_became_active":"2023-12-08T08:17:56.778322+0000","last_became_peered":"2023-12-08T08:17:56.778322+0000","last_unstale":"2023-12-08T08:17:57.759830+0000","last_undegraded":"2023-12-08T08:17:57.759830+0000","last_fullsized":"2023-12-08T08:17:57.759830+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:15.872633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754380+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:56.754380+0000","last_peered":"2023-12-08T08:17:56.754380+0000","last_clean":"2023-12-08T08:17:56.754380+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:56.754380+0000","last_undegraded":"2023-12-08T08:17:56.754380+0000","last_fullsized":"2023-12-08T08:17:56.754380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:19.234272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.758014+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:55.758014+0000","last_peered":"2023-12-08T08:17:55.758014+0000","last_clean":"2023-12-08T08:17:55.758014+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:55.758014+0000","last_undegraded":"2023-12-08T08:17:55.758014+0000","last_fullsized":"2023-12-08T08:17:55.758014+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776810+0000","last_change":"2023-12-08T08:17:57.776810+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776810+0000","last_undegraded":"2023-12-08T08:17:57.776810+0000","last_fullsized":"2023-12-08T08:17:57.776810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:29.646735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767848+0000","last_change":"2023-12-08T08:17:56.796421+0000","last_active":"2023-12-08T08:17:57.767848+0000","last_peered":"2023-12-08T08:17:57.767848+0000","last_clean":"2023-12-08T08:17:57.767848+0000","last_became_active":"2023-12-08T08:17:56.795882+0000","last_became_peered":"2023-12-08T08:17:56.795882+0000","last_unstale":"2023-12-08T08:17:57.767848+0000","last_undegraded":"2023-12-08T08:17:57.767848+0000","last_fullsized":"2023-12-08T08:17:57.767848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:20.323825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773753+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:56.773753+0000","last_peered":"2023-12-08T08:17:56.773753+0000","last_clean":"2023-12-08T08:17:56.773753+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:56.773753+0000","last_undegraded":"2023-12-08T08:17:56.773753+0000","last_fullsized":"2023-12-08T08:17:56.773753+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.781626+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:56.781626+0000","last_peered":"2023-12-08T08:17:56.781626+0000","last_clean":"2023-12-08T08:17:56.781626+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:56.781626+0000","last_undegraded":"2023-12-08T08:17:56.781626+0000","last_fullsized":"2023-12-08T08:17:56.781626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.770802+0000","last_change":"2023-12-08T08:17:57.770802+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.770802+0000","last_undegraded":"2023-12-08T08:17:57.770802+0000","last_fullsized":"2023-12-08T08:17:57.770802+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800011+0000","last_change":"2023-12-08T08:17:56.796029+0000","last_active":"2023-12-08T08:17:56.800011+0000","last_peered":"2023-12-08T08:17:56.800011+0000","last_clean":"2023-12-08T08:17:56.800011+0000","last_became_active":"2023-12-08T08:17:56.795266+0000","last_became_peered":"2023-12-08T08:17:56.795266+0000","last_unstale":"2023-12-08T08:17:56.800011+0000","last_undegraded":"2023-12-08T08:17:56.800011+0000","last_fullsized":"2023-12-08T08:17:56.800011+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:54.839448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795131+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:56.795131+0000","last_peered":"2023-12-08T08:17:56.795131+0000","last_clean":"2023-12-08T08:17:56.795131+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:56.795131+0000","last_undegraded":"2023-12-08T08:17:56.795131+0000","last_fullsized":"2023-12-08T08:17:56.795131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753596+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:55.753596+0000","last_peered":"2023-12-08T08:17:55.753596+0000","last_clean":"2023-12-08T08:17:55.753596+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:55.753596+0000","last_undegraded":"2023-12-08T08:17:55.753596+0000","last_fullsized":"2023-12-08T08:17:55.753596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759400+0000","last_change":"2023-12-08T08:17:56.759400+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759400+0000","last_undegraded":"2023-12-08T08:17:56.759400+0000","last_fullsized":"2023-12-08T08:17:56.759400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.788509+0000","last_change":"2023-12-08T08:17:56.784864+0000","last_active":"2023-12-08T08:17:56.788509+0000","last_peered":"2023-12-08T08:17:56.788509+0000","last_clean":"2023-12-08T08:17:56.788509+0000","last_became_active":"2023-12-08T08:17:56.784452+0000","last_became_peered":"2023-12-08T08:17:56.784452+0000","last_unstale":"2023-12-08T08:17:56.788509+0000","last_undegraded":"2023-12-08T08:17:56.788509+0000","last_fullsized":"2023-12-08T08:17:56.788509+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:34.245758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.745578+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:55.745578+0000","last_peered":"2023-12-08T08:17:55.745578+0000","last_clean":"2023-12-08T08:17:55.745578+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:55.745578+0000","last_undegraded":"2023-12-08T08:17:55.745578+0000","last_fullsized":"2023-12-08T08:17:55.745578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:37.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":25,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754545+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:56.754545+0000","last_peered":"2023-12-08T08:17:56.754545+0000","last_clean":"2023-12-08T08:17:56.754545+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:56.754545+0000","last_undegraded":"2023-12-08T08:17:56.754545+0000","last_fullsized":"2023-12-08T08:17:56.754545+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763151+0000","last_change":"2023-12-08T08:17:57.763151+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763151+0000","last_undegraded":"2023-12-08T08:17:57.763151+0000","last_fullsized":"2023-12-08T08:17:57.763151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.762324+0000","last_change":"2023-12-08T08:17:56.777484+0000","last_active":"2023-12-08T08:17:57.762324+0000","last_peered":"2023-12-08T08:17:57.762324+0000","last_clean":"2023-12-08T08:17:57.762324+0000","last_became_active":"2023-12-08T08:17:56.776424+0000","last_became_peered":"2023-12-08T08:17:56.776424+0000","last_unstale":"2023-12-08T08:17:57.762324+0000","last_undegraded":"2023-12-08T08:17:57.762324+0000","last_fullsized":"2023-12-08T08:17:57.762324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:23.600820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782758+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:56.782758+0000","last_peered":"2023-12-08T08:17:56.782758+0000","last_clean":"2023-12-08T08:17:56.782758+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:56.782758+0000","last_undegraded":"2023-12-08T08:17:56.782758+0000","last_fullsized":"2023-12-08T08:17:56.782758+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.752880+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:55.752880+0000","last_peered":"2023-12-08T08:17:55.752880+0000","last_clean":"2023-12-08T08:17:55.752880+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:55.752880+0000","last_undegraded":"2023-12-08T08:17:55.752880+0000","last_fullsized":"2023-12-08T08:17:55.752880+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764868+0000","last_change":"2023-12-08T08:17:57.764868+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764868+0000","last_undegraded":"2023-12-08T08:17:57.764868+0000","last_fullsized":"2023-12-08T08:17:57.764868+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.776109+0000","last_change":"2023-12-08T08:17:56.789756+0000","last_active":"2023-12-08T08:17:57.776109+0000","last_peered":"2023-12-08T08:17:57.776109+0000","last_clean":"2023-12-08T08:17:57.776109+0000","last_became_active":"2023-12-08T08:17:56.789515+0000","last_became_peered":"2023-12-08T08:17:56.789515+0000","last_unstale":"2023-12-08T08:17:57.776109+0000","last_undegraded":"2023-12-08T08:17:57.776109+0000","last_fullsized":"2023-12-08T08:17:57.776109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:10.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760588+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:55.760588+0000","last_peered":"2023-12-08T08:17:55.760588+0000","last_clean":"2023-12-08T08:17:55.760588+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:55.760588+0000","last_undegraded":"2023-12-08T08:17:55.760588+0000","last_fullsized":"2023-12-08T08:17:55.760588+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760270+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:55.760270+0000","last_peered":"2023-12-08T08:17:55.760270+0000","last_clean":"2023-12-08T08:17:55.760270+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:55.760270+0000","last_undegraded":"2023-12-08T08:17:55.760270+0000","last_fullsized":"2023-12-08T08:17:55.760270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.759427+0000","last_change":"2023-12-08T08:17:56.759427+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.759427+0000","last_undegraded":"2023-12-08T08:17:56.759427+0000","last_fullsized":"2023-12-08T08:17:56.759427+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.789798+0000","last_change":"2023-12-08T08:17:56.788069+0000","last_active":"2023-12-08T08:17:56.789798+0000","last_peered":"2023-12-08T08:17:56.789798+0000","last_clean":"2023-12-08T08:17:56.789798+0000","last_became_active":"2023-12-08T08:17:56.787757+0000","last_became_peered":"2023-12-08T08:17:56.787757+0000","last_unstale":"2023-12-08T08:17:56.789798+0000","last_undegraded":"2023-12-08T08:17:56.789798+0000","last_fullsized":"2023-12-08T08:17:56.789798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793817+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:56.793817+0000","last_peered":"2023-12-08T08:17:56.793817+0000","last_clean":"2023-12-08T08:17:56.793817+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:56.793817+0000","last_undegraded":"2023-12-08T08:17:56.793817+0000","last_fullsized":"2023-12-08T08:17:56.793817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.780446+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:56.780446+0000","last_peered":"2023-12-08T08:17:56.780446+0000","last_clean":"2023-12-08T08:17:56.780446+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:56.780446+0000","last_undegraded":"2023-12-08T08:17:56.780446+0000","last_fullsized":"2023-12-08T08:17:56.780446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763263+0000","last_change":"2023-12-08T08:17:57.763263+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763263+0000","last_undegraded":"2023-12-08T08:17:57.763263+0000","last_fullsized":"2023-12-08T08:17:57.763263+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.798221+0000","last_change":"2023-12-08T08:17:56.792597+0000","last_active":"2023-12-08T08:17:56.798221+0000","last_peered":"2023-12-08T08:17:56.798221+0000","last_clean":"2023-12-08T08:17:56.798221+0000","last_became_active":"2023-12-08T08:17:56.792311+0000","last_became_peered":"2023-12-08T08:17:56.792311+0000","last_unstale":"2023-12-08T08:17:56.798221+0000","last_undegraded":"2023-12-08T08:17:56.798221+0000","last_fullsized":"2023-12-08T08:17:56.798221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:39.332501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753989+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:56.753989+0000","last_peered":"2023-12-08T08:17:56.753989+0000","last_clean":"2023-12-08T08:17:56.753989+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:56.753989+0000","last_undegraded":"2023-12-08T08:17:56.753989+0000","last_fullsized":"2023-12-08T08:17:56.753989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:13:24.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":42,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782874+0000","last_change":"2023-12-08T08:17:47.914689+0000","last_active":"2023-12-08T08:17:56.782874+0000","last_peered":"2023-12-08T08:17:56.782874+0000","last_clean":"2023-12-08T08:17:56.782874+0000","last_became_active":"2023-12-08T08:17:47.896123+0000","last_became_peered":"2023-12-08T08:17:47.896123+0000","last_unstale":"2023-12-08T08:17:56.782874+0000","last_undegraded":"2023-12-08T08:17:56.782874+0000","last_fullsized":"2023-12-08T08:17:56.782874+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:47.568360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763503+0000","last_change":"2023-12-08T08:17:57.763503+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763503+0000","last_undegraded":"2023-12-08T08:17:57.763503+0000","last_fullsized":"2023-12-08T08:17:57.763503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:58:44.299681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.759949+0000","last_change":"2023-12-08T08:17:56.783471+0000","last_active":"2023-12-08T08:17:57.759949+0000","last_peered":"2023-12-08T08:17:57.759949+0000","last_clean":"2023-12-08T08:17:57.759949+0000","last_became_active":"2023-12-08T08:17:56.782732+0000","last_became_peered":"2023-12-08T08:17:56.782732+0000","last_unstale":"2023-12-08T08:17:57.759949+0000","last_undegraded":"2023-12-08T08:17:57.759949+0000","last_fullsized":"2023-12-08T08:17:57.759949+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753330+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:55.753330+0000","last_peered":"2023-12-08T08:17:55.753330+0000","last_clean":"2023-12-08T08:17:55.753330+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:55.753330+0000","last_undegraded":"2023-12-08T08:17:55.753330+0000","last_fullsized":"2023-12-08T08:17:55.753330+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761923+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:55.761923+0000","last_peered":"2023-12-08T08:17:55.761923+0000","last_clean":"2023-12-08T08:17:55.761923+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:55.761923+0000","last_undegraded":"2023-12-08T08:17:55.761923+0000","last_fullsized":"2023-12-08T08:17:55.761923+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789814+0000","last_change":"2023-12-08T08:17:57.789814+0000","last_active":"2023-12-08T08:17:57.789814+0000","last_peered":"2023-12-08T08:17:57.789814+0000","last_clean":"2023-12-08T08:17:57.789814+0000","last_became_active":"2023-12-08T08:17:57.789121+0000","last_became_peered":"2023-12-08T08:17:57.789121+0000","last_unstale":"2023-12-08T08:17:57.789814+0000","last_undegraded":"2023-12-08T08:17:57.789814+0000","last_fullsized":"2023-12-08T08:17:57.789814+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782602+0000","last_change":"2023-12-08T08:17:56.778284+0000","last_active":"2023-12-08T08:17:57.782602+0000","last_peered":"2023-12-08T08:17:57.782602+0000","last_clean":"2023-12-08T08:17:57.782602+0000","last_became_active":"2023-12-08T08:17:56.777942+0000","last_became_peered":"2023-12-08T08:17:56.777942+0000","last_unstale":"2023-12-08T08:17:57.782602+0000","last_undegraded":"2023-12-08T08:17:57.782602+0000","last_fullsized":"2023-12-08T08:17:57.782602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:35:47.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795227+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:56.795227+0000","last_peered":"2023-12-08T08:17:56.795227+0000","last_clean":"2023-12-08T08:17:56.795227+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:56.795227+0000","last_undegraded":"2023-12-08T08:17:56.795227+0000","last_fullsized":"2023-12-08T08:17:56.795227+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:52.110302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753831+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:55.753831+0000","last_peered":"2023-12-08T08:17:55.753831+0000","last_clean":"2023-12-08T08:17:55.753831+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:55.753831+0000","last_undegraded":"2023-12-08T08:17:55.753831+0000","last_fullsized":"2023-12-08T08:17:55.753831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":4,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.784018+0000","last_change":"2023-12-08T08:17:57.777499+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.784018+0000","last_undegraded":"2023-12-08T08:17:57.784018+0000","last_fullsized":"2023-12-08T08:17:57.784018+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.800071+0000","last_change":"2023-12-08T08:17:56.796644+0000","last_active":"2023-12-08T08:17:56.800071+0000","last_peered":"2023-12-08T08:17:56.800071+0000","last_clean":"2023-12-08T08:17:56.800071+0000","last_became_active":"2023-12-08T08:17:56.796276+0000","last_became_peered":"2023-12-08T08:17:56.796276+0000","last_unstale":"2023-12-08T08:17:56.800071+0000","last_undegraded":"2023-12-08T08:17:56.800071+0000","last_fullsized":"2023-12-08T08:17:56.800071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:22:28.402168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.774697+0000","last_change":"2023-12-08T08:17:47.864253+0000","last_active":"2023-12-08T08:17:56.774697+0000","last_peered":"2023-12-08T08:17:56.774697+0000","last_clean":"2023-12-08T08:17:56.774697+0000","last_became_active":"2023-12-08T08:17:47.863753+0000","last_became_peered":"2023-12-08T08:17:47.863753+0000","last_unstale":"2023-12-08T08:17:56.774697+0000","last_undegraded":"2023-12-08T08:17:56.774697+0000","last_fullsized":"2023-12-08T08:17:56.774697+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:12.401320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753774+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:55.753774+0000","last_peered":"2023-12-08T08:17:55.753774+0000","last_clean":"2023-12-08T08:17:55.753774+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:55.753774+0000","last_undegraded":"2023-12-08T08:17:55.753774+0000","last_fullsized":"2023-12-08T08:17:55.753774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777046+0000","last_change":"2023-12-08T08:17:57.777046+0000","last_active":"2023-12-08T08:17:57.777046+0000","last_peered":"2023-12-08T08:17:57.777046+0000","last_clean":"2023-12-08T08:17:57.777046+0000","last_became_active":"2023-12-08T08:17:57.776718+0000","last_became_peered":"2023-12-08T08:17:57.776718+0000","last_unstale":"2023-12-08T08:17:57.777046+0000","last_undegraded":"2023-12-08T08:17:57.777046+0000","last_fullsized":"2023-12-08T08:17:57.777046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:19:39.870427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787223+0000","last_change":"2023-12-08T08:17:56.780944+0000","last_active":"2023-12-08T08:17:57.787223+0000","last_peered":"2023-12-08T08:17:57.787223+0000","last_clean":"2023-12-08T08:17:57.787223+0000","last_became_active":"2023-12-08T08:17:56.780212+0000","last_became_peered":"2023-12-08T08:17:56.780212+0000","last_unstale":"2023-12-08T08:17:57.787223+0000","last_undegraded":"2023-12-08T08:17:57.787223+0000","last_fullsized":"2023-12-08T08:17:57.787223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:58.661778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794170+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:56.794170+0000","last_peered":"2023-12-08T08:17:56.794170+0000","last_clean":"2023-12-08T08:17:56.794170+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:56.794170+0000","last_undegraded":"2023-12-08T08:17:56.794170+0000","last_fullsized":"2023-12-08T08:17:56.794170+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.773158+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:56.773158+0000","last_peered":"2023-12-08T08:17:56.773158+0000","last_clean":"2023-12-08T08:17:56.773158+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:56.773158+0000","last_undegraded":"2023-12-08T08:17:56.773158+0000","last_fullsized":"2023-12-08T08:17:56.773158+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.775811+0000","last_change":"2023-12-08T08:17:57.775811+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.775811+0000","last_undegraded":"2023-12-08T08:17:57.775811+0000","last_fullsized":"2023-12-08T08:17:57.775811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:57.978934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783322+0000","last_change":"2023-12-08T08:17:56.792427+0000","last_active":"2023-12-08T08:17:57.783322+0000","last_peered":"2023-12-08T08:17:57.783322+0000","last_clean":"2023-12-08T08:17:57.783322+0000","last_became_active":"2023-12-08T08:17:56.792047+0000","last_became_peered":"2023-12-08T08:17:56.792047+0000","last_unstale":"2023-12-08T08:17:57.783322+0000","last_undegraded":"2023-12-08T08:17:57.783322+0000","last_fullsized":"2023-12-08T08:17:57.783322+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769796+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:56.769796+0000","last_peered":"2023-12-08T08:17:56.769796+0000","last_clean":"2023-12-08T08:17:56.769796+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:56.769796+0000","last_undegraded":"2023-12-08T08:17:56.769796+0000","last_fullsized":"2023-12-08T08:17:56.769796+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:14.424829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756879+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:55.756879+0000","last_peered":"2023-12-08T08:17:55.756879+0000","last_clean":"2023-12-08T08:17:55.756879+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:55.756879+0000","last_undegraded":"2023-12-08T08:17:55.756879+0000","last_fullsized":"2023-12-08T08:17:55.756879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.764805+0000","last_change":"2023-12-08T08:17:57.764805+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.764805+0000","last_undegraded":"2023-12-08T08:17:57.764805+0000","last_fullsized":"2023-12-08T08:17:57.764805+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777848+0000","last_change":"2023-12-08T08:17:56.791954+0000","last_active":"2023-12-08T08:17:57.777848+0000","last_peered":"2023-12-08T08:17:57.777848+0000","last_clean":"2023-12-08T08:17:57.777848+0000","last_became_active":"2023-12-08T08:17:56.791571+0000","last_became_peered":"2023-12-08T08:17:56.791571+0000","last_unstale":"2023-12-08T08:17:57.777848+0000","last_undegraded":"2023-12-08T08:17:57.777848+0000","last_fullsized":"2023-12-08T08:17:57.777848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760839+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:55.760839+0000","last_peered":"2023-12-08T08:17:55.760839+0000","last_clean":"2023-12-08T08:17:55.760839+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:55.760839+0000","last_undegraded":"2023-12-08T08:17:55.760839+0000","last_fullsized":"2023-12-08T08:17:55.760839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.760419+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:55.760419+0000","last_peered":"2023-12-08T08:17:55.760419+0000","last_clean":"2023-12-08T08:17:55.760419+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:55.760419+0000","last_undegraded":"2023-12-08T08:17:55.760419+0000","last_fullsized":"2023-12-08T08:17:55.760419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.780184+0000","last_change":"2023-12-08T08:17:57.780184+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.780184+0000","last_undegraded":"2023-12-08T08:17:57.780184+0000","last_fullsized":"2023-12-08T08:17:57.780184+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774643+0000","last_change":"2023-12-08T08:17:56.777768+0000","last_active":"2023-12-08T08:17:57.774643+0000","last_peered":"2023-12-08T08:17:57.774643+0000","last_clean":"2023-12-08T08:17:57.774643+0000","last_became_active":"2023-12-08T08:17:56.776405+0000","last_became_peered":"2023-12-08T08:17:56.776405+0000","last_unstale":"2023-12-08T08:17:57.774643+0000","last_undegraded":"2023-12-08T08:17:57.774643+0000","last_fullsized":"2023-12-08T08:17:57.774643+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:36.931349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793911+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:56.793911+0000","last_peered":"2023-12-08T08:17:56.793911+0000","last_clean":"2023-12-08T08:17:56.793911+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:56.793911+0000","last_undegraded":"2023-12-08T08:17:56.793911+0000","last_fullsized":"2023-12-08T08:17:56.793911+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756715+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:55.756715+0000","last_peered":"2023-12-08T08:17:55.756715+0000","last_clean":"2023-12-08T08:17:55.756715+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:55.756715+0000","last_undegraded":"2023-12-08T08:17:55.756715+0000","last_fullsized":"2023-12-08T08:17:55.756715+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.783189+0000","last_change":"2023-12-08T08:17:57.783189+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.783189+0000","last_undegraded":"2023-12-08T08:17:57.783189+0000","last_fullsized":"2023-12-08T08:17:57.783189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:59.629875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.802501+0000","last_change":"2023-12-08T08:17:56.797511+0000","last_active":"2023-12-08T08:17:56.802501+0000","last_peered":"2023-12-08T08:17:56.802501+0000","last_clean":"2023-12-08T08:17:56.802501+0000","last_became_active":"2023-12-08T08:17:56.796361+0000","last_became_peered":"2023-12-08T08:17:56.796361+0000","last_unstale":"2023-12-08T08:17:56.802501+0000","last_undegraded":"2023-12-08T08:17:56.802501+0000","last_fullsized":"2023-12-08T08:17:56.802501+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:04.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.756921+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:55.756921+0000","last_peered":"2023-12-08T08:17:55.756921+0000","last_clean":"2023-12-08T08:17:55.756921+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:55.756921+0000","last_undegraded":"2023-12-08T08:17:55.756921+0000","last_fullsized":"2023-12-08T08:17:55.756921+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762232+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:55.762232+0000","last_peered":"2023-12-08T08:17:55.762232+0000","last_clean":"2023-12-08T08:17:55.762232+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:55.762232+0000","last_undegraded":"2023-12-08T08:17:55.762232+0000","last_fullsized":"2023-12-08T08:17:55.762232+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.771347+0000","last_change":"2023-12-08T08:17:57.771347+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.771347+0000","last_undegraded":"2023-12-08T08:17:57.771347+0000","last_fullsized":"2023-12-08T08:17:57.771347+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.799920+0000","last_change":"2023-12-08T08:17:56.795117+0000","last_active":"2023-12-08T08:17:56.799920+0000","last_peered":"2023-12-08T08:17:56.799920+0000","last_clean":"2023-12-08T08:17:56.799920+0000","last_became_active":"2023-12-08T08:17:56.794822+0000","last_became_peered":"2023-12-08T08:17:56.794822+0000","last_unstale":"2023-12-08T08:17:56.799920+0000","last_undegraded":"2023-12-08T08:17:56.799920+0000","last_fullsized":"2023-12-08T08:17:56.799920+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:27.379446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.769715+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:56.769715+0000","last_peered":"2023-12-08T08:17:56.769715+0000","last_clean":"2023-12-08T08:17:56.769715+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:56.769715+0000","last_undegraded":"2023-12-08T08:17:56.769715+0000","last_fullsized":"2023-12-08T08:17:56.769715+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:26.299694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.762079+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:55.762079+0000","last_peered":"2023-12-08T08:17:55.762079+0000","last_clean":"2023-12-08T08:17:55.762079+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:55.762079+0000","last_undegraded":"2023-12-08T08:17:55.762079+0000","last_fullsized":"2023-12-08T08:17:55.762079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.776946+0000","last_change":"2023-12-08T08:17:57.776946+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.776946+0000","last_undegraded":"2023-12-08T08:17:57.776946+0000","last_fullsized":"2023-12-08T08:17:57.776946+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:51.673242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.776553+0000","last_change":"2023-12-08T08:17:56.768920+0000","last_active":"2023-12-08T08:17:56.776553+0000","last_peered":"2023-12-08T08:17:56.776553+0000","last_clean":"2023-12-08T08:17:56.776553+0000","last_became_active":"2023-12-08T08:17:56.768205+0000","last_became_peered":"2023-12-08T08:17:56.768205+0000","last_unstale":"2023-12-08T08:17:56.776553+0000","last_undegraded":"2023-12-08T08:17:56.776553+0000","last_fullsized":"2023-12-08T08:17:56.776553+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:00.933681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.761805+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:55.761805+0000","last_peered":"2023-12-08T08:17:55.761805+0000","last_clean":"2023-12-08T08:17:55.761805+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:55.761805+0000","last_undegraded":"2023-12-08T08:17:55.761805+0000","last_fullsized":"2023-12-08T08:17:55.761805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.757709+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:55.757709+0000","last_peered":"2023-12-08T08:17:55.757709+0000","last_clean":"2023-12-08T08:17:55.757709+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:55.757709+0000","last_undegraded":"2023-12-08T08:17:55.757709+0000","last_fullsized":"2023-12-08T08:17:55.757709+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763142+0000","last_change":"2023-12-08T08:17:57.763142+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763142+0000","last_undegraded":"2023-12-08T08:17:57.763142+0000","last_fullsized":"2023-12-08T08:17:57.763142+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:59.675754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.782767+0000","last_change":"2023-12-08T08:17:56.779410+0000","last_active":"2023-12-08T08:17:56.782767+0000","last_peered":"2023-12-08T08:17:56.782767+0000","last_clean":"2023-12-08T08:17:56.782767+0000","last_became_active":"2023-12-08T08:17:56.779079+0000","last_became_peered":"2023-12-08T08:17:56.779079+0000","last_unstale":"2023-12-08T08:17:56.782767+0000","last_undegraded":"2023-12-08T08:17:56.782767+0000","last_fullsized":"2023-12-08T08:17:56.782767+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:03.830927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.795160+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:56.795160+0000","last_peered":"2023-12-08T08:17:56.795160+0000","last_clean":"2023-12-08T08:17:56.795160+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:56.795160+0000","last_undegraded":"2023-12-08T08:17:56.795160+0000","last_fullsized":"2023-12-08T08:17:56.795160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.754636+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:56.754636+0000","last_peered":"2023-12-08T08:17:56.754636+0000","last_clean":"2023-12-08T08:17:56.754636+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:56.754636+0000","last_undegraded":"2023-12-08T08:17:56.754636+0000","last_fullsized":"2023-12-08T08:17:56.754636+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.778064+0000","last_change":"2023-12-08T08:17:57.778064+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.778064+0000","last_undegraded":"2023-12-08T08:17:57.778064+0000","last_fullsized":"2023-12-08T08:17:57.778064+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:11:16.845352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767289+0000","last_change":"2023-12-08T08:17:56.791471+0000","last_active":"2023-12-08T08:17:57.767289+0000","last_peered":"2023-12-08T08:17:57.767289+0000","last_clean":"2023-12-08T08:17:57.767289+0000","last_became_active":"2023-12-08T08:17:56.791079+0000","last_became_peered":"2023-12-08T08:17:56.791079+0000","last_unstale":"2023-12-08T08:17:57.767289+0000","last_undegraded":"2023-12-08T08:17:57.767289+0000","last_fullsized":"2023-12-08T08:17:57.767289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:22.747918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.793570+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:56.793570+0000","last_peered":"2023-12-08T08:17:56.793570+0000","last_clean":"2023-12-08T08:17:56.793570+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:56.793570+0000","last_undegraded":"2023-12-08T08:17:56.793570+0000","last_fullsized":"2023-12-08T08:17:56.793570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-08T08:17:55.753050+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:55.753050+0000","last_peered":"2023-12-08T08:17:55.753050+0000","last_clean":"2023-12-08T08:17:55.753050+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:55.753050+0000","last_undegraded":"2023-12-08T08:17:55.753050+0000","last_fullsized":"2023-12-08T08:17:55.753050+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.805299+0000","last_change":"2023-12-08T08:17:57.797287+0000","last_active":"2023-12-08T08:17:57.805299+0000","last_peered":"2023-12-08T08:17:57.805299+0000","last_clean":"2023-12-08T08:17:57.805299+0000","last_became_active":"2023-12-08T08:17:57.796961+0000","last_became_peered":"2023-12-08T08:17:57.796961+0000","last_unstale":"2023-12-08T08:17:57.805299+0000","last_undegraded":"2023-12-08T08:17:57.805299+0000","last_fullsized":"2023-12-08T08:17:57.805299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:16:05.130558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780644+0000","last_change":"2023-12-08T08:17:56.772809+0000","last_active":"2023-12-08T08:17:57.780644+0000","last_peered":"2023-12-08T08:17:57.780644+0000","last_clean":"2023-12-08T08:17:57.780644+0000","last_became_active":"2023-12-08T08:17:56.772556+0000","last_became_peered":"2023-12-08T08:17:56.772556+0000","last_unstale":"2023-12-08T08:17:57.780644+0000","last_undegraded":"2023-12-08T08:17:57.780644+0000","last_fullsized":"2023-12-08T08:17:57.780644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:48:41.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.784572+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:56.784572+0000","last_peered":"2023-12-08T08:17:56.784572+0000","last_clean":"2023-12-08T08:17:56.784572+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:56.784572+0000","last_undegraded":"2023-12-08T08:17:56.784572+0000","last_fullsized":"2023-12-08T08:17:56.784572+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.772623+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:56.772623+0000","last_peered":"2023-12-08T08:17:56.772623+0000","last_clean":"2023-12-08T08:17:56.772623+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:56.772623+0000","last_undegraded":"2023-12-08T08:17:56.772623+0000","last_fullsized":"2023-12-08T08:17:56.772623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763212+0000","last_change":"2023-12-08T08:17:57.763212+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763212+0000","last_undegraded":"2023-12-08T08:17:57.763212+0000","last_fullsized":"2023-12-08T08:17:57.763212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":["6","3"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767960+0000","last_change":"2023-12-08T08:17:56.798843+0000","last_active":"2023-12-08T08:17:57.767960+0000","last_peered":"2023-12-08T08:17:57.767960+0000","last_clean":"2023-12-08T08:17:57.767960+0000","last_became_active":"2023-12-08T08:17:56.798505+0000","last_became_peered":"2023-12-08T08:17:56.798505+0000","last_unstale":"2023-12-08T08:17:57.767960+0000","last_undegraded":"2023-12-08T08:17:57.767960+0000","last_fullsized":"2023-12-08T08:17:57.767960+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753650+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:56.753650+0000","last_peered":"2023-12-08T08:17:56.753650+0000","last_clean":"2023-12-08T08:17:56.753650+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:56.753650+0000","last_undegraded":"2023-12-08T08:17:56.753650+0000","last_fullsized":"2023-12-08T08:17:56.753650+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:02.769189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771534+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:56.771534+0000","last_peered":"2023-12-08T08:17:56.771534+0000","last_clean":"2023-12-08T08:17:56.771534+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:56.771534+0000","last_undegraded":"2023-12-08T08:17:56.771534+0000","last_fullsized":"2023-12-08T08:17:56.771534+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":3,"reported_epoch":64,"state":"creating+activating","last_fresh":"2023-12-08T08:17:57.763193+0000","last_change":"2023-12-08T08:17:57.763193+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:57.763193+0000","last_undegraded":"2023-12-08T08:17:57.763193+0000","last_fullsized":"2023-12-08T08:17:57.763193+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760454+0000","last_change":"2023-12-08T08:17:56.780631+0000","last_active":"2023-12-08T08:17:57.760454+0000","last_peered":"2023-12-08T08:17:57.760454+0000","last_clean":"2023-12-08T08:17:57.760454+0000","last_became_active":"2023-12-08T08:17:56.780250+0000","last_became_peered":"2023-12-08T08:17:56.780250+0000","last_unstale":"2023-12-08T08:17:57.760454+0000","last_undegraded":"2023-12-08T08:17:57.760454+0000","last_fullsized":"2023-12-08T08:17:57.760454+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:36:12.440569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.768685+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:56.768685+0000","last_peered":"2023-12-08T08:17:56.768685+0000","last_clean":"2023-12-08T08:17:56.768685+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:56.768685+0000","last_undegraded":"2023-12-08T08:17:56.768685+0000","last_fullsized":"2023-12-08T08:17:56.768685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:50.672771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.753821+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:56.753821+0000","last_peered":"2023-12-08T08:17:56.753821+0000","last_clean":"2023-12-08T08:17:56.753821+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:56.753821+0000","last_undegraded":"2023-12-08T08:17:56.753821+0000","last_fullsized":"2023-12-08T08:17:56.753821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-12-08T08:17:56.774154+0000","last_change":"2023-12-08T08:17:56.774154+0000","last_active":"2023-12-08T08:17:56.735537+0000","last_peered":"2023-12-08T08:17:56.735537+0000","last_clean":"2023-12-08T08:17:56.735537+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:17:56.774154+0000","last_undegraded":"2023-12-08T08:17:56.774154+0000","last_fullsized":"2023-12-08T08:17:56.774154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786813+0000","last_change":"2023-12-08T08:17:56.792036+0000","last_active":"2023-12-08T08:17:57.786813+0000","last_peered":"2023-12-08T08:17:57.786813+0000","last_clean":"2023-12-08T08:17:57.786813+0000","last_became_active":"2023-12-08T08:17:56.791709+0000","last_became_peered":"2023-12-08T08:17:56.791709+0000","last_unstale":"2023-12-08T08:17:57.786813+0000","last_undegraded":"2023-12-08T08:17:57.786813+0000","last_fullsized":"2023-12-08T08:17:57.786813+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.794039+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:56.794039+0000","last_peered":"2023-12-08T08:17:56.794039+0000","last_clean":"2023-12-08T08:17:56.794039+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:56.794039+0000","last_undegraded":"2023-12-08T08:17:56.794039+0000","last_fullsized":"2023-12-08T08:17:56.794039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.771104+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:56.771104+0000","last_peered":"2023-12-08T08:17:56.771104+0000","last_clean":"2023-12-08T08:17:56.771104+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:56.771104+0000","last_undegraded":"2023-12-08T08:17:56.771104+0000","last_fullsized":"2023-12-08T08:17:56.771104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-08T08:17:56.779411+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:56.779411+0000","last_peered":"2023-12-08T08:17:56.779411+0000","last_clean":"2023-12-08T08:17:56.779411+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:56.779411+0000","last_undegraded":"2023-12-08T08:17:56.779411+0000","last_fullsized":"2023-12-08T08:17:56.779411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1368064,"data_stored":939182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.58599999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3600000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0860000000000001,"15min":1.0800000000000001},"min":{"1min":0.73999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.153,"15min":1.159},"min":{"1min":0.71099999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.159},{"interface":"front","average":{"1min":1.131,"5min":1.224,"15min":1.24},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.587,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.397}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.175,"15min":1.177},"min":{"1min":0.76800000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.474,"5min":1.863,"15min":1.863},"last":1.042},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1890000000000001,"15min":1.1950000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.325,"15min":1.333},"min":{"1min":0.86199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.6040000000000001,"5min":1.855,"15min":1.855},"last":1.361},{"interface":"front","average":{"1min":1.321,"5min":1.405,"15min":1.419},"min":{"1min":0.92900000000000005,"5min":0.75,"15min":0.75},"max":{"1min":1.671,"5min":3.524,"15min":3.524},"last":1.2649999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.393,"15min":1.407},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.702,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.3600000000000001,"15min":1.353},"min":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.754,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.4450000000000001,"15min":1.4330000000000001},"min":{"1min":0.98799999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.9239999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.508,"15min":1.504},"min":{"1min":0.91500000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0009999999999999,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.2889999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.6419999999999999,"15min":1.6559999999999999},"min":{"1min":0.99299999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.9019999999999999,"5min":2.609,"15min":2.609},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":1.01,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.101,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.4419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.75,"15min":1.857},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4770000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.845,"15min":1.978},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.365,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.131,"15min":1.111},"min":{"1min":0.95099999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4830000000000001,"5min":1.762,"15min":1.762},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.637,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2250000000000001,"15min":1.2370000000000001},"min":{"1min":0.879,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5229999999999999,"5min":2.141,"15min":2.141},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.5680000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3959999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.397,"15min":1.425},"min":{"1min":0.77800000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5600000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.3740000000000001,"15min":1.3939999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.8640000000000001,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.048}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.341,"15min":1.349},"min":{"1min":0.98199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.401,"15min":1.4139999999999999},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6759999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.327}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.484,"15min":1.4990000000000001},"min":{"1min":1.089,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.972,"5min":2.96,"15min":2.96},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":1.208,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7809999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.478,"15min":1.484},"min":{"1min":1.2270000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.7410000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.238},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.595,"15min":1.6140000000000001},"min":{"1min":1.0600000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.0760000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.266}]}]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":348060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.5369999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.208}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.337},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4750000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3759999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.2569999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.1080000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.3049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":770048,"data_stored":351145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.427},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.2430000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.286}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.478},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.125}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.381}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.577},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.639}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.95599999999999996,"15min":0.96599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.03,"15min":1.044},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5459999999999998,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.99299999999999999,"15min":0.99199999999999999},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.123,"15min":1.129},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.85899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.125},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.169,"15min":1.1719999999999999},"min":{"1min":0.53300000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.835,"5min":1.97,"15min":1.97},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.84399999999999997,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.24},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3420000000000001,"15min":1.363},"min":{"1min":0.79800000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.458,"15min":1.494},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0209999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.3819999999999999,"15min":1.383},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4279999999999999,"15min":1.4430000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9550000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.5569999999999999,"15min":1.5840000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.1930000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.1930000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.478,"15min":1.49},"min":{"1min":0.94199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.476,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.5960000000000001,"15min":1.6180000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.2330000000000001,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.2270000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":348038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.431}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":1.496}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.5780000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.131}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":2.121},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.337},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":2.1859999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.544},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4690000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":351909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.88},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.306,"5min":1.585,"15min":1.585},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.97399999999999998,"15min":0.98399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.877,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.329,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.095,"15min":1.1220000000000001},"min":{"1min":0.60599999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5429999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1839999999999999,"15min":1.196},"min":{"1min":0.55000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.764,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.038,"5min":1.1259999999999999,"15min":1.1399999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1669999999999998,"5min":2.327,"15min":2.327},"last":1.1339999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6559999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.117},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.464,"15min":1.504},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.5089999999999999,"5min":2.552,"15min":2.552},"last":1.069}]},{"osd":5,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.4670000000000001,"15min":1.5009999999999999},"min":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.3900000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.202},{"interface":"front","average":{"1min":1.236,"5min":1.425,"15min":1.4570000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6220000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.042}]},{"osd":6,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.581,"15min":1.609},"min":{"1min":0.76000000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2989999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.546,"15min":1.5800000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.843,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.0900000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:16:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.571,"15min":1.601},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.016,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.675,"15min":1.6850000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.3460000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1351680,"data_stored":938406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.4490000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.329},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.292}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-12-08T08:18:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.764361+0000', 'last_change': '2023-12-08T08:17:57.764361+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.764361+0000', 'last_undegraded': '2023-12-08T08:17:57.764361+0000', 'last_fullsized': '2023-12-08T08:17:57.764361+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.762419+0000', 'last_change': '2023-12-08T08:17:57.762419+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.762419+0000', 'last_undegraded': '2023-12-08T08:17:57.762419+0000', 'last_fullsized': '2023-12-08T08:17:57.762419+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T19:27:16.621830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.760293+0000', 'last_change': '2023-12-08T08:17:57.760293+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.760293+0000', 'last_undegraded': '2023-12-08T08:17:57.760293+0000', 'last_fullsized': '2023-12-08T08:17:57.760293+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T15:20:41.599819+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.786345+0000', 'last_change': '2023-12-08T08:17:57.786345+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.786345+0000', 'last_undegraded': '2023-12-08T08:17:57.786345+0000', 'last_fullsized': '2023-12-08T08:17:57.786345+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.800058+0000', 'last_change': '2023-12-08T08:17:57.779371+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.800058+0000', 'last_undegraded': '2023-12-08T08:17:57.800058+0000', 'last_fullsized': '2023-12-08T08:17:57.800058+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T20:13:07.224031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.762215+0000', 'last_change': '2023-12-08T08:17:56.762215+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.762215+0000', 'last_undegraded': '2023-12-08T08:17:56.762215+0000', 'last_fullsized': '2023-12-08T08:17:56.762215+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.770685+0000', 'last_change': '2023-12-08T08:17:56.770685+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.770685+0000', 'last_undegraded': '2023-12-08T08:17:56.770685+0000', 'last_fullsized': '2023-12-08T08:17:56.770685+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.767249+0000', 'last_change': '2023-12-08T08:17:56.767249+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.767249+0000', 'last_undegraded': '2023-12-08T08:17:56.767249+0000', 'last_fullsized': '2023-12-08T08:17:56.767249+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.780942+0000', 'last_change': '2023-12-08T08:17:57.780942+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.780942+0000', 'last_undegraded': '2023-12-08T08:17:57.780942+0000', 'last_fullsized': '2023-12-08T08:17:57.780942+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T17:58:13.633709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.779115+0000', 'last_change': '2023-12-08T08:17:57.779115+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.779115+0000', 'last_undegraded': '2023-12-08T08:17:57.779115+0000', 'last_fullsized': '2023-12-08T08:17:57.779115+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763848+0000', 'last_change': '2023-12-08T08:17:57.763848+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763848+0000', 'last_undegraded': '2023-12-08T08:17:57.763848+0000', 'last_fullsized': '2023-12-08T08:17:57.763848+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T18:55:36.597031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-12-08T08:18:03.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.779114+0000', 'last_change': '2023-12-08T08:17:57.779114+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.779114+0000', 'last_undegraded': '2023-12-08T08:17:57.779114+0000', 'last_fullsized': '2023-12-08T08:17:57.779114+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.765929+0000', 'last_change': '2023-12-08T08:17:56.765929+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.765929+0000', 'last_undegraded': '2023-12-08T08:17:56.765929+0000', 'last_fullsized': '2023-12-08T08:17:56.765929+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.761100+0000', 'last_change': '2023-12-08T08:17:56.761100+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.761100+0000', 'last_undegraded': '2023-12-08T08:17:56.761100+0000', 'last_fullsized': '2023-12-08T08:17:56.761100+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.779324+0000', 'last_change': '2023-12-08T08:17:57.779324+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.779324+0000', 'last_undegraded': '2023-12-08T08:17:57.779324+0000', 'last_fullsized': '2023-12-08T08:17:57.779324+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:51:36.537524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.763333+0000', 'last_change': '2023-12-08T08:17:56.763333+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.763333+0000', 'last_undegraded': '2023-12-08T08:17:56.763333+0000', 'last_fullsized': '2023-12-08T08:17:56.763333+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.776869+0000', 'last_change': '2023-12-08T08:17:57.776869+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.776869+0000', 'last_undegraded': '2023-12-08T08:17:57.776869+0000', 'last_fullsized': '2023-12-08T08:17:57.776869+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:34:22.724525+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.775535+0000', 'last_change': '2023-12-08T08:17:57.775535+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.775535+0000', 'last_undegraded': '2023-12-08T08:17:57.775535+0000', 'last_fullsized': '2023-12-08T08:17:57.775535+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.778888+0000', 'last_change': '2023-12-08T08:17:57.778888+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.778888+0000', 'last_undegraded': '2023-12-08T08:17:57.778888+0000', 'last_fullsized': '2023-12-08T08:17:57.778888+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T19:15:24.195559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.760361+0000', 'last_change': '2023-12-08T08:17:57.760361+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.760361+0000', 'last_undegraded': '2023-12-08T08:17:57.760361+0000', 'last_fullsized': '2023-12-08T08:17:57.760361+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T19:01:41.070452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.765064+0000', 'last_change': '2023-12-08T08:17:57.765064+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.765064+0000', 'last_undegraded': '2023-12-08T08:17:57.765064+0000', 'last_fullsized': '2023-12-08T08:17:57.765064+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:34:24.223268+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.775244+0000', 'last_change': '2023-12-08T08:17:57.775244+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.775244+0000', 'last_undegraded': '2023-12-08T08:17:57.775244+0000', 'last_fullsized': '2023-12-08T08:17:57.775244+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:07:15.750669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-12-08T08:18:03.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.777744+0000', 'last_change': '2023-12-08T08:17:57.777744+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.777744+0000', 'last_undegraded': '2023-12-08T08:17:57.777744+0000', 'last_fullsized': '2023-12-08T08:17:57.777744+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.767468+0000', 'last_change': '2023-12-08T08:17:56.767468+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.767468+0000', 'last_undegraded': '2023-12-08T08:17:56.767468+0000', 'last_fullsized': '2023-12-08T08:17:56.767468+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.777837+0000', 'last_change': '2023-12-08T08:17:57.777837+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.777837+0000', 'last_undegraded': '2023-12-08T08:17:57.777837+0000', 'last_fullsized': '2023-12-08T08:17:57.777837+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.771678+0000', 'last_change': '2023-12-08T08:17:56.771678+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.771678+0000', 'last_undegraded': '2023-12-08T08:17:56.771678+0000', 'last_fullsized': '2023-12-08T08:17:56.771678+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.760042+0000', 'last_change': '2023-12-08T08:17:57.760042+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.760042+0000', 'last_undegraded': '2023-12-08T08:17:57.760042+0000', 'last_fullsized': '2023-12-08T08:17:57.760042+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T17:58:58.206551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.782317+0000', 'last_change': '2023-12-08T08:17:57.782317+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.782317+0000', 'last_undegraded': '2023-12-08T08:17:57.782317+0000', 'last_fullsized': '2023-12-08T08:17:57.782317+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.760566+0000', 'last_change': '2023-12-08T08:17:56.760566+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.760566+0000', 'last_undegraded': '2023-12-08T08:17:56.760566+0000', 'last_fullsized': '2023-12-08T08:17:56.760566+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.783622+0000', 'last_change': '2023-12-08T08:17:57.783622+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.783622+0000', 'last_undegraded': '2023-12-08T08:17:57.783622+0000', 'last_fullsized': '2023-12-08T08:17:57.783622+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T14:17:31.796515+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.784216+0000', 'last_change': '2023-12-08T08:17:57.784216+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.784216+0000', 'last_undegraded': '2023-12-08T08:17:57.784216+0000', 'last_fullsized': '2023-12-08T08:17:57.784216+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:00:56.423817+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.772153+0000', 'last_change': '2023-12-08T08:17:57.772153+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.772153+0000', 'last_undegraded': '2023-12-08T08:17:57.772153+0000', 'last_fullsized': '2023-12-08T08:17:57.772153+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T12:35:37.945325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.777217+0000', 'last_change': '2023-12-08T08:17:57.777217+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.777217+0000', 'last_undegraded': '2023-12-08T08:17:57.777217+0000', 'last_fullsized': '2023-12-08T08:17:57.777217+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T10:28:42.910866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-12-08T08:18:03.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.765847+0000', 'last_change': '2023-12-08T08:17:57.765847+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.765847+0000', 'last_undegraded': '2023-12-08T08:17:57.765847+0000', 'last_fullsized': '2023-12-08T08:17:57.765847+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.779412+0000', 'last_change': '2023-12-08T08:17:57.779412+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.779412+0000', 'last_undegraded': '2023-12-08T08:17:57.779412+0000', 'last_fullsized': '2023-12-08T08:17:57.779412+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T19:17:21.091888+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.778378+0000', 'last_change': '2023-12-08T08:17:57.778378+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.778378+0000', 'last_undegraded': '2023-12-08T08:17:57.778378+0000', 'last_fullsized': '2023-12-08T08:17:57.778378+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T12:48:46.607352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.778739+0000', 'last_change': '2023-12-08T08:17:57.778739+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.778739+0000', 'last_undegraded': '2023-12-08T08:17:57.778739+0000', 'last_fullsized': '2023-12-08T08:17:57.778739+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T15:32:11.051763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.776810+0000', 'last_change': '2023-12-08T08:17:57.776810+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.776810+0000', 'last_undegraded': '2023-12-08T08:17:57.776810+0000', 'last_fullsized': '2023-12-08T08:17:57.776810+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T12:47:29.646735+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.770802+0000', 'last_change': '2023-12-08T08:17:57.770802+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.770802+0000', 'last_undegraded': '2023-12-08T08:17:57.770802+0000', 'last_fullsized': '2023-12-08T08:17:57.770802+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.759400+0000', 'last_change': '2023-12-08T08:17:56.759400+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.759400+0000', 'last_undegraded': '2023-12-08T08:17:56.759400+0000', 'last_fullsized': '2023-12-08T08:17:56.759400+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763151+0000', 'last_change': '2023-12-08T08:17:57.763151+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763151+0000', 'last_undegraded': '2023-12-08T08:17:57.763151+0000', 'last_fullsized': '2023-12-08T08:17:57.763151+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.764868+0000', 'last_change': '2023-12-08T08:17:57.764868+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.764868+0000', 'last_undegraded': '2023-12-08T08:17:57.764868+0000', 'last_fullsized': '2023-12-08T08:17:57.764868+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': ['6', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.759427+0000', 'last_change': '2023-12-08T08:17:56.759427+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.759427+0000', 'last_undegraded': '2023-12-08T08:17:56.759427+0000', 'last_fullsized': '2023-12-08T08:17:56.759427+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763263+0000', 'last_change': '2023-12-08T08:17:57.763263+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763263+0000', 'last_undegraded': '2023-12-08T08:17:57.763263+0000', 'last_fullsized': '2023-12-08T08:17:57.763263+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-12-08T08:18:03.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763503+0000', 'last_change': '2023-12-08T08:17:57.763503+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763503+0000', 'last_undegraded': '2023-12-08T08:17:57.763503+0000', 'last_fullsized': '2023-12-08T08:17:57.763503+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T14:58:44.299681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.784018+0000', 'last_change': '2023-12-08T08:17:57.777499+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.784018+0000', 'last_undegraded': '2023-12-08T08:17:57.784018+0000', 'last_fullsized': '2023-12-08T08:17:57.784018+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:25:16.656332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.775811+0000', 'last_change': '2023-12-08T08:17:57.775811+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.775811+0000', 'last_undegraded': '2023-12-08T08:17:57.775811+0000', 'last_fullsized': '2023-12-08T08:17:57.775811+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T11:32:57.978934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.764805+0000', 'last_change': '2023-12-08T08:17:57.764805+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.764805+0000', 'last_undegraded': '2023-12-08T08:17:57.764805+0000', 'last_fullsized': '2023-12-08T08:17:57.764805+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': ['6', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.780184+0000', 'last_change': '2023-12-08T08:17:57.780184+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.780184+0000', 'last_undegraded': '2023-12-08T08:17:57.780184+0000', 'last_fullsized': '2023-12-08T08:17:57.780184+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T20:09:29.147322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.783189+0000', 'last_change': '2023-12-08T08:17:57.783189+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.783189+0000', 'last_undegraded': '2023-12-08T08:17:57.783189+0000', 'last_fullsized': '2023-12-08T08:17:57.783189+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:46:59.629875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.771347+0000', 'last_change': '2023-12-08T08:17:57.771347+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.771347+0000', 'last_undegraded': '2023-12-08T08:17:57.771347+0000', 'last_fullsized': '2023-12-08T08:17:57.771347+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.776946+0000', 'last_change': '2023-12-08T08:17:57.776946+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.776946+0000', 'last_undegraded': '2023-12-08T08:17:57.776946+0000', 'last_fullsized': '2023-12-08T08:17:57.776946+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:48:51.673242+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763142+0000', 'last_change': '2023-12-08T08:17:57.763142+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763142+0000', 'last_undegraded': '2023-12-08T08:17:57.763142+0000', 'last_fullsized': '2023-12-08T08:17:57.763142+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T09:25:59.675754+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': ['6', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.778064+0000', 'last_change': '2023-12-08T08:17:57.778064+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.778064+0000', 'last_undegraded': '2023-12-08T08:17:57.778064+0000', 'last_fullsized': '2023-12-08T08:17:57.778064+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T13:11:16.845352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763212+0000', 'last_change': '2023-12-08T08:17:57.763212+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763212+0000', 'last_undegraded': '2023-12-08T08:17:57.763212+0000', 'last_fullsized': '2023-12-08T08:17:57.763212+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': ['6', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-12-08T08:18:03.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 64, 'state': 'creating+activating', 'last_fresh': '2023-12-08T08:17:57.763193+0000', 'last_change': '2023-12-08T08:17:57.763193+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:57.763193+0000', 'last_undegraded': '2023-12-08T08:17:57.763193+0000', 'last_fullsized': '2023-12-08T08:17:57.763193+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': ['6', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-12-08T08:18:03.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:17:56.774154+0000', 'last_change': '2023-12-08T08:17:56.774154+0000', 'last_active': '2023-12-08T08:17:56.735537+0000', 'last_peered': '2023-12-08T08:17:56.735537+0000', 'last_clean': '2023-12-08T08:17:56.735537+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:17:56.774154+0000', 'last_undegraded': '2023-12-08T08:17:56.774154+0000', 'last_fullsized': '2023-12-08T08:17:56.774154+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'last_clean_scrub_stamp': '2023-12-08T08:17:56.735537+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:03.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:18:03.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.651+0000 7f5f7ee91640 1 Processor -- start 2023-12-08T08:18:03.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.651+0000 7f5f7ee91640 1 -- start start 2023-12-08T08:18:03.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.652+0000 7f5f7ee91640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f781519c0 0x7f5f781584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7ee91640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f780c7a50 0x7f5f780ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7ee91640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f780c4a00 con 0x7f5f780c44d0 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7ee91640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780c4ce0 con 0x7f5f781519c0 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7ee91640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f781579e0 con 0x7f5f780c7a50 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f781519c0 0x7f5f781584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f781519c0 0x7f5f781584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40814/0 (socket says 172.21.15.45:40814) 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 -- 172.21.15.45:0/4209557509 learned_addr learned my addr 172.21.15.45:0/4209557509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:03.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 -- 172.21.15.45:0/4209557509 >> v2:172.21.15.114:3300/0 conn(0x7f5f780c7a50 msgr2=0x7f5f780ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 --2- 172.21.15.45:0/4209557509 >> v2:172.21.15.114:3300/0 conn(0x7f5f780c7a50 0x7f5f780ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 -- 172.21.15.45:0/4209557509 >> v1:172.21.15.114:6789/0 conn(0x7f5f780c44d0 legacy=0x7f5f78154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.653+0000 7f5f7de8f640 1 -- 172.21.15.45:0/4209557509 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78157cc0 con 0x7f5f781519c0 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.654+0000 7f5f7de8f640 1 --2- 172.21.15.45:0/4209557509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f781519c0 0x7f5f781584c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5f780c3f80 tx=0x7f5f7402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11948587154301b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.655+0000 7f5f7ce8d640 1 -- 172.21.15.45:0/4209557509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74031750 con 0x7f5f781519c0 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.655+0000 7f5f7ce8d640 1 -- 172.21.15.45:0/4209557509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f740318b0 con 0x7f5f781519c0 2023-12-08T08:18:03.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.655+0000 7f5f7ce8d640 1 -- 172.21.15.45:0/4209557509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74031c40 con 0x7f5f781519c0 2023-12-08T08:18:03.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.655+0000 7f5f7ee91640 1 -- 172.21.15.45:0/4209557509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f781519c0 msgr2=0x7f5f781584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.655+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/4209557509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f781519c0 0x7f5f781584c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5f780c3f80 tx=0x7f5f7402b7f0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 -- 172.21.15.45:0/4209557509 shutdown_connections 2023-12-08T08:18:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/4209557509 >> v2:172.21.15.114:3300/0 conn(0x7f5f780c7a50 0x7f5f780ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/4209557509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f781519c0 0x7f5f781584c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 -- 172.21.15.45:0/4209557509 >> 172.21.15.45:0/4209557509 conn(0x7f5f780661f0 msgr2=0x7f5f78066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 -- 172.21.15.45:0/4209557509 shutdown_connections 2023-12-08T08:18:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.656+0000 7f5f7ee91640 1 -- 172.21.15.45:0/4209557509 wait complete. 2023-12-08T08:18:03.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.657+0000 7f5f7ee91640 1 Processor -- start 2023-12-08T08:18:03.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.658+0000 7f5f7ee91640 1 -- start start 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.658+0000 7f5f7ee91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.658+0000 7f5f7ee91640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 0x7f5f7814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.658+0000 7f5f7ee91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 0x7f5f7814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7ee91640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c0d20 con 0x7f5f780c44d0 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7ee91640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f781edd10 con 0x7f5f781519c0 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7ee91640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f781ee240 con 0x7f5f780c7a50 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7de8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7de8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40824/0 (socket says 172.21.15.45:40824) 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7de8f640 1 -- 172.21.15.45:0/3906707882 learned_addr learned my addr 172.21.15.45:0/3906707882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7d68e640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 0x7f5f7814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.659+0000 7f5f7e690640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 0x7f5f7814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 -- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 msgr2=0x7f5f7814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 0x7f5f7814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 -- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 msgr2=0x7f5f7814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 0x7f5f7814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 -- 172.21.15.45:0/3906707882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740094d0 con 0x7f5f780c44d0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7d68e640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 0x7f5f7814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7e690640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 0x7f5f7814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7de8f640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000c00 tx=0x7f5f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74033c60 con 0x7f5f780c44d0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74033de0 con 0x7f5f780c44d0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7403d6b0 con 0x7f5f780c44d0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.660+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f780c1330 con 0x7f5f780c44d0 2023-12-08T08:18:03.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.661+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f780ab0b0 con 0x7f5f780c44d0 2023-12-08T08:18:03.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.663+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f780bd600 con 0x7f5f780c44d0 2023-12-08T08:18:03.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.663+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f7403a040 con 0x7f5f780c44d0 2023-12-08T08:18:03.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.664+0000 7f5f6e7fc640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 0x7f5f5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.664+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f5f740abbf0 con 0x7f5f780c44d0 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.664+0000 7f5f7d68e640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 0x7f5f5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.665+0000 7f5f7d68e640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 0x7f5f5c06d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f780abe70 tx=0x7f5f68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.668+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f74076780 con 0x7f5f780c44d0 2023-12-08T08:18:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.938+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5f780743e0 con 0x7f5f780c44d0 2023-12-08T08:18:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.940+0000 7f5f6e7fc640 1 -- 172.21.15.45:0/3906707882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1405 (secure 0 0 0) 0x7f5f74079da0 con 0x7f5f780c44d0 2023-12-08T08:18:03.942 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:03.942 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":203,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023292,"num_in_osds":8,"osd_in_since":1702023284,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":193}],"num_pgs":193,"num_pools":5,"num_objects":46,"data_bytes":596683,"bytes_used":250253312,"bytes_avail":772843859968,"bytes_total":773094113280,"write_bytes_sec":2044,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":38,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6018},{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6024}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-12-08T08:17:23.750752+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:18:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 msgr2=0x7f5f5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 0x7f5f5c06d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f780abe70 tx=0x7f5f68009040 comp rx=0 tx=0).stop 2023-12-08T08:18:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 msgr2=0x7f5f78153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5f74000c00 tx=0x7f5f740046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 shutdown_connections 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5f5c06ae40 0x7f5f5c06d300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5f780c7a50 0x7f5f7814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f781519c0 0x7f5f7814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 --2- 172.21.15.45:0/3906707882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f780c44d0 0x7f5f78153520 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 >> 172.21.15.45:0/3906707882 conn(0x7f5f780661f0 msgr2=0x7f5f7814e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 shutdown_connections 2023-12-08T08:18:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:03.942+0000 7f5f7ee91640 1 -- 172.21.15.45:0/3906707882 wait complete. 2023-12-08T08:18:03.962 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:18:03.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.182+0000 7f024759e640 1 Processor -- start 2023-12-08T08:18:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.182+0000 7f024759e640 1 -- start start 2023-12-08T08:18:04.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f024759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f02481519c0 0x7f02481584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f024759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02480c4a00 con 0x7f02480c44d0 2023-12-08T08:18:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f024759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02480c4ce0 con 0x7f02480c7a50 2023-12-08T08:18:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f024759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02481579e0 con 0x7f02481519c0 2023-12-08T08:18:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f0245d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02480c44d0 0x7f0248154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41934/0 (socket says 172.21.15.45:41934) 2023-12-08T08:18:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.184+0000 7f0245d9b640 1 -- 172.21.15.45:0/137514871 learned_addr learned my addr 172.21.15.45:0/137514871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:04.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024659c640 1 --2- 172.21.15.45:0/137514871 >> v2:172.21.15.114:3300/0 conn(0x7f02481519c0 0x7f02481584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540958422 0 0) 0x7f02480c4a00 con 0x7f02480c44d0 2023-12-08T08:18:04.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0230003520 con 0x7f02480c44d0 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142669788 0 0) 0x7f0230003520 con 0x7f02480c44d0 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 >> v2:172.21.15.114:3300/0 conn(0x7f02481519c0 msgr2=0x7f02481584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 --2- 172.21.15.45:0/137514871 >> v2:172.21.15.114:3300/0 conn(0x7f02481519c0 0x7f02481584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.185+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 >> v1:172.21.15.114:6789/0 conn(0x7f02480c7a50 legacy=0x7f02480ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248157cc0 con 0x7f02480c44d0 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f023c001670 con 0x7f02480c44d0 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 >> v1:172.21.15.45:6789/0 conn(0x7f02480c44d0 legacy=0x7f0248154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300039c0 0x7f0230003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f0230004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02300052a0 0x7f023000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02481579e0 con 0x7f02300047c0 2023-12-08T08:18:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023000c1a0 con 0x7f02300039c0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023000c360 con 0x7f02300052a0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f0245d9b640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f0230004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f024659c640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300039c0 0x7f0230003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.186+0000 7f0246d9d640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02300052a0 0x7f023000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0245d9b640 1 -- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02300052a0 msgr2=0x7f023000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0245d9b640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02300052a0 0x7f023000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0245d9b640 1 -- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300039c0 msgr2=0x7f0230003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0245d9b640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300039c0 0x7f0230003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0245d9b640 1 -- 172.21.15.45:0/137514871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230003520 con 0x7f02300047c0 2023-12-08T08:18:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.187+0000 7f0246d9d640 1 -- 172.21.15.45:0/137514871 reap_dead start 2023-12-08T08:18:04.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f0245d9b640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f0230004c40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c0e0 tx=0x7f02300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98be687d1684935a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c005ad0 con 0x7f02300047c0 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c005c30 con 0x7f02300047c0 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f024559a640 1 -- 172.21.15.45:0/137514871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c02ca50 con 0x7f02300047c0 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f024759e640 1 -- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 msgr2=0x7f0230004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.188+0000 7f024759e640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f0230004c40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f023c00c0e0 tx=0x7f02300057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.189+0000 7f024759e640 1 -- 172.21.15.45:0/137514871 shutdown_connections 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.189+0000 7f024759e640 1 --2- 172.21.15.45:0/137514871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f0230004c40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.189+0000 7f024759e640 1 -- 172.21.15.45:0/137514871 >> 172.21.15.45:0/137514871 conn(0x7f02480661f0 msgr2=0x7f0248066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.189+0000 7f024759e640 1 -- 172.21.15.45:0/137514871 shutdown_connections 2023-12-08T08:18:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.189+0000 7f024759e640 1 -- 172.21.15.45:0/137514871 wait complete. 2023-12-08T08:18:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.190+0000 7f024759e640 1 Processor -- start 2023-12-08T08:18:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.191+0000 7f024759e640 1 -- start start 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.191+0000 7f024759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02480bd680 0x7f02481eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02481ed310 0x7f02481ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c24a0 con 0x7f02300047c0 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c3040 con 0x7f02480bd680 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c2a80 con 0x7f02481ed310 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40844/0 (socket says 172.21.15.45:40844) 2023-12-08T08:18:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 -- 172.21.15.45:0/1927050450 learned_addr learned my addr 172.21.15.45:0/1927050450 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 -- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02481ed310 msgr2=0x7f02481ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f0245d9b640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02480bd680 0x7f02481eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02481ed310 0x7f02481ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 -- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02480bd680 msgr2=0x7f02481eafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02480bd680 0x7f02481eafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.192+0000 7f024659c640 1 -- 172.21.15.45:0/1927050450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02480c2d60 con 0x7f02300047c0 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f024659c640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0238011510 tx=0x7f02380119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238015870 con 0x7f02300047c0 2023-12-08T08:18:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380159d0 con 0x7f02300047c0 2023-12-08T08:18:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02480c1760 con 0x7f02300047c0 2023-12-08T08:18:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238015d40 con 0x7f02300047c0 2023-12-08T08:18:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.193+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02481edcd0 con 0x7f02300047c0 2023-12-08T08:18:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.194+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02480743e0 con 0x7f02300047c0 2023-12-08T08:18:04.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.195+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0238013400 con 0x7f02300047c0 2023-12-08T08:18:04.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.196+0000 7f0236ffd640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 0x7f022806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.196+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f0238089f70 con 0x7f02300047c0 2023-12-08T08:18:04.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.197+0000 7f0245d9b640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 0x7f022806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.198+0000 7f0245d9b640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 0x7f022806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f023c034000 tx=0x7f023c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.200+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0238054b00 con 0x7f02300047c0 2023-12-08T08:18:04.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.394+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02480c53a0 con 0x7f022806ae70 2023-12-08T08:18:04.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.411+0000 7f0236ffd640 1 -- 172.21.15.45:0/1927050450 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525272 (secure 0 0 0) 0x7f02480c53a0 con 0x7f022806ae70 2023-12-08T08:18:04.416 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 msgr2=0x7f022806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 0x7f022806d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f023c034000 tx=0x7f023c009030 comp rx=0 tx=0).stop 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 msgr2=0x7f02480c1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0238011510 tx=0x7f02380119d0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 shutdown_connections 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f022806ae70 0x7f022806d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02481ed310 0x7f02481ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02480bd680 0x7f02481eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 --2- 172.21.15.45:0/1927050450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02300047c0 0x7f02480c1f60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 >> 172.21.15.45:0/1927050450 conn(0x7f02480661f0 msgr2=0x7f0248153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 shutdown_connections 2023-12-08T08:18:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:04.423+0000 7f024759e640 1 -- 172.21.15.45:0/1927050450 wait complete. 2023-12-08T08:18:04.446 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-12-08T08:18:03.763275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244388,"kb_used_data":7400,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730332,"statfs":{"total":773094113280,"available":772843859968,"internally_reserved":0,"allocated":7577600,"data_stored":4102966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.010630"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252798+0000","last_change":"2023-12-08T08:17:57.785587+0000","last_active":"2023-12-08T08:17:59.252798+0000","last_peered":"2023-12-08T08:17:59.252798+0000","last_clean":"2023-12-08T08:17:59.252798+0000","last_became_active":"2023-12-08T08:17:57.780492+0000","last_became_peered":"2023-12-08T08:17:57.780492+0000","last_unstale":"2023-12-08T08:17:59.252798+0000","last_undegraded":"2023-12-08T08:17:59.252798+0000","last_fullsized":"2023-12-08T08:17:59.252798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:01.947657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779327+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:57.779327+0000","last_peered":"2023-12-08T08:17:57.779327+0000","last_clean":"2023-12-08T08:17:57.779327+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:57.779327+0000","last_undegraded":"2023-12-08T08:17:57.779327+0000","last_fullsized":"2023-12-08T08:17:57.779327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:50.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252302+0000","last_change":"2023-12-08T08:17:57.792932+0000","last_active":"2023-12-08T08:17:59.252302+0000","last_peered":"2023-12-08T08:17:59.252302+0000","last_clean":"2023-12-08T08:17:59.252302+0000","last_became_active":"2023-12-08T08:17:57.792683+0000","last_became_peered":"2023-12-08T08:17:57.792683+0000","last_unstale":"2023-12-08T08:17:59.252302+0000","last_undegraded":"2023-12-08T08:17:59.252302+0000","last_fullsized":"2023-12-08T08:17:59.252302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:31.795322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780685+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:57.780685+0000","last_peered":"2023-12-08T08:17:57.780685+0000","last_clean":"2023-12-08T08:17:57.780685+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:57.780685+0000","last_undegraded":"2023-12-08T08:17:57.780685+0000","last_fullsized":"2023-12-08T08:17:57.780685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:09.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255285+0000","last_change":"2023-12-08T08:17:57.791882+0000","last_active":"2023-12-08T08:17:59.255285+0000","last_peered":"2023-12-08T08:17:59.255285+0000","last_clean":"2023-12-08T08:17:59.255285+0000","last_became_active":"2023-12-08T08:17:57.791595+0000","last_became_peered":"2023-12-08T08:17:57.791595+0000","last_unstale":"2023-12-08T08:17:59.255285+0000","last_undegraded":"2023-12-08T08:17:59.255285+0000","last_fullsized":"2023-12-08T08:17:59.255285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:53.810874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789218+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:57.789218+0000","last_peered":"2023-12-08T08:17:57.789218+0000","last_clean":"2023-12-08T08:17:57.789218+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:57.789218+0000","last_undegraded":"2023-12-08T08:17:57.789218+0000","last_fullsized":"2023-12-08T08:17:57.789218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786012+0000","last_change":"2023-12-08T08:17:57.797791+0000","last_active":"2023-12-08T08:17:58.786012+0000","last_peered":"2023-12-08T08:17:58.786012+0000","last_clean":"2023-12-08T08:17:58.786012+0000","last_became_active":"2023-12-08T08:17:57.797012+0000","last_became_peered":"2023-12-08T08:17:57.797012+0000","last_unstale":"2023-12-08T08:17:58.786012+0000","last_undegraded":"2023-12-08T08:17:58.786012+0000","last_fullsized":"2023-12-08T08:17:58.786012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:11.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783861+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:57.783861+0000","last_peered":"2023-12-08T08:17:57.783861+0000","last_clean":"2023-12-08T08:17:57.783861+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:57.783861+0000","last_undegraded":"2023-12-08T08:17:57.783861+0000","last_fullsized":"2023-12-08T08:17:57.783861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254697+0000","last_change":"2023-12-08T08:17:57.806576+0000","last_active":"2023-12-08T08:17:59.254697+0000","last_peered":"2023-12-08T08:17:59.254697+0000","last_clean":"2023-12-08T08:17:59.254697+0000","last_became_active":"2023-12-08T08:17:57.804339+0000","last_became_peered":"2023-12-08T08:17:57.804339+0000","last_unstale":"2023-12-08T08:17:59.254697+0000","last_undegraded":"2023-12-08T08:17:59.254697+0000","last_fullsized":"2023-12-08T08:17:59.254697+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:25.534348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":24,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768187+0000","last_change":"2023-12-08T08:17:47.863838+0000","last_active":"2023-12-08T08:17:57.768187+0000","last_peered":"2023-12-08T08:17:57.768187+0000","last_clean":"2023-12-08T08:17:57.768187+0000","last_became_active":"2023-12-08T08:17:47.863177+0000","last_became_peered":"2023-12-08T08:17:47.863177+0000","last_unstale":"2023-12-08T08:17:57.768187+0000","last_undegraded":"2023-12-08T08:17:57.768187+0000","last_fullsized":"2023-12-08T08:17:57.768187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:35.681140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255058+0000","last_change":"2023-12-08T08:17:57.799227+0000","last_active":"2023-12-08T08:17:59.255058+0000","last_peered":"2023-12-08T08:17:59.255058+0000","last_clean":"2023-12-08T08:17:59.255058+0000","last_became_active":"2023-12-08T08:17:57.797766+0000","last_became_peered":"2023-12-08T08:17:57.797766+0000","last_unstale":"2023-12-08T08:17:59.255058+0000","last_undegraded":"2023-12-08T08:17:59.255058+0000","last_fullsized":"2023-12-08T08:17:59.255058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.776310+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:57.776310+0000","last_peered":"2023-12-08T08:17:57.776310+0000","last_clean":"2023-12-08T08:17:57.776310+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:57.776310+0000","last_undegraded":"2023-12-08T08:17:57.776310+0000","last_fullsized":"2023-12-08T08:17:57.776310+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257595+0000","last_change":"2023-12-08T08:17:57.799451+0000","last_active":"2023-12-08T08:17:59.257595+0000","last_peered":"2023-12-08T08:17:59.257595+0000","last_clean":"2023-12-08T08:17:59.257595+0000","last_became_active":"2023-12-08T08:17:57.798376+0000","last_became_peered":"2023-12-08T08:17:57.798376+0000","last_unstale":"2023-12-08T08:17:59.257595+0000","last_undegraded":"2023-12-08T08:17:59.257595+0000","last_fullsized":"2023-12-08T08:17:59.257595+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:07.450761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.762923+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:57.762923+0000","last_peered":"2023-12-08T08:17:57.762923+0000","last_clean":"2023-12-08T08:17:57.762923+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:57.762923+0000","last_undegraded":"2023-12-08T08:17:57.762923+0000","last_fullsized":"2023-12-08T08:17:57.762923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:26.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254434+0000","last_change":"2023-12-08T08:17:57.800793+0000","last_active":"2023-12-08T08:17:59.254434+0000","last_peered":"2023-12-08T08:17:59.254434+0000","last_clean":"2023-12-08T08:17:59.254434+0000","last_became_active":"2023-12-08T08:17:57.800501+0000","last_became_peered":"2023-12-08T08:17:57.800501+0000","last_unstale":"2023-12-08T08:17:59.254434+0000","last_undegraded":"2023-12-08T08:17:59.254434+0000","last_fullsized":"2023-12-08T08:17:59.254434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:02.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784897+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:57.784897+0000","last_peered":"2023-12-08T08:17:57.784897+0000","last_clean":"2023-12-08T08:17:57.784897+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:57.784897+0000","last_undegraded":"2023-12-08T08:17:57.784897+0000","last_fullsized":"2023-12-08T08:17:57.784897+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:43.683652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255501+0000","last_change":"2023-12-08T08:17:57.805885+0000","last_active":"2023-12-08T08:17:59.255501+0000","last_peered":"2023-12-08T08:17:59.255501+0000","last_clean":"2023-12-08T08:17:59.255501+0000","last_became_active":"2023-12-08T08:17:57.805454+0000","last_became_peered":"2023-12-08T08:17:57.805454+0000","last_unstale":"2023-12-08T08:17:59.255501+0000","last_undegraded":"2023-12-08T08:17:59.255501+0000","last_fullsized":"2023-12-08T08:17:59.255501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:08.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791664+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:57.791664+0000","last_peered":"2023-12-08T08:17:57.791664+0000","last_clean":"2023-12-08T08:17:57.791664+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:57.791664+0000","last_undegraded":"2023-12-08T08:17:57.791664+0000","last_fullsized":"2023-12-08T08:17:57.791664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255293+0000","last_change":"2023-12-08T08:17:57.795580+0000","last_active":"2023-12-08T08:17:59.255293+0000","last_peered":"2023-12-08T08:17:59.255293+0000","last_clean":"2023-12-08T08:17:59.255293+0000","last_became_active":"2023-12-08T08:17:57.795301+0000","last_became_peered":"2023-12-08T08:17:57.795301+0000","last_unstale":"2023-12-08T08:17:59.255293+0000","last_undegraded":"2023-12-08T08:17:59.255293+0000","last_fullsized":"2023-12-08T08:17:59.255293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:11.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.771667+0000","last_change":"2023-12-08T08:17:48.251716+0000","last_active":"2023-12-08T08:17:57.771667+0000","last_peered":"2023-12-08T08:17:57.771667+0000","last_clean":"2023-12-08T08:17:57.771667+0000","last_became_active":"2023-12-08T08:17:48.250928+0000","last_became_peered":"2023-12-08T08:17:48.250928+0000","last_unstale":"2023-12-08T08:17:57.771667+0000","last_undegraded":"2023-12-08T08:17:57.771667+0000","last_fullsized":"2023-12-08T08:17:57.771667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255651+0000","last_change":"2023-12-08T08:17:57.797541+0000","last_active":"2023-12-08T08:17:59.255651+0000","last_peered":"2023-12-08T08:17:59.255651+0000","last_clean":"2023-12-08T08:17:59.255651+0000","last_became_active":"2023-12-08T08:17:57.794103+0000","last_became_peered":"2023-12-08T08:17:57.794103+0000","last_unstale":"2023-12-08T08:17:59.255651+0000","last_undegraded":"2023-12-08T08:17:59.255651+0000","last_fullsized":"2023-12-08T08:17:59.255651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:55.093869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786188+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:57.786188+0000","last_peered":"2023-12-08T08:17:57.786188+0000","last_clean":"2023-12-08T08:17:57.786188+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:57.786188+0000","last_undegraded":"2023-12-08T08:17:57.786188+0000","last_fullsized":"2023-12-08T08:17:57.786188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786045+0000","last_change":"2023-12-08T08:17:57.800420+0000","last_active":"2023-12-08T08:17:58.786045+0000","last_peered":"2023-12-08T08:17:58.786045+0000","last_clean":"2023-12-08T08:17:58.786045+0000","last_became_active":"2023-12-08T08:17:57.797400+0000","last_became_peered":"2023-12-08T08:17:57.797400+0000","last_unstale":"2023-12-08T08:17:58.786045+0000","last_undegraded":"2023-12-08T08:17:58.786045+0000","last_fullsized":"2023-12-08T08:17:58.786045+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:57:21.087350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788122+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:57.788122+0000","last_peered":"2023-12-08T08:17:57.788122+0000","last_clean":"2023-12-08T08:17:57.788122+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:57.788122+0000","last_undegraded":"2023-12-08T08:17:57.788122+0000","last_fullsized":"2023-12-08T08:17:57.788122+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253629+0000","last_change":"2023-12-08T08:17:57.803447+0000","last_active":"2023-12-08T08:17:59.253629+0000","last_peered":"2023-12-08T08:17:59.253629+0000","last_clean":"2023-12-08T08:17:59.253629+0000","last_became_active":"2023-12-08T08:17:57.801502+0000","last_became_peered":"2023-12-08T08:17:57.801502+0000","last_unstale":"2023-12-08T08:17:59.253629+0000","last_undegraded":"2023-12-08T08:17:59.253629+0000","last_fullsized":"2023-12-08T08:17:59.253629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:44.777523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785370+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:57.785370+0000","last_peered":"2023-12-08T08:17:57.785370+0000","last_clean":"2023-12-08T08:17:57.785370+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:57.785370+0000","last_undegraded":"2023-12-08T08:17:57.785370+0000","last_fullsized":"2023-12-08T08:17:57.785370+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:38.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255053+0000","last_change":"2023-12-08T08:17:57.806940+0000","last_active":"2023-12-08T08:17:59.255053+0000","last_peered":"2023-12-08T08:17:59.255053+0000","last_clean":"2023-12-08T08:17:59.255053+0000","last_became_active":"2023-12-08T08:17:57.806644+0000","last_became_peered":"2023-12-08T08:17:57.806644+0000","last_unstale":"2023-12-08T08:17:59.255053+0000","last_undegraded":"2023-12-08T08:17:59.255053+0000","last_fullsized":"2023-12-08T08:17:59.255053+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784059+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:57.784059+0000","last_peered":"2023-12-08T08:17:57.784059+0000","last_clean":"2023-12-08T08:17:57.784059+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:57.784059+0000","last_undegraded":"2023-12-08T08:17:57.784059+0000","last_fullsized":"2023-12-08T08:17:57.784059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.789975+0000","last_change":"2023-12-08T08:17:57.793149+0000","last_active":"2023-12-08T08:17:58.789975+0000","last_peered":"2023-12-08T08:17:58.789975+0000","last_clean":"2023-12-08T08:17:58.789975+0000","last_became_active":"2023-12-08T08:17:57.792819+0000","last_became_peered":"2023-12-08T08:17:57.792819+0000","last_unstale":"2023-12-08T08:17:58.789975+0000","last_undegraded":"2023-12-08T08:17:58.789975+0000","last_fullsized":"2023-12-08T08:17:58.789975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779789+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:57.779789+0000","last_peered":"2023-12-08T08:17:57.779789+0000","last_clean":"2023-12-08T08:17:57.779789+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:57.779789+0000","last_undegraded":"2023-12-08T08:17:57.779789+0000","last_fullsized":"2023-12-08T08:17:57.779789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:07.769792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254809+0000","last_change":"2023-12-08T08:17:57.803196+0000","last_active":"2023-12-08T08:17:59.254809+0000","last_peered":"2023-12-08T08:17:59.254809+0000","last_clean":"2023-12-08T08:17:59.254809+0000","last_became_active":"2023-12-08T08:17:57.802238+0000","last_became_peered":"2023-12-08T08:17:57.802238+0000","last_unstale":"2023-12-08T08:17:59.254809+0000","last_undegraded":"2023-12-08T08:17:59.254809+0000","last_fullsized":"2023-12-08T08:17:59.254809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760020+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:57.760020+0000","last_peered":"2023-12-08T08:17:57.760020+0000","last_clean":"2023-12-08T08:17:57.760020+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:57.760020+0000","last_undegraded":"2023-12-08T08:17:57.760020+0000","last_fullsized":"2023-12-08T08:17:57.760020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:48.031268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788696+0000","last_change":"2023-12-08T08:17:57.797941+0000","last_active":"2023-12-08T08:17:58.788696+0000","last_peered":"2023-12-08T08:17:58.788696+0000","last_clean":"2023-12-08T08:17:58.788696+0000","last_became_active":"2023-12-08T08:17:57.797373+0000","last_became_peered":"2023-12-08T08:17:57.797373+0000","last_unstale":"2023-12-08T08:17:58.788696+0000","last_undegraded":"2023-12-08T08:17:58.788696+0000","last_fullsized":"2023-12-08T08:17:58.788696+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779430+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:57.779430+0000","last_peered":"2023-12-08T08:17:57.779430+0000","last_clean":"2023-12-08T08:17:57.779430+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:57.779430+0000","last_undegraded":"2023-12-08T08:17:57.779430+0000","last_fullsized":"2023-12-08T08:17:57.779430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:53.659318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.250879+0000","last_change":"2023-12-08T08:17:57.800903+0000","last_active":"2023-12-08T08:17:59.250879+0000","last_peered":"2023-12-08T08:17:59.250879+0000","last_clean":"2023-12-08T08:17:59.250879+0000","last_became_active":"2023-12-08T08:17:57.800621+0000","last_became_peered":"2023-12-08T08:17:57.800621+0000","last_unstale":"2023-12-08T08:17:59.250879+0000","last_undegraded":"2023-12-08T08:17:59.250879+0000","last_fullsized":"2023-12-08T08:17:59.250879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:07.450761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787059+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:57.787059+0000","last_peered":"2023-12-08T08:17:57.787059+0000","last_clean":"2023-12-08T08:17:57.787059+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:57.787059+0000","last_undegraded":"2023-12-08T08:17:57.787059+0000","last_fullsized":"2023-12-08T08:17:57.787059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788982+0000","last_change":"2023-12-08T08:17:57.804238+0000","last_active":"2023-12-08T08:17:58.788982+0000","last_peered":"2023-12-08T08:17:58.788982+0000","last_clean":"2023-12-08T08:17:58.788982+0000","last_became_active":"2023-12-08T08:17:57.803608+0000","last_became_peered":"2023-12-08T08:17:57.803608+0000","last_unstale":"2023-12-08T08:17:58.788982+0000","last_undegraded":"2023-12-08T08:17:58.788982+0000","last_fullsized":"2023-12-08T08:17:58.788982+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768506+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:57.768506+0000","last_peered":"2023-12-08T08:17:57.768506+0000","last_clean":"2023-12-08T08:17:57.768506+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:57.768506+0000","last_undegraded":"2023-12-08T08:17:57.768506+0000","last_fullsized":"2023-12-08T08:17:57.768506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254515+0000","last_change":"2023-12-08T08:17:57.807446+0000","last_active":"2023-12-08T08:17:59.254515+0000","last_peered":"2023-12-08T08:17:59.254515+0000","last_clean":"2023-12-08T08:17:59.254515+0000","last_became_active":"2023-12-08T08:17:57.804900+0000","last_became_peered":"2023-12-08T08:17:57.804900+0000","last_unstale":"2023-12-08T08:17:59.254515+0000","last_undegraded":"2023-12-08T08:17:59.254515+0000","last_fullsized":"2023-12-08T08:17:59.254515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:01:09.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775663+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:57.775663+0000","last_peered":"2023-12-08T08:17:57.775663+0000","last_clean":"2023-12-08T08:17:57.775663+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:57.775663+0000","last_undegraded":"2023-12-08T08:17:57.775663+0000","last_fullsized":"2023-12-08T08:17:57.775663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786639+0000","last_change":"2023-12-08T08:17:57.790074+0000","last_active":"2023-12-08T08:17:58.786639+0000","last_peered":"2023-12-08T08:17:58.786639+0000","last_clean":"2023-12-08T08:17:58.786639+0000","last_became_active":"2023-12-08T08:17:57.789798+0000","last_became_peered":"2023-12-08T08:17:57.789798+0000","last_unstale":"2023-12-08T08:17:58.786639+0000","last_undegraded":"2023-12-08T08:17:58.786639+0000","last_fullsized":"2023-12-08T08:17:58.786639+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:16.705997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785471+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:57.785471+0000","last_peered":"2023-12-08T08:17:57.785471+0000","last_clean":"2023-12-08T08:17:57.785471+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:57.785471+0000","last_undegraded":"2023-12-08T08:17:57.785471+0000","last_fullsized":"2023-12-08T08:17:57.785471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256755+0000","last_change":"2023-12-08T08:17:57.789874+0000","last_active":"2023-12-08T08:17:59.256755+0000","last_peered":"2023-12-08T08:17:59.256755+0000","last_clean":"2023-12-08T08:17:59.256755+0000","last_became_active":"2023-12-08T08:17:57.789614+0000","last_became_peered":"2023-12-08T08:17:57.789614+0000","last_unstale":"2023-12-08T08:17:59.256755+0000","last_undegraded":"2023-12-08T08:17:59.256755+0000","last_fullsized":"2023-12-08T08:17:59.256755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:03.242262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786817+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:57.786817+0000","last_peered":"2023-12-08T08:17:57.786817+0000","last_clean":"2023-12-08T08:17:57.786817+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:57.786817+0000","last_undegraded":"2023-12-08T08:17:57.786817+0000","last_fullsized":"2023-12-08T08:17:57.786817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:45.955555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257840+0000","last_change":"2023-12-08T08:17:57.777534+0000","last_active":"2023-12-08T08:17:59.257840+0000","last_peered":"2023-12-08T08:17:59.257840+0000","last_clean":"2023-12-08T08:17:59.257840+0000","last_became_active":"2023-12-08T08:17:57.777268+0000","last_became_peered":"2023-12-08T08:17:57.777268+0000","last_unstale":"2023-12-08T08:17:59.257840+0000","last_undegraded":"2023-12-08T08:17:59.257840+0000","last_fullsized":"2023-12-08T08:17:59.257840+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:13.788448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783489+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:57.783489+0000","last_peered":"2023-12-08T08:17:57.783489+0000","last_clean":"2023-12-08T08:17:57.783489+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:57.783489+0000","last_undegraded":"2023-12-08T08:17:57.783489+0000","last_fullsized":"2023-12-08T08:17:57.783489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:27.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256652+0000","last_change":"2023-12-08T08:17:57.803290+0000","last_active":"2023-12-08T08:17:59.256652+0000","last_peered":"2023-12-08T08:17:59.256652+0000","last_clean":"2023-12-08T08:17:59.256652+0000","last_became_active":"2023-12-08T08:17:57.802999+0000","last_became_peered":"2023-12-08T08:17:57.802999+0000","last_unstale":"2023-12-08T08:17:59.256652+0000","last_undegraded":"2023-12-08T08:17:59.256652+0000","last_fullsized":"2023-12-08T08:17:59.256652+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:42:34.691868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779653+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:57.779653+0000","last_peered":"2023-12-08T08:17:57.779653+0000","last_clean":"2023-12-08T08:17:57.779653+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:57.779653+0000","last_undegraded":"2023-12-08T08:17:57.779653+0000","last_fullsized":"2023-12-08T08:17:57.779653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.251026+0000","last_change":"2023-12-08T08:17:57.800098+0000","last_active":"2023-12-08T08:17:59.251026+0000","last_peered":"2023-12-08T08:17:59.251026+0000","last_clean":"2023-12-08T08:17:59.251026+0000","last_became_active":"2023-12-08T08:17:57.799829+0000","last_became_peered":"2023-12-08T08:17:57.799829+0000","last_unstale":"2023-12-08T08:17:59.251026+0000","last_undegraded":"2023-12-08T08:17:59.251026+0000","last_fullsized":"2023-12-08T08:17:59.251026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:45.444549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793627+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:57.793627+0000","last_peered":"2023-12-08T08:17:57.793627+0000","last_clean":"2023-12-08T08:17:57.793627+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:57.793627+0000","last_undegraded":"2023-12-08T08:17:57.793627+0000","last_fullsized":"2023-12-08T08:17:57.793627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254289+0000","last_change":"2023-12-08T08:17:57.792784+0000","last_active":"2023-12-08T08:17:59.254289+0000","last_peered":"2023-12-08T08:17:59.254289+0000","last_clean":"2023-12-08T08:17:59.254289+0000","last_became_active":"2023-12-08T08:17:57.792477+0000","last_became_peered":"2023-12-08T08:17:57.792477+0000","last_unstale":"2023-12-08T08:17:59.254289+0000","last_undegraded":"2023-12-08T08:17:59.254289+0000","last_fullsized":"2023-12-08T08:17:59.254289+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790421+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:57.790421+0000","last_peered":"2023-12-08T08:17:57.790421+0000","last_clean":"2023-12-08T08:17:57.790421+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:57.790421+0000","last_undegraded":"2023-12-08T08:17:57.790421+0000","last_fullsized":"2023-12-08T08:17:57.790421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252756+0000","last_change":"2023-12-08T08:17:57.801131+0000","last_active":"2023-12-08T08:17:59.252756+0000","last_peered":"2023-12-08T08:17:59.252756+0000","last_clean":"2023-12-08T08:17:59.252756+0000","last_became_active":"2023-12-08T08:17:57.800866+0000","last_became_peered":"2023-12-08T08:17:57.800866+0000","last_unstale":"2023-12-08T08:17:59.252756+0000","last_undegraded":"2023-12-08T08:17:59.252756+0000","last_fullsized":"2023-12-08T08:17:59.252756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:31.337049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786261+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:57.786261+0000","last_peered":"2023-12-08T08:17:57.786261+0000","last_clean":"2023-12-08T08:17:57.786261+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:57.786261+0000","last_undegraded":"2023-12-08T08:17:57.786261+0000","last_fullsized":"2023-12-08T08:17:57.786261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257046+0000","last_change":"2023-12-08T08:17:57.800471+0000","last_active":"2023-12-08T08:17:59.257046+0000","last_peered":"2023-12-08T08:17:59.257046+0000","last_clean":"2023-12-08T08:17:59.257046+0000","last_became_active":"2023-12-08T08:17:57.800158+0000","last_became_peered":"2023-12-08T08:17:57.800158+0000","last_unstale":"2023-12-08T08:17:59.257046+0000","last_undegraded":"2023-12-08T08:17:59.257046+0000","last_fullsized":"2023-12-08T08:17:59.257046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:58.760893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782817+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:57.782817+0000","last_peered":"2023-12-08T08:17:57.782817+0000","last_clean":"2023-12-08T08:17:57.782817+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:57.782817+0000","last_undegraded":"2023-12-08T08:17:57.782817+0000","last_fullsized":"2023-12-08T08:17:57.782817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:11:24.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257306+0000","last_change":"2023-12-08T08:17:57.801790+0000","last_active":"2023-12-08T08:17:59.257306+0000","last_peered":"2023-12-08T08:17:59.257306+0000","last_clean":"2023-12-08T08:17:59.257306+0000","last_became_active":"2023-12-08T08:17:57.800983+0000","last_became_peered":"2023-12-08T08:17:57.800983+0000","last_unstale":"2023-12-08T08:17:59.257306+0000","last_undegraded":"2023-12-08T08:17:59.257306+0000","last_fullsized":"2023-12-08T08:17:59.257306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:16.705997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784842+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:57.784842+0000","last_peered":"2023-12-08T08:17:57.784842+0000","last_clean":"2023-12-08T08:17:57.784842+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:57.784842+0000","last_undegraded":"2023-12-08T08:17:57.784842+0000","last_fullsized":"2023-12-08T08:17:57.784842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257148+0000","last_change":"2023-12-08T08:17:57.798391+0000","last_active":"2023-12-08T08:17:59.257148+0000","last_peered":"2023-12-08T08:17:59.257148+0000","last_clean":"2023-12-08T08:17:59.257148+0000","last_became_active":"2023-12-08T08:17:57.798074+0000","last_became_peered":"2023-12-08T08:17:57.798074+0000","last_unstale":"2023-12-08T08:17:59.257148+0000","last_undegraded":"2023-12-08T08:17:59.257148+0000","last_fullsized":"2023-12-08T08:17:59.257148+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:27.569388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785764+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:57.785764+0000","last_peered":"2023-12-08T08:17:57.785764+0000","last_clean":"2023-12-08T08:17:57.785764+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:57.785764+0000","last_undegraded":"2023-12-08T08:17:57.785764+0000","last_fullsized":"2023-12-08T08:17:57.785764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257597+0000","last_change":"2023-12-08T08:17:57.795403+0000","last_active":"2023-12-08T08:17:59.257597+0000","last_peered":"2023-12-08T08:17:59.257597+0000","last_clean":"2023-12-08T08:17:59.257597+0000","last_became_active":"2023-12-08T08:17:57.795127+0000","last_became_peered":"2023-12-08T08:17:57.795127+0000","last_unstale":"2023-12-08T08:17:59.257597+0000","last_undegraded":"2023-12-08T08:17:59.257597+0000","last_fullsized":"2023-12-08T08:17:59.257597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:18.074256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.778708+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:57.778708+0000","last_peered":"2023-12-08T08:17:57.778708+0000","last_clean":"2023-12-08T08:17:57.778708+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:57.778708+0000","last_undegraded":"2023-12-08T08:17:57.778708+0000","last_fullsized":"2023-12-08T08:17:57.778708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255239+0000","last_change":"2023-12-08T08:17:57.811003+0000","last_active":"2023-12-08T08:17:59.255239+0000","last_peered":"2023-12-08T08:17:59.255239+0000","last_clean":"2023-12-08T08:17:59.255239+0000","last_became_active":"2023-12-08T08:17:57.810507+0000","last_became_peered":"2023-12-08T08:17:57.810507+0000","last_unstale":"2023-12-08T08:17:59.255239+0000","last_undegraded":"2023-12-08T08:17:59.255239+0000","last_fullsized":"2023-12-08T08:17:59.255239+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775850+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:57.775850+0000","last_peered":"2023-12-08T08:17:57.775850+0000","last_clean":"2023-12-08T08:17:57.775850+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:57.775850+0000","last_undegraded":"2023-12-08T08:17:57.775850+0000","last_fullsized":"2023-12-08T08:17:57.775850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788884+0000","last_change":"2023-12-08T08:17:57.807680+0000","last_active":"2023-12-08T08:17:58.788884+0000","last_peered":"2023-12-08T08:17:58.788884+0000","last_clean":"2023-12-08T08:17:58.788884+0000","last_became_active":"2023-12-08T08:17:57.807297+0000","last_became_peered":"2023-12-08T08:17:57.807297+0000","last_unstale":"2023-12-08T08:17:58.788884+0000","last_undegraded":"2023-12-08T08:17:58.788884+0000","last_fullsized":"2023-12-08T08:17:58.788884+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.823075+0000","last_change":"2023-12-08T08:17:56.795327+0000","last_active":"2023-12-08T08:17:57.823075+0000","last_peered":"2023-12-08T08:17:57.823075+0000","last_clean":"2023-12-08T08:17:57.823075+0000","last_became_active":"2023-12-08T08:17:56.795056+0000","last_became_peered":"2023-12-08T08:17:56.795056+0000","last_unstale":"2023-12-08T08:17:57.823075+0000","last_undegraded":"2023-12-08T08:17:57.823075+0000","last_fullsized":"2023-12-08T08:17:57.823075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:46.654077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768243+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:57.768243+0000","last_peered":"2023-12-08T08:17:57.768243+0000","last_clean":"2023-12-08T08:17:57.768243+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:57.768243+0000","last_undegraded":"2023-12-08T08:17:57.768243+0000","last_fullsized":"2023-12-08T08:17:57.768243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779530+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:57.779530+0000","last_peered":"2023-12-08T08:17:57.779530+0000","last_clean":"2023-12-08T08:17:57.779530+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:57.779530+0000","last_undegraded":"2023-12-08T08:17:57.779530+0000","last_fullsized":"2023-12-08T08:17:57.779530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.789022+0000","last_change":"2023-12-08T08:17:57.805111+0000","last_active":"2023-12-08T08:17:58.789022+0000","last_peered":"2023-12-08T08:17:58.789022+0000","last_clean":"2023-12-08T08:17:58.789022+0000","last_became_active":"2023-12-08T08:17:57.804857+0000","last_became_peered":"2023-12-08T08:17:57.804857+0000","last_unstale":"2023-12-08T08:17:58.789022+0000","last_undegraded":"2023-12-08T08:17:58.789022+0000","last_fullsized":"2023-12-08T08:17:58.789022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.824870+0000","last_change":"2023-12-08T08:17:56.798852+0000","last_active":"2023-12-08T08:17:57.824870+0000","last_peered":"2023-12-08T08:17:57.824870+0000","last_clean":"2023-12-08T08:17:57.824870+0000","last_became_active":"2023-12-08T08:17:56.798551+0000","last_became_peered":"2023-12-08T08:17:56.798551+0000","last_unstale":"2023-12-08T08:17:57.824870+0000","last_undegraded":"2023-12-08T08:17:57.824870+0000","last_fullsized":"2023-12-08T08:17:57.824870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:17.192846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786390+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:57.786390+0000","last_peered":"2023-12-08T08:17:57.786390+0000","last_clean":"2023-12-08T08:17:57.786390+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:57.786390+0000","last_undegraded":"2023-12-08T08:17:57.786390+0000","last_fullsized":"2023-12-08T08:17:57.786390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789560+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:57.789560+0000","last_peered":"2023-12-08T08:17:57.789560+0000","last_clean":"2023-12-08T08:17:57.789560+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:57.789560+0000","last_undegraded":"2023-12-08T08:17:57.789560+0000","last_fullsized":"2023-12-08T08:17:57.789560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.250416+0000","last_change":"2023-12-08T08:17:57.794889+0000","last_active":"2023-12-08T08:17:59.250416+0000","last_peered":"2023-12-08T08:17:59.250416+0000","last_clean":"2023-12-08T08:17:59.250416+0000","last_became_active":"2023-12-08T08:17:57.794635+0000","last_became_peered":"2023-12-08T08:17:57.794635+0000","last_unstale":"2023-12-08T08:17:59.250416+0000","last_undegraded":"2023-12-08T08:17:59.250416+0000","last_fullsized":"2023-12-08T08:17:59.250416+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:07.367177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.823632+0000","last_change":"2023-12-08T08:17:56.783004+0000","last_active":"2023-12-08T08:17:57.823632+0000","last_peered":"2023-12-08T08:17:57.823632+0000","last_clean":"2023-12-08T08:17:57.823632+0000","last_became_active":"2023-12-08T08:17:56.780718+0000","last_became_peered":"2023-12-08T08:17:56.780718+0000","last_unstale":"2023-12-08T08:17:57.823632+0000","last_undegraded":"2023-12-08T08:17:57.823632+0000","last_fullsized":"2023-12-08T08:17:57.823632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:03.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790305+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:57.790305+0000","last_peered":"2023-12-08T08:17:57.790305+0000","last_clean":"2023-12-08T08:17:57.790305+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:57.790305+0000","last_undegraded":"2023-12-08T08:17:57.790305+0000","last_fullsized":"2023-12-08T08:17:57.790305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792818+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:57.792818+0000","last_peered":"2023-12-08T08:17:57.792818+0000","last_clean":"2023-12-08T08:17:57.792818+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:57.792818+0000","last_undegraded":"2023-12-08T08:17:57.792818+0000","last_fullsized":"2023-12-08T08:17:57.792818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255846+0000","last_change":"2023-12-08T08:17:57.803592+0000","last_active":"2023-12-08T08:17:59.255846+0000","last_peered":"2023-12-08T08:17:59.255846+0000","last_clean":"2023-12-08T08:17:59.255846+0000","last_became_active":"2023-12-08T08:17:57.803297+0000","last_became_peered":"2023-12-08T08:17:57.803297+0000","last_unstale":"2023-12-08T08:17:59.255846+0000","last_undegraded":"2023-12-08T08:17:59.255846+0000","last_fullsized":"2023-12-08T08:17:59.255846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:35.027907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.824644+0000","last_change":"2023-12-08T08:17:56.796020+0000","last_active":"2023-12-08T08:17:57.824644+0000","last_peered":"2023-12-08T08:17:57.824644+0000","last_clean":"2023-12-08T08:17:57.824644+0000","last_became_active":"2023-12-08T08:17:56.795600+0000","last_became_peered":"2023-12-08T08:17:56.795600+0000","last_unstale":"2023-12-08T08:17:57.824644+0000","last_undegraded":"2023-12-08T08:17:57.824644+0000","last_fullsized":"2023-12-08T08:17:57.824644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:45.593376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791478+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:57.791478+0000","last_peered":"2023-12-08T08:17:57.791478+0000","last_clean":"2023-12-08T08:17:57.791478+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:57.791478+0000","last_undegraded":"2023-12-08T08:17:57.791478+0000","last_fullsized":"2023-12-08T08:17:57.791478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792764+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:57.792764+0000","last_peered":"2023-12-08T08:17:57.792764+0000","last_clean":"2023-12-08T08:17:57.792764+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:57.792764+0000","last_undegraded":"2023-12-08T08:17:57.792764+0000","last_fullsized":"2023-12-08T08:17:57.792764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.790359+0000","last_change":"2023-12-08T08:17:57.793126+0000","last_active":"2023-12-08T08:17:58.790359+0000","last_peered":"2023-12-08T08:17:58.790359+0000","last_clean":"2023-12-08T08:17:58.790359+0000","last_became_active":"2023-12-08T08:17:57.792835+0000","last_became_peered":"2023-12-08T08:17:57.792835+0000","last_unstale":"2023-12-08T08:17:58.790359+0000","last_undegraded":"2023-12-08T08:17:58.790359+0000","last_fullsized":"2023-12-08T08:17:58.790359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782155+0000","last_change":"2023-12-08T08:17:56.785550+0000","last_active":"2023-12-08T08:17:57.782155+0000","last_peered":"2023-12-08T08:17:57.782155+0000","last_clean":"2023-12-08T08:17:57.782155+0000","last_became_active":"2023-12-08T08:17:56.785143+0000","last_became_peered":"2023-12-08T08:17:56.785143+0000","last_unstale":"2023-12-08T08:17:57.782155+0000","last_undegraded":"2023-12-08T08:17:57.782155+0000","last_fullsized":"2023-12-08T08:17:57.782155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:41.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760306+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:57.760306+0000","last_peered":"2023-12-08T08:17:57.760306+0000","last_clean":"2023-12-08T08:17:57.760306+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:57.760306+0000","last_undegraded":"2023-12-08T08:17:57.760306+0000","last_fullsized":"2023-12-08T08:17:57.760306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:50.669464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774961+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:57.774961+0000","last_peered":"2023-12-08T08:17:57.774961+0000","last_clean":"2023-12-08T08:17:57.774961+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:57.774961+0000","last_undegraded":"2023-12-08T08:17:57.774961+0000","last_fullsized":"2023-12-08T08:17:57.774961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254185+0000","last_change":"2023-12-08T08:17:57.787179+0000","last_active":"2023-12-08T08:17:59.254185+0000","last_peered":"2023-12-08T08:17:59.254185+0000","last_clean":"2023-12-08T08:17:59.254185+0000","last_became_active":"2023-12-08T08:17:57.786855+0000","last_became_peered":"2023-12-08T08:17:57.786855+0000","last_unstale":"2023-12-08T08:17:59.254185+0000","last_undegraded":"2023-12-08T08:17:59.254185+0000","last_fullsized":"2023-12-08T08:17:59.254185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:55.630298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779651+0000","last_change":"2023-12-08T08:17:56.787431+0000","last_active":"2023-12-08T08:17:57.779651+0000","last_peered":"2023-12-08T08:17:57.779651+0000","last_clean":"2023-12-08T08:17:57.779651+0000","last_became_active":"2023-12-08T08:17:56.787150+0000","last_became_peered":"2023-12-08T08:17:56.787150+0000","last_unstale":"2023-12-08T08:17:57.779651+0000","last_undegraded":"2023-12-08T08:17:57.779651+0000","last_fullsized":"2023-12-08T08:17:57.779651+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:02.405102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779885+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:57.779885+0000","last_peered":"2023-12-08T08:17:57.779885+0000","last_clean":"2023-12-08T08:17:57.779885+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:57.779885+0000","last_undegraded":"2023-12-08T08:17:57.779885+0000","last_fullsized":"2023-12-08T08:17:57.779885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:49.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786944+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:57.786944+0000","last_peered":"2023-12-08T08:17:57.786944+0000","last_clean":"2023-12-08T08:17:57.786944+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:57.786944+0000","last_undegraded":"2023-12-08T08:17:57.786944+0000","last_fullsized":"2023-12-08T08:17:57.786944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252160+0000","last_change":"2023-12-08T08:17:57.805172+0000","last_active":"2023-12-08T08:17:59.252160+0000","last_peered":"2023-12-08T08:17:59.252160+0000","last_clean":"2023-12-08T08:17:59.252160+0000","last_became_active":"2023-12-08T08:17:57.801743+0000","last_became_peered":"2023-12-08T08:17:57.801743+0000","last_unstale":"2023-12-08T08:17:59.252160+0000","last_undegraded":"2023-12-08T08:17:59.252160+0000","last_fullsized":"2023-12-08T08:17:59.252160+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:43:48.950090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.820196+0000","last_change":"2023-12-08T08:17:56.793596+0000","last_active":"2023-12-08T08:17:57.820196+0000","last_peered":"2023-12-08T08:17:57.820196+0000","last_clean":"2023-12-08T08:17:57.820196+0000","last_became_active":"2023-12-08T08:17:56.793096+0000","last_became_peered":"2023-12-08T08:17:56.793096+0000","last_unstale":"2023-12-08T08:17:57.820196+0000","last_undegraded":"2023-12-08T08:17:57.820196+0000","last_fullsized":"2023-12-08T08:17:57.820196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:06.204089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768224+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:57.768224+0000","last_peered":"2023-12-08T08:17:57.768224+0000","last_clean":"2023-12-08T08:17:57.768224+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:57.768224+0000","last_undegraded":"2023-12-08T08:17:57.768224+0000","last_fullsized":"2023-12-08T08:17:57.768224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783578+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:57.783578+0000","last_peered":"2023-12-08T08:17:57.783578+0000","last_clean":"2023-12-08T08:17:57.783578+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:57.783578+0000","last_undegraded":"2023-12-08T08:17:57.783578+0000","last_fullsized":"2023-12-08T08:17:57.783578+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253997+0000","last_change":"2023-12-08T08:17:57.803214+0000","last_active":"2023-12-08T08:17:59.253997+0000","last_peered":"2023-12-08T08:17:59.253997+0000","last_clean":"2023-12-08T08:17:59.253997+0000","last_became_active":"2023-12-08T08:17:57.800416+0000","last_became_peered":"2023-12-08T08:17:57.800416+0000","last_unstale":"2023-12-08T08:17:59.253997+0000","last_undegraded":"2023-12-08T08:17:59.253997+0000","last_fullsized":"2023-12-08T08:17:59.253997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:59.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.819694+0000","last_change":"2023-12-08T08:17:56.772823+0000","last_active":"2023-12-08T08:17:57.819694+0000","last_peered":"2023-12-08T08:17:57.819694+0000","last_clean":"2023-12-08T08:17:57.819694+0000","last_became_active":"2023-12-08T08:17:56.772152+0000","last_became_peered":"2023-12-08T08:17:56.772152+0000","last_unstale":"2023-12-08T08:17:57.819694+0000","last_undegraded":"2023-12-08T08:17:57.819694+0000","last_fullsized":"2023-12-08T08:17:57.819694+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:39.332501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774867+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:57.774867+0000","last_peered":"2023-12-08T08:17:57.774867+0000","last_clean":"2023-12-08T08:17:57.774867+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:57.774867+0000","last_undegraded":"2023-12-08T08:17:57.774867+0000","last_fullsized":"2023-12-08T08:17:57.774867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767380+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:57.767380+0000","last_peered":"2023-12-08T08:17:57.767380+0000","last_clean":"2023-12-08T08:17:57.767380+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:57.767380+0000","last_undegraded":"2023-12-08T08:17:57.767380+0000","last_fullsized":"2023-12-08T08:17:57.767380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786181+0000","last_change":"2023-12-08T08:17:57.799273+0000","last_active":"2023-12-08T08:17:58.786181+0000","last_peered":"2023-12-08T08:17:58.786181+0000","last_clean":"2023-12-08T08:17:58.786181+0000","last_became_active":"2023-12-08T08:17:57.798921+0000","last_became_peered":"2023-12-08T08:17:57.798921+0000","last_unstale":"2023-12-08T08:17:58.786181+0000","last_undegraded":"2023-12-08T08:17:58.786181+0000","last_fullsized":"2023-12-08T08:17:58.786181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:58.760893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822955+0000","last_change":"2023-12-08T08:17:56.778625+0000","last_active":"2023-12-08T08:17:57.822955+0000","last_peered":"2023-12-08T08:17:57.822955+0000","last_clean":"2023-12-08T08:17:57.822955+0000","last_became_active":"2023-12-08T08:17:56.778322+0000","last_became_peered":"2023-12-08T08:17:56.778322+0000","last_unstale":"2023-12-08T08:17:57.822955+0000","last_undegraded":"2023-12-08T08:17:57.822955+0000","last_fullsized":"2023-12-08T08:17:57.822955+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:15.872633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782687+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:57.782687+0000","last_peered":"2023-12-08T08:17:57.782687+0000","last_clean":"2023-12-08T08:17:57.782687+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:57.782687+0000","last_undegraded":"2023-12-08T08:17:57.782687+0000","last_fullsized":"2023-12-08T08:17:57.782687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:19.234272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791808+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:57.791808+0000","last_peered":"2023-12-08T08:17:57.791808+0000","last_clean":"2023-12-08T08:17:57.791808+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:57.791808+0000","last_undegraded":"2023-12-08T08:17:57.791808+0000","last_fullsized":"2023-12-08T08:17:57.791808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252676+0000","last_change":"2023-12-08T08:17:57.801494+0000","last_active":"2023-12-08T08:17:59.252676+0000","last_peered":"2023-12-08T08:17:59.252676+0000","last_clean":"2023-12-08T08:17:59.252676+0000","last_became_active":"2023-12-08T08:17:57.801167+0000","last_became_peered":"2023-12-08T08:17:57.801167+0000","last_unstale":"2023-12-08T08:17:59.252676+0000","last_undegraded":"2023-12-08T08:17:59.252676+0000","last_fullsized":"2023-12-08T08:17:59.252676+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:53:53.804796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.827243+0000","last_change":"2023-12-08T08:17:56.796421+0000","last_active":"2023-12-08T08:17:57.827243+0000","last_peered":"2023-12-08T08:17:57.827243+0000","last_clean":"2023-12-08T08:17:57.827243+0000","last_became_active":"2023-12-08T08:17:56.795882+0000","last_became_peered":"2023-12-08T08:17:56.795882+0000","last_unstale":"2023-12-08T08:17:57.827243+0000","last_undegraded":"2023-12-08T08:17:57.827243+0000","last_fullsized":"2023-12-08T08:17:57.827243+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:20.323825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782067+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:57.782067+0000","last_peered":"2023-12-08T08:17:57.782067+0000","last_clean":"2023-12-08T08:17:57.782067+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:57.782067+0000","last_undegraded":"2023-12-08T08:17:57.782067+0000","last_fullsized":"2023-12-08T08:17:57.782067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787313+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:57.787313+0000","last_peered":"2023-12-08T08:17:57.787313+0000","last_clean":"2023-12-08T08:17:57.787313+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:57.787313+0000","last_undegraded":"2023-12-08T08:17:57.787313+0000","last_fullsized":"2023-12-08T08:17:57.787313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.251527+0000","last_change":"2023-12-08T08:17:57.796995+0000","last_active":"2023-12-08T08:17:59.251527+0000","last_peered":"2023-12-08T08:17:59.251527+0000","last_clean":"2023-12-08T08:17:59.251527+0000","last_became_active":"2023-12-08T08:17:57.796736+0000","last_became_peered":"2023-12-08T08:17:57.796736+0000","last_unstale":"2023-12-08T08:17:59.251527+0000","last_undegraded":"2023-12-08T08:17:59.251527+0000","last_fullsized":"2023-12-08T08:17:59.251527+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:57.655655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790867+0000","last_change":"2023-12-08T08:17:56.796029+0000","last_active":"2023-12-08T08:17:57.790867+0000","last_peered":"2023-12-08T08:17:57.790867+0000","last_clean":"2023-12-08T08:17:57.790867+0000","last_became_active":"2023-12-08T08:17:56.795266+0000","last_became_peered":"2023-12-08T08:17:56.795266+0000","last_unstale":"2023-12-08T08:17:57.790867+0000","last_undegraded":"2023-12-08T08:17:57.790867+0000","last_fullsized":"2023-12-08T08:17:57.790867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769289+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:57.769289+0000","last_peered":"2023-12-08T08:17:57.769289+0000","last_clean":"2023-12-08T08:17:57.769289+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:57.769289+0000","last_undegraded":"2023-12-08T08:17:57.769289+0000","last_fullsized":"2023-12-08T08:17:57.769289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789721+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:57.789721+0000","last_peered":"2023-12-08T08:17:57.789721+0000","last_clean":"2023-12-08T08:17:57.789721+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:57.789721+0000","last_undegraded":"2023-12-08T08:17:57.789721+0000","last_fullsized":"2023-12-08T08:17:57.789721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252730+0000","last_change":"2023-12-08T08:17:57.799188+0000","last_active":"2023-12-08T08:17:59.252730+0000","last_peered":"2023-12-08T08:17:59.252730+0000","last_clean":"2023-12-08T08:17:59.252730+0000","last_became_active":"2023-12-08T08:17:57.798666+0000","last_became_peered":"2023-12-08T08:17:57.798666+0000","last_unstale":"2023-12-08T08:17:59.252730+0000","last_undegraded":"2023-12-08T08:17:59.252730+0000","last_fullsized":"2023-12-08T08:17:59.252730+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:22:29.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790324+0000","last_change":"2023-12-08T08:17:56.784864+0000","last_active":"2023-12-08T08:17:57.790324+0000","last_peered":"2023-12-08T08:17:57.790324+0000","last_clean":"2023-12-08T08:17:57.790324+0000","last_became_active":"2023-12-08T08:17:56.784452+0000","last_became_peered":"2023-12-08T08:17:56.784452+0000","last_unstale":"2023-12-08T08:17:57.790324+0000","last_undegraded":"2023-12-08T08:17:57.790324+0000","last_fullsized":"2023-12-08T08:17:57.790324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:04.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790766+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:57.790766+0000","last_peered":"2023-12-08T08:17:57.790766+0000","last_clean":"2023-12-08T08:17:57.790766+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:57.790766+0000","last_undegraded":"2023-12-08T08:17:57.790766+0000","last_fullsized":"2023-12-08T08:17:57.790766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:37.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":26,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782864+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:57.782864+0000","last_peered":"2023-12-08T08:17:57.782864+0000","last_clean":"2023-12-08T08:17:57.782864+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:57.782864+0000","last_undegraded":"2023-12-08T08:17:57.782864+0000","last_fullsized":"2023-12-08T08:17:57.782864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255577+0000","last_change":"2023-12-08T08:17:57.796124+0000","last_active":"2023-12-08T08:17:59.255577+0000","last_peered":"2023-12-08T08:17:59.255577+0000","last_clean":"2023-12-08T08:17:59.255577+0000","last_became_active":"2023-12-08T08:17:57.795855+0000","last_became_peered":"2023-12-08T08:17:57.795855+0000","last_unstale":"2023-12-08T08:17:59.255577+0000","last_undegraded":"2023-12-08T08:17:59.255577+0000","last_fullsized":"2023-12-08T08:17:59.255577+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:28.393422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779707+0000","last_change":"2023-12-08T08:17:56.777484+0000","last_active":"2023-12-08T08:17:57.779707+0000","last_peered":"2023-12-08T08:17:57.779707+0000","last_clean":"2023-12-08T08:17:57.779707+0000","last_became_active":"2023-12-08T08:17:56.776424+0000","last_became_peered":"2023-12-08T08:17:56.776424+0000","last_unstale":"2023-12-08T08:17:57.779707+0000","last_undegraded":"2023-12-08T08:17:57.779707+0000","last_fullsized":"2023-12-08T08:17:57.779707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:23.600820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779169+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:57.779169+0000","last_peered":"2023-12-08T08:17:57.779169+0000","last_clean":"2023-12-08T08:17:57.779169+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:57.779169+0000","last_undegraded":"2023-12-08T08:17:57.779169+0000","last_fullsized":"2023-12-08T08:17:57.779169+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785048+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:57.785048+0000","last_peered":"2023-12-08T08:17:57.785048+0000","last_clean":"2023-12-08T08:17:57.785048+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:57.785048+0000","last_undegraded":"2023-12-08T08:17:57.785048+0000","last_fullsized":"2023-12-08T08:17:57.785048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254339+0000","last_change":"2023-12-08T08:17:57.789172+0000","last_active":"2023-12-08T08:17:59.254339+0000","last_peered":"2023-12-08T08:17:59.254339+0000","last_clean":"2023-12-08T08:17:59.254339+0000","last_became_active":"2023-12-08T08:17:57.788900+0000","last_became_peered":"2023-12-08T08:17:57.788900+0000","last_unstale":"2023-12-08T08:17:59.254339+0000","last_undegraded":"2023-12-08T08:17:59.254339+0000","last_fullsized":"2023-12-08T08:17:59.254339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:28.979610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825764+0000","last_change":"2023-12-08T08:17:56.789756+0000","last_active":"2023-12-08T08:17:57.825764+0000","last_peered":"2023-12-08T08:17:57.825764+0000","last_clean":"2023-12-08T08:17:57.825764+0000","last_became_active":"2023-12-08T08:17:56.789515+0000","last_became_peered":"2023-12-08T08:17:56.789515+0000","last_unstale":"2023-12-08T08:17:57.825764+0000","last_undegraded":"2023-12-08T08:17:57.825764+0000","last_fullsized":"2023-12-08T08:17:57.825764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:10.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787350+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:57.787350+0000","last_peered":"2023-12-08T08:17:57.787350+0000","last_clean":"2023-12-08T08:17:57.787350+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:57.787350+0000","last_undegraded":"2023-12-08T08:17:57.787350+0000","last_fullsized":"2023-12-08T08:17:57.787350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785848+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:57.785848+0000","last_peered":"2023-12-08T08:17:57.785848+0000","last_clean":"2023-12-08T08:17:57.785848+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:57.785848+0000","last_undegraded":"2023-12-08T08:17:57.785848+0000","last_fullsized":"2023-12-08T08:17:57.785848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255417+0000","last_change":"2023-12-08T08:17:57.795824+0000","last_active":"2023-12-08T08:17:59.255417+0000","last_peered":"2023-12-08T08:17:59.255417+0000","last_clean":"2023-12-08T08:17:59.255417+0000","last_became_active":"2023-12-08T08:17:57.793498+0000","last_became_peered":"2023-12-08T08:17:57.793498+0000","last_unstale":"2023-12-08T08:17:59.255417+0000","last_undegraded":"2023-12-08T08:17:59.255417+0000","last_fullsized":"2023-12-08T08:17:59.255417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825127+0000","last_change":"2023-12-08T08:17:56.788069+0000","last_active":"2023-12-08T08:17:57.825127+0000","last_peered":"2023-12-08T08:17:57.825127+0000","last_clean":"2023-12-08T08:17:57.825127+0000","last_became_active":"2023-12-08T08:17:56.787757+0000","last_became_peered":"2023-12-08T08:17:56.787757+0000","last_unstale":"2023-12-08T08:17:57.825127+0000","last_undegraded":"2023-12-08T08:17:57.825127+0000","last_fullsized":"2023-12-08T08:17:57.825127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:01.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767749+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:57.767749+0000","last_peered":"2023-12-08T08:17:57.767749+0000","last_clean":"2023-12-08T08:17:57.767749+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:57.767749+0000","last_undegraded":"2023-12-08T08:17:57.767749+0000","last_fullsized":"2023-12-08T08:17:57.767749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780353+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:57.780353+0000","last_peered":"2023-12-08T08:17:57.780353+0000","last_clean":"2023-12-08T08:17:57.780353+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:57.780353+0000","last_undegraded":"2023-12-08T08:17:57.780353+0000","last_fullsized":"2023-12-08T08:17:57.780353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254856+0000","last_change":"2023-12-08T08:17:57.794971+0000","last_active":"2023-12-08T08:17:59.254856+0000","last_peered":"2023-12-08T08:17:59.254856+0000","last_clean":"2023-12-08T08:17:59.254856+0000","last_became_active":"2023-12-08T08:17:57.793598+0000","last_became_peered":"2023-12-08T08:17:57.793598+0000","last_unstale":"2023-12-08T08:17:59.254856+0000","last_undegraded":"2023-12-08T08:17:59.254856+0000","last_fullsized":"2023-12-08T08:17:59.254856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.416931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782392+0000","last_change":"2023-12-08T08:17:56.792597+0000","last_active":"2023-12-08T08:17:57.782392+0000","last_peered":"2023-12-08T08:17:57.782392+0000","last_clean":"2023-12-08T08:17:57.782392+0000","last_became_active":"2023-12-08T08:17:56.792311+0000","last_became_peered":"2023-12-08T08:17:56.792311+0000","last_unstale":"2023-12-08T08:17:57.782392+0000","last_undegraded":"2023-12-08T08:17:57.782392+0000","last_fullsized":"2023-12-08T08:17:57.782392+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:32.840644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779116+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:57.779116+0000","last_peered":"2023-12-08T08:17:57.779116+0000","last_clean":"2023-12-08T08:17:57.779116+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:57.779116+0000","last_undegraded":"2023-12-08T08:17:57.779116+0000","last_fullsized":"2023-12-08T08:17:57.779116+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:13:24.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":43,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783952+0000","last_change":"2023-12-08T08:17:47.914689+0000","last_active":"2023-12-08T08:17:57.783952+0000","last_peered":"2023-12-08T08:17:57.783952+0000","last_clean":"2023-12-08T08:17:57.783952+0000","last_became_active":"2023-12-08T08:17:47.896123+0000","last_became_peered":"2023-12-08T08:17:47.896123+0000","last_unstale":"2023-12-08T08:17:57.783952+0000","last_undegraded":"2023-12-08T08:17:57.783952+0000","last_fullsized":"2023-12-08T08:17:57.783952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:47.568360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255211+0000","last_change":"2023-12-08T08:17:57.785956+0000","last_active":"2023-12-08T08:17:59.255211+0000","last_peered":"2023-12-08T08:17:59.255211+0000","last_clean":"2023-12-08T08:17:59.255211+0000","last_became_active":"2023-12-08T08:17:57.785618+0000","last_became_peered":"2023-12-08T08:17:57.785618+0000","last_unstale":"2023-12-08T08:17:59.255211+0000","last_undegraded":"2023-12-08T08:17:59.255211+0000","last_fullsized":"2023-12-08T08:17:59.255211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:58:41.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825251+0000","last_change":"2023-12-08T08:17:56.783471+0000","last_active":"2023-12-08T08:17:57.825251+0000","last_peered":"2023-12-08T08:17:57.825251+0000","last_clean":"2023-12-08T08:17:57.825251+0000","last_became_active":"2023-12-08T08:17:56.782732+0000","last_became_peered":"2023-12-08T08:17:56.782732+0000","last_unstale":"2023-12-08T08:17:57.825251+0000","last_undegraded":"2023-12-08T08:17:57.825251+0000","last_fullsized":"2023-12-08T08:17:57.825251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787165+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:57.787165+0000","last_peered":"2023-12-08T08:17:57.787165+0000","last_clean":"2023-12-08T08:17:57.787165+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:57.787165+0000","last_undegraded":"2023-12-08T08:17:57.787165+0000","last_fullsized":"2023-12-08T08:17:57.787165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793459+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:57.793459+0000","last_peered":"2023-12-08T08:17:57.793459+0000","last_clean":"2023-12-08T08:17:57.793459+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:57.793459+0000","last_undegraded":"2023-12-08T08:17:57.793459+0000","last_fullsized":"2023-12-08T08:17:57.793459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.785953+0000","last_change":"2023-12-08T08:17:57.789814+0000","last_active":"2023-12-08T08:17:58.785953+0000","last_peered":"2023-12-08T08:17:58.785953+0000","last_clean":"2023-12-08T08:17:58.785953+0000","last_became_active":"2023-12-08T08:17:57.789121+0000","last_became_peered":"2023-12-08T08:17:57.789121+0000","last_unstale":"2023-12-08T08:17:58.785953+0000","last_undegraded":"2023-12-08T08:17:58.785953+0000","last_fullsized":"2023-12-08T08:17:58.785953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.797397+0000","last_change":"2023-12-08T08:17:56.778284+0000","last_active":"2023-12-08T08:17:57.797397+0000","last_peered":"2023-12-08T08:17:57.797397+0000","last_clean":"2023-12-08T08:17:57.797397+0000","last_became_active":"2023-12-08T08:17:56.777942+0000","last_became_peered":"2023-12-08T08:17:56.777942+0000","last_unstale":"2023-12-08T08:17:57.797397+0000","last_undegraded":"2023-12-08T08:17:57.797397+0000","last_fullsized":"2023-12-08T08:17:57.797397+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:35:47.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768574+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:57.768574+0000","last_peered":"2023-12-08T08:17:57.768574+0000","last_clean":"2023-12-08T08:17:57.768574+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:57.768574+0000","last_undegraded":"2023-12-08T08:17:57.768574+0000","last_fullsized":"2023-12-08T08:17:57.768574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:52.110302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790086+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:57.790086+0000","last_peered":"2023-12-08T08:17:57.790086+0000","last_clean":"2023-12-08T08:17:57.790086+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:57.790086+0000","last_undegraded":"2023-12-08T08:17:57.790086+0000","last_fullsized":"2023-12-08T08:17:57.790086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.784608+0000","last_change":"2023-12-08T08:17:57.791350+0000","last_active":"2023-12-08T08:17:58.784608+0000","last_peered":"2023-12-08T08:17:58.784608+0000","last_clean":"2023-12-08T08:17:58.784608+0000","last_became_active":"2023-12-08T08:17:57.791035+0000","last_became_peered":"2023-12-08T08:17:57.791035+0000","last_unstale":"2023-12-08T08:17:58.784608+0000","last_undegraded":"2023-12-08T08:17:58.784608+0000","last_fullsized":"2023-12-08T08:17:58.784608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:42.563173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822702+0000","last_change":"2023-12-08T08:17:56.796644+0000","last_active":"2023-12-08T08:17:57.822702+0000","last_peered":"2023-12-08T08:17:57.822702+0000","last_clean":"2023-12-08T08:17:57.822702+0000","last_became_active":"2023-12-08T08:17:56.796276+0000","last_became_peered":"2023-12-08T08:17:56.796276+0000","last_unstale":"2023-12-08T08:17:57.822702+0000","last_undegraded":"2023-12-08T08:17:57.822702+0000","last_fullsized":"2023-12-08T08:17:57.822702+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.771918+0000","last_change":"2023-12-08T08:17:47.864253+0000","last_active":"2023-12-08T08:17:57.771918+0000","last_peered":"2023-12-08T08:17:57.771918+0000","last_clean":"2023-12-08T08:17:57.771918+0000","last_became_active":"2023-12-08T08:17:47.863753+0000","last_became_peered":"2023-12-08T08:17:47.863753+0000","last_unstale":"2023-12-08T08:17:57.771918+0000","last_undegraded":"2023-12-08T08:17:57.771918+0000","last_fullsized":"2023-12-08T08:17:57.771918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:12.401320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789821+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:57.789821+0000","last_peered":"2023-12-08T08:17:57.789821+0000","last_clean":"2023-12-08T08:17:57.789821+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:57.789821+0000","last_undegraded":"2023-12-08T08:17:57.789821+0000","last_fullsized":"2023-12-08T08:17:57.789821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253309+0000","last_change":"2023-12-08T08:17:57.777046+0000","last_active":"2023-12-08T08:17:59.253309+0000","last_peered":"2023-12-08T08:17:59.253309+0000","last_clean":"2023-12-08T08:17:59.253309+0000","last_became_active":"2023-12-08T08:17:57.776718+0000","last_became_peered":"2023-12-08T08:17:57.776718+0000","last_unstale":"2023-12-08T08:17:59.253309+0000","last_undegraded":"2023-12-08T08:17:59.253309+0000","last_fullsized":"2023-12-08T08:17:59.253309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:43.884845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822558+0000","last_change":"2023-12-08T08:17:56.780944+0000","last_active":"2023-12-08T08:17:57.822558+0000","last_peered":"2023-12-08T08:17:57.822558+0000","last_clean":"2023-12-08T08:17:57.822558+0000","last_became_active":"2023-12-08T08:17:56.780212+0000","last_became_peered":"2023-12-08T08:17:56.780212+0000","last_unstale":"2023-12-08T08:17:57.822558+0000","last_undegraded":"2023-12-08T08:17:57.822558+0000","last_fullsized":"2023-12-08T08:17:57.822558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:58.661778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769051+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:57.769051+0000","last_peered":"2023-12-08T08:17:57.769051+0000","last_clean":"2023-12-08T08:17:57.769051+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:57.769051+0000","last_undegraded":"2023-12-08T08:17:57.769051+0000","last_fullsized":"2023-12-08T08:17:57.769051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775841+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:57.775841+0000","last_peered":"2023-12-08T08:17:57.775841+0000","last_clean":"2023-12-08T08:17:57.775841+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:57.775841+0000","last_undegraded":"2023-12-08T08:17:57.775841+0000","last_fullsized":"2023-12-08T08:17:57.775841+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254783+0000","last_change":"2023-12-08T08:17:57.794255+0000","last_active":"2023-12-08T08:17:59.254783+0000","last_peered":"2023-12-08T08:17:59.254783+0000","last_clean":"2023-12-08T08:17:59.254783+0000","last_became_active":"2023-12-08T08:17:57.793966+0000","last_became_peered":"2023-12-08T08:17:57.793966+0000","last_unstale":"2023-12-08T08:17:59.254783+0000","last_undegraded":"2023-12-08T08:17:59.254783+0000","last_fullsized":"2023-12-08T08:17:59.254783+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:43.895411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788832+0000","last_change":"2023-12-08T08:17:56.792427+0000","last_active":"2023-12-08T08:17:57.788832+0000","last_peered":"2023-12-08T08:17:57.788832+0000","last_clean":"2023-12-08T08:17:57.788832+0000","last_became_active":"2023-12-08T08:17:56.792047+0000","last_became_peered":"2023-12-08T08:17:56.792047+0000","last_unstale":"2023-12-08T08:17:57.788832+0000","last_undegraded":"2023-12-08T08:17:57.788832+0000","last_fullsized":"2023-12-08T08:17:57.788832+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775959+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:57.775959+0000","last_peered":"2023-12-08T08:17:57.775959+0000","last_clean":"2023-12-08T08:17:57.775959+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:57.775959+0000","last_undegraded":"2023-12-08T08:17:57.775959+0000","last_fullsized":"2023-12-08T08:17:57.775959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:14.424829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787037+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:57.787037+0000","last_peered":"2023-12-08T08:17:57.787037+0000","last_clean":"2023-12-08T08:17:57.787037+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:57.787037+0000","last_undegraded":"2023-12-08T08:17:57.787037+0000","last_fullsized":"2023-12-08T08:17:57.787037+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254590+0000","last_change":"2023-12-08T08:17:57.798121+0000","last_active":"2023-12-08T08:17:59.254590+0000","last_peered":"2023-12-08T08:17:59.254590+0000","last_clean":"2023-12-08T08:17:59.254590+0000","last_became_active":"2023-12-08T08:17:57.797862+0000","last_became_peered":"2023-12-08T08:17:57.797862+0000","last_unstale":"2023-12-08T08:17:59.254590+0000","last_undegraded":"2023-12-08T08:17:59.254590+0000","last_fullsized":"2023-12-08T08:17:59.254590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:02.404414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788805+0000","last_change":"2023-12-08T08:17:56.791954+0000","last_active":"2023-12-08T08:17:57.788805+0000","last_peered":"2023-12-08T08:17:57.788805+0000","last_clean":"2023-12-08T08:17:57.788805+0000","last_became_active":"2023-12-08T08:17:56.791571+0000","last_became_peered":"2023-12-08T08:17:56.791571+0000","last_unstale":"2023-12-08T08:17:57.788805+0000","last_undegraded":"2023-12-08T08:17:57.788805+0000","last_fullsized":"2023-12-08T08:17:57.788805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787479+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:57.787479+0000","last_peered":"2023-12-08T08:17:57.787479+0000","last_clean":"2023-12-08T08:17:57.787479+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:57.787479+0000","last_undegraded":"2023-12-08T08:17:57.787479+0000","last_fullsized":"2023-12-08T08:17:57.787479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786686+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:57.786686+0000","last_peered":"2023-12-08T08:17:57.786686+0000","last_clean":"2023-12-08T08:17:57.786686+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:57.786686+0000","last_undegraded":"2023-12-08T08:17:57.786686+0000","last_fullsized":"2023-12-08T08:17:57.786686+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252338+0000","last_change":"2023-12-08T08:17:57.804851+0000","last_active":"2023-12-08T08:17:59.252338+0000","last_peered":"2023-12-08T08:17:59.252338+0000","last_clean":"2023-12-08T08:17:59.252338+0000","last_became_active":"2023-12-08T08:17:57.804281+0000","last_became_peered":"2023-12-08T08:17:57.804281+0000","last_unstale":"2023-12-08T08:17:59.252338+0000","last_undegraded":"2023-12-08T08:17:59.252338+0000","last_fullsized":"2023-12-08T08:17:59.252338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:09:13.119638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822227+0000","last_change":"2023-12-08T08:17:56.777768+0000","last_active":"2023-12-08T08:17:57.822227+0000","last_peered":"2023-12-08T08:17:57.822227+0000","last_clean":"2023-12-08T08:17:57.822227+0000","last_became_active":"2023-12-08T08:17:56.776405+0000","last_became_peered":"2023-12-08T08:17:56.776405+0000","last_unstale":"2023-12-08T08:17:57.822227+0000","last_undegraded":"2023-12-08T08:17:57.822227+0000","last_fullsized":"2023-12-08T08:17:57.822227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:36.931349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768150+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:57.768150+0000","last_peered":"2023-12-08T08:17:57.768150+0000","last_clean":"2023-12-08T08:17:57.768150+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:57.768150+0000","last_undegraded":"2023-12-08T08:17:57.768150+0000","last_fullsized":"2023-12-08T08:17:57.768150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788261+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:57.788261+0000","last_peered":"2023-12-08T08:17:57.788261+0000","last_clean":"2023-12-08T08:17:57.788261+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:57.788261+0000","last_undegraded":"2023-12-08T08:17:57.788261+0000","last_fullsized":"2023-12-08T08:17:57.788261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788918+0000","last_change":"2023-12-08T08:17:57.801851+0000","last_active":"2023-12-08T08:17:58.788918+0000","last_peered":"2023-12-08T08:17:58.788918+0000","last_clean":"2023-12-08T08:17:58.788918+0000","last_became_active":"2023-12-08T08:17:57.800540+0000","last_became_peered":"2023-12-08T08:17:57.800540+0000","last_unstale":"2023-12-08T08:17:58.788918+0000","last_undegraded":"2023-12-08T08:17:58.788918+0000","last_fullsized":"2023-12-08T08:17:58.788918+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784349+0000","last_change":"2023-12-08T08:17:56.797511+0000","last_active":"2023-12-08T08:17:57.784349+0000","last_peered":"2023-12-08T08:17:57.784349+0000","last_clean":"2023-12-08T08:17:57.784349+0000","last_became_active":"2023-12-08T08:17:56.796361+0000","last_became_peered":"2023-12-08T08:17:56.796361+0000","last_unstale":"2023-12-08T08:17:57.784349+0000","last_undegraded":"2023-12-08T08:17:57.784349+0000","last_fullsized":"2023-12-08T08:17:57.784349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:15.642356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792675+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:57.792675+0000","last_peered":"2023-12-08T08:17:57.792675+0000","last_clean":"2023-12-08T08:17:57.792675+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:57.792675+0000","last_undegraded":"2023-12-08T08:17:57.792675+0000","last_fullsized":"2023-12-08T08:17:57.792675+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793634+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:57.793634+0000","last_peered":"2023-12-08T08:17:57.793634+0000","last_clean":"2023-12-08T08:17:57.793634+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:57.793634+0000","last_undegraded":"2023-12-08T08:17:57.793634+0000","last_fullsized":"2023-12-08T08:17:57.793634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253493+0000","last_change":"2023-12-08T08:17:57.793470+0000","last_active":"2023-12-08T08:17:59.253493+0000","last_peered":"2023-12-08T08:17:59.253493+0000","last_clean":"2023-12-08T08:17:59.253493+0000","last_became_active":"2023-12-08T08:17:57.793211+0000","last_became_peered":"2023-12-08T08:17:57.793211+0000","last_unstale":"2023-12-08T08:17:59.253493+0000","last_undegraded":"2023-12-08T08:17:59.253493+0000","last_fullsized":"2023-12-08T08:17:59.253493+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:32.561030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786820+0000","last_change":"2023-12-08T08:17:56.795117+0000","last_active":"2023-12-08T08:17:57.786820+0000","last_peered":"2023-12-08T08:17:57.786820+0000","last_clean":"2023-12-08T08:17:57.786820+0000","last_became_active":"2023-12-08T08:17:56.794822+0000","last_became_peered":"2023-12-08T08:17:56.794822+0000","last_unstale":"2023-12-08T08:17:57.786820+0000","last_undegraded":"2023-12-08T08:17:57.786820+0000","last_fullsized":"2023-12-08T08:17:57.786820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760270+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:57.760270+0000","last_peered":"2023-12-08T08:17:57.760270+0000","last_clean":"2023-12-08T08:17:57.760270+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:57.760270+0000","last_undegraded":"2023-12-08T08:17:57.760270+0000","last_fullsized":"2023-12-08T08:17:57.760270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:26.299694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790684+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:57.790684+0000","last_peered":"2023-12-08T08:17:57.790684+0000","last_clean":"2023-12-08T08:17:57.790684+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:57.790684+0000","last_undegraded":"2023-12-08T08:17:57.790684+0000","last_fullsized":"2023-12-08T08:17:57.790684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788355+0000","last_change":"2023-12-08T08:17:57.795923+0000","last_active":"2023-12-08T08:17:58.788355+0000","last_peered":"2023-12-08T08:17:58.788355+0000","last_clean":"2023-12-08T08:17:58.788355+0000","last_became_active":"2023-12-08T08:17:57.795662+0000","last_became_peered":"2023-12-08T08:17:57.795662+0000","last_unstale":"2023-12-08T08:17:58.788355+0000","last_undegraded":"2023-12-08T08:17:58.788355+0000","last_fullsized":"2023-12-08T08:17:58.788355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822877+0000","last_change":"2023-12-08T08:17:56.768920+0000","last_active":"2023-12-08T08:17:57.822877+0000","last_peered":"2023-12-08T08:17:57.822877+0000","last_clean":"2023-12-08T08:17:57.822877+0000","last_became_active":"2023-12-08T08:17:56.768205+0000","last_became_peered":"2023-12-08T08:17:56.768205+0000","last_unstale":"2023-12-08T08:17:57.822877+0000","last_undegraded":"2023-12-08T08:17:57.822877+0000","last_fullsized":"2023-12-08T08:17:57.822877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:25.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790522+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:57.790522+0000","last_peered":"2023-12-08T08:17:57.790522+0000","last_clean":"2023-12-08T08:17:57.790522+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:57.790522+0000","last_undegraded":"2023-12-08T08:17:57.790522+0000","last_fullsized":"2023-12-08T08:17:57.790522+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792902+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:57.792902+0000","last_peered":"2023-12-08T08:17:57.792902+0000","last_clean":"2023-12-08T08:17:57.792902+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:57.792902+0000","last_undegraded":"2023-12-08T08:17:57.792902+0000","last_fullsized":"2023-12-08T08:17:57.792902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253156+0000","last_change":"2023-12-08T08:17:57.792736+0000","last_active":"2023-12-08T08:17:59.253156+0000","last_peered":"2023-12-08T08:17:59.253156+0000","last_clean":"2023-12-08T08:17:59.253156+0000","last_became_active":"2023-12-08T08:17:57.792475+0000","last_became_peered":"2023-12-08T08:17:57.792475+0000","last_unstale":"2023-12-08T08:17:59.253156+0000","last_undegraded":"2023-12-08T08:17:59.253156+0000","last_fullsized":"2023-12-08T08:17:59.253156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:43.098968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.777932+0000","last_change":"2023-12-08T08:17:56.779410+0000","last_active":"2023-12-08T08:17:58.777932+0000","last_peered":"2023-12-08T08:17:58.777932+0000","last_clean":"2023-12-08T08:17:58.777932+0000","last_became_active":"2023-12-08T08:17:56.779079+0000","last_became_peered":"2023-12-08T08:17:56.779079+0000","last_unstale":"2023-12-08T08:17:58.777932+0000","last_undegraded":"2023-12-08T08:17:58.777932+0000","last_fullsized":"2023-12-08T08:17:58.777932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:15.692021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769271+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:57.769271+0000","last_peered":"2023-12-08T08:17:57.769271+0000","last_clean":"2023-12-08T08:17:57.769271+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:57.769271+0000","last_undegraded":"2023-12-08T08:17:57.769271+0000","last_fullsized":"2023-12-08T08:17:57.769271+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782922+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:57.782922+0000","last_peered":"2023-12-08T08:17:57.782922+0000","last_clean":"2023-12-08T08:17:57.782922+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:57.782922+0000","last_undegraded":"2023-12-08T08:17:57.782922+0000","last_fullsized":"2023-12-08T08:17:57.782922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256297+0000","last_change":"2023-12-08T08:17:57.801602+0000","last_active":"2023-12-08T08:17:59.256297+0000","last_peered":"2023-12-08T08:17:59.256297+0000","last_clean":"2023-12-08T08:17:59.256297+0000","last_became_active":"2023-12-08T08:17:57.801343+0000","last_became_peered":"2023-12-08T08:17:57.801343+0000","last_unstale":"2023-12-08T08:17:59.256297+0000","last_undegraded":"2023-12-08T08:17:59.256297+0000","last_fullsized":"2023-12-08T08:17:59.256297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:10:24.056900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.773893+0000","last_change":"2023-12-08T08:17:56.791471+0000","last_active":"2023-12-08T08:17:57.773893+0000","last_peered":"2023-12-08T08:17:57.773893+0000","last_clean":"2023-12-08T08:17:57.773893+0000","last_became_active":"2023-12-08T08:17:56.791079+0000","last_became_peered":"2023-12-08T08:17:56.791079+0000","last_unstale":"2023-12-08T08:17:57.773893+0000","last_undegraded":"2023-12-08T08:17:57.773893+0000","last_fullsized":"2023-12-08T08:17:57.773893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:22.747918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767130+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:57.767130+0000","last_peered":"2023-12-08T08:17:57.767130+0000","last_clean":"2023-12-08T08:17:57.767130+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:57.767130+0000","last_undegraded":"2023-12-08T08:17:57.767130+0000","last_fullsized":"2023-12-08T08:17:57.767130+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789763+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:57.789763+0000","last_peered":"2023-12-08T08:17:57.789763+0000","last_clean":"2023-12-08T08:17:57.789763+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:57.789763+0000","last_undegraded":"2023-12-08T08:17:57.789763+0000","last_fullsized":"2023-12-08T08:17:57.789763+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255782+0000","last_change":"2023-12-08T08:17:57.797287+0000","last_active":"2023-12-08T08:17:59.255782+0000","last_peered":"2023-12-08T08:17:59.255782+0000","last_clean":"2023-12-08T08:17:59.255782+0000","last_became_active":"2023-12-08T08:17:57.796961+0000","last_became_peered":"2023-12-08T08:17:57.796961+0000","last_unstale":"2023-12-08T08:17:59.255782+0000","last_undegraded":"2023-12-08T08:17:59.255782+0000","last_fullsized":"2023-12-08T08:17:59.255782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:35.292501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.797240+0000","last_change":"2023-12-08T08:17:56.772809+0000","last_active":"2023-12-08T08:17:57.797240+0000","last_peered":"2023-12-08T08:17:57.797240+0000","last_clean":"2023-12-08T08:17:57.797240+0000","last_became_active":"2023-12-08T08:17:56.772556+0000","last_became_peered":"2023-12-08T08:17:56.772556+0000","last_unstale":"2023-12-08T08:17:57.797240+0000","last_undegraded":"2023-12-08T08:17:57.797240+0000","last_fullsized":"2023-12-08T08:17:57.797240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:48:41.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.778964+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:57.778964+0000","last_peered":"2023-12-08T08:17:57.778964+0000","last_clean":"2023-12-08T08:17:57.778964+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:57.778964+0000","last_undegraded":"2023-12-08T08:17:57.778964+0000","last_fullsized":"2023-12-08T08:17:57.778964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786930+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:57.786930+0000","last_peered":"2023-12-08T08:17:57.786930+0000","last_clean":"2023-12-08T08:17:57.786930+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:57.786930+0000","last_undegraded":"2023-12-08T08:17:57.786930+0000","last_fullsized":"2023-12-08T08:17:57.786930+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252730+0000","last_change":"2023-12-08T08:17:57.792409+0000","last_active":"2023-12-08T08:17:59.252730+0000","last_peered":"2023-12-08T08:17:59.252730+0000","last_clean":"2023-12-08T08:17:59.252730+0000","last_became_active":"2023-12-08T08:17:57.792061+0000","last_became_peered":"2023-12-08T08:17:57.792061+0000","last_unstale":"2023-12-08T08:17:59.252730+0000","last_undegraded":"2023-12-08T08:17:59.252730+0000","last_fullsized":"2023-12-08T08:17:59.252730+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:01.746863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.773995+0000","last_change":"2023-12-08T08:17:56.798843+0000","last_active":"2023-12-08T08:17:57.773995+0000","last_peered":"2023-12-08T08:17:57.773995+0000","last_clean":"2023-12-08T08:17:57.773995+0000","last_became_active":"2023-12-08T08:17:56.798505+0000","last_became_peered":"2023-12-08T08:17:56.798505+0000","last_unstale":"2023-12-08T08:17:57.773995+0000","last_undegraded":"2023-12-08T08:17:57.773995+0000","last_fullsized":"2023-12-08T08:17:57.773995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.781926+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:57.781926+0000","last_peered":"2023-12-08T08:17:57.781926+0000","last_clean":"2023-12-08T08:17:57.781926+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:57.781926+0000","last_undegraded":"2023-12-08T08:17:57.781926+0000","last_fullsized":"2023-12-08T08:17:57.781926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:02.769189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783663+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:57.783663+0000","last_peered":"2023-12-08T08:17:57.783663+0000","last_clean":"2023-12-08T08:17:57.783663+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:57.783663+0000","last_undegraded":"2023-12-08T08:17:57.783663+0000","last_fullsized":"2023-12-08T08:17:57.783663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255216+0000","last_change":"2023-12-08T08:17:57.787379+0000","last_active":"2023-12-08T08:17:59.255216+0000","last_peered":"2023-12-08T08:17:59.255216+0000","last_clean":"2023-12-08T08:17:59.255216+0000","last_became_active":"2023-12-08T08:17:57.778356+0000","last_became_peered":"2023-12-08T08:17:57.778356+0000","last_unstale":"2023-12-08T08:17:59.255216+0000","last_undegraded":"2023-12-08T08:17:59.255216+0000","last_fullsized":"2023-12-08T08:17:59.255216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:40.346477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779867+0000","last_change":"2023-12-08T08:17:56.780631+0000","last_active":"2023-12-08T08:17:57.779867+0000","last_peered":"2023-12-08T08:17:57.779867+0000","last_clean":"2023-12-08T08:17:57.779867+0000","last_became_active":"2023-12-08T08:17:56.780250+0000","last_became_peered":"2023-12-08T08:17:56.780250+0000","last_unstale":"2023-12-08T08:17:57.779867+0000","last_undegraded":"2023-12-08T08:17:57.779867+0000","last_fullsized":"2023-12-08T08:17:57.779867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:36:12.440569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.763114+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:57.763114+0000","last_peered":"2023-12-08T08:17:57.763114+0000","last_clean":"2023-12-08T08:17:57.763114+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:57.763114+0000","last_undegraded":"2023-12-08T08:17:57.763114+0000","last_fullsized":"2023-12-08T08:17:57.763114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:50.672771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780857+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:57.780857+0000","last_peered":"2023-12-08T08:17:57.780857+0000","last_clean":"2023-12-08T08:17:57.780857+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:57.780857+0000","last_undegraded":"2023-12-08T08:17:57.780857+0000","last_fullsized":"2023-12-08T08:17:57.780857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256651+0000","last_change":"2023-12-08T08:17:57.808404+0000","last_active":"2023-12-08T08:17:59.256651+0000","last_peered":"2023-12-08T08:17:59.256651+0000","last_clean":"2023-12-08T08:17:59.256651+0000","last_became_active":"2023-12-08T08:17:57.808060+0000","last_became_peered":"2023-12-08T08:17:57.808060+0000","last_unstale":"2023-12-08T08:17:59.256651+0000","last_undegraded":"2023-12-08T08:17:59.256651+0000","last_fullsized":"2023-12-08T08:17:59.256651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:57:21.087350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789022+0000","last_change":"2023-12-08T08:17:56.792036+0000","last_active":"2023-12-08T08:17:57.789022+0000","last_peered":"2023-12-08T08:17:57.789022+0000","last_clean":"2023-12-08T08:17:57.789022+0000","last_became_active":"2023-12-08T08:17:56.791709+0000","last_became_peered":"2023-12-08T08:17:56.791709+0000","last_unstale":"2023-12-08T08:17:57.789022+0000","last_undegraded":"2023-12-08T08:17:57.789022+0000","last_fullsized":"2023-12-08T08:17:57.789022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768253+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:57.768253+0000","last_peered":"2023-12-08T08:17:57.768253+0000","last_clean":"2023-12-08T08:17:57.768253+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:57.768253+0000","last_undegraded":"2023-12-08T08:17:57.768253+0000","last_fullsized":"2023-12-08T08:17:57.768253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777933+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:57.777933+0000","last_peered":"2023-12-08T08:17:57.777933+0000","last_clean":"2023-12-08T08:17:57.777933+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:57.777933+0000","last_undegraded":"2023-12-08T08:17:57.777933+0000","last_fullsized":"2023-12-08T08:17:57.777933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779890+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:57.779890+0000","last_peered":"2023-12-08T08:17:57.779890+0000","last_clean":"2023-12-08T08:17:57.779890+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:57.779890+0000","last_undegraded":"2023-12-08T08:17:57.779890+0000","last_fullsized":"2023-12-08T08:17:57.779890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":954866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.353}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.548},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.667}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.605},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.7569999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.8380000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.8979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":365346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.875},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.294}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.98999999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.05}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":1.391},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.25}]}]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":363756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.1719999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.254},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.5}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.405}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.544},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4730000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.1200000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.605},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.5269999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":368523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.034},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":1.123}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.5269999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.2110000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.331}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.571},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.254}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.466},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.4239999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":364282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.872}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":1.147},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2350000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.403}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.478},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.272}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.3680000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.635}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":364442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.292}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":1.1950000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.468}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.524},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.421}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.5669999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.619},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2509999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":367683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":1.04},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.212}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.337},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":1.379}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.123},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":1.4330000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.657},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.579},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.2849999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.8200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1376256,"data_stored":954068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.014},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.6060000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1879999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.419},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.478}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.268},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.552}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:07.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.694+0000 7f9cf759e640 1 Processor -- start 2023-12-08T08:18:07.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.694+0000 7f9cf759e640 1 -- start start 2023-12-08T08:18:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.696+0000 7f9cf759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9cf815b580 0x7f9cf81587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.696+0000 7f9cf759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9cf8159e50 0x7f9cf815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.696+0000 7f9cf759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf80c0870 con 0x7f9cf80c0100 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.696+0000 7f9cf759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf80a79d0 con 0x7f9cf8159e50 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.696+0000 7f9cf759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf80c0b50 con 0x7f9cf815b580 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9cf8159e50 0x7f9cf815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9cf8159e50 0x7f9cf815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35520/0 (socket says 172.21.15.45:35520) 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 -- 172.21.15.45:0/4252996435 learned_addr learned my addr 172.21.15.45:0/4252996435 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf659c640 1 --2- 172.21.15.45:0/4252996435 >> v2:172.21.15.114:3300/0 conn(0x7f9cf815b580 0x7f9cf81587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 -- 172.21.15.45:0/4252996435 >> v2:172.21.15.114:3300/0 conn(0x7f9cf815b580 msgr2=0x7f9cf81587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 --2- 172.21.15.45:0/4252996435 >> v2:172.21.15.114:3300/0 conn(0x7f9cf815b580 0x7f9cf81587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 -- 172.21.15.45:0/4252996435 >> v1:172.21.15.114:6789/0 conn(0x7f9cf80c0100 legacy=0x7f9cf806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.697+0000 7f9cf6d9d640 1 -- 172.21.15.45:0/4252996435 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80c0e30 con 0x7f9cf8159e50 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.698+0000 7f9cf6d9d640 1 --2- 172.21.15.45:0/4252996435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf815a2a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e50 tx=0x7f9cf002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80958118ac492a05 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.699+0000 7f9cf5d9b640 1 -- 172.21.15.45:0/4252996435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf002c9e0 con 0x7f9cf8159e50 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.699+0000 7f9cf5d9b640 1 -- 172.21.15.45:0/4252996435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf002cb40 con 0x7f9cf8159e50 2023-12-08T08:18:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.699+0000 7f9cf5d9b640 1 -- 172.21.15.45:0/4252996435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00343f0 con 0x7f9cf8159e50 2023-12-08T08:18:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.699+0000 7f9cf759e640 1 -- 172.21.15.45:0/4252996435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 msgr2=0x7f9cf815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.699+0000 7f9cf759e640 1 --2- 172.21.15.45:0/4252996435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf815a2a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e50 tx=0x7f9cf002be40 comp rx=0 tx=0).stop 2023-12-08T08:18:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 -- 172.21.15.45:0/4252996435 shutdown_connections 2023-12-08T08:18:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 --2- 172.21.15.45:0/4252996435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf815a2a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 --2- 172.21.15.45:0/4252996435 >> v2:172.21.15.114:3300/0 conn(0x7f9cf815b580 0x7f9cf81587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 -- 172.21.15.45:0/4252996435 >> 172.21.15.45:0/4252996435 conn(0x7f9cf80c5780 msgr2=0x7f9cf80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 -- 172.21.15.45:0/4252996435 shutdown_connections 2023-12-08T08:18:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.700+0000 7f9cf759e640 1 -- 172.21.15.45:0/4252996435 wait complete. 2023-12-08T08:18:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.701+0000 7f9cf759e640 1 Processor -- start 2023-12-08T08:18:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 -- start start 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cf80c0100 0x7f9cf81f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9cf815b580 0x7f9cf81e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80ab980 con 0x7f9cf8159e50 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80702f0 con 0x7f9cf80c0100 2023-12-08T08:18:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.702+0000 7f9cf759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81f1e90 con 0x7f9cf815b580 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.703+0000 7f9ceffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.703+0000 7f9ceffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35526/0 (socket says 172.21.15.45:35526) 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.703+0000 7f9ceffff640 1 -- 172.21.15.45:0/634982406 learned_addr learned my addr 172.21.15.45:0/634982406 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.703+0000 7f9cf659c640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cf80c0100 0x7f9cf81f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.703+0000 7f9cf6d9d640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9cf815b580 0x7f9cf81e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 -- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9cf815b580 msgr2=0x7f9cf81e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9cf815b580 0x7f9cf81e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 -- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cf80c0100 msgr2=0x7f9cf81f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cf80c0100 0x7f9cf81f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 -- 172.21.15.45:0/634982406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009b30 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceffff640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c430 tx=0x7f9ce000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0011790 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00118f0 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0011ce0 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf8070590 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.704+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf8071ed0 con 0x7f9cf8159e50 2023-12-08T08:18:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.706+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf80743e0 con 0x7f9cf8159e50 2023-12-08T08:18:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.706+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ce001c460 con 0x7f9cf8159e50 2023-12-08T08:18:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.708+0000 7f9ceeffd640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 0x7f9cd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.708+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f9ce0089960 con 0x7f9cf8159e50 2023-12-08T08:18:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.708+0000 7f9cf659c640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 0x7f9cd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.709+0000 7f9cf659c640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 0x7f9cd806d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80079a0 tx=0x7f9ce8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.713+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ce0054590 con 0x7f9cf8159e50 2023-12-08T08:18:07.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.910+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9cf8159b50 con 0x7f9cd806ae70 2023-12-08T08:18:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.929+0000 7f9ceeffd640 1 -- 172.21.15.45:0/634982406 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525273 (secure 0 0 0) 0x7f9cf8159b50 con 0x7f9cd806ae70 2023-12-08T08:18:07.938 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 msgr2=0x7f9cd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 0x7f9cd806d330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80079a0 tx=0x7f9ce8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 msgr2=0x7f9cf8070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c430 tx=0x7f9ce000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 shutdown_connections 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9cd806ae70 0x7f9cd806d330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9cf815b580 0x7f9cf81e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9cf8159e50 0x7f9cf8070ab0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 --2- 172.21.15.45:0/634982406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cf80c0100 0x7f9cf81f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.937+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 >> 172.21.15.45:0/634982406 conn(0x7f9cf80c5780 msgr2=0x7f9cf806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.938+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 shutdown_connections 2023-12-08T08:18:07.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:07.938+0000 7f9cf759e640 1 -- 172.21.15.45:0/634982406 wait complete. 2023-12-08T08:18:07.962 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-12-08T08:18:07.764880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244388,"kb_used_data":7400,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730332,"statfs":{"total":773094113280,"available":772843859968,"internally_reserved":0,"allocated":7577600,"data_stored":4102966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003562"},"pg_stats":[{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252798+0000","last_change":"2023-12-08T08:17:57.785587+0000","last_active":"2023-12-08T08:17:59.252798+0000","last_peered":"2023-12-08T08:17:59.252798+0000","last_clean":"2023-12-08T08:17:59.252798+0000","last_became_active":"2023-12-08T08:17:57.780492+0000","last_became_peered":"2023-12-08T08:17:57.780492+0000","last_unstale":"2023-12-08T08:17:59.252798+0000","last_undegraded":"2023-12-08T08:17:59.252798+0000","last_fullsized":"2023-12-08T08:17:59.252798+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:01.947657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779327+0000","last_change":"2023-12-08T08:17:41.800724+0000","last_active":"2023-12-08T08:17:57.779327+0000","last_peered":"2023-12-08T08:17:57.779327+0000","last_clean":"2023-12-08T08:17:57.779327+0000","last_became_active":"2023-12-08T08:17:41.800426+0000","last_became_peered":"2023-12-08T08:17:41.800426+0000","last_unstale":"2023-12-08T08:17:57.779327+0000","last_undegraded":"2023-12-08T08:17:57.779327+0000","last_fullsized":"2023-12-08T08:17:57.779327+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:57:50.823675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252302+0000","last_change":"2023-12-08T08:17:57.792932+0000","last_active":"2023-12-08T08:17:59.252302+0000","last_peered":"2023-12-08T08:17:59.252302+0000","last_clean":"2023-12-08T08:17:59.252302+0000","last_became_active":"2023-12-08T08:17:57.792683+0000","last_became_peered":"2023-12-08T08:17:57.792683+0000","last_unstale":"2023-12-08T08:17:59.252302+0000","last_undegraded":"2023-12-08T08:17:59.252302+0000","last_fullsized":"2023-12-08T08:17:59.252302+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:31.795322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780685+0000","last_change":"2023-12-08T08:17:41.822465+0000","last_active":"2023-12-08T08:17:57.780685+0000","last_peered":"2023-12-08T08:17:57.780685+0000","last_clean":"2023-12-08T08:17:57.780685+0000","last_became_active":"2023-12-08T08:17:41.817493+0000","last_became_peered":"2023-12-08T08:17:41.817493+0000","last_unstale":"2023-12-08T08:17:57.780685+0000","last_undegraded":"2023-12-08T08:17:57.780685+0000","last_fullsized":"2023-12-08T08:17:57.780685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:51:09.249505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255285+0000","last_change":"2023-12-08T08:17:57.791882+0000","last_active":"2023-12-08T08:17:59.255285+0000","last_peered":"2023-12-08T08:17:59.255285+0000","last_clean":"2023-12-08T08:17:59.255285+0000","last_became_active":"2023-12-08T08:17:57.791595+0000","last_became_peered":"2023-12-08T08:17:57.791595+0000","last_unstale":"2023-12-08T08:17:59.255285+0000","last_undegraded":"2023-12-08T08:17:59.255285+0000","last_fullsized":"2023-12-08T08:17:59.255285+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:53.810874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789218+0000","last_change":"2023-12-08T08:17:41.820629+0000","last_active":"2023-12-08T08:17:57.789218+0000","last_peered":"2023-12-08T08:17:57.789218+0000","last_clean":"2023-12-08T08:17:57.789218+0000","last_became_active":"2023-12-08T08:17:41.820321+0000","last_became_peered":"2023-12-08T08:17:41.820321+0000","last_unstale":"2023-12-08T08:17:57.789218+0000","last_undegraded":"2023-12-08T08:17:57.789218+0000","last_fullsized":"2023-12-08T08:17:57.789218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786012+0000","last_change":"2023-12-08T08:17:57.797791+0000","last_active":"2023-12-08T08:17:58.786012+0000","last_peered":"2023-12-08T08:17:58.786012+0000","last_clean":"2023-12-08T08:17:58.786012+0000","last_became_active":"2023-12-08T08:17:57.797012+0000","last_became_peered":"2023-12-08T08:17:57.797012+0000","last_unstale":"2023-12-08T08:17:58.786012+0000","last_undegraded":"2023-12-08T08:17:58.786012+0000","last_fullsized":"2023-12-08T08:17:58.786012+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:11.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783861+0000","last_change":"2023-12-08T08:17:41.817408+0000","last_active":"2023-12-08T08:17:57.783861+0000","last_peered":"2023-12-08T08:17:57.783861+0000","last_clean":"2023-12-08T08:17:57.783861+0000","last_became_active":"2023-12-08T08:17:41.816787+0000","last_became_peered":"2023-12-08T08:17:41.816787+0000","last_unstale":"2023-12-08T08:17:57.783861+0000","last_undegraded":"2023-12-08T08:17:57.783861+0000","last_fullsized":"2023-12-08T08:17:57.783861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254697+0000","last_change":"2023-12-08T08:17:57.806576+0000","last_active":"2023-12-08T08:17:59.254697+0000","last_peered":"2023-12-08T08:17:59.254697+0000","last_clean":"2023-12-08T08:17:59.254697+0000","last_became_active":"2023-12-08T08:17:57.804339+0000","last_became_peered":"2023-12-08T08:17:57.804339+0000","last_unstale":"2023-12-08T08:17:59.254697+0000","last_undegraded":"2023-12-08T08:17:59.254697+0000","last_fullsized":"2023-12-08T08:17:59.254697+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:44:25.534348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":24,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768187+0000","last_change":"2023-12-08T08:17:47.863838+0000","last_active":"2023-12-08T08:17:57.768187+0000","last_peered":"2023-12-08T08:17:57.768187+0000","last_clean":"2023-12-08T08:17:57.768187+0000","last_became_active":"2023-12-08T08:17:47.863177+0000","last_became_peered":"2023-12-08T08:17:47.863177+0000","last_unstale":"2023-12-08T08:17:57.768187+0000","last_undegraded":"2023-12-08T08:17:57.768187+0000","last_fullsized":"2023-12-08T08:17:57.768187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:35.681140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255058+0000","last_change":"2023-12-08T08:17:57.799227+0000","last_active":"2023-12-08T08:17:59.255058+0000","last_peered":"2023-12-08T08:17:59.255058+0000","last_clean":"2023-12-08T08:17:59.255058+0000","last_became_active":"2023-12-08T08:17:57.797766+0000","last_became_peered":"2023-12-08T08:17:57.797766+0000","last_unstale":"2023-12-08T08:17:59.255058+0000","last_undegraded":"2023-12-08T08:17:59.255058+0000","last_fullsized":"2023-12-08T08:17:59.255058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:08:39.898672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.776310+0000","last_change":"2023-12-08T08:17:41.812317+0000","last_active":"2023-12-08T08:17:57.776310+0000","last_peered":"2023-12-08T08:17:57.776310+0000","last_clean":"2023-12-08T08:17:57.776310+0000","last_became_active":"2023-12-08T08:17:41.811998+0000","last_became_peered":"2023-12-08T08:17:41.811998+0000","last_unstale":"2023-12-08T08:17:57.776310+0000","last_undegraded":"2023-12-08T08:17:57.776310+0000","last_fullsized":"2023-12-08T08:17:57.776310+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257595+0000","last_change":"2023-12-08T08:17:57.799451+0000","last_active":"2023-12-08T08:17:59.257595+0000","last_peered":"2023-12-08T08:17:59.257595+0000","last_clean":"2023-12-08T08:17:59.257595+0000","last_became_active":"2023-12-08T08:17:57.798376+0000","last_became_peered":"2023-12-08T08:17:57.798376+0000","last_unstale":"2023-12-08T08:17:59.257595+0000","last_undegraded":"2023-12-08T08:17:59.257595+0000","last_fullsized":"2023-12-08T08:17:59.257595+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:07.450761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.762923+0000","last_change":"2023-12-08T08:17:41.811573+0000","last_active":"2023-12-08T08:17:57.762923+0000","last_peered":"2023-12-08T08:17:57.762923+0000","last_clean":"2023-12-08T08:17:57.762923+0000","last_became_active":"2023-12-08T08:17:41.809608+0000","last_became_peered":"2023-12-08T08:17:41.809608+0000","last_unstale":"2023-12-08T08:17:57.762923+0000","last_undegraded":"2023-12-08T08:17:57.762923+0000","last_fullsized":"2023-12-08T08:17:57.762923+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:26.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254434+0000","last_change":"2023-12-08T08:17:57.800793+0000","last_active":"2023-12-08T08:17:59.254434+0000","last_peered":"2023-12-08T08:17:59.254434+0000","last_clean":"2023-12-08T08:17:59.254434+0000","last_became_active":"2023-12-08T08:17:57.800501+0000","last_became_peered":"2023-12-08T08:17:57.800501+0000","last_unstale":"2023-12-08T08:17:59.254434+0000","last_undegraded":"2023-12-08T08:17:59.254434+0000","last_fullsized":"2023-12-08T08:17:59.254434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:02.347280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784897+0000","last_change":"2023-12-08T08:17:41.810928+0000","last_active":"2023-12-08T08:17:57.784897+0000","last_peered":"2023-12-08T08:17:57.784897+0000","last_clean":"2023-12-08T08:17:57.784897+0000","last_became_active":"2023-12-08T08:17:41.810526+0000","last_became_peered":"2023-12-08T08:17:41.810526+0000","last_unstale":"2023-12-08T08:17:57.784897+0000","last_undegraded":"2023-12-08T08:17:57.784897+0000","last_fullsized":"2023-12-08T08:17:57.784897+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:43.683652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255501+0000","last_change":"2023-12-08T08:17:57.805885+0000","last_active":"2023-12-08T08:17:59.255501+0000","last_peered":"2023-12-08T08:17:59.255501+0000","last_clean":"2023-12-08T08:17:59.255501+0000","last_became_active":"2023-12-08T08:17:57.805454+0000","last_became_peered":"2023-12-08T08:17:57.805454+0000","last_unstale":"2023-12-08T08:17:59.255501+0000","last_undegraded":"2023-12-08T08:17:59.255501+0000","last_fullsized":"2023-12-08T08:17:59.255501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:08.377254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791664+0000","last_change":"2023-12-08T08:17:41.817094+0000","last_active":"2023-12-08T08:17:57.791664+0000","last_peered":"2023-12-08T08:17:57.791664+0000","last_clean":"2023-12-08T08:17:57.791664+0000","last_became_active":"2023-12-08T08:17:41.816832+0000","last_became_peered":"2023-12-08T08:17:41.816832+0000","last_unstale":"2023-12-08T08:17:57.791664+0000","last_undegraded":"2023-12-08T08:17:57.791664+0000","last_fullsized":"2023-12-08T08:17:57.791664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:38.603643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255293+0000","last_change":"2023-12-08T08:17:57.795580+0000","last_active":"2023-12-08T08:17:59.255293+0000","last_peered":"2023-12-08T08:17:59.255293+0000","last_clean":"2023-12-08T08:17:59.255293+0000","last_became_active":"2023-12-08T08:17:57.795301+0000","last_became_peered":"2023-12-08T08:17:57.795301+0000","last_unstale":"2023-12-08T08:17:59.255293+0000","last_undegraded":"2023-12-08T08:17:59.255293+0000","last_fullsized":"2023-12-08T08:17:59.255293+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:56:11.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.771667+0000","last_change":"2023-12-08T08:17:48.251716+0000","last_active":"2023-12-08T08:17:57.771667+0000","last_peered":"2023-12-08T08:17:57.771667+0000","last_clean":"2023-12-08T08:17:57.771667+0000","last_became_active":"2023-12-08T08:17:48.250928+0000","last_became_peered":"2023-12-08T08:17:48.250928+0000","last_unstale":"2023-12-08T08:17:57.771667+0000","last_undegraded":"2023-12-08T08:17:57.771667+0000","last_fullsized":"2023-12-08T08:17:57.771667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255651+0000","last_change":"2023-12-08T08:17:57.797541+0000","last_active":"2023-12-08T08:17:59.255651+0000","last_peered":"2023-12-08T08:17:59.255651+0000","last_clean":"2023-12-08T08:17:59.255651+0000","last_became_active":"2023-12-08T08:17:57.794103+0000","last_became_peered":"2023-12-08T08:17:57.794103+0000","last_unstale":"2023-12-08T08:17:59.255651+0000","last_undegraded":"2023-12-08T08:17:59.255651+0000","last_fullsized":"2023-12-08T08:17:59.255651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:55.093869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786188+0000","last_change":"2023-12-08T08:17:41.799598+0000","last_active":"2023-12-08T08:17:57.786188+0000","last_peered":"2023-12-08T08:17:57.786188+0000","last_clean":"2023-12-08T08:17:57.786188+0000","last_became_active":"2023-12-08T08:17:41.798619+0000","last_became_peered":"2023-12-08T08:17:41.798619+0000","last_unstale":"2023-12-08T08:17:57.786188+0000","last_undegraded":"2023-12-08T08:17:57.786188+0000","last_fullsized":"2023-12-08T08:17:57.786188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786045+0000","last_change":"2023-12-08T08:17:57.800420+0000","last_active":"2023-12-08T08:17:58.786045+0000","last_peered":"2023-12-08T08:17:58.786045+0000","last_clean":"2023-12-08T08:17:58.786045+0000","last_became_active":"2023-12-08T08:17:57.797400+0000","last_became_peered":"2023-12-08T08:17:57.797400+0000","last_unstale":"2023-12-08T08:17:58.786045+0000","last_undegraded":"2023-12-08T08:17:58.786045+0000","last_fullsized":"2023-12-08T08:17:58.786045+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:57:21.087350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788122+0000","last_change":"2023-12-08T08:17:41.810984+0000","last_active":"2023-12-08T08:17:57.788122+0000","last_peered":"2023-12-08T08:17:57.788122+0000","last_clean":"2023-12-08T08:17:57.788122+0000","last_became_active":"2023-12-08T08:17:41.810711+0000","last_became_peered":"2023-12-08T08:17:41.810711+0000","last_unstale":"2023-12-08T08:17:57.788122+0000","last_undegraded":"2023-12-08T08:17:57.788122+0000","last_fullsized":"2023-12-08T08:17:57.788122+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253629+0000","last_change":"2023-12-08T08:17:57.803447+0000","last_active":"2023-12-08T08:17:59.253629+0000","last_peered":"2023-12-08T08:17:59.253629+0000","last_clean":"2023-12-08T08:17:59.253629+0000","last_became_active":"2023-12-08T08:17:57.801502+0000","last_became_peered":"2023-12-08T08:17:57.801502+0000","last_unstale":"2023-12-08T08:17:59.253629+0000","last_undegraded":"2023-12-08T08:17:59.253629+0000","last_fullsized":"2023-12-08T08:17:59.253629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:44.777523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785370+0000","last_change":"2023-12-08T08:17:41.809057+0000","last_active":"2023-12-08T08:17:57.785370+0000","last_peered":"2023-12-08T08:17:57.785370+0000","last_clean":"2023-12-08T08:17:57.785370+0000","last_became_active":"2023-12-08T08:17:41.807630+0000","last_became_peered":"2023-12-08T08:17:41.807630+0000","last_unstale":"2023-12-08T08:17:57.785370+0000","last_undegraded":"2023-12-08T08:17:57.785370+0000","last_fullsized":"2023-12-08T08:17:57.785370+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:38.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255053+0000","last_change":"2023-12-08T08:17:57.806940+0000","last_active":"2023-12-08T08:17:59.255053+0000","last_peered":"2023-12-08T08:17:59.255053+0000","last_clean":"2023-12-08T08:17:59.255053+0000","last_became_active":"2023-12-08T08:17:57.806644+0000","last_became_peered":"2023-12-08T08:17:57.806644+0000","last_unstale":"2023-12-08T08:17:59.255053+0000","last_undegraded":"2023-12-08T08:17:59.255053+0000","last_fullsized":"2023-12-08T08:17:59.255053+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:04.844904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784059+0000","last_change":"2023-12-08T08:17:41.819715+0000","last_active":"2023-12-08T08:17:57.784059+0000","last_peered":"2023-12-08T08:17:57.784059+0000","last_clean":"2023-12-08T08:17:57.784059+0000","last_became_active":"2023-12-08T08:17:41.819212+0000","last_became_peered":"2023-12-08T08:17:41.819212+0000","last_unstale":"2023-12-08T08:17:57.784059+0000","last_undegraded":"2023-12-08T08:17:57.784059+0000","last_fullsized":"2023-12-08T08:17:57.784059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:10.694455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.789975+0000","last_change":"2023-12-08T08:17:57.793149+0000","last_active":"2023-12-08T08:17:58.789975+0000","last_peered":"2023-12-08T08:17:58.789975+0000","last_clean":"2023-12-08T08:17:58.789975+0000","last_became_active":"2023-12-08T08:17:57.792819+0000","last_became_peered":"2023-12-08T08:17:57.792819+0000","last_unstale":"2023-12-08T08:17:58.789975+0000","last_undegraded":"2023-12-08T08:17:58.789975+0000","last_fullsized":"2023-12-08T08:17:58.789975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:19.848491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779789+0000","last_change":"2023-12-08T08:17:41.817800+0000","last_active":"2023-12-08T08:17:57.779789+0000","last_peered":"2023-12-08T08:17:57.779789+0000","last_clean":"2023-12-08T08:17:57.779789+0000","last_became_active":"2023-12-08T08:17:41.817514+0000","last_became_peered":"2023-12-08T08:17:41.817514+0000","last_unstale":"2023-12-08T08:17:57.779789+0000","last_undegraded":"2023-12-08T08:17:57.779789+0000","last_fullsized":"2023-12-08T08:17:57.779789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:07.769792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254809+0000","last_change":"2023-12-08T08:17:57.803196+0000","last_active":"2023-12-08T08:17:59.254809+0000","last_peered":"2023-12-08T08:17:59.254809+0000","last_clean":"2023-12-08T08:17:59.254809+0000","last_became_active":"2023-12-08T08:17:57.802238+0000","last_became_peered":"2023-12-08T08:17:57.802238+0000","last_unstale":"2023-12-08T08:17:59.254809+0000","last_undegraded":"2023-12-08T08:17:59.254809+0000","last_fullsized":"2023-12-08T08:17:59.254809+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:31:30.914403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760020+0000","last_change":"2023-12-08T08:17:41.808271+0000","last_active":"2023-12-08T08:17:57.760020+0000","last_peered":"2023-12-08T08:17:57.760020+0000","last_clean":"2023-12-08T08:17:57.760020+0000","last_became_active":"2023-12-08T08:17:41.807964+0000","last_became_peered":"2023-12-08T08:17:41.807964+0000","last_unstale":"2023-12-08T08:17:57.760020+0000","last_undegraded":"2023-12-08T08:17:57.760020+0000","last_fullsized":"2023-12-08T08:17:57.760020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:48.031268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788696+0000","last_change":"2023-12-08T08:17:57.797941+0000","last_active":"2023-12-08T08:17:58.788696+0000","last_peered":"2023-12-08T08:17:58.788696+0000","last_clean":"2023-12-08T08:17:58.788696+0000","last_became_active":"2023-12-08T08:17:57.797373+0000","last_became_peered":"2023-12-08T08:17:57.797373+0000","last_unstale":"2023-12-08T08:17:58.788696+0000","last_undegraded":"2023-12-08T08:17:58.788696+0000","last_fullsized":"2023-12-08T08:17:58.788696+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:44:54.782210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779430+0000","last_change":"2023-12-08T08:17:41.800973+0000","last_active":"2023-12-08T08:17:57.779430+0000","last_peered":"2023-12-08T08:17:57.779430+0000","last_clean":"2023-12-08T08:17:57.779430+0000","last_became_active":"2023-12-08T08:17:41.800677+0000","last_became_peered":"2023-12-08T08:17:41.800677+0000","last_unstale":"2023-12-08T08:17:57.779430+0000","last_undegraded":"2023-12-08T08:17:57.779430+0000","last_fullsized":"2023-12-08T08:17:57.779430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:53.659318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.250879+0000","last_change":"2023-12-08T08:17:57.800903+0000","last_active":"2023-12-08T08:17:59.250879+0000","last_peered":"2023-12-08T08:17:59.250879+0000","last_clean":"2023-12-08T08:17:59.250879+0000","last_became_active":"2023-12-08T08:17:57.800621+0000","last_became_peered":"2023-12-08T08:17:57.800621+0000","last_unstale":"2023-12-08T08:17:59.250879+0000","last_undegraded":"2023-12-08T08:17:59.250879+0000","last_fullsized":"2023-12-08T08:17:59.250879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:07.450761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787059+0000","last_change":"2023-12-08T08:17:41.814832+0000","last_active":"2023-12-08T08:17:57.787059+0000","last_peered":"2023-12-08T08:17:57.787059+0000","last_clean":"2023-12-08T08:17:57.787059+0000","last_became_active":"2023-12-08T08:17:41.814575+0000","last_became_peered":"2023-12-08T08:17:41.814575+0000","last_unstale":"2023-12-08T08:17:57.787059+0000","last_undegraded":"2023-12-08T08:17:57.787059+0000","last_fullsized":"2023-12-08T08:17:57.787059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:00:53.545508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788982+0000","last_change":"2023-12-08T08:17:57.804238+0000","last_active":"2023-12-08T08:17:58.788982+0000","last_peered":"2023-12-08T08:17:58.788982+0000","last_clean":"2023-12-08T08:17:58.788982+0000","last_became_active":"2023-12-08T08:17:57.803608+0000","last_became_peered":"2023-12-08T08:17:57.803608+0000","last_unstale":"2023-12-08T08:17:58.788982+0000","last_undegraded":"2023-12-08T08:17:58.788982+0000","last_fullsized":"2023-12-08T08:17:58.788982+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:29.841975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768506+0000","last_change":"2023-12-08T08:17:41.808176+0000","last_active":"2023-12-08T08:17:57.768506+0000","last_peered":"2023-12-08T08:17:57.768506+0000","last_clean":"2023-12-08T08:17:57.768506+0000","last_became_active":"2023-12-08T08:17:41.807870+0000","last_became_peered":"2023-12-08T08:17:41.807870+0000","last_unstale":"2023-12-08T08:17:57.768506+0000","last_undegraded":"2023-12-08T08:17:57.768506+0000","last_fullsized":"2023-12-08T08:17:57.768506+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:00.048902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254515+0000","last_change":"2023-12-08T08:17:57.807446+0000","last_active":"2023-12-08T08:17:59.254515+0000","last_peered":"2023-12-08T08:17:59.254515+0000","last_clean":"2023-12-08T08:17:59.254515+0000","last_became_active":"2023-12-08T08:17:57.804900+0000","last_became_peered":"2023-12-08T08:17:57.804900+0000","last_unstale":"2023-12-08T08:17:59.254515+0000","last_undegraded":"2023-12-08T08:17:59.254515+0000","last_fullsized":"2023-12-08T08:17:59.254515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:01:09.537610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775663+0000","last_change":"2023-12-08T08:17:41.808408+0000","last_active":"2023-12-08T08:17:57.775663+0000","last_peered":"2023-12-08T08:17:57.775663+0000","last_clean":"2023-12-08T08:17:57.775663+0000","last_became_active":"2023-12-08T08:17:41.808106+0000","last_became_peered":"2023-12-08T08:17:41.808106+0000","last_unstale":"2023-12-08T08:17:57.775663+0000","last_undegraded":"2023-12-08T08:17:57.775663+0000","last_fullsized":"2023-12-08T08:17:57.775663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786639+0000","last_change":"2023-12-08T08:17:57.790074+0000","last_active":"2023-12-08T08:17:58.786639+0000","last_peered":"2023-12-08T08:17:58.786639+0000","last_clean":"2023-12-08T08:17:58.786639+0000","last_became_active":"2023-12-08T08:17:57.789798+0000","last_became_peered":"2023-12-08T08:17:57.789798+0000","last_unstale":"2023-12-08T08:17:58.786639+0000","last_undegraded":"2023-12-08T08:17:58.786639+0000","last_fullsized":"2023-12-08T08:17:58.786639+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:16.705997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785471+0000","last_change":"2023-12-08T08:17:41.802487+0000","last_active":"2023-12-08T08:17:57.785471+0000","last_peered":"2023-12-08T08:17:57.785471+0000","last_clean":"2023-12-08T08:17:57.785471+0000","last_became_active":"2023-12-08T08:17:41.802145+0000","last_became_peered":"2023-12-08T08:17:41.802145+0000","last_unstale":"2023-12-08T08:17:57.785471+0000","last_undegraded":"2023-12-08T08:17:57.785471+0000","last_fullsized":"2023-12-08T08:17:57.785471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:23.545167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256755+0000","last_change":"2023-12-08T08:17:57.789874+0000","last_active":"2023-12-08T08:17:59.256755+0000","last_peered":"2023-12-08T08:17:59.256755+0000","last_clean":"2023-12-08T08:17:59.256755+0000","last_became_active":"2023-12-08T08:17:57.789614+0000","last_became_peered":"2023-12-08T08:17:57.789614+0000","last_unstale":"2023-12-08T08:17:59.256755+0000","last_undegraded":"2023-12-08T08:17:59.256755+0000","last_fullsized":"2023-12-08T08:17:59.256755+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:02:03.242262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786817+0000","last_change":"2023-12-08T08:17:41.817827+0000","last_active":"2023-12-08T08:17:57.786817+0000","last_peered":"2023-12-08T08:17:57.786817+0000","last_clean":"2023-12-08T08:17:57.786817+0000","last_became_active":"2023-12-08T08:17:41.817548+0000","last_became_peered":"2023-12-08T08:17:41.817548+0000","last_unstale":"2023-12-08T08:17:57.786817+0000","last_undegraded":"2023-12-08T08:17:57.786817+0000","last_fullsized":"2023-12-08T08:17:57.786817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:45.955555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257840+0000","last_change":"2023-12-08T08:17:57.777534+0000","last_active":"2023-12-08T08:17:59.257840+0000","last_peered":"2023-12-08T08:17:59.257840+0000","last_clean":"2023-12-08T08:17:59.257840+0000","last_became_active":"2023-12-08T08:17:57.777268+0000","last_became_peered":"2023-12-08T08:17:57.777268+0000","last_unstale":"2023-12-08T08:17:59.257840+0000","last_undegraded":"2023-12-08T08:17:59.257840+0000","last_fullsized":"2023-12-08T08:17:59.257840+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:45:13.788448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783489+0000","last_change":"2023-12-08T08:17:41.810824+0000","last_active":"2023-12-08T08:17:57.783489+0000","last_peered":"2023-12-08T08:17:57.783489+0000","last_clean":"2023-12-08T08:17:57.783489+0000","last_became_active":"2023-12-08T08:17:41.810527+0000","last_became_peered":"2023-12-08T08:17:41.810527+0000","last_unstale":"2023-12-08T08:17:57.783489+0000","last_undegraded":"2023-12-08T08:17:57.783489+0000","last_fullsized":"2023-12-08T08:17:57.783489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:27.106866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256652+0000","last_change":"2023-12-08T08:17:57.803290+0000","last_active":"2023-12-08T08:17:59.256652+0000","last_peered":"2023-12-08T08:17:59.256652+0000","last_clean":"2023-12-08T08:17:59.256652+0000","last_became_active":"2023-12-08T08:17:57.802999+0000","last_became_peered":"2023-12-08T08:17:57.802999+0000","last_unstale":"2023-12-08T08:17:59.256652+0000","last_undegraded":"2023-12-08T08:17:59.256652+0000","last_fullsized":"2023-12-08T08:17:59.256652+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:42:34.691868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779653+0000","last_change":"2023-12-08T08:17:41.822809+0000","last_active":"2023-12-08T08:17:57.779653+0000","last_peered":"2023-12-08T08:17:57.779653+0000","last_clean":"2023-12-08T08:17:57.779653+0000","last_became_active":"2023-12-08T08:17:41.822406+0000","last_became_peered":"2023-12-08T08:17:41.822406+0000","last_unstale":"2023-12-08T08:17:57.779653+0000","last_undegraded":"2023-12-08T08:17:57.779653+0000","last_fullsized":"2023-12-08T08:17:57.779653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.251026+0000","last_change":"2023-12-08T08:17:57.800098+0000","last_active":"2023-12-08T08:17:59.251026+0000","last_peered":"2023-12-08T08:17:59.251026+0000","last_clean":"2023-12-08T08:17:59.251026+0000","last_became_active":"2023-12-08T08:17:57.799829+0000","last_became_peered":"2023-12-08T08:17:57.799829+0000","last_unstale":"2023-12-08T08:17:59.251026+0000","last_undegraded":"2023-12-08T08:17:59.251026+0000","last_fullsized":"2023-12-08T08:17:59.251026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:45.444549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793627+0000","last_change":"2023-12-08T08:17:41.805481+0000","last_active":"2023-12-08T08:17:57.793627+0000","last_peered":"2023-12-08T08:17:57.793627+0000","last_clean":"2023-12-08T08:17:57.793627+0000","last_became_active":"2023-12-08T08:17:41.805213+0000","last_became_peered":"2023-12-08T08:17:41.805213+0000","last_unstale":"2023-12-08T08:17:57.793627+0000","last_undegraded":"2023-12-08T08:17:57.793627+0000","last_fullsized":"2023-12-08T08:17:57.793627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:51.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254289+0000","last_change":"2023-12-08T08:17:57.792784+0000","last_active":"2023-12-08T08:17:59.254289+0000","last_peered":"2023-12-08T08:17:59.254289+0000","last_clean":"2023-12-08T08:17:59.254289+0000","last_became_active":"2023-12-08T08:17:57.792477+0000","last_became_peered":"2023-12-08T08:17:57.792477+0000","last_unstale":"2023-12-08T08:17:59.254289+0000","last_undegraded":"2023-12-08T08:17:59.254289+0000","last_fullsized":"2023-12-08T08:17:59.254289+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790421+0000","last_change":"2023-12-08T08:17:41.806208+0000","last_active":"2023-12-08T08:17:57.790421+0000","last_peered":"2023-12-08T08:17:57.790421+0000","last_clean":"2023-12-08T08:17:57.790421+0000","last_became_active":"2023-12-08T08:17:41.805690+0000","last_became_peered":"2023-12-08T08:17:41.805690+0000","last_unstale":"2023-12-08T08:17:57.790421+0000","last_undegraded":"2023-12-08T08:17:57.790421+0000","last_fullsized":"2023-12-08T08:17:57.790421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:03.856389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252756+0000","last_change":"2023-12-08T08:17:57.801131+0000","last_active":"2023-12-08T08:17:59.252756+0000","last_peered":"2023-12-08T08:17:59.252756+0000","last_clean":"2023-12-08T08:17:59.252756+0000","last_became_active":"2023-12-08T08:17:57.800866+0000","last_became_peered":"2023-12-08T08:17:57.800866+0000","last_unstale":"2023-12-08T08:17:59.252756+0000","last_undegraded":"2023-12-08T08:17:59.252756+0000","last_fullsized":"2023-12-08T08:17:59.252756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:31.337049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786261+0000","last_change":"2023-12-08T08:17:41.804344+0000","last_active":"2023-12-08T08:17:57.786261+0000","last_peered":"2023-12-08T08:17:57.786261+0000","last_clean":"2023-12-08T08:17:57.786261+0000","last_became_active":"2023-12-08T08:17:41.804007+0000","last_became_peered":"2023-12-08T08:17:41.804007+0000","last_unstale":"2023-12-08T08:17:57.786261+0000","last_undegraded":"2023-12-08T08:17:57.786261+0000","last_fullsized":"2023-12-08T08:17:57.786261+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257046+0000","last_change":"2023-12-08T08:17:57.800471+0000","last_active":"2023-12-08T08:17:59.257046+0000","last_peered":"2023-12-08T08:17:59.257046+0000","last_clean":"2023-12-08T08:17:59.257046+0000","last_became_active":"2023-12-08T08:17:57.800158+0000","last_became_peered":"2023-12-08T08:17:57.800158+0000","last_unstale":"2023-12-08T08:17:59.257046+0000","last_undegraded":"2023-12-08T08:17:59.257046+0000","last_fullsized":"2023-12-08T08:17:59.257046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:58.760893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782817+0000","last_change":"2023-12-08T08:17:41.811371+0000","last_active":"2023-12-08T08:17:57.782817+0000","last_peered":"2023-12-08T08:17:57.782817+0000","last_clean":"2023-12-08T08:17:57.782817+0000","last_became_active":"2023-12-08T08:17:41.810170+0000","last_became_peered":"2023-12-08T08:17:41.810170+0000","last_unstale":"2023-12-08T08:17:57.782817+0000","last_undegraded":"2023-12-08T08:17:57.782817+0000","last_fullsized":"2023-12-08T08:17:57.782817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:11:24.177944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257306+0000","last_change":"2023-12-08T08:17:57.801790+0000","last_active":"2023-12-08T08:17:59.257306+0000","last_peered":"2023-12-08T08:17:59.257306+0000","last_clean":"2023-12-08T08:17:59.257306+0000","last_became_active":"2023-12-08T08:17:57.800983+0000","last_became_peered":"2023-12-08T08:17:57.800983+0000","last_unstale":"2023-12-08T08:17:59.257306+0000","last_undegraded":"2023-12-08T08:17:59.257306+0000","last_fullsized":"2023-12-08T08:17:59.257306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:16.705997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784842+0000","last_change":"2023-12-08T08:17:41.818164+0000","last_active":"2023-12-08T08:17:57.784842+0000","last_peered":"2023-12-08T08:17:57.784842+0000","last_clean":"2023-12-08T08:17:57.784842+0000","last_became_active":"2023-12-08T08:17:41.815688+0000","last_became_peered":"2023-12-08T08:17:41.815688+0000","last_unstale":"2023-12-08T08:17:57.784842+0000","last_undegraded":"2023-12-08T08:17:57.784842+0000","last_fullsized":"2023-12-08T08:17:57.784842+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257148+0000","last_change":"2023-12-08T08:17:57.798391+0000","last_active":"2023-12-08T08:17:59.257148+0000","last_peered":"2023-12-08T08:17:59.257148+0000","last_clean":"2023-12-08T08:17:59.257148+0000","last_became_active":"2023-12-08T08:17:57.798074+0000","last_became_peered":"2023-12-08T08:17:57.798074+0000","last_unstale":"2023-12-08T08:17:59.257148+0000","last_undegraded":"2023-12-08T08:17:59.257148+0000","last_fullsized":"2023-12-08T08:17:59.257148+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:27.569388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785764+0000","last_change":"2023-12-08T08:17:41.811140+0000","last_active":"2023-12-08T08:17:57.785764+0000","last_peered":"2023-12-08T08:17:57.785764+0000","last_clean":"2023-12-08T08:17:57.785764+0000","last_became_active":"2023-12-08T08:17:41.810744+0000","last_became_peered":"2023-12-08T08:17:41.810744+0000","last_unstale":"2023-12-08T08:17:57.785764+0000","last_undegraded":"2023-12-08T08:17:57.785764+0000","last_fullsized":"2023-12-08T08:17:57.785764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:13.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.257597+0000","last_change":"2023-12-08T08:17:57.795403+0000","last_active":"2023-12-08T08:17:59.257597+0000","last_peered":"2023-12-08T08:17:59.257597+0000","last_clean":"2023-12-08T08:17:59.257597+0000","last_became_active":"2023-12-08T08:17:57.795127+0000","last_became_peered":"2023-12-08T08:17:57.795127+0000","last_unstale":"2023-12-08T08:17:59.257597+0000","last_undegraded":"2023-12-08T08:17:59.257597+0000","last_fullsized":"2023-12-08T08:17:59.257597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:18.074256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.778708+0000","last_change":"2023-12-08T08:17:41.804245+0000","last_active":"2023-12-08T08:17:57.778708+0000","last_peered":"2023-12-08T08:17:57.778708+0000","last_clean":"2023-12-08T08:17:57.778708+0000","last_became_active":"2023-12-08T08:17:41.803929+0000","last_became_peered":"2023-12-08T08:17:41.803929+0000","last_unstale":"2023-12-08T08:17:57.778708+0000","last_undegraded":"2023-12-08T08:17:57.778708+0000","last_fullsized":"2023-12-08T08:17:57.778708+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:27.892743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255239+0000","last_change":"2023-12-08T08:17:57.811003+0000","last_active":"2023-12-08T08:17:59.255239+0000","last_peered":"2023-12-08T08:17:59.255239+0000","last_clean":"2023-12-08T08:17:59.255239+0000","last_became_active":"2023-12-08T08:17:57.810507+0000","last_became_peered":"2023-12-08T08:17:57.810507+0000","last_unstale":"2023-12-08T08:17:59.255239+0000","last_undegraded":"2023-12-08T08:17:59.255239+0000","last_fullsized":"2023-12-08T08:17:59.255239+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:33.854620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775850+0000","last_change":"2023-12-08T08:17:41.812929+0000","last_active":"2023-12-08T08:17:57.775850+0000","last_peered":"2023-12-08T08:17:57.775850+0000","last_clean":"2023-12-08T08:17:57.775850+0000","last_became_active":"2023-12-08T08:17:41.812376+0000","last_became_peered":"2023-12-08T08:17:41.812376+0000","last_unstale":"2023-12-08T08:17:57.775850+0000","last_undegraded":"2023-12-08T08:17:57.775850+0000","last_fullsized":"2023-12-08T08:17:57.775850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:39.638196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788884+0000","last_change":"2023-12-08T08:17:57.807680+0000","last_active":"2023-12-08T08:17:58.788884+0000","last_peered":"2023-12-08T08:17:58.788884+0000","last_clean":"2023-12-08T08:17:58.788884+0000","last_became_active":"2023-12-08T08:17:57.807297+0000","last_became_peered":"2023-12-08T08:17:57.807297+0000","last_unstale":"2023-12-08T08:17:58.788884+0000","last_undegraded":"2023-12-08T08:17:58.788884+0000","last_fullsized":"2023-12-08T08:17:58.788884+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:03:39.537269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.823075+0000","last_change":"2023-12-08T08:17:56.795327+0000","last_active":"2023-12-08T08:17:57.823075+0000","last_peered":"2023-12-08T08:17:57.823075+0000","last_clean":"2023-12-08T08:17:57.823075+0000","last_became_active":"2023-12-08T08:17:56.795056+0000","last_became_peered":"2023-12-08T08:17:56.795056+0000","last_unstale":"2023-12-08T08:17:57.823075+0000","last_undegraded":"2023-12-08T08:17:57.823075+0000","last_fullsized":"2023-12-08T08:17:57.823075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:46.654077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768243+0000","last_change":"2023-12-08T08:17:41.817020+0000","last_active":"2023-12-08T08:17:57.768243+0000","last_peered":"2023-12-08T08:17:57.768243+0000","last_clean":"2023-12-08T08:17:57.768243+0000","last_became_active":"2023-12-08T08:17:41.816719+0000","last_became_peered":"2023-12-08T08:17:41.816719+0000","last_unstale":"2023-12-08T08:17:57.768243+0000","last_undegraded":"2023-12-08T08:17:57.768243+0000","last_fullsized":"2023-12-08T08:17:57.768243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:48.582669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779530+0000","last_change":"2023-12-08T08:17:40.788320+0000","last_active":"2023-12-08T08:17:57.779530+0000","last_peered":"2023-12-08T08:17:57.779530+0000","last_clean":"2023-12-08T08:17:57.779530+0000","last_became_active":"2023-12-08T08:17:40.788020+0000","last_became_peered":"2023-12-08T08:17:40.788020+0000","last_unstale":"2023-12-08T08:17:57.779530+0000","last_undegraded":"2023-12-08T08:17:57.779530+0000","last_fullsized":"2023-12-08T08:17:57.779530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:29.577079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.789022+0000","last_change":"2023-12-08T08:17:57.805111+0000","last_active":"2023-12-08T08:17:58.789022+0000","last_peered":"2023-12-08T08:17:58.789022+0000","last_clean":"2023-12-08T08:17:58.789022+0000","last_became_active":"2023-12-08T08:17:57.804857+0000","last_became_peered":"2023-12-08T08:17:57.804857+0000","last_unstale":"2023-12-08T08:17:58.789022+0000","last_undegraded":"2023-12-08T08:17:58.789022+0000","last_fullsized":"2023-12-08T08:17:58.789022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:26.686557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.824870+0000","last_change":"2023-12-08T08:17:56.798852+0000","last_active":"2023-12-08T08:17:57.824870+0000","last_peered":"2023-12-08T08:17:57.824870+0000","last_clean":"2023-12-08T08:17:57.824870+0000","last_became_active":"2023-12-08T08:17:56.798551+0000","last_became_peered":"2023-12-08T08:17:56.798551+0000","last_unstale":"2023-12-08T08:17:57.824870+0000","last_undegraded":"2023-12-08T08:17:57.824870+0000","last_fullsized":"2023-12-08T08:17:57.824870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:17.192846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786390+0000","last_change":"2023-12-08T08:17:41.810045+0000","last_active":"2023-12-08T08:17:57.786390+0000","last_peered":"2023-12-08T08:17:57.786390+0000","last_clean":"2023-12-08T08:17:57.786390+0000","last_became_active":"2023-12-08T08:17:41.809735+0000","last_became_peered":"2023-12-08T08:17:41.809735+0000","last_unstale":"2023-12-08T08:17:57.786390+0000","last_undegraded":"2023-12-08T08:17:57.786390+0000","last_fullsized":"2023-12-08T08:17:57.786390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:21.152517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789560+0000","last_change":"2023-12-08T08:17:40.785800+0000","last_active":"2023-12-08T08:17:57.789560+0000","last_peered":"2023-12-08T08:17:57.789560+0000","last_clean":"2023-12-08T08:17:57.789560+0000","last_became_active":"2023-12-08T08:17:40.785583+0000","last_became_peered":"2023-12-08T08:17:40.785583+0000","last_unstale":"2023-12-08T08:17:57.789560+0000","last_undegraded":"2023-12-08T08:17:57.789560+0000","last_fullsized":"2023-12-08T08:17:57.789560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.250416+0000","last_change":"2023-12-08T08:17:57.794889+0000","last_active":"2023-12-08T08:17:59.250416+0000","last_peered":"2023-12-08T08:17:59.250416+0000","last_clean":"2023-12-08T08:17:59.250416+0000","last_became_active":"2023-12-08T08:17:57.794635+0000","last_became_peered":"2023-12-08T08:17:57.794635+0000","last_unstale":"2023-12-08T08:17:59.250416+0000","last_undegraded":"2023-12-08T08:17:59.250416+0000","last_fullsized":"2023-12-08T08:17:59.250416+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:31:07.367177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.823632+0000","last_change":"2023-12-08T08:17:56.783004+0000","last_active":"2023-12-08T08:17:57.823632+0000","last_peered":"2023-12-08T08:17:57.823632+0000","last_clean":"2023-12-08T08:17:57.823632+0000","last_became_active":"2023-12-08T08:17:56.780718+0000","last_became_peered":"2023-12-08T08:17:56.780718+0000","last_unstale":"2023-12-08T08:17:57.823632+0000","last_undegraded":"2023-12-08T08:17:57.823632+0000","last_fullsized":"2023-12-08T08:17:57.823632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:03.309751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790305+0000","last_change":"2023-12-08T08:17:41.818743+0000","last_active":"2023-12-08T08:17:57.790305+0000","last_peered":"2023-12-08T08:17:57.790305+0000","last_clean":"2023-12-08T08:17:57.790305+0000","last_became_active":"2023-12-08T08:17:41.816074+0000","last_became_peered":"2023-12-08T08:17:41.816074+0000","last_unstale":"2023-12-08T08:17:57.790305+0000","last_undegraded":"2023-12-08T08:17:57.790305+0000","last_fullsized":"2023-12-08T08:17:57.790305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:24.354375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792818+0000","last_change":"2023-12-08T08:17:40.791591+0000","last_active":"2023-12-08T08:17:57.792818+0000","last_peered":"2023-12-08T08:17:57.792818+0000","last_clean":"2023-12-08T08:17:57.792818+0000","last_became_active":"2023-12-08T08:17:40.790636+0000","last_became_peered":"2023-12-08T08:17:40.790636+0000","last_unstale":"2023-12-08T08:17:57.792818+0000","last_undegraded":"2023-12-08T08:17:57.792818+0000","last_fullsized":"2023-12-08T08:17:57.792818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:18:50.040007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255846+0000","last_change":"2023-12-08T08:17:57.803592+0000","last_active":"2023-12-08T08:17:59.255846+0000","last_peered":"2023-12-08T08:17:59.255846+0000","last_clean":"2023-12-08T08:17:59.255846+0000","last_became_active":"2023-12-08T08:17:57.803297+0000","last_became_peered":"2023-12-08T08:17:57.803297+0000","last_unstale":"2023-12-08T08:17:59.255846+0000","last_undegraded":"2023-12-08T08:17:59.255846+0000","last_fullsized":"2023-12-08T08:17:59.255846+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:48:35.027907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.824644+0000","last_change":"2023-12-08T08:17:56.796020+0000","last_active":"2023-12-08T08:17:57.824644+0000","last_peered":"2023-12-08T08:17:57.824644+0000","last_clean":"2023-12-08T08:17:57.824644+0000","last_became_active":"2023-12-08T08:17:56.795600+0000","last_became_peered":"2023-12-08T08:17:56.795600+0000","last_unstale":"2023-12-08T08:17:57.824644+0000","last_undegraded":"2023-12-08T08:17:57.824644+0000","last_fullsized":"2023-12-08T08:17:57.824644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:48:45.593376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791478+0000","last_change":"2023-12-08T08:17:41.816149+0000","last_active":"2023-12-08T08:17:57.791478+0000","last_peered":"2023-12-08T08:17:57.791478+0000","last_clean":"2023-12-08T08:17:57.791478+0000","last_became_active":"2023-12-08T08:17:41.815736+0000","last_became_peered":"2023-12-08T08:17:41.815736+0000","last_unstale":"2023-12-08T08:17:57.791478+0000","last_undegraded":"2023-12-08T08:17:57.791478+0000","last_fullsized":"2023-12-08T08:17:57.791478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792764+0000","last_change":"2023-12-08T08:17:40.777476+0000","last_active":"2023-12-08T08:17:57.792764+0000","last_peered":"2023-12-08T08:17:57.792764+0000","last_clean":"2023-12-08T08:17:57.792764+0000","last_became_active":"2023-12-08T08:17:40.777023+0000","last_became_peered":"2023-12-08T08:17:40.777023+0000","last_unstale":"2023-12-08T08:17:57.792764+0000","last_undegraded":"2023-12-08T08:17:57.792764+0000","last_fullsized":"2023-12-08T08:17:57.792764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.790359+0000","last_change":"2023-12-08T08:17:57.793126+0000","last_active":"2023-12-08T08:17:58.790359+0000","last_peered":"2023-12-08T08:17:58.790359+0000","last_clean":"2023-12-08T08:17:58.790359+0000","last_became_active":"2023-12-08T08:17:57.792835+0000","last_became_peered":"2023-12-08T08:17:57.792835+0000","last_unstale":"2023-12-08T08:17:58.790359+0000","last_undegraded":"2023-12-08T08:17:58.790359+0000","last_fullsized":"2023-12-08T08:17:58.790359+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:55:14.831076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782155+0000","last_change":"2023-12-08T08:17:56.785550+0000","last_active":"2023-12-08T08:17:57.782155+0000","last_peered":"2023-12-08T08:17:57.782155+0000","last_clean":"2023-12-08T08:17:57.782155+0000","last_became_active":"2023-12-08T08:17:56.785143+0000","last_became_peered":"2023-12-08T08:17:56.785143+0000","last_unstale":"2023-12-08T08:17:57.782155+0000","last_undegraded":"2023-12-08T08:17:57.782155+0000","last_fullsized":"2023-12-08T08:17:57.782155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:41.549197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760306+0000","last_change":"2023-12-08T08:17:41.807119+0000","last_active":"2023-12-08T08:17:57.760306+0000","last_peered":"2023-12-08T08:17:57.760306+0000","last_clean":"2023-12-08T08:17:57.760306+0000","last_became_active":"2023-12-08T08:17:41.806787+0000","last_became_peered":"2023-12-08T08:17:41.806787+0000","last_unstale":"2023-12-08T08:17:57.760306+0000","last_undegraded":"2023-12-08T08:17:57.760306+0000","last_fullsized":"2023-12-08T08:17:57.760306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:50.669464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774961+0000","last_change":"2023-12-08T08:17:40.770650+0000","last_active":"2023-12-08T08:17:57.774961+0000","last_peered":"2023-12-08T08:17:57.774961+0000","last_clean":"2023-12-08T08:17:57.774961+0000","last_became_active":"2023-12-08T08:17:40.770099+0000","last_became_peered":"2023-12-08T08:17:40.770099+0000","last_unstale":"2023-12-08T08:17:57.774961+0000","last_undegraded":"2023-12-08T08:17:57.774961+0000","last_fullsized":"2023-12-08T08:17:57.774961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:37.589334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254185+0000","last_change":"2023-12-08T08:17:57.787179+0000","last_active":"2023-12-08T08:17:59.254185+0000","last_peered":"2023-12-08T08:17:59.254185+0000","last_clean":"2023-12-08T08:17:59.254185+0000","last_became_active":"2023-12-08T08:17:57.786855+0000","last_became_peered":"2023-12-08T08:17:57.786855+0000","last_unstale":"2023-12-08T08:17:59.254185+0000","last_undegraded":"2023-12-08T08:17:59.254185+0000","last_fullsized":"2023-12-08T08:17:59.254185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:55.630298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779651+0000","last_change":"2023-12-08T08:17:56.787431+0000","last_active":"2023-12-08T08:17:57.779651+0000","last_peered":"2023-12-08T08:17:57.779651+0000","last_clean":"2023-12-08T08:17:57.779651+0000","last_became_active":"2023-12-08T08:17:56.787150+0000","last_became_peered":"2023-12-08T08:17:56.787150+0000","last_unstale":"2023-12-08T08:17:57.779651+0000","last_undegraded":"2023-12-08T08:17:57.779651+0000","last_fullsized":"2023-12-08T08:17:57.779651+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:46:02.405102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779885+0000","last_change":"2023-12-08T08:17:41.790134+0000","last_active":"2023-12-08T08:17:57.779885+0000","last_peered":"2023-12-08T08:17:57.779885+0000","last_clean":"2023-12-08T08:17:57.779885+0000","last_became_active":"2023-12-08T08:17:41.789070+0000","last_became_peered":"2023-12-08T08:17:41.789070+0000","last_unstale":"2023-12-08T08:17:57.779885+0000","last_undegraded":"2023-12-08T08:17:57.779885+0000","last_fullsized":"2023-12-08T08:17:57.779885+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:49.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786944+0000","last_change":"2023-12-08T08:17:40.780890+0000","last_active":"2023-12-08T08:17:57.786944+0000","last_peered":"2023-12-08T08:17:57.786944+0000","last_clean":"2023-12-08T08:17:57.786944+0000","last_became_active":"2023-12-08T08:17:40.780517+0000","last_became_peered":"2023-12-08T08:17:40.780517+0000","last_unstale":"2023-12-08T08:17:57.786944+0000","last_undegraded":"2023-12-08T08:17:57.786944+0000","last_fullsized":"2023-12-08T08:17:57.786944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:41:09.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252160+0000","last_change":"2023-12-08T08:17:57.805172+0000","last_active":"2023-12-08T08:17:59.252160+0000","last_peered":"2023-12-08T08:17:59.252160+0000","last_clean":"2023-12-08T08:17:59.252160+0000","last_became_active":"2023-12-08T08:17:57.801743+0000","last_became_peered":"2023-12-08T08:17:57.801743+0000","last_unstale":"2023-12-08T08:17:59.252160+0000","last_undegraded":"2023-12-08T08:17:59.252160+0000","last_fullsized":"2023-12-08T08:17:59.252160+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:43:48.950090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.820196+0000","last_change":"2023-12-08T08:17:56.793596+0000","last_active":"2023-12-08T08:17:57.820196+0000","last_peered":"2023-12-08T08:17:57.820196+0000","last_clean":"2023-12-08T08:17:57.820196+0000","last_became_active":"2023-12-08T08:17:56.793096+0000","last_became_peered":"2023-12-08T08:17:56.793096+0000","last_unstale":"2023-12-08T08:17:57.820196+0000","last_undegraded":"2023-12-08T08:17:57.820196+0000","last_fullsized":"2023-12-08T08:17:57.820196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:06.204089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768224+0000","last_change":"2023-12-08T08:17:41.821735+0000","last_active":"2023-12-08T08:17:57.768224+0000","last_peered":"2023-12-08T08:17:57.768224+0000","last_clean":"2023-12-08T08:17:57.768224+0000","last_became_active":"2023-12-08T08:17:41.821471+0000","last_became_peered":"2023-12-08T08:17:41.821471+0000","last_unstale":"2023-12-08T08:17:57.768224+0000","last_undegraded":"2023-12-08T08:17:57.768224+0000","last_fullsized":"2023-12-08T08:17:57.768224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:01:47.250160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783578+0000","last_change":"2023-12-08T08:17:40.787606+0000","last_active":"2023-12-08T08:17:57.783578+0000","last_peered":"2023-12-08T08:17:57.783578+0000","last_clean":"2023-12-08T08:17:57.783578+0000","last_became_active":"2023-12-08T08:17:40.787322+0000","last_became_peered":"2023-12-08T08:17:40.787322+0000","last_unstale":"2023-12-08T08:17:57.783578+0000","last_undegraded":"2023-12-08T08:17:57.783578+0000","last_fullsized":"2023-12-08T08:17:57.783578+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:57.824666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253997+0000","last_change":"2023-12-08T08:17:57.803214+0000","last_active":"2023-12-08T08:17:59.253997+0000","last_peered":"2023-12-08T08:17:59.253997+0000","last_clean":"2023-12-08T08:17:59.253997+0000","last_became_active":"2023-12-08T08:17:57.800416+0000","last_became_peered":"2023-12-08T08:17:57.800416+0000","last_unstale":"2023-12-08T08:17:59.253997+0000","last_undegraded":"2023-12-08T08:17:59.253997+0000","last_fullsized":"2023-12-08T08:17:59.253997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:58:59.956168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.819694+0000","last_change":"2023-12-08T08:17:56.772823+0000","last_active":"2023-12-08T08:17:57.819694+0000","last_peered":"2023-12-08T08:17:57.819694+0000","last_clean":"2023-12-08T08:17:57.819694+0000","last_became_active":"2023-12-08T08:17:56.772152+0000","last_became_peered":"2023-12-08T08:17:56.772152+0000","last_unstale":"2023-12-08T08:17:57.819694+0000","last_undegraded":"2023-12-08T08:17:57.819694+0000","last_fullsized":"2023-12-08T08:17:57.819694+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:39.332501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.774867+0000","last_change":"2023-12-08T08:17:41.811097+0000","last_active":"2023-12-08T08:17:57.774867+0000","last_peered":"2023-12-08T08:17:57.774867+0000","last_clean":"2023-12-08T08:17:57.774867+0000","last_became_active":"2023-12-08T08:17:41.810224+0000","last_became_peered":"2023-12-08T08:17:41.810224+0000","last_unstale":"2023-12-08T08:17:57.774867+0000","last_undegraded":"2023-12-08T08:17:57.774867+0000","last_fullsized":"2023-12-08T08:17:57.774867+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767380+0000","last_change":"2023-12-08T08:17:40.793777+0000","last_active":"2023-12-08T08:17:57.767380+0000","last_peered":"2023-12-08T08:17:57.767380+0000","last_clean":"2023-12-08T08:17:57.767380+0000","last_became_active":"2023-12-08T08:17:40.793430+0000","last_became_peered":"2023-12-08T08:17:40.793430+0000","last_unstale":"2023-12-08T08:17:57.767380+0000","last_undegraded":"2023-12-08T08:17:57.767380+0000","last_fullsized":"2023-12-08T08:17:57.767380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:55:19.590621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.786181+0000","last_change":"2023-12-08T08:17:57.799273+0000","last_active":"2023-12-08T08:17:58.786181+0000","last_peered":"2023-12-08T08:17:58.786181+0000","last_clean":"2023-12-08T08:17:58.786181+0000","last_became_active":"2023-12-08T08:17:57.798921+0000","last_became_peered":"2023-12-08T08:17:57.798921+0000","last_unstale":"2023-12-08T08:17:58.786181+0000","last_undegraded":"2023-12-08T08:17:58.786181+0000","last_fullsized":"2023-12-08T08:17:58.786181+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:58.760893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"64'3","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822955+0000","last_change":"2023-12-08T08:17:56.778625+0000","last_active":"2023-12-08T08:17:57.822955+0000","last_peered":"2023-12-08T08:17:57.822955+0000","last_clean":"2023-12-08T08:17:57.822955+0000","last_became_active":"2023-12-08T08:17:56.778322+0000","last_became_peered":"2023-12-08T08:17:56.778322+0000","last_unstale":"2023-12-08T08:17:57.822955+0000","last_undegraded":"2023-12-08T08:17:57.822955+0000","last_fullsized":"2023-12-08T08:17:57.822955+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:15.872633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782687+0000","last_change":"2023-12-08T08:17:41.814803+0000","last_active":"2023-12-08T08:17:57.782687+0000","last_peered":"2023-12-08T08:17:57.782687+0000","last_clean":"2023-12-08T08:17:57.782687+0000","last_became_active":"2023-12-08T08:17:41.814116+0000","last_became_peered":"2023-12-08T08:17:41.814116+0000","last_unstale":"2023-12-08T08:17:57.782687+0000","last_undegraded":"2023-12-08T08:17:57.782687+0000","last_fullsized":"2023-12-08T08:17:57.782687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:48:19.234272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.791808+0000","last_change":"2023-12-08T08:17:40.785752+0000","last_active":"2023-12-08T08:17:57.791808+0000","last_peered":"2023-12-08T08:17:57.791808+0000","last_clean":"2023-12-08T08:17:57.791808+0000","last_became_active":"2023-12-08T08:17:40.785462+0000","last_became_peered":"2023-12-08T08:17:40.785462+0000","last_unstale":"2023-12-08T08:17:57.791808+0000","last_undegraded":"2023-12-08T08:17:57.791808+0000","last_fullsized":"2023-12-08T08:17:57.791808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:42.669344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252676+0000","last_change":"2023-12-08T08:17:57.801494+0000","last_active":"2023-12-08T08:17:59.252676+0000","last_peered":"2023-12-08T08:17:59.252676+0000","last_clean":"2023-12-08T08:17:59.252676+0000","last_became_active":"2023-12-08T08:17:57.801167+0000","last_became_peered":"2023-12-08T08:17:57.801167+0000","last_unstale":"2023-12-08T08:17:59.252676+0000","last_undegraded":"2023-12-08T08:17:59.252676+0000","last_fullsized":"2023-12-08T08:17:59.252676+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:53:53.804796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.827243+0000","last_change":"2023-12-08T08:17:56.796421+0000","last_active":"2023-12-08T08:17:57.827243+0000","last_peered":"2023-12-08T08:17:57.827243+0000","last_clean":"2023-12-08T08:17:57.827243+0000","last_became_active":"2023-12-08T08:17:56.795882+0000","last_became_peered":"2023-12-08T08:17:56.795882+0000","last_unstale":"2023-12-08T08:17:57.827243+0000","last_undegraded":"2023-12-08T08:17:57.827243+0000","last_fullsized":"2023-12-08T08:17:57.827243+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:39:20.323825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782067+0000","last_change":"2023-12-08T08:17:41.807684+0000","last_active":"2023-12-08T08:17:57.782067+0000","last_peered":"2023-12-08T08:17:57.782067+0000","last_clean":"2023-12-08T08:17:57.782067+0000","last_became_active":"2023-12-08T08:17:41.807377+0000","last_became_peered":"2023-12-08T08:17:41.807377+0000","last_unstale":"2023-12-08T08:17:57.782067+0000","last_undegraded":"2023-12-08T08:17:57.782067+0000","last_fullsized":"2023-12-08T08:17:57.782067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:17:46.412312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787313+0000","last_change":"2023-12-08T08:17:40.782500+0000","last_active":"2023-12-08T08:17:57.787313+0000","last_peered":"2023-12-08T08:17:57.787313+0000","last_clean":"2023-12-08T08:17:57.787313+0000","last_became_active":"2023-12-08T08:17:40.782188+0000","last_became_peered":"2023-12-08T08:17:40.782188+0000","last_unstale":"2023-12-08T08:17:57.787313+0000","last_undegraded":"2023-12-08T08:17:57.787313+0000","last_fullsized":"2023-12-08T08:17:57.787313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:07.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.251527+0000","last_change":"2023-12-08T08:17:57.796995+0000","last_active":"2023-12-08T08:17:59.251527+0000","last_peered":"2023-12-08T08:17:59.251527+0000","last_clean":"2023-12-08T08:17:59.251527+0000","last_became_active":"2023-12-08T08:17:57.796736+0000","last_became_peered":"2023-12-08T08:17:57.796736+0000","last_unstale":"2023-12-08T08:17:59.251527+0000","last_undegraded":"2023-12-08T08:17:59.251527+0000","last_fullsized":"2023-12-08T08:17:59.251527+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:57.655655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790867+0000","last_change":"2023-12-08T08:17:56.796029+0000","last_active":"2023-12-08T08:17:57.790867+0000","last_peered":"2023-12-08T08:17:57.790867+0000","last_clean":"2023-12-08T08:17:57.790867+0000","last_became_active":"2023-12-08T08:17:56.795266+0000","last_became_peered":"2023-12-08T08:17:56.795266+0000","last_unstale":"2023-12-08T08:17:57.790867+0000","last_undegraded":"2023-12-08T08:17:57.790867+0000","last_fullsized":"2023-12-08T08:17:57.790867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769289+0000","last_change":"2023-12-08T08:17:41.810147+0000","last_active":"2023-12-08T08:17:57.769289+0000","last_peered":"2023-12-08T08:17:57.769289+0000","last_clean":"2023-12-08T08:17:57.769289+0000","last_became_active":"2023-12-08T08:17:41.809844+0000","last_became_peered":"2023-12-08T08:17:41.809844+0000","last_unstale":"2023-12-08T08:17:57.769289+0000","last_undegraded":"2023-12-08T08:17:57.769289+0000","last_fullsized":"2023-12-08T08:17:57.769289+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:11:34.626870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789721+0000","last_change":"2023-12-08T08:17:40.785791+0000","last_active":"2023-12-08T08:17:57.789721+0000","last_peered":"2023-12-08T08:17:57.789721+0000","last_clean":"2023-12-08T08:17:57.789721+0000","last_became_active":"2023-12-08T08:17:40.785050+0000","last_became_peered":"2023-12-08T08:17:40.785050+0000","last_unstale":"2023-12-08T08:17:57.789721+0000","last_undegraded":"2023-12-08T08:17:57.789721+0000","last_fullsized":"2023-12-08T08:17:57.789721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:05:59.034593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252730+0000","last_change":"2023-12-08T08:17:57.799188+0000","last_active":"2023-12-08T08:17:59.252730+0000","last_peered":"2023-12-08T08:17:59.252730+0000","last_clean":"2023-12-08T08:17:59.252730+0000","last_became_active":"2023-12-08T08:17:57.798666+0000","last_became_peered":"2023-12-08T08:17:57.798666+0000","last_unstale":"2023-12-08T08:17:59.252730+0000","last_undegraded":"2023-12-08T08:17:59.252730+0000","last_fullsized":"2023-12-08T08:17:59.252730+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:22:29.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790324+0000","last_change":"2023-12-08T08:17:56.784864+0000","last_active":"2023-12-08T08:17:57.790324+0000","last_peered":"2023-12-08T08:17:57.790324+0000","last_clean":"2023-12-08T08:17:57.790324+0000","last_became_active":"2023-12-08T08:17:56.784452+0000","last_became_peered":"2023-12-08T08:17:56.784452+0000","last_unstale":"2023-12-08T08:17:57.790324+0000","last_undegraded":"2023-12-08T08:17:57.790324+0000","last_fullsized":"2023-12-08T08:17:57.790324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:04:04.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790766+0000","last_change":"2023-12-08T08:17:41.799611+0000","last_active":"2023-12-08T08:17:57.790766+0000","last_peered":"2023-12-08T08:17:57.790766+0000","last_clean":"2023-12-08T08:17:57.790766+0000","last_became_active":"2023-12-08T08:17:41.799321+0000","last_became_peered":"2023-12-08T08:17:41.799321+0000","last_unstale":"2023-12-08T08:17:57.790766+0000","last_undegraded":"2023-12-08T08:17:57.790766+0000","last_fullsized":"2023-12-08T08:17:57.790766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:37.818772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"61'8","reported_seq":26,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782864+0000","last_change":"2023-12-08T08:17:40.782588+0000","last_active":"2023-12-08T08:17:57.782864+0000","last_peered":"2023-12-08T08:17:57.782864+0000","last_clean":"2023-12-08T08:17:57.782864+0000","last_became_active":"2023-12-08T08:17:40.782095+0000","last_became_peered":"2023-12-08T08:17:40.782095+0000","last_unstale":"2023-12-08T08:17:57.782864+0000","last_undegraded":"2023-12-08T08:17:57.782864+0000","last_fullsized":"2023-12-08T08:17:57.782864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:39.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255577+0000","last_change":"2023-12-08T08:17:57.796124+0000","last_active":"2023-12-08T08:17:59.255577+0000","last_peered":"2023-12-08T08:17:59.255577+0000","last_clean":"2023-12-08T08:17:59.255577+0000","last_became_active":"2023-12-08T08:17:57.795855+0000","last_became_peered":"2023-12-08T08:17:57.795855+0000","last_unstale":"2023-12-08T08:17:59.255577+0000","last_undegraded":"2023-12-08T08:17:59.255577+0000","last_fullsized":"2023-12-08T08:17:59.255577+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:28.393422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779707+0000","last_change":"2023-12-08T08:17:56.777484+0000","last_active":"2023-12-08T08:17:57.779707+0000","last_peered":"2023-12-08T08:17:57.779707+0000","last_clean":"2023-12-08T08:17:57.779707+0000","last_became_active":"2023-12-08T08:17:56.776424+0000","last_became_peered":"2023-12-08T08:17:56.776424+0000","last_unstale":"2023-12-08T08:17:57.779707+0000","last_undegraded":"2023-12-08T08:17:57.779707+0000","last_fullsized":"2023-12-08T08:17:57.779707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:23.600820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779169+0000","last_change":"2023-12-08T08:17:41.813987+0000","last_active":"2023-12-08T08:17:57.779169+0000","last_peered":"2023-12-08T08:17:57.779169+0000","last_clean":"2023-12-08T08:17:57.779169+0000","last_became_active":"2023-12-08T08:17:41.813031+0000","last_became_peered":"2023-12-08T08:17:41.813031+0000","last_unstale":"2023-12-08T08:17:57.779169+0000","last_undegraded":"2023-12-08T08:17:57.779169+0000","last_fullsized":"2023-12-08T08:17:57.779169+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:47:15.803220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785048+0000","last_change":"2023-12-08T08:17:40.791662+0000","last_active":"2023-12-08T08:17:57.785048+0000","last_peered":"2023-12-08T08:17:57.785048+0000","last_clean":"2023-12-08T08:17:57.785048+0000","last_became_active":"2023-12-08T08:17:40.791257+0000","last_became_peered":"2023-12-08T08:17:40.791257+0000","last_unstale":"2023-12-08T08:17:57.785048+0000","last_undegraded":"2023-12-08T08:17:57.785048+0000","last_fullsized":"2023-12-08T08:17:57.785048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:06.761099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254339+0000","last_change":"2023-12-08T08:17:57.789172+0000","last_active":"2023-12-08T08:17:59.254339+0000","last_peered":"2023-12-08T08:17:59.254339+0000","last_clean":"2023-12-08T08:17:59.254339+0000","last_became_active":"2023-12-08T08:17:57.788900+0000","last_became_peered":"2023-12-08T08:17:57.788900+0000","last_unstale":"2023-12-08T08:17:59.254339+0000","last_undegraded":"2023-12-08T08:17:59.254339+0000","last_fullsized":"2023-12-08T08:17:59.254339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:28.979610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"64'8","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825764+0000","last_change":"2023-12-08T08:17:56.789756+0000","last_active":"2023-12-08T08:17:57.825764+0000","last_peered":"2023-12-08T08:17:57.825764+0000","last_clean":"2023-12-08T08:17:57.825764+0000","last_became_active":"2023-12-08T08:17:56.789515+0000","last_became_peered":"2023-12-08T08:17:56.789515+0000","last_unstale":"2023-12-08T08:17:57.825764+0000","last_undegraded":"2023-12-08T08:17:57.825764+0000","last_fullsized":"2023-12-08T08:17:57.825764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:32:10.037787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787350+0000","last_change":"2023-12-08T08:17:41.822018+0000","last_active":"2023-12-08T08:17:57.787350+0000","last_peered":"2023-12-08T08:17:57.787350+0000","last_clean":"2023-12-08T08:17:57.787350+0000","last_became_active":"2023-12-08T08:17:41.821151+0000","last_became_peered":"2023-12-08T08:17:41.821151+0000","last_unstale":"2023-12-08T08:17:57.787350+0000","last_undegraded":"2023-12-08T08:17:57.787350+0000","last_fullsized":"2023-12-08T08:17:57.787350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:03:51.225963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.785848+0000","last_change":"2023-12-08T08:17:40.787306+0000","last_active":"2023-12-08T08:17:57.785848+0000","last_peered":"2023-12-08T08:17:57.785848+0000","last_clean":"2023-12-08T08:17:57.785848+0000","last_became_active":"2023-12-08T08:17:40.786975+0000","last_became_peered":"2023-12-08T08:17:40.786975+0000","last_unstale":"2023-12-08T08:17:57.785848+0000","last_undegraded":"2023-12-08T08:17:57.785848+0000","last_fullsized":"2023-12-08T08:17:57.785848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255417+0000","last_change":"2023-12-08T08:17:57.795824+0000","last_active":"2023-12-08T08:17:59.255417+0000","last_peered":"2023-12-08T08:17:59.255417+0000","last_clean":"2023-12-08T08:17:59.255417+0000","last_became_active":"2023-12-08T08:17:57.793498+0000","last_became_peered":"2023-12-08T08:17:57.793498+0000","last_unstale":"2023-12-08T08:17:59.255417+0000","last_undegraded":"2023-12-08T08:17:59.255417+0000","last_fullsized":"2023-12-08T08:17:59.255417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:31:47.668053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825127+0000","last_change":"2023-12-08T08:17:56.788069+0000","last_active":"2023-12-08T08:17:57.825127+0000","last_peered":"2023-12-08T08:17:57.825127+0000","last_clean":"2023-12-08T08:17:57.825127+0000","last_became_active":"2023-12-08T08:17:56.787757+0000","last_became_peered":"2023-12-08T08:17:56.787757+0000","last_unstale":"2023-12-08T08:17:57.825127+0000","last_undegraded":"2023-12-08T08:17:57.825127+0000","last_fullsized":"2023-12-08T08:17:57.825127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:01.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767749+0000","last_change":"2023-12-08T08:17:41.809958+0000","last_active":"2023-12-08T08:17:57.767749+0000","last_peered":"2023-12-08T08:17:57.767749+0000","last_clean":"2023-12-08T08:17:57.767749+0000","last_became_active":"2023-12-08T08:17:41.809516+0000","last_became_peered":"2023-12-08T08:17:41.809516+0000","last_unstale":"2023-12-08T08:17:57.767749+0000","last_undegraded":"2023-12-08T08:17:57.767749+0000","last_fullsized":"2023-12-08T08:17:57.767749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:06:11.577286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780353+0000","last_change":"2023-12-08T08:17:40.787692+0000","last_active":"2023-12-08T08:17:57.780353+0000","last_peered":"2023-12-08T08:17:57.780353+0000","last_clean":"2023-12-08T08:17:57.780353+0000","last_became_active":"2023-12-08T08:17:40.787396+0000","last_became_peered":"2023-12-08T08:17:40.787396+0000","last_unstale":"2023-12-08T08:17:57.780353+0000","last_undegraded":"2023-12-08T08:17:57.780353+0000","last_fullsized":"2023-12-08T08:17:57.780353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254856+0000","last_change":"2023-12-08T08:17:57.794971+0000","last_active":"2023-12-08T08:17:59.254856+0000","last_peered":"2023-12-08T08:17:59.254856+0000","last_clean":"2023-12-08T08:17:59.254856+0000","last_became_active":"2023-12-08T08:17:57.793598+0000","last_became_peered":"2023-12-08T08:17:57.793598+0000","last_unstale":"2023-12-08T08:17:59.254856+0000","last_undegraded":"2023-12-08T08:17:59.254856+0000","last_fullsized":"2023-12-08T08:17:59.254856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.416931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782392+0000","last_change":"2023-12-08T08:17:56.792597+0000","last_active":"2023-12-08T08:17:57.782392+0000","last_peered":"2023-12-08T08:17:57.782392+0000","last_clean":"2023-12-08T08:17:57.782392+0000","last_became_active":"2023-12-08T08:17:56.792311+0000","last_became_peered":"2023-12-08T08:17:56.792311+0000","last_unstale":"2023-12-08T08:17:57.782392+0000","last_undegraded":"2023-12-08T08:17:57.782392+0000","last_fullsized":"2023-12-08T08:17:57.782392+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:39:32.840644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779116+0000","last_change":"2023-12-08T08:17:41.812890+0000","last_active":"2023-12-08T08:17:57.779116+0000","last_peered":"2023-12-08T08:17:57.779116+0000","last_clean":"2023-12-08T08:17:57.779116+0000","last_became_active":"2023-12-08T08:17:41.812577+0000","last_became_peered":"2023-12-08T08:17:41.812577+0000","last_unstale":"2023-12-08T08:17:57.779116+0000","last_undegraded":"2023-12-08T08:17:57.779116+0000","last_fullsized":"2023-12-08T08:17:57.779116+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:13:24.602326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":43,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783952+0000","last_change":"2023-12-08T08:17:47.914689+0000","last_active":"2023-12-08T08:17:57.783952+0000","last_peered":"2023-12-08T08:17:57.783952+0000","last_clean":"2023-12-08T08:17:57.783952+0000","last_became_active":"2023-12-08T08:17:47.896123+0000","last_became_peered":"2023-12-08T08:17:47.896123+0000","last_unstale":"2023-12-08T08:17:57.783952+0000","last_undegraded":"2023-12-08T08:17:57.783952+0000","last_fullsized":"2023-12-08T08:17:57.783952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:25:47.568360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255211+0000","last_change":"2023-12-08T08:17:57.785956+0000","last_active":"2023-12-08T08:17:59.255211+0000","last_peered":"2023-12-08T08:17:59.255211+0000","last_clean":"2023-12-08T08:17:59.255211+0000","last_became_active":"2023-12-08T08:17:57.785618+0000","last_became_peered":"2023-12-08T08:17:57.785618+0000","last_unstale":"2023-12-08T08:17:59.255211+0000","last_undegraded":"2023-12-08T08:17:59.255211+0000","last_fullsized":"2023-12-08T08:17:59.255211+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:58:41.724638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.825251+0000","last_change":"2023-12-08T08:17:56.783471+0000","last_active":"2023-12-08T08:17:57.825251+0000","last_peered":"2023-12-08T08:17:57.825251+0000","last_clean":"2023-12-08T08:17:57.825251+0000","last_became_active":"2023-12-08T08:17:56.782732+0000","last_became_peered":"2023-12-08T08:17:56.782732+0000","last_unstale":"2023-12-08T08:17:57.825251+0000","last_undegraded":"2023-12-08T08:17:57.825251+0000","last_fullsized":"2023-12-08T08:17:57.825251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:33:30.530043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787165+0000","last_change":"2023-12-08T08:17:41.814259+0000","last_active":"2023-12-08T08:17:57.787165+0000","last_peered":"2023-12-08T08:17:57.787165+0000","last_clean":"2023-12-08T08:17:57.787165+0000","last_became_active":"2023-12-08T08:17:41.813884+0000","last_became_peered":"2023-12-08T08:17:41.813884+0000","last_unstale":"2023-12-08T08:17:57.787165+0000","last_undegraded":"2023-12-08T08:17:57.787165+0000","last_fullsized":"2023-12-08T08:17:57.787165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793459+0000","last_change":"2023-12-08T08:17:40.785593+0000","last_active":"2023-12-08T08:17:57.793459+0000","last_peered":"2023-12-08T08:17:57.793459+0000","last_clean":"2023-12-08T08:17:57.793459+0000","last_became_active":"2023-12-08T08:17:40.784148+0000","last_became_peered":"2023-12-08T08:17:40.784148+0000","last_unstale":"2023-12-08T08:17:57.793459+0000","last_undegraded":"2023-12-08T08:17:57.793459+0000","last_fullsized":"2023-12-08T08:17:57.793459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:51:19.531113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.785953+0000","last_change":"2023-12-08T08:17:57.789814+0000","last_active":"2023-12-08T08:17:58.785953+0000","last_peered":"2023-12-08T08:17:58.785953+0000","last_clean":"2023-12-08T08:17:58.785953+0000","last_became_active":"2023-12-08T08:17:57.789121+0000","last_became_peered":"2023-12-08T08:17:57.789121+0000","last_unstale":"2023-12-08T08:17:58.785953+0000","last_undegraded":"2023-12-08T08:17:58.785953+0000","last_fullsized":"2023-12-08T08:17:58.785953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:30:53.749567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.797397+0000","last_change":"2023-12-08T08:17:56.778284+0000","last_active":"2023-12-08T08:17:57.797397+0000","last_peered":"2023-12-08T08:17:57.797397+0000","last_clean":"2023-12-08T08:17:57.797397+0000","last_became_active":"2023-12-08T08:17:56.777942+0000","last_became_peered":"2023-12-08T08:17:56.777942+0000","last_unstale":"2023-12-08T08:17:57.797397+0000","last_undegraded":"2023-12-08T08:17:57.797397+0000","last_fullsized":"2023-12-08T08:17:57.797397+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:35:47.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768574+0000","last_change":"2023-12-08T08:17:41.812192+0000","last_active":"2023-12-08T08:17:57.768574+0000","last_peered":"2023-12-08T08:17:57.768574+0000","last_clean":"2023-12-08T08:17:57.768574+0000","last_became_active":"2023-12-08T08:17:41.811812+0000","last_became_peered":"2023-12-08T08:17:41.811812+0000","last_unstale":"2023-12-08T08:17:57.768574+0000","last_undegraded":"2023-12-08T08:17:57.768574+0000","last_fullsized":"2023-12-08T08:17:57.768574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:52.110302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790086+0000","last_change":"2023-12-08T08:17:40.791907+0000","last_active":"2023-12-08T08:17:57.790086+0000","last_peered":"2023-12-08T08:17:57.790086+0000","last_clean":"2023-12-08T08:17:57.790086+0000","last_became_active":"2023-12-08T08:17:40.791283+0000","last_became_peered":"2023-12-08T08:17:40.791283+0000","last_unstale":"2023-12-08T08:17:57.790086+0000","last_undegraded":"2023-12-08T08:17:57.790086+0000","last_fullsized":"2023-12-08T08:17:57.790086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.784608+0000","last_change":"2023-12-08T08:17:57.791350+0000","last_active":"2023-12-08T08:17:58.784608+0000","last_peered":"2023-12-08T08:17:58.784608+0000","last_clean":"2023-12-08T08:17:58.784608+0000","last_became_active":"2023-12-08T08:17:57.791035+0000","last_became_peered":"2023-12-08T08:17:57.791035+0000","last_unstale":"2023-12-08T08:17:58.784608+0000","last_undegraded":"2023-12-08T08:17:58.784608+0000","last_fullsized":"2023-12-08T08:17:58.784608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:42.563173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822702+0000","last_change":"2023-12-08T08:17:56.796644+0000","last_active":"2023-12-08T08:17:57.822702+0000","last_peered":"2023-12-08T08:17:57.822702+0000","last_clean":"2023-12-08T08:17:57.822702+0000","last_became_active":"2023-12-08T08:17:56.796276+0000","last_became_peered":"2023-12-08T08:17:56.796276+0000","last_unstale":"2023-12-08T08:17:57.822702+0000","last_undegraded":"2023-12-08T08:17:57.822702+0000","last_fullsized":"2023-12-08T08:17:57.822702+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.771918+0000","last_change":"2023-12-08T08:17:47.864253+0000","last_active":"2023-12-08T08:17:57.771918+0000","last_peered":"2023-12-08T08:17:57.771918+0000","last_clean":"2023-12-08T08:17:57.771918+0000","last_became_active":"2023-12-08T08:17:47.863753+0000","last_became_peered":"2023-12-08T08:17:47.863753+0000","last_unstale":"2023-12-08T08:17:57.771918+0000","last_undegraded":"2023-12-08T08:17:57.771918+0000","last_fullsized":"2023-12-08T08:17:57.771918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:34:12.401320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789821+0000","last_change":"2023-12-08T08:17:40.786041+0000","last_active":"2023-12-08T08:17:57.789821+0000","last_peered":"2023-12-08T08:17:57.789821+0000","last_clean":"2023-12-08T08:17:57.789821+0000","last_became_active":"2023-12-08T08:17:40.785457+0000","last_became_peered":"2023-12-08T08:17:40.785457+0000","last_unstale":"2023-12-08T08:17:57.789821+0000","last_undegraded":"2023-12-08T08:17:57.789821+0000","last_fullsized":"2023-12-08T08:17:57.789821+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:12:51.095994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253309+0000","last_change":"2023-12-08T08:17:57.777046+0000","last_active":"2023-12-08T08:17:59.253309+0000","last_peered":"2023-12-08T08:17:59.253309+0000","last_clean":"2023-12-08T08:17:59.253309+0000","last_became_active":"2023-12-08T08:17:57.776718+0000","last_became_peered":"2023-12-08T08:17:57.776718+0000","last_unstale":"2023-12-08T08:17:59.253309+0000","last_undegraded":"2023-12-08T08:17:59.253309+0000","last_fullsized":"2023-12-08T08:17:59.253309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:55:43.884845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822558+0000","last_change":"2023-12-08T08:17:56.780944+0000","last_active":"2023-12-08T08:17:57.822558+0000","last_peered":"2023-12-08T08:17:57.822558+0000","last_clean":"2023-12-08T08:17:57.822558+0000","last_became_active":"2023-12-08T08:17:56.780212+0000","last_became_peered":"2023-12-08T08:17:56.780212+0000","last_unstale":"2023-12-08T08:17:57.822558+0000","last_undegraded":"2023-12-08T08:17:57.822558+0000","last_fullsized":"2023-12-08T08:17:57.822558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:25:58.661778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769051+0000","last_change":"2023-12-08T08:17:41.813007+0000","last_active":"2023-12-08T08:17:57.769051+0000","last_peered":"2023-12-08T08:17:57.769051+0000","last_clean":"2023-12-08T08:17:57.769051+0000","last_became_active":"2023-12-08T08:17:41.812716+0000","last_became_peered":"2023-12-08T08:17:41.812716+0000","last_unstale":"2023-12-08T08:17:57.769051+0000","last_undegraded":"2023-12-08T08:17:57.769051+0000","last_fullsized":"2023-12-08T08:17:57.769051+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:48.095348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775841+0000","last_change":"2023-12-08T08:17:40.776391+0000","last_active":"2023-12-08T08:17:57.775841+0000","last_peered":"2023-12-08T08:17:57.775841+0000","last_clean":"2023-12-08T08:17:57.775841+0000","last_became_active":"2023-12-08T08:17:40.776121+0000","last_became_peered":"2023-12-08T08:17:40.776121+0000","last_unstale":"2023-12-08T08:17:57.775841+0000","last_undegraded":"2023-12-08T08:17:57.775841+0000","last_fullsized":"2023-12-08T08:17:57.775841+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:21:18.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254783+0000","last_change":"2023-12-08T08:17:57.794255+0000","last_active":"2023-12-08T08:17:59.254783+0000","last_peered":"2023-12-08T08:17:59.254783+0000","last_clean":"2023-12-08T08:17:59.254783+0000","last_became_active":"2023-12-08T08:17:57.793966+0000","last_became_peered":"2023-12-08T08:17:57.793966+0000","last_unstale":"2023-12-08T08:17:59.254783+0000","last_undegraded":"2023-12-08T08:17:59.254783+0000","last_fullsized":"2023-12-08T08:17:59.254783+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:43.895411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788832+0000","last_change":"2023-12-08T08:17:56.792427+0000","last_active":"2023-12-08T08:17:57.788832+0000","last_peered":"2023-12-08T08:17:57.788832+0000","last_clean":"2023-12-08T08:17:57.788832+0000","last_became_active":"2023-12-08T08:17:56.792047+0000","last_became_peered":"2023-12-08T08:17:56.792047+0000","last_unstale":"2023-12-08T08:17:57.788832+0000","last_undegraded":"2023-12-08T08:17:57.788832+0000","last_fullsized":"2023-12-08T08:17:57.788832+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:17:20.077911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.775959+0000","last_change":"2023-12-08T08:17:41.812656+0000","last_active":"2023-12-08T08:17:57.775959+0000","last_peered":"2023-12-08T08:17:57.775959+0000","last_clean":"2023-12-08T08:17:57.775959+0000","last_became_active":"2023-12-08T08:17:41.812058+0000","last_became_peered":"2023-12-08T08:17:41.812058+0000","last_unstale":"2023-12-08T08:17:57.775959+0000","last_undegraded":"2023-12-08T08:17:57.775959+0000","last_fullsized":"2023-12-08T08:17:57.775959+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:14.424829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787037+0000","last_change":"2023-12-08T08:17:40.784796+0000","last_active":"2023-12-08T08:17:57.787037+0000","last_peered":"2023-12-08T08:17:57.787037+0000","last_clean":"2023-12-08T08:17:57.787037+0000","last_became_active":"2023-12-08T08:17:40.784492+0000","last_became_peered":"2023-12-08T08:17:40.784492+0000","last_unstale":"2023-12-08T08:17:57.787037+0000","last_undegraded":"2023-12-08T08:17:57.787037+0000","last_fullsized":"2023-12-08T08:17:57.787037+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.254590+0000","last_change":"2023-12-08T08:17:57.798121+0000","last_active":"2023-12-08T08:17:59.254590+0000","last_peered":"2023-12-08T08:17:59.254590+0000","last_clean":"2023-12-08T08:17:59.254590+0000","last_became_active":"2023-12-08T08:17:57.797862+0000","last_became_peered":"2023-12-08T08:17:57.797862+0000","last_unstale":"2023-12-08T08:17:59.254590+0000","last_undegraded":"2023-12-08T08:17:59.254590+0000","last_fullsized":"2023-12-08T08:17:59.254590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:02.404414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788805+0000","last_change":"2023-12-08T08:17:56.791954+0000","last_active":"2023-12-08T08:17:57.788805+0000","last_peered":"2023-12-08T08:17:57.788805+0000","last_clean":"2023-12-08T08:17:57.788805+0000","last_became_active":"2023-12-08T08:17:56.791571+0000","last_became_peered":"2023-12-08T08:17:56.791571+0000","last_unstale":"2023-12-08T08:17:57.788805+0000","last_undegraded":"2023-12-08T08:17:57.788805+0000","last_fullsized":"2023-12-08T08:17:57.788805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.787479+0000","last_change":"2023-12-08T08:17:41.807274+0000","last_active":"2023-12-08T08:17:57.787479+0000","last_peered":"2023-12-08T08:17:57.787479+0000","last_clean":"2023-12-08T08:17:57.787479+0000","last_became_active":"2023-12-08T08:17:41.806061+0000","last_became_peered":"2023-12-08T08:17:41.806061+0000","last_unstale":"2023-12-08T08:17:57.787479+0000","last_undegraded":"2023-12-08T08:17:57.787479+0000","last_fullsized":"2023-12-08T08:17:57.787479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:23.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786686+0000","last_change":"2023-12-08T08:17:40.788482+0000","last_active":"2023-12-08T08:17:57.786686+0000","last_peered":"2023-12-08T08:17:57.786686+0000","last_clean":"2023-12-08T08:17:57.786686+0000","last_became_active":"2023-12-08T08:17:40.788149+0000","last_became_peered":"2023-12-08T08:17:40.788149+0000","last_unstale":"2023-12-08T08:17:57.786686+0000","last_undegraded":"2023-12-08T08:17:57.786686+0000","last_fullsized":"2023-12-08T08:17:57.786686+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:48:34.666831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252338+0000","last_change":"2023-12-08T08:17:57.804851+0000","last_active":"2023-12-08T08:17:59.252338+0000","last_peered":"2023-12-08T08:17:59.252338+0000","last_clean":"2023-12-08T08:17:59.252338+0000","last_became_active":"2023-12-08T08:17:57.804281+0000","last_became_peered":"2023-12-08T08:17:57.804281+0000","last_unstale":"2023-12-08T08:17:59.252338+0000","last_undegraded":"2023-12-08T08:17:59.252338+0000","last_fullsized":"2023-12-08T08:17:59.252338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:09:13.119638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822227+0000","last_change":"2023-12-08T08:17:56.777768+0000","last_active":"2023-12-08T08:17:57.822227+0000","last_peered":"2023-12-08T08:17:57.822227+0000","last_clean":"2023-12-08T08:17:57.822227+0000","last_became_active":"2023-12-08T08:17:56.776405+0000","last_became_peered":"2023-12-08T08:17:56.776405+0000","last_unstale":"2023-12-08T08:17:57.822227+0000","last_undegraded":"2023-12-08T08:17:57.822227+0000","last_fullsized":"2023-12-08T08:17:57.822227+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:36.931349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768150+0000","last_change":"2023-12-08T08:17:41.821582+0000","last_active":"2023-12-08T08:17:57.768150+0000","last_peered":"2023-12-08T08:17:57.768150+0000","last_clean":"2023-12-08T08:17:57.768150+0000","last_became_active":"2023-12-08T08:17:41.821283+0000","last_became_peered":"2023-12-08T08:17:41.821283+0000","last_unstale":"2023-12-08T08:17:57.768150+0000","last_undegraded":"2023-12-08T08:17:57.768150+0000","last_fullsized":"2023-12-08T08:17:57.768150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.788261+0000","last_change":"2023-12-08T08:17:40.789720+0000","last_active":"2023-12-08T08:17:57.788261+0000","last_peered":"2023-12-08T08:17:57.788261+0000","last_clean":"2023-12-08T08:17:57.788261+0000","last_became_active":"2023-12-08T08:17:40.788144+0000","last_became_peered":"2023-12-08T08:17:40.788144+0000","last_unstale":"2023-12-08T08:17:57.788261+0000","last_undegraded":"2023-12-08T08:17:57.788261+0000","last_fullsized":"2023-12-08T08:17:57.788261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788918+0000","last_change":"2023-12-08T08:17:57.801851+0000","last_active":"2023-12-08T08:17:58.788918+0000","last_peered":"2023-12-08T08:17:58.788918+0000","last_clean":"2023-12-08T08:17:58.788918+0000","last_became_active":"2023-12-08T08:17:57.800540+0000","last_became_peered":"2023-12-08T08:17:57.800540+0000","last_unstale":"2023-12-08T08:17:58.788918+0000","last_undegraded":"2023-12-08T08:17:58.788918+0000","last_fullsized":"2023-12-08T08:17:58.788918+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:19:07.046418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.784349+0000","last_change":"2023-12-08T08:17:56.797511+0000","last_active":"2023-12-08T08:17:57.784349+0000","last_peered":"2023-12-08T08:17:57.784349+0000","last_clean":"2023-12-08T08:17:57.784349+0000","last_became_active":"2023-12-08T08:17:56.796361+0000","last_became_peered":"2023-12-08T08:17:56.796361+0000","last_unstale":"2023-12-08T08:17:57.784349+0000","last_undegraded":"2023-12-08T08:17:57.784349+0000","last_fullsized":"2023-12-08T08:17:57.784349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:25:15.642356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792675+0000","last_change":"2023-12-08T08:17:41.813334+0000","last_active":"2023-12-08T08:17:57.792675+0000","last_peered":"2023-12-08T08:17:57.792675+0000","last_clean":"2023-12-08T08:17:57.792675+0000","last_became_active":"2023-12-08T08:17:41.812911+0000","last_became_peered":"2023-12-08T08:17:41.812911+0000","last_unstale":"2023-12-08T08:17:57.792675+0000","last_undegraded":"2023-12-08T08:17:57.792675+0000","last_fullsized":"2023-12-08T08:17:57.792675+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:47:12.987508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.793634+0000","last_change":"2023-12-08T08:17:40.789668+0000","last_active":"2023-12-08T08:17:57.793634+0000","last_peered":"2023-12-08T08:17:57.793634+0000","last_clean":"2023-12-08T08:17:57.793634+0000","last_became_active":"2023-12-08T08:17:40.789385+0000","last_became_peered":"2023-12-08T08:17:40.789385+0000","last_unstale":"2023-12-08T08:17:57.793634+0000","last_undegraded":"2023-12-08T08:17:57.793634+0000","last_fullsized":"2023-12-08T08:17:57.793634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:17:14.790104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253493+0000","last_change":"2023-12-08T08:17:57.793470+0000","last_active":"2023-12-08T08:17:59.253493+0000","last_peered":"2023-12-08T08:17:59.253493+0000","last_clean":"2023-12-08T08:17:59.253493+0000","last_became_active":"2023-12-08T08:17:57.793211+0000","last_became_peered":"2023-12-08T08:17:57.793211+0000","last_unstale":"2023-12-08T08:17:59.253493+0000","last_undegraded":"2023-12-08T08:17:59.253493+0000","last_fullsized":"2023-12-08T08:17:59.253493+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:08:32.561030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786820+0000","last_change":"2023-12-08T08:17:56.795117+0000","last_active":"2023-12-08T08:17:57.786820+0000","last_peered":"2023-12-08T08:17:57.786820+0000","last_clean":"2023-12-08T08:17:57.786820+0000","last_became_active":"2023-12-08T08:17:56.794822+0000","last_became_peered":"2023-12-08T08:17:56.794822+0000","last_unstale":"2023-12-08T08:17:57.786820+0000","last_undegraded":"2023-12-08T08:17:57.786820+0000","last_fullsized":"2023-12-08T08:17:57.786820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:32:56.964958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.760270+0000","last_change":"2023-12-08T08:17:41.821547+0000","last_active":"2023-12-08T08:17:57.760270+0000","last_peered":"2023-12-08T08:17:57.760270+0000","last_clean":"2023-12-08T08:17:57.760270+0000","last_became_active":"2023-12-08T08:17:41.821237+0000","last_became_peered":"2023-12-08T08:17:41.821237+0000","last_unstale":"2023-12-08T08:17:57.760270+0000","last_undegraded":"2023-12-08T08:17:57.760270+0000","last_fullsized":"2023-12-08T08:17:57.760270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:26.299694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790684+0000","last_change":"2023-12-08T08:17:40.786785+0000","last_active":"2023-12-08T08:17:57.790684+0000","last_peered":"2023-12-08T08:17:57.790684+0000","last_clean":"2023-12-08T08:17:57.790684+0000","last_became_active":"2023-12-08T08:17:40.786500+0000","last_became_peered":"2023-12-08T08:17:40.786500+0000","last_unstale":"2023-12-08T08:17:57.790684+0000","last_undegraded":"2023-12-08T08:17:57.790684+0000","last_fullsized":"2023-12-08T08:17:57.790684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:34:05.718114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.788355+0000","last_change":"2023-12-08T08:17:57.795923+0000","last_active":"2023-12-08T08:17:58.788355+0000","last_peered":"2023-12-08T08:17:58.788355+0000","last_clean":"2023-12-08T08:17:58.788355+0000","last_became_active":"2023-12-08T08:17:57.795662+0000","last_became_peered":"2023-12-08T08:17:57.795662+0000","last_unstale":"2023-12-08T08:17:58.788355+0000","last_undegraded":"2023-12-08T08:17:58.788355+0000","last_fullsized":"2023-12-08T08:17:58.788355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:02:39.558687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"64'2","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.822877+0000","last_change":"2023-12-08T08:17:56.768920+0000","last_active":"2023-12-08T08:17:57.822877+0000","last_peered":"2023-12-08T08:17:57.822877+0000","last_clean":"2023-12-08T08:17:57.822877+0000","last_became_active":"2023-12-08T08:17:56.768205+0000","last_became_peered":"2023-12-08T08:17:56.768205+0000","last_unstale":"2023-12-08T08:17:57.822877+0000","last_undegraded":"2023-12-08T08:17:57.822877+0000","last_fullsized":"2023-12-08T08:17:57.822877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:53:25.507830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.790522+0000","last_change":"2023-12-08T08:17:41.821530+0000","last_active":"2023-12-08T08:17:57.790522+0000","last_peered":"2023-12-08T08:17:57.790522+0000","last_clean":"2023-12-08T08:17:57.790522+0000","last_became_active":"2023-12-08T08:17:41.821164+0000","last_became_peered":"2023-12-08T08:17:41.821164+0000","last_unstale":"2023-12-08T08:17:57.790522+0000","last_undegraded":"2023-12-08T08:17:57.790522+0000","last_fullsized":"2023-12-08T08:17:57.790522+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:58.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.792902+0000","last_change":"2023-12-08T08:17:40.790660+0000","last_active":"2023-12-08T08:17:57.792902+0000","last_peered":"2023-12-08T08:17:57.792902+0000","last_clean":"2023-12-08T08:17:57.792902+0000","last_became_active":"2023-12-08T08:17:40.790401+0000","last_became_peered":"2023-12-08T08:17:40.790401+0000","last_unstale":"2023-12-08T08:17:57.792902+0000","last_undegraded":"2023-12-08T08:17:57.792902+0000","last_fullsized":"2023-12-08T08:17:57.792902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:12.835564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.253156+0000","last_change":"2023-12-08T08:17:57.792736+0000","last_active":"2023-12-08T08:17:59.253156+0000","last_peered":"2023-12-08T08:17:59.253156+0000","last_clean":"2023-12-08T08:17:59.253156+0000","last_became_active":"2023-12-08T08:17:57.792475+0000","last_became_peered":"2023-12-08T08:17:57.792475+0000","last_unstale":"2023-12-08T08:17:59.253156+0000","last_undegraded":"2023-12-08T08:17:59.253156+0000","last_fullsized":"2023-12-08T08:17:59.253156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:43.098968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:58.777932+0000","last_change":"2023-12-08T08:17:56.779410+0000","last_active":"2023-12-08T08:17:58.777932+0000","last_peered":"2023-12-08T08:17:58.777932+0000","last_clean":"2023-12-08T08:17:58.777932+0000","last_became_active":"2023-12-08T08:17:56.779079+0000","last_became_peered":"2023-12-08T08:17:56.779079+0000","last_unstale":"2023-12-08T08:17:58.777932+0000","last_undegraded":"2023-12-08T08:17:58.777932+0000","last_fullsized":"2023-12-08T08:17:58.777932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:14:15.692021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.769271+0000","last_change":"2023-12-08T08:17:41.812761+0000","last_active":"2023-12-08T08:17:57.769271+0000","last_peered":"2023-12-08T08:17:57.769271+0000","last_clean":"2023-12-08T08:17:57.769271+0000","last_became_active":"2023-12-08T08:17:41.811411+0000","last_became_peered":"2023-12-08T08:17:41.811411+0000","last_unstale":"2023-12-08T08:17:57.769271+0000","last_undegraded":"2023-12-08T08:17:57.769271+0000","last_fullsized":"2023-12-08T08:17:57.769271+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:07.775408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.782922+0000","last_change":"2023-12-08T08:17:40.782932+0000","last_active":"2023-12-08T08:17:57.782922+0000","last_peered":"2023-12-08T08:17:57.782922+0000","last_clean":"2023-12-08T08:17:57.782922+0000","last_became_active":"2023-12-08T08:17:40.781680+0000","last_became_peered":"2023-12-08T08:17:40.781680+0000","last_unstale":"2023-12-08T08:17:57.782922+0000","last_undegraded":"2023-12-08T08:17:57.782922+0000","last_fullsized":"2023-12-08T08:17:57.782922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:52:42.290185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256297+0000","last_change":"2023-12-08T08:17:57.801602+0000","last_active":"2023-12-08T08:17:59.256297+0000","last_peered":"2023-12-08T08:17:59.256297+0000","last_clean":"2023-12-08T08:17:59.256297+0000","last_became_active":"2023-12-08T08:17:57.801343+0000","last_became_peered":"2023-12-08T08:17:57.801343+0000","last_unstale":"2023-12-08T08:17:59.256297+0000","last_undegraded":"2023-12-08T08:17:59.256297+0000","last_fullsized":"2023-12-08T08:17:59.256297+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:10:24.056900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.773893+0000","last_change":"2023-12-08T08:17:56.791471+0000","last_active":"2023-12-08T08:17:57.773893+0000","last_peered":"2023-12-08T08:17:57.773893+0000","last_clean":"2023-12-08T08:17:57.773893+0000","last_became_active":"2023-12-08T08:17:56.791079+0000","last_became_peered":"2023-12-08T08:17:56.791079+0000","last_unstale":"2023-12-08T08:17:57.773893+0000","last_undegraded":"2023-12-08T08:17:57.773893+0000","last_fullsized":"2023-12-08T08:17:57.773893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:22.747918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.767130+0000","last_change":"2023-12-08T08:17:41.805486+0000","last_active":"2023-12-08T08:17:57.767130+0000","last_peered":"2023-12-08T08:17:57.767130+0000","last_clean":"2023-12-08T08:17:57.767130+0000","last_became_active":"2023-12-08T08:17:41.805198+0000","last_became_peered":"2023-12-08T08:17:41.805198+0000","last_unstale":"2023-12-08T08:17:57.767130+0000","last_undegraded":"2023-12-08T08:17:57.767130+0000","last_fullsized":"2023-12-08T08:17:57.767130+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:09:39.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789763+0000","last_change":"2023-12-08T08:17:40.788361+0000","last_active":"2023-12-08T08:17:57.789763+0000","last_peered":"2023-12-08T08:17:57.789763+0000","last_clean":"2023-12-08T08:17:57.789763+0000","last_became_active":"2023-12-08T08:17:40.788086+0000","last_became_peered":"2023-12-08T08:17:40.788086+0000","last_unstale":"2023-12-08T08:17:57.789763+0000","last_undegraded":"2023-12-08T08:17:57.789763+0000","last_fullsized":"2023-12-08T08:17:57.789763+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:14.515779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255782+0000","last_change":"2023-12-08T08:17:57.797287+0000","last_active":"2023-12-08T08:17:59.255782+0000","last_peered":"2023-12-08T08:17:59.255782+0000","last_clean":"2023-12-08T08:17:59.255782+0000","last_became_active":"2023-12-08T08:17:57.796961+0000","last_became_peered":"2023-12-08T08:17:57.796961+0000","last_unstale":"2023-12-08T08:17:59.255782+0000","last_undegraded":"2023-12-08T08:17:59.255782+0000","last_fullsized":"2023-12-08T08:17:59.255782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:35.292501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.797240+0000","last_change":"2023-12-08T08:17:56.772809+0000","last_active":"2023-12-08T08:17:57.797240+0000","last_peered":"2023-12-08T08:17:57.797240+0000","last_clean":"2023-12-08T08:17:57.797240+0000","last_became_active":"2023-12-08T08:17:56.772556+0000","last_became_peered":"2023-12-08T08:17:56.772556+0000","last_unstale":"2023-12-08T08:17:57.797240+0000","last_undegraded":"2023-12-08T08:17:57.797240+0000","last_fullsized":"2023-12-08T08:17:57.797240+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:48:41.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.778964+0000","last_change":"2023-12-08T08:17:41.810552+0000","last_active":"2023-12-08T08:17:57.778964+0000","last_peered":"2023-12-08T08:17:57.778964+0000","last_clean":"2023-12-08T08:17:57.778964+0000","last_became_active":"2023-12-08T08:17:41.810234+0000","last_became_peered":"2023-12-08T08:17:41.810234+0000","last_unstale":"2023-12-08T08:17:57.778964+0000","last_undegraded":"2023-12-08T08:17:57.778964+0000","last_fullsized":"2023-12-08T08:17:57.778964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:44:57.796346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.786930+0000","last_change":"2023-12-08T08:17:40.775146+0000","last_active":"2023-12-08T08:17:57.786930+0000","last_peered":"2023-12-08T08:17:57.786930+0000","last_clean":"2023-12-08T08:17:57.786930+0000","last_became_active":"2023-12-08T08:17:40.774771+0000","last_became_peered":"2023-12-08T08:17:40.774771+0000","last_unstale":"2023-12-08T08:17:57.786930+0000","last_undegraded":"2023-12-08T08:17:57.786930+0000","last_fullsized":"2023-12-08T08:17:57.786930+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:02:02.842080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.252730+0000","last_change":"2023-12-08T08:17:57.792409+0000","last_active":"2023-12-08T08:17:59.252730+0000","last_peered":"2023-12-08T08:17:59.252730+0000","last_clean":"2023-12-08T08:17:59.252730+0000","last_became_active":"2023-12-08T08:17:57.792061+0000","last_became_peered":"2023-12-08T08:17:57.792061+0000","last_unstale":"2023-12-08T08:17:59.252730+0000","last_undegraded":"2023-12-08T08:17:59.252730+0000","last_fullsized":"2023-12-08T08:17:59.252730+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:01.746863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.773995+0000","last_change":"2023-12-08T08:17:56.798843+0000","last_active":"2023-12-08T08:17:57.773995+0000","last_peered":"2023-12-08T08:17:57.773995+0000","last_clean":"2023-12-08T08:17:57.773995+0000","last_became_active":"2023-12-08T08:17:56.798505+0000","last_became_peered":"2023-12-08T08:17:56.798505+0000","last_unstale":"2023-12-08T08:17:57.773995+0000","last_undegraded":"2023-12-08T08:17:57.773995+0000","last_fullsized":"2023-12-08T08:17:57.773995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:53.581769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.781926+0000","last_change":"2023-12-08T08:17:41.794615+0000","last_active":"2023-12-08T08:17:57.781926+0000","last_peered":"2023-12-08T08:17:57.781926+0000","last_clean":"2023-12-08T08:17:57.781926+0000","last_became_active":"2023-12-08T08:17:41.794242+0000","last_became_peered":"2023-12-08T08:17:41.794242+0000","last_unstale":"2023-12-08T08:17:57.781926+0000","last_undegraded":"2023-12-08T08:17:57.781926+0000","last_fullsized":"2023-12-08T08:17:57.781926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:02.769189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.783663+0000","last_change":"2023-12-08T08:17:40.785505+0000","last_active":"2023-12-08T08:17:57.783663+0000","last_peered":"2023-12-08T08:17:57.783663+0000","last_clean":"2023-12-08T08:17:57.783663+0000","last_became_active":"2023-12-08T08:17:40.784054+0000","last_became_peered":"2023-12-08T08:17:40.784054+0000","last_unstale":"2023-12-08T08:17:57.783663+0000","last_undegraded":"2023-12-08T08:17:57.783663+0000","last_fullsized":"2023-12-08T08:17:57.783663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:27:06.755483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.255216+0000","last_change":"2023-12-08T08:17:57.787379+0000","last_active":"2023-12-08T08:17:59.255216+0000","last_peered":"2023-12-08T08:17:59.255216+0000","last_clean":"2023-12-08T08:17:59.255216+0000","last_became_active":"2023-12-08T08:17:57.778356+0000","last_became_peered":"2023-12-08T08:17:57.778356+0000","last_unstale":"2023-12-08T08:17:59.255216+0000","last_undegraded":"2023-12-08T08:17:59.255216+0000","last_fullsized":"2023-12-08T08:17:59.255216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:42:40.346477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779867+0000","last_change":"2023-12-08T08:17:56.780631+0000","last_active":"2023-12-08T08:17:57.779867+0000","last_peered":"2023-12-08T08:17:57.779867+0000","last_clean":"2023-12-08T08:17:57.779867+0000","last_became_active":"2023-12-08T08:17:56.780250+0000","last_became_peered":"2023-12-08T08:17:56.780250+0000","last_unstale":"2023-12-08T08:17:57.779867+0000","last_undegraded":"2023-12-08T08:17:57.779867+0000","last_fullsized":"2023-12-08T08:17:57.779867+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:36:12.440569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.763114+0000","last_change":"2023-12-08T08:17:41.812661+0000","last_active":"2023-12-08T08:17:57.763114+0000","last_peered":"2023-12-08T08:17:57.763114+0000","last_clean":"2023-12-08T08:17:57.763114+0000","last_became_active":"2023-12-08T08:17:41.812281+0000","last_became_peered":"2023-12-08T08:17:41.812281+0000","last_unstale":"2023-12-08T08:17:57.763114+0000","last_undegraded":"2023-12-08T08:17:57.763114+0000","last_fullsized":"2023-12-08T08:17:57.763114+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:28:50.672771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.780857+0000","last_change":"2023-12-08T08:17:40.785561+0000","last_active":"2023-12-08T08:17:57.780857+0000","last_peered":"2023-12-08T08:17:57.780857+0000","last_clean":"2023-12-08T08:17:57.780857+0000","last_became_active":"2023-12-08T08:17:40.785233+0000","last_became_peered":"2023-12-08T08:17:40.785233+0000","last_unstale":"2023-12-08T08:17:57.780857+0000","last_undegraded":"2023-12-08T08:17:57.780857+0000","last_fullsized":"2023-12-08T08:17:57.780857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:41:00.817791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-08T08:17:59.256651+0000","last_change":"2023-12-08T08:17:57.808404+0000","last_active":"2023-12-08T08:17:59.256651+0000","last_peered":"2023-12-08T08:17:59.256651+0000","last_clean":"2023-12-08T08:17:59.256651+0000","last_became_active":"2023-12-08T08:17:57.808060+0000","last_became_peered":"2023-12-08T08:17:57.808060+0000","last_unstale":"2023-12-08T08:17:59.256651+0000","last_undegraded":"2023-12-08T08:17:59.256651+0000","last_fullsized":"2023-12-08T08:17:59.256651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.735537+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.735537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:57:21.087350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.789022+0000","last_change":"2023-12-08T08:17:56.792036+0000","last_active":"2023-12-08T08:17:57.789022+0000","last_peered":"2023-12-08T08:17:57.789022+0000","last_clean":"2023-12-08T08:17:57.789022+0000","last_became_active":"2023-12-08T08:17:56.791709+0000","last_became_peered":"2023-12-08T08:17:56.791709+0000","last_unstale":"2023-12-08T08:17:57.789022+0000","last_undegraded":"2023-12-08T08:17:57.789022+0000","last_fullsized":"2023-12-08T08:17:57.789022+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.721561+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.721561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:58:12.619733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.768253+0000","last_change":"2023-12-08T08:17:41.815652+0000","last_active":"2023-12-08T08:17:57.768253+0000","last_peered":"2023-12-08T08:17:57.768253+0000","last_clean":"2023-12-08T08:17:57.768253+0000","last_became_active":"2023-12-08T08:17:41.815328+0000","last_became_peered":"2023-12-08T08:17:41.815328+0000","last_unstale":"2023-12-08T08:17:57.768253+0000","last_undegraded":"2023-12-08T08:17:57.768253+0000","last_fullsized":"2023-12-08T08:17:57.768253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:40.743435+0000","last_clean_scrub_stamp":"2023-12-08T08:17:40.743435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:45:15.530088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.777933+0000","last_change":"2023-12-08T08:17:40.771504+0000","last_active":"2023-12-08T08:17:57.777933+0000","last_peered":"2023-12-08T08:17:57.777933+0000","last_clean":"2023-12-08T08:17:57.777933+0000","last_became_active":"2023-12-08T08:17:40.771138+0000","last_became_peered":"2023-12-08T08:17:40.771138+0000","last_unstale":"2023-12-08T08:17:57.777933+0000","last_undegraded":"2023-12-08T08:17:57.777933+0000","last_fullsized":"2023-12-08T08:17:57.777933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:39.729126+0000","last_clean_scrub_stamp":"2023-12-08T08:17:39.729126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:37:44.740453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-08T08:17:57.779890+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:17:57.779890+0000","last_peered":"2023-12-08T08:17:57.779890+0000","last_clean":"2023-12-08T08:17:57.779890+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:17:57.779890+0000","last_undegraded":"2023-12-08T08:17:57.779890+0000","last_fullsized":"2023-12-08T08:17:57.779890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":954866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.353}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0609999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.548},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.667}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.605},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.7569999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.8380000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.8979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":365346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.875},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.294}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.98999999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.05}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":1.391},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.25}]}]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":363756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.1719999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.254},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.5}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.405}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.544},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4730000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.1200000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.605},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.5269999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":368523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.034},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":1.123}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.5269999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.2110000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.331}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.571},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.254}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.466},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.4239999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":364282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.872}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":1.147},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2350000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.403}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.478},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.272}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.3680000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.635}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":364442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.292}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":1.1950000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.468}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.524},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.421}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.5669999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.619},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2509999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":367683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":1.04},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.151}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.212}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.337},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":1.379}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.123},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":1.4330000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.657},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.579},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.2849999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.8200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1376256,"data_stored":954068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.014},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.6060000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1879999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.419},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.478}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.268},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.2330000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.552}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:07.971 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:18:07.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:18:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.247+0000 7fb379872640 1 Processor -- start 2023-12-08T08:18:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.247+0000 7fb379872640 1 -- start start 2023-12-08T08:18:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb379872640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb374154ce0 0x7fb37406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb379872640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb379872640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb374155230 con 0x7fb3740c64f0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb379872640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3740c45b0 con 0x7fb374154ce0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb379872640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c4890 con 0x7fb374157da0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb373fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb374154ce0 0x7fb37406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb373fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb374154ce0 0x7fb37406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35530/0 (socket says 172.21.15.45:35530) 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.249+0000 7fb373fff640 1 -- 172.21.15.45:0/2798161484 learned_addr learned my addr 172.21.15.45:0/2798161484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb379071640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb373fff640 1 -- 172.21.15.45:0/2798161484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 msgr2=0x7fb374158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb373fff640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb373fff640 1 -- 172.21.15.45:0/2798161484 >> v1:172.21.15.114:6789/0 conn(0x7fb3740c64f0 legacy=0x7fb37413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb373fff640 1 -- 172.21.15.45:0/2798161484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740c4b70 con 0x7fb374154ce0 2023-12-08T08:18:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.250+0000 7fb379071640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.251+0000 7fb373fff640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb374154ce0 0x7fb37406c400 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb360009870 tx=0x7fb36002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb1bc415eb6a094 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.251+0000 7fb3737fe640 1 -- 172.21.15.45:0/2798161484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360031740 con 0x7fb374154ce0 2023-12-08T08:18:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.251+0000 7fb3737fe640 1 -- 172.21.15.45:0/2798161484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3600318a0 con 0x7fb374154ce0 2023-12-08T08:18:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.251+0000 7fb3737fe640 1 -- 172.21.15.45:0/2798161484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360031c30 con 0x7fb374154ce0 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 -- 172.21.15.45:0/2798161484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb374154ce0 msgr2=0x7fb37406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb374154ce0 0x7fb37406c400 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb360009870 tx=0x7fb36002b7e0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 -- 172.21.15.45:0/2798161484 shutdown_connections 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 --2- 172.21.15.45:0/2798161484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb374154ce0 0x7fb37406c400 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 -- 172.21.15.45:0/2798161484 >> 172.21.15.45:0/2798161484 conn(0x7fb3740661f0 msgr2=0x7fb374066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 -- 172.21.15.45:0/2798161484 shutdown_connections 2023-12-08T08:18:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.252+0000 7fb379872640 1 -- 172.21.15.45:0/2798161484 wait complete. 2023-12-08T08:18:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.254+0000 7fb379872640 1 Processor -- start 2023-12-08T08:18:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.254+0000 7fb379872640 1 -- start start 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb374154ce0 0x7fb3741e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3741eabf0 con 0x7fb3740c64f0 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740a9850 con 0x7fb374154ce0 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb379872640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740acab0 con 0x7fb374157da0 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.255+0000 7fb378870640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35536/0 (socket says 172.21.15.45:35536) 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 -- 172.21.15.45:0/2741404934 learned_addr learned my addr 172.21.15.45:0/2741404934 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 -- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 msgr2=0x7fb374153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 -- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb374154ce0 msgr2=0x7fb3741e0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb374154ce0 0x7fb3741e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 -- 172.21.15.45:0/2741404934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600094d0 con 0x7fb3740c64f0 2023-12-08T08:18:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.256+0000 7fb378870640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c430 tx=0x7fb36800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.257+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011790 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.257+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3680118f0 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.257+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011ce0 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.257+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3740ab4b0 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.257+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3740aba70 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.258+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3740743e0 con 0x7fb3740c64f0 2023-12-08T08:18:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.259+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb36801c460 con 0x7fb3740c64f0 2023-12-08T08:18:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.260+0000 7fb3717fa640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 0x7fb35806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.260+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb368089ac0 con 0x7fb3740c64f0 2023-12-08T08:18:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.260+0000 7fb373fff640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 0x7fb35806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.261+0000 7fb373fff640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 0x7fb35806d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb360035000 tx=0x7fb360030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.265+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb368054650 con 0x7fb3740c64f0 2023-12-08T08:18:08.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.535+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fb3740c7b60 con 0x7fb3740c64f0 2023-12-08T08:18:08.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.539+0000 7fb3717fa640 1 -- 172.21.15.45:0/2741404934 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7fb368087e60 con 0x7fb3740c64f0 2023-12-08T08:18:08.541 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-08T08:18:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA== 2023-12-08T08:18:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:18:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:18:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:18:08.542 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.1 2023-12-08T08:18:08.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 msgr2=0x7fb35806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 0x7fb35806d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb360035000 tx=0x7fb360030000 comp rx=0 tx=0).stop 2023-12-08T08:18:08.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 msgr2=0x7fb374150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb36800c430 tx=0x7fb36800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 shutdown_connections 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb35806ae70 0x7fb35806d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb374157da0 0x7fb374153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb374154ce0 0x7fb3741e0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 --2- 172.21.15.45:0/2741404934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3740c64f0 0x7fb374150ce0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 >> 172.21.15.45:0/2741404934 conn(0x7fb3740661f0 msgr2=0x7fb374156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 shutdown_connections 2023-12-08T08:18:08.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.542+0000 7fb379872640 1 -- 172.21.15.45:0/2741404934 wait complete. 2023-12-08T08:18:08.564 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:08.564 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:08.624 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:08.624 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:08.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.903+0000 7f982e5f4640 1 Processor -- start 2023-12-08T08:18:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.903+0000 7f982e5f4640 1 -- start start 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982e5f4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f982814e260 0x7f98281542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982e5f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 0x7f98280a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982e5f4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280a7300 con 0x7f98280beb30 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982e5f4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98280bfb90 con 0x7f982814e260 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982e5f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280bf010 con 0x7f98280a7770 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982cdf1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98280beb30 0x7f982806c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46592/0 (socket says 172.21.15.45:46592) 2023-12-08T08:18:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.905+0000 7f982cdf1640 1 -- 172.21.15.45:0/999160119 learned_addr learned my addr 172.21.15.45:0/999160119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f982d5f2640 1 --2- 172.21.15.45:0/999160119 >> v2:172.21.15.114:3300/0 conn(0x7f982814e260 0x7f98281542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f982ddf3640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 0x7f98280a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252455954 0 0) 0x7f98280a7300 con 0x7f98280beb30 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9814003520 con 0x7f98280beb30 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748090332 0 0) 0x7f9814003520 con 0x7f98280beb30 2023-12-08T08:18:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 msgr2=0x7f98280a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 0x7f98280a7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 >> v2:172.21.15.114:3300/0 conn(0x7f982814e260 msgr2=0x7f98281542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 --2- 172.21.15.45:0/999160119 >> v2:172.21.15.114:3300/0 conn(0x7f982814e260 0x7f98281542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280bf2f0 con 0x7f98280beb30 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9818001670 con 0x7f98280beb30 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 >> v1:172.21.15.45:6789/0 conn(0x7f98280beb30 legacy=0x7f982806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9814003970 0x7f9814003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 0x7f9814005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280bfb90 con 0x7f9814003970 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280bf010 con 0x7f98140047c0 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.906+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981400b980 con 0x7f98280a7770 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9814003970 0x7f9814003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 -- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 msgr2=0x7f9814005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98280a7770 0x7f9814005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 -- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98140047c0 msgr2=0x7f9814004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982cdf1640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982d5f2640 1 -- 172.21.15.45:0/999160119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814003520 con 0x7f9814003970 2023-12-08T08:18:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.907+0000 7f982cdf1640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.908+0000 7f982d5f2640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9814003970 0x7f9814003d90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9824009ac0 tx=0x7f98140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dff97ec76a05049 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402c710 con 0x7f9814003970 2023-12-08T08:18:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982402c870 con 0x7f9814003970 2023-12-08T08:18:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f981ffff640 1 -- 172.21.15.45:0/999160119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402cc00 con 0x7f9814003970 2023-12-08T08:18:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 -- 172.21.15.45:0/999160119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9814003970 msgr2=0x7f9814003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 --2- 172.21.15.45:0/999160119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9814003970 0x7f9814003d90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9824009ac0 tx=0x7f98140057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982ddf3640 1 -- 172.21.15.45:0/999160119 reap_dead start 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 -- 172.21.15.45:0/999160119 shutdown_connections 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 -- 172.21.15.45:0/999160119 >> 172.21.15.45:0/999160119 conn(0x7f98280c5780 msgr2=0x7f98280c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 -- 172.21.15.45:0/999160119 shutdown_connections 2023-12-08T08:18:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.909+0000 7f982e5f4640 1 -- 172.21.15.45:0/999160119 wait complete. 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.911+0000 7f982e5f4640 1 Processor -- start 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.911+0000 7f982e5f4640 1 -- start start 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9814003970 0x7f98281539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f982806fdb0 0x7f98281ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828147710 con 0x7f982806f960 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828070660 con 0x7f9814003970 2023-12-08T08:18:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.912+0000 7f982e5f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280a7ca0 con 0x7f982806fdb0 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35554/0 (socket says 172.21.15.45:35554) 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 -- 172.21.15.45:0/4001612732 learned_addr learned my addr 172.21.15.45:0/4001612732 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982d5f2640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9814003970 0x7f98281539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982ddf3640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f982806fdb0 0x7f98281ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 -- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f982806fdb0 msgr2=0x7f98281ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f982806fdb0 0x7f98281ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 -- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9814003970 msgr2=0x7f98281539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9814003970 0x7f98281539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.913+0000 7f982cdf1640 1 -- 172.21.15.45:0/4001612732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98281ea2d0 con 0x7f982806f960 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f982cdf1640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f981800d8b0 tx=0x7f981800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180074e0 con 0x7f982806f960 2023-12-08T08:18:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818007640 con 0x7f982806f960 2023-12-08T08:18:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180049e0 con 0x7f982806f960 2023-12-08T08:18:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98281ea570 con 0x7f982806f960 2023-12-08T08:18:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.914+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828153ee0 con 0x7f982806f960 2023-12-08T08:18:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.915+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98280743e0 con 0x7f982806f960 2023-12-08T08:18:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.916+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9818004b40 con 0x7f982806f960 2023-12-08T08:18:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.917+0000 7f981dffb640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.917+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f98180894b0 con 0x7f982806f960 2023-12-08T08:18:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.917+0000 7f982d5f2640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.918+0000 7f982d5f2640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 0x7f980c06d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9824036000 tx=0x7f9824030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:08.922+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9818054040 con 0x7f982806f960 2023-12-08T08:18:09.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.118+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f982806d650 con 0x7f982806f960 2023-12-08T08:18:09.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.121+0000 7f981dffb640 1 -- 172.21.15.45:0/4001612732 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f9818057660 con 0x7f982806f960 2023-12-08T08:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 msgr2=0x7f980c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 0x7f980c06d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9824036000 tx=0x7f9824030000 comp rx=0 tx=0).stop 2023-12-08T08:18:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 msgr2=0x7f98281e6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f981800d8b0 tx=0x7f981800dd70 comp rx=0 tx=0).stop 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 shutdown_connections 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f980c06ae40 0x7f980c06d300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f982806fdb0 0x7f98281ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982806f960 0x7f98281e6bc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.123+0000 7f982e5f4640 1 --2- 172.21.15.45:0/4001612732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9814003970 0x7f98281539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.124+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 >> 172.21.15.45:0/4001612732 conn(0x7f98280c5780 msgr2=0x7f98280a5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.124+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 shutdown_connections 2023-12-08T08:18:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.124+0000 7f982e5f4640 1 -- 172.21.15.45:0/4001612732 wait complete. 2023-12-08T08:18:09.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:39.667136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:40.266994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:17:55.154580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:17:56.265883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:09.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.373+0000 7fb855175640 1 Processor -- start 2023-12-08T08:18:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.374+0000 7fb855175640 1 -- start start 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8500c3e50 0x7fb85006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb850152e00 0x7fb850155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb850155c40 0x7fb8500a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb850152110 con 0x7fb850152e00 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85014fbb0 con 0x7fb850155c40 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.375+0000 7fb855175640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c7520 con 0x7fb8500c3e50 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.376+0000 7fb84f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb850152e00 0x7fb850155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.376+0000 7fb84f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb850152e00 0x7fb850155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35560/0 (socket says 172.21.15.45:35560) 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.376+0000 7fb84f7fe640 1 -- 172.21.15.45:0/1609883204 learned_addr learned my addr 172.21.15.45:0/1609883204 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.376+0000 7fb84ffff640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8500c3e50 0x7fb85006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.376+0000 7fb854974640 1 --2- 172.21.15.45:0/1609883204 >> v2:172.21.15.114:3300/0 conn(0x7fb850155c40 0x7fb8500a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.377+0000 7fb84f7fe640 1 -- 172.21.15.45:0/1609883204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8500c3e50 msgr2=0x7fb85006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.377+0000 7fb84f7fe640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8500c3e50 0x7fb85006f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.377+0000 7fb84f7fe640 1 -- 172.21.15.45:0/1609883204 >> v2:172.21.15.114:3300/0 conn(0x7fb850155c40 msgr2=0x7fb8500a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.377+0000 7fb84f7fe640 1 --2- 172.21.15.45:0/1609883204 >> v2:172.21.15.114:3300/0 conn(0x7fb850155c40 0x7fb8500a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.377+0000 7fb84f7fe640 1 -- 172.21.15.45:0/1609883204 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850152320 con 0x7fb850152e00 2023-12-08T08:18:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.378+0000 7fb84f7fe640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850152e00 0x7fb850155700 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb8500a7620 tx=0x7fb84402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c2b992d7409c0a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.378+0000 7fb84effd640 1 -- 172.21.15.45:0/1609883204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844031750 con 0x7fb850152e00 2023-12-08T08:18:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.378+0000 7fb84effd640 1 -- 172.21.15.45:0/1609883204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8440318b0 con 0x7fb850152e00 2023-12-08T08:18:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.378+0000 7fb84effd640 1 -- 172.21.15.45:0/1609883204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844031c40 con 0x7fb850152e00 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 -- 172.21.15.45:0/1609883204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850152e00 msgr2=0x7fb850155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850152e00 0x7fb850155700 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb8500a7620 tx=0x7fb84402b7f0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 -- 172.21.15.45:0/1609883204 shutdown_connections 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 --2- 172.21.15.45:0/1609883204 >> v2:172.21.15.114:3300/0 conn(0x7fb850155c40 0x7fb8500a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850152e00 0x7fb850155700 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 --2- 172.21.15.45:0/1609883204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb8500c3e50 0x7fb85006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 -- 172.21.15.45:0/1609883204 >> 172.21.15.45:0/1609883204 conn(0x7fb8500c4840 msgr2=0x7fb8500c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 -- 172.21.15.45:0/1609883204 shutdown_connections 2023-12-08T08:18:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.379+0000 7fb855175640 1 -- 172.21.15.45:0/1609883204 wait complete. 2023-12-08T08:18:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.381+0000 7fb855175640 1 Processor -- start 2023-12-08T08:18:09.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.381+0000 7fb855175640 1 -- start start 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8500c3e50 0x7fb850155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 0x7fb850153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850154760 con 0x7fb850155c40 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85006ce90 con 0x7fb8500c3e50 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb855175640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85006d170 con 0x7fb850152e00 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb854974640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.382+0000 7fb854974640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35566/0 (socket says 172.21.15.45:35566) 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 -- 172.21.15.45:0/1167332951 learned_addr learned my addr 172.21.15.45:0/1167332951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb84f7fe640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 0x7fb850153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb84ffff640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8500c3e50 0x7fb850155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 -- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 msgr2=0x7fb850153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 0x7fb850153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 -- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8500c3e50 msgr2=0x7fb850155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8500c3e50 0x7fb850155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 -- 172.21.15.45:0/1167332951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440094d0 con 0x7fb850155c40 2023-12-08T08:18:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb84f7fe640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 0x7fb850153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb854974640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb84800e930 tx=0x7fb84800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848009690 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.383+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800c980 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.384+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85006d450 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.384+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800cd30 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.384+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500a8fa0 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.385+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8501553a0 con 0x7fb850155c40 2023-12-08T08:18:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.386+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb848013470 con 0x7fb850155c40 2023-12-08T08:18:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.387+0000 7fb84cff9640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 0x7fb83c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.387+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb848089e90 con 0x7fb850155c40 2023-12-08T08:18:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.387+0000 7fb84ffff640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 0x7fb83c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.388+0000 7fb84ffff640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 0x7fb83c06d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb840007380 tx=0x7fb84000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.392+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8501553a0 con 0x7fb850155c40 2023-12-08T08:18:09.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.585+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8501553a0 con 0x7fb850155c40 2023-12-08T08:18:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.586+0000 7fb84cff9640 1 -- 172.21.15.45:0/1167332951 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8501553a0 con 0x7fb850155c40 2023-12-08T08:18:09.588 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 msgr2=0x7fb83c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 0x7fb83c06d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb840007380 tx=0x7fb84000b040 comp rx=0 tx=0).stop 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 msgr2=0x7fb8500a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb84800e930 tx=0x7fb84800edf0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 shutdown_connections 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb83c06ae40 0x7fb83c06d300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb850152e00 0x7fb850153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb850155c40 0x7fb8500a8a60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 --2- 172.21.15.45:0/1167332951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8500c3e50 0x7fb850155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 >> 172.21.15.45:0/1167332951 conn(0x7fb8500c4840 msgr2=0x7fb8500c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 shutdown_connections 2023-12-08T08:18:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.589+0000 7fb855175640 1 -- 172.21.15.45:0/1167332951 wait complete. 2023-12-08T08:18:09.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:09.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.847+0000 7f25db24b640 1 Processor -- start 2023-12-08T08:18:09.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.847+0000 7f25db24b640 1 -- start start 2023-12-08T08:18:09.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.849+0000 7f25db24b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25d4151ad0 0x7f25d40ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.849+0000 7f25db24b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d4154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.849+0000 7f25db24b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d4151eb0 con 0x7f25d40ca610 2023-12-08T08:18:09.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.849+0000 7f25db24b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d40c56a0 con 0x7f25d4151ad0 2023-12-08T08:18:09.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.849+0000 7f25db24b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40c80d0 con 0x7f25d4157a20 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.850+0000 7f25da249640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25d4151ad0 0x7f25d40ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.850+0000 7f25d9a48640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.850+0000 7f25da249640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25d4151ad0 0x7f25d40ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:52658/0 (socket says 172.21.15.45:52658) 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.850+0000 7f25da249640 1 -- 172.21.15.45:0/3552004309 learned_addr learned my addr 172.21.15.45:0/3552004309 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.850+0000 7f25daa4a640 1 --1- 172.21.15.45:0/3552004309 >> v1:172.21.15.114:6789/0 conn(0x7f25d40ca610 0x7f25d4154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:57256/0 (socket says 172.21.15.45:57256) 2023-12-08T08:18:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.851+0000 7f25da249640 1 -- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 msgr2=0x7f25d4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.851+0000 7f25da249640 1 --2- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.851+0000 7f25da249640 1 -- 172.21.15.45:0/3552004309 >> v1:172.21.15.114:6789/0 conn(0x7f25d40ca610 legacy=0x7f25d4154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.851+0000 7f25da249640 1 -- 172.21.15.45:0/3552004309 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4154430 con 0x7f25d4151ad0 2023-12-08T08:18:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.852+0000 7f25da249640 1 --2- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d40ca0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009870 tx=0x7f25d002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1b75c24d361466 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.852+0000 7f25d9247640 1 -- 172.21.15.45:0/3552004309 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0030840 con 0x7f25d4151ad0 2023-12-08T08:18:09.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25d9247640 1 -- 172.21.15.45:0/3552004309 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d00309a0 con 0x7f25d4151ad0 2023-12-08T08:18:09.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25d9247640 1 -- 172.21.15.45:0/3552004309 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0030d30 con 0x7f25d4151ad0 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 -- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 msgr2=0x7f25d40ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 --2- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d40ca0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009870 tx=0x7f25d002b980 comp rx=0 tx=0).stop 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 -- 172.21.15.45:0/3552004309 shutdown_connections 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 --2- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 --2- 172.21.15.45:0/3552004309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d40ca0d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.853+0000 7f25db24b640 1 -- 172.21.15.45:0/3552004309 >> 172.21.15.45:0/3552004309 conn(0x7f25d4066610 msgr2=0x7f25d4066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.854+0000 7f25db24b640 1 -- 172.21.15.45:0/3552004309 shutdown_connections 2023-12-08T08:18:09.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.854+0000 7f25db24b640 1 -- 172.21.15.45:0/3552004309 wait complete. 2023-12-08T08:18:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.856+0000 7f25db24b640 1 Processor -- start 2023-12-08T08:18:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.856+0000 7f25db24b640 1 -- start start 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d4149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d40abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41edd70 con 0x7f25d40ca610 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41ed160 con 0x7f25d4151ad0 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.857+0000 7f25db24b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41ed440 con 0x7f25d4157a20 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35580/0 (socket says 172.21.15.45:35580) 2023-12-08T08:18:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 -- 172.21.15.45:0/157357725 learned_addr learned my addr 172.21.15.45:0/157357725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25d9a48640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d4149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25daa4a640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d40abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 -- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 msgr2=0x7f25d40abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d40abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 -- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 msgr2=0x7f25d4149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d4149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25da249640 1 -- 172.21.15.45:0/157357725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00094d0 con 0x7f25d40ca610 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25d9a48640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d4149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.858+0000 7f25daa4a640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d40abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25da249640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0039c90 con 0x7f25d40ca610 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0039e10 con 0x7f25d40ca610 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0043640 con 0x7f25d40ca610 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d41ed720 con 0x7f25d40ca610 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.859+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d40ac530 con 0x7f25d40ca610 2023-12-08T08:18:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.860+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d40743e0 con 0x7f25d40ca610 2023-12-08T08:18:09.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.861+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25d00437a0 con 0x7f25d40ca610 2023-12-08T08:18:09.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.862+0000 7f25caffd640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.862+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f25d003e070 con 0x7f25d40ca610 2023-12-08T08:18:09.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.863+0000 7f25d9a48640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.863+0000 7f25d9a48640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 0x7f25b806d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f25d40af610 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:09.867+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25d0077680 con 0x7f25d40ca610 2023-12-08T08:18:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.060+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25d414f070 con 0x7f25d40ca610 2023-12-08T08:18:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.061+0000 7f25caffd640 1 -- 172.21.15.45:0/157357725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25d0034020 con 0x7f25d40ca610 2023-12-08T08:18:10.063 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 msgr2=0x7f25b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 0x7f25b806d330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f25d40af610 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 msgr2=0x7f25d40af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0004730 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 shutdown_connections 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f25b806ae70 0x7f25b806d330 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f25d4157a20 0x7f25d40abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25d4151ad0 0x7f25d4149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 --2- 172.21.15.45:0/157357725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25d40ca610 0x7f25d40af0d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 >> 172.21.15.45:0/157357725 conn(0x7f25d4066610 msgr2=0x7f25d414f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 shutdown_connections 2023-12-08T08:18:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.064+0000 7f25db24b640 1 -- 172.21.15.45:0/157357725 wait complete. 2023-12-08T08:18:10.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.312+0000 7fe65ef75640 1 Processor -- start 2023-12-08T08:18:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.312+0000 7fe65ef75640 1 -- start start 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65ef75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe658151ec0 0x7fe6580c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65ef75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6580c4d30 0x7fe65806c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65ef75640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6580c16b0 con 0x7fe6580c1d60 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65ef75640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580a8b30 con 0x7fe658151ec0 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65ef75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580c65d0 con 0x7fe6580c4d30 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65df73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe658151ec0 0x7fe6580c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65df73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe658151ec0 0x7fe6580c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35594/0 (socket says 172.21.15.45:35594) 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.314+0000 7fe65df73640 1 -- 172.21.15.45:0/67639941 learned_addr learned my addr 172.21.15.45:0/67639941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.315+0000 7fe65e774640 1 --2- 172.21.15.45:0/67639941 >> v2:172.21.15.114:3300/0 conn(0x7fe6580c4d30 0x7fe65806c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.315+0000 7fe65df73640 1 -- 172.21.15.45:0/67639941 >> v2:172.21.15.114:3300/0 conn(0x7fe6580c4d30 msgr2=0x7fe65806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.315+0000 7fe65df73640 1 --2- 172.21.15.45:0/67639941 >> v2:172.21.15.114:3300/0 conn(0x7fe6580c4d30 0x7fe65806c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.315+0000 7fe65df73640 1 -- 172.21.15.45:0/67639941 >> v1:172.21.15.114:6789/0 conn(0x7fe6580c1d60 legacy=0x7fe65806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.315+0000 7fe65df73640 1 -- 172.21.15.45:0/67639941 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580c5810 con 0x7fe658151ec0 2023-12-08T08:18:10.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.316+0000 7fe65df73640 1 --2- 172.21.15.45:0/67639941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658151ec0 0x7fe6580c47f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe65806d720 tx=0x7fe65402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f505ec44dbaa622 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.316+0000 7fe65cf71640 1 -- 172.21.15.45:0/67639941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65402ee00 con 0x7fe658151ec0 2023-12-08T08:18:10.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.316+0000 7fe65cf71640 1 -- 172.21.15.45:0/67639941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654036440 con 0x7fe658151ec0 2023-12-08T08:18:10.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65cf71640 1 -- 172.21.15.45:0/67639941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540367d0 con 0x7fe658151ec0 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 -- 172.21.15.45:0/67639941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658151ec0 msgr2=0x7fe6580c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 --2- 172.21.15.45:0/67639941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658151ec0 0x7fe6580c47f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe65806d720 tx=0x7fe65402e050 comp rx=0 tx=0).stop 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 -- 172.21.15.45:0/67639941 shutdown_connections 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 --2- 172.21.15.45:0/67639941 >> v2:172.21.15.114:3300/0 conn(0x7fe6580c4d30 0x7fe65806c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 --2- 172.21.15.45:0/67639941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658151ec0 0x7fe6580c47f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 -- 172.21.15.45:0/67639941 >> 172.21.15.45:0/67639941 conn(0x7fe658066ce0 msgr2=0x7fe6580a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 -- 172.21.15.45:0/67639941 shutdown_connections 2023-12-08T08:18:10.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.317+0000 7fe65ef75640 1 -- 172.21.15.45:0/67639941 wait complete. 2023-12-08T08:18:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.319+0000 7fe65ef75640 1 Processor -- start 2023-12-08T08:18:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.320+0000 7fe65ef75640 1 -- start start 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6580c1d60 0x7fe658149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe658151ec0 0x7fe658144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581e96b0 con 0x7fe6580c4d30 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581e9950 con 0x7fe6580c1d60 2023-12-08T08:18:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65ef75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65806fd30 con 0x7fe658151ec0 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65d772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65d772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35596/0 (socket says 172.21.15.45:35596) 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65d772640 1 -- 172.21.15.45:0/3558278869 learned_addr learned my addr 172.21.15.45:0/3558278869 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.321+0000 7fe65df73640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6580c1d60 0x7fe658149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65e774640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe658151ec0 0x7fe658144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 -- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe658151ec0 msgr2=0x7fe658144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe658151ec0 0x7fe658144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 -- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6580c1d60 msgr2=0x7fe658149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6580c1d60 0x7fe658149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 -- 172.21.15.45:0/3558278869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65400b770 con 0x7fe6580c4d30 2023-12-08T08:18:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65d772640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c430 tx=0x7fe64800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648011790 con 0x7fe6580c4d30 2023-12-08T08:18:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6480118f0 con 0x7fe6580c4d30 2023-12-08T08:18:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe658070010 con 0x7fe6580c4d30 2023-12-08T08:18:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.322+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648011ce0 con 0x7fe6580c4d30 2023-12-08T08:18:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.323+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe658149560 con 0x7fe6580c4d30 2023-12-08T08:18:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.324+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe658070250 con 0x7fe6580c4d30 2023-12-08T08:18:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.325+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe64801c460 con 0x7fe6580c4d30 2023-12-08T08:18:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.326+0000 7fe64e7fc640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 0x7fe63c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.326+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe648089af0 con 0x7fe6580c4d30 2023-12-08T08:18:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.327+0000 7fe65df73640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 0x7fe63c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.328+0000 7fe65df73640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 0x7fe63c06d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe654038000 tx=0x7fe654032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.331+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe658070250 con 0x7fe6580c4d30 2023-12-08T08:18:10.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.527+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe658070250 con 0x7fe6580c4d30 2023-12-08T08:18:10.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.528+0000 7fe64e7fc640 1 -- 172.21.15.45:0/3558278869 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe658070250 con 0x7fe6580c4d30 2023-12-08T08:18:10.530 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 msgr2=0x7fe63c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 0x7fe63c06d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe654038000 tx=0x7fe654032000 comp rx=0 tx=0).stop 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 msgr2=0x7fe658144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c430 tx=0x7fe64800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 shutdown_connections 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe63c06ae40 0x7fe63c06d300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe658151ec0 0x7fe658144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6580c4d30 0x7fe658144950 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 --2- 172.21.15.45:0/3558278869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6580c1d60 0x7fe658149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 >> 172.21.15.45:0/3558278869 conn(0x7fe658066ce0 msgr2=0x7fe6580a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 shutdown_connections 2023-12-08T08:18:10.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.531+0000 7fe65ef75640 1 -- 172.21.15.45:0/3558278869 wait complete. 2023-12-08T08:18:10.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:18:10.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.775+0000 7f3e1483d640 1 Processor -- start 2023-12-08T08:18:10.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.775+0000 7f3e1483d640 1 -- start start 2023-12-08T08:18:10.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.776+0000 7f3e1483d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e1006a730 0x7f3e10154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.776+0000 7f3e1483d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100c1ff0 con 0x7f3e101553e0 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.776+0000 7f3e1483d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100c5910 con 0x7f3e10072190 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.776+0000 7f3e1483d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100c5bf0 con 0x7f3e1006a730 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.776+0000 7f3e0ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3e101553e0 0x7f3e1015ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46600/0 (socket says 172.21.15.45:46600) 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/195472010 learned_addr learned my addr 172.21.15.45:0/195472010 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/195472010 >> v2:172.21.15.114:3300/0 conn(0x7f3e1006a730 0x7f3e10154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685383066 0 0) 0x7f3e100c1ff0 con 0x7f3e101553e0 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dfc003520 con 0x7f3e101553e0 2023-12-08T08:18:10.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578940639 0 0) 0x7f3dfc003520 con 0x7f3e101553e0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 >> v2:172.21.15.114:3300/0 conn(0x7f3e1006a730 msgr2=0x7f3e10154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 --2- 172.21.15.45:0/195472010 >> v2:172.21.15.114:3300/0 conn(0x7f3e1006a730 0x7f3e10154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 >> v1:172.21.15.114:6789/0 conn(0x7f3e10072190 legacy=0x7f3e10157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100c4f70 con 0x7f3e101553e0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f3e08001670 con 0x7f3e101553e0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.777+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 >> v1:172.21.15.45:6789/0 conn(0x7f3e101553e0 legacy=0x7f3e1015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dfc0039c0 0x7f3dfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 0x7f3dfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0051d0 0x7f3dfc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c5bf0 con 0x7f3dfc0047c0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00c120 con 0x7f3dfc0051d0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00c2e0 con 0x7f3dfc0039c0 2023-12-08T08:18:10.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0dd9b640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 0x7f3dfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0ed9d640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0051d0 0x7f3dfc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dfc0039c0 0x7f3dfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.778+0000 7f3e0dd9b640 1 -- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dfc0039c0 msgr2=0x7f3dfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.779+0000 7f3e0dd9b640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dfc0039c0 0x7f3dfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.779+0000 7f3e0dd9b640 1 -- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0051d0 msgr2=0x7f3dfc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.779+0000 7f3e0dd9b640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0051d0 0x7f3dfc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.779+0000 7f3e0dd9b640 1 -- 172.21.15.45:0/195472010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc003520 con 0x7f3dfc0047c0 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.779+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/195472010 reap_dead start 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.780+0000 7f3e0dd9b640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 0x7f3dfc004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3df8001720 tx=0x7f3dfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92503038d3dd7d1a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.780+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80052d0 con 0x7f3dfc0047c0 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.780+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df802e050 con 0x7f3dfc0047c0 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.780+0000 7f3e0d59a640 1 -- 172.21.15.45:0/195472010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8003830 con 0x7f3dfc0047c0 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 -- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 msgr2=0x7f3dfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 0x7f3dfc004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3df8001720 tx=0x7f3dfc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 -- 172.21.15.45:0/195472010 shutdown_connections 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 --2- 172.21.15.45:0/195472010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dfc0047c0 0x7f3dfc004c40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 -- 172.21.15.45:0/195472010 >> 172.21.15.45:0/195472010 conn(0x7f3e100c34d0 msgr2=0x7f3e100c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 -- 172.21.15.45:0/195472010 shutdown_connections 2023-12-08T08:18:10.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.781+0000 7f3e1483d640 1 -- 172.21.15.45:0/195472010 wait complete. 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.783+0000 7f3e1483d640 1 Processor -- start 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.783+0000 7f3e1483d640 1 -- start start 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 0x7f3e1009a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e100aa9a0 0x7f3e101ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101ede90 con 0x7f3e1014fdb0 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100aa1d0 con 0x7f3dfc0047c0 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e1483d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100aae20 con 0x7f3e100aa9a0 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.784+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35616/0 (socket says 172.21.15.45:35616) 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/1111722750 learned_addr learned my addr 172.21.15.45:0/1111722750 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 0x7f3e1009a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e100aa9a0 msgr2=0x7f3e101ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e100aa9a0 0x7f3e101ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 msgr2=0x7f3e1009a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 0x7f3e1009a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 -- 172.21.15.45:0/1111722750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e101edbd0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 0x7f3e1009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.785+0000 7f3e0ed9d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3e10155870 tx=0x7f3e0800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.786+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800eed0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.786+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800c590 con 0x7f3e1014fdb0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.786+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800c940 con 0x7f3e1014fdb0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.786+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100a9b80 con 0x7f3e1014fdb0 2023-12-08T08:18:10.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.786+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e100a81d0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.787+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e100a99e0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.788+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e0800caa0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.789+0000 7f3e06ffd640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 0x7f3df006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.789+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f3e080897f0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.789+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 0x7f3df006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.790+0000 7f3e0e59c640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 0x7f3df006d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3e101e7900 tx=0x7f3e0000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.794+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e100a99e0 con 0x7f3e1014fdb0 2023-12-08T08:18:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.990+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e10157530 con 0x7f3e1014fdb0 2023-12-08T08:18:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.991+0000 7f3e06ffd640 1 -- 172.21.15.45:0/1111722750 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3e10157530 con 0x7f3e1014fdb0 2023-12-08T08:18:10.993 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 msgr2=0x7f3df006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 0x7f3df006d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3e101e7900 tx=0x7f3e0000b040 comp rx=0 tx=0).stop 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 msgr2=0x7f3e10150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3e10155870 tx=0x7f3e0800eb90 comp rx=0 tx=0).stop 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 shutdown_connections 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3df006ae40 0x7f3df006d300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e100aa9a0 0x7f3e101ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1014fdb0 0x7f3e10150260 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 --2- 172.21.15.45:0/1111722750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dfc0047c0 0x7f3e1009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 >> 172.21.15.45:0/1111722750 conn(0x7f3e100c34d0 msgr2=0x7f3e100c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 shutdown_connections 2023-12-08T08:18:10.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:10.994+0000 7f3e1483d640 1 -- 172.21.15.45:0/1111722750 wait complete. 2023-12-08T08:18:11.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:18:11.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.240+0000 7f7718839640 1 Processor -- start 2023-12-08T08:18:11.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.240+0000 7f7718839640 1 -- start start 2023-12-08T08:18:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.241+0000 7f7718839640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f771406c230 0x7f7714155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.241+0000 7f7718839640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7714151eb0 con 0x7f7714151ad0 2023-12-08T08:18:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.241+0000 7f7718839640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77140c80d0 con 0x7f7714157a20 2023-12-08T08:18:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.241+0000 7f7718839640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140c56a0 con 0x7f771406c230 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f7713fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f771406c230 0x7f7714155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f77137fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7714151ad0 0x7f77140ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46608/0 (socket says 172.21.15.45:46608) 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f77137fe640 1 -- 172.21.15.45:0/2731995530 learned_addr learned my addr 172.21.15.45:0/2731995530 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f7713fff640 1 -- 172.21.15.45:0/2731995530 >> v1:172.21.15.114:6789/0 conn(0x7f7714157a20 legacy=0x7f7714154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f7713fff640 1 -- 172.21.15.45:0/2731995530 >> v1:172.21.15.45:6789/0 conn(0x7f7714151ad0 legacy=0x7f77140ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f77127fc640 1 -- 172.21.15.45:0/2731995530 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783616507 0 0) 0x7f7714151eb0 con 0x7f7714151ad0 2023-12-08T08:18:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.242+0000 7f7713fff640 1 -- 172.21.15.45:0/2731995530 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714154430 con 0x7f771406c230 2023-12-08T08:18:11.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f7713fff640 1 --2- 172.21.15.45:0/2731995530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f7714155040 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097a0 tx=0x7f770c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce73ee128059ad1b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f77127fc640 1 -- 172.21.15.45:0/2731995530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c030610 con 0x7f771406c230 2023-12-08T08:18:11.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f77127fc640 1 -- 172.21.15.45:0/2731995530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c030770 con 0x7f771406c230 2023-12-08T08:18:11.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f77127fc640 1 -- 172.21.15.45:0/2731995530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c030b00 con 0x7f771406c230 2023-12-08T08:18:11.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f7718839640 1 -- 172.21.15.45:0/2731995530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 msgr2=0x7f7714155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.244+0000 7f7718839640 1 --2- 172.21.15.45:0/2731995530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f7714155040 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097a0 tx=0x7f770c02b960 comp rx=0 tx=0).stop 2023-12-08T08:18:11.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.245+0000 7f7718839640 1 -- 172.21.15.45:0/2731995530 shutdown_connections 2023-12-08T08:18:11.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.245+0000 7f7718839640 1 --2- 172.21.15.45:0/2731995530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f7714155040 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.245+0000 7f7718839640 1 -- 172.21.15.45:0/2731995530 >> 172.21.15.45:0/2731995530 conn(0x7f7714066610 msgr2=0x7f7714066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:11.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.245+0000 7f7718839640 1 -- 172.21.15.45:0/2731995530 shutdown_connections 2023-12-08T08:18:11.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.245+0000 7f7718839640 1 -- 172.21.15.45:0/2731995530 wait complete. 2023-12-08T08:18:11.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.247+0000 7f7718839640 1 Processor -- start 2023-12-08T08:18:11.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.247+0000 7f7718839640 1 -- start start 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 0x7f77140ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7714157a20 0x7f7714156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140ac170 con 0x7f771406c230 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771414e0e0 con 0x7f7714151ad0 2023-12-08T08:18:11.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7718839640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714157530 con 0x7f7714157a20 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f77137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f77137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35642/0 (socket says 172.21.15.45:35642) 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f77137fe640 1 -- 172.21.15.45:0/2512190638 learned_addr learned my addr 172.21.15.45:0/2512190638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7713fff640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7714157a20 0x7f7714156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f7712ffd640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 0x7f77140ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f77137fe640 1 -- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7714157a20 msgr2=0x7f7714156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.248+0000 7f77137fe640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7714157a20 0x7f7714156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f77137fe640 1 -- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 msgr2=0x7f77140ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f77137fe640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 0x7f77140ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f77137fe640 1 -- 172.21.15.45:0/2512190638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009400 con 0x7f771406c230 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f7712ffd640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 0x7f77140ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f77137fe640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f770400c8c0 tx=0x7f770400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400a640 con 0x7f771406c230 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400a7a0 con 0x7f771406c230 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400ab50 con 0x7f771406c230 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771414bf10 con 0x7f771406c230 2023-12-08T08:18:11.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.249+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771414c4d0 con 0x7f771406c230 2023-12-08T08:18:11.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.250+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77140743e0 con 0x7f771406c230 2023-12-08T08:18:11.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.251+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f770400acb0 con 0x7f771406c230 2023-12-08T08:18:11.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.252+0000 7f770bfff640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 0x7f76f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.252+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f7704088fc0 con 0x7f771406c230 2023-12-08T08:18:11.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.253+0000 7f7712ffd640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 0x7f76f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.253+0000 7f7712ffd640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 0x7f76f406d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f77141579c0 tx=0x7f76fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.257+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77040bbe90 con 0x7f771406c230 2023-12-08T08:18:11.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.451+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f77140c7a40 con 0x7f771406c230 2023-12-08T08:18:11.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.452+0000 7f770bfff640 1 -- 172.21.15.45:0/2512190638 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7704018020 con 0x7f771406c230 2023-12-08T08:18:11.454 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 msgr2=0x7f76f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 0x7f76f406d330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f77141579c0 tx=0x7f76fc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 msgr2=0x7f771414dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f770400c8c0 tx=0x7f770400cd80 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 shutdown_connections 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f76f406ae70 0x7f76f406d330 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7714157a20 0x7f7714156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7714151ad0 0x7f77140ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 --2- 172.21.15.45:0/2512190638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f771406c230 0x7f771414dba0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 >> 172.21.15.45:0/2512190638 conn(0x7f7714066610 msgr2=0x7f771414e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 shutdown_connections 2023-12-08T08:18:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.455+0000 7f7718839640 1 -- 172.21.15.45:0/2512190638 wait complete. 2023-12-08T08:18:11.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:11.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.702+0000 7f386b59e640 1 Processor -- start 2023-12-08T08:18:11.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.702+0000 7f386b59e640 1 -- start start 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f386c155090 0x7f386c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 0x7f386c0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0c4a60 con 0x7f386c0c65b0 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0c4f70 con 0x7f386c155090 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1543a0 con 0x7f386c06c360 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f386c0c65b0 0x7f386c157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46616/0 (socket says 172.21.15.45:46616) 2023-12-08T08:18:11.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.703+0000 7f386a59c640 1 -- 172.21.15.45:0/3015509111 learned_addr learned my addr 172.21.15.45:0/3015509111 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386ad9d640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 0x7f386c0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f3869d9b640 1 --2- 172.21.15.45:0/3015509111 >> v2:172.21.15.114:3300/0 conn(0x7f386c155090 0x7f386c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236140657 0 0) 0x7f386c0c4a60 con 0x7f386c0c65b0 2023-12-08T08:18:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3858003520 con 0x7f386c0c65b0 2023-12-08T08:18:11.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14750205 0 0) 0x7f3858003520 con 0x7f386c0c65b0 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 msgr2=0x7f386c0c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 0x7f386c0c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 >> v2:172.21.15.114:3300/0 conn(0x7f386c155090 msgr2=0x7f386c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 --2- 172.21.15.45:0/3015509111 >> v2:172.21.15.114:3300/0 conn(0x7f386c155090 0x7f386c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c0c4c90 con 0x7f386c0c65b0 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f385c001690 con 0x7f386c0c65b0 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 >> v1:172.21.15.45:6789/0 conn(0x7f386c0c65b0 legacy=0x7f386c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f3858003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.704+0000 7f386959a640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 0x7f38580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386959a640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3858004d00 0x7f3858005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0c4f70 con 0x7f3858003970 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1543a0 con 0x7f3858004d00 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385800ba60 con 0x7f386c06c360 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f3869d9b640 1 --2- 172.21.15.45:0/3015509111 >> v2:172.21.15.114:3300/0 conn(0x7f386c155090 0x7f386c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:11.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f3858003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386ad9d640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3858004d00 0x7f3858005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 -- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 msgr2=0x7f38580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c06c360 0x7f38580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 -- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3858004d00 msgr2=0x7f3858005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3858004d00 0x7f3858005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386a59c640 1 -- 172.21.15.45:0/3015509111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858003520 con 0x7f3858003970 2023-12-08T08:18:11.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.705+0000 7f386ad9d640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3858004d00 0x7f3858005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:11.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.706+0000 7f386a59c640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f3858003d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c210 tx=0x7f38580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784623f4a8ae8770 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c005ad0 con 0x7f3858003970 2023-12-08T08:18:11.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c005c30 con 0x7f3858003970 2023-12-08T08:18:11.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386959a640 1 -- 172.21.15.45:0/3015509111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c02c8b0 con 0x7f3858003970 2023-12-08T08:18:11.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 -- 172.21.15.45:0/3015509111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 msgr2=0x7f3858003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 --2- 172.21.15.45:0/3015509111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f3858003d90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c210 tx=0x7f38580057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386ad9d640 1 -- 172.21.15.45:0/3015509111 reap_dead start 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 -- 172.21.15.45:0/3015509111 shutdown_connections 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 -- 172.21.15.45:0/3015509111 >> 172.21.15.45:0/3015509111 conn(0x7f386c0ab710 msgr2=0x7f386c0abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 -- 172.21.15.45:0/3015509111 shutdown_connections 2023-12-08T08:18:11.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.707+0000 7f386b59e640 1 -- 172.21.15.45:0/3015509111 wait complete. 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.709+0000 7f386b59e640 1 Processor -- start 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.709+0000 7f386b59e640 1 -- start start 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386c0c3680 0x7f386c148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c148690 0x7f386c149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c14b6a0 con 0x7f3858003970 2023-12-08T08:18:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c149120 con 0x7f386c0c3680 2023-12-08T08:18:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.710+0000 7f386b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1499c0 con 0x7f386c148690 2023-12-08T08:18:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35662/0 (socket says 172.21.15.45:35662) 2023-12-08T08:18:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 -- 172.21.15.45:0/3995167066 learned_addr learned my addr 172.21.15.45:0/3995167066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f3869d9b640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386c0c3680 0x7f386c148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 -- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c148690 msgr2=0x7f386c149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c148690 0x7f386c149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 -- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386c0c3680 msgr2=0x7f386c148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386c0c3680 0x7f386c148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 -- 172.21.15.45:0/3995167066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c157b70 con 0x7f3858003970 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.711+0000 7f386a59c640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c330 tx=0x7f385c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.712+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c02ccc0 con 0x7f3858003970 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.712+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c03a070 con 0x7f3858003970 2023-12-08T08:18:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.712+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c0072b0 con 0x7f3858003970 2023-12-08T08:18:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.712+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c1ee140 con 0x7f3858003970 2023-12-08T08:18:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.712+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c149650 con 0x7f3858003970 2023-12-08T08:18:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.713+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c149810 con 0x7f3858003970 2023-12-08T08:18:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.714+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f385c032070 con 0x7f3858003970 2023-12-08T08:18:11.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.715+0000 7f3862ffd640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 0x7f384c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:11.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.716+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f385c0aafc0 con 0x7f3858003970 2023-12-08T08:18:11.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.716+0000 7f3869d9b640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 0x7f384c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.717+0000 7f3869d9b640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 0x7f384c06d300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f38540070b0 tx=0x7f385400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:11.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.720+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f385c075ac0 con 0x7f3858003970 2023-12-08T08:18:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.928+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f386c0743e0 con 0x7f3858003970 2023-12-08T08:18:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.929+0000 7f3862ffd640 1 -- 172.21.15.45:0/3995167066 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f385c0790e0 con 0x7f3858003970 2023-12-08T08:18:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:18:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 msgr2=0x7f384c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 0x7f384c06d300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f38540070b0 tx=0x7f385400b040 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 msgr2=0x7f386c157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c330 tx=0x7f385c001a20 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 shutdown_connections 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f384c06ae40 0x7f384c06d300 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f386c148690 0x7f386c149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386c0c3680 0x7f386c148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.931+0000 7f386b59e640 1 --2- 172.21.15.45:0/3995167066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3858003970 0x7f386c157120 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.932+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 >> 172.21.15.45:0/3995167066 conn(0x7f386c0ab710 msgr2=0x7f386c0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.932+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 shutdown_connections 2023-12-08T08:18:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:11.932+0000 7f386b59e640 1 -- 172.21.15.45:0/3995167066 wait complete. 2023-12-08T08:18:11.952 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:18:11.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:11.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:12.066 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:18:12.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:12.067 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:18:12.116 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:12.116 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:12.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:18:12.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.398+0000 7fb078e10640 1 Processor -- start 2023-12-08T08:18:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.399+0000 7fb078e10640 1 -- start start 2023-12-08T08:18:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.400+0000 7fb078e10640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb07406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.400+0000 7fb078e10640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb074158530 con 0x7fb0740bedd0 2023-12-08T08:18:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.400+0000 7fb078e10640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb074158810 con 0x7fb0740c0db0 2023-12-08T08:18:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.400+0000 7fb078e10640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406d800 con 0x7fb074151d20 2023-12-08T08:18:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb072d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb0740bedd0 0x7fb0740c2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46622/0 (socket says 172.21.15.45:46622) 2023-12-08T08:18:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb072d9d640 1 -- 172.21.15.45:0/1562466817 learned_addr learned my addr 172.21.15.45:0/1562466817 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb07259c640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb07406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838392546 0 0) 0x7fb074158530 con 0x7fb0740bedd0 2023-12-08T08:18:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003520 con 0x7fb0740bedd0 2023-12-08T08:18:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461863339 0 0) 0x7fb060003520 con 0x7fb0740bedd0 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 msgr2=0x7fb07406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.401+0000 7fb071d9b640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb07406d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 >> v1:172.21.15.114:6789/0 conn(0x7fb0740c0db0 legacy=0x7fb0740c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740bf8d0 con 0x7fb0740bedd0 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fb06c0019f0 con 0x7fb0740bedd0 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 >> v1:172.21.15.45:6789/0 conn(0x7fb0740bedd0 legacy=0x7fb0740c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb0600039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060003f70 0x7fb0600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb060004d00 0x7fb060005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406d800 con 0x7fb060004d00 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000bb70 con 0x7fb060003f70 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000bd30 con 0x7fb074151d20 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb072d9d640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb060004d00 0x7fb060005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb07259c640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb0600039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.402+0000 7fb06bfff640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060003f70 0x7fb0600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb072d9d640 1 -- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 msgr2=0x7fb0600039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb072d9d640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb0600039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb072d9d640 1 -- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060003f70 msgr2=0x7fb0600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb072d9d640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060003f70 0x7fb0600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb072d9d640 1 -- 172.21.15.45:0/1562466817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060003520 con 0x7fb060004d00 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb07259c640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074151d20 0x7fb0600039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.403+0000 7fb06bfff640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb060003f70 0x7fb0600047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.404+0000 7fb072d9d640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb060004d00 0x7fb060005180 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00a760 tx=0x7fb0600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b8d2d0694df493 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.404+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c034630 con 0x7fb060004d00 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.404+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c02f070 con 0x7fb060004d00 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.404+0000 7fb071d9b640 1 -- 172.21.15.45:0/1562466817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0349f0 con 0x7fb060004d00 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.404+0000 7fb078e10640 1 -- 172.21.15.45:0/1562466817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb060004d00 msgr2=0x7fb060005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb078e10640 1 --2- 172.21.15.45:0/1562466817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb060004d00 0x7fb060005180 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00a760 tx=0x7fb0600057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb072d9d640 1 -- 172.21.15.45:0/1562466817 reap_dead start 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb078e10640 1 -- 172.21.15.45:0/1562466817 shutdown_connections 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb078e10640 1 -- 172.21.15.45:0/1562466817 >> 172.21.15.45:0/1562466817 conn(0x7fb0740661f0 msgr2=0x7fb074066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb078e10640 1 -- 172.21.15.45:0/1562466817 shutdown_connections 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.405+0000 7fb078e10640 1 -- 172.21.15.45:0/1562466817 wait complete. 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.406+0000 7fb078e10640 1 Processor -- start 2023-12-08T08:18:12.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.407+0000 7fb078e10640 1 -- start start 2023-12-08T08:18:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.407+0000 7fb078e10640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0740a6530 0x7fb074153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.407+0000 7fb078e10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb078e10640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074070230 0x7fb0741e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb078e10640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074154660 con 0x7fb074072150 2023-12-08T08:18:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb078e10640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406fae0 con 0x7fb0740a6530 2023-12-08T08:18:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb078e10640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb074154db0 con 0x7fb074070230 2023-12-08T08:18:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35686/0 (socket says 172.21.15.45:35686) 2023-12-08T08:18:12.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 -- 172.21.15.45:0/92285209 learned_addr learned my addr 172.21.15.45:0/92285209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb07259c640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0740a6530 0x7fb074153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 -- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074070230 msgr2=0x7fb0741e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074070230 0x7fb0741e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 -- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0740a6530 msgr2=0x7fb074153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0740a6530 0x7fb074153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.408+0000 7fb06bfff640 1 -- 172.21.15.45:0/92285209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074155090 con 0x7fb074072150 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb06bfff640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00d770 tx=0x7fb05c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c005270 con 0x7fb074072150 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c0053d0 con 0x7fb074072150 2023-12-08T08:18:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00b850 con 0x7fb074072150 2023-12-08T08:18:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb074155370 con 0x7fb074072150 2023-12-08T08:18:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.409+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb074154a40 con 0x7fb074072150 2023-12-08T08:18:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.410+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb074074600 con 0x7fb074072150 2023-12-08T08:18:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.411+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb05c00b9b0 con 0x7fb074072150 2023-12-08T08:18:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.412+0000 7fb06affd640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 0x7fb05406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.412+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fb05c089ab0 con 0x7fb074072150 2023-12-08T08:18:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.412+0000 7fb07259c640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 0x7fb05406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.413+0000 7fb07259c640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 0x7fb05406d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb0640099b0 tx=0x7fb064008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.416+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb05c0545b0 con 0x7fb074072150 2023-12-08T08:18:12.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.647+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb07406d010 con 0x7fb074072150 2023-12-08T08:18:12.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.648+0000 7fb06affd640 1 -- 172.21.15.45:0/92285209 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7fb05c057bd0 con 0x7fb074072150 2023-12-08T08:18:12.649 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:18:12.649 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:18:12.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 msgr2=0x7fb05406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 0x7fb05406d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb0640099b0 tx=0x7fb064008040 comp rx=0 tx=0).stop 2023-12-08T08:18:12.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 msgr2=0x7fb0741ed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:12.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00d770 tx=0x7fb05c00dc30 comp rx=0 tx=0).stop 2023-12-08T08:18:12.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 shutdown_connections 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb05406ae40 0x7fb05406d300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb074070230 0x7fb0741e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb074072150 0x7fb0741ed2c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 --2- 172.21.15.45:0/92285209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0740a6530 0x7fb074153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.650+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 >> 172.21.15.45:0/92285209 conn(0x7fb0740661f0 msgr2=0x7fb0740c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.651+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 shutdown_connections 2023-12-08T08:18:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:12.651+0000 7fb078e10640 1 -- 172.21.15.45:0/92285209 wait complete. 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:12.672 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:18:12.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:12.673 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.733 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41922sec preferred_lft 41922sec 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.734 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:18:12.735 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:12.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:12.736 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:12.829 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:18:12.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:12.833 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:18:12.881 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:18:12.881 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:12.882 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:18:12.882 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:18:12.882 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:12.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:18:12.882 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:18:13.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:13.063 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:18:13.112 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:18:13.113 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:18:13.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:13.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:18:13.205 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:13.205 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:13.260 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:18:13.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:13.260 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:13.311 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:18:13.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:13.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:13.451 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:13.451 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:18:13.487 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:13.487 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:18:13.487 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:18:13.488 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:18:13.488 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:18:13.490 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:18:13.490 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:18:13.490 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:18:13.490 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:18:13.490 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:18:13.494 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:18:13.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:13.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:13.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:13.578 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:18:13.660 INFO:teuthology.orchestra.run.smithi114.stdout:client5048 2023-12-08T08:18:13.660 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:13.660 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:13.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-08T08:18:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.958+0000 7fc15141a640 1 Processor -- start 2023-12-08T08:18:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.958+0000 7fc15141a640 1 -- start start 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc15141a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc14c0c64f0 0x7fc14c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc15141a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc14c154ce0 0x7fc14c13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc15141a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c155230 con 0x7fc14c13d910 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc15141a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0c45b0 con 0x7fc14c154ce0 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc15141a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0c4890 con 0x7fc14c0c64f0 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc14b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc14c154ce0 0x7fc14c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc14b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc14c154ce0 0x7fc14c13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35700/0 (socket says 172.21.15.45:35700) 2023-12-08T08:18:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.960+0000 7fc14b7fe640 1 -- 172.21.15.45:0/1031780134 learned_addr learned my addr 172.21.15.45:0/1031780134 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.961+0000 7fc14bfff640 1 --2- 172.21.15.45:0/1031780134 >> v2:172.21.15.114:3300/0 conn(0x7fc14c0c64f0 0x7fc14c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.961+0000 7fc14b7fe640 1 -- 172.21.15.45:0/1031780134 >> v2:172.21.15.114:3300/0 conn(0x7fc14c0c64f0 msgr2=0x7fc14c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.961+0000 7fc14b7fe640 1 --2- 172.21.15.45:0/1031780134 >> v2:172.21.15.114:3300/0 conn(0x7fc14c0c64f0 0x7fc14c06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.961+0000 7fc14b7fe640 1 -- 172.21.15.45:0/1031780134 >> v1:172.21.15.114:6789/0 conn(0x7fc14c13d910 legacy=0x7fc14c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.961+0000 7fc14b7fe640 1 -- 172.21.15.45:0/1031780134 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0c4b70 con 0x7fc14c154ce0 2023-12-08T08:18:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.962+0000 7fc14b7fe640 1 --2- 172.21.15.45:0/1031780134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c154ce0 0x7fc14c13d3d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0ac820 tx=0x7fc14002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378a1f1bbbda985 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.962+0000 7fc14affd640 1 -- 172.21.15.45:0/1031780134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140031750 con 0x7fc14c154ce0 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc14affd640 1 -- 172.21.15.45:0/1031780134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400318b0 con 0x7fc14c154ce0 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc14affd640 1 -- 172.21.15.45:0/1031780134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140031c40 con 0x7fc14c154ce0 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 -- 172.21.15.45:0/1031780134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c154ce0 msgr2=0x7fc14c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 --2- 172.21.15.45:0/1031780134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c154ce0 0x7fc14c13d3d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0ac820 tx=0x7fc14002b7f0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 -- 172.21.15.45:0/1031780134 shutdown_connections 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 --2- 172.21.15.45:0/1031780134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c154ce0 0x7fc14c13d3d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 --2- 172.21.15.45:0/1031780134 >> v2:172.21.15.114:3300/0 conn(0x7fc14c0c64f0 0x7fc14c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 -- 172.21.15.45:0/1031780134 >> 172.21.15.45:0/1031780134 conn(0x7fc14c0661f0 msgr2=0x7fc14c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 -- 172.21.15.45:0/1031780134 shutdown_connections 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.963+0000 7fc15141a640 1 -- 172.21.15.45:0/1031780134 wait complete. 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.965+0000 7fc15141a640 1 Processor -- start 2023-12-08T08:18:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.965+0000 7fc15141a640 1 -- start start 2023-12-08T08:18:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14c0c64f0 0x7fc14c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c154ce0 0x7fc14c1ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0ae200 con 0x7fc14c13d910 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0a9620 con 0x7fc14c154ce0 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc15141a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0ad080 con 0x7fc14c0c64f0 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc14b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.966+0000 7fc14b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35710/0 (socket says 172.21.15.45:35710) 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 -- 172.21.15.45:0/2258879262 learned_addr learned my addr 172.21.15.45:0/2258879262 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14bfff640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14c0c64f0 0x7fc14c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc150c19640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c154ce0 0x7fc14c1ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 -- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14c0c64f0 msgr2=0x7fc14c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14c0c64f0 0x7fc14c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 -- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c154ce0 msgr2=0x7fc14c1ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c154ce0 0x7fc14c1ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 -- 172.21.15.45:0/2258879262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400094d0 con 0x7fc14c13d910 2023-12-08T08:18:13.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.967+0000 7fc14b7fe640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc14002b830 tx=0x7fc1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.968+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140033c00 con 0x7fc14c13d910 2023-12-08T08:18:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.968+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140033d60 con 0x7fc14c13d910 2023-12-08T08:18:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.968+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14003c640 con 0x7fc14c13d910 2023-12-08T08:18:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.968+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c0ade50 con 0x7fc14c13d910 2023-12-08T08:18:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.968+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c0ad5b0 con 0x7fc14c13d910 2023-12-08T08:18:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.969+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c1ea080 con 0x7fc14c13d910 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.970+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc14003a040 con 0x7fc14c13d910 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.971+0000 7fc148ff9640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.972+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fc1400ab720 con 0x7fc14c13d910 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.972+0000 7fc14bfff640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.973+0000 7fc14bfff640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 0x7fc13806d300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc13c006fd0 tx=0x7fc13c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:13.976+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc14c1ea080 con 0x7fc14c13d910 2023-12-08T08:18:14.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.243+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fc14c1ea080 con 0x7fc14c13d910 2023-12-08T08:18:14.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.248+0000 7fc148ff9640 1 -- 172.21.15.45:0/2258879262 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v21) v1 ==== 291+0+0 (secure 0 0 0) 0x7fc14c1ea080 con 0x7fc14c13d910 2023-12-08T08:18:14.250 INFO:teuthology.orchestra.run.smithi045.stderr:added key for client.testuser 2023-12-08T08:18:14.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 msgr2=0x7fc13806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 0x7fc13806d300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc13c006fd0 tx=0x7fc13c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:14.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 msgr2=0x7fc14c1ea360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc14002b830 tx=0x7fc1400046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 shutdown_connections 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c154ce0 0x7fc14c1ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc14c13d910 0x7fc14c1ea360 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 --2- 172.21.15.45:0/2258879262 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc14c0c64f0 0x7fc14c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 >> 172.21.15.45:0/2258879262 conn(0x7fc14c0661f0 msgr2=0x7fc14c0c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.251+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 shutdown_connections 2023-12-08T08:18:14.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.252+0000 7fc15141a640 1 -- 172.21.15.45:0/2258879262 wait complete. 2023-12-08T08:18:14.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-08T08:18:14.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.496+0000 7fa5a206d640 1 Processor -- start 2023-12-08T08:18:14.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.497+0000 7fa5a206d640 1 -- start start 2023-12-08T08:18:14.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a206d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa59c0c7a40 0x7fa59c0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a206d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c0c6b30 con 0x7fa59c14e310 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a206d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c0c6e10 con 0x7fa59c0c6550 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a206d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c06c070 con 0x7fa59c0c7a40 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a186c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa59c0c7a40 0x7fa59c0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a106b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa59c14e310 0x7fa59c154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46626/0 (socket says 172.21.15.45:46626) 2023-12-08T08:18:14.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a186c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa59c0c7a40 0x7fa59c0c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35718/0 (socket says 172.21.15.45:35718) 2023-12-08T08:18:14.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.498+0000 7fa5a106b640 1 -- 172.21.15.45:0/2648923059 learned_addr learned my addr 172.21.15.45:0/2648923059 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:14.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.499+0000 7fa5a186c640 1 -- 172.21.15.45:0/2648923059 >> v1:172.21.15.114:6789/0 conn(0x7fa59c0c6550 legacy=0x7fa59c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:14.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.499+0000 7fa5a186c640 1 -- 172.21.15.45:0/2648923059 >> v1:172.21.15.45:6789/0 conn(0x7fa59c14e310 legacy=0x7fa59c154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.499+0000 7fa5a186c640 1 -- 172.21.15.45:0/2648923059 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c06ae80 con 0x7fa59c0c7a40 2023-12-08T08:18:14.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.500+0000 7fa5a186c640 1 --2- 172.21.15.45:0/2648923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c0c7a40 0x7fa59c0c44c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa59402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf321c3f08f3cc3b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:14.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.500+0000 7fa593fff640 1 -- 172.21.15.45:0/2648923059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59402f050 con 0x7fa59c0c7a40 2023-12-08T08:18:14.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.500+0000 7fa593fff640 1 -- 172.21.15.45:0/2648923059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594031700 con 0x7fa59c0c7a40 2023-12-08T08:18:14.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.500+0000 7fa593fff640 1 -- 172.21.15.45:0/2648923059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594031a90 con 0x7fa59c0c7a40 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 -- 172.21.15.45:0/2648923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c0c7a40 msgr2=0x7fa59c0c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 --2- 172.21.15.45:0/2648923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c0c7a40 0x7fa59c0c44c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa59402b7a0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 -- 172.21.15.45:0/2648923059 shutdown_connections 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 --2- 172.21.15.45:0/2648923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c0c7a40 0x7fa59c0c44c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 -- 172.21.15.45:0/2648923059 >> 172.21.15.45:0/2648923059 conn(0x7fa59c0ab710 msgr2=0x7fa59c0abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 -- 172.21.15.45:0/2648923059 shutdown_connections 2023-12-08T08:18:14.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.501+0000 7fa5a206d640 1 -- 172.21.15.45:0/2648923059 wait complete. 2023-12-08T08:18:14.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.503+0000 7fa5a206d640 1 Processor -- start 2023-12-08T08:18:14.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.503+0000 7fa5a206d640 1 -- start start 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa59c0c6550 0x7fa59c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa59c0c7a40 0x7fa59c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c148410 con 0x7fa59c14e310 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c158480 con 0x7fa59c0c6550 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a206d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c144d00 con 0x7fa59c0c7a40 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a186c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a186c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35720/0 (socket says 172.21.15.45:35720) 2023-12-08T08:18:14.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a186c640 1 -- 172.21.15.45:0/4148758192 learned_addr learned my addr 172.21.15.45:0/4148758192 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:14.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.504+0000 7fa5a106b640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa59c0c6550 0x7fa59c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a086a640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa59c0c7a40 0x7fa59c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 -- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa59c0c7a40 msgr2=0x7fa59c156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa59c0c7a40 0x7fa59c156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 -- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa59c0c6550 msgr2=0x7fa59c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa59c0c6550 0x7fa59c156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 -- 172.21.15.45:0/4148758192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594009400 con 0x7fa59c14e310 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a186c640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa5940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594033bb0 con 0x7fa59c14e310 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594033d10 con 0x7fa59c14e310 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c0ab3e0 con 0x7fa59c14e310 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.505+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59403c640 con 0x7fa59c14e310 2023-12-08T08:18:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.506+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c0ab100 con 0x7fa59c14e310 2023-12-08T08:18:14.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.507+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c148550 con 0x7fa59c14e310 2023-12-08T08:18:14.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.508+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa59403a040 con 0x7fa59c14e310 2023-12-08T08:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.509+0000 7fa591ffb640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 0x7fa58006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.509+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa5940ab460 con 0x7fa59c14e310 2023-12-08T08:18:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.509+0000 7fa5a106b640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 0x7fa58006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.510+0000 7fa5a106b640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 0x7fa58006d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa598005c00 tx=0x7fa598009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:14.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.514+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa59c148550 con 0x7fa59c14e310 2023-12-08T08:18:14.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.774+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fa59c148550 con 0x7fa59c14e310 2023-12-08T08:18:14.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.775+0000 7fa591ffb640 1 -- 172.21.15.45:0/4148758192 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+245 (secure 0 0 0) 0x7fa59c148550 con 0x7fa59c14e310 2023-12-08T08:18:14.776 INFO:teuthology.orchestra.run.smithi045.stdout:[client.testuser] 2023-12-08T08:18:14.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA== 2023-12-08T08:18:14.777 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-08T08:18:14.777 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-08T08:18:14.777 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:18:14.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 msgr2=0x7fa58006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 0x7fa58006d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa598005c00 tx=0x7fa598009040 comp rx=0 tx=0).stop 2023-12-08T08:18:14.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 msgr2=0x7fa59c1ed380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:14.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa5940046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 shutdown_connections 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa58006ae40 0x7fa58006d300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa59c0c7a40 0x7fa59c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa59c14e310 0x7fa59c1ed380 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 --2- 172.21.15.45:0/4148758192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa59c0c6550 0x7fa59c156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 >> 172.21.15.45:0/4148758192 conn(0x7fa59c0ab710 msgr2=0x7fa59c153730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 shutdown_connections 2023-12-08T08:18:14.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:14.777+0000 7fa5a206d640 1 -- 172.21.15.45:0/4148758192 wait complete. 2023-12-08T08:18:14.799 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:18:14.859 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.pY9LtWeh9M 2023-12-08T08:18:14.860 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:14.860 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/tmp/tmp.pY9LtWeh9M 2023-12-08T08:18:14.916 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:14.916 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:15.020 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:15.021 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:15.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:15.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.298+0000 7f71337d7640 1 Processor -- start 2023-12-08T08:18:15.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.298+0000 7f71337d7640 1 -- start start 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f71337d7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f712c154190 0x7f712c0aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f71337d7640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f712c154a20 0x7f712c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f71337d7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0c63b0 con 0x7f712c0a4f30 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f71337d7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0a9f20 con 0x7f712c154190 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f71337d7640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0a53c0 con 0x7f712c154a20 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f7131573640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f712c154190 0x7f712c0aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f7131573640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f712c154190 0x7f712c0aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39668/0 (socket says 172.21.15.45:39668) 2023-12-08T08:18:15.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.300+0000 7f7131573640 1 -- 172.21.15.45:0/1722815870 learned_addr learned my addr 172.21.15.45:0/1722815870 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:15.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.301+0000 7f7131573640 1 -- 172.21.15.45:0/1722815870 >> v2:172.21.15.114:3300/0 conn(0x7f712c154a20 msgr2=0x7f712c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:15.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.301+0000 7f7131573640 1 --2- 172.21.15.45:0/1722815870 >> v2:172.21.15.114:3300/0 conn(0x7f712c154a20 0x7f712c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.301+0000 7f7131573640 1 -- 172.21.15.45:0/1722815870 >> v1:172.21.15.114:6789/0 conn(0x7f712c0a4f30 legacy=0x7f712c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:15.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.301+0000 7f7131573640 1 -- 172.21.15.45:0/1722815870 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0a9580 con 0x7f712c154190 2023-12-08T08:18:15.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.302+0000 7f7131573640 1 --2- 172.21.15.45:0/1722815870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c0aa2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f712c0aa7f0 tx=0x7f712802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c81e720170ec12 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.302+0000 7f7123fff640 1 -- 172.21.15.45:0/1722815870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280317e0 con 0x7f712c154190 2023-12-08T08:18:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.302+0000 7f7123fff640 1 -- 172.21.15.45:0/1722815870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7128031940 con 0x7f712c154190 2023-12-08T08:18:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.302+0000 7f7123fff640 1 -- 172.21.15.45:0/1722815870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128031cd0 con 0x7f712c154190 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 -- 172.21.15.45:0/1722815870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 msgr2=0x7f712c0aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 --2- 172.21.15.45:0/1722815870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c0aa2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f712c0aa7f0 tx=0x7f712802b880 comp rx=0 tx=0).stop 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 -- 172.21.15.45:0/1722815870 shutdown_connections 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 --2- 172.21.15.45:0/1722815870 >> v2:172.21.15.114:3300/0 conn(0x7f712c154a20 0x7f712c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 --2- 172.21.15.45:0/1722815870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c0aa2b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 -- 172.21.15.45:0/1722815870 >> 172.21.15.45:0/1722815870 conn(0x7f712c0661f0 msgr2=0x7f712c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 -- 172.21.15.45:0/1722815870 shutdown_connections 2023-12-08T08:18:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.303+0000 7f71337d7640 1 -- 172.21.15.45:0/1722815870 wait complete. 2023-12-08T08:18:15.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.305+0000 7f71337d7640 1 Processor -- start 2023-12-08T08:18:15.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.305+0000 7f71337d7640 1 -- start start 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 0x7f712c06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c154a20 0x7f712c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c09b230 con 0x7f712c154190 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c14e6a0 con 0x7f712c154a20 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f71337d7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c099a50 con 0x7f712c0a4f30 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f7130d72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f7130d72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39672/0 (socket says 172.21.15.45:39672) 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.306+0000 7f7130d72640 1 -- 172.21.15.45:0/2215003021 learned_addr learned my addr 172.21.15.45:0/2215003021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7131573640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 0x7f712c06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 -- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 msgr2=0x7f712c06cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7131d74640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c154a20 0x7f712c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 0x7f712c06cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 -- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c154a20 msgr2=0x7f712c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c154a20 0x7f712c14e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 -- 172.21.15.45:0/2215003021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280094d0 con 0x7f712c154190 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7131573640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 0x7f712c06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7130d72640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c440 tx=0x7f711c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c005480 con 0x7f712c154190 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c0035f0 con 0x7f712c154190 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0039c0 con 0x7f712c154190 2023-12-08T08:18:15.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.307+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c1ea580 con 0x7f712c154190 2023-12-08T08:18:15.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.308+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c099ca0 con 0x7f712c154190 2023-12-08T08:18:15.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.309+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c1ecfd0 con 0x7f712c154190 2023-12-08T08:18:15.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.310+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f711c003b20 con 0x7f712c154190 2023-12-08T08:18:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.310+0000 7f7121ffb640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 0x7f711006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.311+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f711c088b90 con 0x7f712c154190 2023-12-08T08:18:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.311+0000 7f7131573640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 0x7f711006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.311+0000 7f7131573640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 0x7f711006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7128036000 tx=0x7f712803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.315+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f712c1ecfd0 con 0x7f712c154190 2023-12-08T08:18:15.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.510+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f712c1ecfd0 con 0x7f712c154190 2023-12-08T08:18:15.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.513+0000 7f7121ffb640 1 -- 172.21.15.45:0/2215003021 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f712c1ecfd0 con 0x7f712c154190 2023-12-08T08:18:15.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:15.515 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:15.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.515+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 msgr2=0x7f711006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.515+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 0x7f711006d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7128036000 tx=0x7f712803d040 comp rx=0 tx=0).stop 2023-12-08T08:18:15.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.515+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 msgr2=0x7f712c14dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.515+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c440 tx=0x7f711c00c900 comp rx=0 tx=0).stop 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 shutdown_connections 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f711006ae70 0x7f711006d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c154a20 0x7f712c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f712c154190 0x7f712c14dc20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 --2- 172.21.15.45:0/2215003021 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f712c0a4f30 0x7f712c06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 >> 172.21.15.45:0/2215003021 conn(0x7f712c0661f0 msgr2=0x7f712c0a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 shutdown_connections 2023-12-08T08:18:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.516+0000 7f71337d7640 1 -- 172.21.15.45:0/2215003021 wait complete. 2023-12-08T08:18:15.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:39.667136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:40.266994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:17:55.154580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:17:56.265883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:15.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.754+0000 7f28cdbe5640 1 Processor -- start 2023-12-08T08:18:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.754+0000 7f28cdbe5640 1 -- start start 2023-12-08T08:18:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.755+0000 7f28cdbe5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f28c80aaf60 0x7f28c80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.755+0000 7f28cdbe5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c8152660 con 0x7f28c806d960 2023-12-08T08:18:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.755+0000 7f28cdbe5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c8153200 con 0x7f28c80c1930 2023-12-08T08:18:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.755+0000 7f28cdbe5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80a4d10 con 0x7f28c80aaf60 2023-12-08T08:18:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.756+0000 7f28beffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f28c806d960 0x7f28c8152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42298/0 (socket says 172.21.15.45:42298) 2023-12-08T08:18:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.756+0000 7f28beffd640 1 -- 172.21.15.45:0/342183207 learned_addr learned my addr 172.21.15.45:0/342183207 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.756+0000 7f28c77fe640 1 --2- 172.21.15.45:0/342183207 >> v2:172.21.15.114:3300/0 conn(0x7f28c80aaf60 0x7f28c80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66117895 0 0) 0x7f28c8152660 con 0x7f28c806d960 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b4003520 con 0x7f28c806d960 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1097952180 0 0) 0x7f28b4003520 con 0x7f28c806d960 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 >> v2:172.21.15.114:3300/0 conn(0x7f28c80aaf60 msgr2=0x7f28c80c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 --2- 172.21.15.45:0/342183207 >> v2:172.21.15.114:3300/0 conn(0x7f28c80aaf60 0x7f28c80c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 >> v1:172.21.15.114:6789/0 conn(0x7f28c80c1930 legacy=0x7f28c815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80c3310 con 0x7f28c806d960 2023-12-08T08:18:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f28b0001670 con 0x7f28c806d960 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 >> v1:172.21.15.45:6789/0 conn(0x7f28c806d960 legacy=0x7f28c8152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b4003970 0x7f28b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 0x7f28b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28b4005180 0x7f28b400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80a4d10 con 0x7f28b40047c0 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4010530 con 0x7f28b4003970 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40106f0 con 0x7f28b4005180 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.757+0000 7f28beffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 0x7f28b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28c7fff640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28b4005180 0x7f28b400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28c77fe640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b4003970 0x7f28b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28beffd640 1 -- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28b4005180 msgr2=0x7f28b400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28beffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28b4005180 0x7f28b400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28beffd640 1 -- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b4003970 msgr2=0x7f28b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28beffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b4003970 0x7f28b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28beffd640 1 -- 172.21.15.45:0/342183207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4003520 con 0x7f28b40047c0 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28c77fe640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b4003970 0x7f28b4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28c7fff640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28b4005180 0x7f28b400fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.758+0000 7f28c7fff640 1 -- 172.21.15.45:0/342183207 reap_dead start 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.759+0000 7f28beffd640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 0x7f28b4004c40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c210 tx=0x7f28b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9375852dc71d48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.759+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0005ad0 con 0x7f28b40047c0 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.759+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0005c30 con 0x7f28b40047c0 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.759+0000 7f28c6ffd640 1 -- 172.21.15.45:0/342183207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b002cac0 con 0x7f28b40047c0 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 -- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 msgr2=0x7f28b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 0x7f28b4004c40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c210 tx=0x7f28b40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 -- 172.21.15.45:0/342183207 shutdown_connections 2023-12-08T08:18:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/342183207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28b40047c0 0x7f28b4004c40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 -- 172.21.15.45:0/342183207 >> 172.21.15.45:0/342183207 conn(0x7f28c80c2430 msgr2=0x7f28c80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 -- 172.21.15.45:0/342183207 shutdown_connections 2023-12-08T08:18:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.760+0000 7f28cdbe5640 1 -- 172.21.15.45:0/342183207 wait complete. 2023-12-08T08:18:15.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.762+0000 7f28cdbe5640 1 Processor -- start 2023-12-08T08:18:15.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.762+0000 7f28cdbe5640 1 -- start start 2023-12-08T08:18:15.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b40047c0 0x7f28c8146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28c8145c40 0x7f28c8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c814bd60 con 0x7f28c80a9d80 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81e6aa0 con 0x7f28b40047c0 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28cdbe5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81e6520 con 0x7f28c8145c40 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39696/0 (socket says 172.21.15.45:39696) 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.763+0000 7f28c7fff640 1 -- 172.21.15.45:0/135949041 learned_addr learned my addr 172.21.15.45:0/135949041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28beffd640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28c8145c40 0x7f28c8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c77fe640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b40047c0 0x7f28c8146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 -- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28c8145c40 msgr2=0x7f28c8153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28c8145c40 0x7f28c8153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 -- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b40047c0 msgr2=0x7f28c8146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b40047c0 0x7f28c8146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 -- 172.21.15.45:0/135949041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c81e67c0 con 0x7f28c80a9d80 2023-12-08T08:18:15.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c7fff640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f28c80c1d10 tx=0x7f28c000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0003970 con 0x7f28c80a9d80 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0003b10 con 0x7f28c80a9d80 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c814b7a0 con 0x7f28c80a9d80 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.764+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0005070 con 0x7f28c80a9d80 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.765+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c80aa200 con 0x7f28c80a9d80 2023-12-08T08:18:15.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.766+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8074670 con 0x7f28c80a9d80 2023-12-08T08:18:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.767+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28c00051d0 con 0x7f28c80a9d80 2023-12-08T08:18:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.768+0000 7f28c4ff9640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.768+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f28c0089750 con 0x7f28c80a9d80 2023-12-08T08:18:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.768+0000 7f28c77fe640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.769+0000 7f28c77fe640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 0x7f28a806d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009a40 tx=0x7f28b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.773+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28c00542e0 con 0x7f28c80a9d80 2023-12-08T08:18:15.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.969+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28c80c5560 con 0x7f28c80a9d80 2023-12-08T08:18:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.970+0000 7f28c4ff9640 1 -- 172.21.15.45:0/135949041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28c0057900 con 0x7f28c80a9d80 2023-12-08T08:18:15.972 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 msgr2=0x7f28a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 0x7f28a806d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009a40 tx=0x7f28b8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 msgr2=0x7f28c8149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f28c80c1d10 tx=0x7f28c000d9d0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 shutdown_connections 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f28a806ae40 0x7f28a806d300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f28c8145c40 0x7f28c8153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28c80a9d80 0x7f28c8149c10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 --2- 172.21.15.45:0/135949041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28b40047c0 0x7f28c8146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 >> 172.21.15.45:0/135949041 conn(0x7f28c80c2430 msgr2=0x7f28c80ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 shutdown_connections 2023-12-08T08:18:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:15.973+0000 7f28cdbe5640 1 -- 172.21.15.45:0/135949041 wait complete. 2023-12-08T08:18:15.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.220+0000 7ff83abdb640 1 Processor -- start 2023-12-08T08:18:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.220+0000 7ff83abdb640 1 -- start start 2023-12-08T08:18:16.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.221+0000 7ff83abdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff834151ec0 0x7ff8340c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff83abdb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 0x7ff83406c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff83abdb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340c16b0 con 0x7ff8340c1d60 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff83abdb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340a8b30 con 0x7ff834151ec0 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff83abdb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c65d0 con 0x7ff8340c4d30 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff834151ec0 0x7ff8340c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff834151ec0 0x7ff8340c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39704/0 (socket says 172.21.15.45:39704) 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 -- 172.21.15.45:0/2152220029 learned_addr learned my addr 172.21.15.45:0/2152220029 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:16.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff83a3da640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 0x7ff83406c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 -- 172.21.15.45:0/2152220029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 msgr2=0x7ff83406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:16.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 0x7ff83406c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 -- 172.21.15.45:0/2152220029 >> v1:172.21.15.114:6789/0 conn(0x7ff8340c1d60 legacy=0x7ff83406ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:16.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.222+0000 7ff839bd9640 1 -- 172.21.15.45:0/2152220029 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340c5810 con 0x7ff834151ec0 2023-12-08T08:18:16.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.223+0000 7ff83a3da640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 0x7ff83406c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:16.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.224+0000 7ff839bd9640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff834151ec0 0x7ff8340c47f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e50 tx=0x7ff83002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c923000d0d324b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.224+0000 7ff838bd7640 1 -- 172.21.15.45:0/2152220029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83002c9f0 con 0x7ff834151ec0 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.224+0000 7ff838bd7640 1 -- 172.21.15.45:0/2152220029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83002cb50 con 0x7ff834151ec0 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.224+0000 7ff838bd7640 1 -- 172.21.15.45:0/2152220029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300343f0 con 0x7ff834151ec0 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 -- 172.21.15.45:0/2152220029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff834151ec0 msgr2=0x7ff8340c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff834151ec0 0x7ff8340c47f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e50 tx=0x7ff83002be50 comp rx=0 tx=0).stop 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 -- 172.21.15.45:0/2152220029 shutdown_connections 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c4d30 0x7ff83406c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 --2- 172.21.15.45:0/2152220029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff834151ec0 0x7ff8340c47f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 -- 172.21.15.45:0/2152220029 >> 172.21.15.45:0/2152220029 conn(0x7ff834066ce0 msgr2=0x7ff8340a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 -- 172.21.15.45:0/2152220029 shutdown_connections 2023-12-08T08:18:16.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.225+0000 7ff83abdb640 1 -- 172.21.15.45:0/2152220029 wait complete. 2023-12-08T08:18:16.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.227+0000 7ff83abdb640 1 Processor -- start 2023-12-08T08:18:16.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.227+0000 7ff83abdb640 1 -- start start 2023-12-08T08:18:16.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c1d60 0x7ff83414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 0x7ff8341e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341e99f0 con 0x7ff8340c4d30 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83414bf50 con 0x7ff834151ec0 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff83abdb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341e9cb0 con 0x7ff8340c1d60 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff8393d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff8393d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39716/0 (socket says 172.21.15.45:39716) 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff8393d8640 1 -- 172.21.15.45:0/4061096749 learned_addr learned my addr 172.21.15.45:0/4061096749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.228+0000 7ff839bd9640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c1d60 0x7ff83414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff83a3da640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 0x7ff8341e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 -- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c1d60 msgr2=0x7ff83414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c1d60 0x7ff83414f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 -- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 msgr2=0x7ff8341e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 0x7ff8341e6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 -- 172.21.15.45:0/4061096749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009b30 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff83a3da640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 0x7ff8341e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff8393d8640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b3f0 tx=0x7ff82400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011830 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824011990 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8341e9f90 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.229+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011d40 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.230+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83414f570 con 0x7ff8340c4d30 2023-12-08T08:18:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.231+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8341ea4b0 con 0x7ff8340c4d30 2023-12-08T08:18:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.232+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff82401a400 con 0x7ff8340c4d30 2023-12-08T08:18:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.233+0000 7ff82a7fc640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 0x7ff81806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.233+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7ff824089950 con 0x7ff8340c4d30 2023-12-08T08:18:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.233+0000 7ff839bd9640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 0x7ff81806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.234+0000 7ff839bd9640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 0x7ff81806d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff830035000 tx=0x7ff830030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.238+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8341ea4b0 con 0x7ff8340c4d30 2023-12-08T08:18:16.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.430+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8341ea4b0 con 0x7ff8340c4d30 2023-12-08T08:18:16.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.431+0000 7ff82a7fc640 1 -- 172.21.15.45:0/4061096749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8341ea4b0 con 0x7ff8340c4d30 2023-12-08T08:18:16.434 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 msgr2=0x7ff81806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 0x7ff81806d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff830035000 tx=0x7ff830030000 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 msgr2=0x7ff83414b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b3f0 tx=0x7ff82400b8b0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 shutdown_connections 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff81806ae40 0x7ff81806d300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff834151ec0 0x7ff8341e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.434+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8340c4d30 0x7ff83414b700 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.435+0000 7ff83abdb640 1 --2- 172.21.15.45:0/4061096749 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8340c1d60 0x7ff83414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.435+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 >> 172.21.15.45:0/4061096749 conn(0x7ff834066ce0 msgr2=0x7ff8341510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.435+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 shutdown_connections 2023-12-08T08:18:16.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.435+0000 7ff83abdb640 1 -- 172.21.15.45:0/4061096749 wait complete. 2023-12-08T08:18:16.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:16.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.686+0000 7f03effff640 1 Processor -- start 2023-12-08T08:18:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.686+0000 7f03effff640 1 -- start start 2023-12-08T08:18:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.687+0000 7f03effff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f0154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.687+0000 7f03effff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03f006c230 0x7f03f0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.687+0000 7f03effff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f0151eb0 con 0x7f03f0151ad0 2023-12-08T08:18:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.687+0000 7f03effff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00c56a0 con 0x7f03f006c230 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.687+0000 7f03effff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c80d0 con 0x7f03f0157a20 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03f006c230 0x7f03f0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03f006c230 0x7f03f0154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39730/0 (socket says 172.21.15.45:39730) 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 -- 172.21.15.45:0/2017292179 learned_addr learned my addr 172.21.15.45:0/2017292179 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ee7fc640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 -- 172.21.15.45:0/2017292179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 msgr2=0x7f03f0154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f0154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 -- 172.21.15.45:0/2017292179 >> v1:172.21.15.114:6789/0 conn(0x7f03f0151ad0 legacy=0x7f03f00ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.688+0000 7f03ef7fe640 1 -- 172.21.15.45:0/2017292179 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0154430 con 0x7f03f006c230 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.690+0000 7f03ef7fe640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f0154e70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601f6702dacbb910 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.690+0000 7f03edffb640 1 -- 172.21.15.45:0/2017292179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8030840 con 0x7f03f006c230 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.690+0000 7f03edffb640 1 -- 172.21.15.45:0/2017292179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80309a0 con 0x7f03f006c230 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.690+0000 7f03edffb640 1 -- 172.21.15.45:0/2017292179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8030d30 con 0x7f03f006c230 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 -- 172.21.15.45:0/2017292179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 msgr2=0x7f03f0154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f0154e70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e802b980 comp rx=0 tx=0).stop 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 -- 172.21.15.45:0/2017292179 shutdown_connections 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f0154e70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 --2- 172.21.15.45:0/2017292179 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 -- 172.21.15.45:0/2017292179 >> 172.21.15.45:0/2017292179 conn(0x7f03f0066610 msgr2=0x7f03f0066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 -- 172.21.15.45:0/2017292179 shutdown_connections 2023-12-08T08:18:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.691+0000 7f03effff640 1 -- 172.21.15.45:0/2017292179 wait complete. 2023-12-08T08:18:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.693+0000 7f03effff640 1 Processor -- start 2023-12-08T08:18:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.693+0000 7f03effff640 1 -- start start 2023-12-08T08:18:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f0151ad0 0x7f03f00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f01ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ab580 con 0x7f03f006c230 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a9f90 con 0x7f03f0151ad0 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03effff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00aa1e0 con 0x7f03f0157a20 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39734/0 (socket says 172.21.15.45:39734) 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03eeffd640 1 -- 172.21.15.45:0/2928319445 learned_addr learned my addr 172.21.15.45:0/2928319445 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.694+0000 7f03ee7fc640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f0151ad0 0x7f03f00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03ef7fe640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f01ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 -- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 msgr2=0x7f03f01ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f01ea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 -- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f0151ad0 msgr2=0x7f03f00c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f0151ad0 0x7f03f00c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 -- 172.21.15.45:0/2928319445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80094d0 con 0x7f03f006c230 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03eeffd640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c870 tx=0x7f03e000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0003b70 con 0x7f03f006c230 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0003cf0 con 0x7f03f006c230 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00aa4c0 con 0x7f03f006c230 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000aa90 con 0x7f03f006c230 2023-12-08T08:18:16.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.695+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01ed970 con 0x7f03f006c230 2023-12-08T08:18:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.697+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00743e0 con 0x7f03f006c230 2023-12-08T08:18:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.698+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03e000abf0 con 0x7f03f006c230 2023-12-08T08:18:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.698+0000 7f03e7fff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.699+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f03e0089a00 con 0x7f03f006c230 2023-12-08T08:18:16.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.699+0000 7f03ee7fc640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.700+0000 7f03ee7fc640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 0x7f03d006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:16.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.703+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03e0054590 con 0x7f03f006c230 2023-12-08T08:18:16.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.900+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03f014de90 con 0x7f03f006c230 2023-12-08T08:18:16.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.901+0000 7f03e7fff640 1 -- 172.21.15.45:0/2928319445 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03e0003e60 con 0x7f03f006c230 2023-12-08T08:18:16.904 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 msgr2=0x7f03d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 0x7f03d006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 msgr2=0x7f03f01ee170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c870 tx=0x7f03e000cd30 comp rx=0 tx=0).stop 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 shutdown_connections 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f0157a20 0x7f03f01ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f0151ad0 0x7f03f00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 --2- 172.21.15.45:0/2928319445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f006c230 0x7f03f01ee170 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:16.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 >> 172.21.15.45:0/2928319445 conn(0x7f03f0066610 msgr2=0x7f03f00c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:16.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 shutdown_connections 2023-12-08T08:18:16.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:16.904+0000 7f03effff640 1 -- 172.21.15.45:0/2928319445 wait complete. 2023-12-08T08:18:16.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:18:17.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.159+0000 7f06a0e00640 1 Processor -- start 2023-12-08T08:18:17.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.159+0000 7f06a0e00640 1 -- start start 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.161+0000 7f06a0e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.161+0000 7f06a0e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f069c06ca50 0x7f069c0bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.161+0000 7f06a0e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0c5670 con 0x7f069c0c4a60 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.161+0000 7f06a0e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c158120 con 0x7f069c06ca50 2023-12-08T08:18:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.161+0000 7f06a0e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0a4f60 con 0x7f069c151d70 2023-12-08T08:18:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:33664/0 (socket says 172.21.15.45:33664) 2023-12-08T08:18:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 -- 172.21.15.45:0/1370489977 learned_addr learned my addr 172.21.15.45:0/1370489977 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069ad9d640 1 --2- 172.21.15.45:0/1370489977 >> v2:172.21.15.114:3300/0 conn(0x7f069c06ca50 0x7f069c0bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 -- 172.21.15.45:0/1370489977 >> v2:172.21.15.114:3300/0 conn(0x7f069c06ca50 msgr2=0x7f069c0bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 --2- 172.21.15.45:0/1370489977 >> v2:172.21.15.114:3300/0 conn(0x7f069c06ca50 0x7f069c0bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 -- 172.21.15.45:0/1370489977 >> v1:172.21.15.114:6789/0 conn(0x7f069c0c4a60 legacy=0x7f069c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.162+0000 7f069a59c640 1 -- 172.21.15.45:0/1370489977 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0a5240 con 0x7f069c151d70 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.164+0000 7f069a59c640 1 --2- 172.21.15.45:0/1370489977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f068c009870 tx=0x7f068c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d4df0769aa0722 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.164+0000 7f0699d9b640 1 -- 172.21.15.45:0/1370489977 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c0317c0 con 0x7f069c151d70 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.164+0000 7f0699d9b640 1 -- 172.21.15.45:0/1370489977 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c031920 con 0x7f069c151d70 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.164+0000 7f0699d9b640 1 -- 172.21.15.45:0/1370489977 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c031cb0 con 0x7f069c151d70 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 -- 172.21.15.45:0/1370489977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 msgr2=0x7f069c155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 --2- 172.21.15.45:0/1370489977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f068c009870 tx=0x7f068c02b860 comp rx=0 tx=0).stop 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 -- 172.21.15.45:0/1370489977 shutdown_connections 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 --2- 172.21.15.45:0/1370489977 >> v2:172.21.15.114:3300/0 conn(0x7f069c06ca50 0x7f069c0bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 --2- 172.21.15.45:0/1370489977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c155050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 -- 172.21.15.45:0/1370489977 >> 172.21.15.45:0/1370489977 conn(0x7f069c0c2430 msgr2=0x7f069c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 -- 172.21.15.45:0/1370489977 shutdown_connections 2023-12-08T08:18:17.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.165+0000 7f06a0e00640 1 -- 172.21.15.45:0/1370489977 wait complete. 2023-12-08T08:18:17.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.167+0000 7f06a0e00640 1 Processor -- start 2023-12-08T08:18:17.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.167+0000 7f06a0e00640 1 -- start start 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069c06ca50 0x7f069c157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1ed450 con 0x7f069c0c4a60 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1edcf0 con 0x7f069c06ca50 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f06a0e00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1576a0 con 0x7f069c151d70 2023-12-08T08:18:17.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f0693fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f0693fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39750/0 (socket says 172.21.15.45:39750) 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.168+0000 7f0693fff640 1 -- 172.21.15.45:0/2319487329 learned_addr learned my addr 172.21.15.45:0/2319487329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f069ad9d640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f069a59c640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069c06ca50 0x7f069c157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 -- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 msgr2=0x7f069c152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 -- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069c06ca50 msgr2=0x7f069c157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069c06ca50 0x7f069c157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 -- 172.21.15.45:0/2319487329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0094d0 con 0x7f069c0c4a60 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0693fff640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f068400c400 tx=0x7f068400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.169+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840052d0 con 0x7f069c0c4a60 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.170+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684005450 con 0x7f069c0c4a60 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.170+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684007260 con 0x7f069c0c4a60 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.170+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c157920 con 0x7f069c0c4a60 2023-12-08T08:18:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.170+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c1ed980 con 0x7f069c0c4a60 2023-12-08T08:18:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.171+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c1edb40 con 0x7f069c0c4a60 2023-12-08T08:18:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.172+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06840073c0 con 0x7f069c0c4a60 2023-12-08T08:18:17.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.173+0000 7f0692ffd640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.173+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f0684088ff0 con 0x7f069c0c4a60 2023-12-08T08:18:17.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.173+0000 7f069a59c640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.174+0000 7f069a59c640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 0x7f067c06d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f068c036000 tx=0x7f068c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.178+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0684053b00 con 0x7f069c0c4a60 2023-12-08T08:18:17.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.369+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f069c074670 con 0x7f069c0c4a60 2023-12-08T08:18:17.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.370+0000 7f0692ffd640 1 -- 172.21.15.45:0/2319487329 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0684057120 con 0x7f069c0c4a60 2023-12-08T08:18:17.373 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 msgr2=0x7f067c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 0x7f067c06d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f068c036000 tx=0x7f068c03d040 comp rx=0 tx=0).stop 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 msgr2=0x7f069c14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f068400c400 tx=0x7f068400c8c0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 shutdown_connections 2023-12-08T08:18:17.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f067c06ae40 0x7f067c06d300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f069c151d70 0x7f069c152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c0c4a60 0x7f069c14c1d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 --2- 172.21.15.45:0/2319487329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069c06ca50 0x7f069c157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 >> 172.21.15.45:0/2319487329 conn(0x7f069c0c2430 msgr2=0x7f069c06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 shutdown_connections 2023-12-08T08:18:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.373+0000 7f06a0e00640 1 -- 172.21.15.45:0/2319487329 wait complete. 2023-12-08T08:18:17.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:18:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.626+0000 7f41a4d01640 1 Processor -- start 2023-12-08T08:18:17.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.626+0000 7f41a4d01640 1 -- start start 2023-12-08T08:18:17.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41a0147bb0 0x7f41a00c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c1ff0 0x7f41a00c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a00c51d0 0x7f41a0154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a00c0d40 con 0x7f41a00c51d0 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a00c1c50 con 0x7f41a0147bb0 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f41a4d01640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01555c0 con 0x7f41a00c1ff0 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f419ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a00c51d0 0x7f41a0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f419ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a00c51d0 0x7f41a0154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39762/0 (socket says 172.21.15.45:39762) 2023-12-08T08:18:17.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.628+0000 7f419ed9d640 1 -- 172.21.15.45:0/3690586680 learned_addr learned my addr 172.21.15.45:0/3690586680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419e59c640 1 --2- 172.21.15.45:0/3690586680 >> v2:172.21.15.114:3300/0 conn(0x7f41a0147bb0 0x7f41a00c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419dd9b640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c1ff0 0x7f41a00c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419ed9d640 1 -- 172.21.15.45:0/3690586680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c1ff0 msgr2=0x7f41a00c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419ed9d640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c1ff0 0x7f41a00c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419ed9d640 1 -- 172.21.15.45:0/3690586680 >> v2:172.21.15.114:3300/0 conn(0x7f41a0147bb0 msgr2=0x7f41a00c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419ed9d640 1 --2- 172.21.15.45:0/3690586680 >> v2:172.21.15.114:3300/0 conn(0x7f41a0147bb0 0x7f41a00c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.629+0000 7f419ed9d640 1 -- 172.21.15.45:0/3690586680 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a00a4d10 con 0x7f41a00c51d0 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.630+0000 7f419ed9d640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a00c51d0 0x7f41a0154840 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41a00c1f80 tx=0x7f419802db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3adb5d6b4470f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.630+0000 7f419d59a640 1 -- 172.21.15.45:0/3690586680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419802f8e0 con 0x7f41a00c51d0 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.630+0000 7f419d59a640 1 -- 172.21.15.45:0/3690586680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419802fa40 con 0x7f41a00c51d0 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.630+0000 7f419d59a640 1 -- 172.21.15.45:0/3690586680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419802fdd0 con 0x7f41a00c51d0 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 -- 172.21.15.45:0/3690586680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a00c51d0 msgr2=0x7f41a0154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a00c51d0 0x7f41a0154840 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f41a00c1f80 tx=0x7f419802db20 comp rx=0 tx=0).stop 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 -- 172.21.15.45:0/3690586680 shutdown_connections 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a00c51d0 0x7f41a0154840 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 --2- 172.21.15.45:0/3690586680 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c1ff0 0x7f41a00c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 --2- 172.21.15.45:0/3690586680 >> v2:172.21.15.114:3300/0 conn(0x7f41a0147bb0 0x7f41a00c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 -- 172.21.15.45:0/3690586680 >> 172.21.15.45:0/3690586680 conn(0x7f41a00c2430 msgr2=0x7f41a00c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 -- 172.21.15.45:0/3690586680 shutdown_connections 2023-12-08T08:18:17.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.631+0000 7f41a4d01640 1 -- 172.21.15.45:0/3690586680 wait complete. 2023-12-08T08:18:17.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.633+0000 7f41a4d01640 1 Processor -- start 2023-12-08T08:18:17.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.633+0000 7f41a4d01640 1 -- start start 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c51d0 0x7f41a01edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 0x7f41a0146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a014f0c0 con 0x7f41a0147bb0 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0072500 con 0x7f41a014b3e0 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.634+0000 7f41a4d01640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00727e0 con 0x7f41a00c51d0 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39776/0 (socket says 172.21.15.45:39776) 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 -- 172.21.15.45:0/2878514651 learned_addr learned my addr 172.21.15.45:0/2878514651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419ed9d640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 0x7f41a0146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 -- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c51d0 msgr2=0x7f41a01edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c51d0 0x7f41a01edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 -- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 msgr2=0x7f41a0146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 0x7f41a0146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419dd9b640 1 -- 172.21.15.45:0/2878514651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980094d0 con 0x7f41a0147bb0 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.635+0000 7f419ed9d640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 0x7f41a0146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f419dd9b640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f418800d800 tx=0x7f418800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880096a0 con 0x7f41a0147bb0 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188009800 con 0x7f41a0147bb0 2023-12-08T08:18:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188009b90 con 0x7f41a0147bb0 2023-12-08T08:18:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a014f310 con 0x7f41a0147bb0 2023-12-08T08:18:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.636+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a0155010 con 0x7f41a0147bb0 2023-12-08T08:18:17.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.637+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a0074670 con 0x7f41a0147bb0 2023-12-08T08:18:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.638+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4188009cf0 con 0x7f41a0147bb0 2023-12-08T08:18:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.639+0000 7f4196ffd640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 0x7f418006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.639+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f4188089fe0 con 0x7f41a0147bb0 2023-12-08T08:18:17.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.640+0000 7f419e59c640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 0x7f418006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.640+0000 7f419e59c640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 0x7f418006d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f41900070b0 tx=0x7f4190007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.643+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4188054b40 con 0x7f41a0147bb0 2023-12-08T08:18:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.839+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f41a0072950 con 0x7f41a0147bb0 2023-12-08T08:18:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.840+0000 7f4196ffd640 1 -- 172.21.15.45:0/2878514651 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7f418800b440 con 0x7f41a0147bb0 2023-12-08T08:18:17.843 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 msgr2=0x7f418006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 0x7f418006d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f41900070b0 tx=0x7f4190007040 comp rx=0 tx=0).stop 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 msgr2=0x7f41a00c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f418800d800 tx=0x7f418800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 shutdown_connections 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f418006ae40 0x7f418006d300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41a014b3e0 0x7f41a0146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0147bb0 0x7f41a00c3790 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 --2- 172.21.15.45:0/2878514651 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f41a00c51d0 0x7f41a01edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 >> 172.21.15.45:0/2878514651 conn(0x7f41a00c2430 msgr2=0x7f41a006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 shutdown_connections 2023-12-08T08:18:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:17.843+0000 7f41a4d01640 1 -- 172.21.15.45:0/2878514651 wait complete. 2023-12-08T08:18:17.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.074+0000 7f896723d640 1 Processor -- start 2023-12-08T08:18:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.074+0000 7f896723d640 1 -- start start 2023-12-08T08:18:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.075+0000 7f896723d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8960155220 0x7f89600c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.075+0000 7f896723d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 0x7f8960158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f896723d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8960155600 con 0x7f89600c1280 2023-12-08T08:18:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f896723d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8960157bc0 con 0x7f8960155220 2023-12-08T08:18:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f896723d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c4220 con 0x7f89600c2b00 2023-12-08T08:18:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f89657da640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89600c1280 0x7f8960158590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42306/0 (socket says 172.21.15.45:42306) 2023-12-08T08:18:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f89657da640 1 -- 172.21.15.45:0/1553658744 learned_addr learned my addr 172.21.15.45:0/1553658744 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f8964fd9640 1 --2- 172.21.15.45:0/1553658744 >> v2:172.21.15.114:3300/0 conn(0x7f8960155220 0x7f89600c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f895ffff640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 0x7f8960158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809167512 0 0) 0x7f8960155600 con 0x7f89600c1280 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.076+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8950003520 con 0x7f89600c1280 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1951366635 0 0) 0x7f8950003520 con 0x7f89600c1280 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 msgr2=0x7f8960158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 0x7f8960158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 >> v2:172.21.15.114:3300/0 conn(0x7f8960155220 msgr2=0x7f89600c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 --2- 172.21.15.45:0/1553658744 >> v2:172.21.15.114:3300/0 conn(0x7f8960155220 0x7f89600c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600c4500 con 0x7f89600c1280 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f89580019f0 con 0x7f89600c1280 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 >> v1:172.21.15.45:6789/0 conn(0x7f89600c1280 legacy=0x7f8960158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8950003970 0x7f8950003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89500047c0 0x7f8950004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 0x7f8950005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960157bc0 con 0x7f89500047c0 2023-12-08T08:18:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c4220 con 0x7f8950003970 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895000b980 con 0x7f89600c2b00 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.077+0000 7f895ffff640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89500047c0 0x7f8950004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f8964fd9640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8950003970 0x7f8950003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f895ffff640 1 -- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 msgr2=0x7f8950005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f895ffff640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89600c2b00 0x7f8950005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f895ffff640 1 -- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8950003970 msgr2=0x7f8950003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f895ffff640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8950003970 0x7f8950003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.078+0000 7f895ffff640 1 -- 172.21.15.45:0/1553658744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950003520 con 0x7f89500047c0 2023-12-08T08:18:18.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.079+0000 7f895ffff640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89500047c0 0x7f8950004c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f894c00ba00 tx=0x7f89500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404bbf8558e7b3fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.079+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c032640 con 0x7f89500047c0 2023-12-08T08:18:18.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.079+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0327a0 con 0x7f89500047c0 2023-12-08T08:18:18.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.079+0000 7f895f7fe640 1 -- 172.21.15.45:0/1553658744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c032b30 con 0x7f89500047c0 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 -- 172.21.15.45:0/1553658744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89500047c0 msgr2=0x7f8950004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 --2- 172.21.15.45:0/1553658744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89500047c0 0x7f8950004c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f894c00ba00 tx=0x7f89500057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f89657da640 1 -- 172.21.15.45:0/1553658744 reap_dead start 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 -- 172.21.15.45:0/1553658744 shutdown_connections 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 -- 172.21.15.45:0/1553658744 >> 172.21.15.45:0/1553658744 conn(0x7f8960066db0 msgr2=0x7f89600c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 -- 172.21.15.45:0/1553658744 shutdown_connections 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.080+0000 7f896723d640 1 -- 172.21.15.45:0/1553658744 wait complete. 2023-12-08T08:18:18.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.082+0000 7f896723d640 1 Processor -- start 2023-12-08T08:18:18.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.082+0000 7f896723d640 1 -- start start 2023-12-08T08:18:18.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89500047c0 0x7f89601582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8960072730 0x7f89601ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600a76f0 con 0x7f89601ea580 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89601eab20 con 0x7f8960072730 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f896723d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960071a20 con 0x7f89500047c0 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f89657da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f89657da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39796/0 (socket says 172.21.15.45:39796) 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.083+0000 7f89657da640 1 -- 172.21.15.45:0/1185439742 learned_addr learned my addr 172.21.15.45:0/1185439742 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f895ffff640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8960072730 0x7f89601ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 -- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89500047c0 msgr2=0x7f89601582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89500047c0 0x7f89601582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 -- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8960072730 msgr2=0x7f89601ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8960072730 0x7f89601ed670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 -- 172.21.15.45:0/1185439742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89601ed190 con 0x7f89601ea580 2023-12-08T08:18:18.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f89657da640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f89600c3950 tx=0x7f895800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800a5b0 con 0x7f89601ea580 2023-12-08T08:18:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800a710 con 0x7f89601ea580 2023-12-08T08:18:18.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960071cc0 con 0x7f89601ea580 2023-12-08T08:18:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.084+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800aac0 con 0x7f89601ea580 2023-12-08T08:18:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.085+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8960158800 con 0x7f89601ea580 2023-12-08T08:18:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.086+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8960074600 con 0x7f89601ea580 2023-12-08T08:18:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.087+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f895800ac20 con 0x7f89601ea580 2023-12-08T08:18:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.088+0000 7f895d7fa640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 0x7f894406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.088+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f89580898c0 con 0x7f89601ea580 2023-12-08T08:18:18.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.088+0000 7f8964fd9640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 0x7f894406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.089+0000 7f8964fd9640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 0x7f894406d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8954009990 tx=0x7f8954008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.092+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8958054450 con 0x7f89601ea580 2023-12-08T08:18:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.298+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f89601ed320 con 0x7f89601ea580 2023-12-08T08:18:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.299+0000 7f895d7fa640 1 -- 172.21.15.45:0/1185439742 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8958057a70 con 0x7f89601ea580 2023-12-08T08:18:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:18:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.301+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 msgr2=0x7f894406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.301+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 0x7f894406d330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8954009990 tx=0x7f8954008040 comp rx=0 tx=0).stop 2023-12-08T08:18:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.301+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 msgr2=0x7f89601edbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.301+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f89600c3950 tx=0x7f895800ccd0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 shutdown_connections 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f894406ae70 0x7f894406d330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89601ea580 0x7f89601edbb0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8960072730 0x7f89601ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 --2- 172.21.15.45:0/1185439742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89500047c0 0x7f89601582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 >> 172.21.15.45:0/1185439742 conn(0x7f8960066db0 msgr2=0x7f89600c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 shutdown_connections 2023-12-08T08:18:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.302+0000 7f896723d640 1 -- 172.21.15.45:0/1185439742 wait complete. 2023-12-08T08:18:18.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:18:18.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:18.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:18.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:18:18.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:18.437 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:18:18.488 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:18.489 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:18.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:18:18.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:18.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.754+0000 7f8c8ba00640 1 Processor -- start 2023-12-08T08:18:18.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.755+0000 7f8c8ba00640 1 -- start start 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.756+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c840a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.756+0000 7f8c8ba00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840c63b0 con 0x7f8c84154190 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.756+0000 7f8c8ba00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840a9580 con 0x7f8c84154a20 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.756+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840a9f20 con 0x7f8c840aa2b0 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c8979c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8c84154190 0x7f8c840c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42314/0 (socket says 172.21.15.45:42314) 2023-12-08T08:18:18.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c8979c640 1 -- 172.21.15.45:0/3934851135 learned_addr learned my addr 172.21.15.45:0/3934851135 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c88f9b640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c840a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907637463 0 0) 0x7f8c840c63b0 con 0x7f8c84154190 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003520 con 0x7f8c84154190 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.757+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775316031 0 0) 0x7f8c70003520 con 0x7f8c84154190 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 msgr2=0x7f8c840a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c840a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 >> v1:172.21.15.114:6789/0 conn(0x7f8c84154a20 legacy=0x7f8c84154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840a9860 con 0x7f8c84154190 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8c80001670 con 0x7f8c84154190 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 >> v1:172.21.15.45:6789/0 conn(0x7f8c84154190 legacy=0x7f8c840c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c700039a0 0x7f8c70003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840a9f20 con 0x7f8c700039a0 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7000bb10 con 0x7f8c70004d00 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7000dee0 con 0x7f8c840aa2b0 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c8979c640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c700039a0 0x7f8c70003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c89f9d640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c88f9b640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c8979c640 1 -- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 msgr2=0x7f8c700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c8979c640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c840aa2b0 0x7f8c700047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c8979c640 1 -- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c70004d00 msgr2=0x7f8c70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.758+0000 7f8c8979c640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.759+0000 7f8c8979c640 1 -- 172.21.15.45:0/3934851135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70003520 con 0x7f8c700039a0 2023-12-08T08:18:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.759+0000 7f8c89f9d640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c70004d00 0x7f8c70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c8979c640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c700039a0 0x7f8c70003dc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c0e0 tx=0x7f8c700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c298df8c7e47ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80005ad0 con 0x7f8c700039a0 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c80005c30 con 0x7f8c700039a0 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c7bfff640 1 -- 172.21.15.45:0/3934851135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002ca50 con 0x7f8c700039a0 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c8ba00640 1 -- 172.21.15.45:0/3934851135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c700039a0 msgr2=0x7f8c70003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/3934851135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c700039a0 0x7f8c70003dc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c0e0 tx=0x7f8c700057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.760+0000 7f8c89f9d640 1 -- 172.21.15.45:0/3934851135 reap_dead start 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.761+0000 7f8c8ba00640 1 -- 172.21.15.45:0/3934851135 shutdown_connections 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.761+0000 7f8c8ba00640 1 -- 172.21.15.45:0/3934851135 >> 172.21.15.45:0/3934851135 conn(0x7f8c840661f0 msgr2=0x7f8c84066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.761+0000 7f8c8ba00640 1 -- 172.21.15.45:0/3934851135 shutdown_connections 2023-12-08T08:18:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.761+0000 7f8c8ba00640 1 -- 172.21.15.45:0/3934851135 wait complete. 2023-12-08T08:18:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.762+0000 7f8c8ba00640 1 Processor -- start 2023-12-08T08:18:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 -- start start 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 0x7f8c841e54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c8414f050 0x7f8c84070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840aa710 con 0x7f8c840bace0 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840beff0 con 0x7f8c700039a0 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.763+0000 7f8c8ba00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840bebd0 con 0x7f8c8414f050 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39810/0 (socket says 172.21.15.45:39810) 2023-12-08T08:18:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 -- 172.21.15.45:0/2399888689 learned_addr learned my addr 172.21.15.45:0/2399888689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c8979c640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 0x7f8c841e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c89f9d640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c8414f050 0x7f8c84070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 -- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c8414f050 msgr2=0x7f8c84070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c8414f050 0x7f8c84070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 -- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 msgr2=0x7f8c841e54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 0x7f8c841e54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c88f9b640 1 -- 172.21.15.45:0/2399888689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840bf220 con 0x7f8c840bace0 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.764+0000 7f8c8979c640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 0x7f8c841e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:18.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c88f9b640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8c74010890 tx=0x7f8c74010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74009610 con 0x7f8c840bace0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7400eb60 con 0x7f8c840bace0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7401c400 con 0x7f8c840bace0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c840bf500 con 0x7f8c840bace0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.765+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c840bfac0 con 0x7f8c840bace0 2023-12-08T08:18:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.766+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c84074600 con 0x7f8c840bace0 2023-12-08T08:18:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.767+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c7401c560 con 0x7f8c840bace0 2023-12-08T08:18:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.768+0000 7f8c79ffb640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 0x7f8c6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.768+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f8c7408a090 con 0x7f8c840bace0 2023-12-08T08:18:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.769+0000 7f8c8979c640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 0x7f8c6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.769+0000 7f8c8979c640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 0x7f8c6806d300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c80034000 tx=0x7f8c80009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:18.772+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c74054c40 con 0x7f8c840bace0 2023-12-08T08:18:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.005+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8c840c0720 con 0x7f8c840bace0 2023-12-08T08:18:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.006+0000 7f8c79ffb640 1 -- 172.21.15.45:0/2399888689 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7f8c74058260 con 0x7f8c840bace0 2023-12-08T08:18:19.009 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:18:19.009 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 msgr2=0x7f8c6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 0x7f8c6806d300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c80034000 tx=0x7f8c80009030 comp rx=0 tx=0).stop 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 msgr2=0x7f8c8414eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8c74010890 tx=0x7f8c74010d50 comp rx=0 tx=0).stop 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 shutdown_connections 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c6806ae40 0x7f8c6806d300 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8c8414f050 0x7f8c84070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c840bace0 0x7f8c8414eb10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 --2- 172.21.15.45:0/2399888689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c700039a0 0x7f8c841e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.008+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 >> 172.21.15.45:0/2399888689 conn(0x7f8c840661f0 msgr2=0x7f8c840a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:19.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.009+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 shutdown_connections 2023-12-08T08:18:19.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:19.009+0000 7f8c8ba00640 1 -- 172.21.15.45:0/2399888689 wait complete. 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:18:19.029 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.pY9LtWeh9M 2023-12-08T08:18:19.030 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:18:19.086 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.8Z7C8rCtu4 2023-12-08T08:18:19.086 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /tmp/tmp.pY9LtWeh9M /tmp/tmp.8Z7C8rCtu4 2023-12-08T08:18:19.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.8Z7C8rCtu4 2023-12-08T08:18:19.363 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.8Z7C8rCtu4 is 245B 2023-12-08T08:18:19.431 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.8Z7C8rCtu4 2023-12-08T08:18:19.492 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:18:19.492 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:18:19.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.493 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:18:19.554 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:19.554 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:19.554 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:19.554 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:19.555 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41933sec preferred_lft 41933sec 2023-12-08T08:18:19.556 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:18:19.557 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:18:19.558 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:19.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.559 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:19.650 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:18:19.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.654 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:18:19.712 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:18:19.712 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:19.712 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:18:19.712 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:18:19.712 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:19.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.713 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:18:19.713 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:18:19.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:18:19.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:18:19.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:18:19.714 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:18:19.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.915 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:18:19.971 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:18:19.972 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:18:19.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:19.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:18:20.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:20.074 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:20.132 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:18:20.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:20.133 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:20.186 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:20.186 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/tmp/tmp.pY9LtWeh9M of=/dev/stdout 2023-12-08T08:18:20.242 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:18:20.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:20.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:20.408 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:20.408 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:18:20.408 INFO:teuthology.orchestra.run.smithi045.stdout:keyring.get_secret failed 2023-12-08T08:18:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:mount.ceph: kernel BUG! 2023-12-08T08:18:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:mount error 13 = Permission denied 2023-12-08T08:18:20.446 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:18:20.446 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:18:20.447 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:18:20.447 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: testuser@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:18:20.447 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:18:20.452 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-08T08:18:20.452 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-08T08:18:20.452 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:18:20.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:20.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:20.684 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:18:20.684 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:20.684 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:20.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:18:20.746 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:20.746 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:20.808 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:20.808 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:20.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.096+0000 7f5e991ff640 1 Processor -- start 2023-12-08T08:18:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.096+0000 7f5e991ff640 1 -- start start 2023-12-08T08:18:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e991ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e9414e840 0x7f5e94151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e991ff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e940c1210 0x7f5e940c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e991ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e94151ea0 con 0x7f5e940a9e80 2023-12-08T08:18:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e991ff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9414ec20 con 0x7f5e940c1210 2023-12-08T08:18:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e991ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94154850 con 0x7f5e9414e840 2023-12-08T08:18:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e989fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e940a9e80 0x7f5e940aa310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42322/0 (socket says 172.21.15.45:42322) 2023-12-08T08:18:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e989fe640 1 -- 172.21.15.45:0/497964973 learned_addr learned my addr 172.21.15.45:0/497964973 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:21.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.098+0000 7f5e8b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e940c1210 0x7f5e940c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.099+0000 7f5e93fff640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e9414e840 0x7f5e94151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.099+0000 7f5e8b7fe640 1 -- 172.21.15.45:0/497964973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e9414e840 msgr2=0x7f5e94151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.099+0000 7f5e8b7fe640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e9414e840 0x7f5e94151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.099+0000 7f5e8b7fe640 1 -- 172.21.15.45:0/497964973 >> v1:172.21.15.45:6789/0 conn(0x7f5e940a9e80 legacy=0x7f5e940aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.099+0000 7f5e8b7fe640 1 -- 172.21.15.45:0/497964973 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94154b30 con 0x7f5e940c1210 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.100+0000 7f5e8b7fe640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e940c1210 0x7f5e940c1670 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009d90 tx=0x7f5e7c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a78a82325148bd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.100+0000 7f5e937fe640 1 -- 172.21.15.45:0/497964973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c02cbd0 con 0x7f5e940c1210 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.100+0000 7f5e937fe640 1 -- 172.21.15.45:0/497964973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c02cd30 con 0x7f5e940c1210 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.100+0000 7f5e937fe640 1 -- 172.21.15.45:0/497964973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c02cea0 con 0x7f5e940c1210 2023-12-08T08:18:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 -- 172.21.15.45:0/497964973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e940c1210 msgr2=0x7f5e940c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e940c1210 0x7f5e940c1670 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009d90 tx=0x7f5e7c02be20 comp rx=0 tx=0).stop 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 -- 172.21.15.45:0/497964973 shutdown_connections 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e940c1210 0x7f5e940c1670 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 --2- 172.21.15.45:0/497964973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e9414e840 0x7f5e94151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 -- 172.21.15.45:0/497964973 >> 172.21.15.45:0/497964973 conn(0x7f5e940c5780 msgr2=0x7f5e940c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 -- 172.21.15.45:0/497964973 shutdown_connections 2023-12-08T08:18:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.101+0000 7f5e991ff640 1 -- 172.21.15.45:0/497964973 wait complete. 2023-12-08T08:18:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.103+0000 7f5e991ff640 1 Processor -- start 2023-12-08T08:18:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.103+0000 7f5e991ff640 1 -- start start 2023-12-08T08:18:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e940a9e80 0x7f5e940a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 0x7f5e940a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e941eddf0 con 0x7f5e9414e840 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9406fd60 con 0x7f5e940c1210 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e991ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94070040 con 0x7f5e940a9e80 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39834/0 (socket says 172.21.15.45:39834) 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 -- 172.21.15.45:0/616395481 learned_addr learned my addr 172.21.15.45:0/616395481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e8b7fe640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 0x7f5e940a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e93fff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e940a9e80 0x7f5e940a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 -- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e940a9e80 msgr2=0x7f5e940a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e940a9e80 0x7f5e940a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 -- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 msgr2=0x7f5e940a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 0x7f5e940a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e989fe640 1 -- 172.21.15.45:0/616395481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009a70 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.104+0000 7f5e8b7fe640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 0x7f5e940a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e989fe640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c450 tx=0x7f5e8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c005ce0 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c005e40 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9406f9c0 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c007270 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.105+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940a6b60 con 0x7f5e9414e840 2023-12-08T08:18:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.106+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9406fea0 con 0x7f5e9414e840 2023-12-08T08:18:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.108+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e8c0073d0 con 0x7f5e9414e840 2023-12-08T08:18:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.109+0000 7f5e917fa640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 0x7f5e7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.109+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f5e8c088ea0 con 0x7f5e9414e840 2023-12-08T08:18:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.110+0000 7f5e93fff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 0x7f5e7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.110+0000 7f5e93fff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 0x7f5e7406d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006fd0 tx=0x7f5e84008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.114+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e9406fea0 con 0x7f5e9414e840 2023-12-08T08:18:21.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.311+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e9406fea0 con 0x7f5e9414e840 2023-12-08T08:18:21.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.315+0000 7f5e917fa640 1 -- 172.21.15.45:0/616395481 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f5e9406fea0 con 0x7f5e9414e840 2023-12-08T08:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:21.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 msgr2=0x7f5e7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 0x7f5e7406d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006fd0 tx=0x7f5e84008040 comp rx=0 tx=0).stop 2023-12-08T08:18:21.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 msgr2=0x7f5e940a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c450 tx=0x7f5e8c00c910 comp rx=0 tx=0).stop 2023-12-08T08:18:21.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 shutdown_connections 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5e7406ae40 0x7f5e7406d300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e9414e840 0x7f5e940a74a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e940c1210 0x7f5e940a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 --2- 172.21.15.45:0/616395481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5e940a9e80 0x7f5e940a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.318+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 >> 172.21.15.45:0/616395481 conn(0x7f5e940c5780 msgr2=0x7f5e9414eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.319+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 shutdown_connections 2023-12-08T08:18:21.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.319+0000 7f5e991ff640 1 -- 172.21.15.45:0/616395481 wait complete. 2023-12-08T08:18:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:39.667136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:40.266994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:17:55.154580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:17:56.265883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:21.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:21.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.571+0000 7f615d7fa640 1 Processor -- start 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.571+0000 7f615d7fa640 1 -- start start 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f615d7fa640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f615814c280 0x7f61580a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f615d7fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61580c4970 0x7f615806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f615d7fa640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61580c60c0 con 0x7f615806d3e0 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f615d7fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615806d7f0 con 0x7f61580c4970 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f615d7fa640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6158152dc0 con 0x7f615814c280 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f61577fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61580c4970 0x7f615806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f61577fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61580c4970 0x7f615806cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39842/0 (socket says 172.21.15.45:39842) 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.573+0000 7f61577fe640 1 -- 172.21.15.45:0/1208277838 learned_addr learned my addr 172.21.15.45:0/1208277838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:21.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.574+0000 7f6157fff640 1 --2- 172.21.15.45:0/1208277838 >> v2:172.21.15.114:3300/0 conn(0x7f615814c280 0x7f61580a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.574+0000 7f61577fe640 1 -- 172.21.15.45:0/1208277838 >> v2:172.21.15.114:3300/0 conn(0x7f615814c280 msgr2=0x7f61580a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.574+0000 7f61577fe640 1 --2- 172.21.15.45:0/1208277838 >> v2:172.21.15.114:3300/0 conn(0x7f615814c280 0x7f61580a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.574+0000 7f61577fe640 1 -- 172.21.15.45:0/1208277838 >> v1:172.21.15.114:6789/0 conn(0x7f615806d3e0 legacy=0x7f6158155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.574+0000 7f61577fe640 1 -- 172.21.15.45:0/1208277838 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61581521d0 con 0x7f61580c4970 2023-12-08T08:18:21.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.575+0000 7f61577fe640 1 --2- 172.21.15.45:0/1208277838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61580c4970 0x7f615806cea0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61580aaba0 tx=0x7f614c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa9a3b6e3d251ad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.575+0000 7f6156ffd640 1 -- 172.21.15.45:0/1208277838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0317e0 con 0x7f61580c4970 2023-12-08T08:18:21.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.575+0000 7f6156ffd640 1 -- 172.21.15.45:0/1208277838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c031940 con 0x7f61580c4970 2023-12-08T08:18:21.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.575+0000 7f6156ffd640 1 -- 172.21.15.45:0/1208277838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c031cd0 con 0x7f61580c4970 2023-12-08T08:18:21.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 -- 172.21.15.45:0/1208277838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61580c4970 msgr2=0x7f615806cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 --2- 172.21.15.45:0/1208277838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61580c4970 0x7f615806cea0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61580aaba0 tx=0x7f614c02b880 comp rx=0 tx=0).stop 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 -- 172.21.15.45:0/1208277838 shutdown_connections 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 --2- 172.21.15.45:0/1208277838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61580c4970 0x7f615806cea0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 --2- 172.21.15.45:0/1208277838 >> v2:172.21.15.114:3300/0 conn(0x7f615814c280 0x7f61580a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 -- 172.21.15.45:0/1208277838 >> 172.21.15.45:0/1208277838 conn(0x7f6158066ce0 msgr2=0x7f61580a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 -- 172.21.15.45:0/1208277838 shutdown_connections 2023-12-08T08:18:21.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.576+0000 7f615d7fa640 1 -- 172.21.15.45:0/1208277838 wait complete. 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.578+0000 7f615d7fa640 1 Processor -- start 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.578+0000 7f615d7fa640 1 -- start start 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615806d3e0 0x7f61580a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61580c4970 0x7f61580a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581ea260 con 0x7f615814c280 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615814adc0 con 0x7f615806d3e0 2023-12-08T08:18:21.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615d7fa640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615814b310 con 0x7f61580c4970 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615cff9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615cff9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39858/0 (socket says 172.21.15.45:39858) 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.579+0000 7f615cff9640 1 -- 172.21.15.45:0/3375624229 learned_addr learned my addr 172.21.15.45:0/3375624229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f6157fff640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615806d3e0 0x7f61580a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 -- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61580c4970 msgr2=0x7f61580a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61580c4970 0x7f61580a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 -- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615806d3e0 msgr2=0x7f61580a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615806d3e0 0x7f61580a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 -- 172.21.15.45:0/3375624229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0094d0 con 0x7f615814c280 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f615cff9640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f615000b410 tx=0x7f615000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150004020 con 0x7f615814c280 2023-12-08T08:18:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150004180 con 0x7f615814c280 2023-12-08T08:18:21.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.580+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150011630 con 0x7f615814c280 2023-12-08T08:18:21.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.581+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615814b5f0 con 0x7f615814c280 2023-12-08T08:18:21.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.581+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61580aa920 con 0x7f615814c280 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.582+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61580678c0 con 0x7f615814c280 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.583+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6150011790 con 0x7f615814c280 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.584+0000 7f6154ff9640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 0x7f614406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.584+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f6150089790 con 0x7f615814c280 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.584+0000 7f6157fff640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 0x7f614406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.585+0000 7f6157fff640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 0x7f614406d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61581ee410 tx=0x7f61480039b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.589+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61500543c0 con 0x7f615814c280 2023-12-08T08:18:21.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.784+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61580743e0 con 0x7f615814c280 2023-12-08T08:18:21.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.785+0000 7f6154ff9640 1 -- 172.21.15.45:0/3375624229 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61500579e0 con 0x7f615814c280 2023-12-08T08:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:21.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 msgr2=0x7f614406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 0x7f614406d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61581ee410 tx=0x7f61480039b0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 msgr2=0x7f61581ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f615000b410 tx=0x7f615000b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 shutdown_connections 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f614406ae40 0x7f614406d300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f61580c4970 0x7f61580a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f615814c280 0x7f61581ea6f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 --2- 172.21.15.45:0/3375624229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f615806d3e0 0x7f61580a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.789+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 >> 172.21.15.45:0/3375624229 conn(0x7f6158066ce0 msgr2=0x7f61580c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.790+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 shutdown_connections 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:21.790+0000 7f615d7fa640 1 -- 172.21.15.45:0/3375624229 wait complete. 2023-12-08T08:18:21.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.029+0000 7f1b22a00640 1 Processor -- start 2023-12-08T08:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.029+0000 7f1b22a00640 1 -- start start 2023-12-08T08:18:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.030+0000 7f1b22a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b1c0c6050 0x7f1b1c0c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.030+0000 7f1b22a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c0c4f90 con 0x7f1b1c06cd40 2023-12-08T08:18:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.030+0000 7f1b22a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c157ea0 con 0x7f1b1c0c6960 2023-12-08T08:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.030+0000 7f1b22a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c06d120 con 0x7f1b1c0c6050 2023-12-08T08:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.031+0000 7f1b1bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1b1c06cd40 0x7f1b1c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42328/0 (socket says 172.21.15.45:42328) 2023-12-08T08:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.031+0000 7f1b1bfff640 1 -- 172.21.15.45:0/3857173395 learned_addr learned my addr 172.21.15.45:0/3857173395 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.031+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690298550 0 0) 0x7f1b1c0c4f90 con 0x7f1b1c06cd40 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.031+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b08003520 con 0x7f1b1c06cd40 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b20f9d640 1 --2- 172.21.15.45:0/3857173395 >> v2:172.21.15.114:3300/0 conn(0x7f1b1c0c6050 0x7f1b1c0c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362160943 0 0) 0x7f1b08003520 con 0x7f1b1c06cd40 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 >> v2:172.21.15.114:3300/0 conn(0x7f1b1c0c6050 msgr2=0x7f1b1c0c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 --2- 172.21.15.45:0/3857173395 >> v2:172.21.15.114:3300/0 conn(0x7f1b1c0c6050 0x7f1b1c0c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 >> v1:172.21.15.114:6789/0 conn(0x7f1b1c0c6960 legacy=0x7f1b1c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c0c77c0 con 0x7f1b1c06cd40 2023-12-08T08:18:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f1b0c0019f0 con 0x7f1b1c06cd40 2023-12-08T08:18:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 >> v1:172.21.15.45:6789/0 conn(0x7f1b1c06cd40 legacy=0x7f1b1c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 0x7f1b08003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080047c0 0x7f1b08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b08005330 0x7f1b0800b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0800c250 con 0x7f1b080039c0 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0800c3c0 con 0x7f1b080047c0 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0800c580 con 0x7f1b08005330 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b20f9d640 1 --2- 172.21.15.45:0/3857173395 >> v2:172.21.15.114:3300/0 conn(0x7f1b1c0c6050 0x7f1b1c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.032+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 0x7f1b08003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b137fe640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080047c0 0x7f1b08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b20f9d640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b08005330 0x7f1b0800b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b1bfff640 1 -- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b08005330 msgr2=0x7f1b0800b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b08005330 0x7f1b0800b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b1bfff640 1 -- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080047c0 msgr2=0x7f1b08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080047c0 0x7f1b08004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b1bfff640 1 -- 172.21.15.45:0/3857173395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08003520 con 0x7f1b080039c0 2023-12-08T08:18:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.033+0000 7f1b20f9d640 1 -- 172.21.15.45:0/3857173395 reap_dead start 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.034+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 0x7f1b08003dc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00a810 tx=0x7f1b080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38b640d7a813de2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.034+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c034630 con 0x7f1b080039c0 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.034+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c02f070 con 0x7f1b080039c0 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.034+0000 7f1b1b7fe640 1 -- 172.21.15.45:0/3857173395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c034a10 con 0x7f1b080039c0 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 -- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 msgr2=0x7f1b08003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 0x7f1b08003dc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00a810 tx=0x7f1b080057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 -- 172.21.15.45:0/3857173395 shutdown_connections 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3857173395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b080039c0 0x7f1b08003dc0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 -- 172.21.15.45:0/3857173395 >> 172.21.15.45:0/3857173395 conn(0x7f1b1c0a9770 msgr2=0x7f1b1c0a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 -- 172.21.15.45:0/3857173395 shutdown_connections 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.035+0000 7f1b22a00640 1 -- 172.21.15.45:0/3857173395 wait complete. 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.037+0000 7f1b22a00640 1 Processor -- start 2023-12-08T08:18:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.037+0000 7f1b22a00640 1 -- start start 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 0x7f1b1c1ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 0x7f1b1c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c157050 con 0x7f1b1c099a50 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0aba90 con 0x7f1b080039c0 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b22a00640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1ea790 con 0x7f1b1c150d60 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39886/0 (socket says 172.21.15.45:39886) 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.038+0000 7f1b137fe640 1 -- 172.21.15.45:0/3343643503 learned_addr learned my addr 172.21.15.45:0/3343643503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 0x7f1b1c1ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b20f9d640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 0x7f1b1c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 -- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 msgr2=0x7f1b1c1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 0x7f1b1c1511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 -- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 msgr2=0x7f1b1c1ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 0x7f1b1c1ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 -- 172.21.15.45:0/3343643503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c151720 con 0x7f1b1c099a50 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b20f9d640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 0x7f1b1c1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 0x7f1b1c1ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b137fe640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e480 tx=0x7f1b0400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.039+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040135f0 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.040+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04013770 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.040+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c0aae80 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.040+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04013b20 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.040+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c0ab440 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.041+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c074670 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.042+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b04013c80 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.043+0000 7f1b197fa640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 0x7f1afc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.043+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f1b04089ce0 con 0x7f1b1c099a50 2023-12-08T08:18:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.043+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 0x7f1afc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.044+0000 7f1b1bfff640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 0x7f1afc06d350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.047+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b040548f0 con 0x7f1b1c099a50 2023-12-08T08:18:22.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.240+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b1c0c5e30 con 0x7f1b1c099a50 2023-12-08T08:18:22.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.241+0000 7f1b197fa640 1 -- 172.21.15.45:0/3343643503 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b04057f10 con 0x7f1b1c099a50 2023-12-08T08:18:22.244 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 msgr2=0x7f1afc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 0x7f1afc06d350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02f000 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 msgr2=0x7f1b1c0a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e480 tx=0x7f1b0400e940 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 shutdown_connections 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1afc06ae90 0x7f1afc06d350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1b1c150d60 0x7f1b1c1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b1c099a50 0x7f1b1c0a6920 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 --2- 172.21.15.45:0/3343643503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b080039c0 0x7f1b1c1ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 >> 172.21.15.45:0/3343643503 conn(0x7f1b1c0a9770 msgr2=0x7f1b1c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 shutdown_connections 2023-12-08T08:18:22.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.244+0000 7f1b22a00640 1 -- 172.21.15.45:0/3343643503 wait complete. 2023-12-08T08:18:22.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:22.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.491+0000 7f4ecdb76640 1 Processor -- start 2023-12-08T08:18:22.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.491+0000 7f4ecdb76640 1 -- start start 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ecdb76640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ec80aaf60 0x7f4ec80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ecdb76640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec8152660 con 0x7f4ec806d960 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ecdb76640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec8153200 con 0x7f4ec80c1930 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ecdb76640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec80a4d10 con 0x7f4ec80aaf60 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ec77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ec80aaf60 0x7f4ec80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ebffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4ec806d960 0x7f4ec8152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42334/0 (socket says 172.21.15.45:42334) 2023-12-08T08:18:22.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.493+0000 7f4ebffff640 1 -- 172.21.15.45:0/2376292497 learned_addr learned my addr 172.21.15.45:0/2376292497 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:22.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.494+0000 7f4ec77fe640 1 -- 172.21.15.45:0/2376292497 >> v1:172.21.15.114:6789/0 conn(0x7f4ec80c1930 legacy=0x7f4ec815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.494+0000 7f4ec77fe640 1 -- 172.21.15.45:0/2376292497 >> v1:172.21.15.45:6789/0 conn(0x7f4ec806d960 legacy=0x7f4ec8152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.494+0000 7f4ec77fe640 1 -- 172.21.15.45:0/2376292497 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80c3310 con 0x7f4ec80aaf60 2023-12-08T08:18:22.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.494+0000 7f4ec6ffd640 1 -- 172.21.15.45:0/2376292497 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076279903 0 0) 0x7f4ec8152660 con 0x7f4ec806d960 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.495+0000 7f4ec77fe640 1 --2- 172.21.15.45:0/2376292497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80c3830 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80097a0 tx=0x7f4eb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a31c4a74a054de9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.495+0000 7f4ec6ffd640 1 -- 172.21.15.45:0/2376292497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb802e070 con 0x7f4ec80aaf60 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ec6ffd640 1 -- 172.21.15.45:0/2376292497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80315a0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ec6ffd640 1 -- 172.21.15.45:0/2376292497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8031930 con 0x7f4ec80aaf60 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 -- 172.21.15.45:0/2376292497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 msgr2=0x7f4ec80c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/2376292497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80c3830 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4eb80097a0 tx=0x7f4eb802b840 comp rx=0 tx=0).stop 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 -- 172.21.15.45:0/2376292497 shutdown_connections 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/2376292497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80c3830 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 -- 172.21.15.45:0/2376292497 >> 172.21.15.45:0/2376292497 conn(0x7f4ec80c2430 msgr2=0x7f4ec80c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 -- 172.21.15.45:0/2376292497 shutdown_connections 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.496+0000 7f4ecdb76640 1 -- 172.21.15.45:0/2376292497 wait complete. 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.498+0000 7f4ecdb76640 1 Processor -- start 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.498+0000 7f4ecdb76640 1 -- start start 2023-12-08T08:18:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 0x7f4ec8072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 0x7f4ec80bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81ea680 con 0x7f4ec80aaf60 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80bf7e0 con 0x7f4ec80c1930 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ecdb76640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81e9ce0 con 0x7f4ec806d960 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ebffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ebffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39912/0 (socket says 172.21.15.45:39912) 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ebffff640 1 -- 172.21.15.45:0/1391177525 learned_addr learned my addr 172.21.15.45:0/1391177525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.499+0000 7f4ec7fff640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 0x7f4ec80bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec77fe640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 0x7f4ec8072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 -- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 msgr2=0x7f4ec8072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 0x7f4ec8072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 -- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 msgr2=0x7f4ec80bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 0x7f4ec80bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 -- 172.21.15.45:0/1391177525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8009400 con 0x7f4ec80aaf60 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec7fff640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 0x7f4ec80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec77fe640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 0x7f4ec8072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ebffff640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c410 tx=0x7f4eb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00074e0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0007660 con 0x7f4ec80aaf60 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0004a20 con 0x7f4ec80aaf60 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec81e9fc0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.500+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec80727d0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.502+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec81ea7c0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.502+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4eb0004b80 con 0x7f4ec80aaf60 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.504+0000 7f4ec4ff9640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.504+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f4eb0089930 con 0x7f4ec80aaf60 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.504+0000 7f4ec77fe640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.505+0000 7f4ec77fe640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 0x7f4ea806d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8036000 tx=0x7f4eb803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.508+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ec81ea7c0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.692+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ec81ea7c0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.693+0000 7f4ec4ff9640 1 -- 172.21.15.45:0/1391177525 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ec81ea7c0 con 0x7f4ec80aaf60 2023-12-08T08:18:22.696 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 msgr2=0x7f4ea806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 0x7f4ea806d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8036000 tx=0x7f4eb803d040 comp rx=0 tx=0).stop 2023-12-08T08:18:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 msgr2=0x7f4ec80bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000c410 tx=0x7f4eb000c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 shutdown_connections 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ec80c1930 0x7f4ec80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec80aaf60 0x7f4ec80bed60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 --2- 172.21.15.45:0/1391177525 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4ec806d960 0x7f4ec8072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.695+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 >> 172.21.15.45:0/1391177525 conn(0x7f4ec80c2430 msgr2=0x7f4ec8073030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.696+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 shutdown_connections 2023-12-08T08:18:22.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.696+0000 7f4ecdb76640 1 -- 172.21.15.45:0/1391177525 wait complete. 2023-12-08T08:18:22.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:18:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.942+0000 7fa14914c640 1 Processor -- start 2023-12-08T08:18:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.942+0000 7fa14914c640 1 -- start start 2023-12-08T08:18:22.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.943+0000 7fa14914c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.943+0000 7fa14914c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1440c81d0 0x7fa1440c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa14914c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1441589d0 con 0x7fa1440c4c50 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa14914c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1440c50e0 con 0x7fa1440c81d0 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa14914c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1440c71b0 con 0x7fa144151c20 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa13a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1440c81d0 0x7fa1440c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa13a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1440c81d0 0x7fa1440c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39920/0 (socket says 172.21.15.45:39920) 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa13a59c640 1 -- 172.21.15.45:0/294850636 learned_addr learned my addr 172.21.15.45:0/294850636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.944+0000 7fa142d9d640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.945+0000 7fa13a59c640 1 -- 172.21.15.45:0/294850636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 msgr2=0x7fa1440c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.945+0000 7fa13a59c640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.945+0000 7fa13a59c640 1 -- 172.21.15.45:0/294850636 >> v1:172.21.15.114:6789/0 conn(0x7fa1440c4c50 legacy=0x7fa144154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.945+0000 7fa13a59c640 1 -- 172.21.15.45:0/294850636 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144157dc0 con 0x7fa1440c81d0 2023-12-08T08:18:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.946+0000 7fa13a59c640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa1440c4710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009870 tx=0x7fa12c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc2549b977ac4d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.946+0000 7fa14259c640 1 -- 172.21.15.45:0/294850636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c031640 con 0x7fa1440c81d0 2023-12-08T08:18:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.946+0000 7fa14259c640 1 -- 172.21.15.45:0/294850636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0317a0 con 0x7fa1440c81d0 2023-12-08T08:18:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.946+0000 7fa14259c640 1 -- 172.21.15.45:0/294850636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c031b30 con 0x7fa1440c81d0 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 -- 172.21.15.45:0/294850636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 msgr2=0x7fa1440c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa1440c4710 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009870 tx=0x7fa12c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 -- 172.21.15.45:0/294850636 shutdown_connections 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa1440c4710 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 --2- 172.21.15.45:0/294850636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 -- 172.21.15.45:0/294850636 >> 172.21.15.45:0/294850636 conn(0x7fa1440ab920 msgr2=0x7fa1440abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 -- 172.21.15.45:0/294850636 shutdown_connections 2023-12-08T08:18:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.947+0000 7fa14914c640 1 -- 172.21.15.45:0/294850636 wait complete. 2023-12-08T08:18:22.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.949+0000 7fa14914c640 1 Processor -- start 2023-12-08T08:18:22.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.949+0000 7fa14914c640 1 -- start start 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 0x7fa1441ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1441529e0 con 0x7fa1440c81d0 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1441ee3c0 con 0x7fa1440c4c50 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa14914c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14414ee20 con 0x7fa144151c20 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa13a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa13a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39936/0 (socket says 172.21.15.45:39936) 2023-12-08T08:18:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.950+0000 7fa13a59c640 1 -- 172.21.15.45:0/2798127868 learned_addr learned my addr 172.21.15.45:0/2798127868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa142d9d640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 0x7fa1441ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa14359e640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 -- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 msgr2=0x7fa1440c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 -- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 msgr2=0x7fa1441ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 0x7fa1441ede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 -- 172.21.15.45:0/2798127868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0094d0 con 0x7fa1440c81d0 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa142d9d640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 0x7fa1441ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.951+0000 7fa13a59c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa12c000c00 tx=0x7fa12c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.952+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c03ac60 con 0x7fa1440c81d0 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.952+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c03ade0 con 0x7fa1440c81d0 2023-12-08T08:18:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.952+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c044630 con 0x7fa1440c81d0 2023-12-08T08:18:22.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.952+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa144153e30 con 0x7fa1440c81d0 2023-12-08T08:18:22.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.952+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa144152c80 con 0x7fa1440c81d0 2023-12-08T08:18:22.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.953+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa144152e70 con 0x7fa1440c81d0 2023-12-08T08:18:22.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.954+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa12c02f050 con 0x7fa1440c81d0 2023-12-08T08:18:22.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.955+0000 7fa13bfff640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 0x7fa12406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.955+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fa12c0ab930 con 0x7fa1440c81d0 2023-12-08T08:18:22.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.955+0000 7fa142d9d640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 0x7fa12406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.956+0000 7fa142d9d640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 0x7fa12406d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa14414eb30 tx=0x7fa1340039f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:22.960+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa12c076680 con 0x7fa1440c81d0 2023-12-08T08:18:23.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.148+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa144074670 con 0x7fa1440c81d0 2023-12-08T08:18:23.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.149+0000 7fa13bfff640 1 -- 172.21.15.45:0/2798127868 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa12c0350b0 con 0x7fa1440c81d0 2023-12-08T08:18:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 msgr2=0x7fa12406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 0x7fa12406d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa14414eb30 tx=0x7fa1340039f0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 msgr2=0x7fa14414e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa12c000c00 tx=0x7fa12c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 shutdown_connections 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa12406ae40 0x7fa12406d300 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa144151c20 0x7fa1440c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1440c81d0 0x7fa14414e1e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 --2- 172.21.15.45:0/2798127868 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1440c4c50 0x7fa1441ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 >> 172.21.15.45:0/2798127868 conn(0x7fa1440ab920 msgr2=0x7fa14406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 shutdown_connections 2023-12-08T08:18:23.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.152+0000 7fa14914c640 1 -- 172.21.15.45:0/2798127868 wait complete. 2023-12-08T08:18:23.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:18:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.397+0000 7f9ba1b67640 1 Processor -- start 2023-12-08T08:18:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.397+0000 7f9ba1b67640 1 -- start start 2023-12-08T08:18:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1b67640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 0x7f9b9c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1b67640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b9c155790 0x7f9b9c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1b67640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c0c60c0 con 0x7f9b9c0c4970 2023-12-08T08:18:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1b67640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c152dc0 con 0x7f9b9c155790 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1b67640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1521d0 con 0x7f9b9c14c280 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1366640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b9c155790 0x7f9b9c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1366640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b9c155790 0x7f9b9c155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39946/0 (socket says 172.21.15.45:39946) 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.399+0000 7f9ba1366640 1 -- 172.21.15.45:0/2874624563 learned_addr learned my addr 172.21.15.45:0/2874624563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 0x7f9b9c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba1366640 1 -- 172.21.15.45:0/2874624563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 msgr2=0x7f9b9c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba1366640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 0x7f9b9c0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba1366640 1 -- 172.21.15.45:0/2874624563 >> v1:172.21.15.114:6789/0 conn(0x7f9b9c0c4970 legacy=0x7f9b9c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba1366640 1 -- 172.21.15.45:0/2874624563 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c14c660 con 0x7f9b9c155790 2023-12-08T08:18:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.400+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 0x7f9b9c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.401+0000 7f9ba1366640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c155790 0x7f9b9c155c00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009e50 tx=0x7f9b9402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f80a4eeefacab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.401+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/2874624563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9402c9e0 con 0x7f9b9c155790 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.401+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/2874624563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9402cb40 con 0x7f9b9c155790 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.401+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/2874624563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b940343f0 con 0x7f9b9c155790 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 -- 172.21.15.45:0/2874624563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c155790 msgr2=0x7f9b9c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c155790 0x7f9b9c155c00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009e50 tx=0x7f9b9402be40 comp rx=0 tx=0).stop 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 -- 172.21.15.45:0/2874624563 shutdown_connections 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c155790 0x7f9b9c155c00 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/2874624563 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14c280 0x7f9b9c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 -- 172.21.15.45:0/2874624563 >> 172.21.15.45:0/2874624563 conn(0x7f9b9c066ce0 msgr2=0x7f9b9c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 -- 172.21.15.45:0/2874624563 shutdown_connections 2023-12-08T08:18:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.402+0000 7f9ba1b67640 1 -- 172.21.15.45:0/2874624563 wait complete. 2023-12-08T08:18:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.403+0000 7f9ba1b67640 1 Processor -- start 2023-12-08T08:18:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.404+0000 7f9ba1b67640 1 -- start start 2023-12-08T08:18:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.404+0000 7f9ba1b67640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 0x7f9b9c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.404+0000 7f9ba1b67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba1b67640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b9c155790 0x7f9b9c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba1b67640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c153250 con 0x7f9b9c14c280 2023-12-08T08:18:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba1b67640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c143a70 con 0x7f9b9c155790 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba1b67640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c143ce0 con 0x7f9b9c0c4970 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9b9bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39956/0 (socket says 172.21.15.45:39956) 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9b9bfff640 1 -- 172.21.15.45:0/3582958938 learned_addr learned my addr 172.21.15.45:0/3582958938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 0x7f9b9c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.405+0000 7f9ba1366640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b9c155790 0x7f9b9c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 -- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 msgr2=0x7f9b9c154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 0x7f9b9c154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 -- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b9c155790 msgr2=0x7f9b9c150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b9c155790 0x7f9b9c150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 -- 172.21.15.45:0/3582958938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009b30 con 0x7f9b9c14c280 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 0x7f9b9c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800b420 tx=0x7f9b8800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011830 con 0x7f9b9c14c280 2023-12-08T08:18:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b88011990 con 0x7f9b9c14c280 2023-12-08T08:18:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011d40 con 0x7f9b9c14c280 2023-12-08T08:18:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c151b50 con 0x7f9b9c14c280 2023-12-08T08:18:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.406+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1534a0 con 0x7f9b9c14c280 2023-12-08T08:18:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.408+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c0678c0 con 0x7f9b9c14c280 2023-12-08T08:18:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.408+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b8801b460 con 0x7f9b9c14c280 2023-12-08T08:18:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.409+0000 7f9b997fa640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.409+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f9b880896c0 con 0x7f9b9c14c280 2023-12-08T08:18:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.410+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.410+0000 7f9ba0b65640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 0x7f9b8006d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0c1d10 tx=0x7f9b90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.414+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b88054250 con 0x7f9b9c14c280 2023-12-08T08:18:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.606+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9b9c0743e0 con 0x7f9b9c14c280 2023-12-08T08:18:23.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.607+0000 7f9b997fa640 1 -- 172.21.15.45:0/3582958938 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9b88057870 con 0x7f9b9c14c280 2023-12-08T08:18:23.610 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:23.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 msgr2=0x7f9b8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 0x7f9b8006d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0c1d10 tx=0x7f9b90008040 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 msgr2=0x7f9b9c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800b420 tx=0x7f9b8800b8e0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 shutdown_connections 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b8006ae40 0x7f9b8006d300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b9c155790 0x7f9b9c150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14c280 0x7f9b9c1551d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 --2- 172.21.15.45:0/3582958938 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c0c4970 0x7f9b9c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 >> 172.21.15.45:0/3582958938 conn(0x7f9b9c066ce0 msgr2=0x7f9b9c0c3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 shutdown_connections 2023-12-08T08:18:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.610+0000 7f9ba1b67640 1 -- 172.21.15.45:0/3582958938 wait complete. 2023-12-08T08:18:23.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:23.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.841+0000 7fc1b70e6640 1 Processor -- start 2023-12-08T08:18:23.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.841+0000 7fc1b70e6640 1 -- start start 2023-12-08T08:18:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.842+0000 7fc1b70e6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc1b006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b70e6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0154620 con 0x7fc1b014e680 2023-12-08T08:18:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b70e6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0154900 con 0x7fc1b014ea60 2023-12-08T08:18:23.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b70e6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00c3190 con 0x7fc1b006ca90 2023-12-08T08:18:23.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b60e4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc1b014e680 0x7fc1b00c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42340/0 (socket says 172.21.15.45:42340) 2023-12-08T08:18:23.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b60e4640 1 -- 172.21.15.45:0/3742904553 learned_addr learned my addr 172.21.15.45:0/3742904553 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc1b006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510143106 0 0) 0x7fc1b0154620 con 0x7fc1b014e680 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.843+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc19c005730 con 0x7fc1b014e680 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492386737 0 0) 0x7fc19c005730 con 0x7fc1b014e680 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 msgr2=0x7fc1b006e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc1b006e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 >> v1:172.21.15.114:6789/0 conn(0x7fc1b014ea60 legacy=0x7fc1b0151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0154be0 con 0x7fc1b014e680 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fc1ac001670 con 0x7fc1b014e680 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 >> v1:172.21.15.45:6789/0 conn(0x7fc1b014e680 legacy=0x7fc1b00c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc19c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc19c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c006f10 0x7fc19c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00c3190 con 0x7fc19c0061e0 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c00dd50 con 0x7fc19c006f10 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c00df10 con 0x7fc1b006ca90 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc19c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.844+0000 7fc1b60e4640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc19c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b68e5640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c006f10 0x7fc19c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b58e3640 1 -- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 msgr2=0x7fc19c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b006ca90 0x7fc19c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b58e3640 1 -- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c006f10 msgr2=0x7fc19c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:23.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c006f10 0x7fc19c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b58e3640 1 -- 172.21.15.45:0/3742904553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c005730 con 0x7fc19c0061e0 2023-12-08T08:18:23.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.845+0000 7fc1b68e5640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c006f10 0x7fc19c007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:23.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc19c0069d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc1b006e800 tx=0x7fc19c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c7917bc924ea1a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00325f0 con 0x7fc19c0061e0 2023-12-08T08:18:23.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0032750 con 0x7fc19c0061e0 2023-12-08T08:18:23.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b50e2640 1 -- 172.21.15.45:0/3742904553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0032ae0 con 0x7fc19c0061e0 2023-12-08T08:18:23.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3742904553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 msgr2=0x7fc19c0069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3742904553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc19c0069d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc1b006e800 tx=0x7fc19c007a00 comp rx=0 tx=0).stop 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.846+0000 7fc1b68e5640 1 -- 172.21.15.45:0/3742904553 reap_dead start 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.847+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3742904553 shutdown_connections 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.847+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3742904553 >> 172.21.15.45:0/3742904553 conn(0x7fc1b0066880 msgr2=0x7fc1b00a8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.847+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3742904553 shutdown_connections 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.847+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3742904553 wait complete. 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.848+0000 7fc1b70e6640 1 Processor -- start 2023-12-08T08:18:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 -- start start 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b00a5f40 0x7fc1b0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b0148b70 0x7fc1b0148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0153f70 con 0x7fc19c0061e0 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0149530 con 0x7fc1b0148b70 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.849+0000 7fc1b70e6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01ed180 con 0x7fc1b00a5f40 2023-12-08T08:18:23.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39984/0 (socket says 172.21.15.45:39984) 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 -- 172.21.15.45:0/3586253129 learned_addr learned my addr 172.21.15.45:0/3586253129 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b00a5f40 0x7fc1b0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b68e5640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b0148b70 0x7fc1b0148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 -- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b00a5f40 msgr2=0x7fc1b0152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b00a5f40 0x7fc1b0152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 -- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b0148b70 msgr2=0x7fc1b0148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b0148b70 0x7fc1b0148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.850+0000 7fc1b60e4640 1 -- 172.21.15.45:0/3586253129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00aac30 con 0x7fc19c0061e0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1b60e4640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac001200 tx=0x7fc1ac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00c870 con 0x7fc19c0061e0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00c9d0 con 0x7fc19c0061e0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00cd80 con 0x7fc19c0061e0 2023-12-08T08:18:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b00aaf10 con 0x7fc19c0061e0 2023-12-08T08:18:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.851+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b00ab4d0 con 0x7fc19c0061e0 2023-12-08T08:18:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.852+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0067af0 con 0x7fc19c0061e0 2023-12-08T08:18:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.853+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1ac01d460 con 0x7fc19c0061e0 2023-12-08T08:18:23.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.854+0000 7fc1a6ffd640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 0x7fc19406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:23.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.854+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fc1ac089a70 con 0x7fc19c0061e0 2023-12-08T08:18:23.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.854+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 0x7fc19406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:23.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.855+0000 7fc1b58e3640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 0x7fc19406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc1b006ced0 tx=0x7fc1a003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:23.859+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1ac054600 con 0x7fc19c0061e0 2023-12-08T08:18:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.065+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1b00673e0 con 0x7fc19c0061e0 2023-12-08T08:18:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.066+0000 7fc1a6ffd640 1 -- 172.21.15.45:0/3586253129 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1ac057c20 con 0x7fc19c0061e0 2023-12-08T08:18:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:18:24.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 msgr2=0x7fc19406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 0x7fc19406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc1b006ced0 tx=0x7fc1a003d040 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 msgr2=0x7fc1b0153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac001200 tx=0x7fc1ac00ec80 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 shutdown_connections 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc19406ae70 0x7fc19406d330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc1b00a5f40 0x7fc1b0152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1b0148b70 0x7fc1b0148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 --2- 172.21.15.45:0/3586253129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc19c0061e0 0x7fc1b0153820 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 >> 172.21.15.45:0/3586253129 conn(0x7fc1b0066880 msgr2=0x7fc1b00bfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 shutdown_connections 2023-12-08T08:18:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.069+0000 7fc1b70e6640 1 -- 172.21.15.45:0/3586253129 wait complete. 2023-12-08T08:18:24.092 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:18:24.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:24.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:24.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:18:24.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:24.209 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:18:24.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.491+0000 7feed6edc640 1 Processor -- start 2023-12-08T08:18:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.491+0000 7feed6edc640 1 -- start start 2023-12-08T08:18:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed6edc640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feed01542a0 0x7feed00a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed6edc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00a7300 con 0x7feed00beb30 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed6edc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00bf010 con 0x7feed014e260 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed6edc640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00bfb90 con 0x7feed01542a0 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed56d9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feed00beb30 0x7feed00a7770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42350/0 (socket says 172.21.15.45:42350) 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed56d9640 1 -- 172.21.15.45:0/3815396115 learned_addr learned my addr 172.21.15.45:0/3815396115 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.493+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073765825 0 0) 0x7feed00a7300 con 0x7feed00beb30 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed66db640 1 --2- 172.21.15.45:0/3815396115 >> v2:172.21.15.114:3300/0 conn(0x7feed01542a0 0x7feed00a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feebc003520 con 0x7feed00beb30 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664765652 0 0) 0x7feebc003520 con 0x7feed00beb30 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 >> v2:172.21.15.114:3300/0 conn(0x7feed01542a0 msgr2=0x7feed00a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 --2- 172.21.15.45:0/3815396115 >> v2:172.21.15.114:3300/0 conn(0x7feed01542a0 0x7feed00a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 >> v1:172.21.15.114:6789/0 conn(0x7feed014e260 legacy=0x7feed006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00bf2f0 con 0x7feed00beb30 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7feec0001670 con 0x7feed00beb30 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 >> v1:172.21.15.45:6789/0 conn(0x7feed00beb30 legacy=0x7feed00a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0039c0 0x7feebc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feebc0047c0 0x7feebc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feebc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00bfb90 con 0x7feebc0051d0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc00c120 con 0x7feebc0047c0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc00c2e0 con 0x7feebc0039c0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.494+0000 7feed66db640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feebc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed5eda640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0039c0 0x7feebc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed56d9640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feebc0047c0 0x7feebc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed66db640 1 -- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0039c0 msgr2=0x7feebc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed66db640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feebc0039c0 0x7feebc003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed66db640 1 -- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feebc0047c0 msgr2=0x7feebc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed66db640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feebc0047c0 0x7feebc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed66db640 1 -- 172.21.15.45:0/3815396115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc003520 con 0x7feebc0051d0 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.495+0000 7feed56d9640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feebc0047c0 0x7feebc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.496+0000 7feed66db640 1 -- 172.21.15.45:0/3815396115 reap_dead start 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.496+0000 7feed66db640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feebc00b980 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feec8007360 tx=0x7feebc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637142f6b4032d00 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.496+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec802ccf0 con 0x7feebc0051d0 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.496+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802ce50 con 0x7feebc0051d0 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.496+0000 7feed4ed8640 1 -- 172.21.15.45:0/3815396115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8003bd0 con 0x7feebc0051d0 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 -- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 msgr2=0x7feebc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feebc00b980 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feec8007360 tx=0x7feebc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 -- 172.21.15.45:0/3815396115 shutdown_connections 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 --2- 172.21.15.45:0/3815396115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feebc00b980 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 -- 172.21.15.45:0/3815396115 >> 172.21.15.45:0/3815396115 conn(0x7feed00c5780 msgr2=0x7feed00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 -- 172.21.15.45:0/3815396115 shutdown_connections 2023-12-08T08:18:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.497+0000 7feed6edc640 1 -- 172.21.15.45:0/3815396115 wait complete. 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.499+0000 7feed6edc640 1 Processor -- start 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.499+0000 7feed6edc640 1 -- start start 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feed0151620 0x7feed014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feed00c4590 0x7feed00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0153e10 con 0x7feebc0051d0 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed014f680 con 0x7feed00c4590 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed6edc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed0154090 con 0x7feed0151620 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed5eda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed5eda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40000/0 (socket says 172.21.15.45:40000) 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.500+0000 7feed5eda640 1 -- 172.21.15.45:0/3621876975 learned_addr learned my addr 172.21.15.45:0/3621876975 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed56d9640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feed0151620 0x7feed014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 -- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feed0151620 msgr2=0x7feed014edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feed0151620 0x7feed014edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 -- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feed00c4590 msgr2=0x7feed00c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feed00c4590 0x7feed00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 -- 172.21.15.45:0/3621876975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed01edbe0 con 0x7feebc0051d0 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed5eda640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d570 tx=0x7feecc00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc003610 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc003770 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc003ae0 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.501+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed01ece20 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.502+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed01ed3e0 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.503+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00743e0 con 0x7feebc0051d0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.503+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feecc003c40 con 0x7feebc0051d0 2023-12-08T08:18:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.504+0000 7feec67fc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 0x7feeb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.504+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7feecc0899c0 con 0x7feebc0051d0 2023-12-08T08:18:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.505+0000 7feed56d9640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 0x7feeb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.505+0000 7feed56d9640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 0x7feeb406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feec0000ff0 tx=0x7feec0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.509+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feecc0546b0 con 0x7feebc0051d0 2023-12-08T08:18:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.733+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feed00ab6b0 con 0x7feebc0051d0 2023-12-08T08:18:24.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.737+0000 7feec67fc640 1 -- 172.21.15.45:0/3621876975 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6130 (secure 0 0 0) 0x7feecc057cd0 con 0x7feebc0051d0 2023-12-08T08:18:24.740 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:24.740 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:24.740 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-12-08T08:18:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 msgr2=0x7feeb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 0x7feeb406d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feec0000ff0 tx=0x7feec0009040 comp rx=0 tx=0).stop 2023-12-08T08:18:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 msgr2=0x7feed01538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d570 tx=0x7feecc00da30 comp rx=0 tx=0).stop 2023-12-08T08:18:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 shutdown_connections 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feeb406ae70 0x7feeb406d330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feed0151620 0x7feed014edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feed00c4590 0x7feed00c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 --2- 172.21.15.45:0/3621876975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feebc0051d0 0x7feed01538d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.739+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 >> 172.21.15.45:0/3621876975 conn(0x7feed00c5780 msgr2=0x7feed0149680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.740+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 shutdown_connections 2023-12-08T08:18:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.740+0000 7feed6edc640 1 -- 172.21.15.45:0/3621876975 wait complete. 2023-12-08T08:18:24.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.982+0000 7f5b89a32640 1 Processor -- start 2023-12-08T08:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.982+0000 7f5b89a32640 1 -- start start 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89a32640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b8414e840 0x7f5b84151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89a32640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b84151ea0 con 0x7f5b840c16a0 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89a32640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b84154850 con 0x7f5b840c1210 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89a32640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8414ec20 con 0x7f5b8414e840 2023-12-08T08:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89231640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5b840c16a0 0x7f5b840aa590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42354/0 (socket says 172.21.15.45:42354) 2023-12-08T08:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.984+0000 7f5b89231640 1 -- 172.21.15.45:0/2826832790 learned_addr learned my addr 172.21.15.45:0/2826832790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b88a30640 1 --2- 172.21.15.45:0/2826832790 >> v2:172.21.15.114:3300/0 conn(0x7f5b8414e840 0x7f5b84151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199122880 0 0) 0x7f5b84151ea0 con 0x7f5b840c16a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b74003520 con 0x7f5b840c16a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826627323 0 0) 0x7f5b74003520 con 0x7f5b840c16a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 >> v2:172.21.15.114:3300/0 conn(0x7f5b8414e840 msgr2=0x7f5b84151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 --2- 172.21.15.45:0/2826832790 >> v2:172.21.15.114:3300/0 conn(0x7f5b8414e840 0x7f5b84151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 >> v1:172.21.15.114:6789/0 conn(0x7f5b840c1210 legacy=0x7f5b840a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84154b30 con 0x7f5b840c16a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5b7c0019f0 con 0x7f5b840c16a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 >> v1:172.21.15.45:6789/0 conn(0x7f5b840c16a0 legacy=0x7f5b840aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740039c0 0x7f5b74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 0x7f5b74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b740052a0 0x7f5b7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8414ec20 con 0x7f5b740047c0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7400c1a0 con 0x7f5b740052a0 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.985+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7400c360 con 0x7f5b740039c0 2023-12-08T08:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 0x7f5b74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b88a30640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740039c0 0x7f5b74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b89231640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b740052a0 0x7f5b7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 -- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740039c0 msgr2=0x7f5b74003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740039c0 0x7f5b74003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 -- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b740052a0 msgr2=0x7f5b7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b740052a0 0x7f5b7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b83fff640 1 -- 172.21.15.45:0/2826832790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74003520 con 0x7f5b740047c0 2023-12-08T08:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b89231640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b740052a0 0x7f5b7400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.986+0000 7f5b89231640 1 -- 172.21.15.45:0/2826832790 reap_dead start 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b83fff640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 0x7f5b74004c40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001750 tx=0x7f5b740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e450fa5a6f8869fe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700052d0 con 0x7f5b740047c0 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7002e050 con 0x7f5b740047c0 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b837fe640 1 -- 172.21.15.45:0/2826832790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70003830 con 0x7f5b740047c0 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b89a32640 1 -- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 msgr2=0x7f5b74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b89a32640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 0x7f5b74004c40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001750 tx=0x7f5b740057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b89a32640 1 -- 172.21.15.45:0/2826832790 shutdown_connections 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b89a32640 1 --2- 172.21.15.45:0/2826832790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b740047c0 0x7f5b74004c40 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.988+0000 7f5b89a32640 1 -- 172.21.15.45:0/2826832790 >> 172.21.15.45:0/2826832790 conn(0x7f5b840c5780 msgr2=0x7f5b840c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.989+0000 7f5b89a32640 1 -- 172.21.15.45:0/2826832790 shutdown_connections 2023-12-08T08:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.989+0000 7f5b89a32640 1 -- 172.21.15.45:0/2826832790 wait complete. 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.990+0000 7f5b89a32640 1 Processor -- start 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.991+0000 7f5b89a32640 1 -- start start 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.991+0000 7f5b89a32640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740047c0 0x7f5b841e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.991+0000 7f5b89a32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.991+0000 7f5b89a32640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b841e50a0 0x7f5b8414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b89a32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84151c70 con 0x7f5b84072350 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b89a32640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84071b80 con 0x7f5b841e50a0 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b89a32640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84071e60 con 0x7f5b740047c0 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56374/0 (socket says 172.21.15.45:56374) 2023-12-08T08:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 -- 172.21.15.45:0/4199106200 learned_addr learned my addr 172.21.15.45:0/4199106200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b88a30640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740047c0 0x7f5b841e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 -- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740047c0 msgr2=0x7f5b841e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740047c0 0x7f5b841e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 -- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b841e50a0 msgr2=0x7f5b8414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b841e50a0 0x7f5b8414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.992+0000 7f5b83fff640 1 -- 172.21.15.45:0/4199106200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b841e8610 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b83fff640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5b7002bc00 tx=0x7f5b70001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700076c0 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70007a30 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70006c20 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b841e88f0 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.993+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b840c4ab0 con 0x7f5b84072350 2023-12-08T08:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.994+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b840743e0 con 0x7f5b84072350 2023-12-08T08:18:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.995+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b700035f0 con 0x7f5b84072350 2023-12-08T08:18:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.997+0000 7f5b817fa640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 0x7f5b6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.997+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f5b700ab750 con 0x7f5b84072350 2023-12-08T08:18:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.997+0000 7f5b88a30640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 0x7f5b6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:24.998+0000 7f5b88a30640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 0x7f5b6806d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b780099d0 tx=0x7f5b78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.001+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b70079e20 con 0x7f5b84072350 2023-12-08T08:18:25.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.204+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b8406ae00 con 0x7f5b84072350 2023-12-08T08:18:25.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.208+0000 7f5b817fa640 1 -- 172.21.15.45:0/4199106200 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f5b700799b0 con 0x7f5b84072350 2023-12-08T08:18:25.211 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:25.211 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 msgr2=0x7f5b6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 0x7f5b6806d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b780099d0 tx=0x7f5b78008040 comp rx=0 tx=0).stop 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 msgr2=0x7f5b840c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5b7002bc00 tx=0x7f5b70001120 comp rx=0 tx=0).stop 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 shutdown_connections 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5b6806ae40 0x7f5b6806d300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b841e50a0 0x7f5b8414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b84072350 0x7f5b840c4570 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 --2- 172.21.15.45:0/4199106200 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5b740047c0 0x7f5b841e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 >> 172.21.15.45:0/4199106200 conn(0x7f5b840c5780 msgr2=0x7f5b8414ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 shutdown_connections 2023-12-08T08:18:25.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.211+0000 7f5b89a32640 1 -- 172.21.15.45:0/4199106200 wait complete. 2023-12-08T08:18:25.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:39.667136+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:40.266994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:17:55.154580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:17:56.265883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:25.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.461+0000 7fc8463bc640 1 Processor -- start 2023-12-08T08:18:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.461+0000 7fc8463bc640 1 -- start start 2023-12-08T08:18:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.462+0000 7fc8463bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc840154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.462+0000 7fc8463bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8401579d0 con 0x7fc8401519a0 2023-12-08T08:18:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.462+0000 7fc8463bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840155030 con 0x7fc8400c7aa0 2023-12-08T08:18:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.462+0000 7fc8463bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c5280 con 0x7fc8400c7f00 2023-12-08T08:18:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.463+0000 7fc8453ba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8401519a0 0x7fc8400c6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50054/0 (socket says 172.21.15.45:50054) 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.463+0000 7fc8453ba640 1 -- 172.21.15.45:0/3128218940 learned_addr learned my addr 172.21.15.45:0/3128218940 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.463+0000 7fc845bbb640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc840154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.463+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430845992 0 0) 0x7fc8401579d0 con 0x7fc8401519a0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.463+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c003520 con 0x7fc8401519a0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188591020 0 0) 0x7fc82c003520 con 0x7fc8401519a0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 msgr2=0x7fc840154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc840154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 >> v1:172.21.15.114:6789/0 conn(0x7fc8400c7aa0 legacy=0x7fc8401543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400c70a0 con 0x7fc8401519a0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fc83c001670 con 0x7fc8401519a0 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 >> v1:172.21.15.45:6789/0 conn(0x7fc8401519a0 legacy=0x7fc8400c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc82c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc82c003f20 0x7fc82c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c004d00 0x7fc82c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00bb10 con 0x7fc82c003f20 2023-12-08T08:18:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00bc50 con 0x7fc82c004d00 2023-12-08T08:18:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00be10 con 0x7fc8400c7f00 2023-12-08T08:18:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc8453ba640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc82c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.464+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc82c003f20 0x7fc82c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc845bbb640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c004d00 0x7fc82c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc844bb9640 1 -- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 msgr2=0x7fc82c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c7f00 0x7fc82c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc844bb9640 1 -- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c004d00 msgr2=0x7fc82c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c004d00 0x7fc82c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.465+0000 7fc844bb9640 1 -- 172.21.15.45:0/3128218940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c003520 con 0x7fc82c003f20 2023-12-08T08:18:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.466+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc82c003f20 0x7fc82c0047c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc8401551c0 tx=0x7fc82c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7950eeef7c631 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.466+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830005270 con 0x7fc82c003f20 2023-12-08T08:18:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.466+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83002e070 con 0x7fc82c003f20 2023-12-08T08:18:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.466+0000 7fc837fff640 1 -- 172.21.15.45:0/3128218940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830003640 con 0x7fc82c003f20 2023-12-08T08:18:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 -- 172.21.15.45:0/3128218940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc82c003f20 msgr2=0x7fc82c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3128218940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc82c003f20 0x7fc82c0047c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc8401551c0 tx=0x7fc82c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc845bbb640 1 -- 172.21.15.45:0/3128218940 reap_dead start 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 -- 172.21.15.45:0/3128218940 shutdown_connections 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 -- 172.21.15.45:0/3128218940 >> 172.21.15.45:0/3128218940 conn(0x7fc8400663d0 msgr2=0x7fc8400667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 -- 172.21.15.45:0/3128218940 shutdown_connections 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.467+0000 7fc8463bc640 1 -- 172.21.15.45:0/3128218940 wait complete. 2023-12-08T08:18:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.469+0000 7fc8463bc640 1 Processor -- start 2023-12-08T08:18:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.469+0000 7fc8463bc640 1 -- start start 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c003f20 0x7fc840153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c3750 0x7fc8400a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400caa10 con 0x7fc8400c9850 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c3bd0 con 0x7fc82c003f20 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc8463bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c8500 con 0x7fc8400c3750 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc844bb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc844bb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56390/0 (socket says 172.21.15.45:56390) 2023-12-08T08:18:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.470+0000 7fc844bb9640 1 -- 172.21.15.45:0/3696303592 learned_addr learned my addr 172.21.15.45:0/3696303592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc845bbb640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c3750 0x7fc8400a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc8453ba640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c003f20 0x7fc840153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 -- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c3750 msgr2=0x7fc8400a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c3750 0x7fc8400a95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 -- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c003f20 msgr2=0x7fc840153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c003f20 0x7fc840153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 -- 172.21.15.45:0/3696303592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400c87e0 con 0x7fc8400c9850 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc844bb9640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc83002bbc0 tx=0x7fc830001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.471+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830006a20 con 0x7fc8400c9850 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.472+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830006b80 con 0x7fc8400c9850 2023-12-08T08:18:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.472+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830007030 con 0x7fc8400c9850 2023-12-08T08:18:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.472+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400c8ac0 con 0x7fc8400c9850 2023-12-08T08:18:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.472+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400c9080 con 0x7fc8400c9850 2023-12-08T08:18:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.473+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400743e0 con 0x7fc8400c9850 2023-12-08T08:18:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.474+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc830030030 con 0x7fc8400c9850 2023-12-08T08:18:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.475+0000 7fc835ffb640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 0x7fc82406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.475+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fc8300a9df0 con 0x7fc8400c9850 2023-12-08T08:18:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.475+0000 7fc8453ba640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 0x7fc82406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.476+0000 7fc8453ba640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 0x7fc82406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc83c001050 tx=0x7fc83c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.480+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc830074a20 con 0x7fc8400c9850 2023-12-08T08:18:25.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.673+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc840066ca0 con 0x7fc8400c9850 2023-12-08T08:18:25.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.674+0000 7fc835ffb640 1 -- 172.21.15.45:0/3696303592 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc830078040 con 0x7fc8400c9850 2023-12-08T08:18:25.677 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.676+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 msgr2=0x7fc82406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.676+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 0x7fc82406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc83c001050 tx=0x7fc83c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.676+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 msgr2=0x7fc8400c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.676+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc83002bbc0 tx=0x7fc830001170 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 shutdown_connections 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc82406ae40 0x7fc82406d300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc8400c3750 0x7fc8400a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8400c9850 0x7fc8400c3210 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 --2- 172.21.15.45:0/3696303592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc82c003f20 0x7fc840153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 >> 172.21.15.45:0/3696303592 conn(0x7fc8400663d0 msgr2=0x7fc84014e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 shutdown_connections 2023-12-08T08:18:25.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.677+0000 7fc8463bc640 1 -- 172.21.15.45:0/3696303592 wait complete. 2023-12-08T08:18:25.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:25.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.928+0000 7fd9df0ff640 1 Processor -- start 2023-12-08T08:18:25.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.928+0000 7fd9df0ff640 1 -- start start 2023-12-08T08:18:25.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9df0ff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9d814c280 0x7fd9d80a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9df0ff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80c60c0 con 0x7fd9d80c4970 2023-12-08T08:18:25.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9df0ff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d8152dc0 con 0x7fd9d8155790 2023-12-08T08:18:25.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9df0ff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d81521d0 con 0x7fd9d814c280 2023-12-08T08:18:25.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9dd8fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9d80c4970 0x7fd9d806cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50068/0 (socket says 172.21.15.45:50068) 2023-12-08T08:18:25.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.930+0000 7fd9dd8fc640 1 -- 172.21.15.45:0/267652560 learned_addr learned my addr 172.21.15.45:0/267652560 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:25.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/267652560 >> v2:172.21.15.114:3300/0 conn(0x7fd9d814c280 0x7fd9d80a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465384579 0 0) 0x7fd9c8001110 con 0x7fd9d80c4970 2023-12-08T08:18:25.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c4003520 con 0x7fd9d80c4970 2023-12-08T08:18:25.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3215754359 0 0) 0x7fd9c4003520 con 0x7fd9d80c4970 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 >> v2:172.21.15.114:3300/0 conn(0x7fd9d814c280 msgr2=0x7fd9d80a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 --2- 172.21.15.45:0/267652560 >> v2:172.21.15.114:3300/0 conn(0x7fd9d814c280 0x7fd9d80a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 >> v1:172.21.15.114:6789/0 conn(0x7fd9d8155790 legacy=0x7fd9d8155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d814c660 con 0x7fd9d80c4970 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd9c8001800 con 0x7fd9d80c4970 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 >> v1:172.21.15.45:6789/0 conn(0x7fd9d80c4970 legacy=0x7fd9d806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c40039c0 0x7fd9c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40047c0 0x7fd9c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 0x7fd9c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81521d0 con 0x7fd9c40052a0 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c400c1c0 con 0x7fd9c40047c0 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.931+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c400c380 con 0x7fd9c40039c0 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 0x7fd9c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c40039c0 0x7fd9c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9dd8fc640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40047c0 0x7fd9c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 -- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c40039c0 msgr2=0x7fd9c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9c40039c0 0x7fd9c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 -- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40047c0 msgr2=0x7fd9c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40047c0 0x7fd9c4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.932+0000 7fd9de8fe640 1 -- 172.21.15.45:0/267652560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4003520 con 0x7fd9c40052a0 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.933+0000 7fd9de8fe640 1 -- 172.21.15.45:0/267652560 reap_dead start 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.933+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 0x7fd9c400b980 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0001e50 tx=0x7fd9c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad4c058dff17b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0003b70 con 0x7fd9c40052a0 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0003cf0 con 0x7fd9c40052a0 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9dd0fb640 1 -- 172.21.15.45:0/267652560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0005310 con 0x7fd9c40052a0 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 -- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 msgr2=0x7fd9c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 0x7fd9c400b980 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0001e50 tx=0x7fd9c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 -- 172.21.15.45:0/267652560 shutdown_connections 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/267652560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c40052a0 0x7fd9c400b980 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 -- 172.21.15.45:0/267652560 >> 172.21.15.45:0/267652560 conn(0x7fd9d8066ce0 msgr2=0x7fd9d80a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 -- 172.21.15.45:0/267652560 shutdown_connections 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.934+0000 7fd9df0ff640 1 -- 172.21.15.45:0/267652560 wait complete. 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.936+0000 7fd9df0ff640 1 Processor -- start 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.936+0000 7fd9df0ff640 1 -- start start 2023-12-08T08:18:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 0x7fd9d80c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 0x7fd9d81ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81ed390 con 0x7fd9d80aa210 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81edbf0 con 0x7fd9c40052a0 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9df0ff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81ea7e0 con 0x7fd9d81e9e20 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9dd8fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9dd8fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56410/0 (socket says 172.21.15.45:56410) 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.937+0000 7fd9dd8fc640 1 -- 172.21.15.45:0/655841717 learned_addr learned my addr 172.21.15.45:0/655841717 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 0x7fd9d81ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 0x7fd9d80c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 -- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 msgr2=0x7fd9d81ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 0x7fd9d81ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 -- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 msgr2=0x7fd9d80c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 0x7fd9d80c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 -- 172.21.15.45:0/655841717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8155230 con 0x7fd9d80aa210 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9de8fe640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 0x7fd9d81ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 0x7fd9d80c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9dd8fc640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800d7a0 tx=0x7fd9c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.938+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80072d0 con 0x7fd9d80aa210 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.939+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8007430 con 0x7fd9d80aa210 2023-12-08T08:18:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.939+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80047e0 con 0x7fd9d80aa210 2023-12-08T08:18:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.939+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d81ed5a0 con 0x7fd9d80aa210 2023-12-08T08:18:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.939+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80c18e0 con 0x7fd9d80aa210 2023-12-08T08:18:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.940+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d80a4cf0 con 0x7fd9d80aa210 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.941+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9c8004940 con 0x7fd9d80aa210 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.942+0000 7fd9ceffd640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.942+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fd9c80891a0 con 0x7fd9d80aa210 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.942+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.943+0000 7fd9de0fd640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 0x7fd9bc06d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4006fd0 tx=0x7fd9d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:25.947+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9d80a4cf0 con 0x7fd9d80aa210 2023-12-08T08:18:26.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.143+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9d80c60c0 con 0x7fd9d80aa210 2023-12-08T08:18:26.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.144+0000 7fd9ceffd640 1 -- 172.21.15.45:0/655841717 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9d80c60c0 con 0x7fd9d80aa210 2023-12-08T08:18:26.146 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:26.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 msgr2=0x7fd9bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 0x7fd9bc06d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4006fd0 tx=0x7fd9d4008040 comp rx=0 tx=0).stop 2023-12-08T08:18:26.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 msgr2=0x7fd9d81549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800d7a0 tx=0x7fd9c800dc60 comp rx=0 tx=0).stop 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 shutdown_connections 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9bc06ae40 0x7fd9bc06d300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9d81e9e20 0x7fd9d81ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d80aa210 0x7fd9d81549e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 --2- 172.21.15.45:0/655841717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c40052a0 0x7fd9d80c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.146+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 >> 172.21.15.45:0/655841717 conn(0x7fd9d8066ce0 msgr2=0x7fd9d8146770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.147+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 shutdown_connections 2023-12-08T08:18:26.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.147+0000 7fd9df0ff640 1 -- 172.21.15.45:0/655841717 wait complete. 2023-12-08T08:18:26.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.398+0000 7fbb57fb6640 1 Processor -- start 2023-12-08T08:18:26.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.398+0000 7fbb57fb6640 1 -- start start 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb57fb6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 0x7fbb500c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb57fb6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb50072a90 con 0x7fbb5006a730 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb57fb6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb500721f0 con 0x7fbb501487f0 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb57fb6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500724d0 con 0x7fbb50148c80 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb55d52640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb5006a730 0x7fbb50152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50074/0 (socket says 172.21.15.45:50074) 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb55d52640 1 -- 172.21.15.45:0/3079049246 learned_addr learned my addr 172.21.15.45:0/3079049246 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.400+0000 7fbb56553640 1 --2- 172.21.15.45:0/3079049246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 0x7fbb500c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30104165 0 0) 0x7fbb50072a90 con 0x7fbb5006a730 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb3c003520 con 0x7fbb5006a730 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624172914 0 0) 0x7fbb3c003520 con 0x7fbb5006a730 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb56553640 1 -- 172.21.15.45:0/3079049246 >> v1:172.21.15.114:6789/0 conn(0x7fbb501487f0 legacy=0x7fbb500c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb56553640 1 -- 172.21.15.45:0/3079049246 >> v1:172.21.15.45:6789/0 conn(0x7fbb5006a730 legacy=0x7fbb50152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.401+0000 7fbb56553640 1 -- 172.21.15.45:0/3079049246 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500727b0 con 0x7fbb50148c80 2023-12-08T08:18:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.402+0000 7fbb56553640 1 --2- 172.21.15.45:0/3079049246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 0x7fbb500c5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009dc0 tx=0x7fbb4802bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa5a64917fb21bd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.403+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c001670 con 0x7fbb50148c80 2023-12-08T08:18:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.403+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4802c880 con 0x7fbb50148c80 2023-12-08T08:18:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.403+0000 7fbb54d50640 1 -- 172.21.15.45:0/3079049246 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802cc10 con 0x7fbb50148c80 2023-12-08T08:18:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 -- 172.21.15.45:0/3079049246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 msgr2=0x7fbb500c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/3079049246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 0x7fbb500c5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009dc0 tx=0x7fbb4802bd50 comp rx=0 tx=0).stop 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 -- 172.21.15.45:0/3079049246 shutdown_connections 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/3079049246 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb50148c80 0x7fbb500c5670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 -- 172.21.15.45:0/3079049246 >> 172.21.15.45:0/3079049246 conn(0x7fbb500c34d0 msgr2=0x7fbb500c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 -- 172.21.15.45:0/3079049246 shutdown_connections 2023-12-08T08:18:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.404+0000 7fbb57fb6640 1 -- 172.21.15.45:0/3079049246 wait complete. 2023-12-08T08:18:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.406+0000 7fbb57fb6640 1 Processor -- start 2023-12-08T08:18:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.406+0000 7fbb57fb6640 1 -- start start 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5006a730 0x7fbb501eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb501487f0 0x7fbb501eb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501ea910 con 0x7fbb50148c80 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501eae40 con 0x7fbb5006a730 2023-12-08T08:18:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb57fb6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501eab60 con 0x7fbb501487f0 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb56553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb56553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56418/0 (socket says 172.21.15.45:56418) 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb56553640 1 -- 172.21.15.45:0/620551630 learned_addr learned my addr 172.21.15.45:0/620551630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb55d52640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5006a730 0x7fbb501eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.408+0000 7fbb55551640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb501487f0 0x7fbb501eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 -- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb501487f0 msgr2=0x7fbb501eb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb501487f0 0x7fbb501eb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 -- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5006a730 msgr2=0x7fbb501eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5006a730 0x7fbb501eb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 -- 172.21.15.45:0/620551630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48009a70 con 0x7fbb50148c80 2023-12-08T08:18:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb56553640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbb4802c360 tx=0x7fbb48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4802ce70 con 0x7fbb50148c80 2023-12-08T08:18:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48034c80 con 0x7fbb50148c80 2023-12-08T08:18:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48003990 con 0x7fbb50148c80 2023-12-08T08:18:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.409+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb501491c0 con 0x7fbb50148c80 2023-12-08T08:18:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.410+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb500a7540 con 0x7fbb50148c80 2023-12-08T08:18:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.411+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb500711b0 con 0x7fbb50148c80 2023-12-08T08:18:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.412+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb4803f420 con 0x7fbb50148c80 2023-12-08T08:18:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.413+0000 7fbb467fc640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 0x7fbb3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.413+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fbb480ac2f0 con 0x7fbb50148c80 2023-12-08T08:18:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.413+0000 7fbb55d52640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 0x7fbb3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.414+0000 7fbb55d52640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 0x7fbb3406d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007a00 tx=0x7fbb4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.420+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb48076fa0 con 0x7fbb50148c80 2023-12-08T08:18:26.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.611+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb501496e0 con 0x7fbb50148c80 2023-12-08T08:18:26.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.612+0000 7fbb467fc640 1 -- 172.21.15.45:0/620551630 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb501496e0 con 0x7fbb50148c80 2023-12-08T08:18:26.615 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.614+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 msgr2=0x7fbb3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.614+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 0x7fbb3406d330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c007a00 tx=0x7fbb4c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.614+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 msgr2=0x7fbb5014a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.614+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbb4802c360 tx=0x7fbb48004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 shutdown_connections 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbb3406ae70 0x7fbb3406d330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbb501487f0 0x7fbb501eb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb50148c80 0x7fbb5014a030 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 --2- 172.21.15.45:0/620551630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5006a730 0x7fbb501eb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 >> 172.21.15.45:0/620551630 conn(0x7fbb500c34d0 msgr2=0x7fbb500c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 shutdown_connections 2023-12-08T08:18:26.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.615+0000 7fbb57fb6640 1 -- 172.21.15.45:0/620551630 wait complete. 2023-12-08T08:18:26.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.870+0000 7fe410e56640 1 Processor -- start 2023-12-08T08:18:26.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.871+0000 7fe410e56640 1 -- start start 2023-12-08T08:18:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.872+0000 7fe410e56640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe40c0aaf60 0x7fe40c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.872+0000 7fe410e56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c0c1930 0x7fe40c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.872+0000 7fe410e56640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c152660 con 0x7fe40c06d960 2023-12-08T08:18:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.872+0000 7fe410e56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c0a4d10 con 0x7fe40c0c1930 2023-12-08T08:18:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.872+0000 7fe410e56640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c153200 con 0x7fe40c0aaf60 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c0c1930 0x7fe40c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c0c1930 0x7fe40c0c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56428/0 (socket says 172.21.15.45:56428) 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 -- 172.21.15.45:0/968699944 learned_addr learned my addr 172.21.15.45:0/968699944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 -- 172.21.15.45:0/968699944 >> v2:172.21.15.114:3300/0 conn(0x7fe40c0aaf60 msgr2=0x7fe40c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 --2- 172.21.15.45:0/968699944 >> v2:172.21.15.114:3300/0 conn(0x7fe40c0aaf60 0x7fe40c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 -- 172.21.15.45:0/968699944 >> v1:172.21.15.114:6789/0 conn(0x7fe40c06d960 legacy=0x7fe40c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.873+0000 7fe40ad9d640 1 -- 172.21.15.45:0/968699944 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c0c3310 con 0x7fe40c0c1930 2023-12-08T08:18:26.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.874+0000 7fe40ad9d640 1 --2- 172.21.15.45:0/968699944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0c1930 0x7fe40c0c1de0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0c2390 tx=0x7fe40402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba7704a2cdf003e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe40959a640 1 -- 172.21.15.45:0/968699944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4040317e0 con 0x7fe40c0c1930 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe40959a640 1 -- 172.21.15.45:0/968699944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe404031940 con 0x7fe40c0c1930 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe40959a640 1 -- 172.21.15.45:0/968699944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404031cd0 con 0x7fe40c0c1930 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 -- 172.21.15.45:0/968699944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0c1930 msgr2=0x7fe40c0c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 --2- 172.21.15.45:0/968699944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0c1930 0x7fe40c0c1de0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0c2390 tx=0x7fe40402b880 comp rx=0 tx=0).stop 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 -- 172.21.15.45:0/968699944 shutdown_connections 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 --2- 172.21.15.45:0/968699944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0c1930 0x7fe40c0c1de0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 --2- 172.21.15.45:0/968699944 >> v2:172.21.15.114:3300/0 conn(0x7fe40c0aaf60 0x7fe40c0c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.875+0000 7fe410e56640 1 -- 172.21.15.45:0/968699944 >> 172.21.15.45:0/968699944 conn(0x7fe40c0c2430 msgr2=0x7fe40c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.876+0000 7fe410e56640 1 -- 172.21.15.45:0/968699944 shutdown_connections 2023-12-08T08:18:26.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.876+0000 7fe410e56640 1 -- 172.21.15.45:0/968699944 wait complete. 2023-12-08T08:18:26.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.877+0000 7fe410e56640 1 Processor -- start 2023-12-08T08:18:26.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.877+0000 7fe410e56640 1 -- start start 2023-12-08T08:18:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40c06d960 0x7fe40c0befd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe40c0c1930 0x7fe40c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c14ca50 con 0x7fe40c0aaf60 2023-12-08T08:18:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c1ed2b0 con 0x7fe40c06d960 2023-12-08T08:18:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.878+0000 7fe410e56640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c1ed500 con 0x7fe40c0c1930 2023-12-08T08:18:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56438/0 (socket says 172.21.15.45:56438) 2023-12-08T08:18:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 -- 172.21.15.45:0/2066632640 learned_addr learned my addr 172.21.15.45:0/2066632640 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 -- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe40c0c1930 msgr2=0x7fe40c13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe40c0c1930 0x7fe40c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 -- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40c06d960 msgr2=0x7fe40c0befd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40c06d960 0x7fe40c0befd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 -- 172.21.15.45:0/2066632640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040094d0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.879+0000 7fe409d9b640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c400 tx=0x7fe40000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.880+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000035f0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.880+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400003750 con 0x7fe40c0aaf60 2023-12-08T08:18:26.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.880+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c1ed7e0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.880+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400003b40 con 0x7fe40c0aaf60 2023-12-08T08:18:26.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.880+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c1edda0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.881+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c06c6a0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.882+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe400003ca0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.883+0000 7fe3faffd640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 0x7fe3ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.883+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe4000890a0 con 0x7fe40c0aaf60 2023-12-08T08:18:26.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.883+0000 7fe40a59c640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 0x7fe3ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.884+0000 7fe40a59c640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 0x7fe3ec06d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00ab90 tx=0x7fe3fc009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:26.888+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe400053ce0 con 0x7fe40c0aaf60 2023-12-08T08:18:27.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.083+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe40c0c4bc0 con 0x7fe40c0aaf60 2023-12-08T08:18:27.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.084+0000 7fe3faffd640 1 -- 172.21.15.45:0/2066632640 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v65) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe4000170b0 con 0x7fe40c0aaf60 2023-12-08T08:18:27.086 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 msgr2=0x7fe3ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 0x7fe3ec06d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00ab90 tx=0x7fe3fc009250 comp rx=0 tx=0).stop 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 msgr2=0x7fe40c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c400 tx=0x7fe40000c8c0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 shutdown_connections 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe3ec06ae40 0x7fe3ec06d300 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe40c0c1930 0x7fe40c13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c0aaf60 0x7fe40c071b10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 --2- 172.21.15.45:0/2066632640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe40c06d960 0x7fe40c0befd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 >> 172.21.15.45:0/2066632640 conn(0x7fe40c0c2430 msgr2=0x7fe40c06ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.086+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 shutdown_connections 2023-12-08T08:18:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.087+0000 7fe410e56640 1 -- 172.21.15.45:0/2066632640 wait complete. 2023-12-08T08:18:27.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:18:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.324+0000 7fe7e2c72640 1 Processor -- start 2023-12-08T08:18:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.324+0000 7fe7e2c72640 1 -- start start 2023-12-08T08:18:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.325+0000 7fe7e2c72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7dc0c1ff0 0x7fe7dc154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.325+0000 7fe7e2c72640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc0c51d0 0x7fe7dc154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.325+0000 7fe7e2c72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc0c0d40 con 0x7fe7dc147bb0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.325+0000 7fe7e2c72640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc1555c0 con 0x7fe7dc0c1ff0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.325+0000 7fe7e2c72640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0a4d10 con 0x7fe7dc0c51d0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7e0a0e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe7dc147bb0 0x7fe7dc0c11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50088/0 (socket says 172.21.15.45:50088) 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7e0a0e640 1 -- 172.21.15.45:0/4145792694 learned_addr learned my addr 172.21.15.45:0/4145792694 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/4145792694 >> v2:172.21.15.45:3300/0 conn(0x7fe7dc0c1ff0 0x7fe7dc154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7e120f640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc0c51d0 0x7fe7dc154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d37fe640 1 -- 172.21.15.45:0/4145792694 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224386303 0 0) 0x7fe7dc0c0d40 con 0x7fe7dc147bb0 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d3fff640 1 -- 172.21.15.45:0/4145792694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc0c51d0 msgr2=0x7fe7dc154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc0c51d0 0x7fe7dc154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d3fff640 1 -- 172.21.15.45:0/4145792694 >> v1:172.21.15.45:6789/0 conn(0x7fe7dc147bb0 legacy=0x7fe7dc0c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.326+0000 7fe7d3fff640 1 -- 172.21.15.45:0/4145792694 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0a4ff0 con 0x7fe7dc0c1ff0 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.328+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc0c1ff0 0x7fe7dc154840 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097a0 tx=0x7fe7cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43786fb5a1fb76c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.328+0000 7fe7d37fe640 1 -- 172.21.15.45:0/4145792694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc031830 con 0x7fe7dc0c1ff0 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.328+0000 7fe7d37fe640 1 -- 172.21.15.45:0/4145792694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc031990 con 0x7fe7dc0c1ff0 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.328+0000 7fe7d37fe640 1 -- 172.21.15.45:0/4145792694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc031d20 con 0x7fe7dc0c1ff0 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.328+0000 7fe7e2c72640 1 -- 172.21.15.45:0/4145792694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc0c1ff0 msgr2=0x7fe7dc154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc0c1ff0 0x7fe7dc154840 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0097a0 tx=0x7fe7cc02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 -- 172.21.15.45:0/4145792694 shutdown_connections 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc0c51d0 0x7fe7dc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/4145792694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc0c1ff0 0x7fe7dc154840 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 -- 172.21.15.45:0/4145792694 >> 172.21.15.45:0/4145792694 conn(0x7fe7dc0c2430 msgr2=0x7fe7dc0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 -- 172.21.15.45:0/4145792694 shutdown_connections 2023-12-08T08:18:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.329+0000 7fe7e2c72640 1 -- 172.21.15.45:0/4145792694 wait complete. 2023-12-08T08:18:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.330+0000 7fe7e2c72640 1 Processor -- start 2023-12-08T08:18:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.331+0000 7fe7e2c72640 1 -- start start 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.331+0000 7fe7e2c72640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 0x7fe7dc1ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.331+0000 7fe7e2c72640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc147bb0 0x7fe7dc1ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.331+0000 7fe7e2c72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.331+0000 7fe7e2c72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1ea960 con 0x7fe7dc14ff20 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e2c72640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1e9f90 con 0x7fe7dc0c51d0 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e2c72640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1e99a0 con 0x7fe7dc147bb0 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56460/0 (socket says 172.21.15.45:56460) 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 -- 172.21.15.45:0/3704860886 learned_addr learned my addr 172.21.15.45:0/3704860886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7d3fff640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc147bb0 0x7fe7dc1ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 -- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc147bb0 msgr2=0x7fe7dc1ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc147bb0 0x7fe7dc1ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e0a0e640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 0x7fe7dc1ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 -- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 msgr2=0x7fe7dc1ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 0x7fe7dc1ea420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e120f640 1 -- 172.21.15.45:0/3704860886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009400 con 0x7fe7dc14ff20 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.332+0000 7fe7e0a0e640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 0x7fe7dc1ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:27.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7e120f640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40070b0 tx=0x7fe7d40085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4010070 con 0x7fe7dc14ff20 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400be80 con 0x7fe7dc14ff20 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4003990 con 0x7fe7dc14ff20 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc072540 con 0x7fe7dc14ff20 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.333+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc1e9c20 con 0x7fe7dc14ff20 2023-12-08T08:18:27.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.334+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc1ea120 con 0x7fe7dc14ff20 2023-12-08T08:18:27.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.335+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7d4014030 con 0x7fe7dc14ff20 2023-12-08T08:18:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.336+0000 7fe7d17fa640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 0x7fe7c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.336+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fe7d4089920 con 0x7fe7dc14ff20 2023-12-08T08:18:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.336+0000 7fe7e0a0e640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 0x7fe7c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.337+0000 7fe7e0a0e640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 0x7fe7c806d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000f60 tx=0x7fe7d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.340+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7d40544b0 con 0x7fe7dc14ff20 2023-12-08T08:18:27.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.529+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe7dc074670 con 0x7fe7dc14ff20 2023-12-08T08:18:27.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.530+0000 7fe7d17fa640 1 -- 172.21.15.45:0/3704860886 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v65) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe7d4057ad0 con 0x7fe7dc14ff20 2023-12-08T08:18:27.533 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 msgr2=0x7fe7c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 0x7fe7c806d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000f60 tx=0x7fe7d8009040 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 msgr2=0x7fe7dc151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40070b0 tx=0x7fe7d40085d0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 shutdown_connections 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe7c806ae40 0x7fe7c806d300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe7dc147bb0 0x7fe7dc1ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7dc14ff20 0x7fe7dc151b60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 --2- 172.21.15.45:0/3704860886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0c51d0 0x7fe7dc1ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 >> 172.21.15.45:0/3704860886 conn(0x7fe7dc0c2430 msgr2=0x7fe7dc0a6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 shutdown_connections 2023-12-08T08:18:27.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.533+0000 7fe7e2c72640 1 -- 172.21.15.45:0/3704860886 wait complete. 2023-12-08T08:18:27.555 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.767+0000 7f1835e9b640 1 Processor -- start 2023-12-08T08:18:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.767+0000 7f1835e9b640 1 -- start start 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.768+0000 7f1835e9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f183014e0c0 0x7f18300c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f1835e9b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18300c0a70 0x7f1830150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f1835e9b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183014e4a0 con 0x7f18300c03a0 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f1835e9b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1830154100 con 0x7f183014e0c0 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f1835e9b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18301543e0 con 0x7f18300c0a70 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f183014e0c0 0x7f18300c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f183014e0c0 0x7f18300c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56472/0 (socket says 172.21.15.45:56472) 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 -- 172.21.15.45:0/2203257635 learned_addr learned my addr 172.21.15.45:0/2203257635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 -- 172.21.15.45:0/2203257635 >> v2:172.21.15.114:3300/0 conn(0x7f18300c0a70 msgr2=0x7f1830150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 --2- 172.21.15.45:0/2203257635 >> v2:172.21.15.114:3300/0 conn(0x7f18300c0a70 0x7f1830150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 -- 172.21.15.45:0/2203257635 >> v1:172.21.15.114:6789/0 conn(0x7f18300c03a0 legacy=0x7f1830151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.769+0000 7f182f7fe640 1 -- 172.21.15.45:0/2203257635 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18301546c0 con 0x7f183014e0c0 2023-12-08T08:18:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.770+0000 7f182f7fe640 1 --2- 172.21.15.45:0/2203257635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f183014e0c0 0x7f18300c3900 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f18300bfb30 tx=0x7f182002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2907c284d5005af server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f182effd640 1 -- 172.21.15.45:0/2203257635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820032860 con 0x7f183014e0c0 2023-12-08T08:18:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f182effd640 1 -- 172.21.15.45:0/2203257635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200329c0 con 0x7f183014e0c0 2023-12-08T08:18:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f182effd640 1 -- 172.21.15.45:0/2203257635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820032d50 con 0x7f183014e0c0 2023-12-08T08:18:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 -- 172.21.15.45:0/2203257635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f183014e0c0 msgr2=0x7f18300c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 --2- 172.21.15.45:0/2203257635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f183014e0c0 0x7f18300c3900 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f18300bfb30 tx=0x7f182002c900 comp rx=0 tx=0).stop 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 -- 172.21.15.45:0/2203257635 shutdown_connections 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 --2- 172.21.15.45:0/2203257635 >> v2:172.21.15.114:3300/0 conn(0x7f18300c0a70 0x7f1830150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 --2- 172.21.15.45:0/2203257635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f183014e0c0 0x7f18300c3900 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.771+0000 7f1835e9b640 1 -- 172.21.15.45:0/2203257635 >> 172.21.15.45:0/2203257635 conn(0x7f18300661f0 msgr2=0x7f1830066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.772+0000 7f1835e9b640 1 -- 172.21.15.45:0/2203257635 shutdown_connections 2023-12-08T08:18:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.772+0000 7f1835e9b640 1 -- 172.21.15.45:0/2203257635 wait complete. 2023-12-08T08:18:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.773+0000 7f1835e9b640 1 Processor -- start 2023-12-08T08:18:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.773+0000 7f1835e9b640 1 -- start start 2023-12-08T08:18:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 0x7f183006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 0x7f183014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830150880 con 0x7f18300c0a70 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301edd90 con 0x7f183014e0c0 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.774+0000 7f1835e9b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18301eda90 con 0x7f18300c03a0 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56474/0 (socket says 172.21.15.45:56474) 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 -- 172.21.15.45:0/1945675915 learned_addr learned my addr 172.21.15.45:0/1945675915 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f182f7fe640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 0x7f183006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f182ffff640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 0x7f183014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 -- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 msgr2=0x7f183006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 0x7f183006fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 -- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 msgr2=0x7f183014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 0x7f183014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 -- 172.21.15.45:0/1945675915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200094d0 con 0x7f18300c0a70 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f182f7fe640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 0x7f183006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f182ffff640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 0x7f183014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.775+0000 7f1827fff640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f181800b4d0 tx=0x7f181800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.776+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818010870 con 0x7f18300c0a70 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.776+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180109d0 con 0x7f18300c0a70 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.776+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818010d80 con 0x7f18300c0a70 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.776+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18301eb3c0 con 0x7f18300c0a70 2023-12-08T08:18:27.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.776+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830153030 con 0x7f18300c0a70 2023-12-08T08:18:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.777+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830074600 con 0x7f18300c0a70 2023-12-08T08:18:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.778+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f181800f3c0 con 0x7f18300c0a70 2023-12-08T08:18:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.779+0000 7f182cff9640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 0x7f181006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.779+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f1818089a00 con 0x7f18300c0a70 2023-12-08T08:18:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.779+0000 7f182f7fe640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 0x7f181006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.780+0000 7f182f7fe640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 0x7f181006d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1820037000 tx=0x7f1820008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:27.784+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1818054630 con 0x7f18300c0a70 2023-12-08T08:18:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.008+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18300c3270 con 0x7f18300c0a70 2023-12-08T08:18:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.009+0000 7f182cff9640 1 -- 172.21.15.45:0/1945675915 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f1818057c50 con 0x7f18300c0a70 2023-12-08T08:18:28.012 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:28.013 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 msgr2=0x7f181006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 0x7f181006d330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1820037000 tx=0x7f1820008030 comp rx=0 tx=0).stop 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 msgr2=0x7f18301eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f181800b4d0 tx=0x7f181800b990 comp rx=0 tx=0).stop 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 shutdown_connections 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f181006ae70 0x7f181006d330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183014e0c0 0x7f183014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18300c0a70 0x7f18301eae80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 --2- 172.21.15.45:0/1945675915 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18300c03a0 0x7f183006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 >> 172.21.15.45:0/1945675915 conn(0x7f18300661f0 msgr2=0x7f183014d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 shutdown_connections 2023-12-08T08:18:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.012+0000 7f1835e9b640 1 -- 172.21.15.45:0/1945675915 wait complete. 2023-12-08T08:18:28.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.252+0000 7f3c8722e640 1 Processor -- start 2023-12-08T08:18:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.252+0000 7f3c8722e640 1 -- start start 2023-12-08T08:18:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c8722e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c800c7d50 0x7f3c80157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c8722e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c800c8470 con 0x7f3c800af290 2023-12-08T08:18:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c8722e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8006c320 con 0x7f3c800c47d0 2023-12-08T08:18:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c8722e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8006cb30 con 0x7f3c800c7d50 2023-12-08T08:18:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c85a2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c800c7d50 0x7f3c80157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c85a2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c800c7d50 0x7f3c80157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56476/0 (socket says 172.21.15.45:56476) 2023-12-08T08:18:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.253+0000 7f3c85a2b640 1 -- 172.21.15.45:0/679804349 learned_addr learned my addr 172.21.15.45:0/679804349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.254+0000 7f3c85a2b640 1 -- 172.21.15.45:0/679804349 >> v1:172.21.15.114:6789/0 conn(0x7f3c800c47d0 legacy=0x7f3c801582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.254+0000 7f3c85a2b640 1 -- 172.21.15.45:0/679804349 >> v1:172.21.15.45:6789/0 conn(0x7f3c800af290 legacy=0x7f3c800ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.254+0000 7f3c85a2b640 1 -- 172.21.15.45:0/679804349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800c4fd0 con 0x7f3c800c7d50 2023-12-08T08:18:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.254+0000 7f3c8522a640 1 -- 172.21.15.45:0/679804349 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239268369 0 0) 0x7f3c800c8470 con 0x7f3c800af290 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.255+0000 7f3c85a2b640 1 --2- 172.21.15.45:0/679804349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c7d50 0x7f3c80157da0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009870 tx=0x7f3c7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13163795e31651a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.255+0000 7f3c8522a640 1 -- 172.21.15.45:0/679804349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c700317e0 con 0x7f3c800c7d50 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.255+0000 7f3c8522a640 1 -- 172.21.15.45:0/679804349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c70031940 con 0x7f3c800c7d50 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.255+0000 7f3c8522a640 1 -- 172.21.15.45:0/679804349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70031cd0 con 0x7f3c800c7d50 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 -- 172.21.15.45:0/679804349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c7d50 msgr2=0x7f3c80157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 --2- 172.21.15.45:0/679804349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c7d50 0x7f3c80157da0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009870 tx=0x7f3c7002b880 comp rx=0 tx=0).stop 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 -- 172.21.15.45:0/679804349 shutdown_connections 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 --2- 172.21.15.45:0/679804349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c7d50 0x7f3c80157da0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 -- 172.21.15.45:0/679804349 >> 172.21.15.45:0/679804349 conn(0x7f3c800663d0 msgr2=0x7f3c800667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 -- 172.21.15.45:0/679804349 shutdown_connections 2023-12-08T08:18:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.256+0000 7f3c8722e640 1 -- 172.21.15.45:0/679804349 wait complete. 2023-12-08T08:18:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.258+0000 7f3c8722e640 1 Processor -- start 2023-12-08T08:18:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.258+0000 7f3c8722e640 1 -- start start 2023-12-08T08:18:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 0x7f3c800aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c800c7d50 0x7f3c801553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800ab040 con 0x7f3c800c47d0 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800ab2c0 con 0x7f3c800c7d50 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c8722e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c800ab5a0 con 0x7f3c800af290 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c85a2b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c85a2b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56492/0 (socket says 172.21.15.45:56492) 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.259+0000 7f3c85a2b640 1 -- 172.21.15.45:0/1335945041 learned_addr learned my addr 172.21.15.45:0/1335945041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c8622c640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 0x7f3c800aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 -- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 msgr2=0x7f3c800aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 0x7f3c800aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c86a2d640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c800c7d50 0x7f3c801553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 -- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c800c7d50 msgr2=0x7f3c801553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c800c7d50 0x7f3c801553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 -- 172.21.15.45:0/1335945041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700094d0 con 0x7f3c800c47d0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c8622c640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 0x7f3c800aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c85a2b640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009870 tx=0x7f3c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70004230 con 0x7f3c800c47d0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c700043b0 con 0x7f3c800c47d0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.260+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70004520 con 0x7f3c800c47d0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.261+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c800ab880 con 0x7f3c800c47d0 2023-12-08T08:18:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.261+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c800abe40 con 0x7f3c800c47d0 2023-12-08T08:18:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.262+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c800ab6e0 con 0x7f3c800c47d0 2023-12-08T08:18:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.263+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c70043070 con 0x7f3c800c47d0 2023-12-08T08:18:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.264+0000 7f3c76ffd640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 0x7f3c6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.264+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f3c700aba20 con 0x7f3c800c47d0 2023-12-08T08:18:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.264+0000 7f3c8622c640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 0x7f3c6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.265+0000 7f3c8622c640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 0x7f3c6406d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000f60 tx=0x7f3c7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.268+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c800ab6e0 con 0x7f3c800c47d0 2023-12-08T08:18:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.466+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c800ab6e0 con 0x7f3c800c47d0 2023-12-08T08:18:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.468+0000 7f3c76ffd640 1 -- 172.21.15.45:0/1335945041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f3c800ab6e0 con 0x7f3c800c47d0 2023-12-08T08:18:28.471 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:28.472 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 msgr2=0x7f3c6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 0x7f3c6406d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c000f60 tx=0x7f3c7c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 msgr2=0x7f3c800a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009870 tx=0x7f3c700046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 shutdown_connections 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c6406ae40 0x7f3c6406d300 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c800c7d50 0x7f3c801553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c800c47d0 0x7f3c800a9b90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 --2- 172.21.15.45:0/1335945041 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c800af290 0x7f3c800aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 >> 172.21.15.45:0/1335945041 conn(0x7f3c800663d0 msgr2=0x7f3c800667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 shutdown_connections 2023-12-08T08:18:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.471+0000 7f3c8722e640 1 -- 172.21.15.45:0/1335945041 wait complete. 2023-12-08T08:18:28.493 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:18:28.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.699+0000 7f9bf64df640 1 Processor -- start 2023-12-08T08:18:28.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.699+0000 7f9bf64df640 1 -- start start 2023-12-08T08:18:28.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf00a7910 0x7f9bf00c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bf00c1dc0 0x7f9bf014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bf01521b0 0x7f9bf0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf0155850 con 0x7f9bf01521b0 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf00c0890 con 0x7f9bf00c1dc0 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf64df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00c0b70 con 0x7f9bf00a7910 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf5cde640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bf01521b0 0x7f9bf0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.701+0000 7f9bf5cde640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bf01521b0 0x7f9bf0155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56508/0 (socket says 172.21.15.45:56508) 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 -- 172.21.15.45:0/823539577 learned_addr learned my addr 172.21.15.45:0/823539577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf54dd640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf00a7910 0x7f9bf00c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf4cdc640 1 --2- 172.21.15.45:0/823539577 >> v2:172.21.15.114:3300/0 conn(0x7f9bf00c1dc0 0x7f9bf014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 -- 172.21.15.45:0/823539577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf00a7910 msgr2=0x7f9bf00c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf00a7910 0x7f9bf00c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 -- 172.21.15.45:0/823539577 >> v2:172.21.15.114:3300/0 conn(0x7f9bf00c1dc0 msgr2=0x7f9bf014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 --2- 172.21.15.45:0/823539577 >> v2:172.21.15.114:3300/0 conn(0x7f9bf00c1dc0 0x7f9bf014f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.702+0000 7f9bf5cde640 1 -- 172.21.15.45:0/823539577 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf00c0e50 con 0x7f9bf01521b0 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.703+0000 7f9bf5cde640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf01521b0 0x7f9bf0155ce0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9bf006ac60 tx=0x7f9be802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7304f592cbd09f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9be7fff640 1 -- 172.21.15.45:0/823539577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be80317e0 con 0x7f9bf01521b0 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9be7fff640 1 -- 172.21.15.45:0/823539577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8031940 con 0x7f9bf01521b0 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9be7fff640 1 -- 172.21.15.45:0/823539577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8031cd0 con 0x7f9bf01521b0 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 -- 172.21.15.45:0/823539577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf01521b0 msgr2=0x7f9bf0155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf01521b0 0x7f9bf0155ce0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9bf006ac60 tx=0x7f9be802b880 comp rx=0 tx=0).stop 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 -- 172.21.15.45:0/823539577 shutdown_connections 2023-12-08T08:18:28.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 --2- 172.21.15.45:0/823539577 >> v2:172.21.15.114:3300/0 conn(0x7f9bf00c1dc0 0x7f9bf014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf01521b0 0x7f9bf0155ce0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 --2- 172.21.15.45:0/823539577 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf00a7910 0x7f9bf00c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 -- 172.21.15.45:0/823539577 >> 172.21.15.45:0/823539577 conn(0x7f9bf00c5780 msgr2=0x7f9bf00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 -- 172.21.15.45:0/823539577 shutdown_connections 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.704+0000 7f9bf64df640 1 -- 172.21.15.45:0/823539577 wait complete. 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.706+0000 7f9bf64df640 1 Processor -- start 2023-12-08T08:18:28.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.706+0000 7f9bf64df640 1 -- start start 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bf00c1dc0 0x7f9bf014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 0x7f9bf01e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf014bd50 con 0x7f9bf00a7910 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf014ee50 con 0x7f9bf00c1dc0 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf64df640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf01e89c0 con 0x7f9bf01521b0 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.707+0000 7f9bf54dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56510/0 (socket says 172.21.15.45:56510) 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 -- 172.21.15.45:0/2330806916 learned_addr learned my addr 172.21.15.45:0/2330806916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 -- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 msgr2=0x7f9bf01e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf5cde640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 0x7f9bf01e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf4cdc640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bf00c1dc0 0x7f9bf014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 0x7f9bf01e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 -- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bf00c1dc0 msgr2=0x7f9bf014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bf00c1dc0 0x7f9bf014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 -- 172.21.15.45:0/2330806916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80094d0 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf5cde640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 0x7f9bf01e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.708+0000 7f9bf54dd640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007e90 tx=0x7f9bec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.709+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec014420 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.709+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec014580 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.709+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec014910 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.709+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf00bf8d0 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.709+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf00c4d20 con 0x7f9bf00a7910 2023-12-08T08:18:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.710+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf00743e0 con 0x7f9bf00a7910 2023-12-08T08:18:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.711+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9bec014a70 con 0x7f9bf00a7910 2023-12-08T08:18:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.712+0000 7f9be5ffb640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 0x7f9bd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.712+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f9bec08a340 con 0x7f9bf00a7910 2023-12-08T08:18:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.712+0000 7f9bf4cdc640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 0x7f9bd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.713+0000 7f9bf4cdc640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 0x7f9bd406d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9be0006fd0 tx=0x7f9be0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.716+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bec054f70 con 0x7f9bf00a7910 2023-12-08T08:18:28.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:28.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.955+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf00ab030 con 0x7f9bf00a7910 2023-12-08T08:18:28.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.956+0000 7f9be5ffb640 1 -- 172.21.15.45:0/2330806916 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f9bec058590 con 0x7f9bf00a7910 2023-12-08T08:18:28.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:28.959 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:28.960 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-12-08T08:18:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 msgr2=0x7f9bd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 0x7f9bd406d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9be0006fd0 tx=0x7f9be0008040 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 msgr2=0x7f9bf01e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007e90 tx=0x7f9bec00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 shutdown_connections 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9bd406ae40 0x7f9bd406d300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9bf01521b0 0x7f9bf01e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bf00c1dc0 0x7f9bf014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 --2- 172.21.15.45:0/2330806916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf00a7910 0x7f9bf01e5e60 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 >> 172.21.15.45:0/2330806916 conn(0x7f9bf00c5780 msgr2=0x7f9bf014f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 shutdown_connections 2023-12-08T08:18:28.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:28.958+0000 7f9bf64df640 1 -- 172.21.15.45:0/2330806916 wait complete. 2023-12-08T08:18:28.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:29.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.180+0000 7f95c7b05640 1 Processor -- start 2023-12-08T08:18:29.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.180+0000 7f95c7b05640 1 -- start start 2023-12-08T08:18:29.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.181+0000 7f95c7b05640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f95c0154190 0x7f95c00aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c7b05640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00c63b0 con 0x7f95c00a4f30 2023-12-08T08:18:29.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c7b05640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00a53c0 con 0x7f95c0154a20 2023-12-08T08:18:29.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c7b05640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c00a9f20 con 0x7f95c0154190 2023-12-08T08:18:29.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c50a0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95c00a4f30 0x7f95c00c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50110/0 (socket says 172.21.15.45:50110) 2023-12-08T08:18:29.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c50a0640 1 -- 172.21.15.45:0/3281815381 learned_addr learned my addr 172.21.15.45:0/3281815381 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:29.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c58a1640 1 --2- 172.21.15.45:0/3281815381 >> v2:172.21.15.114:3300/0 conn(0x7f95c0154190 0x7f95c00aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556289889 0 0) 0x7f95c00c63b0 con 0x7f95c00a4f30 2023-12-08T08:18:29.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.182+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac005730 con 0x7f95c00a4f30 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480149241 0 0) 0x7f95ac005730 con 0x7f95c00a4f30 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 >> v2:172.21.15.114:3300/0 conn(0x7f95c0154190 msgr2=0x7f95c00aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 --2- 172.21.15.45:0/3281815381 >> v2:172.21.15.114:3300/0 conn(0x7f95c0154190 0x7f95c00aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 >> v1:172.21.15.114:6789/0 conn(0x7f95c0154a20 legacy=0x7f95c0154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00a9580 con 0x7f95c00a4f30 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f95b0001670 con 0x7f95c00a4f30 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 >> v1:172.21.15.45:6789/0 conn(0x7f95c00a4f30 legacy=0x7f95c00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95ac005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ac0069d0 0x7f95ac006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95ac0073e0 0x7f95ac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00a9f20 con 0x7f95ac005bd0 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00e330 con 0x7f95ac0069d0 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00e4f0 con 0x7f95ac0073e0 2023-12-08T08:18:29.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.183+0000 7f95c58a1640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95ac005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c58a1640 1 -- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95ac0073e0 msgr2=0x7f95ac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c58a1640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95ac0073e0 0x7f95ac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c58a1640 1 -- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ac0069d0 msgr2=0x7f95ac006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c58a1640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95ac0069d0 0x7f95ac006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c58a1640 1 -- 172.21.15.45:0/3281815381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac005730 con 0x7f95ac005bd0 2023-12-08T08:18:29.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.184+0000 7f95c60a2640 1 -- 172.21.15.45:0/3281815381 reap_dead start 2023-12-08T08:18:29.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c58a1640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95ac005ff0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009a90 tx=0x7f95ac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1e68ba0e6216fc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc02c6b0 con 0x7f95ac005bd0 2023-12-08T08:18:29.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc02c810 con 0x7f95ac005bd0 2023-12-08T08:18:29.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c489f640 1 -- 172.21.15.45:0/3281815381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc02cba0 con 0x7f95ac005bd0 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c7b05640 1 -- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 msgr2=0x7f95ac005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.185+0000 7f95c7b05640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95ac005ff0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009a90 tx=0x7f95ac007a00 comp rx=0 tx=0).stop 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.186+0000 7f95c7b05640 1 -- 172.21.15.45:0/3281815381 shutdown_connections 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.186+0000 7f95c7b05640 1 --2- 172.21.15.45:0/3281815381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95ac005ff0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.186+0000 7f95c7b05640 1 -- 172.21.15.45:0/3281815381 >> 172.21.15.45:0/3281815381 conn(0x7f95c00661f0 msgr2=0x7f95c0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.186+0000 7f95c7b05640 1 -- 172.21.15.45:0/3281815381 shutdown_connections 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.186+0000 7f95c7b05640 1 -- 172.21.15.45:0/3281815381 wait complete. 2023-12-08T08:18:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.187+0000 7f95c7b05640 1 Processor -- start 2023-12-08T08:18:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.188+0000 7f95c7b05640 1 -- start start 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95c01520e0 0x7f95c0148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95c0149080 0x7f95c01ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01ebb00 con 0x7f95ac005bd0 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c009cc20 con 0x7f95c01520e0 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c7b05640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c009a0a0 con 0x7f95c0149080 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56528/0 (socket says 172.21.15.45:56528) 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 -- 172.21.15.45:0/596693077 learned_addr learned my addr 172.21.15.45:0/596693077 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 -- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95c0149080 msgr2=0x7f95c01ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95c0149080 0x7f95c01ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 -- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95c01520e0 msgr2=0x7f95c0148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95c01520e0 0x7f95c0148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.189+0000 7f95c58a1640 1 -- 172.21.15.45:0/596693077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c01eb480 con 0x7f95ac005bd0 2023-12-08T08:18:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95c58a1640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f95bc037040 tx=0x7f95bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003810 con 0x7f95ac005bd0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc003970 con 0x7f95ac005bd0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc003ce0 con 0x7f95ac005bd0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c01ee3a0 con 0x7f95ac005bd0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.190+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c01eb720 con 0x7f95ac005bd0 2023-12-08T08:18:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.191+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0074600 con 0x7f95ac005bd0 2023-12-08T08:18:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.192+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95bc047450 con 0x7f95ac005bd0 2023-12-08T08:18:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.193+0000 7f95b67fc640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 0x7f95a406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.193+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f95bc0abda0 con 0x7f95ac005bd0 2023-12-08T08:18:29.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.193+0000 7f95c50a0640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 0x7f95a406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.194+0000 7f95c50a0640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 0x7f95a406d350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f95c00bf2f0 tx=0x7f95b0001540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.197+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95bc076b80 con 0x7f95ac005bd0 2023-12-08T08:18:29.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.424+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95c00c0720 con 0x7f95ac005bd0 2023-12-08T08:18:29.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.425+0000 7f95b67fc640 1 -- 172.21.15.45:0/596693077 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f95bc0044e0 con 0x7f95ac005bd0 2023-12-08T08:18:29.428 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:29.428 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:41.237126+0000","modified":"2023-12-08T08:17:44.323853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6024":{"gid":6024,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6837/63008111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":63008111},{"type":"v1","addr":"172.21.15.45:6837","nonce":63008111}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:29.429 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 msgr2=0x7f95a406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 0x7f95a406d350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f95c00bf2f0 tx=0x7f95b0001540 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 msgr2=0x7f95c01ede60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f95bc037040 tx=0x7f95bc004730 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 shutdown_connections 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95a406ae90 0x7f95a406d350 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95c0149080 0x7f95c01ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95c01520e0 0x7f95c0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 --2- 172.21.15.45:0/596693077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95ac005bd0 0x7f95c01ede60 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 >> 172.21.15.45:0/596693077 conn(0x7f95c00661f0 msgr2=0x7f95c00665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 shutdown_connections 2023-12-08T08:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.428+0000 7f95c7b05640 1 -- 172.21.15.45:0/596693077 wait complete. 2023-12-08T08:18:29.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.666+0000 7f7b2359e640 1 Processor -- start 2023-12-08T08:18:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.666+0000 7f7b2359e640 1 -- start start 2023-12-08T08:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.667+0000 7f7b2359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b240af290 0x7f7b240ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.667+0000 7f7b2359e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 0x7f7b241584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.667+0000 7f7b2359e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240c8470 con 0x7f7b240c7d50 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.667+0000 7f7b2359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2406cb30 con 0x7f7b240af290 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.667+0000 7f7b2359e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2406c320 con 0x7f7b240ca6d0 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b2259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b240af290 0x7f7b240ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b21d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b240c7d50 0x7f7b24157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50114/0 (socket says 172.21.15.45:50114) 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b21d9b640 1 -- 172.21.15.45:0/154428726 learned_addr learned my addr 172.21.15.45:0/154428726 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b22d9d640 1 --2- 172.21.15.45:0/154428726 >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 0x7f7b241584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b2159a640 1 -- 172.21.15.45:0/154428726 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048167722 0 0) 0x7f7b240c8470 con 0x7f7b240c7d50 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.668+0000 7f7b2159a640 1 -- 172.21.15.45:0/154428726 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b0c003520 con 0x7f7b240c7d50 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.669+0000 7f7b2259c640 1 -- 172.21.15.45:0/154428726 >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 msgr2=0x7f7b241584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.669+0000 7f7b2259c640 1 --2- 172.21.15.45:0/154428726 >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 0x7f7b241584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.669+0000 7f7b2259c640 1 -- 172.21.15.45:0/154428726 >> v1:172.21.15.45:6789/0 conn(0x7f7b240c7d50 legacy=0x7f7b24157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.669+0000 7f7b2259c640 1 -- 172.21.15.45:0/154428726 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240c4fd0 con 0x7f7b240af290 2023-12-08T08:18:29.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.669+0000 7f7b22d9d640 1 --2- 172.21.15.45:0/154428726 >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 0x7f7b241584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.670+0000 7f7b2259c640 1 --2- 172.21.15.45:0/154428726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b240ca190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7b240a9900 tx=0x7f7b1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4860d1927764a2d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2159a640 1 -- 172.21.15.45:0/154428726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402e070 con 0x7f7b240af290 2023-12-08T08:18:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2159a640 1 -- 172.21.15.45:0/154428726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b140315a0 con 0x7f7b240af290 2023-12-08T08:18:29.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2159a640 1 -- 172.21.15.45:0/154428726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14031910 con 0x7f7b240af290 2023-12-08T08:18:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 -- 172.21.15.45:0/154428726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 msgr2=0x7f7b240ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 --2- 172.21.15.45:0/154428726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b240ca190 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7b240a9900 tx=0x7f7b1402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 -- 172.21.15.45:0/154428726 shutdown_connections 2023-12-08T08:18:29.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 --2- 172.21.15.45:0/154428726 >> v2:172.21.15.114:3300/0 conn(0x7f7b240ca6d0 0x7f7b241584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 --2- 172.21.15.45:0/154428726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b240ca190 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 -- 172.21.15.45:0/154428726 >> 172.21.15.45:0/154428726 conn(0x7f7b240663d0 msgr2=0x7f7b240667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 -- 172.21.15.45:0/154428726 shutdown_connections 2023-12-08T08:18:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.671+0000 7f7b2359e640 1 -- 172.21.15.45:0/154428726 wait complete. 2023-12-08T08:18:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.673+0000 7f7b2359e640 1 Processor -- start 2023-12-08T08:18:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.673+0000 7f7b2359e640 1 -- start start 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b240c7d50 0x7f7b24153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b240ca6d0 0x7f7b241ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241dd2b0 con 0x7f7b240af290 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240c18d0 con 0x7f7b240c7d50 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2359e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241ecbc0 con 0x7f7b240ca6d0 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56548/0 (socket says 172.21.15.45:56548) 2023-12-08T08:18:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.674+0000 7f7b2259c640 1 -- 172.21.15.45:0/4291923333 learned_addr learned my addr 172.21.15.45:0/4291923333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 -- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b240ca6d0 msgr2=0x7f7b241ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b240ca6d0 0x7f7b241ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 -- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b240c7d50 msgr2=0x7f7b24153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b240c7d50 0x7f7b24153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 -- 172.21.15.45:0/4291923333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009400 con 0x7f7b240af290 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b2259c640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.675+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14003810 con 0x7f7b240af290 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.676+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14040070 con 0x7f7b240af290 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.676+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b241ea3d0 con 0x7f7b240af290 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.676+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14003b70 con 0x7f7b240af290 2023-12-08T08:18:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.676+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b240c1310 con 0x7f7b240af290 2023-12-08T08:18:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.677+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b240743e0 con 0x7f7b240af290 2023-12-08T08:18:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.678+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b14003cd0 con 0x7f7b240af290 2023-12-08T08:18:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.679+0000 7f7b12ffd640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 0x7f7b0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.679+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f7b14042070 con 0x7f7b240af290 2023-12-08T08:18:29.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.679+0000 7f7b21d9b640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 0x7f7b0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.679+0000 7f7b21d9b640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 0x7f7b0406d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000f60 tx=0x7f7b180078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.683+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b14076d50 con 0x7f7b240af290 2023-12-08T08:18:29.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.884+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b240c5bc0 con 0x7f7b240af290 2023-12-08T08:18:29.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.886+0000 7f7b12ffd640 1 -- 172.21.15.45:0/4291923333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+20602 (secure 0 0 0) 0x7f7b14006e10 con 0x7f7b240af290 2023-12-08T08:18:29.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:29.889 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:17:58.773564+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:39.667136+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:40.266994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.10","mappings":[{"from":7,"to":2}]},{"pgid":"10.e","mappings":[{"from":4,"to":3}]},{"pgid":"10.36","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:29.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 msgr2=0x7f7b0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 0x7f7b0406d330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000f60 tx=0x7f7b180078f0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 msgr2=0x7f7b241e9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b140046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 shutdown_connections 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7b0406ae70 0x7f7b0406d330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b240ca6d0 0x7f7b241ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b240c7d50 0x7f7b24153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 --2- 172.21.15.45:0/4291923333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b240af290 0x7f7b241e9e90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.889+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 >> 172.21.15.45:0/4291923333 conn(0x7f7b240663d0 msgr2=0x7f7b241573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.890+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 shutdown_connections 2023-12-08T08:18:29.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:29.890+0000 7f7b2359e640 1 -- 172.21.15.45:0/4291923333 wait complete. 2023-12-08T08:18:29.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.127+0000 7f08c51d4640 1 Processor -- start 2023-12-08T08:18:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.128+0000 7f08c51d4640 1 -- start start 2023-12-08T08:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.129+0000 7f08c51d4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08c006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.129+0000 7f08c51d4640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f08c0155dd0 0x7f08c00c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.129+0000 7f08c51d4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c01521e0 con 0x7f08c00c5600 2023-12-08T08:18:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.129+0000 7f08c51d4640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c0152b80 con 0x7f08c0155dd0 2023-12-08T08:18:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.129+0000 7f08c51d4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01524c0 con 0x7f08c00c50b0 2023-12-08T08:18:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08bffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08c00c5600 0x7f08c01556c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50122/0 (socket says 172.21.15.45:50122) 2023-12-08T08:18:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08bffff640 1 -- 172.21.15.45:0/3124990163 learned_addr learned my addr 172.21.15.45:0/3124990163 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245061311 0 0) 0x7f08c01521e0 con 0x7f08c00c5600 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8003520 con 0x7f08c00c5600 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08bf7fe640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08c006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.130+0000 7f08c49d3640 1 --2- 172.21.15.45:0/3124990163 >> v2:172.21.15.114:3300/0 conn(0x7f08c0155dd0 0x7f08c00c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4064404618 0 0) 0x7f08a8003520 con 0x7f08c00c5600 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 msgr2=0x7f08c006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08c006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 >> v2:172.21.15.114:3300/0 conn(0x7f08c0155dd0 msgr2=0x7f08c00c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 --2- 172.21.15.45:0/3124990163 >> v2:172.21.15.114:3300/0 conn(0x7f08c0155dd0 0x7f08c00c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c01527a0 con 0x7f08c00c5600 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f08b0001670 con 0x7f08c00c5600 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 >> v1:172.21.15.45:6789/0 conn(0x7f08c00c5600 legacy=0x7f08c01556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08a8003970 0x7f08a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0152b80 con 0x7f08a8004d00 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01524c0 con 0x7f08a8003970 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800bb30 con 0x7f08c00c50b0 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.131+0000 7f08c49d3640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08bf7fe640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08bffff640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08a8003970 0x7f08a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08c49d3640 1 -- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 msgr2=0x7f08a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08c49d3640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c00c50b0 0x7f08a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08c49d3640 1 -- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08a8003970 msgr2=0x7f08a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08c49d3640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08a8003970 0x7f08a8003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.132+0000 7f08c49d3640 1 -- 172.21.15.45:0/3124990163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8003520 con 0x7f08a8004d00 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.133+0000 7f08c49d3640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08a8005180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007360 tx=0x7f08a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798b2c00d9c10035 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.133+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b802ccf0 con 0x7f08a8004d00 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.133+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b802ce50 con 0x7f08a8004d00 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.133+0000 7f08beffd640 1 -- 172.21.15.45:0/3124990163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8034660 con 0x7f08a8004d00 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 -- 172.21.15.45:0/3124990163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 msgr2=0x7f08a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 --2- 172.21.15.45:0/3124990163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08a8005180 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007360 tx=0x7f08a80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c49d3640 1 -- 172.21.15.45:0/3124990163 reap_dead start 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 -- 172.21.15.45:0/3124990163 shutdown_connections 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 -- 172.21.15.45:0/3124990163 >> 172.21.15.45:0/3124990163 conn(0x7f08c00a7600 msgr2=0x7f08c00a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 -- 172.21.15.45:0/3124990163 shutdown_connections 2023-12-08T08:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.134+0000 7f08c51d4640 1 -- 172.21.15.45:0/3124990163 wait complete. 2023-12-08T08:18:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.137+0000 7f08c51d4640 1 Processor -- start 2023-12-08T08:18:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.137+0000 7f08c51d4640 1 -- start start 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08c01463b0 0x7f08c0142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c01534c0 0x7f08c0143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c014d1b0 con 0x7f08a8004d00 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00a8830 con 0x7f08c01463b0 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08c51d4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00a8c50 con 0x7f08c01534c0 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.138+0000 7f08bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56568/0 (socket says 172.21.15.45:56568) 2023-12-08T08:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 -- 172.21.15.45:0/2341199197 learned_addr learned my addr 172.21.15.45:0/2341199197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bf7fe640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08c01463b0 0x7f08c0142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 -- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c01534c0 msgr2=0x7f08c0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c01534c0 0x7f08c0143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 -- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08c01463b0 msgr2=0x7f08c0142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08c01463b0 0x7f08c0142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 -- 172.21.15.45:0/2341199197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c01461e0 con 0x7f08a8004d00 2023-12-08T08:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.139+0000 7f08bffff640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f08b000d7a0 tx=0x7f08b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.140+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00074e0 con 0x7f08a8004d00 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.140+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b0007640 con 0x7f08a8004d00 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.140+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00049e0 con 0x7f08a8004d00 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.140+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c0145f00 con 0x7f08a8004d00 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.140+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0150dc0 con 0x7f08a8004d00 2023-12-08T08:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.141+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c00743e0 con 0x7f08a8004d00 2023-12-08T08:18:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.142+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08b0004b40 con 0x7f08a8004d00 2023-12-08T08:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.143+0000 7f08bcff9640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.144+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7001+0+0 (secure 0 0 0) 0x7f08b00892f0 con 0x7f08a8004d00 2023-12-08T08:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.144+0000 7f08bf7fe640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.144+0000 7f08bf7fe640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 0x7f08ac06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f08c01559c0 tx=0x7f08b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.148+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08b0053e80 con 0x7f08a8004d00 2023-12-08T08:18:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.373+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08c00a8590 con 0x7f08a8004d00 2023-12-08T08:18:30.377 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:18:30.374+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:18:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.378+0000 7f08bcff9640 1 -- 172.21.15.45:0/2341199197 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08b00574a0 con 0x7f08a8004d00 2023-12-08T08:18:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:18:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.381+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 msgr2=0x7f08ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.381+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 0x7f08ac06d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f08c01559c0 tx=0x7f08b4008040 comp rx=0 tx=0).stop 2023-12-08T08:18:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.381+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 msgr2=0x7f08c014ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.381+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f08b000d7a0 tx=0x7f08b000dc60 comp rx=0 tx=0).stop 2023-12-08T08:18:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 shutdown_connections 2023-12-08T08:18:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f08ac06ae70 0x7f08ac06d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f08c01534c0 0x7f08c0143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08c01463b0 0x7f08c0142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 --2- 172.21.15.45:0/2341199197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8004d00 0x7f08c014ed70 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 >> 172.21.15.45:0/2341199197 conn(0x7f08c00a7600 msgr2=0x7f08c01504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.382+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 shutdown_connections 2023-12-08T08:18:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.383+0000 7f08c51d4640 1 -- 172.21.15.45:0/2341199197 wait complete. 2023-12-08T08:18:30.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:18:30.408 INFO:tasks.ceph.mds.c.smithi045.stderr: -3406> 2023-12-08T08:17:44.640+0000 7f4c0b8d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:18:30.476 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:18:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.591+0000 7f0e3f59e640 1 Processor -- start 2023-12-08T08:18:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.591+0000 7f0e3f59e640 1 -- start start 2023-12-08T08:18:30.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e4014c280 0x7f0e400a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e400c4970 0x7f0e4006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3f59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e400c60c0 con 0x7f0e4006d3e0 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3f59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4006d7f0 con 0x7f0e400c4970 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3f59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40152dc0 con 0x7f0e4014c280 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e400c4970 0x7f0e4006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e400c4970 0x7f0e4006cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56584/0 (socket says 172.21.15.45:56584) 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e37fff640 1 -- 172.21.15.45:0/2927934682 learned_addr learned my addr 172.21.15.45:0/2927934682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:30.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3ed9d640 1 --1- 172.21.15.45:0/2927934682 >> v1:172.21.15.45:6789/0 conn(0x7f0e4006d3e0 0x7f0e40155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50144/0 (socket says 172.21.15.45:50144) 2023-12-08T08:18:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.593+0000 7f0e3e59c640 1 --2- 172.21.15.45:0/2927934682 >> v2:172.21.15.114:3300/0 conn(0x7f0e4014c280 0x7f0e400a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.594+0000 7f0e37fff640 1 -- 172.21.15.45:0/2927934682 >> v2:172.21.15.114:3300/0 conn(0x7f0e4014c280 msgr2=0x7f0e400a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.594+0000 7f0e37fff640 1 --2- 172.21.15.45:0/2927934682 >> v2:172.21.15.114:3300/0 conn(0x7f0e4014c280 0x7f0e400a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.594+0000 7f0e37fff640 1 -- 172.21.15.45:0/2927934682 >> v1:172.21.15.45:6789/0 conn(0x7f0e4006d3e0 legacy=0x7f0e40155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.594+0000 7f0e37fff640 1 -- 172.21.15.45:0/2927934682 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e401521d0 con 0x7f0e400c4970 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.595+0000 7f0e37fff640 1 --2- 172.21.15.45:0/2927934682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e4006cea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0e400aaba0 tx=0x7f0e2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70d5ddea0e9bcf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.595+0000 7f0e3dd9b640 1 -- 172.21.15.45:0/2927934682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28031870 con 0x7f0e400c4970 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.595+0000 7f0e3dd9b640 1 -- 172.21.15.45:0/2927934682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280319d0 con 0x7f0e400c4970 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.595+0000 7f0e3dd9b640 1 -- 172.21.15.45:0/2927934682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28031d60 con 0x7f0e400c4970 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2927934682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 msgr2=0x7f0e4006cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2927934682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e4006cea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0e400aaba0 tx=0x7f0e2802b910 comp rx=0 tx=0).stop 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2927934682 shutdown_connections 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2927934682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e4006cea0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2927934682 >> v2:172.21.15.114:3300/0 conn(0x7f0e4014c280 0x7f0e400a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2927934682 >> 172.21.15.45:0/2927934682 conn(0x7f0e40066ce0 msgr2=0x7f0e400a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2927934682 shutdown_connections 2023-12-08T08:18:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.596+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2927934682 wait complete. 2023-12-08T08:18:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.598+0000 7f0e3f59e640 1 Processor -- start 2023-12-08T08:18:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.599+0000 7f0e3f59e640 1 -- start start 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0e4006d3e0 0x7f0e401ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 0x7f0e400a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400a5be0 con 0x7f0e400c4970 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400a5620 con 0x7f0e4014c280 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e3f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400a5900 con 0x7f0e4006d3e0 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56590/0 (socket says 172.21.15.45:56590) 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.600+0000 7f0e37fff640 1 -- 172.21.15.45:0/2630646474 learned_addr learned my addr 172.21.15.45:0/2630646474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e3e59c640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0e4006d3e0 0x7f0e401ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e3ed9d640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 0x7f0e400a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 -- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0e4006d3e0 msgr2=0x7f0e401ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0e4006d3e0 0x7f0e401ea0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 -- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 msgr2=0x7f0e400a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 0x7f0e400a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 -- 172.21.15.45:0/2630646474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280094d0 con 0x7f0e400c4970 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e3ed9d640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 0x7f0e400a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e37fff640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0e2802b950 tx=0x7f0e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2803ad30 con 0x7f0e400c4970 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280443f0 con 0x7f0e400c4970 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280447a0 con 0x7f0e400c4970 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.601+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e400a7950 con 0x7f0e400c4970 2023-12-08T08:18:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.602+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e400a8a20 con 0x7f0e400c4970 2023-12-08T08:18:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.602+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e401ed660 con 0x7f0e400c4970 2023-12-08T08:18:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.604+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e2804d450 con 0x7f0e400c4970 2023-12-08T08:18:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.604+0000 7f0e36ffd640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 0x7f0e2006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.605+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7087+0+0 (secure 0 0 0) 0x7f0e2802d040 con 0x7f0e400c4970 2023-12-08T08:18:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.605+0000 7f0e3e59c640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 0x7f0e2006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.605+0000 7f0e3e59c640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 0x7f0e2006d380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006fd0 tx=0x7f0e30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.609+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e401ed660 con 0x7f0e400c4970 2023-12-08T08:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:30.843+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e401eda40 con 0x7f0e400c4970 2023-12-08T08:18:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.382+0000 7f0e36ffd640 1 -- 172.21.15.45:0/2630646474 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e401eda40 con 0x7f0e400c4970 2023-12-08T08:18:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 msgr2=0x7f0e2006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 0x7f0e2006d380 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0e30006fd0 tx=0x7f0e30008040 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 msgr2=0x7f0e400a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0e2802b950 tx=0x7f0e280046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 shutdown_connections 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0e2006aec0 0x7f0e2006d380 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e4014c280 0x7f0e400a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e400c4970 0x7f0e400a68c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 --2- 172.21.15.45:0/2630646474 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0e4006d3e0 0x7f0e401ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.385+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 >> 172.21.15.45:0/2630646474 conn(0x7f0e40066ce0 msgr2=0x7f0e401557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.386+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 shutdown_connections 2023-12-08T08:18:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.386+0000 7f0e3f59e640 1 -- 172.21.15.45:0/2630646474 wait complete. 2023-12-08T08:18:31.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:18:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.689+0000 7fa0f0f0f640 1 Processor -- start 2023-12-08T08:18:31.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.689+0000 7fa0f0f0f640 1 -- start start 2023-12-08T08:18:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0ec155fe0 0x7fa0ec0c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0ec15be10 0x7fa0ec15c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec06cf50 con 0x7fa0ec15be10 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec0c0be0 con 0x7fa0ec155fe0 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0f0f0f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec06c6b0 con 0x7fa0ec0c0690 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0ead9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0ec15be10 0x7fa0ec15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0ead9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0ec15be10 0x7fa0ec15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56594/0 (socket says 172.21.15.45:56594) 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0ead9d640 1 -- 172.21.15.45:0/1769992117 learned_addr learned my addr 172.21.15.45:0/1769992117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.691+0000 7fa0ea59c640 1 --2- 172.21.15.45:0/1769992117 >> v2:172.21.15.114:3300/0 conn(0x7fa0ec155fe0 0x7fa0ec0c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0e9d9b640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0ead9d640 1 -- 172.21.15.45:0/1769992117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 msgr2=0x7fa0ec0c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:31.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0ead9d640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0ead9d640 1 -- 172.21.15.45:0/1769992117 >> v2:172.21.15.114:3300/0 conn(0x7fa0ec155fe0 msgr2=0x7fa0ec0c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0ead9d640 1 --2- 172.21.15.45:0/1769992117 >> v2:172.21.15.114:3300/0 conn(0x7fa0ec155fe0 0x7fa0ec0c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.692+0000 7fa0ead9d640 1 -- 172.21.15.45:0/1769992117 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec06c990 con 0x7fa0ec15be10 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.693+0000 7fa0ead9d640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec15be10 0x7fa0ec15c270 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0c2cd0 tx=0x7fa0e402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b603adac7f0890b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.694+0000 7fa0e959a640 1 -- 172.21.15.45:0/1769992117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e402c9e0 con 0x7fa0ec15be10 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.694+0000 7fa0e959a640 1 -- 172.21.15.45:0/1769992117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e402cb40 con 0x7fa0ec15be10 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.694+0000 7fa0e959a640 1 -- 172.21.15.45:0/1769992117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40343f0 con 0x7fa0ec15be10 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/1769992117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec15be10 msgr2=0x7fa0ec15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec15be10 0x7fa0ec15c270 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0c2cd0 tx=0x7fa0e402be40 comp rx=0 tx=0).stop 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/1769992117 shutdown_connections 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec15be10 0x7fa0ec15c270 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/1769992117 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/1769992117 >> v2:172.21.15.114:3300/0 conn(0x7fa0ec155fe0 0x7fa0ec0c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/1769992117 >> 172.21.15.45:0/1769992117 conn(0x7fa0ec0a7ca0 msgr2=0x7fa0ec0c23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/1769992117 shutdown_connections 2023-12-08T08:18:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.695+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/1769992117 wait complete. 2023-12-08T08:18:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.697+0000 7fa0f0f0f640 1 Processor -- start 2023-12-08T08:18:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.698+0000 7fa0f0f0f640 1 -- start start 2023-12-08T08:18:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec15be10 0x7fa0ec151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0aba60 con 0x7fa0ec155fe0 2023-12-08T08:18:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec1ee600 con 0x7fa0ec15be10 2023-12-08T08:18:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0f0f0f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0ab4e0 con 0x7fa0ec0c0690 2023-12-08T08:18:31.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56602/0 (socket says 172.21.15.45:56602) 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0e9d9b640 1 -- 172.21.15.45:0/3339267042 learned_addr learned my addr 172.21.15.45:0/3339267042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.699+0000 7fa0ea59c640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0ead9d640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec15be10 0x7fa0ec151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 -- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 msgr2=0x7fa0ec0bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 -- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec15be10 msgr2=0x7fa0ec151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec15be10 0x7fa0ec151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 -- 172.21.15.45:0/3339267042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009b30 con 0x7fa0ec155fe0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.700+0000 7fa0e9d9b640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000e840 tx=0x7fa0e000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.701+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000c730 con 0x7fa0ec155fe0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.701+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000c890 con 0x7fa0ec155fe0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.701+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec0ab780 con 0x7fa0ec155fe0 2023-12-08T08:18:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.701+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000cc40 con 0x7fa0ec155fe0 2023-12-08T08:18:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.701+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec1e2270 con 0x7fa0ec155fe0 2023-12-08T08:18:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.702+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec074730 con 0x7fa0ec155fe0 2023-12-08T08:18:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.703+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa0e0013470 con 0x7fa0ec155fe0 2023-12-08T08:18:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.704+0000 7fa0daffd640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 0x7fa0cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.704+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7087+0+0 (secure 0 0 0) 0x7fa0e0089a80 con 0x7fa0ec155fe0 2023-12-08T08:18:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.704+0000 7fa0ea59c640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 0x7fa0cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.705+0000 7fa0ea59c640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 0x7fa0cc06d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec073630 tx=0x7fa0dc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.709+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa0e00546f0 con 0x7fa0ec155fe0 2023-12-08T08:18:31.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:31.906+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0ec0c0470 con 0x7fa0ec155fe0 2023-12-08T08:18:32.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.788+0000 7fa0daffd640 1 -- 172.21.15.45:0/3339267042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa0e0057d10 con 0x7fa0ec155fe0 2023-12-08T08:18:32.791 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:18:32.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 msgr2=0x7fa0cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 0x7fa0cc06d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec073630 tx=0x7fa0dc009190 comp rx=0 tx=0).stop 2023-12-08T08:18:32.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 msgr2=0x7fa0ec158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000e840 tx=0x7fa0e000ed00 comp rx=0 tx=0).stop 2023-12-08T08:18:32.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 shutdown_connections 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa0cc06ae40 0x7fa0cc06d300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec15be10 0x7fa0ec151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0ec155fe0 0x7fa0ec158a30 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 --2- 172.21.15.45:0/3339267042 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa0ec0c0690 0x7fa0ec0bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 >> 172.21.15.45:0/3339267042 conn(0x7fa0ec0a7ca0 msgr2=0x7fa0ec0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.792+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 shutdown_connections 2023-12-08T08:18:32.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:32.793+0000 7fa0f0f0f640 1 -- 172.21.15.45:0/3339267042 wait complete. 2023-12-08T08:18:32.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:18:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.036+0000 7f39da961640 1 Processor -- start 2023-12-08T08:18:33.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.037+0000 7f39da961640 1 -- start start 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.038+0000 7f39da961640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39d406a4c0 0x7f39d406a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.038+0000 7f39da961640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4155580 con 0x7f39d40c6580 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.038+0000 7f39da961640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4154970 con 0x7f39d4151ff0 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.038+0000 7f39da961640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d4154c50 con 0x7f39d406a4c0 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.038+0000 7f39cbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39d40c6580 0x7f39d41518e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50158/0 (socket says 172.21.15.45:50158) 2023-12-08T08:18:33.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39cbfff640 1 -- 172.21.15.45:0/225591280 learned_addr learned my addr 172.21.15.45:0/225591280 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:33.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d3fff640 1 --2- 172.21.15.45:0/225591280 >> v2:172.21.15.114:3300/0 conn(0x7f39d406a4c0 0x7f39d406a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141213524 0 0) 0x7f39d4155580 con 0x7f39d40c6580 2023-12-08T08:18:33.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c0003520 con 0x7f39d40c6580 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082411802 0 0) 0x7f39c0003520 con 0x7f39d40c6580 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 >> v2:172.21.15.114:3300/0 conn(0x7f39d406a4c0 msgr2=0x7f39d406a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 --2- 172.21.15.45:0/225591280 >> v2:172.21.15.114:3300/0 conn(0x7f39d406a4c0 0x7f39d406a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 >> v1:172.21.15.114:6789/0 conn(0x7f39d4151ff0 legacy=0x7f39d40c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d4154f30 con 0x7f39d40c6580 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.039+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f39bc001670 con 0x7f39d40c6580 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 >> v1:172.21.15.45:6789/0 conn(0x7f39d40c6580 legacy=0x7f39d41518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c00047c0 0x7f39c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39c0005380 0x7f39c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4154c50 con 0x7f39c00039c0 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c000c260 con 0x7f39c00047c0 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c000c420 con 0x7f39c0005380 2023-12-08T08:18:33.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39cbfff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c00047c0 0x7f39c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 -- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39c0005380 msgr2=0x7f39c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39c0005380 0x7f39c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 -- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c00047c0 msgr2=0x7f39c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c00047c0 0x7f39c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39d3fff640 1 -- 172.21.15.45:0/225591280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0003520 con 0x7f39c00039c0 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.040+0000 7f39cbfff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39c00047c0 0x7f39c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:33.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.041+0000 7f39d8efe640 1 -- 172.21.15.45:0/225591280 reap_dead start 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39d3fff640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39c0003de0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f39c400ba30 tx=0x7f39c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b6562800ccbc07 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4032630 con 0x7f39c00039c0 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4032790 con 0x7f39c00039c0 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39d37fe640 1 -- 172.21.15.45:0/225591280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4032b20 con 0x7f39c00039c0 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39da961640 1 -- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 msgr2=0x7f39c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.042+0000 7f39da961640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39c0003de0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f39c400ba30 tx=0x7f39c00057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.043+0000 7f39da961640 1 -- 172.21.15.45:0/225591280 shutdown_connections 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.043+0000 7f39da961640 1 --2- 172.21.15.45:0/225591280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39c0003de0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.043+0000 7f39da961640 1 -- 172.21.15.45:0/225591280 >> 172.21.15.45:0/225591280 conn(0x7f39d40a8960 msgr2=0x7f39d40a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.043+0000 7f39da961640 1 -- 172.21.15.45:0/225591280 shutdown_connections 2023-12-08T08:18:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.043+0000 7f39da961640 1 -- 172.21.15.45:0/225591280 wait complete. 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.044+0000 7f39da961640 1 Processor -- start 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.045+0000 7f39da961640 1 -- start start 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.045+0000 7f39da961640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.045+0000 7f39da961640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39d40a5db0 0x7f39d41ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39da961640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39d41dfb20 0x7f39d41edd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39da961640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4150e80 con 0x7f39c00039c0 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39da961640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d41e1320 con 0x7f39d41dfb20 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39da961640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d41ded50 con 0x7f39d40a5db0 2023-12-08T08:18:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56626/0 (socket says 172.21.15.45:56626) 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 -- 172.21.15.45:0/2690231660 learned_addr learned my addr 172.21.15.45:0/2690231660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 -- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39d40a5db0 msgr2=0x7f39d41ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39cbfff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39d40a5db0 0x7f39d41ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39d40a5db0 0x7f39d41ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 -- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39d41dfb20 msgr2=0x7f39d41edd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39d41dfb20 0x7f39d41edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.046+0000 7f39d3fff640 1 -- 172.21.15.45:0/2690231660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d41dea20 con 0x7f39c00039c0 2023-12-08T08:18:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39d3fff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f39c402beb0 tx=0x7f39c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c403ba70 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c403bbd0 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4030400 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d41e1550 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.047+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4072520 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.048+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d40c0030 con 0x7f39c00039c0 2023-12-08T08:18:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.049+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39c4030560 con 0x7f39c00039c0 2023-12-08T08:18:33.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.050+0000 7f39d17fa640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 0x7f39b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:33.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.050+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6620+0+0 (secure 0 0 0) 0x7f39c40ac070 con 0x7f39c00039c0 2023-12-08T08:18:33.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.050+0000 7f39cbfff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 0x7f39b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:33.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.051+0000 7f39cbfff640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 0x7f39b406d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39bc001eb0 tx=0x7f39bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:33.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.055+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39c40dee90 con 0x7f39c00039c0 2023-12-08T08:18:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.255+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f39d4074600 con 0x7f39c00039c0 2023-12-08T08:18:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.799+0000 7f39d17fa640 1 -- 172.21.15.45:0/2690231660 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7f39c4036020 con 0x7f39c00039c0 2023-12-08T08:18:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-08T08:18:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 msgr2=0x7f39b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 0x7f39b406d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39bc001eb0 tx=0x7f39bc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 msgr2=0x7f39d4071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f39c402beb0 tx=0x7f39c4004730 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 shutdown_connections 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39b406ae40 0x7f39b406d300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39d40a5db0 0x7f39d41ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39d41dfb20 0x7f39d41edd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 --2- 172.21.15.45:0/2690231660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c00039c0 0x7f39d4071fe0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 >> 172.21.15.45:0/2690231660 conn(0x7f39d40a8960 msgr2=0x7f39d40c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.803+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 shutdown_connections 2023-12-08T08:18:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:33.804+0000 7f39da961640 1 -- 172.21.15.45:0/2690231660 wait complete. 2023-12-08T08:18:33.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.039+0000 7f80333c5640 1 Processor -- start 2023-12-08T08:18:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.040+0000 7f80333c5640 1 -- start start 2023-12-08T08:18:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.041+0000 7f80333c5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f802c14c4a0 0x7f802c156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.041+0000 7f80333c5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.041+0000 7f80333c5640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c14c880 con 0x7f802c0a4d10 2023-12-08T08:18:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.041+0000 7f80333c5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c0c4730 con 0x7f802c14c4a0 2023-12-08T08:18:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.041+0000 7f80333c5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c56e0 con 0x7f802c153880 2023-12-08T08:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.042+0000 7f8031962640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.042+0000 7f8031962640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:57542/0 (socket says 172.21.15.45:57542) 2023-12-08T08:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.042+0000 7f8031962640 1 -- 172.21.15.45:0/754425077 learned_addr learned my addr 172.21.15.45:0/754425077 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.042+0000 7f8031161640 1 --2- 172.21.15.45:0/754425077 >> v2:172.21.15.114:3300/0 conn(0x7f802c14c4a0 0x7f802c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.043+0000 7f8031962640 1 -- 172.21.15.45:0/754425077 >> v2:172.21.15.114:3300/0 conn(0x7f802c14c4a0 msgr2=0x7f802c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.043+0000 7f8031962640 1 --2- 172.21.15.45:0/754425077 >> v2:172.21.15.114:3300/0 conn(0x7f802c14c4a0 0x7f802c156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.043+0000 7f8031962640 1 -- 172.21.15.45:0/754425077 >> v1:172.21.15.114:6789/0 conn(0x7f802c0a4d10 legacy=0x7f802c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.043+0000 7f8031962640 1 -- 172.21.15.45:0/754425077 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0c63b0 con 0x7f802c153880 2023-12-08T08:18:34.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.044+0000 7f8031962640 1 --2- 172.21.15.45:0/754425077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8024009e50 tx=0x7f802402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1245d5dc049fb9fd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.045+0000 7f8023fff640 1 -- 172.21.15.45:0/754425077 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802402ca70 con 0x7f802c153880 2023-12-08T08:18:34.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.045+0000 7f8023fff640 1 -- 172.21.15.45:0/754425077 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802402cbd0 con 0x7f802c153880 2023-12-08T08:18:34.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.045+0000 7f8023fff640 1 -- 172.21.15.45:0/754425077 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240343f0 con 0x7f802c153880 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 -- 172.21.15.45:0/754425077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 msgr2=0x7f802c153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 --2- 172.21.15.45:0/754425077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8024009e50 tx=0x7f802402bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 -- 172.21.15.45:0/754425077 shutdown_connections 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 --2- 172.21.15.45:0/754425077 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c153880 0x7f802c153cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 --2- 172.21.15.45:0/754425077 >> v2:172.21.15.114:3300/0 conn(0x7f802c14c4a0 0x7f802c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 -- 172.21.15.45:0/754425077 >> 172.21.15.45:0/754425077 conn(0x7f802c0661f0 msgr2=0x7f802c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 -- 172.21.15.45:0/754425077 shutdown_connections 2023-12-08T08:18:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.046+0000 7f80333c5640 1 -- 172.21.15.45:0/754425077 wait complete. 2023-12-08T08:18:34.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.048+0000 7f80333c5640 1 Processor -- start 2023-12-08T08:18:34.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.049+0000 7f80333c5640 1 -- start start 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c0a4d10 0x7f802c0a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 0x7f802c0bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c140280 con 0x7f802c153880 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1ed750 con 0x7f802c14c4a0 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f80333c5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1eda30 con 0x7f802c0a4d10 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f8031962640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f8031962640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56642/0 (socket says 172.21.15.45:56642) 2023-12-08T08:18:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f8031962640 1 -- 172.21.15.45:0/143750862 learned_addr learned my addr 172.21.15.45:0/143750862 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f8030960640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 0x7f802c0bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.050+0000 7f8031161640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c0a4d10 0x7f802c0a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 -- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c0a4d10 msgr2=0x7f802c0a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c0a4d10 0x7f802c0a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 -- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 msgr2=0x7f802c0bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 0x7f802c0bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 -- 172.21.15.45:0/143750862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009b30 con 0x7f802c153880 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8030960640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 0x7f802c0bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.051+0000 7f8031962640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8024009e50 tx=0x7f8024004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.052+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024009510 con 0x7f802c153880 2023-12-08T08:18:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.052+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802403e450 con 0x7f802c153880 2023-12-08T08:18:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.052+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802403e800 con 0x7f802c153880 2023-12-08T08:18:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.052+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c1edd10 con 0x7f802c153880 2023-12-08T08:18:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.052+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c0bf580 con 0x7f802c153880 2023-12-08T08:18:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.053+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c1403c0 con 0x7f802c153880 2023-12-08T08:18:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.054+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f802403e960 con 0x7f802c153880 2023-12-08T08:18:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.055+0000 7f8021ffb640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 0x7f801006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.056+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f80240ac440 con 0x7f802c153880 2023-12-08T08:18:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.056+0000 7f8031161640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 0x7f801006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.057+0000 7f8031161640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 0x7f801006d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8028009a30 tx=0x7f8028008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.060+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80240773e0 con 0x7f802c153880 2023-12-08T08:18:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.272+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f802c074600 con 0x7f802c153880 2023-12-08T08:18:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.273+0000 7f8021ffb640 1 -- 172.21.15.45:0/143750862 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16882 (secure 0 0 0) 0x7f802407aa00 con 0x7f802c153880 2023-12-08T08:18:34.276 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:34.277 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":68,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:33.789880+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/63008111":"2023-12-09T08:18:30.374972+0000","172.21.15.45:6836/63008111":"2023-12-09T08:18:30.374972+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:34.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 msgr2=0x7f801006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 0x7f801006d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8028009a30 tx=0x7f8028008040 comp rx=0 tx=0).stop 2023-12-08T08:18:34.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 msgr2=0x7f802c1406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8024009e50 tx=0x7f8024004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 shutdown_connections 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f801006ae40 0x7f801006d300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802c153880 0x7f802c1406a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f802c14c4a0 0x7f802c0bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 --2- 172.21.15.45:0/143750862 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f802c0a4d10 0x7f802c0a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 >> 172.21.15.45:0/143750862 conn(0x7f802c0661f0 msgr2=0x7f802c0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 shutdown_connections 2023-12-08T08:18:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.276+0000 7f80333c5640 1 -- 172.21.15.45:0/143750862 wait complete. 2023-12-08T08:18:34.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:17:55.154580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:17:56.265883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:34.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.513+0000 7f257ec2e640 1 Processor -- start 2023-12-08T08:18:34.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.514+0000 7f257ec2e640 1 -- start start 2023-12-08T08:18:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257ec2e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25780ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257ec2e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578151eb0 con 0x7f2578157a20 2023-12-08T08:18:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257ec2e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25780c80d0 con 0x7f25780ca610 2023-12-08T08:18:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257ec2e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c56a0 con 0x7f2578151ad0 2023-12-08T08:18:34.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257d42b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2578157a20 0x7f2578154930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50172/0 (socket says 172.21.15.45:50172) 2023-12-08T08:18:34.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.515+0000 7f257d42b640 1 -- 172.21.15.45:0/2958164515 learned_addr learned my addr 172.21.15.45:0/2958164515 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:34.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25780ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566998938 0 0) 0x7f2578151eb0 con 0x7f2578157a20 2023-12-08T08:18:34.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2564003520 con 0x7f2578157a20 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2117173622 0 0) 0x7f2564003520 con 0x7f2578157a20 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 msgr2=0x7f25780ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25780ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 >> v1:172.21.15.114:6789/0 conn(0x7f25780ca610 legacy=0x7f257815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578154430 con 0x7f2578157a20 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f2568001670 con 0x7f2578157a20 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 >> v1:172.21.15.45:6789/0 conn(0x7f2578157a20 legacy=0x7f2578154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.516+0000 7f257cc2a640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f2564003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257cc2a640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257cc2a640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2564004d00 0x7f2564005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256400ba30 con 0x7f25640039a0 2023-12-08T08:18:34.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256400bb70 con 0x7f2564004d00 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256400bd30 con 0x7f2578151ad0 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f2564003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257d42b640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 -- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 msgr2=0x7f25640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257e42d640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2564004d00 0x7f2564005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 -- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2564004d00 msgr2=0x7f2564005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2564004d00 0x7f2564005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257dc2c640 1 -- 172.21.15.45:0/2958164515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564003520 con 0x7f25640039a0 2023-12-08T08:18:34.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.517+0000 7f257d42b640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2578151ad0 0x7f25640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.518+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f2564003dc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2574009a90 tx=0x7f25640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52628bc6be0497a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257402c680 con 0x7f25640039a0 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257402c7e0 con 0x7f25640039a0 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257cc2a640 1 -- 172.21.15.45:0/2958164515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257402cb70 con 0x7f25640039a0 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257ec2e640 1 -- 172.21.15.45:0/2958164515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 msgr2=0x7f2564003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2958164515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f2564003dc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2574009a90 tx=0x7f25640057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257e42d640 1 -- 172.21.15.45:0/2958164515 reap_dead start 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257ec2e640 1 -- 172.21.15.45:0/2958164515 shutdown_connections 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.519+0000 7f257ec2e640 1 -- 172.21.15.45:0/2958164515 >> 172.21.15.45:0/2958164515 conn(0x7f2578066610 msgr2=0x7f2578066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.520+0000 7f257ec2e640 1 -- 172.21.15.45:0/2958164515 shutdown_connections 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.520+0000 7f257ec2e640 1 -- 172.21.15.45:0/2958164515 wait complete. 2023-12-08T08:18:34.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.521+0000 7f257ec2e640 1 Processor -- start 2023-12-08T08:18:34.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.521+0000 7f257ec2e640 1 -- start start 2023-12-08T08:18:34.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780aa090 0x7f25780abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f257814bd70 0x7f257814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578156560 con 0x7f25640039a0 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257814c730 con 0x7f25780aa090 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.522+0000 7f257ec2e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578155950 con 0x7f257814bd70 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56670/0 (socket says 172.21.15.45:56670) 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 -- 172.21.15.45:0/2519539384 learned_addr learned my addr 172.21.15.45:0/2519539384 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 -- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f257814bd70 msgr2=0x7f257814c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257e42d640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f257814bd70 0x7f257814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257d42b640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780aa090 0x7f25780abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f257814bd70 0x7f257814c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 -- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780aa090 msgr2=0x7f25780abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780aa090 0x7f25780abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 -- 172.21.15.45:0/2519539384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578155c30 con 0x7f25640039a0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.523+0000 7f257dc2c640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f257402c220 tx=0x7f2574004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.524+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574003810 con 0x7f25640039a0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.524+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574003970 con 0x7f25640039a0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.524+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574003ce0 con 0x7f25640039a0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.524+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578155f10 con 0x7f25640039a0 2023-12-08T08:18:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.524+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25780ac0a0 con 0x7f25640039a0 2023-12-08T08:18:34.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.525+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25780673e0 con 0x7f25640039a0 2023-12-08T08:18:34.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.526+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2574034440 con 0x7f25640039a0 2023-12-08T08:18:34.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.527+0000 7f256e7fc640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 0x7f255c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.527+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f25740ab670 con 0x7f25640039a0 2023-12-08T08:18:34.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.527+0000 7f257d42b640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 0x7f255c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.528+0000 7f257d42b640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 0x7f255c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2568000c00 tx=0x7f2568009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.531+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2574076590 con 0x7f25640039a0 2023-12-08T08:18:34.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.724+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25780743e0 con 0x7f25640039a0 2023-12-08T08:18:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.725+0000 7f256e7fc640 1 -- 172.21.15.45:0/2519539384 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25740044e0 con 0x7f25640039a0 2023-12-08T08:18:34.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:34.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 msgr2=0x7f255c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 0x7f255c06d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2568000c00 tx=0x7f2568009040 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 msgr2=0x7f25781574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f257402c220 tx=0x7f2574004730 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 shutdown_connections 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f255c06ae70 0x7f255c06d330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f257814bd70 0x7f257814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780aa090 0x7f25780abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 --2- 172.21.15.45:0/2519539384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25640039a0 0x7f25781574c0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.727+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 >> 172.21.15.45:0/2519539384 conn(0x7f2578066610 msgr2=0x7f25780c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.728+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 shutdown_connections 2023-12-08T08:18:34.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.728+0000 7f257ec2e640 1 -- 172.21.15.45:0/2519539384 wait complete. 2023-12-08T08:18:34.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:18:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.978+0000 7f0e015e2640 1 Processor -- start 2023-12-08T08:18:34.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.978+0000 7f0e015e2640 1 -- start start 2023-12-08T08:18:34.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.979+0000 7f0e015e2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0dfc14e2f0 0x7f0dfc0a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.979+0000 7f0e015e2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc154cf0 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.979+0000 7f0e015e2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0a6300 con 0x7f0dfc157940 2023-12-08T08:18:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.979+0000 7f0e015e2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc1546a0 con 0x7f0dfc14e2f0 2023-12-08T08:18:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.980+0000 7f0dfb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0dfc0c47d0 0x7f0dfc0c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50180/0 (socket says 172.21.15.45:50180) 2023-12-08T08:18:34.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.980+0000 7f0dfb7fe640 1 -- 172.21.15.45:0/2628765784 learned_addr learned my addr 172.21.15.45:0/2628765784 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfbfff640 1 --2- 172.21.15.45:0/2628765784 >> v2:172.21.15.114:3300/0 conn(0x7f0dfc14e2f0 0x7f0dfc0a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080021721 0 0) 0x7f0dfc154cf0 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de8003520 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545029665 0 0) 0x7f0de8003520 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 >> v2:172.21.15.114:3300/0 conn(0x7f0dfc14e2f0 msgr2=0x7f0dfc0a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 --2- 172.21.15.45:0/2628765784 >> v2:172.21.15.114:3300/0 conn(0x7f0dfc14e2f0 0x7f0dfc0a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 >> v1:172.21.15.114:6789/0 conn(0x7f0dfc157940 legacy=0x7f0dfc157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc154980 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f0de4001670 con 0x7f0dfc0c47d0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 >> v1:172.21.15.45:6789/0 conn(0x7f0dfc0c47d0 legacy=0x7f0dfc0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 0x7f0de800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1546a0 con 0x7f0de80052a0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de800c170 con 0x7f0de8003970 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de800c330 con 0x7f0de80047c0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.981+0000 7f0dfbfff640 1 --2- 172.21.15.45:0/2628765784 >> v2:172.21.15.114:3300/0 conn(0x7f0dfc14e2f0 0x7f0dfc0a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 0x7f0de800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0dfbfff640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0dfb7fe640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 -- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de80047c0 msgr2=0x7f0de8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 -- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de8003970 msgr2=0x7f0de8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.982+0000 7f0e00de1640 1 -- 172.21.15.45:0/2628765784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8003520 con 0x7f0de80052a0 2023-12-08T08:18:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.983+0000 7f0e00de1640 1 -- 172.21.15.45:0/2628765784 reap_dead start 2023-12-08T08:18:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.983+0000 7f0e00de1640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 0x7f0de800b980 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0df4001720 tx=0x7f0de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a75ccb5cddaea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40052d0 con 0x7f0de80052a0 2023-12-08T08:18:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df402e050 con 0x7f0de80052a0 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0dfaffd640 1 -- 172.21.15.45:0/2628765784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40035f0 con 0x7f0de80052a0 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 -- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 msgr2=0x7f0de800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 0x7f0de800b980 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0df4001720 tx=0x7f0de80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 -- 172.21.15.45:0/2628765784 shutdown_connections 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 --2- 172.21.15.45:0/2628765784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80052a0 0x7f0de800b980 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 -- 172.21.15.45:0/2628765784 >> 172.21.15.45:0/2628765784 conn(0x7f0dfc0c6cc0 msgr2=0x7f0dfc0c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 -- 172.21.15.45:0/2628765784 shutdown_connections 2023-12-08T08:18:34.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.984+0000 7f0e015e2640 1 -- 172.21.15.45:0/2628765784 wait complete. 2023-12-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.986+0000 7f0e015e2640 1 Processor -- start 2023-12-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.986+0000 7f0e015e2640 1 -- start start 2023-12-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de80052a0 0x7f0dfc14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0dfc1515f0 0x7f0dfc14d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc14f530 con 0x7f0dfc155fe0 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc157790 con 0x7f0de80052a0 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0e015e2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc14d7d0 con 0x7f0dfc1515f0 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46276/0 (socket says 172.21.15.45:46276) 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.987+0000 7f0dfb7fe640 1 -- 172.21.15.45:0/3470601182 learned_addr learned my addr 172.21.15.45:0/3470601182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 -- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0dfc1515f0 msgr2=0x7f0dfc14d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0dfc1515f0 0x7f0dfc14d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 -- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de80052a0 msgr2=0x7f0dfc14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de80052a0 0x7f0dfc14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 -- 172.21.15.45:0/3470601182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc1567c0 con 0x7f0dfc155fe0 2023-12-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0dfb7fe640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001eb0 tx=0x7f0de400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40074e0 con 0x7f0dfc155fe0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4007640 con 0x7f0dfc155fe0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40049e0 con 0x7f0dfc155fe0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.988+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc156cf0 con 0x7f0dfc155fe0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.989+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc156f90 con 0x7f0dfc155fe0 2023-12-08T08:18:34.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.990+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc0673e0 con 0x7f0dfc155fe0 2023-12-08T08:18:34.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.991+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0de4004b40 con 0x7f0dfc155fe0 2023-12-08T08:18:34.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.992+0000 7f0df8ff9640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 0x7f0ddc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.992+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f0de4088f70 con 0x7f0dfc155fe0 2023-12-08T08:18:34.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.992+0000 7f0dfbfff640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 0x7f0ddc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.993+0000 7f0dfbfff640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 0x7f0ddc06d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0095c0 tx=0x7f0dec0094b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:34.996+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0de40bbe90 con 0x7f0dfc155fe0 2023-12-08T08:18:35.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.189+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dfc0c0e10 con 0x7f0dfc155fe0 2023-12-08T08:18:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.190+0000 7f0df8ff9640 1 -- 172.21.15.45:0/3470601182 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v68) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0de4019020 con 0x7f0dfc155fe0 2023-12-08T08:18:35.193 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 msgr2=0x7f0ddc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 0x7f0ddc06d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0095c0 tx=0x7f0dec0094b0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 msgr2=0x7f0dfc14cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001eb0 tx=0x7f0de400dc70 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 shutdown_connections 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0ddc06ae70 0x7f0ddc06d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0dfc1515f0 0x7f0dfc14d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dfc155fe0 0x7f0dfc14cd50 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 --2- 172.21.15.45:0/3470601182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0de80052a0 0x7f0dfc14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 >> 172.21.15.45:0/3470601182 conn(0x7f0dfc0c6cc0 msgr2=0x7f0dfc1526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 shutdown_connections 2023-12-08T08:18:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.193+0000 7f0e015e2640 1 -- 172.21.15.45:0/3470601182 wait complete. 2023-12-08T08:18:35.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:18:35.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.432+0000 7f682e9e6640 1 Processor -- start 2023-12-08T08:18:35.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.433+0000 7f682e9e6640 1 -- start start 2023-12-08T08:18:35.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.434+0000 7f682e9e6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68280c4520 0x7f68280c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.434+0000 7f682e9e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68280c8800 0x7f68280c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.434+0000 7f682e9e6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6828155050 con 0x7f682814ae10 2023-12-08T08:18:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.434+0000 7f682e9e6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6828154460 con 0x7f68280c8800 2023-12-08T08:18:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.434+0000 7f682e9e6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6828154720 con 0x7f68280c4520 2023-12-08T08:18:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.435+0000 7f682e1e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68280c8800 0x7f68280c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.435+0000 7f682d9e4640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f682814ae10 0x7f68280c7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:57150/0 (socket says 172.21.15.45:57150) 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.435+0000 7f682d9e4640 1 -- 172.21.15.45:0/3200503556 learned_addr learned my addr 172.21.15.45:0/3200503556 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.435+0000 7f682d1e3640 1 --2- 172.21.15.45:0/3200503556 >> v2:172.21.15.114:3300/0 conn(0x7f68280c4520 0x7f68280c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.436+0000 7f682e1e5640 1 -- 172.21.15.45:0/3200503556 >> v2:172.21.15.114:3300/0 conn(0x7f68280c4520 msgr2=0x7f68280c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.436+0000 7f682e1e5640 1 --2- 172.21.15.45:0/3200503556 >> v2:172.21.15.114:3300/0 conn(0x7f68280c4520 0x7f68280c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.436+0000 7f682e1e5640 1 -- 172.21.15.45:0/3200503556 >> v1:172.21.15.114:6789/0 conn(0x7f682814ae10 legacy=0x7f68280c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.436+0000 7f682e1e5640 1 -- 172.21.15.45:0/3200503556 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828154a00 con 0x7f68280c8800 2023-12-08T08:18:35.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.437+0000 7f682e1e5640 1 --2- 172.21.15.45:0/3200503556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c8800 0x7f68280c8c90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6828071fd0 tx=0x7f682002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825f5b507b4ce80b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.437+0000 7f682c9e2640 1 -- 172.21.15.45:0/3200503556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682002e070 con 0x7f68280c8800 2023-12-08T08:18:35.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.437+0000 7f682c9e2640 1 -- 172.21.15.45:0/3200503556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200315a0 con 0x7f68280c8800 2023-12-08T08:18:35.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.437+0000 7f682c9e2640 1 -- 172.21.15.45:0/3200503556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820031930 con 0x7f68280c8800 2023-12-08T08:18:35.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 -- 172.21.15.45:0/3200503556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c8800 msgr2=0x7f68280c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 --2- 172.21.15.45:0/3200503556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c8800 0x7f68280c8c90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6828071fd0 tx=0x7f682002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:35.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 -- 172.21.15.45:0/3200503556 shutdown_connections 2023-12-08T08:18:35.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 --2- 172.21.15.45:0/3200503556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c8800 0x7f68280c8c90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 --2- 172.21.15.45:0/3200503556 >> v2:172.21.15.114:3300/0 conn(0x7f68280c4520 0x7f68280c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 -- 172.21.15.45:0/3200503556 >> 172.21.15.45:0/3200503556 conn(0x7f68280ab730 msgr2=0x7f68280abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:35.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 -- 172.21.15.45:0/3200503556 shutdown_connections 2023-12-08T08:18:35.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.438+0000 7f682e9e6640 1 -- 172.21.15.45:0/3200503556 wait complete. 2023-12-08T08:18:35.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.440+0000 7f682e9e6640 1 Processor -- start 2023-12-08T08:18:35.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.440+0000 7f682e9e6640 1 -- start start 2023-12-08T08:18:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68280c8800 0x7f68280c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f682814ae10 0x7f68280bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682814e850 con 0x7f68280c4520 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682814e290 con 0x7f68280c8800 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682e9e6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682814e570 con 0x7f682814ae10 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682d9e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682d9e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46286/0 (socket says 172.21.15.45:46286) 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.441+0000 7f682d9e4640 1 -- 172.21.15.45:0/2901064880 learned_addr learned my addr 172.21.15.45:0/2901064880 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d1e3640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68280c8800 0x7f68280c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682e1e5640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f682814ae10 0x7f68280bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 -- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f682814ae10 msgr2=0x7f68280bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f682814ae10 0x7f68280bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 -- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68280c8800 msgr2=0x7f68280c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68280c8800 0x7f68280c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 -- 172.21.15.45:0/2901064880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820009400 con 0x7f68280c4520 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.442+0000 7f682d9e4640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f682400cbc0 tx=0x7f682400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.443+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400aca0 con 0x7f68280c4520 2023-12-08T08:18:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.443+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682400ae00 con 0x7f68280c4520 2023-12-08T08:18:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.443+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824012600 con 0x7f68280c4520 2023-12-08T08:18:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.443+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68281ed030 con 0x7f68280c4520 2023-12-08T08:18:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.443+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68280bfa50 con 0x7f68280c4520 2023-12-08T08:18:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.444+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68281ed220 con 0x7f68280c4520 2023-12-08T08:18:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.445+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6824007070 con 0x7f68280c4520 2023-12-08T08:18:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.446+0000 7f681e7fc640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 0x7f680c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.446+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f6824089640 con 0x7f68280c4520 2023-12-08T08:18:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.446+0000 7f682d1e3640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 0x7f680c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.447+0000 7f682d1e3640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 0x7f680c06d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6828158980 tx=0x7f6818008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.451+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6824054560 con 0x7f68280c4520 2023-12-08T08:18:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.652+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f68280673e0 con 0x7f68280c4520 2023-12-08T08:18:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.653+0000 7f681e7fc640 1 -- 172.21.15.45:0/2901064880 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v68) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6824057b80 con 0x7f68280c4520 2023-12-08T08:18:35.655 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.655+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 msgr2=0x7f680c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.655+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 0x7f680c06d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6828158980 tx=0x7f6818008040 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.655+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 msgr2=0x7f6828158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.655+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f682400cbc0 tx=0x7f682400a060 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 shutdown_connections 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f680c06ae40 0x7f680c06d300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f682814ae10 0x7f68280bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68280c8800 0x7f68280c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 --2- 172.21.15.45:0/2901064880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68280c4520 0x7f6828158440 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 >> 172.21.15.45:0/2901064880 conn(0x7f68280ab730 msgr2=0x7f68280aaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 shutdown_connections 2023-12-08T08:18:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.656+0000 7f682e9e6640 1 -- 172.21.15.45:0/2901064880 wait complete. 2023-12-08T08:18:35.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:35.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.894+0000 7fe999eff640 1 Processor -- start 2023-12-08T08:18:35.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.894+0000 7fe999eff640 1 -- start start 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe999eff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9941521b0 0x7fe99414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe999eff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe99414fb20 0x7fe994155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe999eff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe994155850 con 0x7fe9940a7910 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe999eff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940c0890 con 0x7fe9941521b0 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe999eff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940c0b70 con 0x7fe99414fb20 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe993fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9941521b0 0x7fe99414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe993fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9941521b0 0x7fe99414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46290/0 (socket says 172.21.15.45:46290) 2023-12-08T08:18:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.896+0000 7fe993fff640 1 -- 172.21.15.45:0/2740679778 learned_addr learned my addr 172.21.15.45:0/2740679778 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.897+0000 7fe9996fe640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe99414fb20 0x7fe994155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.897+0000 7fe993fff640 1 -- 172.21.15.45:0/2740679778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe99414fb20 msgr2=0x7fe994155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.897+0000 7fe993fff640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe99414fb20 0x7fe994155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.897+0000 7fe993fff640 1 -- 172.21.15.45:0/2740679778 >> v1:172.21.15.114:6789/0 conn(0x7fe9940a7910 legacy=0x7fe9940c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.897+0000 7fe993fff640 1 -- 172.21.15.45:0/2740679778 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940c0e50 con 0x7fe9941521b0 2023-12-08T08:18:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.898+0000 7fe993fff640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9941521b0 0x7fe99414f5e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe980009870 tx=0x7fe98002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6384b78baef566 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe9937fe640 1 -- 172.21.15.45:0/2740679778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980031640 con 0x7fe9941521b0 2023-12-08T08:18:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe9937fe640 1 -- 172.21.15.45:0/2740679778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800317a0 con 0x7fe9941521b0 2023-12-08T08:18:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe9937fe640 1 -- 172.21.15.45:0/2740679778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980031b30 con 0x7fe9941521b0 2023-12-08T08:18:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe999eff640 1 -- 172.21.15.45:0/2740679778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9941521b0 msgr2=0x7fe99414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe999eff640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9941521b0 0x7fe99414f5e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe980009870 tx=0x7fe98002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe999eff640 1 -- 172.21.15.45:0/2740679778 shutdown_connections 2023-12-08T08:18:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe999eff640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe99414fb20 0x7fe994155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.899+0000 7fe999eff640 1 --2- 172.21.15.45:0/2740679778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9941521b0 0x7fe99414f5e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.900+0000 7fe999eff640 1 -- 172.21.15.45:0/2740679778 >> 172.21.15.45:0/2740679778 conn(0x7fe9940c5780 msgr2=0x7fe9940c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.900+0000 7fe999eff640 1 -- 172.21.15.45:0/2740679778 shutdown_connections 2023-12-08T08:18:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.900+0000 7fe999eff640 1 -- 172.21.15.45:0/2740679778 wait complete. 2023-12-08T08:18:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.901+0000 7fe999eff640 1 Processor -- start 2023-12-08T08:18:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.901+0000 7fe999eff640 1 -- start start 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99414fb20 0x7fe9941dac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9941521b0 0x7fe9941ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99414f100 con 0x7fe9940a7910 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99414f350 con 0x7fe99414fb20 2023-12-08T08:18:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.902+0000 7fe999eff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99414f630 con 0x7fe9941521b0 2023-12-08T08:18:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46292/0 (socket says 172.21.15.45:46292) 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 -- 172.21.15.45:0/2958037598 learned_addr learned my addr 172.21.15.45:0/2958037598 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe993fff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99414fb20 0x7fe9941dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe9996fe640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9941521b0 0x7fe9941ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 -- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9941521b0 msgr2=0x7fe9941ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9941521b0 0x7fe9941ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 -- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99414fb20 msgr2=0x7fe9941dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99414fb20 0x7fe9941dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.903+0000 7fe998efd640 1 -- 172.21.15.45:0/2958037598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800094d0 con 0x7fe9940a7910 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe998efd640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe98800c450 tx=0x7fe98800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880052d0 con 0x7fe9940a7910 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988005430 con 0x7fe9940a7910 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988012870 con 0x7fe9940a7910 2023-12-08T08:18:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9941e9ff0 con 0x7fe9940a7910 2023-12-08T08:18:35.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.904+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9941db1a0 con 0x7fe9940a7910 2023-12-08T08:18:35.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.905+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9941ea510 con 0x7fe9940a7910 2023-12-08T08:18:35.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.906+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9880129d0 con 0x7fe9940a7910 2023-12-08T08:18:35.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.908+0000 7fe9917fa640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:35.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.908+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fe988089300 con 0x7fe9940a7910 2023-12-08T08:18:35.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.908+0000 7fe993fff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:35.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.909+0000 7fe993fff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 0x7fe97806d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe980036000 tx=0x7fe98003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:35.913+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9941ea510 con 0x7fe9940a7910 2023-12-08T08:18:36.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.144+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9941ea510 con 0x7fe9940a7910 2023-12-08T08:18:36.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.145+0000 7fe9917fa640 1 -- 172.21.15.45:0/2958037598 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fe9941ea510 con 0x7fe9940a7910 2023-12-08T08:18:36.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:36.148 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1617058959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1617058959},{"type":"v1","addr":"172.21.15.45:6837","nonce":1617058959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:36.148 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 40 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 msgr2=0x7fe97806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 0x7fe97806d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe980036000 tx=0x7fe98003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 msgr2=0x7fe9941ea7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe98800c450 tx=0x7fe98800c910 comp rx=0 tx=0).stop 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 shutdown_connections 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9941521b0 0x7fe9941ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99414fb20 0x7fe9941dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 --2- 172.21.15.45:0/2958037598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9940a7910 0x7fe9941ea7f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 >> 172.21.15.45:0/2958037598 conn(0x7fe9940c5780 msgr2=0x7fe9940a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 shutdown_connections 2023-12-08T08:18:36.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.147+0000 7fe999eff640 1 -- 172.21.15.45:0/2958037598 wait complete. 2023-12-08T08:18:36.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:36.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.386+0000 7fc620855640 1 Processor -- start 2023-12-08T08:18:36.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.386+0000 7fc620855640 1 -- start start 2023-12-08T08:18:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.387+0000 7fc620855640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc61c1521b0 0x7fc61c14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.387+0000 7fc620855640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.387+0000 7fc620855640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c155850 con 0x7fc61c0a7910 2023-12-08T08:18:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.387+0000 7fc620855640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0c0890 con 0x7fc61c1521b0 2023-12-08T08:18:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.387+0000 7fc620855640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0c0b70 con 0x7fc61c14fb20 2023-12-08T08:18:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.388+0000 7fc61b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.388+0000 7fc61b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:39446/0 (socket says 172.21.15.45:39446) 2023-12-08T08:18:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.388+0000 7fc61b59e640 1 -- 172.21.15.45:0/2902250642 learned_addr learned my addr 172.21.15.45:0/2902250642 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.388+0000 7fc61259c640 1 --2- 172.21.15.45:0/2902250642 >> v2:172.21.15.114:3300/0 conn(0x7fc61c1521b0 0x7fc61c14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.389+0000 7fc61b59e640 1 -- 172.21.15.45:0/2902250642 >> v2:172.21.15.114:3300/0 conn(0x7fc61c1521b0 msgr2=0x7fc61c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.389+0000 7fc61b59e640 1 --2- 172.21.15.45:0/2902250642 >> v2:172.21.15.114:3300/0 conn(0x7fc61c1521b0 0x7fc61c14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.389+0000 7fc61b59e640 1 -- 172.21.15.45:0/2902250642 >> v1:172.21.15.114:6789/0 conn(0x7fc61c0a7910 legacy=0x7fc61c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.389+0000 7fc61b59e640 1 -- 172.21.15.45:0/2902250642 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0c0e50 con 0x7fc61c14fb20 2023-12-08T08:18:36.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.390+0000 7fc61b59e640 1 --2- 172.21.15.45:0/2902250642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b54b3f97e96795f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.391+0000 7fc61a59c640 1 -- 172.21.15.45:0/2902250642 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614031640 con 0x7fc61c14fb20 2023-12-08T08:18:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.391+0000 7fc61a59c640 1 -- 172.21.15.45:0/2902250642 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140317a0 con 0x7fc61c14fb20 2023-12-08T08:18:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.391+0000 7fc61a59c640 1 -- 172.21.15.45:0/2902250642 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614031b30 con 0x7fc61c14fb20 2023-12-08T08:18:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 -- 172.21.15.45:0/2902250642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 msgr2=0x7fc61c155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 --2- 172.21.15.45:0/2902250642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 -- 172.21.15.45:0/2902250642 shutdown_connections 2023-12-08T08:18:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 --2- 172.21.15.45:0/2902250642 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c155ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 --2- 172.21.15.45:0/2902250642 >> v2:172.21.15.114:3300/0 conn(0x7fc61c1521b0 0x7fc61c14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 -- 172.21.15.45:0/2902250642 >> 172.21.15.45:0/2902250642 conn(0x7fc61c0c5780 msgr2=0x7fc61c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 -- 172.21.15.45:0/2902250642 shutdown_connections 2023-12-08T08:18:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.392+0000 7fc620855640 1 -- 172.21.15.45:0/2902250642 wait complete. 2023-12-08T08:18:36.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.394+0000 7fc620855640 1 Processor -- start 2023-12-08T08:18:36.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.394+0000 7fc620855640 1 -- start start 2023-12-08T08:18:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc61c0a7910 0x7fc61c149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0c54a0 con 0x7fc61c1521b0 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c06fa70 con 0x7fc61c0a7910 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc620855640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0c4350 con 0x7fc61c14fb20 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc61b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc61b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46294/0 (socket says 172.21.15.45:46294) 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.395+0000 7fc61b59e640 1 -- 172.21.15.45:0/4043923906 learned_addr learned my addr 172.21.15.45:0/4043923906 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61259c640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61ad9d640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc61c0a7910 0x7fc61c149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 -- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 msgr2=0x7fc61c0a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c0a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 -- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc61c0a7910 msgr2=0x7fc61c149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc61c0a7910 0x7fc61c149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 -- 172.21.15.45:0/4043923906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140094d0 con 0x7fc61c1521b0 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.396+0000 7fc61b59e640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc6140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.397+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61403a930 con 0x7fc61c1521b0 2023-12-08T08:18:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.397+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61403aab0 con 0x7fc61c1521b0 2023-12-08T08:18:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.397+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61403ae60 con 0x7fc61c1521b0 2023-12-08T08:18:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.397+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c06ff00 con 0x7fc61c1521b0 2023-12-08T08:18:36.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.397+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c0c51c0 con 0x7fc61c1521b0 2023-12-08T08:18:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.398+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c06fbe0 con 0x7fc61c1521b0 2023-12-08T08:18:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.399+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc61402f050 con 0x7fc61c1521b0 2023-12-08T08:18:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.400+0000 7fc613fff640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.400+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7fc6140ab5c0 con 0x7fc61c1521b0 2023-12-08T08:18:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.400+0000 7fc61ad9d640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.401+0000 7fc61ad9d640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 0x7fc5fc06d300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0012e0 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.405+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6140764c0 con 0x7fc61c1521b0 2023-12-08T08:18:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.601+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc61c0743e0 con 0x7fc61c1521b0 2023-12-08T08:18:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.603+0000 7fc613fff640 1 -- 172.21.15.45:0/4043923906 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16882 (secure 0 0 0) 0x7fc614079ae0 con 0x7fc61c1521b0 2023-12-08T08:18:36.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:36.607 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":68,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:33.789880+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/63008111":"2023-12-09T08:18:30.374972+0000","172.21.15.45:6836/63008111":"2023-12-09T08:18:30.374972+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 msgr2=0x7fc5fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 0x7fc5fc06d300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0012e0 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 msgr2=0x7fc61c1e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc6140046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 shutdown_connections 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc61c14fb20 0x7fc61c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc61c1521b0 0x7fc61c1e5640 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 --2- 172.21.15.45:0/4043923906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc61c0a7910 0x7fc61c149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.606+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 >> 172.21.15.45:0/4043923906 conn(0x7fc61c0c5780 msgr2=0x7fc61c151420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.607+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 shutdown_connections 2023-12-08T08:18:36.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.607+0000 7fc620855640 1 -- 172.21.15.45:0/4043923906 wait complete. 2023-12-08T08:18:36.630 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:18:36.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:36.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.853+0000 7f5aaffff640 1 Processor -- start 2023-12-08T08:18:36.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.853+0000 7f5aaffff640 1 -- start start 2023-12-08T08:18:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aaffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5ab014e840 0x7f5ab0151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aaffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab0151ea0 con 0x7f5ab00c1210 2023-12-08T08:18:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aaffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab0154850 con 0x7f5ab00c16a0 2023-12-08T08:18:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aaffff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab014ec20 con 0x7f5ab014e840 2023-12-08T08:18:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aa7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ab00c1210 0x7f5ab00a9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33842/0 (socket says 172.21.15.45:33842) 2023-12-08T08:18:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aa7fff640 1 -- 172.21.15.45:0/558726209 learned_addr learned my addr 172.21.15.45:0/558726209 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aaeffd640 1 --2- 172.21.15.45:0/558726209 >> v2:172.21.15.114:3300/0 conn(0x7f5ab014e840 0x7f5ab0151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.855+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649037215 0 0) 0x7f5ab0151ea0 con 0x7f5ab00c1210 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a9c003520 con 0x7f5ab00c1210 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458059769 0 0) 0x7f5a9c003520 con 0x7f5ab00c1210 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 >> v2:172.21.15.114:3300/0 conn(0x7f5ab014e840 msgr2=0x7f5ab0151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 --2- 172.21.15.45:0/558726209 >> v2:172.21.15.114:3300/0 conn(0x7f5ab014e840 0x7f5ab0151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 >> v1:172.21.15.114:6789/0 conn(0x7f5ab00c16a0 legacy=0x7f5ab00aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0154b30 con 0x7f5ab00c1210 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5a98001670 con 0x7f5ab00c1210 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 >> v1:172.21.15.45:6789/0 conn(0x7f5ab00c1210 legacy=0x7f5ab00a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a9c0039c0 0x7f5a9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 0x7f5a9c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab014ec20 con 0x7f5a9c005380 2023-12-08T08:18:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c00e470 con 0x7f5a9c0047c0 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c00e630 con 0x7f5a9c0039c0 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.856+0000 7f5aaf7fe640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 0x7f5a9c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.857+0000 7f5aaf7fe640 1 -- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a9c0039c0 msgr2=0x7f5a9c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.857+0000 7f5aaf7fe640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a9c0039c0 0x7f5a9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.857+0000 7f5aaf7fe640 1 -- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c0047c0 msgr2=0x7f5a9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.857+0000 7f5aaf7fe640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c0047c0 0x7f5a9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.857+0000 7f5aaf7fe640 1 -- 172.21.15.45:0/558726209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c003520 con 0x7f5a9c005380 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aaf7fe640 1 -- 172.21.15.45:0/558726209 reap_dead start 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aaf7fe640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 0x7f5a9c00db90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8001e50 tx=0x7f5a9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcd5712dcedb8ea server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8003b70 con 0x7f5a9c005380 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8003d10 con 0x7f5a9c005380 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aae7fc640 1 -- 172.21.15.45:0/558726209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005310 con 0x7f5a9c005380 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aaffff640 1 -- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 msgr2=0x7f5a9c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.858+0000 7f5aaffff640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 0x7f5a9c00db90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8001e50 tx=0x7f5a9c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.859+0000 7f5aaffff640 1 -- 172.21.15.45:0/558726209 shutdown_connections 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.859+0000 7f5aaffff640 1 --2- 172.21.15.45:0/558726209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c005380 0x7f5a9c00db90 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.859+0000 7f5aaffff640 1 -- 172.21.15.45:0/558726209 >> 172.21.15.45:0/558726209 conn(0x7f5ab00c5780 msgr2=0x7f5ab00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.859+0000 7f5aaffff640 1 -- 172.21.15.45:0/558726209 shutdown_connections 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.859+0000 7f5aaffff640 1 -- 172.21.15.45:0/558726209 wait complete. 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.860+0000 7f5aaffff640 1 Processor -- start 2023-12-08T08:18:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.860+0000 7f5aaffff640 1 -- start start 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c005380 0x7f5ab01e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ab0149c70 0x7f5ab014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01e94b0 con 0x7f5ab0072410 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0071770 con 0x7f5a9c005380 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.861+0000 7f5aaffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0071a50 con 0x7f5ab0149c70 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46314/0 (socket says 172.21.15.45:46314) 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 -- 172.21.15.45:0/3418321454 learned_addr learned my addr 172.21.15.45:0/3418321454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 -- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ab0149c70 msgr2=0x7f5ab014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ab0149c70 0x7f5ab014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 -- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c005380 msgr2=0x7f5ab01e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c005380 0x7f5ab01e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 -- 172.21.15.45:0/3418321454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0071d30 con 0x7f5ab0072410 2023-12-08T08:18:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa7fff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800c730 tx=0x7f5a9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980072d0 con 0x7f5ab0072410 2023-12-08T08:18:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98007430 con 0x7f5ab0072410 2023-12-08T08:18:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.862+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980047e0 con 0x7f5ab0072410 2023-12-08T08:18:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.863+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab014ee00 con 0x7f5ab0072410 2023-12-08T08:18:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.863+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab014c290 con 0x7f5ab0072410 2023-12-08T08:18:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.864+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab014f320 con 0x7f5ab0072410 2023-12-08T08:18:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.865+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a98004940 con 0x7f5ab0072410 2023-12-08T08:18:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.866+0000 7f5aa77fe640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 0x7f5a9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.866+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f5a98088a90 con 0x7f5ab0072410 2023-12-08T08:18:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.867+0000 7f5aaeffd640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 0x7f5a9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.867+0000 7f5aaeffd640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 0x7f5a9006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006f00 tx=0x7f5aa0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:36.871+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ab014f320 con 0x7f5ab0072410 2023-12-08T08:18:37.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.102+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ab014f320 con 0x7f5ab0072410 2023-12-08T08:18:37.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.103+0000 7f5aa77fe640 1 -- 172.21.15.45:0/3418321454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f5ab014f320 con 0x7f5ab0072410 2023-12-08T08:18:37.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:37.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1617058959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1617058959},{"type":"v1","addr":"172.21.15.45:6837","nonce":1617058959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:37.106 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 40 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 msgr2=0x7f5a9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 0x7f5a9006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006f00 tx=0x7f5aa0008040 comp rx=0 tx=0).stop 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 msgr2=0x7f5ab014bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800c730 tx=0x7f5a9800cbf0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 shutdown_connections 2023-12-08T08:18:37.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a9006ae40 0x7f5a9006d300 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5ab0149c70 0x7f5ab014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ab0072410 0x7f5ab014bd50 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 --2- 172.21.15.45:0/3418321454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a9c005380 0x7f5ab01e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.106+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 >> 172.21.15.45:0/3418321454 conn(0x7f5ab00c5780 msgr2=0x7f5ab0153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.107+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 shutdown_connections 2023-12-08T08:18:37.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.107+0000 7f5aaffff640 1 -- 172.21.15.45:0/3418321454 wait complete. 2023-12-08T08:18:37.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.344+0000 7ff59bfff640 1 Processor -- start 2023-12-08T08:18:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.344+0000 7ff59bfff640 1 -- start start 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.346+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff59c0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.346+0000 7ff59bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c1588f0 con 0x7ff59c0c44d0 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.346+0000 7ff59bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c0c4a00 con 0x7ff59c1519c0 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.346+0000 7ff59bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c8160 con 0x7ff59c1584c0 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff59a7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff59c0c44d0 0x7ff59c0c7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33850/0 (socket says 172.21.15.45:33850) 2023-12-08T08:18:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff59a7fc640 1 -- 172.21.15.45:0/4188415051 learned_addr learned my addr 172.21.15.45:0/4188415051 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199200487 0 0) 0x7ff59c1588f0 con 0x7ff59c0c44d0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff588003520 con 0x7ff59c0c44d0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff59b7fe640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff59c0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1399909290 0 0) 0x7ff588003520 con 0x7ff59c0c44d0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 msgr2=0x7ff59c0ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff59c0ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 >> v1:172.21.15.114:6789/0 conn(0x7ff59c1519c0 legacy=0x7ff59c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0c4ce0 con 0x7ff59c0c44d0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.347+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ff584001670 con 0x7ff59c0c44d0 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 >> v1:172.21.15.45:6789/0 conn(0x7ff59c0c44d0 legacy=0x7ff59c0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5880039a0 0x7ff588003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff5880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff588004d00 0x7ff588005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c8160 con 0x7ff5880039a0 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58800bab0 con 0x7ff588004d00 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58800bc70 con 0x7ff59c1584c0 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59affd640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5880039a0 0x7ff588003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59a7fc640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff5880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59b7fe640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff588004d00 0x7ff588005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59affd640 1 -- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 msgr2=0x7ff5880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59affd640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c1584c0 0x7ff5880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59affd640 1 -- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff588004d00 msgr2=0x7ff588005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.348+0000 7ff59affd640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff588004d00 0x7ff588005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.349+0000 7ff59affd640 1 -- 172.21.15.45:0/4188415051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff588003520 con 0x7ff5880039a0 2023-12-08T08:18:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.350+0000 7ff59affd640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5880039a0 0x7ff588003dc0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff58c001e50 tx=0x7ff5880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f0609ed0efbc9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.350+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c003b70 con 0x7ff5880039a0 2023-12-08T08:18:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.350+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c003cd0 con 0x7ff5880039a0 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.350+0000 7ff599ffb640 1 -- 172.21.15.45:0/4188415051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c005310 con 0x7ff5880039a0 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 -- 172.21.15.45:0/4188415051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5880039a0 msgr2=0x7ff588003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 --2- 172.21.15.45:0/4188415051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5880039a0 0x7ff588003dc0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff58c001e50 tx=0x7ff5880057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59b7fe640 1 -- 172.21.15.45:0/4188415051 reap_dead start 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 -- 172.21.15.45:0/4188415051 shutdown_connections 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 -- 172.21.15.45:0/4188415051 >> 172.21.15.45:0/4188415051 conn(0x7ff59c0661f0 msgr2=0x7ff59c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 -- 172.21.15.45:0/4188415051 shutdown_connections 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.351+0000 7ff59bfff640 1 -- 172.21.15.45:0/4188415051 wait complete. 2023-12-08T08:18:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.352+0000 7ff59bfff640 1 Processor -- start 2023-12-08T08:18:37.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.353+0000 7ff59bfff640 1 -- start start 2023-12-08T08:18:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.353+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5880039a0 0x7ff59c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c14aa20 0x7ff59c0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c14aea0 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c2920 con 0x7ff5880039a0 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c14bfb0 con 0x7ff59c14aa20 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46330/0 (socket says 172.21.15.45:46330) 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 -- 172.21.15.45:0/1687327257 learned_addr learned my addr 172.21.15.45:0/1687327257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59b7fe640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c14aa20 0x7ff59c0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 -- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c14aa20 msgr2=0x7ff59c0c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c14aa20 0x7ff59c0c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59affd640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5880039a0 0x7ff59c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 -- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5880039a0 msgr2=0x7ff59c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5880039a0 0x7ff59c14b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.354+0000 7ff59a7fc640 1 -- 172.21.15.45:0/1687327257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c1ead10 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff59a7fc640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff58400e730 tx=0x7ff58400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400ee40 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400c8d0 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400cc80 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c1eaff0 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.355+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c0c37b0 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.356+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c0c97b0 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.357+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff58401d460 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.358+0000 7ff593fff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 0x7ff57c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.358+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7ff584089750 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.358+0000 7ff59affd640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 0x7ff57c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.359+0000 7ff59affd640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 0x7ff57c06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff58c034000 tx=0x7ff58c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.362+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff584058050 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.589+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff59c0c7f80 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.589+0000 7ff593fff640 1 -- 172.21.15.45:0/1687327257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4920 (secure 0 0 0) 0x7ff584087e60 con 0x7ff59c1ea4d0 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1617058959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1617058959},{"type":"v1","addr":"172.21.15.45:6837","nonce":1617058959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.237664+0000","modified":"2023-12-08T08:18:00.298896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6018},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6018":{"gid":6018,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6835/1879788882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879788882},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879788882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 40 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 msgr2=0x7ff57c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 0x7ff57c06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff58c034000 tx=0x7ff58c009030 comp rx=0 tx=0).stop 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 msgr2=0x7ff59c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff58400e730 tx=0x7ff58400ebf0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 shutdown_connections 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff57c06ae70 0x7ff57c06d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff59c14aa20 0x7ff59c0c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c1ea4d0 0x7ff59c14a4e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 --2- 172.21.15.45:0/1687327257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5880039a0 0x7ff59c14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 >> 172.21.15.45:0/1687327257 conn(0x7ff59c0661f0 msgr2=0x7ff59c0a9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 shutdown_connections 2023-12-08T08:18:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.592+0000 7ff59bfff640 1 -- 172.21.15.45:0/1687327257 wait complete. 2023-12-08T08:18:37.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.834+0000 7f08298c2640 1 Processor -- start 2023-12-08T08:18:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.834+0000 7f08298c2640 1 -- start start 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.835+0000 7f08298c2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08240c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.835+0000 7f08298c2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08240a6ee0 0x7f08240c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.835+0000 7f08298c2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240c87d0 con 0x7f08240c3cf0 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.835+0000 7f08298c2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0824157d30 con 0x7f08240a6ee0 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.835+0000 7f08298c2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0824158010 con 0x7f0824151e10 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08240a6ee0 0x7f08240c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08240a6ee0 0x7f08240c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46332/0 (socket says 172.21.15.45:46332) 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 -- 172.21.15.45:0/3732875789 learned_addr learned my addr 172.21.15.45:0/3732875789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f0822ffd640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08240c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 -- 172.21.15.45:0/3732875789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 msgr2=0x7f08240c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08240c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 -- 172.21.15.45:0/3732875789 >> v1:172.21.15.114:6789/0 conn(0x7f08240c3cf0 legacy=0x7f0824154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:37.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.836+0000 7f08227fc640 1 -- 172.21.15.45:0/3732875789 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08241582f0 con 0x7f08240a6ee0 2023-12-08T08:18:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.837+0000 7f08227fc640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240c37b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbbc73e6f3d5630 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.838+0000 7f0821ffb640 1 -- 172.21.15.45:0/3732875789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c02ca70 con 0x7f08240a6ee0 2023-12-08T08:18:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.838+0000 7f0821ffb640 1 -- 172.21.15.45:0/3732875789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c02cbd0 con 0x7f08240a6ee0 2023-12-08T08:18:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.838+0000 7f0821ffb640 1 -- 172.21.15.45:0/3732875789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c0343f0 con 0x7f08240a6ee0 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.838+0000 7f08298c2640 1 -- 172.21.15.45:0/3732875789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 msgr2=0x7f08240c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.838+0000 7f08298c2640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240c37b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e50 tx=0x7f080c02bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 -- 172.21.15.45:0/3732875789 shutdown_connections 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240c37b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 --2- 172.21.15.45:0/3732875789 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08240c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 -- 172.21.15.45:0/3732875789 >> 172.21.15.45:0/3732875789 conn(0x7f0824072240 msgr2=0x7f08240661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 -- 172.21.15.45:0/3732875789 shutdown_connections 2023-12-08T08:18:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.839+0000 7f08298c2640 1 -- 172.21.15.45:0/3732875789 wait complete. 2023-12-08T08:18:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.840+0000 7f08298c2640 1 Processor -- start 2023-12-08T08:18:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.841+0000 7f08298c2640 1 -- start start 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.841+0000 7f08298c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.841+0000 7f08298c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08240c3cf0 0x7f08241ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.841+0000 7f08298c2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08241ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.841+0000 7f08298c2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240ab440 con 0x7f08240a6ee0 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f08298c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240abc50 con 0x7f08240c3cf0 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f08298c2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240ab690 con 0x7f0824151e10 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46348/0 (socket says 172.21.15.45:46348) 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 -- 172.21.15.45:0/2516203832 learned_addr learned my addr 172.21.15.45:0/2516203832 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 -- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 msgr2=0x7f08241ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08241ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 -- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08240c3cf0 msgr2=0x7f08241ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08240c3cf0 0x7f08241ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 -- 172.21.15.45:0/2516203832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009b30 con 0x7f08240a6ee0 2023-12-08T08:18:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.842+0000 7f0822ffd640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f081400d5f0 tx=0x7f081400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.843+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140125f0 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.843+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0814012750 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.843+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08240ab970 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.843+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814012b00 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.843+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08240aa520 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.844+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824072ac0 con 0x7f08240a6ee0 2023-12-08T08:18:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.845+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0814012c60 con 0x7f08240a6ee0 2023-12-08T08:18:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.846+0000 7f081bfff640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 0x7f080406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.846+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f0814089c90 con 0x7f08240a6ee0 2023-12-08T08:18:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.846+0000 7f08227fc640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 0x7f080406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.847+0000 7f08227fc640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 0x7f080406d300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f080c035000 tx=0x7f080c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:37.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:37.850+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0814054b90 con 0x7f08240a6ee0 2023-12-08T08:18:38.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.044+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0824074600 con 0x7f08240a6ee0 2023-12-08T08:18:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.047+0000 7f081bfff640 1 -- 172.21.15.45:0/2516203832 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16882 (secure 0 0 0) 0x7f08140581b0 con 0x7f08240a6ee0 2023-12-08T08:18:38.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:38.051 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":68,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:33.789880+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:17:55.154580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:17:56.265883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/63008111":"2023-12-09T08:18:30.374972+0000","172.21.15.45:6836/63008111":"2023-12-09T08:18:30.374972+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.050+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 msgr2=0x7f080406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.050+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 0x7f080406d300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f080c035000 tx=0x7f080c02e000 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.050+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 msgr2=0x7f08240a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.050+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f081400d5f0 tx=0x7f081400dab0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 shutdown_connections 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f080406ae40 0x7f080406d300 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0824151e10 0x7f08241ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08240c3cf0 0x7f08241ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 --2- 172.21.15.45:0/2516203832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08240a6ee0 0x7f08240a87b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 >> 172.21.15.45:0/2516203832 conn(0x7f0824072240 msgr2=0x7f08240661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 shutdown_connections 2023-12-08T08:18:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.051+0000 7f08298c2640 1 -- 172.21.15.45:0/2516203832 wait complete. 2023-12-08T08:18:38.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:18:38.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.294+0000 7f9b59839640 1 Processor -- start 2023-12-08T08:18:38.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.294+0000 7f9b59839640 1 -- start start 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b59839640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b54155d40 0x7f9b540c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b59839640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540aa8e0 con 0x7f9b54159500 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b59839640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b54158760 con 0x7f9b540c5d20 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b59839640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540a9780 con 0x7f9b54155d40 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b58837640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b54155d40 0x7f9b540c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b53fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b54159500 0x7f9b540c3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33860/0 (socket says 172.21.15.45:33860) 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b53fff640 1 -- 172.21.15.45:0/920886084 learned_addr learned my addr 172.21.15.45:0/920886084 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:38.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b58837640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b54155d40 0x7f9b540c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46352/0 (socket says 172.21.15.45:46352) 2023-12-08T08:18:38.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.296+0000 7f9b58837640 1 -- 172.21.15.45:0/920886084 >> v1:172.21.15.114:6789/0 conn(0x7f9b540c5d20 legacy=0x7f9b541630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:38.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.297+0000 7f9b58837640 1 -- 172.21.15.45:0/920886084 >> v1:172.21.15.45:6789/0 conn(0x7f9b54159500 legacy=0x7f9b540c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.297+0000 7f9b58837640 1 -- 172.21.15.45:0/920886084 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540c5010 con 0x7f9b54155d40 2023-12-08T08:18:38.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.297+0000 7f9b537fe640 1 -- 172.21.15.45:0/920886084 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001875791 0 0) 0x7f9b540aa8e0 con 0x7f9b54159500 2023-12-08T08:18:38.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.298+0000 7f9b58837640 1 --2- 172.21.15.45:0/920886084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b54155d40 0x7f9b540c57e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d213cab8da7fdaa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.298+0000 7f9b537fe640 1 -- 172.21.15.45:0/920886084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4402cbd0 con 0x7f9b54155d40 2023-12-08T08:18:38.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.298+0000 7f9b537fe640 1 -- 172.21.15.45:0/920886084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4402cd30 con 0x7f9b54155d40 2023-12-08T08:18:38.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.298+0000 7f9b537fe640 1 -- 172.21.15.45:0/920886084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4402cea0 con 0x7f9b54155d40 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 -- 172.21.15.45:0/920886084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b54155d40 msgr2=0x7f9b540c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 --2- 172.21.15.45:0/920886084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b54155d40 0x7f9b540c57e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b4402be20 comp rx=0 tx=0).stop 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 -- 172.21.15.45:0/920886084 shutdown_connections 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 --2- 172.21.15.45:0/920886084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b54155d40 0x7f9b540c57e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 -- 172.21.15.45:0/920886084 >> 172.21.15.45:0/920886084 conn(0x7f9b540a7600 msgr2=0x7f9b540a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 -- 172.21.15.45:0/920886084 shutdown_connections 2023-12-08T08:18:38.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.299+0000 7f9b59839640 1 -- 172.21.15.45:0/920886084 wait complete. 2023-12-08T08:18:38.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.301+0000 7f9b59839640 1 Processor -- start 2023-12-08T08:18:38.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.301+0000 7f9b59839640 1 -- start start 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b54155d40 0x7f9b541f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b54159500 0x7f9b540a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54072210 con 0x7f9b540c5d20 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540719b0 con 0x7f9b54159500 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b59839640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541f22f0 con 0x7f9b54155d40 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46354/0 (socket says 172.21.15.45:46354) 2023-12-08T08:18:38.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 -- 172.21.15.45:0/2326908488 learned_addr learned my addr 172.21.15.45:0/2326908488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 -- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b54155d40 msgr2=0x7f9b541f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b54155d40 0x7f9b541f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 -- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b54159500 msgr2=0x7f9b540a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b54159500 0x7f9b540a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.302+0000 7f9b58837640 1 -- 172.21.15.45:0/2326908488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009a70 con 0x7f9b540c5d20 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b58837640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4402cea0 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4402cb70 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4403f870 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b54071c50 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.303+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540a2260 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.305+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b540a24b0 con 0x7f9b540c5d20 2023-12-08T08:18:38.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.305+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b4403f9d0 con 0x7f9b540c5d20 2023-12-08T08:18:38.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.306+0000 7f9b517fa640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 0x7f9b3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.306+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f9b440ac380 con 0x7f9b540c5d20 2023-12-08T08:18:38.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.307+0000 7f9b53fff640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 0x7f9b3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.307+0000 7f9b53fff640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 0x7f9b3406d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c007960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.310+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b44077280 con 0x7f9b540c5d20 2023-12-08T08:18:38.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.541+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f9b540743e0 con 0x7f9b540c5d20 2023-12-08T08:18:38.545 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:18:38.543+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:18:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.546+0000 7f9b517fa640 1 -- 172.21.15.45:0/2326908488 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 163+0+0 (secure 0 0 0) 0x7f9b4407a8a0 con 0x7f9b540c5d20 2023-12-08T08:18:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 msgr2=0x7f9b3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 0x7f9b3406d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c007fd0 tx=0x7f9b3c007960 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 msgr2=0x7f9b541f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b44004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 shutdown_connections 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b3406ae40 0x7f9b3406d300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b54155d40 0x7f9b541f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b54159500 0x7f9b540a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 --2- 172.21.15.45:0/2326908488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b540c5d20 0x7f9b541f1700 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 >> 172.21.15.45:0/2326908488 conn(0x7f9b540a7600 msgr2=0x7f9b540c3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 shutdown_connections 2023-12-08T08:18:38.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.549+0000 7f9b59839640 1 -- 172.21.15.45:0/2326908488 wait complete. 2023-12-08T08:18:38.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:18:38.575 INFO:tasks.ceph.mds.a.smithi045.stderr: -2468> 2023-12-08T08:17:59.641+0000 7f8bb4a6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:18:38.640 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:18:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.767+0000 7fb48759e640 1 Processor -- start 2023-12-08T08:18:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.767+0000 7fb48759e640 1 -- start start 2023-12-08T08:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4881518e0 0x7fb4880c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb4880c4460 0x7fb4880c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880c92c0 con 0x7fb4880c8740 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb488155330 con 0x7fb4881518e0 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4881542f0 con 0x7fb4880c4460 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb48659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4881518e0 0x7fb4880c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb486d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb4880c8740 0x7fb4880c8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33876/0 (socket says 172.21.15.45:33876) 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.768+0000 7fb486d9d640 1 -- 172.21.15.45:0/1941718870 learned_addr learned my addr 172.21.15.45:0/1941718870 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb485d9b640 1 --2- 172.21.15.45:0/1941718870 >> v2:172.21.15.114:3300/0 conn(0x7fb4880c4460 0x7fb4880c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb48659c640 1 -- 172.21.15.45:0/1941718870 >> v2:172.21.15.114:3300/0 conn(0x7fb4880c4460 msgr2=0x7fb4880c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb48659c640 1 --2- 172.21.15.45:0/1941718870 >> v2:172.21.15.114:3300/0 conn(0x7fb4880c4460 0x7fb4880c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb48659c640 1 -- 172.21.15.45:0/1941718870 >> v1:172.21.15.45:6789/0 conn(0x7fb4880c8740 legacy=0x7fb4880c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb48659c640 1 -- 172.21.15.45:0/1941718870 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488154570 con 0x7fb4881518e0 2023-12-08T08:18:38.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.769+0000 7fb48559a640 1 -- 172.21.15.45:0/1941718870 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957532542 0 0) 0x7fb4880c92c0 con 0x7fb4880c8740 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.770+0000 7fb48659c640 1 --2- 172.21.15.45:0/1941718870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4880c79e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb488067110 tx=0x7fb47802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e88120314c7e8c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.770+0000 7fb48559a640 1 -- 172.21.15.45:0/1941718870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47802e070 con 0x7fb4881518e0 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48559a640 1 -- 172.21.15.45:0/1941718870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780315a0 con 0x7fb4881518e0 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48559a640 1 -- 172.21.15.45:0/1941718870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478031930 con 0x7fb4881518e0 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 -- 172.21.15.45:0/1941718870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 msgr2=0x7fb4880c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 --2- 172.21.15.45:0/1941718870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4880c79e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb488067110 tx=0x7fb47802b840 comp rx=0 tx=0).stop 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 -- 172.21.15.45:0/1941718870 shutdown_connections 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 --2- 172.21.15.45:0/1941718870 >> v2:172.21.15.114:3300/0 conn(0x7fb4880c4460 0x7fb4880c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 --2- 172.21.15.45:0/1941718870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4880c79e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 -- 172.21.15.45:0/1941718870 >> 172.21.15.45:0/1941718870 conn(0x7fb4880ab6d0 msgr2=0x7fb4880abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 -- 172.21.15.45:0/1941718870 shutdown_connections 2023-12-08T08:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.771+0000 7fb48759e640 1 -- 172.21.15.45:0/1941718870 wait complete. 2023-12-08T08:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.773+0000 7fb48759e640 1 Processor -- start 2023-12-08T08:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.773+0000 7fb48759e640 1 -- start start 2023-12-08T08:18:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 0x7fb4880aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4880c8740 0x7fb488157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881ed430 con 0x7fb4881518e0 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881557a0 con 0x7fb4880c4460 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb48759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880c3b50 con 0x7fb4880c8740 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb486d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb486d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46370/0 (socket says 172.21.15.45:46370) 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.774+0000 7fb486d9d640 1 -- 172.21.15.45:0/2339229424 learned_addr learned my addr 172.21.15.45:0/2339229424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb48659c640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 0x7fb4880aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb485d9b640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4880c8740 0x7fb488157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 -- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4880c8740 msgr2=0x7fb488157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4880c8740 0x7fb488157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 -- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 msgr2=0x7fb4880aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 0x7fb4880aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 -- 172.21.15.45:0/2339229424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009400 con 0x7fb4881518e0 2023-12-08T08:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb48659c640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 0x7fb4880aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb486d9d640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c7a0 tx=0x7fb48000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.775+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000a640 con 0x7fb4881518e0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.776+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000a7a0 con 0x7fb4881518e0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.776+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000abd0 con 0x7fb4881518e0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.776+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4881ecb00 con 0x7fb4881518e0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.776+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4881ed0c0 con 0x7fb4881518e0 2023-12-08T08:18:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.777+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4881ed280 con 0x7fb4881518e0 2023-12-08T08:18:38.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.778+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb48000ad30 con 0x7fb4881518e0 2023-12-08T08:18:38.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.779+0000 7fb47effd640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.779+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6205+0+0 (secure 0 0 0) 0x7fb480088d00 con 0x7fb4881518e0 2023-12-08T08:18:38.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.780+0000 7fb48659c640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.780+0000 7fb48659c640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 0x7fb46806d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb478036000 tx=0x7fb478008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:38.784+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb480053c50 con 0x7fb4881518e0 2023-12-08T08:18:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.017+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb4880743e0 con 0x7fb4881518e0 2023-12-08T08:18:39.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.550+0000 7fb47effd640 1 -- 172.21.15.45:0/2339229424 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb480018070 con 0x7fb4881518e0 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 msgr2=0x7fb46806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 0x7fb46806d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb478036000 tx=0x7fb478008030 comp rx=0 tx=0).stop 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 msgr2=0x7fb4881577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c7a0 tx=0x7fb48000cc60 comp rx=0 tx=0).stop 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 shutdown_connections 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb46806ae40 0x7fb46806d300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb4880c8740 0x7fb488157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4881518e0 0x7fb4881577c0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 --2- 172.21.15.45:0/2339229424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4880c4460 0x7fb4880aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 >> 172.21.15.45:0/2339229424 conn(0x7fb4880ab6d0 msgr2=0x7fb4880c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:39.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 shutdown_connections 2023-12-08T08:18:39.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.554+0000 7fb48759e640 1 -- 172.21.15.45:0/2339229424 wait complete. 2023-12-08T08:18:39.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:18:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.808+0000 7f58bea59640 1 Processor -- start 2023-12-08T08:18:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.808+0000 7f58bea59640 1 -- start start 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bea59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58b80c44e0 0x7f58b8154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bea59640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 0x7f58b80c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bea59640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b8157890 con 0x7f58b80c7a60 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bea59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b8155300 con 0x7f58b80c44e0 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bea59640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c7f70 con 0x7f58b8158430 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bda57640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58b80c44e0 0x7f58b8154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bda57640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58b80c44e0 0x7f58b8154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46374/0 (socket says 172.21.15.45:46374) 2023-12-08T08:18:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.810+0000 7f58bda57640 1 -- 172.21.15.45:0/3896304069 learned_addr learned my addr 172.21.15.45:0/3896304069 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58bda57640 1 -- 172.21.15.45:0/3896304069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 msgr2=0x7f58b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58be258640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 0x7f58b80c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58bda57640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 0x7f58b80c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58bda57640 1 -- 172.21.15.45:0/3896304069 >> v1:172.21.15.114:6789/0 conn(0x7f58b80c7a60 legacy=0x7f58b8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58bda57640 1 -- 172.21.15.45:0/3896304069 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80ca040 con 0x7f58b80c44e0 2023-12-08T08:18:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.811+0000 7f58be258640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 0x7f58b80c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.812+0000 7f58bda57640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b80c44e0 0x7f58b8154d20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009870 tx=0x7f58b402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e93d2863ba20a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bca55640 1 -- 172.21.15.45:0/3896304069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40317c0 con 0x7f58b80c44e0 2023-12-08T08:18:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bca55640 1 -- 172.21.15.45:0/3896304069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4031920 con 0x7f58b80c44e0 2023-12-08T08:18:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bca55640 1 -- 172.21.15.45:0/3896304069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4031cb0 con 0x7f58b80c44e0 2023-12-08T08:18:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 -- 172.21.15.45:0/3896304069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b80c44e0 msgr2=0x7f58b8154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b80c44e0 0x7f58b8154d20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009870 tx=0x7f58b402b860 comp rx=0 tx=0).stop 2023-12-08T08:18:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 -- 172.21.15.45:0/3896304069 shutdown_connections 2023-12-08T08:18:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b8158430 0x7f58b80c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 --2- 172.21.15.45:0/3896304069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b80c44e0 0x7f58b8154d20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.813+0000 7f58bea59640 1 -- 172.21.15.45:0/3896304069 >> 172.21.15.45:0/3896304069 conn(0x7f58b80663d0 msgr2=0x7f58b80667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.814+0000 7f58bea59640 1 -- 172.21.15.45:0/3896304069 shutdown_connections 2023-12-08T08:18:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.814+0000 7f58bea59640 1 -- 172.21.15.45:0/3896304069 wait complete. 2023-12-08T08:18:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.815+0000 7f58bea59640 1 Processor -- start 2023-12-08T08:18:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 -- start start 2023-12-08T08:18:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b80c44e0 0x7f58b81ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b80c7a60 0x7f58b8156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c2ca0 con 0x7f58b8158430 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c2f80 con 0x7f58b80c44e0 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.816+0000 7f58bea59640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b81ea170 con 0x7f58b80c7a60 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46384/0 (socket says 172.21.15.45:46384) 2023-12-08T08:18:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 -- 172.21.15.45:0/343056240 learned_addr learned my addr 172.21.15.45:0/343056240 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58bda57640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b80c44e0 0x7f58b81ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 -- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b80c7a60 msgr2=0x7f58b8156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b80c7a60 0x7f58b8156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 -- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b80c44e0 msgr2=0x7f58b81ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b80c44e0 0x7f58b81ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.817+0000 7f58be258640 1 -- 172.21.15.45:0/343056240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40094d0 con 0x7f58b8158430 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58be258640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cd50 tx=0x7f58b000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000f680 con 0x7f58b8158430 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b000f800 con 0x7f58b8158430 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b81ea450 con 0x7f58b8158430 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000fbb0 con 0x7f58b8158430 2023-12-08T08:18:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.818+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b81e9e20 con 0x7f58b8158430 2023-12-08T08:18:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.819+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b81ea690 con 0x7f58b8158430 2023-12-08T08:18:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.820+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58b000b040 con 0x7f58b8158430 2023-12-08T08:18:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.822+0000 7f58aa7fc640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 0x7f589c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.822+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6205+0+0 (secure 0 0 0) 0x7f58b008a230 con 0x7f58b8158430 2023-12-08T08:18:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.822+0000 7f58bda57640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 0x7f589c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.823+0000 7f58bda57640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 0x7f589c06d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f58b4036000 tx=0x7f58b403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:39.826+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58b81ea690 con 0x7f58b8158430 2023-12-08T08:18:40.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.013+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58b81ea690 con 0x7f58b8158430 2023-12-08T08:18:40.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.838+0000 7f58aa7fc640 1 -- 172.21.15.45:0/343056240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v70) v1 ==== 184+0+0 (secure 0 0 0) 0x7f58b81ea690 con 0x7f58b8158430 2023-12-08T08:18:40.841 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:18:40.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.841+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 msgr2=0x7f589c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 0x7f589c06d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f58b4036000 tx=0x7f58b403d040 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 msgr2=0x7f58b8152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cd50 tx=0x7f58b000a650 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 shutdown_connections 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f589c06ae40 0x7f589c06d300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f58b80c7a60 0x7f58b8156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58b8158430 0x7f58b8152110 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 --2- 172.21.15.45:0/343056240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58b80c44e0 0x7f58b81ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.842+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 >> 172.21.15.45:0/343056240 conn(0x7f58b80663d0 msgr2=0x7f58b80667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:40.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.843+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 shutdown_connections 2023-12-08T08:18:40.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:40.844+0000 7f58bea59640 1 -- 172.21.15.45:0/343056240 wait complete. 2023-12-08T08:18:40.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:18:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.086+0000 7fe37711b640 1 Processor -- start 2023-12-08T08:18:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.087+0000 7fe37711b640 1 -- start start 2023-12-08T08:18:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.088+0000 7fe37711b640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3700c7b10 0x7fe370151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe37711b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3700c4630 con 0x7fe3700c8240 2023-12-08T08:18:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe37711b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3700c86f0 con 0x7fe370151a50 2023-12-08T08:18:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe37711b640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3700c6f60 con 0x7fe3700c7b10 2023-12-08T08:18:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe37691a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3700c8240 0x7fe370157c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33880/0 (socket says 172.21.15.45:33880) 2023-12-08T08:18:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe37691a640 1 -- 172.21.15.45:0/4081574219 learned_addr learned my addr 172.21.15.45:0/4081574219 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.089+0000 7fe375918640 1 --2- 172.21.15.45:0/4081574219 >> v2:172.21.15.114:3300/0 conn(0x7fe3700c7b10 0x7fe370151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265452599 0 0) 0x7fe3700c4630 con 0x7fe3700c8240 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe35c003520 con 0x7fe3700c8240 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502401906 0 0) 0x7fe3700c86f0 con 0x7fe370151a50 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3700c4630 con 0x7fe370151a50 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375918640 1 -- 172.21.15.45:0/4081574219 >> v1:172.21.15.114:6789/0 conn(0x7fe370151a50 legacy=0x7fe3700c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536604827 0 0) 0x7fe35c003520 con 0x7fe3700c8240 2023-12-08T08:18:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.090+0000 7fe375918640 1 -- 172.21.15.45:0/4081574219 >> v1:172.21.15.45:6789/0 conn(0x7fe3700c8240 legacy=0x7fe370157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.091+0000 7fe375918640 1 -- 172.21.15.45:0/4081574219 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700c7160 con 0x7fe3700c7b10 2023-12-08T08:18:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.092+0000 7fe375918640 1 --2- 172.21.15.45:0/4081574219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe370151e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0097d0 tx=0x7fe36c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34cd542fd56f9f56 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.092+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3680019f0 con 0x7fe3700c7b10 2023-12-08T08:18:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.092+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c02e050 con 0x7fe3700c7b10 2023-12-08T08:18:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.092+0000 7fe375117640 1 -- 172.21.15.45:0/4081574219 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c030710 con 0x7fe3700c7b10 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 -- 172.21.15.45:0/4081574219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 msgr2=0x7fe370151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 --2- 172.21.15.45:0/4081574219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe370151e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0097d0 tx=0x7fe36c02b790 comp rx=0 tx=0).stop 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 -- 172.21.15.45:0/4081574219 shutdown_connections 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 --2- 172.21.15.45:0/4081574219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe370151e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 -- 172.21.15.45:0/4081574219 >> 172.21.15.45:0/4081574219 conn(0x7fe37006b850 msgr2=0x7fe37006bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.093+0000 7fe37711b640 1 -- 172.21.15.45:0/4081574219 shutdown_connections 2023-12-08T08:18:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.094+0000 7fe37711b640 1 -- 172.21.15.45:0/4081574219 wait complete. 2023-12-08T08:18:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.097+0000 7fe37711b640 1 Processor -- start 2023-12-08T08:18:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.097+0000 7fe37711b640 1 -- start start 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.098+0000 7fe37711b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe3701e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37711b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37711b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe370151a50 0x7fe3701ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37711b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700c1f80 con 0x7fe3700c8240 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37711b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700c2260 con 0x7fe3700c7b10 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37711b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700c2540 con 0x7fe370151a50 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46388/0 (socket says 172.21.15.45:46388) 2023-12-08T08:18:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 -- 172.21.15.45:0/1595950242 learned_addr learned my addr 172.21.15.45:0/1595950242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe376119640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe3701e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe37691a640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe370151a50 0x7fe3701ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 -- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe370151a50 msgr2=0x7fe3701ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe370151a50 0x7fe3701ed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 -- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 msgr2=0x7fe3701e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe3701e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe375918640 1 -- 172.21.15.45:0/1595950242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009400 con 0x7fe3700c8240 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.099+0000 7fe376119640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe3701e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe375918640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c03c620 con 0x7fe3700c8240 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c03c7a0 con 0x7fe3700c8240 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3701585d0 con 0x7fe3700c8240 2023-12-08T08:18:41.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c03cb50 con 0x7fe3700c8240 2023-12-08T08:18:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.100+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3700a9b40 con 0x7fe3700c8240 2023-12-08T08:18:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.101+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3700678c0 con 0x7fe3700c8240 2023-12-08T08:18:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.103+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe36c039070 con 0x7fe3700c8240 2023-12-08T08:18:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.103+0000 7fe366ffd640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 0x7fe35406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.104+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fe36c0aad80 con 0x7fe3700c8240 2023-12-08T08:18:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.104+0000 7fe376119640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 0x7fe35406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.105+0000 7fe376119640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 0x7fe35406d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3600011e0 tx=0x7fe360009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.108+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe36c075df0 con 0x7fe3700c8240 2023-12-08T08:18:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.309+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3700c26b0 con 0x7fe3700c8240 2023-12-08T08:18:41.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.848+0000 7fe366ffd640 1 -- 172.21.15.45:0/1595950242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v71) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe36c04a0d0 con 0x7fe3700c8240 2023-12-08T08:18:41.851 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' removed 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 msgr2=0x7fe35406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 0x7fe35406d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3600011e0 tx=0x7fe360009040 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 msgr2=0x7fe3701e7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 shutdown_connections 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe35406ae40 0x7fe35406d300 secure :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3600011e0 tx=0x7fe360009040 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe370151a50 0x7fe3701ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3700c8240 0x7fe3701e7270 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 --2- 172.21.15.45:0/1595950242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3700c7b10 0x7fe3701e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.853+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 >> 172.21.15.45:0/1595950242 conn(0x7fe37006b850 msgr2=0x7fe3700bcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.855+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 shutdown_connections 2023-12-08T08:18:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:41.856+0000 7fe37711b640 1 -- 172.21.15.45:0/1595950242 wait complete. 2023-12-08T08:18:41.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:18:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.105+0000 7faf81685640 1 Processor -- start 2023-12-08T08:18:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.105+0000 7faf81685640 1 -- start start 2023-12-08T08:18:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf81685640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf7c151ad0 0x7faf7c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf81685640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf81685640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c151eb0 con 0x7faf7c0ca610 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf81685640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0c56a0 con 0x7faf7c151ad0 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf81685640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0c80d0 con 0x7faf7c157a20 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.107+0000 7faf73fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf73fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:39582/0 (socket says 172.21.15.45:39582) 2023-12-08T08:18:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf73fff640 1 -- 172.21.15.45:0/1501405338 learned_addr learned my addr 172.21.15.45:0/1501405338 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf7bfff640 1 --2- 172.21.15.45:0/1501405338 >> v2:172.21.15.114:3300/0 conn(0x7faf7c151ad0 0x7faf7c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf7b7fe640 1 -- 172.21.15.45:0/1501405338 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616940774 0 0) 0x7faf7c151eb0 con 0x7faf7c0ca610 2023-12-08T08:18:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf7b7fe640 1 -- 172.21.15.45:0/1501405338 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf68003520 con 0x7faf7c0ca610 2023-12-08T08:18:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf73fff640 1 -- 172.21.15.45:0/1501405338 >> v2:172.21.15.114:3300/0 conn(0x7faf7c151ad0 msgr2=0x7faf7c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.108+0000 7faf73fff640 1 --2- 172.21.15.45:0/1501405338 >> v2:172.21.15.114:3300/0 conn(0x7faf7c151ad0 0x7faf7c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.109+0000 7faf73fff640 1 -- 172.21.15.45:0/1501405338 >> v1:172.21.15.114:6789/0 conn(0x7faf7c0ca610 legacy=0x7faf7c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.109+0000 7faf73fff640 1 -- 172.21.15.45:0/1501405338 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c154430 con 0x7faf7c157a20 2023-12-08T08:18:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.110+0000 7faf73fff640 1 --2- 172.21.15.45:0/1501405338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf64009870 tx=0x7faf6402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43954e427035b0ff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.110+0000 7faf7b7fe640 1 -- 172.21.15.45:0/1501405338 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64030840 con 0x7faf7c157a20 2023-12-08T08:18:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf7b7fe640 1 -- 172.21.15.45:0/1501405338 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640309a0 con 0x7faf7c157a20 2023-12-08T08:18:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf7b7fe640 1 -- 172.21.15.45:0/1501405338 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64030d30 con 0x7faf7c157a20 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 -- 172.21.15.45:0/1501405338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 msgr2=0x7faf7c154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 --2- 172.21.15.45:0/1501405338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf64009870 tx=0x7faf6402b980 comp rx=0 tx=0).stop 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 -- 172.21.15.45:0/1501405338 shutdown_connections 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 --2- 172.21.15.45:0/1501405338 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c157a20 0x7faf7c154930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 --2- 172.21.15.45:0/1501405338 >> v2:172.21.15.114:3300/0 conn(0x7faf7c151ad0 0x7faf7c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 -- 172.21.15.45:0/1501405338 >> 172.21.15.45:0/1501405338 conn(0x7faf7c066610 msgr2=0x7faf7c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 -- 172.21.15.45:0/1501405338 shutdown_connections 2023-12-08T08:18:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.111+0000 7faf81685640 1 -- 172.21.15.45:0/1501405338 wait complete. 2023-12-08T08:18:42.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.113+0000 7faf81685640 1 Processor -- start 2023-12-08T08:18:42.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.113+0000 7faf81685640 1 -- start start 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c0ca610 0x7faf7c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf7c157a20 0x7faf7c1ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c14f420 con 0x7faf7c151ad0 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c150380 con 0x7faf7c157a20 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.114+0000 7faf81685640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c14c220 con 0x7faf7c0ca610 2023-12-08T08:18:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46404/0 (socket says 172.21.15.45:46404) 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 -- 172.21.15.45:0/3454827771 learned_addr learned my addr 172.21.15.45:0/3454827771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf7bfff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c0ca610 0x7faf7c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 -- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c0ca610 msgr2=0x7faf7c150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c0ca610 0x7faf7c150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 -- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf7c157a20 msgr2=0x7faf7c1ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf80e84640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf7c157a20 0x7faf7c1ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf7c157a20 0x7faf7c1ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 -- 172.21.15.45:0/3454827771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640094d0 con 0x7faf7c151ad0 2023-12-08T08:18:42.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.115+0000 7faf73fff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7faf64000c00 tx=0x7faf64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.116+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64039a90 con 0x7faf7c151ad0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.116+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf64039c10 con 0x7faf7c151ad0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.116+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64043410 con 0x7faf7c151ad0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.116+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c14c500 con 0x7faf7c151ad0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.116+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c14c760 con 0x7faf7c151ad0 2023-12-08T08:18:42.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.117+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c14c080 con 0x7faf7c151ad0 2023-12-08T08:18:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.118+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf6402f390 con 0x7faf7c151ad0 2023-12-08T08:18:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.119+0000 7faf797fa640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 0x7faf5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.119+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7faf640ab510 con 0x7faf7c151ad0 2023-12-08T08:18:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.119+0000 7faf7bfff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 0x7faf5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.120+0000 7faf7bfff640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 0x7faf5c06d300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009fd0 tx=0x7faf6c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.123+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf7c14c080 con 0x7faf7c151ad0 2023-12-08T08:18:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.317+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faf7c14c080 con 0x7faf7c151ad0 2023-12-08T08:18:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.324+0000 7faf797fa640 1 -- 172.21.15.45:0/3454827771 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf7c14c080 con 0x7faf7c151ad0 2023-12-08T08:18:42.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 msgr2=0x7faf5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 0x7faf5c06d300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009fd0 tx=0x7faf6c00b040 comp rx=0 tx=0).stop 2023-12-08T08:18:42.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 msgr2=0x7faf7c1ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7faf64000c00 tx=0x7faf64004730 comp rx=0 tx=0).stop 2023-12-08T08:18:42.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 shutdown_connections 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7faf5c06ae40 0x7faf5c06d300 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf7c157a20 0x7faf7c1ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf7c151ad0 0x7faf7c1ed3d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 --2- 172.21.15.45:0/3454827771 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7faf7c0ca610 0x7faf7c150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.327+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 >> 172.21.15.45:0/3454827771 conn(0x7faf7c066610 msgr2=0x7faf7c0c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.328+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 shutdown_connections 2023-12-08T08:18:42.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.328+0000 7faf81685640 1 -- 172.21.15.45:0/3454827771 wait complete. 2023-12-08T08:18:42.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-08T08:18:42.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.567+0000 7fd01a7db640 1 Processor -- start 2023-12-08T08:18:42.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.567+0000 7fd01a7db640 1 -- start start 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.568+0000 7fd01a7db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0141519c0 0x7fd0141584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd01a7db640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0140c7a50 0x7fd0140ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd01a7db640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0140c4a00 con 0x7fd0140c44d0 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd01a7db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0140c4ce0 con 0x7fd0141519c0 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd01a7db640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141579e0 con 0x7fd0140c7a50 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0141519c0 0x7fd0141584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0141519c0 0x7fd0141584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46410/0 (socket says 172.21.15.45:46410) 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 -- 172.21.15.45:0/4126629724 learned_addr learned my addr 172.21.15.45:0/4126629724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd019fda640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0140c7a50 0x7fd0140ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 -- 172.21.15.45:0/4126629724 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0140c7a50 msgr2=0x7fd0140ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0140c7a50 0x7fd0140ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 -- 172.21.15.45:0/4126629724 >> v1:172.21.15.114:6789/0 conn(0x7fd0140c44d0 legacy=0x7fd014154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.569+0000 7fd0197d9640 1 -- 172.21.15.45:0/4126629724 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014157cc0 con 0x7fd0141519c0 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd0197d9640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0141519c0 0x7fd0141584c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd010009870 tx=0x7fd01002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549c8c5a911d38c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd00bfff640 1 -- 172.21.15.45:0/4126629724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100317c0 con 0x7fd0141519c0 2023-12-08T08:18:42.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd00bfff640 1 -- 172.21.15.45:0/4126629724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010031920 con 0x7fd0141519c0 2023-12-08T08:18:42.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd00bfff640 1 -- 172.21.15.45:0/4126629724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010031cb0 con 0x7fd0141519c0 2023-12-08T08:18:42.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd01a7db640 1 -- 172.21.15.45:0/4126629724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0141519c0 msgr2=0x7fd0141584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.571+0000 7fd01a7db640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0141519c0 0x7fd0141584c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd010009870 tx=0x7fd01002b860 comp rx=0 tx=0).stop 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 -- 172.21.15.45:0/4126629724 shutdown_connections 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0140c7a50 0x7fd0140ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 --2- 172.21.15.45:0/4126629724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0141519c0 0x7fd0141584c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 -- 172.21.15.45:0/4126629724 >> 172.21.15.45:0/4126629724 conn(0x7fd0140661f0 msgr2=0x7fd014066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 -- 172.21.15.45:0/4126629724 shutdown_connections 2023-12-08T08:18:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.572+0000 7fd01a7db640 1 -- 172.21.15.45:0/4126629724 wait complete. 2023-12-08T08:18:42.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.573+0000 7fd01a7db640 1 Processor -- start 2023-12-08T08:18:42.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.573+0000 7fd01a7db640 1 -- start start 2023-12-08T08:18:42.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 0x7fd0141e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 0x7fd014150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141ea580 con 0x7fd0140c7a50 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141ea860 con 0x7fd0140c44d0 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.574+0000 7fd01a7db640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0141eab40 con 0x7fd0141519c0 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46416/0 (socket says 172.21.15.45:46416) 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 -- 172.21.15.45:0/1872942796 learned_addr learned my addr 172.21.15.45:0/1872942796 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd0197d9640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 0x7fd0141e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd019fda640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 0x7fd014150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 -- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 msgr2=0x7fd014150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 0x7fd014150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 -- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 msgr2=0x7fd0141e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 0x7fd0141e9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd018fd8640 1 -- 172.21.15.45:0/1872942796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0100094d0 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd0197d9640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 0x7fd0141e9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.575+0000 7fd019fda640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 0x7fd014150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd018fd8640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b3f0 tx=0x7fd00400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004011830 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004011990 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004011d40 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0141eae20 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.576+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140ab6d0 con 0x7fd0140c7a50 2023-12-08T08:18:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.577+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0140a98d0 con 0x7fd0140c7a50 2023-12-08T08:18:42.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.578+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd00401a400 con 0x7fd0140c7a50 2023-12-08T08:18:42.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.579+0000 7fd009ffb640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 0x7fcff806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.579+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd004089320 con 0x7fd0140c7a50 2023-12-08T08:18:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.579+0000 7fd0197d9640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 0x7fcff806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.580+0000 7fd0197d9640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 0x7fcff806d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd010036000 tx=0x7fd01003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.584+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0140a98d0 con 0x7fd0140c7a50 2023-12-08T08:18:42.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:42.849+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fd0140a98d0 con 0x7fd0140c7a50 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.854+0000 7fd009ffb640 1 -- 172.21.15.45:0/1872942796 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v224) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd0140a98d0 con 0x7fd0140c7a50 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.858+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 msgr2=0x7fcff806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.858+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 0x7fcff806d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd010036000 tx=0x7fd01003d040 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 msgr2=0x7fd01414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b3f0 tx=0x7fd00400b8b0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 shutdown_connections 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcff806ae40 0x7fcff806d300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd0141519c0 0x7fd014150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0140c7a50 0x7fd01414a920 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 --2- 172.21.15.45:0/1872942796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0140c44d0 0x7fd0141e9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 >> 172.21.15.45:0/1872942796 conn(0x7fd0140661f0 msgr2=0x7fd0141528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 shutdown_connections 2023-12-08T08:18:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:43.859+0000 7fd01a7db640 1 -- 172.21.15.45:0/1872942796 wait complete. 2023-12-08T08:18:43.886 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-08T08:18:43.886 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:18:43.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.113+0000 7f01c292e640 1 Processor -- start 2023-12-08T08:18:44.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.113+0000 7f01c292e640 1 -- start start 2023-12-08T08:18:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c292e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01bc0a7910 0x7f01bc0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c292e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c292e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc155850 con 0x7f01bc1521b0 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c292e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc0c0890 con 0x7f01bc0a7910 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c292e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0c0b70 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.115+0000 7f01c112b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:39608/0 (socket says 172.21.15.45:39608) 2023-12-08T08:18:44.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 -- 172.21.15.45:0/199141040 learned_addr learned my addr 172.21.15.45:0/199141040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c192c640 1 --2- 172.21.15.45:0/199141040 >> v2:172.21.15.114:3300/0 conn(0x7f01bc0a7910 0x7f01bc0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 -- 172.21.15.45:0/199141040 >> v2:172.21.15.114:3300/0 conn(0x7f01bc0a7910 msgr2=0x7f01bc0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 --2- 172.21.15.45:0/199141040 >> v2:172.21.15.114:3300/0 conn(0x7f01bc0a7910 0x7f01bc0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 -- 172.21.15.45:0/199141040 >> v1:172.21.15.114:6789/0 conn(0x7f01bc1521b0 legacy=0x7f01bc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.116+0000 7f01c112b640 1 -- 172.21.15.45:0/199141040 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0c0e50 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.118+0000 7f01c112b640 1 --2- 172.21.15.45:0/199141040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009870 tx=0x7f01ac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37cb229b13a8863 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.118+0000 7f01c092a640 1 -- 172.21.15.45:0/199141040 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac031640 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.118+0000 7f01c092a640 1 -- 172.21.15.45:0/199141040 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac0317a0 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.118+0000 7f01c092a640 1 -- 172.21.15.45:0/199141040 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac031b30 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 -- 172.21.15.45:0/199141040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 msgr2=0x7f01bc14f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 --2- 172.21.15.45:0/199141040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009870 tx=0x7f01ac02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 -- 172.21.15.45:0/199141040 shutdown_connections 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 --2- 172.21.15.45:0/199141040 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0c1dc0 0x7f01bc14f5e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 --2- 172.21.15.45:0/199141040 >> v2:172.21.15.114:3300/0 conn(0x7f01bc0a7910 0x7f01bc0c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 -- 172.21.15.45:0/199141040 >> 172.21.15.45:0/199141040 conn(0x7f01bc0c5780 msgr2=0x7f01bc0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 -- 172.21.15.45:0/199141040 shutdown_connections 2023-12-08T08:18:44.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.119+0000 7f01c292e640 1 -- 172.21.15.45:0/199141040 wait complete. 2023-12-08T08:18:44.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.121+0000 7f01c292e640 1 Processor -- start 2023-12-08T08:18:44.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.121+0000 7f01c292e640 1 -- start start 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0a7910 0x7f01bc0be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01bc0c1dc0 0x7f01bc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0bdd60 con 0x7f01bc1521b0 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0bedd0 con 0x7f01bc0c1dc0 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c292e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0bab90 con 0x7f01bc0a7910 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c212d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c212d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46418/0 (socket says 172.21.15.45:46418) 2023-12-08T08:18:44.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.122+0000 7f01c212d640 1 -- 172.21.15.45:0/815604540 learned_addr learned my addr 172.21.15.45:0/815604540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c192c640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0a7910 0x7f01bc0be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c112b640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01bc0c1dc0 0x7f01bc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 -- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0a7910 msgr2=0x7f01bc0be890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0a7910 0x7f01bc0be890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 -- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01bc0c1dc0 msgr2=0x7f01bc14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01bc0c1dc0 0x7f01bc14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 -- 172.21.15.45:0/815604540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0094d0 con 0x7f01bc1521b0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c212d640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f01b400c6f0 tx=0x7f01b400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4003970 con 0x7f01bc1521b0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4003ad0 con 0x7f01bc1521b0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.123+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc1eb080 con 0x7f01bc1521b0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.124+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4003e80 con 0x7f01bc1521b0 2023-12-08T08:18:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.124+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc1eb320 con 0x7f01bc1521b0 2023-12-08T08:18:44.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.125+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc1eb510 con 0x7f01bc1521b0 2023-12-08T08:18:44.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.126+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01b400a850 con 0x7f01bc1521b0 2023-12-08T08:18:44.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.127+0000 7f01b27fc640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 0x7f01a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.127+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f01b4089280 con 0x7f01bc1521b0 2023-12-08T08:18:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.127+0000 7f01c192c640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 0x7f01a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.128+0000 7f01c192c640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 0x7f01a006d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009a30 tx=0x7f01b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.131+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01b4054480 con 0x7f01bc1521b0 2023-12-08T08:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.326+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01bc0743e0 con 0x7f01bc1521b0 2023-12-08T08:18:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.328+0000 7f01b27fc640 1 -- 172.21.15.45:0/815604540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+13294 (secure 0 0 0) 0x7f01b4057aa0 con 0x7f01bc1521b0 2023-12-08T08:18:44.331 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:44.331 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":71,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:41.839784+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879788882":"2023-12-09T08:18:38.543637+0000","172.21.15.45:6834/1879788882":"2023-12-09T08:18:38.543637+0000","172.21.15.45:6837/63008111":"2023-12-09T08:18:30.374972+0000","172.21.15.45:6836/63008111":"2023-12-09T08:18:30.374972+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 msgr2=0x7f01a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 0x7f01a006d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009a30 tx=0x7f01b8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 msgr2=0x7f01bc1eb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f01b400c6f0 tx=0x7f01b400cbb0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 shutdown_connections 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f01a006ae40 0x7f01a006d300 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01bc1521b0 0x7f01bc1eb840 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01bc0c1dc0 0x7f01bc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 --2- 172.21.15.45:0/815604540 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01bc0a7910 0x7f01bc0be890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 >> 172.21.15.45:0/815604540 conn(0x7f01bc0c5780 msgr2=0x7f01bc153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.331+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 shutdown_connections 2023-12-08T08:18:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.332+0000 7f01c292e640 1 -- 172.21.15.45:0/815604540 wait complete. 2023-12-08T08:18:44.353 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:44.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.571+0000 7ff823fff640 1 Processor -- start 2023-12-08T08:18:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.571+0000 7ff823fff640 1 -- start start 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff823fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff824155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff823fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff824073f80 con 0x7ff82414f880 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff823fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240abd80 con 0x7ff824152140 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff823fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240ac060 con 0x7ff8240a93d0 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff822ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff82414f880 0x7ff8240c2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33886/0 (socket says 172.21.15.45:33886) 2023-12-08T08:18:44.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff822ffd640 1 -- 172.21.15.45:0/766667834 learned_addr learned my addr 172.21.15.45:0/766667834 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.573+0000 7ff81bfff640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff824155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880313620 0 0) 0x7ff824073f80 con 0x7ff82414f880 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff810003520 con 0x7ff82414f880 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358351102 0 0) 0x7ff810003520 con 0x7ff82414f880 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 msgr2=0x7ff824155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff824155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 >> v1:172.21.15.114:6789/0 conn(0x7ff824152140 legacy=0x7ff82415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824073ca0 con 0x7ff82414f880 2023-12-08T08:18:44.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ff814001670 con 0x7ff82414f880 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 >> v1:172.21.15.45:6789/0 conn(0x7ff82414f880 legacy=0x7ff8240c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff810003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff8100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff810004d00 0x7ff810005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240ac060 con 0x7ff8100039a0 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81000bb90 con 0x7ff810004d00 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.574+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81000bd50 con 0x7ff8240a93d0 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff810003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff81bfff640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff8100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 -- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 msgr2=0x7ff8100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff8100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff8237fe640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff810004d00 0x7ff810005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 -- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff810004d00 msgr2=0x7ff810005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff810004d00 0x7ff810005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff822ffd640 1 -- 172.21.15.45:0/766667834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810003520 con 0x7ff8100039a0 2023-12-08T08:18:44.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff8237fe640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff810004d00 0x7ff810005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:44.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.575+0000 7ff81bfff640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8240a93d0 0x7ff8100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.576+0000 7ff822ffd640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff810003dc0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c0e0 tx=0x7ff8100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23700f93165d6124 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814005ad0 con 0x7ff8100039a0 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814005c50 con 0x7ff8100039a0 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff8227fc640 1 -- 172.21.15.45:0/766667834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81402c7f0 con 0x7ff8100039a0 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 -- 172.21.15.45:0/766667834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 msgr2=0x7ff810003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 --2- 172.21.15.45:0/766667834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff810003dc0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c0e0 tx=0x7ff8100057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff8237fe640 1 -- 172.21.15.45:0/766667834 reap_dead start 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 -- 172.21.15.45:0/766667834 shutdown_connections 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 -- 172.21.15.45:0/766667834 >> 172.21.15.45:0/766667834 conn(0x7ff82406a4c0 msgr2=0x7ff82406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 -- 172.21.15.45:0/766667834 shutdown_connections 2023-12-08T08:18:44.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.577+0000 7ff823fff640 1 -- 172.21.15.45:0/766667834 wait complete. 2023-12-08T08:18:44.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.579+0000 7ff823fff640 1 Processor -- start 2023-12-08T08:18:44.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.579+0000 7ff823fff640 1 -- start start 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff824143c30 0x7ff824145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 0x7ff8240c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824145aa0 con 0x7ff8100039a0 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8241edf30 con 0x7ff8240c0dd0 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff823fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff824144810 con 0x7ff824143c30 2023-12-08T08:18:44.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.580+0000 7ff822ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46430/0 (socket says 172.21.15.45:46430) 2023-12-08T08:18:44.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 -- 172.21.15.45:0/461553519 learned_addr learned my addr 172.21.15.45:0/461553519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff81bfff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff824143c30 0x7ff824145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff8237fe640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 0x7ff8240c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 -- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff824143c30 msgr2=0x7ff824145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff824143c30 0x7ff824145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 -- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 msgr2=0x7ff8240c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 0x7ff8240c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 -- 172.21.15.45:0/461553519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8241ed690 con 0x7ff8100039a0 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff8237fe640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 0x7ff8240c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.581+0000 7ff822ffd640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c0e0 tx=0x7ff814001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.582+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814039070 con 0x7ff8100039a0 2023-12-08T08:18:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.582+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81402cc00 con 0x7ff8100039a0 2023-12-08T08:18:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.582+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81403c040 con 0x7ff8100039a0 2023-12-08T08:18:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.582+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8241ed970 con 0x7ff8100039a0 2023-12-08T08:18:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.582+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240c08b0 con 0x7ff8100039a0 2023-12-08T08:18:44.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.583+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8240c0a40 con 0x7ff8100039a0 2023-12-08T08:18:44.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.584+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff814032070 con 0x7ff8100039a0 2023-12-08T08:18:44.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.585+0000 7ff820ff9640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 0x7ff80406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.585+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff8140aa870 con 0x7ff8100039a0 2023-12-08T08:18:44.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.586+0000 7ff81bfff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 0x7ff80406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.586+0000 7ff81bfff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 0x7ff80406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0099c0 tx=0x7ff80c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.590+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff814075b10 con 0x7ff8100039a0 2023-12-08T08:18:44.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.787+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8240743e0 con 0x7ff8100039a0 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.788+0000 7ff820ff9640 1 -- 172.21.15.45:0/461553519 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff814079130 con 0x7ff8100039a0 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 msgr2=0x7ff80406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 0x7ff80406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0099c0 tx=0x7ff80c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 msgr2=0x7ff8241ed000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff81400c0e0 tx=0x7ff814001930 comp rx=0 tx=0).stop 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 shutdown_connections 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff80406ae40 0x7ff80406d300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff824143c30 0x7ff824145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8240c0dd0 0x7ff8240c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 --2- 172.21.15.45:0/461553519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8100039a0 0x7ff8241ed000 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.791+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 >> 172.21.15.45:0/461553519 conn(0x7ff82406a4c0 msgr2=0x7ff824155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.792+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 shutdown_connections 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:44.792+0000 7ff823fff640 1 -- 172.21.15.45:0/461553519 wait complete. 2023-12-08T08:18:44.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-08T08:18:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.040+0000 7f7dff59e640 1 Processor -- start 2023-12-08T08:18:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.040+0000 7f7dff59e640 1 -- start start 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dff59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7e00151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dff59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00151ea0 con 0x7f7e000c1670 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dff59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00154850 con 0x7f7e000c1210 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dff59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0014ec20 con 0x7f7e0014e840 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dfed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7e000c1670 0x7f7e000aa590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35136/0 (socket says 172.21.15.45:35136) 2023-12-08T08:18:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.041+0000 7f7dfed9d640 1 -- 172.21.15.45:0/111538919 learned_addr learned my addr 172.21.15.45:0/111538919 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7e00151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291596534 0 0) 0x7f7e00151ea0 con 0x7f7e000c1670 2023-12-08T08:18:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dec003520 con 0x7f7e000c1670 2023-12-08T08:18:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147102437 0 0) 0x7f7dec003520 con 0x7f7e000c1670 2023-12-08T08:18:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 msgr2=0x7f7e00151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7e00151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 >> v1:172.21.15.114:6789/0 conn(0x7f7e000c1210 legacy=0x7f7e000a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00154b30 con 0x7f7e000c1670 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.042+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f7df8001670 con 0x7f7e000c1670 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 >> v1:172.21.15.45:6789/0 conn(0x7f7e000c1670 legacy=0x7f7e000aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec0039a0 0x7f7dec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7dec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dec004d00 0x7f7dec005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0014ec20 con 0x7f7dec0039a0 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec00bb90 con 0x7f7dec004d00 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec00bd50 con 0x7f7e0014e840 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec0039a0 0x7f7dec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 -- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 msgr2=0x7f7dec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfdd9b640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7dec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfed9d640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dec004d00 0x7f7dec005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7e0014e840 0x7f7dec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 -- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dec004d00 msgr2=0x7f7dec005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dec004d00 0x7f7dec005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.043+0000 7f7dfe59c640 1 -- 172.21.15.45:0/111538919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec003520 con 0x7f7dec0039a0 2023-12-08T08:18:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.044+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec0039a0 0x7f7dec003dc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ac0 tx=0x7f7dec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78c0042d29d77e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df002c6b0 con 0x7f7dec0039a0 2023-12-08T08:18:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df002c810 con 0x7f7dec0039a0 2023-12-08T08:18:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dfd59a640 1 -- 172.21.15.45:0/111538919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df002cba0 con 0x7f7dec0039a0 2023-12-08T08:18:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dff59e640 1 -- 172.21.15.45:0/111538919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec0039a0 msgr2=0x7f7dec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dff59e640 1 --2- 172.21.15.45:0/111538919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec0039a0 0x7f7dec003dc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ac0 tx=0x7f7dec0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dfed9d640 1 -- 172.21.15.45:0/111538919 reap_dead start 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dff59e640 1 -- 172.21.15.45:0/111538919 shutdown_connections 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dff59e640 1 -- 172.21.15.45:0/111538919 >> 172.21.15.45:0/111538919 conn(0x7f7e000c5780 msgr2=0x7f7e000c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.045+0000 7f7dff59e640 1 -- 172.21.15.45:0/111538919 shutdown_connections 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.046+0000 7f7dff59e640 1 -- 172.21.15.45:0/111538919 wait complete. 2023-12-08T08:18:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.047+0000 7f7dff59e640 1 Processor -- start 2023-12-08T08:18:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.048+0000 7f7dff59e640 1 -- start start 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.048+0000 7f7dff59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 0x7f7e000ba720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.048+0000 7f7dff59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dff59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e001e7cb0 0x7f7e001ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dff59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000bfa20 con 0x7f7e00070a00 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dff59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001e7820 con 0x7f7e001e7cb0 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dff59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000bf740 con 0x7f7dec0039a0 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44402/0 (socket says 172.21.15.45:44402) 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 -- 172.21.15.45:0/3415119715 learned_addr learned my addr 172.21.15.45:0/3415119715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 0x7f7e000ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 -- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 msgr2=0x7f7e000ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 0x7f7e000ba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 -- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e001e7cb0 msgr2=0x7f7e001ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e001e7cb0 0x7f7e001ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfdd9b640 1 -- 172.21.15.45:0/3415119715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e001e71d0 con 0x7f7e00070a00 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.049+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 0x7f7e000ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7dfdd9b640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7de800d860 tx=0x7f7de800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de8003da0 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de800b6b0 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800ba40 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e001e74b0 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.050+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e000bf3a0 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.051+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e001e7030 con 0x7f7e00070a00 2023-12-08T08:18:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.052+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7de800bba0 con 0x7f7e00070a00 2023-12-08T08:18:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.053+0000 7f7df6ffd640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 0x7f7de006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.053+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7de80897a0 con 0x7f7e00070a00 2023-12-08T08:18:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.053+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 0x7f7de006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.054+0000 7f7dfe59c640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 0x7f7de006d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.057+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e001e7030 con 0x7f7e00070a00 2023-12-08T08:18:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.309+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f7e001e7030 con 0x7f7e00070a00 2023-12-08T08:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.859+0000 7f7df6ffd640 1 -- 172.21.15.45:0/3415119715 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v226) v1 ==== 162+0+0 (secure 0 0 0) 0x7f7e001e7030 con 0x7f7e00070a00 2023-12-08T08:18:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 msgr2=0x7f7de006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 0x7f7de006d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df0030000 comp rx=0 tx=0).stop 2023-12-08T08:18:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 msgr2=0x7f7e00151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7de800d860 tx=0x7f7de800dd20 comp rx=0 tx=0).stop 2023-12-08T08:18:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 shutdown_connections 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7de006ae40 0x7f7de006d300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e001e7cb0 0x7f7e001ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e00070a00 0x7f7e00151220 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 --2- 172.21.15.45:0/3415119715 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7dec0039a0 0x7f7e000ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.864+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 >> 172.21.15.45:0/3415119715 conn(0x7f7e000c5780 msgr2=0x7f7e000c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.865+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 shutdown_connections 2023-12-08T08:18:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:45.865+0000 7f7dff59e640 1 -- 172.21.15.45:0/3415119715 wait complete. 2023-12-08T08:18:45.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:18:46.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.122+0000 7f63ae154640 1 Processor -- start 2023-12-08T08:18:46.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.123+0000 7f63ae154640 1 -- start start 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 0x7f63a81562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 0x7f63a80aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a806ce10 0x7f63a8152150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80c2030 con 0x7f63a806ce10 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a806d660 con 0x7f63a80aaba0 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.124+0000 7f63ae154640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a806d940 con 0x7f63a80c4910 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a806ce10 0x7f63a8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a806ce10 0x7f63a8152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44414/0 (socket says 172.21.15.45:44414) 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 -- 172.21.15.45:0/3388147220 learned_addr learned my addr 172.21.15.45:0/3388147220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:46.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ac951640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 0x7f63a80aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad152640 1 --2- 172.21.15.45:0/3388147220 >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 0x7f63a81562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 -- 172.21.15.45:0/3388147220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 msgr2=0x7f63a80aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 0x7f63a80aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 -- 172.21.15.45:0/3388147220 >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 msgr2=0x7f63a81562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 --2- 172.21.15.45:0/3388147220 >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 0x7f63a81562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad953640 1 -- 172.21.15.45:0/3388147220 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a81557e0 con 0x7f63a806ce10 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ad152640 1 --2- 172.21.15.45:0/3388147220 >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 0x7f63a81562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.125+0000 7f63ac951640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 0x7f63a80aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.126+0000 7f63ad953640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a806ce10 0x7f63a8152150 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f63a806dbe0 tx=0x7f63a002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61874db66e1860c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f639ffff640 1 -- 172.21.15.45:0/3388147220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a002c9f0 con 0x7f63a806ce10 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f639ffff640 1 -- 172.21.15.45:0/3388147220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a002cb50 con 0x7f63a806ce10 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f639ffff640 1 -- 172.21.15.45:0/3388147220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00343f0 con 0x7f63a806ce10 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 -- 172.21.15.45:0/3388147220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a806ce10 msgr2=0x7f63a8152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a806ce10 0x7f63a8152150 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f63a806dbe0 tx=0x7f63a002be50 comp rx=0 tx=0).stop 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 -- 172.21.15.45:0/3388147220 shutdown_connections 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a806ce10 0x7f63a8152150 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 --2- 172.21.15.45:0/3388147220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80c4910 0x7f63a80aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 --2- 172.21.15.45:0/3388147220 >> v2:172.21.15.114:3300/0 conn(0x7f63a80aaba0 0x7f63a81562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 -- 172.21.15.45:0/3388147220 >> 172.21.15.45:0/3388147220 conn(0x7f63a80a7590 msgr2=0x7f63a80a79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 -- 172.21.15.45:0/3388147220 shutdown_connections 2023-12-08T08:18:46.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.127+0000 7f63ae154640 1 -- 172.21.15.45:0/3388147220 wait complete. 2023-12-08T08:18:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.129+0000 7f63ae154640 1 Processor -- start 2023-12-08T08:18:46.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.129+0000 7f63ae154640 1 -- start start 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a806ce10 0x7f63a8071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 0x7f63a81ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80ab400 con 0x7f63a80c4910 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8150280 con 0x7f63a806ce10 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ae154640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81504d0 con 0x7f63a80aaba0 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ad953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ad953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44420/0 (socket says 172.21.15.45:44420) 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.130+0000 7f63ad953640 1 -- 172.21.15.45:0/1171431211 learned_addr learned my addr 172.21.15.45:0/1171431211 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ac951640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 0x7f63a81ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad152640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a806ce10 0x7f63a8071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 -- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 msgr2=0x7f63a81ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 0x7f63a81ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 -- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a806ce10 msgr2=0x7f63a8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a806ce10 0x7f63a8071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 -- 172.21.15.45:0/1171431211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009b30 con 0x7f63a80c4910 2023-12-08T08:18:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ac951640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 0x7f63a81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f63ad953640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f63a0036040 tx=0x7f63a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.131+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0009510 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.132+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a003e450 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.132+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a003e800 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.132+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a81507b0 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.132+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a80721b0 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.133+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a81ed400 con 0x7f63a80c4910 2023-12-08T08:18:46.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.134+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63a003e960 con 0x7f63a80c4910 2023-12-08T08:18:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.135+0000 7f639dffb640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 0x7f638c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.135+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f63a00ac260 con 0x7f63a80c4910 2023-12-08T08:18:46.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.135+0000 7f63ad152640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 0x7f638c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.136+0000 7f63ad152640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 0x7f638c06d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63a4006fd0 tx=0x7f63a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.139+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63a0077460 con 0x7f63a80c4910 2023-12-08T08:18:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.323+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f63a80743e0 con 0x7f63a80c4910 2023-12-08T08:18:46.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.328+0000 7f639dffb640 1 -- 172.21.15.45:0/1171431211 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63a007aa80 con 0x7f63a80c4910 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 msgr2=0x7f638c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 0x7f638c06d330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63a4006fd0 tx=0x7f63a4008040 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 msgr2=0x7f63a81edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f63a0036040 tx=0x7f63a0004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 shutdown_connections 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f638c06ae70 0x7f638c06d330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63a80aaba0 0x7f63a81ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80c4910 0x7f63a81edaf0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 --2- 172.21.15.45:0/1171431211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a806ce10 0x7f63a8071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 >> 172.21.15.45:0/1171431211 conn(0x7f63a80a7590 msgr2=0x7f63a80a7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 shutdown_connections 2023-12-08T08:18:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.331+0000 7f63ae154640 1 -- 172.21.15.45:0/1171431211 wait complete. 2023-12-08T08:18:46.353 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:18:46.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:46.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:46.580 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:18:46.580 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:18:46.580 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:46.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:18:46.646 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:18:46.646 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:46.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:18:46.705 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-08T08:18:46.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.937+0000 7ff1f5f8a640 1 Processor -- start 2023-12-08T08:18:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.937+0000 7ff1f5f8a640 1 -- start start 2023-12-08T08:18:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.938+0000 7ff1f5f8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1f0153f90 0x7ff1f0156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.938+0000 7ff1f5f8a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f014c880 con 0x7ff1f00a4d10 2023-12-08T08:18:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.938+0000 7ff1f5f8a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f00c63b0 con 0x7ff1f014c4a0 2023-12-08T08:18:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.938+0000 7ff1f5f8a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f00c4730 con 0x7ff1f0153f90 2023-12-08T08:18:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1effff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1f0153f90 0x7ff1f0156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1eeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1f00a4d10 0x7ff1f0153880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35144/0 (socket says 172.21.15.45:35144) 2023-12-08T08:18:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1eeffd640 1 -- 172.21.15.45:0/2306870787 learned_addr learned my addr 172.21.15.45:0/2306870787 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:46.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1effff640 1 -- 172.21.15.45:0/2306870787 >> v1:172.21.15.114:6789/0 conn(0x7ff1f014c4a0 legacy=0x7ff1f0155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1effff640 1 -- 172.21.15.45:0/2306870787 >> v1:172.21.15.45:6789/0 conn(0x7ff1f00a4d10 legacy=0x7ff1f0153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.939+0000 7ff1effff640 1 -- 172.21.15.45:0/2306870787 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00a5210 con 0x7ff1f0153f90 2023-12-08T08:18:46.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.940+0000 7ff1effff640 1 --2- 172.21.15.45:0/2306870787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f0153f90 0x7ff1f0156490 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ae89cf42f967a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.940+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/2306870787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e802cbd0 con 0x7ff1f0153f90 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/2306870787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e802cd30 con 0x7ff1f0153f90 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/2306870787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e802cea0 con 0x7ff1f0153f90 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/2306870787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f0153f90 msgr2=0x7ff1f0156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/2306870787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f0153f90 0x7ff1f0156490 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009d90 tx=0x7ff1e802be20 comp rx=0 tx=0).stop 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/2306870787 shutdown_connections 2023-12-08T08:18:46.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/2306870787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f0153f90 0x7ff1f0156490 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/2306870787 >> 172.21.15.45:0/2306870787 conn(0x7ff1f00661f0 msgr2=0x7ff1f0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/2306870787 shutdown_connections 2023-12-08T08:18:46.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.941+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/2306870787 wait complete. 2023-12-08T08:18:46.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.943+0000 7ff1f5f8a640 1 Processor -- start 2023-12-08T08:18:46.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.943+0000 7ff1f5f8a640 1 -- start start 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1f014c4a0 0x7ff1f00a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1f0153f90 0x7ff1f01ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0141fb0 con 0x7ff1f00a4d10 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00c32c0 con 0x7ff1f0153f90 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1f5f8a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00c25c0 con 0x7ff1f014c4a0 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44436/0 (socket says 172.21.15.45:44436) 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.944+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/1588736194 learned_addr learned my addr 172.21.15.45:0/1588736194 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1f014c4a0 0x7ff1f00a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1effff640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1f0153f90 0x7ff1f01ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1f014c4a0 msgr2=0x7ff1f00a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1f014c4a0 0x7ff1f00a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1f0153f90 msgr2=0x7ff1f01ed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1f0153f90 0x7ff1f01ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/1588736194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e8009a70 con 0x7ff1f00a4d10 2023-12-08T08:18:46.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c430 tx=0x7ff1e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0011790 con 0x7ff1f00a4d10 2023-12-08T08:18:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00118f0 con 0x7ff1f00a4d10 2023-12-08T08:18:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0011ce0 con 0x7ff1f00a4d10 2023-12-08T08:18:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.945+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f01edc20 con 0x7ff1f00a4d10 2023-12-08T08:18:46.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.946+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f00a8d20 con 0x7ff1f00a4d10 2023-12-08T08:18:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.947+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f00c2aa0 con 0x7ff1f00a4d10 2023-12-08T08:18:46.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.948+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1e001c460 con 0x7ff1f00a4d10 2023-12-08T08:18:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.949+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.949+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff1e0089390 con 0x7ff1f00a4d10 2023-12-08T08:18:46.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.949+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.950+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 0x7ff1dc06d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00aad30 tx=0x7ff1e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:46.953+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1f00c2aa0 con 0x7ff1f00a4d10 2023-12-08T08:18:47.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.185+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1f006dc90 con 0x7ff1f00a4d10 2023-12-08T08:18:47.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.187+0000 7ff1d7fff640 1 -- 172.21.15.45:0/1588736194 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3702 (secure 0 0 0) 0x7ff1e0054630 con 0x7ff1f00a4d10 2023-12-08T08:18:47.190 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:47.190 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/3037839172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3037839172},{"type":"v1","addr":"172.21.15.114:6833","nonce":3037839172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":4931,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/276306384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":276306384},{"type":"v1","addr":"172.21.15.114:6835","nonce":276306384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6588,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1617058959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1617058959},{"type":"v1","addr":"172.21.15.45:6837","nonce":1617058959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6672,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3374586579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3374586579},{"type":"v1","addr":"172.21.15.45:6835","nonce":3374586579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[]} 2023-12-08T08:18:47.190 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-08T08:18:47.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 msgr2=0x7ff1dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 0x7ff1dc06d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00aad30 tx=0x7ff1e4009040 comp rx=0 tx=0).stop 2023-12-08T08:18:47.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 msgr2=0x7ff1f00c2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c430 tx=0x7ff1e000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 shutdown_connections 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff1f014c4a0 0x7ff1f00a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1f0153f90 0x7ff1f01ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 --2- 172.21.15.45:0/1588736194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f00a4d10 0x7ff1f00c2d80 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.189+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 >> 172.21.15.45:0/1588736194 conn(0x7ff1f00661f0 msgr2=0x7ff1f0148250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.190+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 shutdown_connections 2023-12-08T08:18:47.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.190+0000 7ff1f5f8a640 1 -- 172.21.15.45:0/1588736194 wait complete. 2023-12-08T08:18:47.212 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:18:47.213 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:18:47.213 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:18:47.213 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:47.213 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:18:47.213 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:18:47.213 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:18:47.213 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:47.214 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:18:47.214 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:18:47.214 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:18:47.214 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:47.214 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:18:47.214 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:18:47.214 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:18:47.215 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:47.232 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:18:47.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:18:47.235 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:18:47.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:18:47.236 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:18:47.236 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:18:47.245 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:18:47.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:18:47.284 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:18:47.284 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:47.292 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:18:47.292 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:47.293 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:18:47.294 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:47.301 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:18:47.302 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:47.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:18:47.451 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:18:47.452 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:18:47.459 INFO:tasks.ceph.mds.d.smithi114.stdout:starting mds.d at 2023-12-08T08:18:47.467 INFO:tasks.ceph.mds.b.smithi114.stdout:starting mds.b at 2023-12-08T08:18:47.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.494+0000 7f0087a7c640 1 Processor -- start 2023-12-08T08:18:47.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.494+0000 7f0087a7c640 1 -- start start 2023-12-08T08:18:47.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.495+0000 7f0087a7c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f00800c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.495+0000 7f0087a7c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00801528f0 con 0x7f00800a8ac0 2023-12-08T08:18:47.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.495+0000 7f0087a7c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0080153160 con 0x7f00800c4f00 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.495+0000 7f0087a7c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0080152ba0 con 0x7f00801536d0 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0085017640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f00800a8ac0 0x7f00800c40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35154/0 (socket says 172.21.15.45:35154) 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0085017640 1 -- 172.21.15.45:0/3181644636 learned_addr learned my addr 172.21.15.45:0/3181644636 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0086019640 1 --2- 172.21.15.45:0/3181644636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f00800c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744119226 0 0) 0x7f00801528f0 con 0x7f00800a8ac0 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003520 con 0x7f00800a8ac0 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541827134 0 0) 0x7f0080153160 con 0x7f00800c4f00 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00801528f0 con 0x7f00800c4f00 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0086019640 1 -- 172.21.15.45:0/3181644636 >> v1:172.21.15.114:6789/0 conn(0x7f00800c4f00 legacy=0x7f00801521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0086019640 1 -- 172.21.15.45:0/3181644636 >> v1:172.21.15.45:6789/0 conn(0x7f00800a8ac0 legacy=0x7f00800c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.496+0000 7f0086019640 1 -- 172.21.15.45:0/3181644636 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080152e80 con 0x7f00801536d0 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.498+0000 7f0086019640 1 --2- 172.21.15.45:0/3181644636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f00800c52e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0078009dc0 tx=0x7f007802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c7a34b6247a95 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.498+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007802cc30 con 0x7f00801536d0 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.498+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007802cd90 con 0x7f00801536d0 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.498+0000 7f0084816640 1 -- 172.21.15.45:0/3181644636 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078034660 con 0x7f00801536d0 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 -- 172.21.15.45:0/3181644636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 msgr2=0x7f00800c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 --2- 172.21.15.45:0/3181644636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f00800c52e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0078009dc0 tx=0x7f007802be80 comp rx=0 tx=0).stop 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 -- 172.21.15.45:0/3181644636 shutdown_connections 2023-12-08T08:18:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 --2- 172.21.15.45:0/3181644636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f00800c52e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 -- 172.21.15.45:0/3181644636 >> 172.21.15.45:0/3181644636 conn(0x7f0080066db0 msgr2=0x7f00800c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 -- 172.21.15.45:0/3181644636 shutdown_connections 2023-12-08T08:18:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.499+0000 7f0087a7c640 1 -- 172.21.15.45:0/3181644636 wait complete. 2023-12-08T08:18:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.501+0000 7f0087a7c640 1 Processor -- start 2023-12-08T08:18:47.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.501+0000 7f0087a7c640 1 -- start start 2023-12-08T08:18:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800c4f00 0x7f008014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f008014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014c930 con 0x7f00800a8ac0 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00801ebbe0 con 0x7f00800c4f00 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0087a7c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00801ec110 con 0x7f00801536d0 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0085818640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0085818640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44458/0 (socket says 172.21.15.45:44458) 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0085818640 1 -- 172.21.15.45:0/1586616745 learned_addr learned my addr 172.21.15.45:0/1586616745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0086019640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f008014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.502+0000 7f0085017640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800c4f00 0x7f008014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 -- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 msgr2=0x7f008014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f008014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 -- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800c4f00 msgr2=0x7f008014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800c4f00 0x7f008014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 -- 172.21.15.45:0/1586616745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009a70 con 0x7f00800a8ac0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0085818640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c460 tx=0x7f007c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0052d0 con 0x7f00800a8ac0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c005450 con 0x7f00800a8ac0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c012870 con 0x7f00800a8ac0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0080070190 con 0x7f00800a8ac0 2023-12-08T08:18:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.503+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008006feb0 con 0x7f00800a8ac0 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.504+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008014db10 con 0x7f00800a8ac0 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.505+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f007c0129d0 con 0x7f00800a8ac0 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.506+0000 7f00767fc640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 0x7f006406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.506+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f007c088f00 con 0x7f00800a8ac0 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.507+0000 7f0085017640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 0x7f006406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.507+0000 7f0085017640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 0x7f006406d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f00800a7040 tx=0x7f0070007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.511+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f007c054120 con 0x7f00800a8ac0 2023-12-08T08:18:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.719+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f00801ebe90 con 0x7f00800a8ac0 2023-12-08T08:18:47.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.887+0000 7f00767fc640 1 -- 172.21.15.45:0/1586616745 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f007c057740 con 0x7f00800a8ac0 2023-12-08T08:18:47.890 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 msgr2=0x7f006406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 0x7f006406d330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f00800a7040 tx=0x7f0070007d30 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 msgr2=0x7f0080155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f007c00c460 tx=0x7f007c00c920 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 shutdown_connections 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f006406ae70 0x7f006406d330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f00801536d0 0x7f008014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00800c4f00 0x7f008014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 --2- 172.21.15.45:0/1586616745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00800a8ac0 0x7f0080155570 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.891+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 >> 172.21.15.45:0/1586616745 conn(0x7f0080066db0 msgr2=0x7f0080154b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.892+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 shutdown_connections 2023-12-08T08:18:47.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:47.892+0000 7f0087a7c640 1 -- 172.21.15.45:0/1586616745 wait complete. 2023-12-08T08:18:47.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:18:48.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.124+0000 7f98dd79e640 1 Processor -- start 2023-12-08T08:18:48.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.125+0000 7f98dd79e640 1 -- start start 2023-12-08T08:18:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98dd79e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f98d814c4a0 0x7f98d8156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98dd79e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d814c880 con 0x7f98d80a4d10 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98dd79e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c63b0 con 0x7f98d8153880 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98dd79e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80c4730 con 0x7f98d814c4a0 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98d67fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98d80a4d10 0x7f98d8155980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35156/0 (socket says 172.21.15.45:35156) 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.126+0000 7f98d67fc640 1 -- 172.21.15.45:0/1311938188 learned_addr learned my addr 172.21.15.45:0/1311938188 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d6ffd640 1 --2- 172.21.15.45:0/1311938188 >> v2:172.21.15.114:3300/0 conn(0x7f98d814c4a0 0x7f98d8156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652838608 0 0) 0x7f98d814c880 con 0x7f98d80a4d10 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c4003520 con 0x7f98d80a4d10 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882825257 0 0) 0x7f98c4003520 con 0x7f98d80a4d10 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 >> v2:172.21.15.114:3300/0 conn(0x7f98d814c4a0 msgr2=0x7f98d8156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 --2- 172.21.15.45:0/1311938188 >> v2:172.21.15.114:3300/0 conn(0x7f98d814c4a0 0x7f98d8156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 >> v1:172.21.15.114:6789/0 conn(0x7f98d8153880 legacy=0x7f98d8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80a5210 con 0x7f98d80a4d10 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f98c00019f0 con 0x7f98d80a4d10 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 >> v1:172.21.15.45:6789/0 conn(0x7f98d80a4d10 legacy=0x7f98d8155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.127+0000 7f98d5ffb640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 0x7f98c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c4730 con 0x7f98c4005180 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c400c120 con 0x7f98c40047c0 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c400c2e0 con 0x7f98c4003970 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 0x7f98c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d6ffd640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d67fc640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 -- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98c4003970 msgr2=0x7f98c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 -- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c40047c0 msgr2=0x7f98c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.128+0000 7f98d77fe640 1 -- 172.21.15.45:0/1311938188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4003520 con 0x7f98c4005180 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.129+0000 7f98d77fe640 1 -- 172.21.15.45:0/1311938188 reap_dead start 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.129+0000 7f98d77fe640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 0x7f98c400b980 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f98d0001750 tx=0x7f98c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5216aff556d27e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00052d0 con 0x7f98c4005180 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d002e050 con 0x7f98c4005180 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98d5ffb640 1 -- 172.21.15.45:0/1311938188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00035f0 con 0x7f98c4005180 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 -- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 msgr2=0x7f98c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 0x7f98c400b980 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f98d0001750 tx=0x7f98c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 -- 172.21.15.45:0/1311938188 shutdown_connections 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 --2- 172.21.15.45:0/1311938188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c4005180 0x7f98c400b980 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 -- 172.21.15.45:0/1311938188 >> 172.21.15.45:0/1311938188 conn(0x7f98d80661f0 msgr2=0x7f98d8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 -- 172.21.15.45:0/1311938188 shutdown_connections 2023-12-08T08:18:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.130+0000 7f98dd79e640 1 -- 172.21.15.45:0/1311938188 wait complete. 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.132+0000 7f98dd79e640 1 Processor -- start 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.132+0000 7f98dd79e640 1 -- start start 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c4005180 0x7f98d8147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98d8071360 0x7f98d80a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8071c40 con 0x7f98d81ecdd0 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81495d0 con 0x7f98c4005180 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.133+0000 7f98dd79e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81ea7b0 con 0x7f98d8071360 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44476/0 (socket says 172.21.15.45:44476) 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 -- 172.21.15.45:0/951893984 learned_addr learned my addr 172.21.15.45:0/951893984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d6ffd640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c4005180 0x7f98d8147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d77fe640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98d8071360 0x7f98d80a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 -- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98d8071360 msgr2=0x7f98d80a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98d8071360 0x7f98d80a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 -- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c4005180 msgr2=0x7f98d8147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c4005180 0x7f98d8147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.134+0000 7f98d67fc640 1 -- 172.21.15.45:0/951893984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d81e9c30 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98d67fc640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f98c0007a50 tx=0x7f98c000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000ee50 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0013420 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00137d0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d81e9f10 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.135+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d81ea4d0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.136+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80a9ab0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.137+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98c0013930 con 0x7f98d81ecdd0 2023-12-08T08:18:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.138+0000 7f98cf7fe640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 0x7f98b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.138+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f98c0089c60 con 0x7f98d81ecdd0 2023-12-08T08:18:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.139+0000 7f98d6ffd640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 0x7f98b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.139+0000 7f98d6ffd640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 0x7f98b806d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009990 tx=0x7f98c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.143+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98c0054fb0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.404+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f98d806ccd0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.405+0000 7f98cf7fe640 1 -- 172.21.15.45:0/951893984 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f98c00585d0 con 0x7f98d81ecdd0 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJla7GwKRAABCs1sRB3k9+U2d+Nv+6Qsg==", 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlUl35EBAAKLS/fMIt6G9vqde16uAsoA==", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlkimAOhAARjxtAqp4aGMJAk9pQEuEcg==", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlhY+rIRAAOcH5Vdj4eehrPUQuDuwLRw==", 2023-12-08T08:18:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBN0HJlen9oARAAcqoG1WYSzpUAuVNvDa1mKg==", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBQ0HJlEsRmGxAAfml/gGZ8vfNzJsUlDsTbyg==", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBU0HJl+ct7CBAAEuBM0fSR04+8zaRtqq8k/g==", 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBX0HJlVnwVExAAFxt0oSVa42WXjwm+S9Ts6Q==", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBe0HJlqX4IGBAAoSzK53JRumPJ10WGo1EjYA==", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBh0HJlA6GSMRAAqOCPmn8QGJzAco8jgWd3zQ==", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBl0HJlXY8/ABAAXD0SJ5TMILJDA/sXMzLSRA==", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBo0HJlBOSzCRAA8e0cUSeNL2bCJyy587oT2Q==", 2023-12-08T08:18:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg==", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA==", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBI0HJlPJ/uHBAAJP4PeCgGIkF9JZ0ruG0wGQ==", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-08T08:18:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.testuser", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBG0XJlKw+UDhAAguTdKeOCvGpLJgVWoOamTA==", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow rw fsname=cephfs", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-08T08:18:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJl/rIKHRAAaJjZUtDXcmEgavGZvjHxow==", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBJ0HJlKZgvERAAL98Wtoye5tepo7AlBftDNg==", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:48.420 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-08T08:18:48.420 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:18:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.407+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 msgr2=0x7f98b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.407+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 0x7f98b806d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009990 tx=0x7f98c8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.407+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 msgr2=0x7f98d8070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.407+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f98c0007a50 tx=0x7f98c000e530 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 shutdown_connections 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f98b806ae40 0x7f98b806d300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f98d8071360 0x7f98d80a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98d81ecdd0 0x7f98d8070e20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 --2- 172.21.15.45:0/951893984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98c4005180 0x7f98d8147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 >> 172.21.15.45:0/951893984 conn(0x7f98d80661f0 msgr2=0x7f98d80665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 shutdown_connections 2023-12-08T08:18:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.408+0000 7f98dd79e640 1 -- 172.21.15.45:0/951893984 wait complete. 2023-12-08T08:18:48.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-08T08:18:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.646+0000 7f89a624b640 1 Processor -- start 2023-12-08T08:18:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.646+0000 7f89a624b640 1 -- start start 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.647+0000 7f89a624b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89a00c5600 0x7f89a006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a624b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a01521e0 con 0x7f89a00c50b0 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a624b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a01524c0 con 0x7f89a0155dd0 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a624b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0152b80 con 0x7f89a00c5600 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a4a48640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89a00c50b0 0x7f89a01556c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35158/0 (socket says 172.21.15.45:35158) 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a4a48640 1 -- 172.21.15.45:0/546616223 learned_addr learned my addr 172.21.15.45:0/546616223 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.648+0000 7f89a5249640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89a00c5600 0x7f89a006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713663075 0 0) 0x7f89a01521e0 con 0x7f89a00c50b0 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c003520 con 0x7f89a00c50b0 2023-12-08T08:18:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922197686 0 0) 0x7f898c003520 con 0x7f89a00c50b0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89a00c5600 msgr2=0x7f89a006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f89a00c5600 0x7f89a006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 >> v1:172.21.15.114:6789/0 conn(0x7f89a0155dd0 legacy=0x7f89a015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a01527a0 con 0x7f89a00c50b0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8990001670 con 0x7f89a00c50b0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 >> v1:172.21.15.45:6789/0 conn(0x7f89a00c50b0 legacy=0x7f89a01556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0039a0 0x7f898c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f898c0051f0 0x7f898c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0152b80 con 0x7f898c0047c0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00c100 con 0x7f898c0051f0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00c2c0 con 0x7f898c0039a0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.649+0000 7f89a4a48640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a5249640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0039a0 0x7f898c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a5a4a640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f898c0051f0 0x7f898c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a4a48640 1 -- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0039a0 msgr2=0x7f898c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a4a48640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0039a0 0x7f898c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a4a48640 1 -- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f898c0051f0 msgr2=0x7f898c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a4a48640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f898c0051f0 0x7f898c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a4a48640 1 -- 172.21.15.45:0/546616223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c003520 con 0x7f898c0047c0 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.650+0000 7f89a5a4a640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f898c0051f0 0x7f898c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.651+0000 7f89a4a48640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f899000c0e0 tx=0x7f898c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf99de613f495079 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990005ad0 con 0x7f898c0047c0 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990005c30 con 0x7f898c0047c0 2023-12-08T08:18:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f8997fff640 1 -- 172.21.15.45:0/546616223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899002c7d0 con 0x7f898c0047c0 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f89a624b640 1 -- 172.21.15.45:0/546616223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f898c0047c0 msgr2=0x7f898c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f89a624b640 1 --2- 172.21.15.45:0/546616223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f899000c0e0 tx=0x7f898c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f89a5a4a640 1 -- 172.21.15.45:0/546616223 reap_dead start 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f89a624b640 1 -- 172.21.15.45:0/546616223 shutdown_connections 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.652+0000 7f89a624b640 1 -- 172.21.15.45:0/546616223 >> 172.21.15.45:0/546616223 conn(0x7f89a00a7600 msgr2=0x7f89a00a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.653+0000 7f89a624b640 1 -- 172.21.15.45:0/546616223 shutdown_connections 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.653+0000 7f89a624b640 1 -- 172.21.15.45:0/546616223 wait complete. 2023-12-08T08:18:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.654+0000 7f89a624b640 1 Processor -- start 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.654+0000 7f89a624b640 1 -- start start 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0047c0 0x7f89a00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a01ea6b0 0x7f89a01dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01db670 con 0x7f89a014bdf0 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01ee0b0 con 0x7f89a01ea6b0 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.655+0000 7f89a624b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01ee540 con 0x7f898c0047c0 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44482/0 (socket says 172.21.15.45:44482) 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 -- 172.21.15.45:0/3738541207 learned_addr learned my addr 172.21.15.45:0/3738541207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a5249640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0047c0 0x7f89a00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a5a4a640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a01ea6b0 0x7f89a01dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 -- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0047c0 msgr2=0x7f89a00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0047c0 0x7f89a00a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 -- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a01ea6b0 msgr2=0x7f89a01dcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a01ea6b0 0x7f89a01dcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.656+0000 7f89a4a48640 1 -- 172.21.15.45:0/3738541207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a01ed780 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f89a4a48640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f899000c0e0 tx=0x7f89a01520d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990001670 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899002cc00 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990007070 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a01eda60 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.657+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a0072a80 con 0x7f89a014bdf0 2023-12-08T08:18:48.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.658+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a01ee1f0 con 0x7f89a014bdf0 2023-12-08T08:18:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.659+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8990032070 con 0x7f89a014bdf0 2023-12-08T08:18:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.660+0000 7f8995ffb640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.660+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f89900aa610 con 0x7f89a014bdf0 2023-12-08T08:18:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.661+0000 7f89a5249640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.661+0000 7f89a5249640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 0x7f898406d300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f89a00aae60 tx=0x7f899c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.665+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8990075960 con 0x7f89a014bdf0 2023-12-08T08:18:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.934+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f89a00c6760 con 0x7f89a014bdf0 2023-12-08T08:18:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.939+0000 7f8995ffb640 1 -- 172.21.15.45:0/3738541207 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v22) v1 ==== 85+0+0 (secure 0 0 0) 0x7f8990045020 con 0x7f89a014bdf0 2023-12-08T08:18:48.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.942+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 msgr2=0x7f898406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.942+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 0x7f898406d300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f89a00aae60 tx=0x7f899c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.942+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 msgr2=0x7f89a01ea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.942+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f899000c0e0 tx=0x7f89a01520d0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 shutdown_connections 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89a01ea6b0 0x7f89a01dcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a014bdf0 0x7f89a01ea170 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 --2- 172.21.15.45:0/3738541207 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f898c0047c0 0x7f89a00a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 >> 172.21.15.45:0/3738541207 conn(0x7f89a00a7600 msgr2=0x7f89a00a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 shutdown_connections 2023-12-08T08:18:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:48.943+0000 7f89a624b640 1 -- 172.21.15.45:0/3738541207 wait complete. 2023-12-08T08:18:48.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:49.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.178+0000 7fdceffff640 1 Processor -- start 2023-12-08T08:18:49.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.179+0000 7fdceffff640 1 -- start start 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.180+0000 7fdceffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdcf01519c0 0x7fdcf01584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.180+0000 7fdceffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00c4a00 con 0x7fdcf00c7a50 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.180+0000 7fdceffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00c4ce0 con 0x7fdcf00c44d0 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.180+0000 7fdceffff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf01579e0 con 0x7fdcf01519c0 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.181+0000 7fdcef7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdcf00c7a50 0x7fdcf00ab6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35160/0 (socket says 172.21.15.45:35160) 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.181+0000 7fdcef7fe640 1 -- 172.21.15.45:0/2057486713 learned_addr learned my addr 172.21.15.45:0/2057486713 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.181+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2057486713 >> v2:172.21.15.114:3300/0 conn(0x7fdcf01519c0 0x7fdcf01584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.181+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111322148 0 0) 0x7fdcf00c4a00 con 0x7fdcf00c7a50 2023-12-08T08:18:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.181+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc003520 con 0x7fdcf00c7a50 2023-12-08T08:18:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485643512 0 0) 0x7fdcdc003520 con 0x7fdcf00c7a50 2023-12-08T08:18:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 >> v2:172.21.15.114:3300/0 conn(0x7fdcf01519c0 msgr2=0x7fdcf01584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 --2- 172.21.15.45:0/2057486713 >> v2:172.21.15.114:3300/0 conn(0x7fdcf01519c0 0x7fdcf01584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 >> v1:172.21.15.114:6789/0 conn(0x7fdcf00c44d0 legacy=0x7fdcf0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0157cc0 con 0x7fdcf00c7a50 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdce80019f0 con 0x7fdcf00c7a50 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 >> v1:172.21.15.45:6789/0 conn(0x7fdcf00c7a50 legacy=0x7fdcf00ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 0x7fdcdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc0047c0 0x7fdcdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc0052a0 0x7fdcdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01579e0 con 0x7fdcdc003970 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00c170 con 0x7fdcdc0052a0 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00c330 con 0x7fdcdc0047c0 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 0x7fdcdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.182+0000 7fdcee7fc640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc0047c0 0x7fdcdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdcef7fe640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc0052a0 0x7fdcdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdceeffd640 1 -- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc0047c0 msgr2=0x7fdcdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcdc0047c0 0x7fdcdc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdceeffd640 1 -- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc0052a0 msgr2=0x7fdcdc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc0052a0 0x7fdcdc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdceeffd640 1 -- 172.21.15.45:0/2057486713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc003520 con 0x7fdcdc003970 2023-12-08T08:18:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdcef7fe640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc0052a0 0x7fdcdc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.183+0000 7fdcef7fe640 1 -- 172.21.15.45:0/2057486713 reap_dead start 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.184+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 0x7fdcdc003d90 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009a90 tx=0x7fdcdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f37e2a57f2492ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.184+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce002c680 con 0x7fdcdc003970 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.184+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce002c7e0 con 0x7fdcdc003970 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.184+0000 7fdcedffb640 1 -- 172.21.15.45:0/2057486713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce002cb70 con 0x7fdcdc003970 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 -- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 msgr2=0x7fdcdc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 0x7fdcdc003d90 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009a90 tx=0x7fdcdc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 -- 172.21.15.45:0/2057486713 shutdown_connections 2023-12-08T08:18:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 --2- 172.21.15.45:0/2057486713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcdc003970 0x7fdcdc003d90 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 -- 172.21.15.45:0/2057486713 >> 172.21.15.45:0/2057486713 conn(0x7fdcf00661f0 msgr2=0x7fdcf0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 -- 172.21.15.45:0/2057486713 shutdown_connections 2023-12-08T08:18:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.185+0000 7fdceffff640 1 -- 172.21.15.45:0/2057486713 wait complete. 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.187+0000 7fdceffff640 1 Processor -- start 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.187+0000 7fdceffff640 1 -- start start 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc003970 0x7fdcf014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcf00c0e30 0x7fdcf014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01ea880 con 0x7fdcf01ea310 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf014c7a0 con 0x7fdcdc003970 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdceffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf014d640 con 0x7fdcf00c0e30 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdcee7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdcee7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44496/0 (socket says 172.21.15.45:44496) 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.188+0000 7fdcee7fc640 1 -- 172.21.15.45:0/2374571702 learned_addr learned my addr 172.21.15.45:0/2374571702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcef7fe640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcf00c0e30 0x7fdcf014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc003970 0x7fdcf014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 -- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcf00c0e30 msgr2=0x7fdcf014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcf00c0e30 0x7fdcf014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 -- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc003970 msgr2=0x7fdcf014e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc003970 0x7fdcf014e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 -- 172.21.15.45:0/2374571702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf00c1410 con 0x7fdcf01ea310 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdcee7fc640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e4d0 tx=0x7fdcd800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80053a0 con 0x7fdcf01ea310 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd80035f0 con 0x7fdcf01ea310 2023-12-08T08:18:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8003980 con 0x7fdcf01ea310 2023-12-08T08:18:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf014be00 con 0x7fdcf01ea310 2023-12-08T08:18:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.189+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf014c3c0 con 0x7fdcf01ea310 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.190+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00743e0 con 0x7fdcf01ea310 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.191+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcd8003ae0 con 0x7fdcf01ea310 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.192+0000 7fdce77fe640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 0x7fdcd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.192+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdcd8089120 con 0x7fdcf01ea310 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.193+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 0x7fdcd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.193+0000 7fdceeffd640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 0x7fdcd006d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdce0036000 tx=0x7fdce0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.197+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdcd8054470 con 0x7fdcf01ea310 2023-12-08T08:18:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.386+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcf00c7190 con 0x7fdcf01ea310 2023-12-08T08:18:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.388+0000 7fdce77fe640 1 -- 172.21.15.45:0/2374571702 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+13039 (secure 0 0 0) 0x7fdcd8057a90 con 0x7fdcf01ea310 2023-12-08T08:18:49.391 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:49.391 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:47.900322+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 msgr2=0x7fdcd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 0x7fdcd006d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdce0036000 tx=0x7fdce0030000 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 msgr2=0x7fdcf014cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e4d0 tx=0x7fdcd800e990 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 shutdown_connections 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdcd006ae40 0x7fdcd006d300 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdcf00c0e30 0x7fdcf014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcf01ea310 0x7fdcf014cbc0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 --2- 172.21.15.45:0/2374571702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcdc003970 0x7fdcf014e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 >> 172.21.15.45:0/2374571702 conn(0x7fdcf00661f0 msgr2=0x7fdcf014f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 shutdown_connections 2023-12-08T08:18:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.391+0000 7fdceffff640 1 -- 172.21.15.45:0/2374571702 wait complete. 2023-12-08T08:18:49.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:18:49.413 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:49.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.636+0000 7fe6eda7e640 1 Processor -- start 2023-12-08T08:18:49.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.637+0000 7fe6eda7e640 1 -- start start 2023-12-08T08:18:49.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.638+0000 7fe6eda7e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6e80c59e0 0x7fe6e8158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.638+0000 7fe6eda7e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e80c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.638+0000 7fe6eda7e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80c51f0 con 0x7fe6e806bdd0 2023-12-08T08:18:49.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.638+0000 7fe6eda7e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80c1ce0 con 0x7fe6e80c59e0 2023-12-08T08:18:49.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.638+0000 7fe6eda7e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c54d0 con 0x7fe6e806d1d0 2023-12-08T08:18:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.639+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e80c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.639+0000 7fe6eca7c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6e80c59e0 0x7fe6e8158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.639+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e80c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:33446/0 (socket says 172.21.15.45:33446) 2023-12-08T08:18:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.639+0000 7fe6e7fff640 1 -- 172.21.15.45:0/504351595 learned_addr learned my addr 172.21.15.45:0/504351595 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.640+0000 7fe6eca7c640 1 -- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 msgr2=0x7fe6e80c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.640+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e80c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.640+0000 7fe6eca7c640 1 -- 172.21.15.45:0/504351595 >> v1:172.21.15.114:6789/0 conn(0x7fe6e806bdd0 legacy=0x7fe6e8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.640+0000 7fe6eca7c640 1 -- 172.21.15.45:0/504351595 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8157ba0 con 0x7fe6e80c59e0 2023-12-08T08:18:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.641+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e80c59e0 0x7fe6e8158680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097a0 tx=0x7fe6dc02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282a9092e449affe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6e77fe640 1 -- 172.21.15.45:0/504351595 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc030800 con 0x7fe6e80c59e0 2023-12-08T08:18:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6e77fe640 1 -- 172.21.15.45:0/504351595 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc030960 con 0x7fe6e80c59e0 2023-12-08T08:18:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6e77fe640 1 -- 172.21.15.45:0/504351595 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc030cf0 con 0x7fe6e80c59e0 2023-12-08T08:18:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 -- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e80c59e0 msgr2=0x7fe6e8158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e80c59e0 0x7fe6e8158680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0097a0 tx=0x7fe6dc02b940 comp rx=0 tx=0).stop 2023-12-08T08:18:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 -- 172.21.15.45:0/504351595 shutdown_connections 2023-12-08T08:18:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e80c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/504351595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e80c59e0 0x7fe6e8158680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 -- 172.21.15.45:0/504351595 >> 172.21.15.45:0/504351595 conn(0x7fe6e8066ce0 msgr2=0x7fe6e80a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.642+0000 7fe6eda7e640 1 -- 172.21.15.45:0/504351595 shutdown_connections 2023-12-08T08:18:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.643+0000 7fe6eda7e640 1 -- 172.21.15.45:0/504351595 wait complete. 2023-12-08T08:18:49.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.644+0000 7fe6eda7e640 1 Processor -- start 2023-12-08T08:18:49.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.644+0000 7fe6eda7e640 1 -- start start 2023-12-08T08:18:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 0x7fe6e8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8071420 con 0x7fe6e80c59e0 2023-12-08T08:18:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80a8930 con 0x7fe6e806bdd0 2023-12-08T08:18:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.645+0000 7fe6eda7e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8071960 con 0x7fe6e806d1d0 2023-12-08T08:18:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44512/0 (socket says 172.21.15.45:44512) 2023-12-08T08:18:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 -- 172.21.15.45:0/4141085635 learned_addr learned my addr 172.21.15.45:0/4141085635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6e7fff640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 0x7fe6e8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 -- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 msgr2=0x7fe6e8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 -- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 msgr2=0x7fe6e8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 0x7fe6e8070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6ed27d640 1 -- 172.21.15.45:0/4141085635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009400 con 0x7fe6e80c59e0 2023-12-08T08:18:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.646+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 0x7fe6e8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6ed27d640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c7a0 tx=0x7fe6e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0003b70 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e0003cf0 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0003ea0 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e8071c40 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.647+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8157210 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.648+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8072160 con 0x7fe6e80c59e0 2023-12-08T08:18:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.649+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6e000aa90 con 0x7fe6e80c59e0 2023-12-08T08:18:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.650+0000 7fe6e57fa640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.650+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe6e0089270 con 0x7fe6e80c59e0 2023-12-08T08:18:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.650+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.651+0000 7fe6eca7c640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 0x7fe6cc06d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.654+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6e8072160 con 0x7fe6e80c59e0 2023-12-08T08:18:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.852+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6e8072160 con 0x7fe6e80c59e0 2023-12-08T08:18:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.853+0000 7fe6e57fa640 1 -- 172.21.15.45:0/4141085635 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6e8072160 con 0x7fe6e80c59e0 2023-12-08T08:18:49.856 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.855+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 msgr2=0x7fe6cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.855+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 0x7fe6cc06d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc03b040 comp rx=0 tx=0).stop 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.855+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 msgr2=0x7fe6e81ecc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.855+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c7a0 tx=0x7fe6e000cc60 comp rx=0 tx=0).stop 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 shutdown_connections 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe6cc06ae40 0x7fe6cc06d300 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe6e806d1d0 0x7fe6e8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e80c59e0 0x7fe6e81ecc20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 --2- 172.21.15.45:0/4141085635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6e806bdd0 0x7fe6e8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 >> 172.21.15.45:0/4141085635 conn(0x7fe6e8066ce0 msgr2=0x7fe6e8154160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 shutdown_connections 2023-12-08T08:18:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:49.856+0000 7fe6eda7e640 1 -- 172.21.15.45:0/4141085635 wait complete. 2023-12-08T08:18:49.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:18:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.102+0000 7fafd4090640 1 Processor -- start 2023-12-08T08:18:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.102+0000 7fafd4090640 1 -- start start 2023-12-08T08:18:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd4090640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fafcc0ca0e0 0x7fafcc0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd4090640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0c4880 con 0x7fafcc14e800 2023-12-08T08:18:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd4090640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0c4b60 con 0x7fafcc1581c0 2023-12-08T08:18:50.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd4090640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc0c4e40 con 0x7fafcc0ca0e0 2023-12-08T08:18:50.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd1e2c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafcc14e800 0x7fafcc155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35164/0 (socket says 172.21.15.45:35164) 2023-12-08T08:18:50.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd1e2c640 1 -- 172.21.15.45:0/3133803120 learned_addr learned my addr 172.21.15.45:0/3133803120 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd162b640 1 --2- 172.21.15.45:0/3133803120 >> v2:172.21.15.114:3300/0 conn(0x7fafcc0ca0e0 0x7fafcc0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243613948 0 0) 0x7fafcc0c4880 con 0x7fafcc14e800 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.104+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb8003520 con 0x7fafcc14e800 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2627165150 0 0) 0x7fafb8003520 con 0x7fafcc14e800 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 >> v2:172.21.15.114:3300/0 conn(0x7fafcc0ca0e0 msgr2=0x7fafcc0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 --2- 172.21.15.45:0/3133803120 >> v2:172.21.15.114:3300/0 conn(0x7fafcc0ca0e0 0x7fafcc0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 >> v1:172.21.15.114:6789/0 conn(0x7fafcc1581c0 legacy=0x7fafcc15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc157ca0 con 0x7fafcc14e800 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fafc8001670 con 0x7fafcc14e800 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 >> v1:172.21.15.45:6789/0 conn(0x7fafcc14e800 legacy=0x7fafcc155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb8003970 0x7fafb8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb80047c0 0x7fafb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 0x7fafb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0c4e40 con 0x7fafb80052a0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c1f0 con 0x7fafb8003970 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb800c3b0 con 0x7fafb80047c0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd262d640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 0x7fafb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.105+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb8003970 0x7fafb8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd162b640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb80047c0 0x7fafb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd262d640 1 -- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb80047c0 msgr2=0x7fafb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd262d640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafb80047c0 0x7fafb8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd262d640 1 -- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb8003970 msgr2=0x7fafb8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd262d640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb8003970 0x7fafb8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd262d640 1 -- 172.21.15.45:0/3133803120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8003520 con 0x7fafb80052a0 2023-12-08T08:18:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.106+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb8003970 0x7fafb8003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.107+0000 7fafd262d640 1 -- 172.21.15.45:0/3133803120 reap_dead start 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.107+0000 7fafd262d640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 0x7fafb800b980 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fafc4004480 tx=0x7fafb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda536191c7423b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.107+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4030400 con 0x7fafb80052a0 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.107+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4030560 con 0x7fafb80052a0 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.107+0000 7fafd0e2a640 1 -- 172.21.15.45:0/3133803120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40308f0 con 0x7fafb80052a0 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 -- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 msgr2=0x7fafb800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 0x7fafb800b980 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fafc4004480 tx=0x7fafb80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 -- 172.21.15.45:0/3133803120 shutdown_connections 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 --2- 172.21.15.45:0/3133803120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80052a0 0x7fafb800b980 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 -- 172.21.15.45:0/3133803120 >> 172.21.15.45:0/3133803120 conn(0x7fafcc0663d0 msgr2=0x7fafcc0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 -- 172.21.15.45:0/3133803120 shutdown_connections 2023-12-08T08:18:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.108+0000 7fafd4090640 1 -- 172.21.15.45:0/3133803120 wait complete. 2023-12-08T08:18:50.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.110+0000 7fafd4090640 1 Processor -- start 2023-12-08T08:18:50.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.110+0000 7fafd4090640 1 -- start start 2023-12-08T08:18:50.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 0x7fafcc0ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafcc14fc70 0x7fafcc1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1e7860 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1513e0 con 0x7fafb80052a0 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd4090640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc151bf0 con 0x7fafcc14fc70 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd262d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd262d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44542/0 (socket says 172.21.15.45:44542) 2023-12-08T08:18:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd262d640 1 -- 172.21.15.45:0/1347217764 learned_addr learned my addr 172.21.15.45:0/1347217764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 0x7fafcc0ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd162b640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafcc14fc70 0x7fafcc1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.111+0000 7fafd262d640 1 -- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafcc14fc70 msgr2=0x7fafcc1ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd262d640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafcc14fc70 0x7fafcc1ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd262d640 1 -- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 msgr2=0x7fafcc0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd262d640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 0x7fafcc0ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd262d640 1 -- 172.21.15.45:0/1347217764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc151630 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 0x7fafcc0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd262d640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000f80 tx=0x7fafc4003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4006b50 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4006cd0 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40399e0 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc151910 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.112+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc0abd70 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.114+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc0ab8d0 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.115+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafc4039b40 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.116+0000 7fafc27fc640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 0x7fafb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.116+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fafc40aafd0 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.116+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 0x7fafb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.117+0000 7fafd1e2c640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 0x7fafb006d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fafcc14f990 tx=0x7fafc8000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.120+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafc4076290 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.316+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fafcc0c4b60 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.317+0000 7fafc27fc640 1 -- 172.21.15.45:0/1347217764 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7fafc4048060 con 0x7fafcc1e6ea0 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:18:50.320 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:18:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.319+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 msgr2=0x7fafb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.319+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 0x7fafb006d330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fafcc14f990 tx=0x7fafc8000ed0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.319+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 msgr2=0x7fafcc1e7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.319+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000f80 tx=0x7fafc4003ae0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 shutdown_connections 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fafb006ae70 0x7fafb006d330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fafcc14fc70 0x7fafcc1ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafcc1e6ea0 0x7fafcc1e7320 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 --2- 172.21.15.45:0/1347217764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafb80052a0 0x7fafcc0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 >> 172.21.15.45:0/1347217764 conn(0x7fafcc0663d0 msgr2=0x7fafcc0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 shutdown_connections 2023-12-08T08:18:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.320+0000 7fafd4090640 1 -- 172.21.15.45:0/1347217764 wait complete. 2023-12-08T08:18:50.342 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:18:50.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:18:50.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.567+0000 7f621ffff640 1 Processor -- start 2023-12-08T08:18:50.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.567+0000 7f621ffff640 1 -- start start 2023-12-08T08:18:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.569+0000 7f621ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.569+0000 7f621ffff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62200c57b0 0x7f62200a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.569+0000 7f621ffff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62200a9810 con 0x7f62200c5c10 2023-12-08T08:18:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.569+0000 7f621ffff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200a5040 con 0x7f62200c57b0 2023-12-08T08:18:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.569+0000 7f621ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200a52e0 con 0x7f62200c1640 2023-12-08T08:18:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.570+0000 7f621effd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.570+0000 7f621effd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:33504/0 (socket says 172.21.15.45:33504) 2023-12-08T08:18:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.570+0000 7f6217fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62200c57b0 0x7f62200a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.570+0000 7f621effd640 1 -- 172.21.15.45:0/3731359274 learned_addr learned my addr 172.21.15.45:0/3731359274 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.571+0000 7f621effd640 1 -- 172.21.15.45:0/3731359274 >> v2:172.21.15.114:3300/0 conn(0x7f62200c57b0 msgr2=0x7f62200a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.571+0000 7f621effd640 1 --2- 172.21.15.45:0/3731359274 >> v2:172.21.15.114:3300/0 conn(0x7f62200c57b0 0x7f62200a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.571+0000 7f621effd640 1 -- 172.21.15.45:0/3731359274 >> v1:172.21.15.114:6789/0 conn(0x7f62200c5c10 legacy=0x7f6220151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.571+0000 7f621effd640 1 -- 172.21.15.45:0/3731359274 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200a94a0 con 0x7f62200c1640 2023-12-08T08:18:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.572+0000 7f621effd640 1 --2- 172.21.15.45:0/3731359274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f621002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d13ed449a3a588 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621e7fc640 1 -- 172.21.15.45:0/3731359274 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210030840 con 0x7f62200c1640 2023-12-08T08:18:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621e7fc640 1 -- 172.21.15.45:0/3731359274 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62100309a0 con 0x7f62200c1640 2023-12-08T08:18:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621e7fc640 1 -- 172.21.15.45:0/3731359274 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210030d30 con 0x7f62200c1640 2023-12-08T08:18:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 -- 172.21.15.45:0/3731359274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 msgr2=0x7f62200c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 --2- 172.21.15.45:0/3731359274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6210009870 tx=0x7f621002b980 comp rx=0 tx=0).stop 2023-12-08T08:18:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 -- 172.21.15.45:0/3731359274 shutdown_connections 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 --2- 172.21.15.45:0/3731359274 >> v2:172.21.15.114:3300/0 conn(0x7f62200c57b0 0x7f62200a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 --2- 172.21.15.45:0/3731359274 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c1640 0x7f62200c4dd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.573+0000 7f621ffff640 1 -- 172.21.15.45:0/3731359274 >> 172.21.15.45:0/3731359274 conn(0x7f6220066df0 msgr2=0x7f62200a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.574+0000 7f621ffff640 1 -- 172.21.15.45:0/3731359274 shutdown_connections 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.574+0000 7f621ffff640 1 -- 172.21.15.45:0/3731359274 wait complete. 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.575+0000 7f621ffff640 1 Processor -- start 2023-12-08T08:18:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 -- start start 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 0x7f62200a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c57b0 0x7f622014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c0020 con 0x7f622014e3e0 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62201eb870 con 0x7f62200c1640 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.576+0000 7f621ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200bb7c0 con 0x7f62200c57b0 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44548/0 (socket says 172.21.15.45:44548) 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 -- 172.21.15.45:0/2457873903 learned_addr learned my addr 172.21.15.45:0/2457873903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621effd640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 0x7f62200a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f6217fff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c57b0 0x7f622014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 -- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c57b0 msgr2=0x7f622014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c57b0 0x7f622014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 -- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 msgr2=0x7f62200a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 0x7f62200a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621f7fe640 1 -- 172.21.15.45:0/2457873903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100094d0 con 0x7f622014e3e0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.577+0000 7f621effd640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 0x7f62200a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f621f7fe640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f621800c730 tx=0x7f621800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218003b70 con 0x7f622014e3e0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218003cd0 con 0x7f622014e3e0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800aa90 con 0x7f622014e3e0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200bfd40 con 0x7f622014e3e0 2023-12-08T08:18:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.578+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200bf9f0 con 0x7f622014e3e0 2023-12-08T08:18:50.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.579+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6220067900 con 0x7f622014e3e0 2023-12-08T08:18:50.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.580+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f621800abf0 con 0x7f622014e3e0 2023-12-08T08:18:50.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.581+0000 7f62177fe640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 0x7f620006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.581+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f62180891d0 con 0x7f622014e3e0 2023-12-08T08:18:50.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.582+0000 7f621effd640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 0x7f620006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.582+0000 7f621effd640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 0x7f620006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6210036000 tx=0x7f621003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.585+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6218054480 con 0x7f622014e3e0 2023-12-08T08:18:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:50.782+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62201eb9e0 con 0x7f622014e3e0 2023-12-08T08:18:51.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.724+0000 7f62177fe640 1 -- 172.21.15.45:0/2457873903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6218057aa0 con 0x7f622014e3e0 2023-12-08T08:18:51.728 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.728+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 msgr2=0x7f620006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.728+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 0x7f620006d330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6210036000 tx=0x7f621003b040 comp rx=0 tx=0).stop 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.728+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 msgr2=0x7f62201e7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.728+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f621800c730 tx=0x7f621800cbf0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 shutdown_connections 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f620006ae70 0x7f620006d330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f62200c57b0 0x7f622014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622014e3e0 0x7f62201e7680 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 --2- 172.21.15.45:0/2457873903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62200c1640 0x7f62200a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 >> 172.21.15.45:0/2457873903 conn(0x7f6220066df0 msgr2=0x7f6220151910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 shutdown_connections 2023-12-08T08:18:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.729+0000 7f621ffff640 1 -- 172.21.15.45:0/2457873903 wait complete. 2023-12-08T08:18:51.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:18:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.970+0000 7fd4e3335640 1 Processor -- start 2023-12-08T08:18:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.970+0000 7fd4e3335640 1 -- start start 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.971+0000 7fd4e3335640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e3335640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4dc0bfe00 con 0x7fd4dc0a56b0 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e3335640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4dc151810 con 0x7fd4dc14e800 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e3335640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4dc14ebe0 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1b32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e2b34640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd4dc0a56b0 0x7fd4dc154cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35180/0 (socket says 172.21.15.45:35180) 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1b32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44558/0 (socket says 172.21.15.45:44558) 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e2b34640 1 -- 172.21.15.45:0/3000669282 learned_addr learned my addr 172.21.15.45:0/3000669282 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1b32640 1 -- 172.21.15.45:0/3000669282 >> v1:172.21.15.114:6789/0 conn(0x7fd4dc14e800 legacy=0x7fd4dc0c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1b32640 1 -- 172.21.15.45:0/3000669282 >> v1:172.21.15.45:6789/0 conn(0x7fd4dc0a56b0 legacy=0x7fd4dc154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1b32640 1 -- 172.21.15.45:0/3000669282 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc151af0 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.972+0000 7fd4e1331640 1 -- 172.21.15.45:0/3000669282 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127780119 0 0) 0x7fd4dc0bfe00 con 0x7fd4dc0a56b0 2023-12-08T08:18:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.974+0000 7fd4e1b32640 1 --2- 172.21.15.45:0/3000669282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097a0 tx=0x7fd4cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fff5e2b6d1495f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.974+0000 7fd4e1331640 1 -- 172.21.15.45:0/3000669282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc02e070 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.974+0000 7fd4e1331640 1 -- 172.21.15.45:0/3000669282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0315a0 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.974+0000 7fd4e1331640 1 -- 172.21.15.45:0/3000669282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc031930 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 -- 172.21.15.45:0/3000669282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc0a5e10 msgr2=0x7fd4dc1510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 --2- 172.21.15.45:0/3000669282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097a0 tx=0x7fd4cc02b840 comp rx=0 tx=0).stop 2023-12-08T08:18:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 -- 172.21.15.45:0/3000669282 shutdown_connections 2023-12-08T08:18:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 --2- 172.21.15.45:0/3000669282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc0a5e10 0x7fd4dc1510c0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 -- 172.21.15.45:0/3000669282 >> 172.21.15.45:0/3000669282 conn(0x7fd4dc0c2200 msgr2=0x7fd4dc0c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 -- 172.21.15.45:0/3000669282 shutdown_connections 2023-12-08T08:18:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.975+0000 7fd4e3335640 1 -- 172.21.15.45:0/3000669282 wait complete. 2023-12-08T08:18:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.976+0000 7fd4e3335640 1 Processor -- start 2023-12-08T08:18:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.977+0000 7fd4e3335640 1 -- start start 2023-12-08T08:18:51.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.977+0000 7fd4e3335640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4dc0a56b0 0x7fd4dc0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.977+0000 7fd4e3335640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4dc0a5e10 0x7fd4dc1e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e3335640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e3335640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc1520b0 con 0x7fd4dc14e800 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e3335640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc1e05c0 con 0x7fd4dc0a56b0 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e3335640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0c36c0 con 0x7fd4dc0a5e10 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44574/0 (socket says 172.21.15.45:44574) 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 -- 172.21.15.45:0/2871425655 learned_addr learned my addr 172.21.15.45:0/2871425655 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e1b32640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4dc0a5e10 0x7fd4dc1e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2333640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4dc0a56b0 0x7fd4dc0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 -- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4dc0a5e10 msgr2=0x7fd4dc1e0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4dc0a5e10 0x7fd4dc1e0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 -- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4dc0a56b0 msgr2=0x7fd4dc0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4dc0a56b0 0x7fd4dc0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.978+0000 7fd4e2b34640 1 -- 172.21.15.45:0/2871425655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009400 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4e2b34640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c7e0 tx=0x7fd4d400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400a640 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d400a7c0 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400ab70 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4dc0714a0 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.979+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4dc0c3ed0 con 0x7fd4dc14e800 2023-12-08T08:18:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.980+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4dc0a5200 con 0x7fd4dc14e800 2023-12-08T08:18:51.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.983+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4d400acd0 con 0x7fd4dc14e800 2023-12-08T08:18:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.984+0000 7fd4d2ffd640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.984+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fd4d4088f10 con 0x7fd4dc14e800 2023-12-08T08:18:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.984+0000 7fd4e2333640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.985+0000 7fd4e2333640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 0x7fd4c006d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006fd0 tx=0x7fd4d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:51.988+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4d40540d0 con 0x7fd4dc14e800 2023-12-08T08:18:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.181+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd4dc071630 con 0x7fd4dc14e800 2023-12-08T08:18:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.741+0000 7fd4d2ffd640 1 -- 172.21.15.45:0/2871425655 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd4d4018020 con 0x7fd4dc14e800 2023-12-08T08:18:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-08T08:18:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 msgr2=0x7fd4c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 0x7fd4c006d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006fd0 tx=0x7fd4d8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 msgr2=0x7fd4dc071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400c7e0 tx=0x7fd4d400cca0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 shutdown_connections 2023-12-08T08:18:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd4c006ae40 0x7fd4c006d300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd4dc0a5e10 0x7fd4dc1e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4dc14e800 0x7fd4dc071930 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 --2- 172.21.15.45:0/2871425655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4dc0a56b0 0x7fd4dc0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.745+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 >> 172.21.15.45:0/2871425655 conn(0x7fd4dc0c2200 msgr2=0x7fd4dc0bfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.746+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 shutdown_connections 2023-12-08T08:18:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.746+0000 7fd4e3335640 1 -- 172.21.15.45:0/2871425655 wait complete. 2023-12-08T08:18:52.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:18:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.972+0000 7f012e44f640 1 Processor -- start 2023-12-08T08:18:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.972+0000 7f012e44f640 1 -- start start 2023-12-08T08:18:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.973+0000 7f012e44f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 0x7f0128155a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f012e44f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280c1f00 con 0x7f01280c05a0 2023-12-08T08:18:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f012e44f640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280c1090 con 0x7f0128155f60 2023-12-08T08:18:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f012e44f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012806c9a0 con 0x7f0128159380 2023-12-08T08:18:52.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f0127fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01280c05a0 0x7f01280c0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35182/0 (socket says 172.21.15.45:35182) 2023-12-08T08:18:52.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f0127fff640 1 -- 172.21.15.45:0/344689260 learned_addr learned my addr 172.21.15.45:0/344689260 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:52.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f011ffff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 0x7f0128155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475508980 0 0) 0x7f01280c1f00 con 0x7f01280c05a0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.974+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0114003520 con 0x7f01280c05a0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922708393 0 0) 0x7f0114003520 con 0x7f01280c05a0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 msgr2=0x7f0128155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 0x7f0128155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 >> v1:172.21.15.114:6789/0 conn(0x7f0128155f60 legacy=0x7f01280c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012806bf30 con 0x7f01280c05a0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f0118001670 con 0x7f01280c05a0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 >> v1:172.21.15.45:6789/0 conn(0x7f01280c05a0 legacy=0x7f01280c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01140039a0 0x7f0114003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f0114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 0x7f0114005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012806c9a0 con 0x7f01140047c0 2023-12-08T08:18:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011400ba30 con 0x7f01140039a0 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011400bbf0 con 0x7f0128159380 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.975+0000 7f011ffff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f0114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f0127fff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01140039a0 0x7f0114003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f011ffff640 1 -- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 msgr2=0x7f0114005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f011ffff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0128159380 0x7f0114005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f011ffff640 1 -- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01140039a0 msgr2=0x7f0114003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f011ffff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01140039a0 0x7f0114003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.976+0000 7f011ffff640 1 -- 172.21.15.45:0/344689260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114003520 con 0x7f01140047c0 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.977+0000 7f011ffff640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f0114004c40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0110009a90 tx=0x7f01140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877c0c6d2439b506 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.977+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011002c6b0 con 0x7f01140047c0 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.977+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011002c810 con 0x7f01140047c0 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.977+0000 7f01277fe640 1 -- 172.21.15.45:0/344689260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011002cba0 con 0x7f01140047c0 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 -- 172.21.15.45:0/344689260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 msgr2=0x7f0114004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 --2- 172.21.15.45:0/344689260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f0114004c40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0110009a90 tx=0x7f01140057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012c9ec640 1 -- 172.21.15.45:0/344689260 reap_dead start 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 -- 172.21.15.45:0/344689260 shutdown_connections 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 -- 172.21.15.45:0/344689260 >> 172.21.15.45:0/344689260 conn(0x7f01280c2430 msgr2=0x7f01280c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 -- 172.21.15.45:0/344689260 shutdown_connections 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.978+0000 7f012e44f640 1 -- 172.21.15.45:0/344689260 wait complete. 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.980+0000 7f012e44f640 1 Processor -- start 2023-12-08T08:18:52.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.980+0000 7f012e44f640 1 -- start start 2023-12-08T08:18:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 0x7f0128152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01280aaf60 0x7f01281edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281f1c80 con 0x7f01140047c0 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280abae0 con 0x7f01281f2110 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f012e44f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01281f1630 con 0x7f01280aaf60 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f0127fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f0127fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44592/0 (socket says 172.21.15.45:44592) 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.981+0000 7f0127fff640 1 -- 172.21.15.45:0/3969101546 learned_addr learned my addr 172.21.15.45:0/3969101546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f011ffff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 0x7f0128152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f012c9ec640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01280aaf60 0x7f01281edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 -- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01280aaf60 msgr2=0x7f01281edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01280aaf60 0x7f01281edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 -- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 msgr2=0x7f0128152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 0x7f0128152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 -- 172.21.15.45:0/3969101546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01281f1910 con 0x7f01140047c0 2023-12-08T08:18:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f011ffff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 0x7f0128152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:52.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f0127fff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f011800e7f0 tx=0x7f011800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800eea0 con 0x7f01140047c0 2023-12-08T08:18:52.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011800c870 con 0x7f01140047c0 2023-12-08T08:18:52.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011800cc00 con 0x7f01140047c0 2023-12-08T08:18:52.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.982+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0128153410 con 0x7f01140047c0 2023-12-08T08:18:52.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.983+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01281ee480 con 0x7f01140047c0 2023-12-08T08:18:52.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.984+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0128074670 con 0x7f01140047c0 2023-12-08T08:18:52.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.986+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f011801d460 con 0x7f01140047c0 2023-12-08T08:18:52.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.987+0000 7f01257fa640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 0x7f010806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.987+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f011808a170 con 0x7f01140047c0 2023-12-08T08:18:52.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.987+0000 7f011ffff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 0x7f010806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.988+0000 7f011ffff640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 0x7f010806d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0110036000 tx=0x7f0110030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:52.991+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01180551b0 con 0x7f01140047c0 2023-12-08T08:18:53.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.235+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0128154720 con 0x7f01140047c0 2023-12-08T08:18:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.745+0000 7f01257fa640 1 -- 172.21.15.45:0/3969101546 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f01180587d0 con 0x7f01140047c0 2023-12-08T08:18:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 13 and data pool 14 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 msgr2=0x7f010806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 0x7f010806d330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0110036000 tx=0x7f0110030000 comp rx=0 tx=0).stop 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 msgr2=0x7f01280a8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f011800e7f0 tx=0x7f011800ecb0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 shutdown_connections 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f010806ae70 0x7f010806d330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01280aaf60 0x7f01281edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01281f2110 0x7f0128152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.749+0000 7f012e44f640 1 --2- 172.21.15.45:0/3969101546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01140047c0 0x7f01280a8c70 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.750+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 >> 172.21.15.45:0/3969101546 conn(0x7f01280c2430 msgr2=0x7f0128159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.753+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 shutdown_connections 2023-12-08T08:18:53.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.754+0000 7f012e44f640 1 -- 172.21.15.45:0/3969101546 wait complete. 2023-12-08T08:18:53.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.986+0000 7fea85a9b640 1 Processor -- start 2023-12-08T08:18:53.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.986+0000 7fea85a9b640 1 -- start start 2023-12-08T08:18:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.987+0000 7fea85a9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea800c0db0 0x7fea8006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.987+0000 7fea85a9b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea80158530 con 0x7fea80151d20 2023-12-08T08:18:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.987+0000 7fea85a9b640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea80158810 con 0x7fea800bedd0 2023-12-08T08:18:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.987+0000 7fea85a9b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8006d800 con 0x7fea800c0db0 2023-12-08T08:18:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea800c0db0 0x7fea8006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea800c0db0 0x7fea8006d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44606/0 (socket says 172.21.15.45:44606) 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 -- 172.21.15.45:0/191358665 learned_addr learned my addr 172.21.15.45:0/191358665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 -- 172.21.15.45:0/191358665 >> v1:172.21.15.114:6789/0 conn(0x7fea800bedd0 legacy=0x7fea800c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 -- 172.21.15.45:0/191358665 >> v1:172.21.15.45:6789/0 conn(0x7fea80151d20 legacy=0x7fea800c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7effd640 1 -- 172.21.15.45:0/191358665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea800bf8d0 con 0x7fea800c0db0 2023-12-08T08:18:53.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.988+0000 7fea7e7fc640 1 -- 172.21.15.45:0/191358665 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157757600 0 0) 0x7fea80158530 con 0x7fea80151d20 2023-12-08T08:18:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.989+0000 7fea7effd640 1 --2- 172.21.15.45:0/191358665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800c0db0 0x7fea8006d2c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fea74009870 tx=0x7fea7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aed67bee4b7698b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea7e7fc640 1 -- 172.21.15.45:0/191358665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74031870 con 0x7fea800c0db0 2023-12-08T08:18:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea7e7fc640 1 -- 172.21.15.45:0/191358665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea740319d0 con 0x7fea800c0db0 2023-12-08T08:18:53.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea7e7fc640 1 -- 172.21.15.45:0/191358665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74031d60 con 0x7fea800c0db0 2023-12-08T08:18:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea85a9b640 1 -- 172.21.15.45:0/191358665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800c0db0 msgr2=0x7fea8006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea85a9b640 1 --2- 172.21.15.45:0/191358665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800c0db0 0x7fea8006d2c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fea74009870 tx=0x7fea7402b910 comp rx=0 tx=0).stop 2023-12-08T08:18:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea85a9b640 1 -- 172.21.15.45:0/191358665 shutdown_connections 2023-12-08T08:18:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea85a9b640 1 --2- 172.21.15.45:0/191358665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800c0db0 0x7fea8006d2c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.990+0000 7fea85a9b640 1 -- 172.21.15.45:0/191358665 >> 172.21.15.45:0/191358665 conn(0x7fea800661f0 msgr2=0x7fea80066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.991+0000 7fea85a9b640 1 -- 172.21.15.45:0/191358665 shutdown_connections 2023-12-08T08:18:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.991+0000 7fea85a9b640 1 -- 172.21.15.45:0/191358665 wait complete. 2023-12-08T08:18:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.992+0000 7fea85a9b640 1 Processor -- start 2023-12-08T08:18:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.992+0000 7fea85a9b640 1 -- start start 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea800c0db0 0x7fea801537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea80151d20 0x7fea801563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80152550 con 0x7fea800bedd0 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801e05e0 con 0x7fea80151d20 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea85a9b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea80153ce0 con 0x7fea800c0db0 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.993+0000 7fea7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44610/0 (socket says 172.21.15.45:44610) 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 -- 172.21.15.45:0/2075609751 learned_addr learned my addr 172.21.15.45:0/2075609751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 -- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea800c0db0 msgr2=0x7fea801537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea800c0db0 0x7fea801537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 -- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea80151d20 msgr2=0x7fea801563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7ffff640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea80151d20 0x7fea801563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea80151d20 0x7fea801563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 -- 172.21.15.45:0/2075609751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740094d0 con 0x7fea800bedd0 2023-12-08T08:18:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.994+0000 7fea7f7fe640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c7f0 tx=0x7fea7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.995+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70003da0 con 0x7fea800bedd0 2023-12-08T08:18:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.995+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea70005070 con 0x7fea800bedd0 2023-12-08T08:18:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.995+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea801527a0 con 0x7fea800bedd0 2023-12-08T08:18:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.995+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70005420 con 0x7fea800bedd0 2023-12-08T08:18:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.995+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea801eda70 con 0x7fea800bedd0 2023-12-08T08:18:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.996+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea801e03b0 con 0x7fea800bedd0 2023-12-08T08:18:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.997+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea70005580 con 0x7fea800bedd0 2023-12-08T08:18:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.998+0000 7fea67fff640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 0x7fea6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.998+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fea70089010 con 0x7fea800bedd0 2023-12-08T08:18:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.998+0000 7fea7effd640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 0x7fea6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:53.999+0000 7fea7effd640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 0x7fea6c06d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fea74036000 tx=0x7fea74030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.003+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea801e03b0 con 0x7fea800bedd0 2023-12-08T08:18:54.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.194+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea801e03b0 con 0x7fea800bedd0 2023-12-08T08:18:54.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.197+0000 7fea67fff640 1 -- 172.21.15.45:0/2075609751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fea801e03b0 con 0x7fea800bedd0 2023-12-08T08:18:54.201 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:54.201 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":78,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:53.238042+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:54.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 msgr2=0x7fea6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 0x7fea6c06d330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fea74036000 tx=0x7fea74030000 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 msgr2=0x7fea80153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c7f0 tx=0x7fea7000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 shutdown_connections 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fea6c06ae70 0x7fea6c06d330 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea800c0db0 0x7fea801537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea80151d20 0x7fea801563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 --2- 172.21.15.45:0/2075609751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea800bedd0 0x7fea80153260 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 >> 172.21.15.45:0/2075609751 conn(0x7fea800661f0 msgr2=0x7fea800665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.200+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 shutdown_connections 2023-12-08T08:18:54.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.201+0000 7fea85a9b640 1 -- 172.21.15.45:0/2075609751 wait complete. 2023-12-08T08:18:54.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.432+0000 7f5217e36640 1 Processor -- start 2023-12-08T08:18:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.433+0000 7f5217e36640 1 -- start start 2023-12-08T08:18:54.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5217e36640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52100ca0e0 0x7f52100ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5217e36640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 0x7f52101585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5217e36640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100c4880 con 0x7f521014e800 2023-12-08T08:18:54.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5217e36640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5210158b30 con 0x7f52100ca0e0 2023-12-08T08:18:54.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5217e36640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100c4b60 con 0x7f52101581c0 2023-12-08T08:18:54.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.434+0000 7f5215bd2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f521014e800 0x7f5210155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35200/0 (socket says 172.21.15.45:35200) 2023-12-08T08:18:54.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f5215bd2640 1 -- 172.21.15.45:0/237574437 learned_addr learned my addr 172.21.15.45:0/237574437 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:54.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52153d1640 1 --2- 172.21.15.45:0/237574437 >> v2:172.21.15.45:3300/0 conn(0x7f52100ca0e0 0x7f52100ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52163d3640 1 --2- 172.21.15.45:0/237574437 >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 0x7f52101585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f5214bd0640 1 -- 172.21.15.45:0/237574437 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575305911 0 0) 0x7f52100c4880 con 0x7f521014e800 2023-12-08T08:18:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52153d1640 1 -- 172.21.15.45:0/237574437 >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 msgr2=0x7f52101585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52153d1640 1 --2- 172.21.15.45:0/237574437 >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 0x7f52101585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52153d1640 1 -- 172.21.15.45:0/237574437 >> v1:172.21.15.45:6789/0 conn(0x7f521014e800 legacy=0x7f5210155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52153d1640 1 -- 172.21.15.45:0/237574437 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100c4e40 con 0x7f52100ca0e0 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.435+0000 7f52163d3640 1 --2- 172.21.15.45:0/237574437 >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 0x7f52101585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.436+0000 7f52153d1640 1 --2- 172.21.15.45:0/237574437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52100ca560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f521006c410 tx=0x7f520402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a20e1dd613d7ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5214bd0640 1 -- 172.21.15.45:0/237574437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204031520 con 0x7f52100ca0e0 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5214bd0640 1 -- 172.21.15.45:0/237574437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204031680 con 0x7f52100ca0e0 2023-12-08T08:18:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5214bd0640 1 -- 172.21.15.45:0/237574437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204031a10 con 0x7f52100ca0e0 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 -- 172.21.15.45:0/237574437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 msgr2=0x7f52100ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 --2- 172.21.15.45:0/237574437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52100ca560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f521006c410 tx=0x7f520402b7c0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 -- 172.21.15.45:0/237574437 shutdown_connections 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 --2- 172.21.15.45:0/237574437 >> v2:172.21.15.114:3300/0 conn(0x7f52101581c0 0x7f52101585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 --2- 172.21.15.45:0/237574437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52100ca560 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 -- 172.21.15.45:0/237574437 >> 172.21.15.45:0/237574437 conn(0x7f52100663d0 msgr2=0x7f52100667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 -- 172.21.15.45:0/237574437 shutdown_connections 2023-12-08T08:18:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.437+0000 7f5217e36640 1 -- 172.21.15.45:0/237574437 wait complete. 2023-12-08T08:18:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.439+0000 7f5217e36640 1 Processor -- start 2023-12-08T08:18:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.439+0000 7f5217e36640 1 -- start start 2023-12-08T08:18:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 0x7f52101ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52101581c0 0x7f5210156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101515d0 con 0x7f52100ca0e0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101ead60 con 0x7f52101581c0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5217e36640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5210151be0 con 0x7f521014e800 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5215bd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5215bd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44634/0 (socket says 172.21.15.45:44634) 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.440+0000 7f5215bd2640 1 -- 172.21.15.45:0/609108005 learned_addr learned my addr 172.21.15.45:0/609108005 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f52153d1640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 0x7f52101ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f52163d3640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52101581c0 0x7f5210156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 -- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 msgr2=0x7f52101ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 0x7f52101ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 -- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52101581c0 msgr2=0x7f5210156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52101581c0 0x7f5210156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 -- 172.21.15.45:0/609108005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009400 con 0x7f52100ca0e0 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f52153d1640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 0x7f52101ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5215bd2640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f520000c890 tx=0x7f520000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000a640 con 0x7f52100ca0e0 2023-12-08T08:18:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000a7c0 con 0x7f52100ca0e0 2023-12-08T08:18:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000ab70 con 0x7f52100ca0e0 2023-12-08T08:18:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210153930 con 0x7f52100ca0e0 2023-12-08T08:18:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.441+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101ed430 con 0x7f52100ca0e0 2023-12-08T08:18:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.442+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210154ad0 con 0x7f52100ca0e0 2023-12-08T08:18:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.444+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f520000acd0 con 0x7f52100ca0e0 2023-12-08T08:18:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.444+0000 7f520e7fc640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 0x7f51fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.444+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5200088c80 con 0x7f52100ca0e0 2023-12-08T08:18:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.445+0000 7f52153d1640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 0x7f51fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.446+0000 7f52153d1640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 0x7f51fc06d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5204035000 tx=0x7f5204030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.449+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5200053be0 con 0x7f52100ca0e0 2023-12-08T08:18:54.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.642+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5210074600 con 0x7f52100ca0e0 2023-12-08T08:18:54.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.646+0000 7f520e7fc640 1 -- 172.21.15.45:0/609108005 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f5200018020 con 0x7f52100ca0e0 2023-12-08T08:18:54.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:54.649 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":78,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:53.238042+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:54.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 msgr2=0x7f51fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 0x7f51fc06d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5204035000 tx=0x7f5204030000 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 msgr2=0x7f52101edf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f520000c890 tx=0x7f520000cd50 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 shutdown_connections 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51fc06ae40 0x7f51fc06d300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f521014e800 0x7f52101ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52101581c0 0x7f5210156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 --2- 172.21.15.45:0/609108005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52100ca0e0 0x7f52101edf10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.648+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 >> 172.21.15.45:0/609108005 conn(0x7f52100663d0 msgr2=0x7f52100667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.649+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 shutdown_connections 2023-12-08T08:18:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.649+0000 7f5217e36640 1 -- 172.21.15.45:0/609108005 wait complete. 2023-12-08T08:18:54.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:18:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.898+0000 7f45f5eb2640 1 Processor -- start 2023-12-08T08:18:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.899+0000 7f45f5eb2640 1 -- start start 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45f5eb2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45f0151a70 0x7f45f00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45f5eb2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f0154cf0 con 0x7f45f00c1630 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45f5eb2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f0151e50 con 0x7f45f00c8000 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45f5eb2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f01543e0 con 0x7f45f0151a70 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45f0151a70 0x7f45f00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45ef7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45f0151a70 0x7f45f00c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44650/0 (socket says 172.21.15.45:44650) 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.900+0000 7f45ef7fe640 1 -- 172.21.15.45:0/1464487520 learned_addr learned my addr 172.21.15.45:0/1464487520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.901+0000 7f45ef7fe640 1 -- 172.21.15.45:0/1464487520 >> v1:172.21.15.114:6789/0 conn(0x7f45f00c8000 legacy=0x7f45f00c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.901+0000 7f45ef7fe640 1 -- 172.21.15.45:0/1464487520 >> v1:172.21.15.45:6789/0 conn(0x7f45f00c1630 legacy=0x7f45f015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.901+0000 7f45ef7fe640 1 -- 172.21.15.45:0/1464487520 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00a7440 con 0x7f45f0151a70 2023-12-08T08:18:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.902+0000 7f45ef7fe640 1 --2- 172.21.15.45:0/1464487520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0151a70 0x7f45f00c7ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa17ea1287e6301 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.902+0000 7f45ee7fc640 1 -- 172.21.15.45:0/1464487520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e002c9f0 con 0x7f45f0151a70 2023-12-08T08:18:54.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.902+0000 7f45ee7fc640 1 -- 172.21.15.45:0/1464487520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e002cb50 con 0x7f45f0151a70 2023-12-08T08:18:54.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.902+0000 7f45ee7fc640 1 -- 172.21.15.45:0/1464487520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00343f0 con 0x7f45f0151a70 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 -- 172.21.15.45:0/1464487520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0151a70 msgr2=0x7f45f00c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/1464487520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0151a70 0x7f45f00c7ac0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e002be50 comp rx=0 tx=0).stop 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 -- 172.21.15.45:0/1464487520 shutdown_connections 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/1464487520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0151a70 0x7f45f00c7ac0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 -- 172.21.15.45:0/1464487520 >> 172.21.15.45:0/1464487520 conn(0x7f45f00a98a0 msgr2=0x7f45f00a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 -- 172.21.15.45:0/1464487520 shutdown_connections 2023-12-08T08:18:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.903+0000 7f45f5eb2640 1 -- 172.21.15.45:0/1464487520 wait complete. 2023-12-08T08:18:54.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.905+0000 7f45f5eb2640 1 Processor -- start 2023-12-08T08:18:54.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.905+0000 7f45f5eb2640 1 -- start start 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 0x7f45f0157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f0151a70 0x7f45f014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f014ade0 con 0x7f45f014b310 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0157700 con 0x7f45f0151a70 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45f5eb2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f014b030 con 0x7f45f00c8000 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45effff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44656/0 (socket says 172.21.15.45:44656) 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.906+0000 7f45effff640 1 -- 172.21.15.45:0/4056584854 learned_addr learned my addr 172.21.15.45:0/4056584854 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45ef7fe640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 0x7f45f0157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45eeffd640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f0151a70 0x7f45f014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 -- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 msgr2=0x7f45f0157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 0x7f45f0157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 -- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f0151a70 msgr2=0x7f45f014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f0151a70 0x7f45f014d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 -- 172.21.15.45:0/4056584854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009b30 con 0x7f45f014b310 2023-12-08T08:18:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45ef7fe640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 0x7f45f0157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45effff640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3a0 tx=0x7f45e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80052d0 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8005430 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8003830 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.907+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f0156d60 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.908+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f014d610 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.909+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0155160 con 0x7f45f014b310 2023-12-08T08:18:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.910+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45e8003990 con 0x7f45f014b310 2023-12-08T08:18:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.911+0000 7f45e7fff640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 0x7f45d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.911+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f45e8088d20 con 0x7f45f014b310 2023-12-08T08:18:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.911+0000 7f45ef7fe640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 0x7f45d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.912+0000 7f45ef7fe640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 0x7f45d006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45e0035000 tx=0x7f45e0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:54.915+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45f0155160 con 0x7f45f014b310 2023-12-08T08:18:55.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.147+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f45f0155160 con 0x7f45f014b310 2023-12-08T08:18:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.785+0000 7f45e7fff640 1 -- 172.21.15.45:0/4056584854 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f45f0155160 con 0x7f45f014b310 2023-12-08T08:18:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 msgr2=0x7f45d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 0x7f45d006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45e0035000 tx=0x7f45e0030000 comp rx=0 tx=0).stop 2023-12-08T08:18:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 msgr2=0x7f45f01ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3a0 tx=0x7f45e800c860 comp rx=0 tx=0).stop 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 shutdown_connections 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f45d006ae40 0x7f45d006d300 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f014b310 0x7f45f01ed5e0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f0151a70 0x7f45f014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 --2- 172.21.15.45:0/4056584854 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f45f00c8000 0x7f45f0157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 >> 172.21.15.45:0/4056584854 conn(0x7f45f00a98a0 msgr2=0x7f45f014ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.789+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 shutdown_connections 2023-12-08T08:18:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:55.790+0000 7f45f5eb2640 1 -- 172.21.15.45:0/4056584854 wait complete. 2023-12-08T08:18:55.814 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:18:55.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:18:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.047+0000 7fab5637a640 1 Processor -- start 2023-12-08T08:18:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.048+0000 7fab5637a640 1 -- start start 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab5637a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab5014c280 0x7fab500a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab5637a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500c60c0 con 0x7fab500c4970 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab5637a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab50152dc0 con 0x7fab50155790 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab5637a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab501521d0 con 0x7fab5014c280 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab55378640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab5014c280 0x7fab500a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab55378640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab5014c280 0x7fab500a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46650/0 (socket says 172.21.15.45:46650) 2023-12-08T08:18:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.049+0000 7fab55378640 1 -- 172.21.15.45:0/701301041 learned_addr learned my addr 172.21.15.45:0/701301041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.050+0000 7fab55378640 1 -- 172.21.15.45:0/701301041 >> v1:172.21.15.114:6789/0 conn(0x7fab50155790 legacy=0x7fab50155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.050+0000 7fab55378640 1 -- 172.21.15.45:0/701301041 >> v1:172.21.15.45:6789/0 conn(0x7fab500c4970 legacy=0x7fab5006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.050+0000 7fab55378640 1 -- 172.21.15.45:0/701301041 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5014c660 con 0x7fab5014c280 2023-12-08T08:18:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.050+0000 7fab47fff640 1 -- 172.21.15.45:0/701301041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401677086 0 0) 0x7fab40001110 con 0x7fab500c4970 2023-12-08T08:18:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.051+0000 7fab55378640 1 --2- 172.21.15.45:0/701301041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5014c280 0x7fab500a4d10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e42d899542a7fbf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.051+0000 7fab47fff640 1 -- 172.21.15.45:0/701301041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c031870 con 0x7fab5014c280 2023-12-08T08:18:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.051+0000 7fab47fff640 1 -- 172.21.15.45:0/701301041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c0319d0 con 0x7fab5014c280 2023-12-08T08:18:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.051+0000 7fab47fff640 1 -- 172.21.15.45:0/701301041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c031d60 con 0x7fab5014c280 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 -- 172.21.15.45:0/701301041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5014c280 msgr2=0x7fab500a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 --2- 172.21.15.45:0/701301041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5014c280 0x7fab500a4d10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c02b910 comp rx=0 tx=0).stop 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 -- 172.21.15.45:0/701301041 shutdown_connections 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 --2- 172.21.15.45:0/701301041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5014c280 0x7fab500a4d10 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 -- 172.21.15.45:0/701301041 >> 172.21.15.45:0/701301041 conn(0x7fab50066ce0 msgr2=0x7fab500a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 -- 172.21.15.45:0/701301041 shutdown_connections 2023-12-08T08:18:56.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.052+0000 7fab5637a640 1 -- 172.21.15.45:0/701301041 wait complete. 2023-12-08T08:18:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.054+0000 7fab5637a640 1 Processor -- start 2023-12-08T08:18:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.054+0000 7fab5637a640 1 -- start start 2023-12-08T08:18:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 0x7fab500a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab50155790 0x7fab500a9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500a9b80 con 0x7fab500c4970 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500a8990 con 0x7fab5014c280 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab5637a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500a9d90 con 0x7fab50155790 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab55378640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab55378640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46658/0 (socket says 172.21.15.45:46658) 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab55378640 1 -- 172.21.15.45:0/1040378489 learned_addr learned my addr 172.21.15.45:0/1040378489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab54b77640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 0x7fab500a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab55378640 1 -- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab50155790 msgr2=0x7fab500a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.055+0000 7fab55378640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab50155790 0x7fab500a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab55378640 1 -- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 msgr2=0x7fab500a9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab55378640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 0x7fab500a9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab55378640 1 -- 172.21.15.45:0/1040378489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0094d0 con 0x7fab500c4970 2023-12-08T08:18:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab54b77640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 0x7fab500a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:56.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab55378640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fab4c000c00 tx=0x7fab4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c03ad30 con 0x7fab500c4970 2023-12-08T08:18:56.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c03ae90 con 0x7fab500c4970 2023-12-08T08:18:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c044630 con 0x7fab500c4970 2023-12-08T08:18:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab501495d0 con 0x7fab500c4970 2023-12-08T08:18:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.056+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab501ee360 con 0x7fab500c4970 2023-12-08T08:18:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.058+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500678c0 con 0x7fab500c4970 2023-12-08T08:18:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.059+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab4c04d450 con 0x7fab500c4970 2023-12-08T08:18:56.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.060+0000 7fab45ffb640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 0x7fab3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.060+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fab4c02d040 con 0x7fab500c4970 2023-12-08T08:18:56.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.060+0000 7fab54b77640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 0x7fab3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.061+0000 7fab54b77640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 0x7fab3406d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab50153050 tx=0x7fab40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.065+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab4c076d00 con 0x7fab500c4970 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.298+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab500743e0 con 0x7fab500c4970 2023-12-08T08:18:56.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.797+0000 7fab45ffb640 1 -- 172.21.15.45:0/1040378489 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab4c07a320 con 0x7fab500c4970 2023-12-08T08:18:56.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 msgr2=0x7fab3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 0x7fab3406d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab50153050 tx=0x7fab40009040 comp rx=0 tx=0).stop 2023-12-08T08:18:56.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 msgr2=0x7fab501ed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fab4c000c00 tx=0x7fab4c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 shutdown_connections 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab3406ae70 0x7fab3406d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab50155790 0x7fab500a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab5014c280 0x7fab500a9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 --2- 172.21.15.45:0/1040378489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab500c4970 0x7fab501ed5d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.800+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 >> 172.21.15.45:0/1040378489 conn(0x7fab50066ce0 msgr2=0x7fab50147440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.801+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 shutdown_connections 2023-12-08T08:18:56.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:56.801+0000 7fab5637a640 1 -- 172.21.15.45:0/1040378489 wait complete. 2023-12-08T08:18:56.829 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:18:56.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:57.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.058+0000 7f53a3fff640 1 Processor -- start 2023-12-08T08:18:57.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.058+0000 7f53a3fff640 1 -- start start 2023-12-08T08:18:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.059+0000 7f53a3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53a40c7d50 0x7f53a4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.059+0000 7f53a3fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40c8470 con 0x7f53a40af290 2023-12-08T08:18:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.059+0000 7f53a3fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a406c320 con 0x7f53a40c47d0 2023-12-08T08:18:57.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.059+0000 7f53a3fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a406cb30 con 0x7f53a40c7d50 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.060+0000 7f53a2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f53a40af290 0x7f53a40ca190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56238/0 (socket says 172.21.15.45:56238) 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.060+0000 7f53a2ffd640 1 -- 172.21.15.45:0/776592956 learned_addr learned my addr 172.21.15.45:0/776592956 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.060+0000 7f53a27fc640 1 --2- 172.21.15.45:0/776592956 >> v2:172.21.15.114:3300/0 conn(0x7f53a40c7d50 0x7f53a4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.060+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031908349 0 0) 0x7f53a40c8470 con 0x7f53a40af290 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.060+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c003520 con 0x7f53a40af290 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851167660 0 0) 0x7f538c003520 con 0x7f53a40af290 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 >> v2:172.21.15.114:3300/0 conn(0x7f53a40c7d50 msgr2=0x7f53a4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 --2- 172.21.15.45:0/776592956 >> v2:172.21.15.114:3300/0 conn(0x7f53a40c7d50 0x7f53a4157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 >> v1:172.21.15.114:6789/0 conn(0x7f53a40c47d0 legacy=0x7f53a41582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40c4fd0 con 0x7f53a40af290 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5394001670 con 0x7f53a40af290 2023-12-08T08:18:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 >> v1:172.21.15.45:6789/0 conn(0x7f53a40af290 legacy=0x7f53a40ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0039c0 0x7f538c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 0x7f538c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0052a0 0x7f538c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a406cb30 con 0x7f538c0047c0 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00c1a0 con 0x7f538c0052a0 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00c360 con 0x7f538c0039c0 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.061+0000 7f53a27fc640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 0x7f538c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a27fc640 1 -- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0039c0 msgr2=0x7f538c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a27fc640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0039c0 0x7f538c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a27fc640 1 -- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0052a0 msgr2=0x7f538c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a37fe640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0052a0 0x7f538c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a27fc640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0052a0 0x7f538c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a27fc640 1 -- 172.21.15.45:0/776592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c003520 con 0x7f538c0047c0 2023-12-08T08:18:57.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.062+0000 7f53a37fe640 1 -- 172.21.15.45:0/776592956 reap_dead start 2023-12-08T08:18:57.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.063+0000 7f53a27fc640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 0x7f538c004c40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5398009ac0 tx=0x7f538c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc681ada5cf767 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.063+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539802c6b0 con 0x7f538c0047c0 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.063+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539802c810 con 0x7f538c0047c0 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.063+0000 7f53a1ffb640 1 -- 172.21.15.45:0/776592956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539802cba0 con 0x7f538c0047c0 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 -- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 msgr2=0x7f538c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 0x7f538c004c40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5398009ac0 tx=0x7f538c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 -- 172.21.15.45:0/776592956 shutdown_connections 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 --2- 172.21.15.45:0/776592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f538c0047c0 0x7f538c004c40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 -- 172.21.15.45:0/776592956 >> 172.21.15.45:0/776592956 conn(0x7f53a40663d0 msgr2=0x7f53a40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 -- 172.21.15.45:0/776592956 shutdown_connections 2023-12-08T08:18:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.064+0000 7f53a3fff640 1 -- 172.21.15.45:0/776592956 wait complete. 2023-12-08T08:18:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.066+0000 7f53a3fff640 1 Processor -- start 2023-12-08T08:18:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.066+0000 7f53a3fff640 1 -- start start 2023-12-08T08:18:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 0x7f53a41de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53a40ac5a0 0x7f53a414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40ac230 con 0x7f53a414bb70 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a41dea00 con 0x7f53a40ac5a0 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a3fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a414ded0 con 0x7f538c0047c0 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46678/0 (socket says 172.21.15.45:46678) 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 -- 172.21.15.45:0/379503402 learned_addr learned my addr 172.21.15.45:0/379503402 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a27fc640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53a40ac5a0 0x7f53a414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a2ffd640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 0x7f53a41de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 -- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 msgr2=0x7f53a41de4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 0x7f53a41de4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 -- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53a40ac5a0 msgr2=0x7f53a414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53a40ac5a0 0x7f53a414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a37fe640 1 -- 172.21.15.45:0/379503402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4157330 con 0x7f53a414bb70 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.067+0000 7f53a2ffd640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 0x7f53a41de4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f53a37fe640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f53a40caed0 tx=0x7f539c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c003b70 con 0x7f53a414bb70 2023-12-08T08:18:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c003cd0 con 0x7f53a414bb70 2023-12-08T08:18:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c005270 con 0x7f53a414bb70 2023-12-08T08:18:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a414e100 con 0x7f53a414bb70 2023-12-08T08:18:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.068+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4156fc0 con 0x7f53a414bb70 2023-12-08T08:18:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.070+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4157180 con 0x7f53a414bb70 2023-12-08T08:18:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.070+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f539c0053d0 con 0x7f53a414bb70 2023-12-08T08:18:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.071+0000 7f538b7fe640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 0x7f539006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.071+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f539c088e60 con 0x7f53a414bb70 2023-12-08T08:18:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.072+0000 7f53a2ffd640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 0x7f539006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.072+0000 7f53a2ffd640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 0x7f539006d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53940079b0 tx=0x7f5394009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.075+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f539c053f40 con 0x7f53a414bb70 2023-12-08T08:18:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.305+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53a41574c0 con 0x7f53a414bb70 2023-12-08T08:18:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.306+0000 7f538b7fe640 1 -- 172.21.15.45:0/379503402 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f539c018070 con 0x7f53a414bb70 2023-12-08T08:18:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:57.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-08T08:18:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-08T08:18:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 msgr2=0x7f539006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 0x7f539006d330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53940079b0 tx=0x7f5394009040 comp rx=0 tx=0).stop 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 msgr2=0x7f53a41e9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f53a40caed0 tx=0x7f539c00dc00 comp rx=0 tx=0).stop 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 shutdown_connections 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f539006ae70 0x7f539006d330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a414bb70 0x7f53a41e9af0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53a40ac5a0 0x7f53a414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 --2- 172.21.15.45:0/379503402 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f538c0047c0 0x7f53a41de4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.309+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 >> 172.21.15.45:0/379503402 conn(0x7f53a40663d0 msgr2=0x7f53a40667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.310+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 shutdown_connections 2023-12-08T08:18:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.310+0000 7f53a3fff640 1 -- 172.21.15.45:0/379503402 wait complete. 2023-12-08T08:18:57.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:57.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.549+0000 7f145ffff640 1 Processor -- start 2023-12-08T08:18:57.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.549+0000 7f145ffff640 1 -- start start 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.551+0000 7f145ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f146015b580 0x7f14601587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.551+0000 7f145ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1460159e50 0x7f146015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.551+0000 7f145ffff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14600c0870 con 0x7f14600c0100 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.551+0000 7f145ffff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14600a79d0 con 0x7f1460159e50 2023-12-08T08:18:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.551+0000 7f145ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14600c0b50 con 0x7f146015b580 2023-12-08T08:18:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f14567fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14600c0100 0x7f146006c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56246/0 (socket says 172.21.15.45:56246) 2023-12-08T08:18:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f14567fc640 1 -- 172.21.15.45:0/1019350631 learned_addr learned my addr 172.21.15.45:0/1019350631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145f7fe640 1 --2- 172.21.15.45:0/1019350631 >> v2:172.21.15.45:3300/0 conn(0x7f1460159e50 0x7f146015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145effd640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f146015b580 0x7f14601587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145e7fc640 1 -- 172.21.15.45:0/1019350631 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213739908 0 0) 0x7f14600c0870 con 0x7f14600c0100 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145e7fc640 1 -- 172.21.15.45:0/1019350631 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c003520 con 0x7f14600c0100 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145f7fe640 1 -- 172.21.15.45:0/1019350631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f146015b580 msgr2=0x7f14601587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145f7fe640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f146015b580 0x7f14601587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145f7fe640 1 -- 172.21.15.45:0/1019350631 >> v1:172.21.15.45:6789/0 conn(0x7f14600c0100 legacy=0x7f146006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.552+0000 7f145f7fe640 1 -- 172.21.15.45:0/1019350631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600c0e30 con 0x7f1460159e50 2023-12-08T08:18:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.554+0000 7f145f7fe640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f146015a2e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f14580097a0 tx=0x7f145802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c2c97aef69996e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.554+0000 7f145e7fc640 1 -- 172.21.15.45:0/1019350631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458031780 con 0x7f1460159e50 2023-12-08T08:18:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.554+0000 7f145e7fc640 1 -- 172.21.15.45:0/1019350631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14580318e0 con 0x7f1460159e50 2023-12-08T08:18:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.554+0000 7f145e7fc640 1 -- 172.21.15.45:0/1019350631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458031c70 con 0x7f1460159e50 2023-12-08T08:18:57.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.554+0000 7f145ffff640 1 -- 172.21.15.45:0/1019350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 msgr2=0x7f146015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f146015a2e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f14580097a0 tx=0x7f145802b820 comp rx=0 tx=0).stop 2023-12-08T08:18:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 -- 172.21.15.45:0/1019350631 shutdown_connections 2023-12-08T08:18:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f146015a2e0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 --2- 172.21.15.45:0/1019350631 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f146015b580 0x7f14601587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 -- 172.21.15.45:0/1019350631 >> 172.21.15.45:0/1019350631 conn(0x7f14600c5780 msgr2=0x7f14600c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 -- 172.21.15.45:0/1019350631 shutdown_connections 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.555+0000 7f145ffff640 1 -- 172.21.15.45:0/1019350631 wait complete. 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.556+0000 7f145ffff640 1 Processor -- start 2023-12-08T08:18:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.557+0000 7f145ffff640 1 -- start start 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.557+0000 7f145ffff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 0x7f14600a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.557+0000 7f145ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145ffff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f146015b580 0x7f14600a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145ffff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14601ee950 con 0x7f1460159e50 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145ffff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14601f1e20 con 0x7f146015b580 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145ffff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14601f10a0 con 0x7f14600c0100 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46694/0 (socket says 172.21.15.45:46694) 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 -- 172.21.15.45:0/3553670731 learned_addr learned my addr 172.21.15.45:0/3553670731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145effd640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 0x7f14600a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 -- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 msgr2=0x7f14600a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 0x7f14600a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 -- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f146015b580 msgr2=0x7f14600a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f146015b580 0x7f14600a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f14567fc640 1 -- 172.21.15.45:0/3553670731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458009400 con 0x7f1460159e50 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.558+0000 7f145effd640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 0x7f14600a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f14567fc640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f144800c500 tx=0x7f144800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448005ce0 con 0x7f1460159e50 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448005e40 con 0x7f1460159e50 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448007330 con 0x7f1460159e50 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14600a9680 con 0x7f1460159e50 2023-12-08T08:18:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.559+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14601f1620 con 0x7f1460159e50 2023-12-08T08:18:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.560+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1460072ec0 con 0x7f1460159e50 2023-12-08T08:18:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.561+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1448007490 con 0x7f1460159e50 2023-12-08T08:18:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.562+0000 7f145cff9640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 0x7f144006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.563+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1448088d50 con 0x7f1460159e50 2023-12-08T08:18:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.563+0000 7f145effd640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 0x7f144006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.564+0000 7f145effd640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 0x7f144006d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1450009f50 tx=0x7f145000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.567+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f144808c030 con 0x7f1460159e50 2023-12-08T08:18:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.760+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14600743e0 con 0x7f1460159e50 2023-12-08T08:18:57.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.762+0000 7f145cff9640 1 -- 172.21.15.45:0/3553670731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f1448017090 con 0x7f1460159e50 2023-12-08T08:18:57.765 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:57.765 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":79,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:54.765032+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.764+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 msgr2=0x7f144006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.764+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 0x7f144006d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1450009f50 tx=0x7f145000b040 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.764+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 msgr2=0x7f14601ee410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.764+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f144800c500 tx=0x7f144800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 shutdown_connections 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f144006ae70 0x7f144006d330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f146015b580 0x7f14600a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1460159e50 0x7f14601ee410 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 --2- 172.21.15.45:0/3553670731 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14600c0100 0x7f14600a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 >> 172.21.15.45:0/3553670731 conn(0x7f14600c5780 msgr2=0x7f146015a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 shutdown_connections 2023-12-08T08:18:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:57.765+0000 7f145ffff640 1 -- 172.21.15.45:0/3553670731 wait complete. 2023-12-08T08:18:57.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:18:57.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:58.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.008+0000 7fb3bbfff640 1 Processor -- start 2023-12-08T08:18:58.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.008+0000 7fb3bbfff640 1 -- start start 2023-12-08T08:18:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bbfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc0bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bbfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc06e2f0 con 0x7fb3bc152010 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bbfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0c2940 con 0x7fb3bc0c2560 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bbfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0bb470 con 0x7fb3bc073b00 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3baffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.010+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc0bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:37600/0 (socket says 172.21.15.45:37600) 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc0bc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:47240/0 (socket says 172.21.15.45:47240) 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 -- 172.21.15.45:0/3642110089 learned_addr learned my addr 172.21.15.45:0/3642110089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 -- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 msgr2=0x7fb3bc0bc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 --2- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc0bc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 -- 172.21.15.45:0/3642110089 >> v1:172.21.15.114:6789/0 conn(0x7fb3bc152010 legacy=0x7fb3bc06dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.011+0000 7fb3baffd640 1 -- 172.21.15.45:0/3642110089 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc06c1c0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.013+0000 7fb3baffd640 1 --2- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009870 tx=0x7fb3ac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44630c5af3f5700d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.013+0000 7fb3b9ffb640 1 -- 172.21.15.45:0/3642110089 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac030840 con 0x7fb3bc0c2560 2023-12-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.013+0000 7fb3b9ffb640 1 -- 172.21.15.45:0/3642110089 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac0309a0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.013+0000 7fb3b9ffb640 1 -- 172.21.15.45:0/3642110089 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac030d30 con 0x7fb3bc0c2560 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 -- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc0c2560 msgr2=0x7fb3bc06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009870 tx=0x7fb3ac02b980 comp rx=0 tx=0).stop 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 -- 172.21.15.45:0/3642110089 shutdown_connections 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc0bc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/3642110089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc06d6a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 -- 172.21.15.45:0/3642110089 >> 172.21.15.45:0/3642110089 conn(0x7fb3bc0c6110 msgr2=0x7fb3bc0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 -- 172.21.15.45:0/3642110089 shutdown_connections 2023-12-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.014+0000 7fb3bbfff640 1 -- 172.21.15.45:0/3642110089 wait complete. 2023-12-08T08:18:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.016+0000 7fb3bbfff640 1 Processor -- start 2023-12-08T08:18:58.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.016+0000 7fb3bbfff640 1 -- start start 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc152010 0x7fb3bc155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1363f0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1ea940 con 0x7fb3bc152010 2023-12-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.017+0000 7fb3bbfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1564c0 con 0x7fb3bc073b00 2023-12-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46706/0 (socket says 172.21.15.45:46706) 2023-12-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 -- 172.21.15.45:0/300320004 learned_addr learned my addr 172.21.15.45:0/300320004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3baffd640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3bb7fe640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc152010 0x7fb3bc155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 -- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 msgr2=0x7fb3bc135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc135410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 -- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc152010 msgr2=0x7fb3bc155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc152010 0x7fb3bc155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.018+0000 7fb3ba7fc640 1 -- 172.21.15.45:0/300320004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0094d0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3ba7fc640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c480 tx=0x7fb3b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00052d0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0005430 con 0x7fb3bc0c2560 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0012870 con 0x7fb3bc0c2560 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc1561e0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.019+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1eac00 con 0x7fb3bc0c2560 2023-12-08T08:18:58.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.020+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc0673e0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.021+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3b00129d0 con 0x7fb3bc0c2560 2023-12-08T08:18:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.022+0000 7fb3a37fe640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 0x7fb3a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.023+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb3b0089060 con 0x7fb3bc0c2560 2023-12-08T08:18:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.023+0000 7fb3baffd640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 0x7fb3a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.024+0000 7fb3baffd640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 0x7fb3a806d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac036000 tx=0x7fb3ac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.027+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3b00bbe90 con 0x7fb3bc0c2560 2023-12-08T08:18:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.219+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3bc0bbc80 con 0x7fb3a806ae40 2023-12-08T08:18:58.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.233+0000 7fb3a37fe640 1 -- 172.21.15.45:0/300320004 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281654 (secure 0 0 0) 0x7fb3ac030b90 con 0x7fb3a806ae40 2023-12-08T08:18:58.239 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:58.241 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.239+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 msgr2=0x7fb3a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.239+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 0x7fb3a806d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac036000 tx=0x7fb3ac008030 comp rx=0 tx=0).stop 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.239+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 msgr2=0x7fb3bc070bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.239+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c480 tx=0x7fb3b000c940 comp rx=0 tx=0).stop 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 shutdown_connections 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb3a806ae40 0x7fb3a806d300 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3bc152010 0x7fb3bc155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3bc0c2560 0x7fb3bc070bb0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 --2- 172.21.15.45:0/300320004 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb3bc073b00 0x7fb3bc135410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 >> 172.21.15.45:0/300320004 conn(0x7fb3bc0c6110 msgr2=0x7fb3bc13a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 shutdown_connections 2023-12-08T08:18:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.240+0000 7fb3bbfff640 1 -- 172.21.15.45:0/300320004 wait complete. 2023-12-08T08:18:58.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-12-08T08:18:57.782071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245416,"kb_used_data":8456,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729304,"statfs":{"total":773094113280,"available":772842807296,"internally_reserved":0,"allocated":8658944,"data_stored":4636592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001617"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758662+0000","last_change":"2023-12-08T08:18:52.758662+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758662+0000","last_undegraded":"2023-12-08T08:18:52.758662+0000","last_fullsized":"2023-12-08T08:18:52.758662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774222+0000","last_change":"2023-12-08T08:18:52.774222+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774222+0000","last_undegraded":"2023-12-08T08:18:52.774222+0000","last_fullsized":"2023-12-08T08:18:52.774222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757711+0000","last_change":"2023-12-08T08:18:52.757711+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757711+0000","last_undegraded":"2023-12-08T08:18:52.757711+0000","last_fullsized":"2023-12-08T08:18:52.757711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766816+0000","last_change":"2023-12-08T08:18:52.766816+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766816+0000","last_undegraded":"2023-12-08T08:18:52.766816+0000","last_fullsized":"2023-12-08T08:18:52.766816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758772+0000","last_change":"2023-12-08T08:18:52.758772+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758772+0000","last_undegraded":"2023-12-08T08:18:52.758772+0000","last_fullsized":"2023-12-08T08:18:52.758772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756354+0000","last_change":"2023-12-08T08:18:52.756354+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756354+0000","last_undegraded":"2023-12-08T08:18:52.756354+0000","last_fullsized":"2023-12-08T08:18:52.756354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762325+0000","last_change":"2023-12-08T08:18:52.762325+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762325+0000","last_undegraded":"2023-12-08T08:18:52.762325+0000","last_fullsized":"2023-12-08T08:18:52.762325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766174+0000","last_change":"2023-12-08T08:18:52.766174+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766174+0000","last_undegraded":"2023-12-08T08:18:52.766174+0000","last_fullsized":"2023-12-08T08:18:52.766174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755095+0000","last_change":"2023-12-08T08:18:52.755095+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755095+0000","last_undegraded":"2023-12-08T08:18:52.755095+0000","last_fullsized":"2023-12-08T08:18:52.755095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759154+0000","last_change":"2023-12-08T08:18:52.759154+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759154+0000","last_undegraded":"2023-12-08T08:18:52.759154+0000","last_fullsized":"2023-12-08T08:18:52.759154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758563+0000","last_change":"2023-12-08T08:18:52.758563+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758563+0000","last_undegraded":"2023-12-08T08:18:52.758563+0000","last_fullsized":"2023-12-08T08:18:52.758563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758591+0000","last_change":"2023-12-08T08:18:52.758591+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758591+0000","last_undegraded":"2023-12-08T08:18:52.758591+0000","last_fullsized":"2023-12-08T08:18:52.758591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761277+0000","last_change":"2023-12-08T08:18:52.761277+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761277+0000","last_undegraded":"2023-12-08T08:18:52.761277+0000","last_fullsized":"2023-12-08T08:18:52.761277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767479+0000","last_change":"2023-12-08T08:18:52.767479+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767479+0000","last_undegraded":"2023-12-08T08:18:52.767479+0000","last_fullsized":"2023-12-08T08:18:52.767479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.765891+0000","last_change":"2023-12-08T08:18:52.765891+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.765891+0000","last_undegraded":"2023-12-08T08:18:52.765891+0000","last_fullsized":"2023-12-08T08:18:52.765891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755803+0000","last_change":"2023-12-08T08:18:52.755803+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755803+0000","last_undegraded":"2023-12-08T08:18:52.755803+0000","last_fullsized":"2023-12-08T08:18:52.755803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759761+0000","last_change":"2023-12-08T08:18:52.759761+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759761+0000","last_undegraded":"2023-12-08T08:18:52.759761+0000","last_fullsized":"2023-12-08T08:18:52.759761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757192+0000","last_change":"2023-12-08T08:18:52.757192+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757192+0000","last_undegraded":"2023-12-08T08:18:52.757192+0000","last_fullsized":"2023-12-08T08:18:52.757192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757485+0000","last_change":"2023-12-08T08:18:52.757485+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757485+0000","last_undegraded":"2023-12-08T08:18:52.757485+0000","last_fullsized":"2023-12-08T08:18:52.757485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763953+0000","last_change":"2023-12-08T08:18:52.763953+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763953+0000","last_undegraded":"2023-12-08T08:18:52.763953+0000","last_fullsized":"2023-12-08T08:18:52.763953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759957+0000","last_change":"2023-12-08T08:18:52.759957+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759957+0000","last_undegraded":"2023-12-08T08:18:52.759957+0000","last_fullsized":"2023-12-08T08:18:52.759957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761794+0000","last_change":"2023-12-08T08:18:52.761794+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761794+0000","last_undegraded":"2023-12-08T08:18:52.761794+0000","last_fullsized":"2023-12-08T08:18:52.761794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763520+0000","last_change":"2023-12-08T08:18:52.763520+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763520+0000","last_undegraded":"2023-12-08T08:18:52.763520+0000","last_fullsized":"2023-12-08T08:18:52.763520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754462+0000","last_change":"2023-12-08T08:18:52.754462+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754462+0000","last_undegraded":"2023-12-08T08:18:52.754462+0000","last_fullsized":"2023-12-08T08:18:52.754462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774141+0000","last_change":"2023-12-08T08:18:52.774141+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774141+0000","last_undegraded":"2023-12-08T08:18:52.774141+0000","last_fullsized":"2023-12-08T08:18:52.774141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764759+0000","last_change":"2023-12-08T08:18:52.764759+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764759+0000","last_undegraded":"2023-12-08T08:18:52.764759+0000","last_fullsized":"2023-12-08T08:18:52.764759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754600+0000","last_change":"2023-12-08T08:18:52.754600+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754600+0000","last_undegraded":"2023-12-08T08:18:52.754600+0000","last_fullsized":"2023-12-08T08:18:52.754600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763511+0000","last_change":"2023-12-08T08:18:52.763511+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763511+0000","last_undegraded":"2023-12-08T08:18:52.763511+0000","last_fullsized":"2023-12-08T08:18:52.763511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762598+0000","last_change":"2023-12-08T08:18:52.762598+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762598+0000","last_undegraded":"2023-12-08T08:18:52.762598+0000","last_fullsized":"2023-12-08T08:18:52.762598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760727+0000","last_change":"2023-12-08T08:18:52.760727+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760727+0000","last_undegraded":"2023-12-08T08:18:52.760727+0000","last_fullsized":"2023-12-08T08:18:52.760727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.776458+0000","last_change":"2023-12-08T08:18:52.776458+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.776458+0000","last_undegraded":"2023-12-08T08:18:52.776458+0000","last_fullsized":"2023-12-08T08:18:52.776458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755357+0000","last_change":"2023-12-08T08:18:52.755357+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755357+0000","last_undegraded":"2023-12-08T08:18:52.755357+0000","last_fullsized":"2023-12-08T08:18:52.755357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754777+0000","last_change":"2023-12-08T08:18:52.754777+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754777+0000","last_undegraded":"2023-12-08T08:18:52.754777+0000","last_fullsized":"2023-12-08T08:18:52.754777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787114+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:52.787114+0000","last_peered":"2023-12-08T08:18:52.787114+0000","last_clean":"2023-12-08T08:18:52.787114+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:52.787114+0000","last_undegraded":"2023-12-08T08:18:52.787114+0000","last_fullsized":"2023-12-08T08:18:52.787114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:11.691410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755100+0000","last_change":"2023-12-08T08:18:52.755100+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755100+0000","last_undegraded":"2023-12-08T08:18:52.755100+0000","last_fullsized":"2023-12-08T08:18:52.755100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776896+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:52.776896+0000","last_peered":"2023-12-08T08:18:52.776896+0000","last_clean":"2023-12-08T08:18:52.776896+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:52.776896+0000","last_undegraded":"2023-12-08T08:18:52.776896+0000","last_fullsized":"2023-12-08T08:18:52.776896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:11.641745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.768482+0000","last_change":"2023-12-08T08:18:52.768482+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.768482+0000","last_undegraded":"2023-12-08T08:18:52.768482+0000","last_fullsized":"2023-12-08T08:18:52.768482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787115+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:52.787115+0000","last_peered":"2023-12-08T08:18:52.787115+0000","last_clean":"2023-12-08T08:18:52.787115+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:52.787115+0000","last_undegraded":"2023-12-08T08:18:52.787115+0000","last_fullsized":"2023-12-08T08:18:52.787115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:53:59.971342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754660+0000","last_change":"2023-12-08T08:18:52.754660+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754660+0000","last_undegraded":"2023-12-08T08:18:52.754660+0000","last_fullsized":"2023-12-08T08:18:52.754660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787133+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:52.787133+0000","last_peered":"2023-12-08T08:18:52.787133+0000","last_clean":"2023-12-08T08:18:52.787133+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:52.787133+0000","last_undegraded":"2023-12-08T08:18:52.787133+0000","last_fullsized":"2023-12-08T08:18:52.787133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:16.072763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757574+0000","last_change":"2023-12-08T08:18:52.757574+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757574+0000","last_undegraded":"2023-12-08T08:18:52.757574+0000","last_fullsized":"2023-12-08T08:18:52.757574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776262+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:52.776262+0000","last_peered":"2023-12-08T08:18:52.776262+0000","last_clean":"2023-12-08T08:18:52.776262+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:52.776262+0000","last_undegraded":"2023-12-08T08:18:52.776262+0000","last_fullsized":"2023-12-08T08:18:52.776262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:49:41.592765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759007+0000","last_change":"2023-12-08T08:18:52.759007+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759007+0000","last_undegraded":"2023-12-08T08:18:52.759007+0000","last_fullsized":"2023-12-08T08:18:52.759007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779747+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:52.779747+0000","last_peered":"2023-12-08T08:18:52.779747+0000","last_clean":"2023-12-08T08:18:52.779747+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:52.779747+0000","last_undegraded":"2023-12-08T08:18:52.779747+0000","last_fullsized":"2023-12-08T08:18:52.779747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:21:47.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754175+0000","last_change":"2023-12-08T08:18:52.754175+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754175+0000","last_undegraded":"2023-12-08T08:18:52.754175+0000","last_fullsized":"2023-12-08T08:18:52.754175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778176+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:52.778176+0000","last_peered":"2023-12-08T08:18:52.778176+0000","last_clean":"2023-12-08T08:18:52.778176+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:52.778176+0000","last_undegraded":"2023-12-08T08:18:52.778176+0000","last_fullsized":"2023-12-08T08:18:52.778176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760841+0000","last_change":"2023-12-08T08:18:52.760841+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760841+0000","last_undegraded":"2023-12-08T08:18:52.760841+0000","last_fullsized":"2023-12-08T08:18:52.760841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789418+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:52.789418+0000","last_peered":"2023-12-08T08:18:52.789418+0000","last_clean":"2023-12-08T08:18:52.789418+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:52.789418+0000","last_undegraded":"2023-12-08T08:18:52.789418+0000","last_fullsized":"2023-12-08T08:18:52.789418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757179+0000","last_change":"2023-12-08T08:18:52.757179+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757179+0000","last_undegraded":"2023-12-08T08:18:52.757179+0000","last_fullsized":"2023-12-08T08:18:52.757179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778934+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:18:52.778934+0000","last_peered":"2023-12-08T08:18:52.778934+0000","last_clean":"2023-12-08T08:18:52.778934+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:18:52.778934+0000","last_undegraded":"2023-12-08T08:18:52.778934+0000","last_fullsized":"2023-12-08T08:18:52.778934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763914+0000","last_change":"2023-12-08T08:18:52.763914+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763914+0000","last_undegraded":"2023-12-08T08:18:52.763914+0000","last_fullsized":"2023-12-08T08:18:52.763914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776014+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:52.776014+0000","last_peered":"2023-12-08T08:18:52.776014+0000","last_clean":"2023-12-08T08:18:52.776014+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:52.776014+0000","last_undegraded":"2023-12-08T08:18:52.776014+0000","last_fullsized":"2023-12-08T08:18:52.776014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756740+0000","last_change":"2023-12-08T08:18:52.756740+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756740+0000","last_undegraded":"2023-12-08T08:18:52.756740+0000","last_fullsized":"2023-12-08T08:18:52.756740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775910+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:52.775910+0000","last_peered":"2023-12-08T08:18:52.775910+0000","last_clean":"2023-12-08T08:18:52.775910+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:52.775910+0000","last_undegraded":"2023-12-08T08:18:52.775910+0000","last_fullsized":"2023-12-08T08:18:52.775910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:06.037175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764182+0000","last_change":"2023-12-08T08:18:52.764182+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764182+0000","last_undegraded":"2023-12-08T08:18:52.764182+0000","last_fullsized":"2023-12-08T08:18:52.764182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783301+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:18:52.783301+0000","last_peered":"2023-12-08T08:18:52.783301+0000","last_clean":"2023-12-08T08:18:52.783301+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:18:52.783301+0000","last_undegraded":"2023-12-08T08:18:52.783301+0000","last_fullsized":"2023-12-08T08:18:52.783301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756970+0000","last_change":"2023-12-08T08:18:52.756970+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756970+0000","last_undegraded":"2023-12-08T08:18:52.756970+0000","last_fullsized":"2023-12-08T08:18:52.756970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789449+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:52.789449+0000","last_peered":"2023-12-08T08:18:52.789449+0000","last_clean":"2023-12-08T08:18:52.789449+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:52.789449+0000","last_undegraded":"2023-12-08T08:18:52.789449+0000","last_fullsized":"2023-12-08T08:18:52.789449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.647947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752588+0000","last_change":"2023-12-08T08:18:52.752588+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752588+0000","last_undegraded":"2023-12-08T08:18:52.752588+0000","last_fullsized":"2023-12-08T08:18:52.752588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.782761+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:52.782761+0000","last_peered":"2023-12-08T08:18:52.782761+0000","last_clean":"2023-12-08T08:18:52.782761+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:52.782761+0000","last_undegraded":"2023-12-08T08:18:52.782761+0000","last_fullsized":"2023-12-08T08:18:52.782761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755606+0000","last_change":"2023-12-08T08:18:52.755606+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755606+0000","last_undegraded":"2023-12-08T08:18:52.755606+0000","last_fullsized":"2023-12-08T08:18:52.755606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783087+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:52.783087+0000","last_peered":"2023-12-08T08:18:52.783087+0000","last_clean":"2023-12-08T08:18:52.783087+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:52.783087+0000","last_undegraded":"2023-12-08T08:18:52.783087+0000","last_fullsized":"2023-12-08T08:18:52.783087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:19.455016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757505+0000","last_change":"2023-12-08T08:18:52.757505+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757505+0000","last_undegraded":"2023-12-08T08:18:52.757505+0000","last_fullsized":"2023-12-08T08:18:52.757505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.771981+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:52.771981+0000","last_peered":"2023-12-08T08:18:52.771981+0000","last_clean":"2023-12-08T08:18:52.771981+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:52.771981+0000","last_undegraded":"2023-12-08T08:18:52.771981+0000","last_fullsized":"2023-12-08T08:18:52.771981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:28:27.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754288+0000","last_change":"2023-12-08T08:18:52.754288+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754288+0000","last_undegraded":"2023-12-08T08:18:52.754288+0000","last_fullsized":"2023-12-08T08:18:52.754288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787136+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:52.787136+0000","last_peered":"2023-12-08T08:18:52.787136+0000","last_clean":"2023-12-08T08:18:52.787136+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:52.787136+0000","last_undegraded":"2023-12-08T08:18:52.787136+0000","last_fullsized":"2023-12-08T08:18:52.787136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:51:53.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761702+0000","last_change":"2023-12-08T08:18:52.761702+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761702+0000","last_undegraded":"2023-12-08T08:18:52.761702+0000","last_fullsized":"2023-12-08T08:18:52.761702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789463+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:52.789463+0000","last_peered":"2023-12-08T08:18:52.789463+0000","last_clean":"2023-12-08T08:18:52.789463+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:52.789463+0000","last_undegraded":"2023-12-08T08:18:52.789463+0000","last_fullsized":"2023-12-08T08:18:52.789463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761845+0000","last_change":"2023-12-08T08:18:52.761845+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761845+0000","last_undegraded":"2023-12-08T08:18:52.761845+0000","last_fullsized":"2023-12-08T08:18:52.761845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775928+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:52.775928+0000","last_peered":"2023-12-08T08:18:52.775928+0000","last_clean":"2023-12-08T08:18:52.775928+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:52.775928+0000","last_undegraded":"2023-12-08T08:18:52.775928+0000","last_fullsized":"2023-12-08T08:18:52.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:32.930738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752737+0000","last_change":"2023-12-08T08:18:52.752737+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752737+0000","last_undegraded":"2023-12-08T08:18:52.752737+0000","last_fullsized":"2023-12-08T08:18:52.752737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.781143+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:18:52.781143+0000","last_peered":"2023-12-08T08:18:52.781143+0000","last_clean":"2023-12-08T08:18:52.781143+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:18:52.781143+0000","last_undegraded":"2023-12-08T08:18:52.781143+0000","last_fullsized":"2023-12-08T08:18:52.781143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.775067+0000","last_change":"2023-12-08T08:18:52.775067+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.775067+0000","last_undegraded":"2023-12-08T08:18:52.775067+0000","last_fullsized":"2023-12-08T08:18:52.775067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776609+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:52.776609+0000","last_peered":"2023-12-08T08:18:52.776609+0000","last_clean":"2023-12-08T08:18:52.776609+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:52.776609+0000","last_undegraded":"2023-12-08T08:18:52.776609+0000","last_fullsized":"2023-12-08T08:18:52.776609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:26:54.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773299+0000","last_change":"2023-12-08T08:18:52.773299+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773299+0000","last_undegraded":"2023-12-08T08:18:52.773299+0000","last_fullsized":"2023-12-08T08:18:52.773299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.780121+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:18:52.780121+0000","last_peered":"2023-12-08T08:18:52.780121+0000","last_clean":"2023-12-08T08:18:52.780121+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:18:52.780121+0000","last_undegraded":"2023-12-08T08:18:52.780121+0000","last_fullsized":"2023-12-08T08:18:52.780121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.753596+0000","last_change":"2023-12-08T08:18:52.753596+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.753596+0000","last_undegraded":"2023-12-08T08:18:52.753596+0000","last_fullsized":"2023-12-08T08:18:52.753596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779082+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:52.779082+0000","last_peered":"2023-12-08T08:18:52.779082+0000","last_clean":"2023-12-08T08:18:52.779082+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:52.779082+0000","last_undegraded":"2023-12-08T08:18:52.779082+0000","last_fullsized":"2023-12-08T08:18:52.779082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:03:34.544099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767818+0000","last_change":"2023-12-08T08:18:52.767818+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767818+0000","last_undegraded":"2023-12-08T08:18:52.767818+0000","last_fullsized":"2023-12-08T08:18:52.767818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.790035+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:52.790035+0000","last_peered":"2023-12-08T08:18:52.790035+0000","last_clean":"2023-12-08T08:18:52.790035+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:52.790035+0000","last_undegraded":"2023-12-08T08:18:52.790035+0000","last_fullsized":"2023-12-08T08:18:52.790035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:08.702449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752626+0000","last_change":"2023-12-08T08:18:52.752626+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752626+0000","last_undegraded":"2023-12-08T08:18:52.752626+0000","last_fullsized":"2023-12-08T08:18:52.752626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783797+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:52.783797+0000","last_peered":"2023-12-08T08:18:52.783797+0000","last_clean":"2023-12-08T08:18:52.783797+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:52.783797+0000","last_undegraded":"2023-12-08T08:18:52.783797+0000","last_fullsized":"2023-12-08T08:18:52.783797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:42.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752368+0000","last_change":"2023-12-08T08:18:52.752368+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752368+0000","last_undegraded":"2023-12-08T08:18:52.752368+0000","last_fullsized":"2023-12-08T08:18:52.752368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775890+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:52.775890+0000","last_peered":"2023-12-08T08:18:52.775890+0000","last_clean":"2023-12-08T08:18:52.775890+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:52.775890+0000","last_undegraded":"2023-12-08T08:18:52.775890+0000","last_fullsized":"2023-12-08T08:18:52.775890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:52.964347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773594+0000","last_change":"2023-12-08T08:18:52.773594+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773594+0000","last_undegraded":"2023-12-08T08:18:52.773594+0000","last_fullsized":"2023-12-08T08:18:52.773594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779243+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:52.779243+0000","last_peered":"2023-12-08T08:18:52.779243+0000","last_clean":"2023-12-08T08:18:52.779243+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:52.779243+0000","last_undegraded":"2023-12-08T08:18:52.779243+0000","last_fullsized":"2023-12-08T08:18:52.779243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:06.479309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754146+0000","last_change":"2023-12-08T08:18:52.754146+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754146+0000","last_undegraded":"2023-12-08T08:18:52.754146+0000","last_fullsized":"2023-12-08T08:18:52.754146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.777518+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:52.777518+0000","last_peered":"2023-12-08T08:18:52.777518+0000","last_clean":"2023-12-08T08:18:52.777518+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:52.777518+0000","last_undegraded":"2023-12-08T08:18:52.777518+0000","last_fullsized":"2023-12-08T08:18:52.777518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755487+0000","last_change":"2023-12-08T08:18:52.755487+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755487+0000","last_undegraded":"2023-12-08T08:18:52.755487+0000","last_fullsized":"2023-12-08T08:18:52.755487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779279+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:18:52.779279+0000","last_peered":"2023-12-08T08:18:52.779279+0000","last_clean":"2023-12-08T08:18:52.779279+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:18:52.779279+0000","last_undegraded":"2023-12-08T08:18:52.779279+0000","last_fullsized":"2023-12-08T08:18:52.779279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761470+0000","last_change":"2023-12-08T08:18:52.761470+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761470+0000","last_undegraded":"2023-12-08T08:18:52.761470+0000","last_fullsized":"2023-12-08T08:18:52.761470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.784161+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:52.784161+0000","last_peered":"2023-12-08T08:18:52.784161+0000","last_clean":"2023-12-08T08:18:52.784161+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:52.784161+0000","last_undegraded":"2023-12-08T08:18:52.784161+0000","last_fullsized":"2023-12-08T08:18:52.784161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:10:02.436174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752317+0000","last_change":"2023-12-08T08:18:52.752317+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752317+0000","last_undegraded":"2023-12-08T08:18:52.752317+0000","last_fullsized":"2023-12-08T08:18:52.752317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787192+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:52.787192+0000","last_peered":"2023-12-08T08:18:52.787192+0000","last_clean":"2023-12-08T08:18:52.787192+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:52.787192+0000","last_undegraded":"2023-12-08T08:18:52.787192+0000","last_fullsized":"2023-12-08T08:18:52.787192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:10.099547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764535+0000","last_change":"2023-12-08T08:18:52.764535+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764535+0000","last_undegraded":"2023-12-08T08:18:52.764535+0000","last_fullsized":"2023-12-08T08:18:52.764535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783552+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:52.783552+0000","last_peered":"2023-12-08T08:18:52.783552+0000","last_clean":"2023-12-08T08:18:52.783552+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:52.783552+0000","last_undegraded":"2023-12-08T08:18:52.783552+0000","last_fullsized":"2023-12-08T08:18:52.783552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:22.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-08T08:18:51.735559+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:51.735559+0000","last_peered":"2023-12-08T08:18:51.735559+0000","last_clean":"2023-12-08T08:18:51.735559+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:51.735559+0000","last_undegraded":"2023-12-08T08:18:51.735559+0000","last_fullsized":"2023-12-08T08:18:51.735559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.726}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.9390000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.073},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.5600000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.3120000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.0409999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6160000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":2.0859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6850000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.9950000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.5069999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":4.6319999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":3.835}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":6.5620000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":7.2539999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":8.0719999999999992},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":6.6040000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":3.8919999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":8.6150000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":6.4370000000000003},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":7.0430000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":8.0039999999999996},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":3.9209999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":7.1989999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":8.532}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.1459999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4410000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.343},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.375}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.5409999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.492},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.712}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":1.0349999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.4039999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.28}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4530000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.2210000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.611},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.55}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1359999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.7290000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.946},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.51}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.0649999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.427}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.333}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.363},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4730000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.501},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":0.91500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.622},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.76500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.4350000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.2150000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.083},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.286}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1819999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.399}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.474},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:58.269 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:58.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.530+0000 7fe87d31d640 1 Processor -- start 2023-12-08T08:18:58.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.530+0000 7fe87d31d640 1 -- start start 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe87d31d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87814e800 0x7fe878155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe87d31d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 0x7fe8780ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe87d31d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe878155540 con 0x7fe8781581c0 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe87d31d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780c4880 con 0x7fe87814e800 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe87d31d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c4b60 con 0x7fe8780ca0e0 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.532+0000 7fe876ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87814e800 0x7fe878155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87814e800 0x7fe878155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46716/0 (socket says 172.21.15.45:46716) 2023-12-08T08:18:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 -- 172.21.15.45:0/2070047594 learned_addr learned my addr 172.21.15.45:0/2070047594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 -- 172.21.15.45:0/2070047594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 msgr2=0x7fe8780ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe8767fc640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 0x7fe8780ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 0x7fe8780ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 -- 172.21.15.45:0/2070047594 >> v1:172.21.15.114:6789/0 conn(0x7fe8781581c0 legacy=0x7fe8780c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe876ffd640 1 -- 172.21.15.45:0/2070047594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780c4e40 con 0x7fe87814e800 2023-12-08T08:18:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.533+0000 7fe8767fc640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 0x7fe8780ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.534+0000 7fe876ffd640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe878155000 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e50 tx=0x7fe86802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b1db3a20986091 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe875ffb640 1 -- 172.21.15.45:0/2070047594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86802c960 con 0x7fe87814e800 2023-12-08T08:18:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe875ffb640 1 -- 172.21.15.45:0/2070047594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86802cac0 con 0x7fe87814e800 2023-12-08T08:18:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe875ffb640 1 -- 172.21.15.45:0/2070047594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86802ce50 con 0x7fe87814e800 2023-12-08T08:18:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe87d31d640 1 -- 172.21.15.45:0/2070047594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 msgr2=0x7fe878155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe87d31d640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe878155000 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e50 tx=0x7fe86802bdc0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe87d31d640 1 -- 172.21.15.45:0/2070047594 shutdown_connections 2023-12-08T08:18:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe87d31d640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8780ca0e0 0x7fe8780ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.535+0000 7fe87d31d640 1 --2- 172.21.15.45:0/2070047594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe878155000 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.536+0000 7fe87d31d640 1 -- 172.21.15.45:0/2070047594 >> 172.21.15.45:0/2070047594 conn(0x7fe8780663d0 msgr2=0x7fe8780667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.536+0000 7fe87d31d640 1 -- 172.21.15.45:0/2070047594 shutdown_connections 2023-12-08T08:18:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.536+0000 7fe87d31d640 1 -- 172.21.15.45:0/2070047594 wait complete. 2023-12-08T08:18:58.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.538+0000 7fe87d31d640 1 Processor -- start 2023-12-08T08:18:58.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.538+0000 7fe87d31d640 1 -- start start 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 0x7fe87814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 0x7fe8780bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c0a30 con 0x7fe87814e800 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780beb10 con 0x7fe8780ca0e0 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.539+0000 7fe87d31d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780bedf0 con 0x7fe8781581c0 2023-12-08T08:18:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46720/0 (socket says 172.21.15.45:46720) 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 -- 172.21.15.45:0/1909850629 learned_addr learned my addr 172.21.15.45:0/1909850629 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe876ffd640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 0x7fe87814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8777fe640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 0x7fe8780bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 -- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 msgr2=0x7fe8780bf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 0x7fe8780bf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 -- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 msgr2=0x7fe87814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 0x7fe87814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8767fc640 1 -- 172.21.15.45:0/1909850629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009b30 con 0x7fe87814e800 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe876ffd640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 0x7fe87814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.540+0000 7fe8777fe640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 0x7fe8780bf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe8767fc640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c7f0 tx=0x7fe86000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860007820 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe860007980 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860007cf0 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8780bf0d0 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.541+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8780c1e60 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.542+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878074600 con 0x7fe87814e800 2023-12-08T08:18:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.543+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8600113f0 con 0x7fe87814e800 2023-12-08T08:18:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.544+0000 7fe86f7fe640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 0x7fe85806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.544+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe860089a70 con 0x7fe87814e800 2023-12-08T08:18:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.544+0000 7fe876ffd640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 0x7fe85806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.545+0000 7fe876ffd640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 0x7fe85806d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe868035000 tx=0x7fe868030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.548+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8600549d0 con 0x7fe87814e800 2023-12-08T08:18:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.740+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8780bec80 con 0x7fe85806ae40 2023-12-08T08:18:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.762+0000 7fe86f7fe640 1 -- 172.21.15.45:0/1909850629 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281654 (secure 0 0 0) 0x7fe8780bec80 con 0x7fe85806ae40 2023-12-08T08:18:58.769 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:58.771 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:58.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 msgr2=0x7fe85806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 0x7fe85806d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe868035000 tx=0x7fe868030000 comp rx=0 tx=0).stop 2023-12-08T08:18:58.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 msgr2=0x7fe8780c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c7f0 tx=0x7fe86000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 shutdown_connections 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe85806ae40 0x7fe85806d300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe8781581c0 0x7fe8780bf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe87814e800 0x7fe8780c1920 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 --2- 172.21.15.45:0/1909850629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8780ca0e0 0x7fe87814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.768+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 >> 172.21.15.45:0/1909850629 conn(0x7fe8780663d0 msgr2=0x7fe8780667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.769+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 shutdown_connections 2023-12-08T08:18:58.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:58.769+0000 7fe87d31d640 1 -- 172.21.15.45:0/1909850629 wait complete. 2023-12-08T08:18:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-12-08T08:18:57.782071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245416,"kb_used_data":8456,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729304,"statfs":{"total":773094113280,"available":772842807296,"internally_reserved":0,"allocated":8658944,"data_stored":4636592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001617"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758662+0000","last_change":"2023-12-08T08:18:52.758662+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758662+0000","last_undegraded":"2023-12-08T08:18:52.758662+0000","last_fullsized":"2023-12-08T08:18:52.758662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774222+0000","last_change":"2023-12-08T08:18:52.774222+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774222+0000","last_undegraded":"2023-12-08T08:18:52.774222+0000","last_fullsized":"2023-12-08T08:18:52.774222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757711+0000","last_change":"2023-12-08T08:18:52.757711+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757711+0000","last_undegraded":"2023-12-08T08:18:52.757711+0000","last_fullsized":"2023-12-08T08:18:52.757711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766816+0000","last_change":"2023-12-08T08:18:52.766816+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766816+0000","last_undegraded":"2023-12-08T08:18:52.766816+0000","last_fullsized":"2023-12-08T08:18:52.766816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758772+0000","last_change":"2023-12-08T08:18:52.758772+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758772+0000","last_undegraded":"2023-12-08T08:18:52.758772+0000","last_fullsized":"2023-12-08T08:18:52.758772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756354+0000","last_change":"2023-12-08T08:18:52.756354+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756354+0000","last_undegraded":"2023-12-08T08:18:52.756354+0000","last_fullsized":"2023-12-08T08:18:52.756354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762325+0000","last_change":"2023-12-08T08:18:52.762325+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762325+0000","last_undegraded":"2023-12-08T08:18:52.762325+0000","last_fullsized":"2023-12-08T08:18:52.762325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766174+0000","last_change":"2023-12-08T08:18:52.766174+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766174+0000","last_undegraded":"2023-12-08T08:18:52.766174+0000","last_fullsized":"2023-12-08T08:18:52.766174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755095+0000","last_change":"2023-12-08T08:18:52.755095+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755095+0000","last_undegraded":"2023-12-08T08:18:52.755095+0000","last_fullsized":"2023-12-08T08:18:52.755095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759154+0000","last_change":"2023-12-08T08:18:52.759154+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759154+0000","last_undegraded":"2023-12-08T08:18:52.759154+0000","last_fullsized":"2023-12-08T08:18:52.759154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758563+0000","last_change":"2023-12-08T08:18:52.758563+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758563+0000","last_undegraded":"2023-12-08T08:18:52.758563+0000","last_fullsized":"2023-12-08T08:18:52.758563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758591+0000","last_change":"2023-12-08T08:18:52.758591+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758591+0000","last_undegraded":"2023-12-08T08:18:52.758591+0000","last_fullsized":"2023-12-08T08:18:52.758591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761277+0000","last_change":"2023-12-08T08:18:52.761277+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761277+0000","last_undegraded":"2023-12-08T08:18:52.761277+0000","last_fullsized":"2023-12-08T08:18:52.761277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767479+0000","last_change":"2023-12-08T08:18:52.767479+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767479+0000","last_undegraded":"2023-12-08T08:18:52.767479+0000","last_fullsized":"2023-12-08T08:18:52.767479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.765891+0000","last_change":"2023-12-08T08:18:52.765891+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.765891+0000","last_undegraded":"2023-12-08T08:18:52.765891+0000","last_fullsized":"2023-12-08T08:18:52.765891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755803+0000","last_change":"2023-12-08T08:18:52.755803+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755803+0000","last_undegraded":"2023-12-08T08:18:52.755803+0000","last_fullsized":"2023-12-08T08:18:52.755803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759761+0000","last_change":"2023-12-08T08:18:52.759761+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759761+0000","last_undegraded":"2023-12-08T08:18:52.759761+0000","last_fullsized":"2023-12-08T08:18:52.759761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757192+0000","last_change":"2023-12-08T08:18:52.757192+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757192+0000","last_undegraded":"2023-12-08T08:18:52.757192+0000","last_fullsized":"2023-12-08T08:18:52.757192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757485+0000","last_change":"2023-12-08T08:18:52.757485+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757485+0000","last_undegraded":"2023-12-08T08:18:52.757485+0000","last_fullsized":"2023-12-08T08:18:52.757485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763953+0000","last_change":"2023-12-08T08:18:52.763953+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763953+0000","last_undegraded":"2023-12-08T08:18:52.763953+0000","last_fullsized":"2023-12-08T08:18:52.763953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759957+0000","last_change":"2023-12-08T08:18:52.759957+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759957+0000","last_undegraded":"2023-12-08T08:18:52.759957+0000","last_fullsized":"2023-12-08T08:18:52.759957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761794+0000","last_change":"2023-12-08T08:18:52.761794+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761794+0000","last_undegraded":"2023-12-08T08:18:52.761794+0000","last_fullsized":"2023-12-08T08:18:52.761794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763520+0000","last_change":"2023-12-08T08:18:52.763520+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763520+0000","last_undegraded":"2023-12-08T08:18:52.763520+0000","last_fullsized":"2023-12-08T08:18:52.763520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754462+0000","last_change":"2023-12-08T08:18:52.754462+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754462+0000","last_undegraded":"2023-12-08T08:18:52.754462+0000","last_fullsized":"2023-12-08T08:18:52.754462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774141+0000","last_change":"2023-12-08T08:18:52.774141+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774141+0000","last_undegraded":"2023-12-08T08:18:52.774141+0000","last_fullsized":"2023-12-08T08:18:52.774141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764759+0000","last_change":"2023-12-08T08:18:52.764759+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764759+0000","last_undegraded":"2023-12-08T08:18:52.764759+0000","last_fullsized":"2023-12-08T08:18:52.764759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754600+0000","last_change":"2023-12-08T08:18:52.754600+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754600+0000","last_undegraded":"2023-12-08T08:18:52.754600+0000","last_fullsized":"2023-12-08T08:18:52.754600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763511+0000","last_change":"2023-12-08T08:18:52.763511+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763511+0000","last_undegraded":"2023-12-08T08:18:52.763511+0000","last_fullsized":"2023-12-08T08:18:52.763511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762598+0000","last_change":"2023-12-08T08:18:52.762598+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762598+0000","last_undegraded":"2023-12-08T08:18:52.762598+0000","last_fullsized":"2023-12-08T08:18:52.762598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760727+0000","last_change":"2023-12-08T08:18:52.760727+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760727+0000","last_undegraded":"2023-12-08T08:18:52.760727+0000","last_fullsized":"2023-12-08T08:18:52.760727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.776458+0000","last_change":"2023-12-08T08:18:52.776458+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.776458+0000","last_undegraded":"2023-12-08T08:18:52.776458+0000","last_fullsized":"2023-12-08T08:18:52.776458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755357+0000","last_change":"2023-12-08T08:18:52.755357+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755357+0000","last_undegraded":"2023-12-08T08:18:52.755357+0000","last_fullsized":"2023-12-08T08:18:52.755357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754777+0000","last_change":"2023-12-08T08:18:52.754777+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754777+0000","last_undegraded":"2023-12-08T08:18:52.754777+0000","last_fullsized":"2023-12-08T08:18:52.754777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787114+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:52.787114+0000","last_peered":"2023-12-08T08:18:52.787114+0000","last_clean":"2023-12-08T08:18:52.787114+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:52.787114+0000","last_undegraded":"2023-12-08T08:18:52.787114+0000","last_fullsized":"2023-12-08T08:18:52.787114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:11.691410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755100+0000","last_change":"2023-12-08T08:18:52.755100+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755100+0000","last_undegraded":"2023-12-08T08:18:52.755100+0000","last_fullsized":"2023-12-08T08:18:52.755100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776896+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:52.776896+0000","last_peered":"2023-12-08T08:18:52.776896+0000","last_clean":"2023-12-08T08:18:52.776896+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:52.776896+0000","last_undegraded":"2023-12-08T08:18:52.776896+0000","last_fullsized":"2023-12-08T08:18:52.776896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:11.641745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.768482+0000","last_change":"2023-12-08T08:18:52.768482+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.768482+0000","last_undegraded":"2023-12-08T08:18:52.768482+0000","last_fullsized":"2023-12-08T08:18:52.768482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787115+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:52.787115+0000","last_peered":"2023-12-08T08:18:52.787115+0000","last_clean":"2023-12-08T08:18:52.787115+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:52.787115+0000","last_undegraded":"2023-12-08T08:18:52.787115+0000","last_fullsized":"2023-12-08T08:18:52.787115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:53:59.971342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754660+0000","last_change":"2023-12-08T08:18:52.754660+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754660+0000","last_undegraded":"2023-12-08T08:18:52.754660+0000","last_fullsized":"2023-12-08T08:18:52.754660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787133+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:52.787133+0000","last_peered":"2023-12-08T08:18:52.787133+0000","last_clean":"2023-12-08T08:18:52.787133+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:52.787133+0000","last_undegraded":"2023-12-08T08:18:52.787133+0000","last_fullsized":"2023-12-08T08:18:52.787133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:16.072763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757574+0000","last_change":"2023-12-08T08:18:52.757574+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757574+0000","last_undegraded":"2023-12-08T08:18:52.757574+0000","last_fullsized":"2023-12-08T08:18:52.757574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776262+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:52.776262+0000","last_peered":"2023-12-08T08:18:52.776262+0000","last_clean":"2023-12-08T08:18:52.776262+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:52.776262+0000","last_undegraded":"2023-12-08T08:18:52.776262+0000","last_fullsized":"2023-12-08T08:18:52.776262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:49:41.592765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759007+0000","last_change":"2023-12-08T08:18:52.759007+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759007+0000","last_undegraded":"2023-12-08T08:18:52.759007+0000","last_fullsized":"2023-12-08T08:18:52.759007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779747+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:52.779747+0000","last_peered":"2023-12-08T08:18:52.779747+0000","last_clean":"2023-12-08T08:18:52.779747+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:52.779747+0000","last_undegraded":"2023-12-08T08:18:52.779747+0000","last_fullsized":"2023-12-08T08:18:52.779747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:21:47.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754175+0000","last_change":"2023-12-08T08:18:52.754175+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754175+0000","last_undegraded":"2023-12-08T08:18:52.754175+0000","last_fullsized":"2023-12-08T08:18:52.754175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778176+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:52.778176+0000","last_peered":"2023-12-08T08:18:52.778176+0000","last_clean":"2023-12-08T08:18:52.778176+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:52.778176+0000","last_undegraded":"2023-12-08T08:18:52.778176+0000","last_fullsized":"2023-12-08T08:18:52.778176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760841+0000","last_change":"2023-12-08T08:18:52.760841+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760841+0000","last_undegraded":"2023-12-08T08:18:52.760841+0000","last_fullsized":"2023-12-08T08:18:52.760841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789418+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:52.789418+0000","last_peered":"2023-12-08T08:18:52.789418+0000","last_clean":"2023-12-08T08:18:52.789418+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:52.789418+0000","last_undegraded":"2023-12-08T08:18:52.789418+0000","last_fullsized":"2023-12-08T08:18:52.789418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757179+0000","last_change":"2023-12-08T08:18:52.757179+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757179+0000","last_undegraded":"2023-12-08T08:18:52.757179+0000","last_fullsized":"2023-12-08T08:18:52.757179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778934+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:18:52.778934+0000","last_peered":"2023-12-08T08:18:52.778934+0000","last_clean":"2023-12-08T08:18:52.778934+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:18:52.778934+0000","last_undegraded":"2023-12-08T08:18:52.778934+0000","last_fullsized":"2023-12-08T08:18:52.778934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763914+0000","last_change":"2023-12-08T08:18:52.763914+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763914+0000","last_undegraded":"2023-12-08T08:18:52.763914+0000","last_fullsized":"2023-12-08T08:18:52.763914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776014+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:52.776014+0000","last_peered":"2023-12-08T08:18:52.776014+0000","last_clean":"2023-12-08T08:18:52.776014+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:52.776014+0000","last_undegraded":"2023-12-08T08:18:52.776014+0000","last_fullsized":"2023-12-08T08:18:52.776014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756740+0000","last_change":"2023-12-08T08:18:52.756740+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756740+0000","last_undegraded":"2023-12-08T08:18:52.756740+0000","last_fullsized":"2023-12-08T08:18:52.756740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775910+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:52.775910+0000","last_peered":"2023-12-08T08:18:52.775910+0000","last_clean":"2023-12-08T08:18:52.775910+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:52.775910+0000","last_undegraded":"2023-12-08T08:18:52.775910+0000","last_fullsized":"2023-12-08T08:18:52.775910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:06.037175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764182+0000","last_change":"2023-12-08T08:18:52.764182+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764182+0000","last_undegraded":"2023-12-08T08:18:52.764182+0000","last_fullsized":"2023-12-08T08:18:52.764182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783301+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:18:52.783301+0000","last_peered":"2023-12-08T08:18:52.783301+0000","last_clean":"2023-12-08T08:18:52.783301+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:18:52.783301+0000","last_undegraded":"2023-12-08T08:18:52.783301+0000","last_fullsized":"2023-12-08T08:18:52.783301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756970+0000","last_change":"2023-12-08T08:18:52.756970+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756970+0000","last_undegraded":"2023-12-08T08:18:52.756970+0000","last_fullsized":"2023-12-08T08:18:52.756970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789449+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:52.789449+0000","last_peered":"2023-12-08T08:18:52.789449+0000","last_clean":"2023-12-08T08:18:52.789449+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:52.789449+0000","last_undegraded":"2023-12-08T08:18:52.789449+0000","last_fullsized":"2023-12-08T08:18:52.789449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.647947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752588+0000","last_change":"2023-12-08T08:18:52.752588+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752588+0000","last_undegraded":"2023-12-08T08:18:52.752588+0000","last_fullsized":"2023-12-08T08:18:52.752588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.782761+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:52.782761+0000","last_peered":"2023-12-08T08:18:52.782761+0000","last_clean":"2023-12-08T08:18:52.782761+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:52.782761+0000","last_undegraded":"2023-12-08T08:18:52.782761+0000","last_fullsized":"2023-12-08T08:18:52.782761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755606+0000","last_change":"2023-12-08T08:18:52.755606+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755606+0000","last_undegraded":"2023-12-08T08:18:52.755606+0000","last_fullsized":"2023-12-08T08:18:52.755606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783087+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:52.783087+0000","last_peered":"2023-12-08T08:18:52.783087+0000","last_clean":"2023-12-08T08:18:52.783087+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:52.783087+0000","last_undegraded":"2023-12-08T08:18:52.783087+0000","last_fullsized":"2023-12-08T08:18:52.783087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:19.455016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757505+0000","last_change":"2023-12-08T08:18:52.757505+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757505+0000","last_undegraded":"2023-12-08T08:18:52.757505+0000","last_fullsized":"2023-12-08T08:18:52.757505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.771981+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:52.771981+0000","last_peered":"2023-12-08T08:18:52.771981+0000","last_clean":"2023-12-08T08:18:52.771981+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:52.771981+0000","last_undegraded":"2023-12-08T08:18:52.771981+0000","last_fullsized":"2023-12-08T08:18:52.771981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:28:27.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754288+0000","last_change":"2023-12-08T08:18:52.754288+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754288+0000","last_undegraded":"2023-12-08T08:18:52.754288+0000","last_fullsized":"2023-12-08T08:18:52.754288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787136+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:52.787136+0000","last_peered":"2023-12-08T08:18:52.787136+0000","last_clean":"2023-12-08T08:18:52.787136+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:52.787136+0000","last_undegraded":"2023-12-08T08:18:52.787136+0000","last_fullsized":"2023-12-08T08:18:52.787136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:51:53.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761702+0000","last_change":"2023-12-08T08:18:52.761702+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761702+0000","last_undegraded":"2023-12-08T08:18:52.761702+0000","last_fullsized":"2023-12-08T08:18:52.761702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789463+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:52.789463+0000","last_peered":"2023-12-08T08:18:52.789463+0000","last_clean":"2023-12-08T08:18:52.789463+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:52.789463+0000","last_undegraded":"2023-12-08T08:18:52.789463+0000","last_fullsized":"2023-12-08T08:18:52.789463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761845+0000","last_change":"2023-12-08T08:18:52.761845+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761845+0000","last_undegraded":"2023-12-08T08:18:52.761845+0000","last_fullsized":"2023-12-08T08:18:52.761845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775928+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:52.775928+0000","last_peered":"2023-12-08T08:18:52.775928+0000","last_clean":"2023-12-08T08:18:52.775928+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:52.775928+0000","last_undegraded":"2023-12-08T08:18:52.775928+0000","last_fullsized":"2023-12-08T08:18:52.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:32.930738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752737+0000","last_change":"2023-12-08T08:18:52.752737+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752737+0000","last_undegraded":"2023-12-08T08:18:52.752737+0000","last_fullsized":"2023-12-08T08:18:52.752737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.781143+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:18:52.781143+0000","last_peered":"2023-12-08T08:18:52.781143+0000","last_clean":"2023-12-08T08:18:52.781143+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:18:52.781143+0000","last_undegraded":"2023-12-08T08:18:52.781143+0000","last_fullsized":"2023-12-08T08:18:52.781143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.775067+0000","last_change":"2023-12-08T08:18:52.775067+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.775067+0000","last_undegraded":"2023-12-08T08:18:52.775067+0000","last_fullsized":"2023-12-08T08:18:52.775067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776609+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:52.776609+0000","last_peered":"2023-12-08T08:18:52.776609+0000","last_clean":"2023-12-08T08:18:52.776609+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:52.776609+0000","last_undegraded":"2023-12-08T08:18:52.776609+0000","last_fullsized":"2023-12-08T08:18:52.776609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:26:54.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773299+0000","last_change":"2023-12-08T08:18:52.773299+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773299+0000","last_undegraded":"2023-12-08T08:18:52.773299+0000","last_fullsized":"2023-12-08T08:18:52.773299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.780121+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:18:52.780121+0000","last_peered":"2023-12-08T08:18:52.780121+0000","last_clean":"2023-12-08T08:18:52.780121+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:18:52.780121+0000","last_undegraded":"2023-12-08T08:18:52.780121+0000","last_fullsized":"2023-12-08T08:18:52.780121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.753596+0000","last_change":"2023-12-08T08:18:52.753596+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.753596+0000","last_undegraded":"2023-12-08T08:18:52.753596+0000","last_fullsized":"2023-12-08T08:18:52.753596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779082+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:52.779082+0000","last_peered":"2023-12-08T08:18:52.779082+0000","last_clean":"2023-12-08T08:18:52.779082+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:52.779082+0000","last_undegraded":"2023-12-08T08:18:52.779082+0000","last_fullsized":"2023-12-08T08:18:52.779082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:03:34.544099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767818+0000","last_change":"2023-12-08T08:18:52.767818+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767818+0000","last_undegraded":"2023-12-08T08:18:52.767818+0000","last_fullsized":"2023-12-08T08:18:52.767818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.790035+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:52.790035+0000","last_peered":"2023-12-08T08:18:52.790035+0000","last_clean":"2023-12-08T08:18:52.790035+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:52.790035+0000","last_undegraded":"2023-12-08T08:18:52.790035+0000","last_fullsized":"2023-12-08T08:18:52.790035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:08.702449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752626+0000","last_change":"2023-12-08T08:18:52.752626+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752626+0000","last_undegraded":"2023-12-08T08:18:52.752626+0000","last_fullsized":"2023-12-08T08:18:52.752626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783797+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:52.783797+0000","last_peered":"2023-12-08T08:18:52.783797+0000","last_clean":"2023-12-08T08:18:52.783797+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:52.783797+0000","last_undegraded":"2023-12-08T08:18:52.783797+0000","last_fullsized":"2023-12-08T08:18:52.783797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:42.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752368+0000","last_change":"2023-12-08T08:18:52.752368+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752368+0000","last_undegraded":"2023-12-08T08:18:52.752368+0000","last_fullsized":"2023-12-08T08:18:52.752368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775890+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:52.775890+0000","last_peered":"2023-12-08T08:18:52.775890+0000","last_clean":"2023-12-08T08:18:52.775890+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:52.775890+0000","last_undegraded":"2023-12-08T08:18:52.775890+0000","last_fullsized":"2023-12-08T08:18:52.775890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:52.964347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773594+0000","last_change":"2023-12-08T08:18:52.773594+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773594+0000","last_undegraded":"2023-12-08T08:18:52.773594+0000","last_fullsized":"2023-12-08T08:18:52.773594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779243+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:52.779243+0000","last_peered":"2023-12-08T08:18:52.779243+0000","last_clean":"2023-12-08T08:18:52.779243+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:52.779243+0000","last_undegraded":"2023-12-08T08:18:52.779243+0000","last_fullsized":"2023-12-08T08:18:52.779243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:06.479309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754146+0000","last_change":"2023-12-08T08:18:52.754146+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754146+0000","last_undegraded":"2023-12-08T08:18:52.754146+0000","last_fullsized":"2023-12-08T08:18:52.754146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.777518+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:52.777518+0000","last_peered":"2023-12-08T08:18:52.777518+0000","last_clean":"2023-12-08T08:18:52.777518+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:52.777518+0000","last_undegraded":"2023-12-08T08:18:52.777518+0000","last_fullsized":"2023-12-08T08:18:52.777518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755487+0000","last_change":"2023-12-08T08:18:52.755487+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755487+0000","last_undegraded":"2023-12-08T08:18:52.755487+0000","last_fullsized":"2023-12-08T08:18:52.755487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779279+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:18:52.779279+0000","last_peered":"2023-12-08T08:18:52.779279+0000","last_clean":"2023-12-08T08:18:52.779279+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:18:52.779279+0000","last_undegraded":"2023-12-08T08:18:52.779279+0000","last_fullsized":"2023-12-08T08:18:52.779279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761470+0000","last_change":"2023-12-08T08:18:52.761470+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761470+0000","last_undegraded":"2023-12-08T08:18:52.761470+0000","last_fullsized":"2023-12-08T08:18:52.761470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.784161+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:52.784161+0000","last_peered":"2023-12-08T08:18:52.784161+0000","last_clean":"2023-12-08T08:18:52.784161+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:52.784161+0000","last_undegraded":"2023-12-08T08:18:52.784161+0000","last_fullsized":"2023-12-08T08:18:52.784161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:10:02.436174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752317+0000","last_change":"2023-12-08T08:18:52.752317+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752317+0000","last_undegraded":"2023-12-08T08:18:52.752317+0000","last_fullsized":"2023-12-08T08:18:52.752317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787192+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:52.787192+0000","last_peered":"2023-12-08T08:18:52.787192+0000","last_clean":"2023-12-08T08:18:52.787192+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:52.787192+0000","last_undegraded":"2023-12-08T08:18:52.787192+0000","last_fullsized":"2023-12-08T08:18:52.787192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:10.099547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764535+0000","last_change":"2023-12-08T08:18:52.764535+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764535+0000","last_undegraded":"2023-12-08T08:18:52.764535+0000","last_fullsized":"2023-12-08T08:18:52.764535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783552+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:52.783552+0000","last_peered":"2023-12-08T08:18:52.783552+0000","last_clean":"2023-12-08T08:18:52.783552+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:52.783552+0000","last_undegraded":"2023-12-08T08:18:52.783552+0000","last_fullsized":"2023-12-08T08:18:52.783552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:22.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-08T08:18:51.735559+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:51.735559+0000","last_peered":"2023-12-08T08:18:51.735559+0000","last_clean":"2023-12-08T08:18:51.735559+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:51.735559+0000","last_undegraded":"2023-12-08T08:18:51.735559+0000","last_fullsized":"2023-12-08T08:18:51.735559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.726}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.9390000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.073},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.5600000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.3120000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.0409999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6160000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":2.0859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6850000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.9950000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.5069999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":4.6319999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":3.835}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":6.5620000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":7.2539999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":8.0719999999999992},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":6.6040000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":3.8919999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":8.6150000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":6.4370000000000003},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":7.0430000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":8.0039999999999996},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":3.9209999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":7.1989999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":8.532}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.1459999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4410000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.343},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.375}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.5409999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.492},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.712}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":1.0349999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.4039999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.28}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4530000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.2210000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.611},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.55}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1359999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.7290000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.946},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.51}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.0649999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.427}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.333}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.363},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4730000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.501},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":0.91500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.622},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.76500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.4350000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.2150000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.083},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.286}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1819999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.399}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.474},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:58.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:58.906 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-08T08:18:58.903+0000 7f21d6724640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:18:59.051 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:59.061 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.064+0000 7fcfc54e7640 1 Processor -- start 2023-12-08T08:18:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.064+0000 7fcfc54e7640 1 -- start start 2023-12-08T08:18:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.065+0000 7fcfc54e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfc00c3440 0x7fcfc00c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.065+0000 7fcfc54e7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00c80f0 con 0x7fcfc00c6880 2023-12-08T08:18:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.065+0000 7fcfc54e7640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00c83d0 con 0x7fcfc0155600 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.065+0000 7fcfc54e7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00c86b0 con 0x7fcfc00c3440 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcfc00c6880 0x7fcfc0154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56260/0 (socket says 172.21.15.45:56260) 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbeffd640 1 -- 172.21.15.45:0/237054977 learned_addr learned my addr 172.21.15.45:0/237054977 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbf7fe640 1 --2- 172.21.15.45:0/237054977 >> v2:172.21.15.45:3300/0 conn(0x7fcfc00c3440 0x7fcfc00c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbdffb640 1 -- 172.21.15.45:0/237054977 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619243567 0 0) 0x7fcfc00c80f0 con 0x7fcfc00c6880 2023-12-08T08:18:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/237054977 >> v1:172.21.15.114:6789/0 conn(0x7fcfc0155600 legacy=0x7fcfc00c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/237054977 >> v1:172.21.15.45:6789/0 conn(0x7fcfc00c6880 legacy=0x7fcfc0154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.066+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/237054977 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00c2530 con 0x7fcfc00c3440 2023-12-08T08:18:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.068+0000 7fcfbf7fe640 1 --2- 172.21.15.45:0/237054977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc00c3440 0x7fcfc00c7aa0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c8c5ee1553af65 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.068+0000 7fcfbdffb640 1 -- 172.21.15.45:0/237054977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8031830 con 0x7fcfc00c3440 2023-12-08T08:18:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.068+0000 7fcfbdffb640 1 -- 172.21.15.45:0/237054977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8031990 con 0x7fcfc00c3440 2023-12-08T08:18:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.068+0000 7fcfbdffb640 1 -- 172.21.15.45:0/237054977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8031d20 con 0x7fcfc00c3440 2023-12-08T08:18:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 -- 172.21.15.45:0/237054977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc00c3440 msgr2=0x7fcfc00c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/237054977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc00c3440 0x7fcfc00c7aa0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 -- 172.21.15.45:0/237054977 shutdown_connections 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/237054977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc00c3440 0x7fcfc00c7aa0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 -- 172.21.15.45:0/237054977 >> 172.21.15.45:0/237054977 conn(0x7fcfc0072240 msgr2=0x7fcfc00661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 -- 172.21.15.45:0/237054977 shutdown_connections 2023-12-08T08:18:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.069+0000 7fcfc54e7640 1 -- 172.21.15.45:0/237054977 wait complete. 2023-12-08T08:18:59.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.071+0000 7fcfc54e7640 1 Processor -- start 2023-12-08T08:18:59.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.071+0000 7fcfc54e7640 1 -- start start 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc00c3440 0x7fcfc00a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfc00c6880 0x7fcfc014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0099b80 con 0x7fcfc0155600 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc006b8b0 con 0x7fcfc00c3440 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfc54e7640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc006b5d0 con 0x7fcfc00c6880 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46742/0 (socket says 172.21.15.45:46742) 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/1589973830 learned_addr learned my addr 172.21.15.45:0/1589973830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.072+0000 7fcfbe7fc640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfc00c6880 0x7fcfc014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbeffd640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc00c3440 0x7fcfc00a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfc00c6880 msgr2=0x7fcfc014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfc00c6880 0x7fcfc014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc00c3440 msgr2=0x7fcfc00a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc00c3440 0x7fcfc00a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 -- 172.21.15.45:0/1589973830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009400 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfbf7fe640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80098c0 tx=0x7fcfb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.073+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb803b9f0 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.074+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb803bb50 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.074+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc006c590 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.074+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80453f0 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.074+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc006cb50 con 0x7fcfc0155600 2023-12-08T08:18:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.075+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0099cf0 con 0x7fcfc0155600 2023-12-08T08:18:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.076+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfb8045550 con 0x7fcfc0155600 2023-12-08T08:18:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.077+0000 7fcfb77fe640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 0x7fcfa006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.077+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcfb80abb60 con 0x7fcfc0155600 2023-12-08T08:18:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.077+0000 7fcfbeffd640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 0x7fcfa006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.078+0000 7fcfbeffd640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 0x7fcfa006d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00012e0 tx=0x7fcfb0007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.081+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfb8076c00 con 0x7fcfc0155600 2023-12-08T08:18:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.275+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfc00c32d0 con 0x7fcfa006ae40 2023-12-08T08:18:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.296+0000 7fcfb77fe640 1 -- 172.21.15.45:0/1589973830 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281654 (secure 0 0 0) 0x7fcfc00c32d0 con 0x7fcfa006ae40 2023-12-08T08:18:59.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:18:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.302+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 msgr2=0x7fcfa006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.302+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 0x7fcfa006d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00012e0 tx=0x7fcfb0007ed0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 msgr2=0x7fcfc009a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80098c0 tx=0x7fcfb80046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 shutdown_connections 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcfa006ae40 0x7fcfa006d300 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcfc00c6880 0x7fcfc014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc0155600 0x7fcfc009a010 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 --2- 172.21.15.45:0/1589973830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfc00c3440 0x7fcfc00a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 >> 172.21.15.45:0/1589973830 conn(0x7fcfc0072240 msgr2=0x7fcfc00661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 shutdown_connections 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.303+0000 7fcfc54e7640 1 -- 172.21.15.45:0/1589973830 wait complete. 2023-12-08T08:18:59.325 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-12-08T08:18:57.782071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245416,"kb_used_data":8456,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729304,"statfs":{"total":773094113280,"available":772842807296,"internally_reserved":0,"allocated":8658944,"data_stored":4636592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001617"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758662+0000","last_change":"2023-12-08T08:18:52.758662+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758662+0000","last_undegraded":"2023-12-08T08:18:52.758662+0000","last_fullsized":"2023-12-08T08:18:52.758662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774222+0000","last_change":"2023-12-08T08:18:52.774222+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774222+0000","last_undegraded":"2023-12-08T08:18:52.774222+0000","last_fullsized":"2023-12-08T08:18:52.774222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757711+0000","last_change":"2023-12-08T08:18:52.757711+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757711+0000","last_undegraded":"2023-12-08T08:18:52.757711+0000","last_fullsized":"2023-12-08T08:18:52.757711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766816+0000","last_change":"2023-12-08T08:18:52.766816+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766816+0000","last_undegraded":"2023-12-08T08:18:52.766816+0000","last_fullsized":"2023-12-08T08:18:52.766816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758772+0000","last_change":"2023-12-08T08:18:52.758772+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758772+0000","last_undegraded":"2023-12-08T08:18:52.758772+0000","last_fullsized":"2023-12-08T08:18:52.758772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756354+0000","last_change":"2023-12-08T08:18:52.756354+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756354+0000","last_undegraded":"2023-12-08T08:18:52.756354+0000","last_fullsized":"2023-12-08T08:18:52.756354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762325+0000","last_change":"2023-12-08T08:18:52.762325+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762325+0000","last_undegraded":"2023-12-08T08:18:52.762325+0000","last_fullsized":"2023-12-08T08:18:52.762325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.766174+0000","last_change":"2023-12-08T08:18:52.766174+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.766174+0000","last_undegraded":"2023-12-08T08:18:52.766174+0000","last_fullsized":"2023-12-08T08:18:52.766174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755095+0000","last_change":"2023-12-08T08:18:52.755095+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755095+0000","last_undegraded":"2023-12-08T08:18:52.755095+0000","last_fullsized":"2023-12-08T08:18:52.755095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759154+0000","last_change":"2023-12-08T08:18:52.759154+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759154+0000","last_undegraded":"2023-12-08T08:18:52.759154+0000","last_fullsized":"2023-12-08T08:18:52.759154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758563+0000","last_change":"2023-12-08T08:18:52.758563+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758563+0000","last_undegraded":"2023-12-08T08:18:52.758563+0000","last_fullsized":"2023-12-08T08:18:52.758563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.758591+0000","last_change":"2023-12-08T08:18:52.758591+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.758591+0000","last_undegraded":"2023-12-08T08:18:52.758591+0000","last_fullsized":"2023-12-08T08:18:52.758591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761277+0000","last_change":"2023-12-08T08:18:52.761277+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761277+0000","last_undegraded":"2023-12-08T08:18:52.761277+0000","last_fullsized":"2023-12-08T08:18:52.761277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767479+0000","last_change":"2023-12-08T08:18:52.767479+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767479+0000","last_undegraded":"2023-12-08T08:18:52.767479+0000","last_fullsized":"2023-12-08T08:18:52.767479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.765891+0000","last_change":"2023-12-08T08:18:52.765891+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.765891+0000","last_undegraded":"2023-12-08T08:18:52.765891+0000","last_fullsized":"2023-12-08T08:18:52.765891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755803+0000","last_change":"2023-12-08T08:18:52.755803+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755803+0000","last_undegraded":"2023-12-08T08:18:52.755803+0000","last_fullsized":"2023-12-08T08:18:52.755803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759761+0000","last_change":"2023-12-08T08:18:52.759761+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759761+0000","last_undegraded":"2023-12-08T08:18:52.759761+0000","last_fullsized":"2023-12-08T08:18:52.759761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757192+0000","last_change":"2023-12-08T08:18:52.757192+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757192+0000","last_undegraded":"2023-12-08T08:18:52.757192+0000","last_fullsized":"2023-12-08T08:18:52.757192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757485+0000","last_change":"2023-12-08T08:18:52.757485+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757485+0000","last_undegraded":"2023-12-08T08:18:52.757485+0000","last_fullsized":"2023-12-08T08:18:52.757485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763953+0000","last_change":"2023-12-08T08:18:52.763953+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763953+0000","last_undegraded":"2023-12-08T08:18:52.763953+0000","last_fullsized":"2023-12-08T08:18:52.763953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759957+0000","last_change":"2023-12-08T08:18:52.759957+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759957+0000","last_undegraded":"2023-12-08T08:18:52.759957+0000","last_fullsized":"2023-12-08T08:18:52.759957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761794+0000","last_change":"2023-12-08T08:18:52.761794+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761794+0000","last_undegraded":"2023-12-08T08:18:52.761794+0000","last_fullsized":"2023-12-08T08:18:52.761794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763520+0000","last_change":"2023-12-08T08:18:52.763520+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763520+0000","last_undegraded":"2023-12-08T08:18:52.763520+0000","last_fullsized":"2023-12-08T08:18:52.763520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754462+0000","last_change":"2023-12-08T08:18:52.754462+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754462+0000","last_undegraded":"2023-12-08T08:18:52.754462+0000","last_fullsized":"2023-12-08T08:18:52.754462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.774141+0000","last_change":"2023-12-08T08:18:52.774141+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.774141+0000","last_undegraded":"2023-12-08T08:18:52.774141+0000","last_fullsized":"2023-12-08T08:18:52.774141+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764759+0000","last_change":"2023-12-08T08:18:52.764759+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764759+0000","last_undegraded":"2023-12-08T08:18:52.764759+0000","last_fullsized":"2023-12-08T08:18:52.764759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754600+0000","last_change":"2023-12-08T08:18:52.754600+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754600+0000","last_undegraded":"2023-12-08T08:18:52.754600+0000","last_fullsized":"2023-12-08T08:18:52.754600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763511+0000","last_change":"2023-12-08T08:18:52.763511+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763511+0000","last_undegraded":"2023-12-08T08:18:52.763511+0000","last_fullsized":"2023-12-08T08:18:52.763511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.762598+0000","last_change":"2023-12-08T08:18:52.762598+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.762598+0000","last_undegraded":"2023-12-08T08:18:52.762598+0000","last_fullsized":"2023-12-08T08:18:52.762598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760727+0000","last_change":"2023-12-08T08:18:52.760727+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760727+0000","last_undegraded":"2023-12-08T08:18:52.760727+0000","last_fullsized":"2023-12-08T08:18:52.760727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.776458+0000","last_change":"2023-12-08T08:18:52.776458+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.776458+0000","last_undegraded":"2023-12-08T08:18:52.776458+0000","last_fullsized":"2023-12-08T08:18:52.776458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755357+0000","last_change":"2023-12-08T08:18:52.755357+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755357+0000","last_undegraded":"2023-12-08T08:18:52.755357+0000","last_fullsized":"2023-12-08T08:18:52.755357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754777+0000","last_change":"2023-12-08T08:18:52.754777+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754777+0000","last_undegraded":"2023-12-08T08:18:52.754777+0000","last_fullsized":"2023-12-08T08:18:52.754777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787114+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:52.787114+0000","last_peered":"2023-12-08T08:18:52.787114+0000","last_clean":"2023-12-08T08:18:52.787114+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:52.787114+0000","last_undegraded":"2023-12-08T08:18:52.787114+0000","last_fullsized":"2023-12-08T08:18:52.787114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:11.691410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755100+0000","last_change":"2023-12-08T08:18:52.755100+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755100+0000","last_undegraded":"2023-12-08T08:18:52.755100+0000","last_fullsized":"2023-12-08T08:18:52.755100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776896+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:52.776896+0000","last_peered":"2023-12-08T08:18:52.776896+0000","last_clean":"2023-12-08T08:18:52.776896+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:52.776896+0000","last_undegraded":"2023-12-08T08:18:52.776896+0000","last_fullsized":"2023-12-08T08:18:52.776896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:11.641745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.768482+0000","last_change":"2023-12-08T08:18:52.768482+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.768482+0000","last_undegraded":"2023-12-08T08:18:52.768482+0000","last_fullsized":"2023-12-08T08:18:52.768482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787115+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:52.787115+0000","last_peered":"2023-12-08T08:18:52.787115+0000","last_clean":"2023-12-08T08:18:52.787115+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:52.787115+0000","last_undegraded":"2023-12-08T08:18:52.787115+0000","last_fullsized":"2023-12-08T08:18:52.787115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:53:59.971342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754660+0000","last_change":"2023-12-08T08:18:52.754660+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754660+0000","last_undegraded":"2023-12-08T08:18:52.754660+0000","last_fullsized":"2023-12-08T08:18:52.754660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787133+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:52.787133+0000","last_peered":"2023-12-08T08:18:52.787133+0000","last_clean":"2023-12-08T08:18:52.787133+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:52.787133+0000","last_undegraded":"2023-12-08T08:18:52.787133+0000","last_fullsized":"2023-12-08T08:18:52.787133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:16.072763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757574+0000","last_change":"2023-12-08T08:18:52.757574+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757574+0000","last_undegraded":"2023-12-08T08:18:52.757574+0000","last_fullsized":"2023-12-08T08:18:52.757574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776262+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:52.776262+0000","last_peered":"2023-12-08T08:18:52.776262+0000","last_clean":"2023-12-08T08:18:52.776262+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:52.776262+0000","last_undegraded":"2023-12-08T08:18:52.776262+0000","last_fullsized":"2023-12-08T08:18:52.776262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:49:41.592765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.759007+0000","last_change":"2023-12-08T08:18:52.759007+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.759007+0000","last_undegraded":"2023-12-08T08:18:52.759007+0000","last_fullsized":"2023-12-08T08:18:52.759007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779747+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:52.779747+0000","last_peered":"2023-12-08T08:18:52.779747+0000","last_clean":"2023-12-08T08:18:52.779747+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:52.779747+0000","last_undegraded":"2023-12-08T08:18:52.779747+0000","last_fullsized":"2023-12-08T08:18:52.779747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:21:47.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754175+0000","last_change":"2023-12-08T08:18:52.754175+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754175+0000","last_undegraded":"2023-12-08T08:18:52.754175+0000","last_fullsized":"2023-12-08T08:18:52.754175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778176+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:52.778176+0000","last_peered":"2023-12-08T08:18:52.778176+0000","last_clean":"2023-12-08T08:18:52.778176+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:52.778176+0000","last_undegraded":"2023-12-08T08:18:52.778176+0000","last_fullsized":"2023-12-08T08:18:52.778176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.760841+0000","last_change":"2023-12-08T08:18:52.760841+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.760841+0000","last_undegraded":"2023-12-08T08:18:52.760841+0000","last_fullsized":"2023-12-08T08:18:52.760841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789418+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:52.789418+0000","last_peered":"2023-12-08T08:18:52.789418+0000","last_clean":"2023-12-08T08:18:52.789418+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:52.789418+0000","last_undegraded":"2023-12-08T08:18:52.789418+0000","last_fullsized":"2023-12-08T08:18:52.789418+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757179+0000","last_change":"2023-12-08T08:18:52.757179+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757179+0000","last_undegraded":"2023-12-08T08:18:52.757179+0000","last_fullsized":"2023-12-08T08:18:52.757179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.778934+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:18:52.778934+0000","last_peered":"2023-12-08T08:18:52.778934+0000","last_clean":"2023-12-08T08:18:52.778934+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:18:52.778934+0000","last_undegraded":"2023-12-08T08:18:52.778934+0000","last_fullsized":"2023-12-08T08:18:52.778934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.763914+0000","last_change":"2023-12-08T08:18:52.763914+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.763914+0000","last_undegraded":"2023-12-08T08:18:52.763914+0000","last_fullsized":"2023-12-08T08:18:52.763914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776014+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:52.776014+0000","last_peered":"2023-12-08T08:18:52.776014+0000","last_clean":"2023-12-08T08:18:52.776014+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:52.776014+0000","last_undegraded":"2023-12-08T08:18:52.776014+0000","last_fullsized":"2023-12-08T08:18:52.776014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756740+0000","last_change":"2023-12-08T08:18:52.756740+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756740+0000","last_undegraded":"2023-12-08T08:18:52.756740+0000","last_fullsized":"2023-12-08T08:18:52.756740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775910+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:52.775910+0000","last_peered":"2023-12-08T08:18:52.775910+0000","last_clean":"2023-12-08T08:18:52.775910+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:52.775910+0000","last_undegraded":"2023-12-08T08:18:52.775910+0000","last_fullsized":"2023-12-08T08:18:52.775910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:33:06.037175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764182+0000","last_change":"2023-12-08T08:18:52.764182+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764182+0000","last_undegraded":"2023-12-08T08:18:52.764182+0000","last_fullsized":"2023-12-08T08:18:52.764182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783301+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:18:52.783301+0000","last_peered":"2023-12-08T08:18:52.783301+0000","last_clean":"2023-12-08T08:18:52.783301+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:18:52.783301+0000","last_undegraded":"2023-12-08T08:18:52.783301+0000","last_fullsized":"2023-12-08T08:18:52.783301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.756970+0000","last_change":"2023-12-08T08:18:52.756970+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.756970+0000","last_undegraded":"2023-12-08T08:18:52.756970+0000","last_fullsized":"2023-12-08T08:18:52.756970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789449+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:52.789449+0000","last_peered":"2023-12-08T08:18:52.789449+0000","last_clean":"2023-12-08T08:18:52.789449+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:52.789449+0000","last_undegraded":"2023-12-08T08:18:52.789449+0000","last_fullsized":"2023-12-08T08:18:52.789449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:03.647947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752588+0000","last_change":"2023-12-08T08:18:52.752588+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752588+0000","last_undegraded":"2023-12-08T08:18:52.752588+0000","last_fullsized":"2023-12-08T08:18:52.752588+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.782761+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:52.782761+0000","last_peered":"2023-12-08T08:18:52.782761+0000","last_clean":"2023-12-08T08:18:52.782761+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:52.782761+0000","last_undegraded":"2023-12-08T08:18:52.782761+0000","last_fullsized":"2023-12-08T08:18:52.782761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755606+0000","last_change":"2023-12-08T08:18:52.755606+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755606+0000","last_undegraded":"2023-12-08T08:18:52.755606+0000","last_fullsized":"2023-12-08T08:18:52.755606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783087+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:52.783087+0000","last_peered":"2023-12-08T08:18:52.783087+0000","last_clean":"2023-12-08T08:18:52.783087+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:52.783087+0000","last_undegraded":"2023-12-08T08:18:52.783087+0000","last_fullsized":"2023-12-08T08:18:52.783087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:19.455016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.757505+0000","last_change":"2023-12-08T08:18:52.757505+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.757505+0000","last_undegraded":"2023-12-08T08:18:52.757505+0000","last_fullsized":"2023-12-08T08:18:52.757505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.771981+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:52.771981+0000","last_peered":"2023-12-08T08:18:52.771981+0000","last_clean":"2023-12-08T08:18:52.771981+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:52.771981+0000","last_undegraded":"2023-12-08T08:18:52.771981+0000","last_fullsized":"2023-12-08T08:18:52.771981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:28:27.389297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754288+0000","last_change":"2023-12-08T08:18:52.754288+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754288+0000","last_undegraded":"2023-12-08T08:18:52.754288+0000","last_fullsized":"2023-12-08T08:18:52.754288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787136+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:52.787136+0000","last_peered":"2023-12-08T08:18:52.787136+0000","last_clean":"2023-12-08T08:18:52.787136+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:52.787136+0000","last_undegraded":"2023-12-08T08:18:52.787136+0000","last_fullsized":"2023-12-08T08:18:52.787136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:51:53.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761702+0000","last_change":"2023-12-08T08:18:52.761702+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761702+0000","last_undegraded":"2023-12-08T08:18:52.761702+0000","last_fullsized":"2023-12-08T08:18:52.761702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.789463+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:52.789463+0000","last_peered":"2023-12-08T08:18:52.789463+0000","last_clean":"2023-12-08T08:18:52.789463+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:52.789463+0000","last_undegraded":"2023-12-08T08:18:52.789463+0000","last_fullsized":"2023-12-08T08:18:52.789463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:54.386243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761845+0000","last_change":"2023-12-08T08:18:52.761845+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761845+0000","last_undegraded":"2023-12-08T08:18:52.761845+0000","last_fullsized":"2023-12-08T08:18:52.761845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775928+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:52.775928+0000","last_peered":"2023-12-08T08:18:52.775928+0000","last_clean":"2023-12-08T08:18:52.775928+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:52.775928+0000","last_undegraded":"2023-12-08T08:18:52.775928+0000","last_fullsized":"2023-12-08T08:18:52.775928+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:32.930738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752737+0000","last_change":"2023-12-08T08:18:52.752737+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752737+0000","last_undegraded":"2023-12-08T08:18:52.752737+0000","last_fullsized":"2023-12-08T08:18:52.752737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.781143+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:18:52.781143+0000","last_peered":"2023-12-08T08:18:52.781143+0000","last_clean":"2023-12-08T08:18:52.781143+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:18:52.781143+0000","last_undegraded":"2023-12-08T08:18:52.781143+0000","last_fullsized":"2023-12-08T08:18:52.781143+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.775067+0000","last_change":"2023-12-08T08:18:52.775067+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.775067+0000","last_undegraded":"2023-12-08T08:18:52.775067+0000","last_fullsized":"2023-12-08T08:18:52.775067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.776609+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:52.776609+0000","last_peered":"2023-12-08T08:18:52.776609+0000","last_clean":"2023-12-08T08:18:52.776609+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:52.776609+0000","last_undegraded":"2023-12-08T08:18:52.776609+0000","last_fullsized":"2023-12-08T08:18:52.776609+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:26:54.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773299+0000","last_change":"2023-12-08T08:18:52.773299+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773299+0000","last_undegraded":"2023-12-08T08:18:52.773299+0000","last_fullsized":"2023-12-08T08:18:52.773299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.780121+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:18:52.780121+0000","last_peered":"2023-12-08T08:18:52.780121+0000","last_clean":"2023-12-08T08:18:52.780121+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:18:52.780121+0000","last_undegraded":"2023-12-08T08:18:52.780121+0000","last_fullsized":"2023-12-08T08:18:52.780121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.753596+0000","last_change":"2023-12-08T08:18:52.753596+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.753596+0000","last_undegraded":"2023-12-08T08:18:52.753596+0000","last_fullsized":"2023-12-08T08:18:52.753596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779082+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:52.779082+0000","last_peered":"2023-12-08T08:18:52.779082+0000","last_clean":"2023-12-08T08:18:52.779082+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:52.779082+0000","last_undegraded":"2023-12-08T08:18:52.779082+0000","last_fullsized":"2023-12-08T08:18:52.779082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:03:34.544099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.767818+0000","last_change":"2023-12-08T08:18:52.767818+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.767818+0000","last_undegraded":"2023-12-08T08:18:52.767818+0000","last_fullsized":"2023-12-08T08:18:52.767818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.790035+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:52.790035+0000","last_peered":"2023-12-08T08:18:52.790035+0000","last_clean":"2023-12-08T08:18:52.790035+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:52.790035+0000","last_undegraded":"2023-12-08T08:18:52.790035+0000","last_fullsized":"2023-12-08T08:18:52.790035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:08.702449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752626+0000","last_change":"2023-12-08T08:18:52.752626+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752626+0000","last_undegraded":"2023-12-08T08:18:52.752626+0000","last_fullsized":"2023-12-08T08:18:52.752626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783797+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:52.783797+0000","last_peered":"2023-12-08T08:18:52.783797+0000","last_clean":"2023-12-08T08:18:52.783797+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:52.783797+0000","last_undegraded":"2023-12-08T08:18:52.783797+0000","last_fullsized":"2023-12-08T08:18:52.783797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:32:42.653466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752368+0000","last_change":"2023-12-08T08:18:52.752368+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752368+0000","last_undegraded":"2023-12-08T08:18:52.752368+0000","last_fullsized":"2023-12-08T08:18:52.752368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.775890+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:52.775890+0000","last_peered":"2023-12-08T08:18:52.775890+0000","last_clean":"2023-12-08T08:18:52.775890+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:52.775890+0000","last_undegraded":"2023-12-08T08:18:52.775890+0000","last_fullsized":"2023-12-08T08:18:52.775890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:52.964347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.773594+0000","last_change":"2023-12-08T08:18:52.773594+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.773594+0000","last_undegraded":"2023-12-08T08:18:52.773594+0000","last_fullsized":"2023-12-08T08:18:52.773594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779243+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:52.779243+0000","last_peered":"2023-12-08T08:18:52.779243+0000","last_clean":"2023-12-08T08:18:52.779243+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:52.779243+0000","last_undegraded":"2023-12-08T08:18:52.779243+0000","last_fullsized":"2023-12-08T08:18:52.779243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:06.479309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.754146+0000","last_change":"2023-12-08T08:18:52.754146+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.754146+0000","last_undegraded":"2023-12-08T08:18:52.754146+0000","last_fullsized":"2023-12-08T08:18:52.754146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.777518+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:52.777518+0000","last_peered":"2023-12-08T08:18:52.777518+0000","last_clean":"2023-12-08T08:18:52.777518+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:52.777518+0000","last_undegraded":"2023-12-08T08:18:52.777518+0000","last_fullsized":"2023-12-08T08:18:52.777518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.755487+0000","last_change":"2023-12-08T08:18:52.755487+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.755487+0000","last_undegraded":"2023-12-08T08:18:52.755487+0000","last_fullsized":"2023-12-08T08:18:52.755487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.779279+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:18:52.779279+0000","last_peered":"2023-12-08T08:18:52.779279+0000","last_clean":"2023-12-08T08:18:52.779279+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:18:52.779279+0000","last_undegraded":"2023-12-08T08:18:52.779279+0000","last_fullsized":"2023-12-08T08:18:52.779279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.761470+0000","last_change":"2023-12-08T08:18:52.761470+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.761470+0000","last_undegraded":"2023-12-08T08:18:52.761470+0000","last_fullsized":"2023-12-08T08:18:52.761470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.784161+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:52.784161+0000","last_peered":"2023-12-08T08:18:52.784161+0000","last_clean":"2023-12-08T08:18:52.784161+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:52.784161+0000","last_undegraded":"2023-12-08T08:18:52.784161+0000","last_fullsized":"2023-12-08T08:18:52.784161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:10:02.436174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.752317+0000","last_change":"2023-12-08T08:18:52.752317+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.752317+0000","last_undegraded":"2023-12-08T08:18:52.752317+0000","last_fullsized":"2023-12-08T08:18:52.752317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.787192+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:52.787192+0000","last_peered":"2023-12-08T08:18:52.787192+0000","last_clean":"2023-12-08T08:18:52.787192+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:52.787192+0000","last_undegraded":"2023-12-08T08:18:52.787192+0000","last_fullsized":"2023-12-08T08:18:52.787192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:10.099547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":77,"state":"creating+peering","last_fresh":"2023-12-08T08:18:52.764535+0000","last_change":"2023-12-08T08:18:52.764535+0000","last_active":"2023-12-08T08:18:52.727257+0000","last_peered":"2023-12-08T08:18:52.727257+0000","last_clean":"2023-12-08T08:18:52.727257+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:18:52.764535+0000","last_undegraded":"2023-12-08T08:18:52.764535+0000","last_fullsized":"2023-12-08T08:18:52.764535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-08T08:18:52.783552+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:52.783552+0000","last_peered":"2023-12-08T08:18:52.783552+0000","last_clean":"2023-12-08T08:18:52.783552+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:52.783552+0000","last_undegraded":"2023-12-08T08:18:52.783552+0000","last_fullsized":"2023-12-08T08:18:52.783552+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:35:22.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-08T08:18:51.735559+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:51.735559+0000","last_peered":"2023-12-08T08:18:51.735559+0000","last_clean":"2023-12-08T08:18:51.735559+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:51.735559+0000","last_undegraded":"2023-12-08T08:18:51.735559+0000","last_fullsized":"2023-12-08T08:18:51.735559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.7769999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.726}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.9390000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.073},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.5600000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.3120000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.0409999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6160000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":2.0859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6850000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.9950000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.5069999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":4.6319999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":3.835}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":6.5620000000000003},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":7.2539999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":8.0719999999999992},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":6.6040000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":3.8919999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":8.6150000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":6.4370000000000003},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":7.0430000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":8.0039999999999996},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":3.9209999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":7.1989999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":8.532}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":1.1459999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.4410000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.343},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.375}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.5409999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":1.492},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.712}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":1.0349999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.4039999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.28}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4530000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.181},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.2210000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":0.93000000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.611},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.55}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1359999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.8420000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.47}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.7290000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.946},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.51}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.0649999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.427}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.333}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.363},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1830000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4730000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":431982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.501},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":0.91500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.622},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.76500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.4350000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.2150000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.083},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.286}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.1819999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.399}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.474},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.758662+0000', 'last_change': '2023-12-08T08:18:52.758662+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.758662+0000', 'last_undegraded': '2023-12-08T08:18:52.758662+0000', 'last_fullsized': '2023-12-08T08:18:52.758662+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.774222+0000', 'last_change': '2023-12-08T08:18:52.774222+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.774222+0000', 'last_undegraded': '2023-12-08T08:18:52.774222+0000', 'last_fullsized': '2023-12-08T08:18:52.774222+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757711+0000', 'last_change': '2023-12-08T08:18:52.757711+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757711+0000', 'last_undegraded': '2023-12-08T08:18:52.757711+0000', 'last_fullsized': '2023-12-08T08:18:52.757711+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.766816+0000', 'last_change': '2023-12-08T08:18:52.766816+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.766816+0000', 'last_undegraded': '2023-12-08T08:18:52.766816+0000', 'last_fullsized': '2023-12-08T08:18:52.766816+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-12-08T08:18:59.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.758772+0000', 'last_change': '2023-12-08T08:18:52.758772+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.758772+0000', 'last_undegraded': '2023-12-08T08:18:52.758772+0000', 'last_fullsized': '2023-12-08T08:18:52.758772+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.756354+0000', 'last_change': '2023-12-08T08:18:52.756354+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.756354+0000', 'last_undegraded': '2023-12-08T08:18:52.756354+0000', 'last_fullsized': '2023-12-08T08:18:52.756354+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.762325+0000', 'last_change': '2023-12-08T08:18:52.762325+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.762325+0000', 'last_undegraded': '2023-12-08T08:18:52.762325+0000', 'last_fullsized': '2023-12-08T08:18:52.762325+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.766174+0000', 'last_change': '2023-12-08T08:18:52.766174+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.766174+0000', 'last_undegraded': '2023-12-08T08:18:52.766174+0000', 'last_fullsized': '2023-12-08T08:18:52.766174+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755095+0000', 'last_change': '2023-12-08T08:18:52.755095+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755095+0000', 'last_undegraded': '2023-12-08T08:18:52.755095+0000', 'last_fullsized': '2023-12-08T08:18:52.755095+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.759154+0000', 'last_change': '2023-12-08T08:18:52.759154+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.759154+0000', 'last_undegraded': '2023-12-08T08:18:52.759154+0000', 'last_fullsized': '2023-12-08T08:18:52.759154+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.758563+0000', 'last_change': '2023-12-08T08:18:52.758563+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.758563+0000', 'last_undegraded': '2023-12-08T08:18:52.758563+0000', 'last_fullsized': '2023-12-08T08:18:52.758563+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.758591+0000', 'last_change': '2023-12-08T08:18:52.758591+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.758591+0000', 'last_undegraded': '2023-12-08T08:18:52.758591+0000', 'last_fullsized': '2023-12-08T08:18:52.758591+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.761277+0000', 'last_change': '2023-12-08T08:18:52.761277+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.761277+0000', 'last_undegraded': '2023-12-08T08:18:52.761277+0000', 'last_fullsized': '2023-12-08T08:18:52.761277+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.767479+0000', 'last_change': '2023-12-08T08:18:52.767479+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.767479+0000', 'last_undegraded': '2023-12-08T08:18:52.767479+0000', 'last_fullsized': '2023-12-08T08:18:52.767479+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.765891+0000', 'last_change': '2023-12-08T08:18:52.765891+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.765891+0000', 'last_undegraded': '2023-12-08T08:18:52.765891+0000', 'last_fullsized': '2023-12-08T08:18:52.765891+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-12-08T08:18:59.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755803+0000', 'last_change': '2023-12-08T08:18:52.755803+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755803+0000', 'last_undegraded': '2023-12-08T08:18:52.755803+0000', 'last_fullsized': '2023-12-08T08:18:52.755803+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.759761+0000', 'last_change': '2023-12-08T08:18:52.759761+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.759761+0000', 'last_undegraded': '2023-12-08T08:18:52.759761+0000', 'last_fullsized': '2023-12-08T08:18:52.759761+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757192+0000', 'last_change': '2023-12-08T08:18:52.757192+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757192+0000', 'last_undegraded': '2023-12-08T08:18:52.757192+0000', 'last_fullsized': '2023-12-08T08:18:52.757192+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757485+0000', 'last_change': '2023-12-08T08:18:52.757485+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757485+0000', 'last_undegraded': '2023-12-08T08:18:52.757485+0000', 'last_fullsized': '2023-12-08T08:18:52.757485+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.763953+0000', 'last_change': '2023-12-08T08:18:52.763953+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.763953+0000', 'last_undegraded': '2023-12-08T08:18:52.763953+0000', 'last_fullsized': '2023-12-08T08:18:52.763953+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.759957+0000', 'last_change': '2023-12-08T08:18:52.759957+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.759957+0000', 'last_undegraded': '2023-12-08T08:18:52.759957+0000', 'last_fullsized': '2023-12-08T08:18:52.759957+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.761794+0000', 'last_change': '2023-12-08T08:18:52.761794+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.761794+0000', 'last_undegraded': '2023-12-08T08:18:52.761794+0000', 'last_fullsized': '2023-12-08T08:18:52.761794+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.763520+0000', 'last_change': '2023-12-08T08:18:52.763520+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.763520+0000', 'last_undegraded': '2023-12-08T08:18:52.763520+0000', 'last_fullsized': '2023-12-08T08:18:52.763520+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754462+0000', 'last_change': '2023-12-08T08:18:52.754462+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754462+0000', 'last_undegraded': '2023-12-08T08:18:52.754462+0000', 'last_fullsized': '2023-12-08T08:18:52.754462+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.774141+0000', 'last_change': '2023-12-08T08:18:52.774141+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.774141+0000', 'last_undegraded': '2023-12-08T08:18:52.774141+0000', 'last_fullsized': '2023-12-08T08:18:52.774141+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.764759+0000', 'last_change': '2023-12-08T08:18:52.764759+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.764759+0000', 'last_undegraded': '2023-12-08T08:18:52.764759+0000', 'last_fullsized': '2023-12-08T08:18:52.764759+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-12-08T08:18:59.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754600+0000', 'last_change': '2023-12-08T08:18:52.754600+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754600+0000', 'last_undegraded': '2023-12-08T08:18:52.754600+0000', 'last_fullsized': '2023-12-08T08:18:52.754600+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.763511+0000', 'last_change': '2023-12-08T08:18:52.763511+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.763511+0000', 'last_undegraded': '2023-12-08T08:18:52.763511+0000', 'last_fullsized': '2023-12-08T08:18:52.763511+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.762598+0000', 'last_change': '2023-12-08T08:18:52.762598+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.762598+0000', 'last_undegraded': '2023-12-08T08:18:52.762598+0000', 'last_fullsized': '2023-12-08T08:18:52.762598+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.760727+0000', 'last_change': '2023-12-08T08:18:52.760727+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.760727+0000', 'last_undegraded': '2023-12-08T08:18:52.760727+0000', 'last_fullsized': '2023-12-08T08:18:52.760727+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.776458+0000', 'last_change': '2023-12-08T08:18:52.776458+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.776458+0000', 'last_undegraded': '2023-12-08T08:18:52.776458+0000', 'last_fullsized': '2023-12-08T08:18:52.776458+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755357+0000', 'last_change': '2023-12-08T08:18:52.755357+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755357+0000', 'last_undegraded': '2023-12-08T08:18:52.755357+0000', 'last_fullsized': '2023-12-08T08:18:52.755357+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-12-08T08:18:59.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754777+0000', 'last_change': '2023-12-08T08:18:52.754777+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754777+0000', 'last_undegraded': '2023-12-08T08:18:52.754777+0000', 'last_fullsized': '2023-12-08T08:18:52.754777+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755100+0000', 'last_change': '2023-12-08T08:18:52.755100+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755100+0000', 'last_undegraded': '2023-12-08T08:18:52.755100+0000', 'last_fullsized': '2023-12-08T08:18:52.755100+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.768482+0000', 'last_change': '2023-12-08T08:18:52.768482+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.768482+0000', 'last_undegraded': '2023-12-08T08:18:52.768482+0000', 'last_fullsized': '2023-12-08T08:18:52.768482+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754660+0000', 'last_change': '2023-12-08T08:18:52.754660+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754660+0000', 'last_undegraded': '2023-12-08T08:18:52.754660+0000', 'last_fullsized': '2023-12-08T08:18:52.754660+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757574+0000', 'last_change': '2023-12-08T08:18:52.757574+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757574+0000', 'last_undegraded': '2023-12-08T08:18:52.757574+0000', 'last_fullsized': '2023-12-08T08:18:52.757574+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.759007+0000', 'last_change': '2023-12-08T08:18:52.759007+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.759007+0000', 'last_undegraded': '2023-12-08T08:18:52.759007+0000', 'last_fullsized': '2023-12-08T08:18:52.759007+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-12-08T08:18:59.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754175+0000', 'last_change': '2023-12-08T08:18:52.754175+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754175+0000', 'last_undegraded': '2023-12-08T08:18:52.754175+0000', 'last_fullsized': '2023-12-08T08:18:52.754175+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.760841+0000', 'last_change': '2023-12-08T08:18:52.760841+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.760841+0000', 'last_undegraded': '2023-12-08T08:18:52.760841+0000', 'last_fullsized': '2023-12-08T08:18:52.760841+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757179+0000', 'last_change': '2023-12-08T08:18:52.757179+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757179+0000', 'last_undegraded': '2023-12-08T08:18:52.757179+0000', 'last_fullsized': '2023-12-08T08:18:52.757179+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.763914+0000', 'last_change': '2023-12-08T08:18:52.763914+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.763914+0000', 'last_undegraded': '2023-12-08T08:18:52.763914+0000', 'last_fullsized': '2023-12-08T08:18:52.763914+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.756740+0000', 'last_change': '2023-12-08T08:18:52.756740+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.756740+0000', 'last_undegraded': '2023-12-08T08:18:52.756740+0000', 'last_fullsized': '2023-12-08T08:18:52.756740+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.764182+0000', 'last_change': '2023-12-08T08:18:52.764182+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.764182+0000', 'last_undegraded': '2023-12-08T08:18:52.764182+0000', 'last_fullsized': '2023-12-08T08:18:52.764182+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.756970+0000', 'last_change': '2023-12-08T08:18:52.756970+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.756970+0000', 'last_undegraded': '2023-12-08T08:18:52.756970+0000', 'last_fullsized': '2023-12-08T08:18:52.756970+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.752588+0000', 'last_change': '2023-12-08T08:18:52.752588+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.752588+0000', 'last_undegraded': '2023-12-08T08:18:52.752588+0000', 'last_fullsized': '2023-12-08T08:18:52.752588+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755606+0000', 'last_change': '2023-12-08T08:18:52.755606+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755606+0000', 'last_undegraded': '2023-12-08T08:18:52.755606+0000', 'last_fullsized': '2023-12-08T08:18:52.755606+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.757505+0000', 'last_change': '2023-12-08T08:18:52.757505+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.757505+0000', 'last_undegraded': '2023-12-08T08:18:52.757505+0000', 'last_fullsized': '2023-12-08T08:18:52.757505+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754288+0000', 'last_change': '2023-12-08T08:18:52.754288+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754288+0000', 'last_undegraded': '2023-12-08T08:18:52.754288+0000', 'last_fullsized': '2023-12-08T08:18:52.754288+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-12-08T08:18:59.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.761702+0000', 'last_change': '2023-12-08T08:18:52.761702+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.761702+0000', 'last_undegraded': '2023-12-08T08:18:52.761702+0000', 'last_fullsized': '2023-12-08T08:18:52.761702+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.761845+0000', 'last_change': '2023-12-08T08:18:52.761845+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.761845+0000', 'last_undegraded': '2023-12-08T08:18:52.761845+0000', 'last_fullsized': '2023-12-08T08:18:52.761845+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.752737+0000', 'last_change': '2023-12-08T08:18:52.752737+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.752737+0000', 'last_undegraded': '2023-12-08T08:18:52.752737+0000', 'last_fullsized': '2023-12-08T08:18:52.752737+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.775067+0000', 'last_change': '2023-12-08T08:18:52.775067+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.775067+0000', 'last_undegraded': '2023-12-08T08:18:52.775067+0000', 'last_fullsized': '2023-12-08T08:18:52.775067+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.773299+0000', 'last_change': '2023-12-08T08:18:52.773299+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.773299+0000', 'last_undegraded': '2023-12-08T08:18:52.773299+0000', 'last_fullsized': '2023-12-08T08:18:52.773299+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.753596+0000', 'last_change': '2023-12-08T08:18:52.753596+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.753596+0000', 'last_undegraded': '2023-12-08T08:18:52.753596+0000', 'last_fullsized': '2023-12-08T08:18:52.753596+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.767818+0000', 'last_change': '2023-12-08T08:18:52.767818+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.767818+0000', 'last_undegraded': '2023-12-08T08:18:52.767818+0000', 'last_fullsized': '2023-12-08T08:18:52.767818+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.752626+0000', 'last_change': '2023-12-08T08:18:52.752626+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.752626+0000', 'last_undegraded': '2023-12-08T08:18:52.752626+0000', 'last_fullsized': '2023-12-08T08:18:52.752626+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.752368+0000', 'last_change': '2023-12-08T08:18:52.752368+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.752368+0000', 'last_undegraded': '2023-12-08T08:18:52.752368+0000', 'last_fullsized': '2023-12-08T08:18:52.752368+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.773594+0000', 'last_change': '2023-12-08T08:18:52.773594+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.773594+0000', 'last_undegraded': '2023-12-08T08:18:52.773594+0000', 'last_fullsized': '2023-12-08T08:18:52.773594+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.754146+0000', 'last_change': '2023-12-08T08:18:52.754146+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.754146+0000', 'last_undegraded': '2023-12-08T08:18:52.754146+0000', 'last_fullsized': '2023-12-08T08:18:52.754146+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.755487+0000', 'last_change': '2023-12-08T08:18:52.755487+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.755487+0000', 'last_undegraded': '2023-12-08T08:18:52.755487+0000', 'last_fullsized': '2023-12-08T08:18:52.755487+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:18:59.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-12-08T08:18:59.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.761470+0000', 'last_change': '2023-12-08T08:18:52.761470+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.761470+0000', 'last_undegraded': '2023-12-08T08:18:52.761470+0000', 'last_fullsized': '2023-12-08T08:18:52.761470+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:18:59.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-12-08T08:18:59.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.752317+0000', 'last_change': '2023-12-08T08:18:52.752317+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.752317+0000', 'last_undegraded': '2023-12-08T08:18:52.752317+0000', 'last_fullsized': '2023-12-08T08:18:52.752317+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:18:59.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-12-08T08:18:59.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 77, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:18:52.764535+0000', 'last_change': '2023-12-08T08:18:52.764535+0000', 'last_active': '2023-12-08T08:18:52.727257+0000', 'last_peered': '2023-12-08T08:18:52.727257+0000', 'last_clean': '2023-12-08T08:18:52.727257+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:18:52.764535+0000', 'last_undegraded': '2023-12-08T08:18:52.764535+0000', 'last_fullsized': '2023-12-08T08:18:52.764535+0000', 'mapping_epoch': 77, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'last_clean_scrub_stamp': '2023-12-08T08:18:52.727257+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-08T08:18:59.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:18:59.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.595+0000 7f3d625ae640 1 Processor -- start 2023-12-08T08:18:59.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.595+0000 7f3d625ae640 1 -- start start 2023-12-08T08:18:59.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.596+0000 7f3d625ae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d5c0a7910 0x7f3d5c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.596+0000 7f3d625ae640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d625ae640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c155850 con 0x7f3d5c1521b0 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d625ae640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c0890 con 0x7f3d5c0a7910 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d625ae640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c0b70 con 0x7f3d5c0c1dc0 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d5c0a7910 0x7f3d5c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d5c0a7910 0x7f3d5c0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46744/0 (socket says 172.21.15.45:46744) 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 -- 172.21.15.45:0/1526190742 learned_addr learned my addr 172.21.15.45:0/1526190742 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:59.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d60dab640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 -- 172.21.15.45:0/1526190742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 msgr2=0x7f3d5c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 -- 172.21.15.45:0/1526190742 >> v1:172.21.15.114:6789/0 conn(0x7f3d5c1521b0 legacy=0x7f3d5c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.597+0000 7f3d615ac640 1 -- 172.21.15.45:0/1526190742 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0c0e50 con 0x7f3d5c0a7910 2023-12-08T08:18:59.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.599+0000 7f3d615ac640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c0c1880 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009e50 tx=0x7f3d4c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0040dd41442d0bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.599+0000 7f3d5bfff640 1 -- 172.21.15.45:0/1526190742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c02c9e0 con 0x7f3d5c0a7910 2023-12-08T08:18:59.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.599+0000 7f3d5bfff640 1 -- 172.21.15.45:0/1526190742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c02cb40 con 0x7f3d5c0a7910 2023-12-08T08:18:59.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.599+0000 7f3d5bfff640 1 -- 172.21.15.45:0/1526190742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0343f0 con 0x7f3d5c0a7910 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 -- 172.21.15.45:0/1526190742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 msgr2=0x7f3d5c0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c0c1880 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009e50 tx=0x7f3d4c02be40 comp rx=0 tx=0).stop 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 -- 172.21.15.45:0/1526190742 shutdown_connections 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 --2- 172.21.15.45:0/1526190742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c0c1880 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 -- 172.21.15.45:0/1526190742 >> 172.21.15.45:0/1526190742 conn(0x7f3d5c0c5780 msgr2=0x7f3d5c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 -- 172.21.15.45:0/1526190742 shutdown_connections 2023-12-08T08:18:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.600+0000 7f3d625ae640 1 -- 172.21.15.45:0/1526190742 wait complete. 2023-12-08T08:18:59.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.602+0000 7f3d625ae640 1 Processor -- start 2023-12-08T08:18:59.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.602+0000 7f3d625ae640 1 -- start start 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 0x7f3d5c1eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0bf790 con 0x7f3d5c0a7910 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c071cb0 con 0x7f3d5c1521b0 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d625ae640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0bf4b0 con 0x7f3d5c0c1dc0 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d615ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d615ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46746/0 (socket says 172.21.15.45:46746) 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d615ac640 1 -- 172.21.15.45:0/392485455 learned_addr learned my addr 172.21.15.45:0/392485455 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:18:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.603+0000 7f3d60dab640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 -- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 msgr2=0x7f3d5c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 -- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 msgr2=0x7f3d5c1eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d61dad640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 0x7f3d5c1eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 0x7f3d5c1eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 -- 172.21.15.45:0/392485455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009b30 con 0x7f3d5c0a7910 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d60dab640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d61dad640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 0x7f3d5c1eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d615ac640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009e50 tx=0x7f3d4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c009510 con 0x7f3d5c0a7910 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c03e450 con 0x7f3d5c0a7910 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c03e800 con 0x7f3d5c0a7910 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.604+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c1eafe0 con 0x7f3d5c0a7910 2023-12-08T08:18:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.605+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c1e7d90 con 0x7f3d5c0a7910 2023-12-08T08:18:59.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.606+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c1eae40 con 0x7f3d5c0a7910 2023-12-08T08:18:59.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.607+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d4c03e960 con 0x7f3d5c0a7910 2023-12-08T08:18:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.607+0000 7f3d59ffb640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 0x7f3d4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.607+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3d4c0ac510 con 0x7f3d5c0a7910 2023-12-08T08:18:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.608+0000 7f3d60dab640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 0x7f3d4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.608+0000 7f3d60dab640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 0x7f3d4806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ba930 tx=0x7f3d50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.612+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d5c1eae40 con 0x7f3d5c0a7910 2023-12-08T08:18:59.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.884+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3d5c1eae40 con 0x7f3d5c0a7910 2023-12-08T08:18:59.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.885+0000 7f3d59ffb640 1 -- 172.21.15.45:0/392485455 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1303 (secure 0 0 0) 0x7f3d5c1eae40 con 0x7f3d5c0a7910 2023-12-08T08:18:59.888 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:18:59.888 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":259,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":79,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023292,"num_in_osds":8,"osd_in_since":1702023284,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":260186112,"bytes_avail":772833927168,"bytes_total":773094113280,"write_bytes_sec":2037,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6747}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-12-08T08:18:35.776123+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 msgr2=0x7f3d4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 0x7f3d4806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0ba930 tx=0x7f3d50008040 comp rx=0 tx=0).stop 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 msgr2=0x7f3d5c1e7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009e50 tx=0x7f3d4c004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 shutdown_connections 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d4806ae40 0x7f3d4806d300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3d5c0c1dc0 0x7f3d5c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d5c1521b0 0x7f3d5c1eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 --2- 172.21.15.45:0/392485455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d5c0a7910 0x7f3d5c1e7850 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 >> 172.21.15.45:0/392485455 conn(0x7f3d5c0c5780 msgr2=0x7f3d5c150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 shutdown_connections 2023-12-08T08:18:59.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:18:59.888+0000 7f3d625ae640 1 -- 172.21.15.45:0/392485455 wait complete. 2023-12-08T08:18:59.911 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:18:59.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.125+0000 7f3df759e640 1 Processor -- start 2023-12-08T08:19:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.125+0000 7f3df759e640 1 -- start start 2023-12-08T08:19:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df759e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3df80a7910 0x7f3df80c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3df814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df8155850 con 0x7f3df81521b0 2023-12-08T08:19:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df759e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80c0890 con 0x7f3df80a7910 2023-12-08T08:19:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c0b70 con 0x7f3df80c1dc0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3df81521b0 0x7f3df8155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56274/0 (socket says 172.21.15.45:56274) 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.127+0000 7f3df6d9d640 1 -- 172.21.15.45:0/3070255306 learned_addr learned my addr 172.21.15.45:0/3070255306 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df5d9b640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3df814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df659c640 1 --2- 172.21.15.45:0/3070255306 >> v2:172.21.15.114:3300/0 conn(0x7f3df80a7910 0x7f3df80c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189603386 0 0) 0x7f3df8155850 con 0x7f3df81521b0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de0003520 con 0x7f3df81521b0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853627251 0 0) 0x7f3de0003520 con 0x7f3df81521b0 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 msgr2=0x7f3df814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3df814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 >> v2:172.21.15.114:3300/0 conn(0x7f3df80a7910 msgr2=0x7f3df80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 --2- 172.21.15.45:0/3070255306 >> v2:172.21.15.114:3300/0 conn(0x7f3df80a7910 0x7f3df80c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80c0e50 con 0x7f3df81521b0 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f3df00019f0 con 0x7f3df81521b0 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 >> v1:172.21.15.45:6789/0 conn(0x7f3df81521b0 legacy=0x7f3df8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0003970 0x7f3de0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3de00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.128+0000 7f3df559a640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3de0004d00 0x7f3de0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c0890 con 0x7f3de0004d00 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c0b70 con 0x7f3de0003970 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de000b980 con 0x7f3df80c1dc0 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3de0004d00 0x7f3de0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df659c640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0003970 0x7f3de0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df5d9b640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3de00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 -- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 msgr2=0x7f3de00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df80c1dc0 0x7f3de00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 -- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0003970 msgr2=0x7f3de0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0003970 0x7f3de0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df6d9d640 1 -- 172.21.15.45:0/3070255306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0003520 con 0x7f3de0004d00 2023-12-08T08:19:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.129+0000 7f3df659c640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0003970 0x7f3de0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.130+0000 7f3df6d9d640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3de0004d00 0x7f3de0005180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3df806bad0 tx=0x7f3de00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fefd5647587858e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0034630 con 0x7f3de0004d00 2023-12-08T08:19:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df002f070 con 0x7f3de0004d00 2023-12-08T08:19:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df559a640 1 -- 172.21.15.45:0/3070255306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00349d0 con 0x7f3de0004d00 2023-12-08T08:19:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 -- 172.21.15.45:0/3070255306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3de0004d00 msgr2=0x7f3de0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 --2- 172.21.15.45:0/3070255306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3de0004d00 0x7f3de0005180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3df806bad0 tx=0x7f3de00057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df6d9d640 1 -- 172.21.15.45:0/3070255306 reap_dead start 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 -- 172.21.15.45:0/3070255306 shutdown_connections 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 -- 172.21.15.45:0/3070255306 >> 172.21.15.45:0/3070255306 conn(0x7f3df80c5780 msgr2=0x7f3df80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 -- 172.21.15.45:0/3070255306 shutdown_connections 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.131+0000 7f3df759e640 1 -- 172.21.15.45:0/3070255306 wait complete. 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.133+0000 7f3df759e640 1 Processor -- start 2023-12-08T08:19:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.133+0000 7f3df759e640 1 -- start start 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 0x7f3df8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df81eda70 0x7f3df814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81eab20 con 0x7f3df80c3350 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8152cb0 con 0x7f3de0004d00 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.134+0000 7f3df759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81ed0a0 con 0x7f3df81eda70 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46762/0 (socket says 172.21.15.45:46762) 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 -- 172.21.15.45:0/809731268 learned_addr learned my addr 172.21.15.45:0/809731268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df659c640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 0x7f3df8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df6d9d640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df81eda70 0x7f3df814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 -- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df81eda70 msgr2=0x7f3df814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df81eda70 0x7f3df814e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 -- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 msgr2=0x7f3df8150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 0x7f3df8150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 -- 172.21.15.45:0/809731268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80a5bc0 con 0x7f3df80c3350 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df659c640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 0x7f3df8150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.135+0000 7f3df5d9b640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3dec011590 tx=0x7f3dec011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.136+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec004220 con 0x7f3df80c3350 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.136+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec004380 con 0x7f3df80c3350 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.136+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec015870 con 0x7f3df80c3350 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.136+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df80a52a0 con 0x7f3df80c3350 2023-12-08T08:19:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.136+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df81dca20 con 0x7f3df80c3350 2023-12-08T08:19:00.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.137+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df80743e0 con 0x7f3df80c3350 2023-12-08T08:19:00.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.138+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dec0159d0 con 0x7f3df80c3350 2023-12-08T08:19:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.139+0000 7f3de6ffd640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 0x7f3dd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.139+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3dec0898d0 con 0x7f3df80c3350 2023-12-08T08:19:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.139+0000 7f3df659c640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 0x7f3dd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.140+0000 7f3df659c640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 0x7f3dd806d300 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3df81dc370 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.143+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dec054830 con 0x7f3df80c3350 2023-12-08T08:19:00.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.335+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3df80ab5f0 con 0x7f3dd806ae40 2023-12-08T08:19:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.348+0000 7f3de6ffd640 1 -- 172.21.15.45:0/809731268 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286857 (secure 0 0 0) 0x7f3df80ab5f0 con 0x7f3dd806ae40 2023-12-08T08:19:00.353 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.354+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 msgr2=0x7f3dd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.354+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 0x7f3dd806d300 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3df81dc370 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.354+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 msgr2=0x7f3df81ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.354+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3dec011590 tx=0x7f3dec011a50 comp rx=0 tx=0).stop 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 shutdown_connections 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3dd806ae40 0x7f3dd806d300 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3df81eda70 0x7f3df814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3df80c3350 0x7f3df81ed530 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 --2- 172.21.15.45:0/809731268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de0004d00 0x7f3df8150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 >> 172.21.15.45:0/809731268 conn(0x7f3df80c5780 msgr2=0x7f3df80beb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 shutdown_connections 2023-12-08T08:19:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:00.355+0000 7f3df759e640 1 -- 172.21.15.45:0/809731268 wait complete. 2023-12-08T08:19:00.377 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2023-12-08T08:18:59.782847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254088,"kb_used_data":8808,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720632,"statfs":{"total":773094113280,"available":772833927168,"internally_reserved":0,"allocated":9019392,"data_stored":4803892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.035929"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739659+0000","last_change":"2023-12-08T08:18:53.772671+0000","last_active":"2023-12-08T08:18:56.739659+0000","last_peered":"2023-12-08T08:18:56.739659+0000","last_clean":"2023-12-08T08:18:56.739659+0000","last_became_active":"2023-12-08T08:18:53.772403+0000","last_became_peered":"2023-12-08T08:18:53.772403+0000","last_unstale":"2023-12-08T08:18:56.739659+0000","last_undegraded":"2023-12-08T08:18:56.739659+0000","last_fullsized":"2023-12-08T08:18:56.739659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:49.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738717+0000","last_change":"2023-12-08T08:18:53.783694+0000","last_active":"2023-12-08T08:18:56.738717+0000","last_peered":"2023-12-08T08:18:56.738717+0000","last_clean":"2023-12-08T08:18:56.738717+0000","last_became_active":"2023-12-08T08:18:53.782993+0000","last_became_peered":"2023-12-08T08:18:53.782993+0000","last_unstale":"2023-12-08T08:18:56.738717+0000","last_undegraded":"2023-12-08T08:18:56.738717+0000","last_fullsized":"2023-12-08T08:18:56.738717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739466+0000","last_change":"2023-12-08T08:18:53.786844+0000","last_active":"2023-12-08T08:18:56.739466+0000","last_peered":"2023-12-08T08:18:56.739466+0000","last_clean":"2023-12-08T08:18:56.739466+0000","last_became_active":"2023-12-08T08:18:53.786534+0000","last_became_peered":"2023-12-08T08:18:53.786534+0000","last_unstale":"2023-12-08T08:18:56.739466+0000","last_undegraded":"2023-12-08T08:18:56.739466+0000","last_fullsized":"2023-12-08T08:18:56.739466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:41.159908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737406+0000","last_change":"2023-12-08T08:18:53.789128+0000","last_active":"2023-12-08T08:18:56.737406+0000","last_peered":"2023-12-08T08:18:56.737406+0000","last_clean":"2023-12-08T08:18:56.737406+0000","last_became_active":"2023-12-08T08:18:53.788783+0000","last_became_peered":"2023-12-08T08:18:53.788783+0000","last_unstale":"2023-12-08T08:18:56.737406+0000","last_undegraded":"2023-12-08T08:18:56.737406+0000","last_fullsized":"2023-12-08T08:18:56.737406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:26:07.559242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737264+0000","last_change":"2023-12-08T08:18:53.789378+0000","last_active":"2023-12-08T08:18:56.737264+0000","last_peered":"2023-12-08T08:18:56.737264+0000","last_clean":"2023-12-08T08:18:56.737264+0000","last_became_active":"2023-12-08T08:18:53.789113+0000","last_became_peered":"2023-12-08T08:18:53.789113+0000","last_unstale":"2023-12-08T08:18:56.737264+0000","last_undegraded":"2023-12-08T08:18:56.737264+0000","last_fullsized":"2023-12-08T08:18:56.737264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:31.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265640+0000","last_change":"2023-12-08T08:18:53.796019+0000","last_active":"2023-12-08T08:18:55.265640+0000","last_peered":"2023-12-08T08:18:55.265640+0000","last_clean":"2023-12-08T08:18:55.265640+0000","last_became_active":"2023-12-08T08:18:53.788065+0000","last_became_peered":"2023-12-08T08:18:53.788065+0000","last_unstale":"2023-12-08T08:18:55.265640+0000","last_undegraded":"2023-12-08T08:18:55.265640+0000","last_fullsized":"2023-12-08T08:18:55.265640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078751+0000","last_change":"2023-12-08T08:18:53.793006+0000","last_active":"2023-12-08T08:18:56.078751+0000","last_peered":"2023-12-08T08:18:56.078751+0000","last_clean":"2023-12-08T08:18:56.078751+0000","last_became_active":"2023-12-08T08:18:53.792739+0000","last_became_peered":"2023-12-08T08:18:53.792739+0000","last_unstale":"2023-12-08T08:18:56.078751+0000","last_undegraded":"2023-12-08T08:18:56.078751+0000","last_fullsized":"2023-12-08T08:18:56.078751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:16.681517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737401+0000","last_change":"2023-12-08T08:18:53.791174+0000","last_active":"2023-12-08T08:18:56.737401+0000","last_peered":"2023-12-08T08:18:56.737401+0000","last_clean":"2023-12-08T08:18:56.737401+0000","last_became_active":"2023-12-08T08:18:53.788909+0000","last_became_peered":"2023-12-08T08:18:53.788909+0000","last_unstale":"2023-12-08T08:18:56.737401+0000","last_undegraded":"2023-12-08T08:18:56.737401+0000","last_fullsized":"2023-12-08T08:18:56.737401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:49:42.248379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737971+0000","last_change":"2023-12-08T08:18:53.786983+0000","last_active":"2023-12-08T08:18:56.737971+0000","last_peered":"2023-12-08T08:18:56.737971+0000","last_clean":"2023-12-08T08:18:56.737971+0000","last_became_active":"2023-12-08T08:18:53.786722+0000","last_became_peered":"2023-12-08T08:18:53.786722+0000","last_unstale":"2023-12-08T08:18:56.737971+0000","last_undegraded":"2023-12-08T08:18:56.737971+0000","last_fullsized":"2023-12-08T08:18:56.737971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778393+0000","last_change":"2023-12-08T08:18:53.789804+0000","last_active":"2023-12-08T08:18:54.778393+0000","last_peered":"2023-12-08T08:18:54.778393+0000","last_clean":"2023-12-08T08:18:54.778393+0000","last_became_active":"2023-12-08T08:18:53.786215+0000","last_became_peered":"2023-12-08T08:18:53.786215+0000","last_unstale":"2023-12-08T08:18:54.778393+0000","last_undegraded":"2023-12-08T08:18:54.778393+0000","last_fullsized":"2023-12-08T08:18:54.778393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:51.622019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737281+0000","last_change":"2023-12-08T08:18:53.782075+0000","last_active":"2023-12-08T08:18:56.737281+0000","last_peered":"2023-12-08T08:18:56.737281+0000","last_clean":"2023-12-08T08:18:56.737281+0000","last_became_active":"2023-12-08T08:18:53.775721+0000","last_became_peered":"2023-12-08T08:18:53.775721+0000","last_unstale":"2023-12-08T08:18:56.737281+0000","last_undegraded":"2023-12-08T08:18:56.737281+0000","last_fullsized":"2023-12-08T08:18:56.737281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778031+0000","last_change":"2023-12-08T08:18:53.776155+0000","last_active":"2023-12-08T08:18:54.778031+0000","last_peered":"2023-12-08T08:18:54.778031+0000","last_clean":"2023-12-08T08:18:54.778031+0000","last_became_active":"2023-12-08T08:18:53.775833+0000","last_became_peered":"2023-12-08T08:18:53.775833+0000","last_unstale":"2023-12-08T08:18:54.778031+0000","last_undegraded":"2023-12-08T08:18:54.778031+0000","last_fullsized":"2023-12-08T08:18:54.778031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:57.738584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736728+0000","last_change":"2023-12-08T08:18:53.787632+0000","last_active":"2023-12-08T08:18:56.736728+0000","last_peered":"2023-12-08T08:18:56.736728+0000","last_clean":"2023-12-08T08:18:56.736728+0000","last_became_active":"2023-12-08T08:18:53.787135+0000","last_became_peered":"2023-12-08T08:18:53.787135+0000","last_unstale":"2023-12-08T08:18:56.736728+0000","last_undegraded":"2023-12-08T08:18:56.736728+0000","last_fullsized":"2023-12-08T08:18:56.736728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:51:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737235+0000","last_change":"2023-12-08T08:18:53.771818+0000","last_active":"2023-12-08T08:18:56.737235+0000","last_peered":"2023-12-08T08:18:56.737235+0000","last_clean":"2023-12-08T08:18:56.737235+0000","last_became_active":"2023-12-08T08:18:53.771528+0000","last_became_peered":"2023-12-08T08:18:53.771528+0000","last_unstale":"2023-12-08T08:18:56.737235+0000","last_undegraded":"2023-12-08T08:18:56.737235+0000","last_fullsized":"2023-12-08T08:18:56.737235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.782986+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.782641+0000","last_became_peered":"2023-12-08T08:18:53.782641+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:07:35.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265388+0000","last_change":"2023-12-08T08:18:53.783616+0000","last_active":"2023-12-08T08:18:55.265388+0000","last_peered":"2023-12-08T08:18:55.265388+0000","last_clean":"2023-12-08T08:18:55.265388+0000","last_became_active":"2023-12-08T08:18:53.783322+0000","last_became_peered":"2023-12-08T08:18:53.783322+0000","last_unstale":"2023-12-08T08:18:55.265388+0000","last_undegraded":"2023-12-08T08:18:55.265388+0000","last_fullsized":"2023-12-08T08:18:55.265388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:45.651039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267104+0000","last_change":"2023-12-08T08:18:53.795881+0000","last_active":"2023-12-08T08:18:55.267104+0000","last_peered":"2023-12-08T08:18:55.267104+0000","last_clean":"2023-12-08T08:18:55.267104+0000","last_became_active":"2023-12-08T08:18:53.795563+0000","last_became_peered":"2023-12-08T08:18:53.795563+0000","last_unstale":"2023-12-08T08:18:55.267104+0000","last_undegraded":"2023-12-08T08:18:55.267104+0000","last_fullsized":"2023-12-08T08:18:55.267104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:59.236997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739646+0000","last_change":"2023-12-08T08:18:53.783723+0000","last_active":"2023-12-08T08:18:56.739646+0000","last_peered":"2023-12-08T08:18:56.739646+0000","last_clean":"2023-12-08T08:18:56.739646+0000","last_became_active":"2023-12-08T08:18:53.783415+0000","last_became_peered":"2023-12-08T08:18:53.783415+0000","last_unstale":"2023-12-08T08:18:56.739646+0000","last_undegraded":"2023-12-08T08:18:56.739646+0000","last_fullsized":"2023-12-08T08:18:56.739646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:52.604642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737512+0000","last_change":"2023-12-08T08:18:53.784426+0000","last_active":"2023-12-08T08:18:56.737512+0000","last_peered":"2023-12-08T08:18:56.737512+0000","last_clean":"2023-12-08T08:18:56.737512+0000","last_became_active":"2023-12-08T08:18:53.774174+0000","last_became_peered":"2023-12-08T08:18:53.774174+0000","last_unstale":"2023-12-08T08:18:56.737512+0000","last_undegraded":"2023-12-08T08:18:56.737512+0000","last_fullsized":"2023-12-08T08:18:56.737512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737770+0000","last_change":"2023-12-08T08:18:53.775530+0000","last_active":"2023-12-08T08:18:56.737770+0000","last_peered":"2023-12-08T08:18:56.737770+0000","last_clean":"2023-12-08T08:18:56.737770+0000","last_became_active":"2023-12-08T08:18:53.775237+0000","last_became_peered":"2023-12-08T08:18:53.775237+0000","last_unstale":"2023-12-08T08:18:56.737770+0000","last_undegraded":"2023-12-08T08:18:56.737770+0000","last_fullsized":"2023-12-08T08:18:56.737770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:40.484831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737052+0000","last_change":"2023-12-08T08:18:53.791563+0000","last_active":"2023-12-08T08:18:56.737052+0000","last_peered":"2023-12-08T08:18:56.737052+0000","last_clean":"2023-12-08T08:18:56.737052+0000","last_became_active":"2023-12-08T08:18:53.791257+0000","last_became_peered":"2023-12-08T08:18:53.791257+0000","last_unstale":"2023-12-08T08:18:56.737052+0000","last_undegraded":"2023-12-08T08:18:56.737052+0000","last_fullsized":"2023-12-08T08:18:56.737052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:04.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737716+0000","last_change":"2023-12-08T08:18:53.771206+0000","last_active":"2023-12-08T08:18:56.737716+0000","last_peered":"2023-12-08T08:18:56.737716+0000","last_clean":"2023-12-08T08:18:56.737716+0000","last_became_active":"2023-12-08T08:18:53.763984+0000","last_became_peered":"2023-12-08T08:18:53.763984+0000","last_unstale":"2023-12-08T08:18:56.737716+0000","last_undegraded":"2023-12-08T08:18:56.737716+0000","last_fullsized":"2023-12-08T08:18:56.737716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784756+0000","last_change":"2023-12-08T08:18:53.794394+0000","last_active":"2023-12-08T08:18:54.784756+0000","last_peered":"2023-12-08T08:18:54.784756+0000","last_clean":"2023-12-08T08:18:54.784756+0000","last_became_active":"2023-12-08T08:18:53.794138+0000","last_became_peered":"2023-12-08T08:18:53.794138+0000","last_unstale":"2023-12-08T08:18:54.784756+0000","last_undegraded":"2023-12-08T08:18:54.784756+0000","last_fullsized":"2023-12-08T08:18:54.784756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.786075+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.783458+0000","last_became_peered":"2023-12-08T08:18:53.783458+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:12:32.634182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739114+0000","last_change":"2023-12-08T08:18:53.789101+0000","last_active":"2023-12-08T08:18:56.739114+0000","last_peered":"2023-12-08T08:18:56.739114+0000","last_clean":"2023-12-08T08:18:56.739114+0000","last_became_active":"2023-12-08T08:18:53.788487+0000","last_became_peered":"2023-12-08T08:18:53.788487+0000","last_unstale":"2023-12-08T08:18:56.739114+0000","last_undegraded":"2023-12-08T08:18:56.739114+0000","last_fullsized":"2023-12-08T08:18:56.739114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:42.120522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738383+0000","last_change":"2023-12-08T08:18:53.772180+0000","last_active":"2023-12-08T08:18:56.738383+0000","last_peered":"2023-12-08T08:18:56.738383+0000","last_clean":"2023-12-08T08:18:56.738383+0000","last_became_active":"2023-12-08T08:18:53.764066+0000","last_became_peered":"2023-12-08T08:18:53.764066+0000","last_unstale":"2023-12-08T08:18:56.738383+0000","last_undegraded":"2023-12-08T08:18:56.738383+0000","last_fullsized":"2023-12-08T08:18:56.738383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778269+0000","last_change":"2023-12-08T08:18:53.793998+0000","last_active":"2023-12-08T08:18:54.778269+0000","last_peered":"2023-12-08T08:18:54.778269+0000","last_clean":"2023-12-08T08:18:54.778269+0000","last_became_active":"2023-12-08T08:18:53.793584+0000","last_became_peered":"2023-12-08T08:18:53.793584+0000","last_unstale":"2023-12-08T08:18:54.778269+0000","last_undegraded":"2023-12-08T08:18:54.778269+0000","last_fullsized":"2023-12-08T08:18:54.778269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:30:39.090688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738098+0000","last_change":"2023-12-08T08:18:53.768788+0000","last_active":"2023-12-08T08:18:56.738098+0000","last_peered":"2023-12-08T08:18:56.738098+0000","last_clean":"2023-12-08T08:18:56.738098+0000","last_became_active":"2023-12-08T08:18:53.768468+0000","last_became_peered":"2023-12-08T08:18:53.768468+0000","last_unstale":"2023-12-08T08:18:56.738098+0000","last_undegraded":"2023-12-08T08:18:56.738098+0000","last_fullsized":"2023-12-08T08:18:56.738098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:44:42.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079535+0000","last_change":"2023-12-08T08:18:53.786191+0000","last_active":"2023-12-08T08:18:56.079535+0000","last_peered":"2023-12-08T08:18:56.079535+0000","last_clean":"2023-12-08T08:18:56.079535+0000","last_became_active":"2023-12-08T08:18:53.785934+0000","last_became_peered":"2023-12-08T08:18:53.785934+0000","last_unstale":"2023-12-08T08:18:56.079535+0000","last_undegraded":"2023-12-08T08:18:56.079535+0000","last_fullsized":"2023-12-08T08:18:56.079535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:26.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738088+0000","last_change":"2023-12-08T08:18:53.785767+0000","last_active":"2023-12-08T08:18:56.738088+0000","last_peered":"2023-12-08T08:18:56.738088+0000","last_clean":"2023-12-08T08:18:56.738088+0000","last_became_active":"2023-12-08T08:18:53.785369+0000","last_became_peered":"2023-12-08T08:18:53.785369+0000","last_unstale":"2023-12-08T08:18:56.738088+0000","last_undegraded":"2023-12-08T08:18:56.738088+0000","last_fullsized":"2023-12-08T08:18:56.738088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736341+0000","last_change":"2023-12-08T08:18:53.786744+0000","last_active":"2023-12-08T08:18:56.736341+0000","last_peered":"2023-12-08T08:18:56.736341+0000","last_clean":"2023-12-08T08:18:56.736341+0000","last_became_active":"2023-12-08T08:18:53.785499+0000","last_became_peered":"2023-12-08T08:18:53.785499+0000","last_unstale":"2023-12-08T08:18:56.736341+0000","last_undegraded":"2023-12-08T08:18:56.736341+0000","last_fullsized":"2023-12-08T08:18:56.736341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265746+0000","last_change":"2023-12-08T08:18:53.783040+0000","last_active":"2023-12-08T08:18:55.265746+0000","last_peered":"2023-12-08T08:18:55.265746+0000","last_clean":"2023-12-08T08:18:55.265746+0000","last_became_active":"2023-12-08T08:18:53.781940+0000","last_became_peered":"2023-12-08T08:18:53.781940+0000","last_unstale":"2023-12-08T08:18:55.265746+0000","last_undegraded":"2023-12-08T08:18:55.265746+0000","last_fullsized":"2023-12-08T08:18:55.265746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:35.044283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266255+0000","last_change":"2023-12-08T08:18:53.797000+0000","last_active":"2023-12-08T08:18:55.266255+0000","last_peered":"2023-12-08T08:18:55.266255+0000","last_clean":"2023-12-08T08:18:55.266255+0000","last_became_active":"2023-12-08T08:18:53.791588+0000","last_became_peered":"2023-12-08T08:18:53.791588+0000","last_unstale":"2023-12-08T08:18:55.266255+0000","last_undegraded":"2023-12-08T08:18:55.266255+0000","last_fullsized":"2023-12-08T08:18:55.266255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:32.972182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800688+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:53.800688+0000","last_peered":"2023-12-08T08:18:53.800688+0000","last_clean":"2023-12-08T08:18:53.800688+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:53.800688+0000","last_undegraded":"2023-12-08T08:18:53.800688+0000","last_fullsized":"2023-12-08T08:18:53.800688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:03.362667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266519+0000","last_change":"2023-12-08T08:18:53.784523+0000","last_active":"2023-12-08T08:18:55.266519+0000","last_peered":"2023-12-08T08:18:55.266519+0000","last_clean":"2023-12-08T08:18:55.266519+0000","last_became_active":"2023-12-08T08:18:53.784246+0000","last_became_peered":"2023-12-08T08:18:53.784246+0000","last_unstale":"2023-12-08T08:18:55.266519+0000","last_undegraded":"2023-12-08T08:18:55.266519+0000","last_fullsized":"2023-12-08T08:18:55.266519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:09.884228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795005+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:53.795005+0000","last_peered":"2023-12-08T08:18:53.795005+0000","last_clean":"2023-12-08T08:18:53.795005+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:53.795005+0000","last_undegraded":"2023-12-08T08:18:53.795005+0000","last_fullsized":"2023-12-08T08:18:53.795005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079331+0000","last_change":"2023-12-08T08:18:53.796068+0000","last_active":"2023-12-08T08:18:56.079331+0000","last_peered":"2023-12-08T08:18:56.079331+0000","last_clean":"2023-12-08T08:18:56.079331+0000","last_became_active":"2023-12-08T08:18:53.795798+0000","last_became_peered":"2023-12-08T08:18:53.795798+0000","last_unstale":"2023-12-08T08:18:56.079331+0000","last_undegraded":"2023-12-08T08:18:56.079331+0000","last_fullsized":"2023-12-08T08:18:56.079331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:19.902148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799218+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:53.799218+0000","last_peered":"2023-12-08T08:18:53.799218+0000","last_clean":"2023-12-08T08:18:53.799218+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:53.799218+0000","last_undegraded":"2023-12-08T08:18:53.799218+0000","last_fullsized":"2023-12-08T08:18:53.799218+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:38.128264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267110+0000","last_change":"2023-12-08T08:18:53.794864+0000","last_active":"2023-12-08T08:18:55.267110+0000","last_peered":"2023-12-08T08:18:55.267110+0000","last_clean":"2023-12-08T08:18:55.267110+0000","last_became_active":"2023-12-08T08:18:53.794563+0000","last_became_peered":"2023-12-08T08:18:53.794563+0000","last_unstale":"2023-12-08T08:18:55.267110+0000","last_undegraded":"2023-12-08T08:18:55.267110+0000","last_fullsized":"2023-12-08T08:18:55.267110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:24.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.793681+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:53.793681+0000","last_peered":"2023-12-08T08:18:53.793681+0000","last_clean":"2023-12-08T08:18:53.793681+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:53.793681+0000","last_undegraded":"2023-12-08T08:18:53.793681+0000","last_fullsized":"2023-12-08T08:18:53.793681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736727+0000","last_change":"2023-12-08T08:18:53.779851+0000","last_active":"2023-12-08T08:18:56.736727+0000","last_peered":"2023-12-08T08:18:56.736727+0000","last_clean":"2023-12-08T08:18:56.736727+0000","last_became_active":"2023-12-08T08:18:53.775977+0000","last_became_peered":"2023-12-08T08:18:53.775977+0000","last_unstale":"2023-12-08T08:18:56.736727+0000","last_undegraded":"2023-12-08T08:18:56.736727+0000","last_fullsized":"2023-12-08T08:18:56.736727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:05.520867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.785079+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:53.785079+0000","last_peered":"2023-12-08T08:18:53.785079+0000","last_clean":"2023-12-08T08:18:53.785079+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:53.785079+0000","last_undegraded":"2023-12-08T08:18:53.785079+0000","last_fullsized":"2023-12-08T08:18:53.785079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784046+0000","last_change":"2023-12-08T08:18:53.792138+0000","last_active":"2023-12-08T08:18:54.784046+0000","last_peered":"2023-12-08T08:18:54.784046+0000","last_clean":"2023-12-08T08:18:54.784046+0000","last_became_active":"2023-12-08T08:18:53.791865+0000","last_became_peered":"2023-12-08T08:18:53.791865+0000","last_unstale":"2023-12-08T08:18:54.784046+0000","last_undegraded":"2023-12-08T08:18:54.784046+0000","last_fullsized":"2023-12-08T08:18:54.784046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778377+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:53.778377+0000","last_peered":"2023-12-08T08:18:53.778377+0000","last_clean":"2023-12-08T08:18:53.778377+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:53.778377+0000","last_undegraded":"2023-12-08T08:18:53.778377+0000","last_fullsized":"2023-12-08T08:18:53.778377+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:38.922247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265759+0000","last_change":"2023-12-08T08:18:53.789767+0000","last_active":"2023-12-08T08:18:55.265759+0000","last_peered":"2023-12-08T08:18:55.265759+0000","last_clean":"2023-12-08T08:18:55.265759+0000","last_became_active":"2023-12-08T08:18:53.787669+0000","last_became_peered":"2023-12-08T08:18:53.787669+0000","last_unstale":"2023-12-08T08:18:55.265759+0000","last_undegraded":"2023-12-08T08:18:55.265759+0000","last_fullsized":"2023-12-08T08:18:55.265759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:50.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.765578+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:53.765578+0000","last_peered":"2023-12-08T08:18:53.765578+0000","last_clean":"2023-12-08T08:18:53.765578+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:53.765578+0000","last_undegraded":"2023-12-08T08:18:53.765578+0000","last_fullsized":"2023-12-08T08:18:53.765578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:19:13.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737008+0000","last_change":"2023-12-08T08:18:53.792753+0000","last_active":"2023-12-08T08:18:56.737008+0000","last_peered":"2023-12-08T08:18:56.737008+0000","last_clean":"2023-12-08T08:18:56.737008+0000","last_became_active":"2023-12-08T08:18:53.792416+0000","last_became_peered":"2023-12-08T08:18:53.792416+0000","last_unstale":"2023-12-08T08:18:56.737008+0000","last_undegraded":"2023-12-08T08:18:56.737008+0000","last_fullsized":"2023-12-08T08:18:56.737008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:25.085766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777800+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:53.777800+0000","last_peered":"2023-12-08T08:18:53.777800+0000","last_clean":"2023-12-08T08:18:53.777800+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:53.777800+0000","last_undegraded":"2023-12-08T08:18:53.777800+0000","last_fullsized":"2023-12-08T08:18:53.777800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737781+0000","last_change":"2023-12-08T08:18:53.774352+0000","last_active":"2023-12-08T08:18:56.737781+0000","last_peered":"2023-12-08T08:18:56.737781+0000","last_clean":"2023-12-08T08:18:56.737781+0000","last_became_active":"2023-12-08T08:18:53.773904+0000","last_became_peered":"2023-12-08T08:18:53.773904+0000","last_unstale":"2023-12-08T08:18:56.737781+0000","last_undegraded":"2023-12-08T08:18:56.737781+0000","last_fullsized":"2023-12-08T08:18:56.737781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778702+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:18:53.778702+0000","last_peered":"2023-12-08T08:18:53.778702+0000","last_clean":"2023-12-08T08:18:53.778702+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:18:53.778702+0000","last_undegraded":"2023-12-08T08:18:53.778702+0000","last_fullsized":"2023-12-08T08:18:53.778702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079026+0000","last_change":"2023-12-08T08:18:53.792470+0000","last_active":"2023-12-08T08:18:56.079026+0000","last_peered":"2023-12-08T08:18:56.079026+0000","last_clean":"2023-12-08T08:18:56.079026+0000","last_became_active":"2023-12-08T08:18:53.792143+0000","last_became_peered":"2023-12-08T08:18:53.792143+0000","last_unstale":"2023-12-08T08:18:56.079026+0000","last_undegraded":"2023-12-08T08:18:56.079026+0000","last_fullsized":"2023-12-08T08:18:56.079026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:25:20.644648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.763782+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:53.763782+0000","last_peered":"2023-12-08T08:18:53.763782+0000","last_clean":"2023-12-08T08:18:53.763782+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:53.763782+0000","last_undegraded":"2023-12-08T08:18:53.763782+0000","last_fullsized":"2023-12-08T08:18:53.763782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:41.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739816+0000","last_change":"2023-12-08T08:18:53.778524+0000","last_active":"2023-12-08T08:18:56.739816+0000","last_peered":"2023-12-08T08:18:56.739816+0000","last_clean":"2023-12-08T08:18:56.739816+0000","last_became_active":"2023-12-08T08:18:53.778209+0000","last_became_peered":"2023-12-08T08:18:53.778209+0000","last_unstale":"2023-12-08T08:18:56.739816+0000","last_undegraded":"2023-12-08T08:18:56.739816+0000","last_fullsized":"2023-12-08T08:18:56.739816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:42.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.801258+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:53.801258+0000","last_peered":"2023-12-08T08:18:53.801258+0000","last_clean":"2023-12-08T08:18:53.801258+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:53.801258+0000","last_undegraded":"2023-12-08T08:18:53.801258+0000","last_fullsized":"2023-12-08T08:18:53.801258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738456+0000","last_change":"2023-12-08T08:18:53.790906+0000","last_active":"2023-12-08T08:18:56.738456+0000","last_peered":"2023-12-08T08:18:56.738456+0000","last_clean":"2023-12-08T08:18:56.738456+0000","last_became_active":"2023-12-08T08:18:53.790630+0000","last_became_peered":"2023-12-08T08:18:53.790630+0000","last_unstale":"2023-12-08T08:18:56.738456+0000","last_undegraded":"2023-12-08T08:18:56.738456+0000","last_fullsized":"2023-12-08T08:18:56.738456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:59:27.277967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.807037+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:18:53.807037+0000","last_peered":"2023-12-08T08:18:53.807037+0000","last_clean":"2023-12-08T08:18:53.807037+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:18:53.807037+0000","last_undegraded":"2023-12-08T08:18:53.807037+0000","last_fullsized":"2023-12-08T08:18:53.807037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:18.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737140+0000","last_change":"2023-12-08T08:18:53.785668+0000","last_active":"2023-12-08T08:18:56.737140+0000","last_peered":"2023-12-08T08:18:56.737140+0000","last_clean":"2023-12-08T08:18:56.737140+0000","last_became_active":"2023-12-08T08:18:53.785342+0000","last_became_peered":"2023-12-08T08:18:53.785342+0000","last_unstale":"2023-12-08T08:18:56.737140+0000","last_undegraded":"2023-12-08T08:18:56.737140+0000","last_fullsized":"2023-12-08T08:18:56.737140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:53.630993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.796583+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:53.796583+0000","last_peered":"2023-12-08T08:18:53.796583+0000","last_clean":"2023-12-08T08:18:53.796583+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:53.796583+0000","last_undegraded":"2023-12-08T08:18:53.796583+0000","last_fullsized":"2023-12-08T08:18:53.796583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737237+0000","last_change":"2023-12-08T08:18:53.788006+0000","last_active":"2023-12-08T08:18:56.737237+0000","last_peered":"2023-12-08T08:18:56.737237+0000","last_clean":"2023-12-08T08:18:56.737237+0000","last_became_active":"2023-12-08T08:18:53.787709+0000","last_became_peered":"2023-12-08T08:18:53.787709+0000","last_unstale":"2023-12-08T08:18:56.737237+0000","last_undegraded":"2023-12-08T08:18:56.737237+0000","last_fullsized":"2023-12-08T08:18:56.737237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:55.392551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.764699+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:53.764699+0000","last_peered":"2023-12-08T08:18:53.764699+0000","last_clean":"2023-12-08T08:18:53.764699+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:53.764699+0000","last_undegraded":"2023-12-08T08:18:53.764699+0000","last_fullsized":"2023-12-08T08:18:53.764699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:01.823592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777824+0000","last_change":"2023-12-08T08:18:53.780686+0000","last_active":"2023-12-08T08:18:54.777824+0000","last_peered":"2023-12-08T08:18:54.777824+0000","last_clean":"2023-12-08T08:18:54.777824+0000","last_became_active":"2023-12-08T08:18:53.780408+0000","last_became_peered":"2023-12-08T08:18:53.780408+0000","last_unstale":"2023-12-08T08:18:54.777824+0000","last_undegraded":"2023-12-08T08:18:54.777824+0000","last_fullsized":"2023-12-08T08:18:54.777824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:50.587465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.753049+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:53.753049+0000","last_peered":"2023-12-08T08:18:53.753049+0000","last_clean":"2023-12-08T08:18:53.753049+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:53.753049+0000","last_undegraded":"2023-12-08T08:18:53.753049+0000","last_fullsized":"2023-12-08T08:18:53.753049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:12.525160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778063+0000","last_change":"2023-12-08T08:18:53.774289+0000","last_active":"2023-12-08T08:18:54.778063+0000","last_peered":"2023-12-08T08:18:54.778063+0000","last_clean":"2023-12-08T08:18:54.778063+0000","last_became_active":"2023-12-08T08:18:53.773997+0000","last_became_peered":"2023-12-08T08:18:53.773997+0000","last_unstale":"2023-12-08T08:18:54.778063+0000","last_undegraded":"2023-12-08T08:18:54.778063+0000","last_fullsized":"2023-12-08T08:18:54.778063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:57.939378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799582+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:53.799582+0000","last_peered":"2023-12-08T08:18:53.799582+0000","last_clean":"2023-12-08T08:18:53.799582+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:53.799582+0000","last_undegraded":"2023-12-08T08:18:53.799582+0000","last_fullsized":"2023-12-08T08:18:53.799582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:50.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266509+0000","last_change":"2023-12-08T08:18:53.791859+0000","last_active":"2023-12-08T08:18:55.266509+0000","last_peered":"2023-12-08T08:18:55.266509+0000","last_clean":"2023-12-08T08:18:55.266509+0000","last_became_active":"2023-12-08T08:18:53.791211+0000","last_became_peered":"2023-12-08T08:18:53.791211+0000","last_unstale":"2023-12-08T08:18:55.266509+0000","last_undegraded":"2023-12-08T08:18:55.266509+0000","last_fullsized":"2023-12-08T08:18:55.266509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:58.762577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.791574+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:53.791574+0000","last_peered":"2023-12-08T08:18:53.791574+0000","last_clean":"2023-12-08T08:18:53.791574+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:53.791574+0000","last_undegraded":"2023-12-08T08:18:53.791574+0000","last_fullsized":"2023-12-08T08:18:53.791574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:30.013320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784262+0000","last_change":"2023-12-08T08:18:53.788889+0000","last_active":"2023-12-08T08:18:54.784262+0000","last_peered":"2023-12-08T08:18:54.784262+0000","last_clean":"2023-12-08T08:18:54.784262+0000","last_became_active":"2023-12-08T08:18:53.788322+0000","last_became_peered":"2023-12-08T08:18:53.788322+0000","last_unstale":"2023-12-08T08:18:54.784262+0000","last_undegraded":"2023-12-08T08:18:54.784262+0000","last_fullsized":"2023-12-08T08:18:54.784262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.797401+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:53.797401+0000","last_peered":"2023-12-08T08:18:53.797401+0000","last_clean":"2023-12-08T08:18:53.797401+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:53.797401+0000","last_undegraded":"2023-12-08T08:18:53.797401+0000","last_fullsized":"2023-12-08T08:18:53.797401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:16.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738117+0000","last_change":"2023-12-08T08:18:53.779656+0000","last_active":"2023-12-08T08:18:56.738117+0000","last_peered":"2023-12-08T08:18:56.738117+0000","last_clean":"2023-12-08T08:18:56.738117+0000","last_became_active":"2023-12-08T08:18:53.774380+0000","last_became_peered":"2023-12-08T08:18:53.774380+0000","last_unstale":"2023-12-08T08:18:56.738117+0000","last_undegraded":"2023-12-08T08:18:56.738117+0000","last_fullsized":"2023-12-08T08:18:56.738117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800530+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:53.800530+0000","last_peered":"2023-12-08T08:18:53.800530+0000","last_clean":"2023-12-08T08:18:53.800530+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:53.800530+0000","last_undegraded":"2023-12-08T08:18:53.800530+0000","last_fullsized":"2023-12-08T08:18:53.800530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265782+0000","last_change":"2023-12-08T08:18:53.790829+0000","last_active":"2023-12-08T08:18:55.265782+0000","last_peered":"2023-12-08T08:18:55.265782+0000","last_clean":"2023-12-08T08:18:55.265782+0000","last_became_active":"2023-12-08T08:18:53.790471+0000","last_became_peered":"2023-12-08T08:18:53.790471+0000","last_unstale":"2023-12-08T08:18:55.265782+0000","last_undegraded":"2023-12-08T08:18:55.265782+0000","last_fullsized":"2023-12-08T08:18:55.265782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:53.065257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799654+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:18:53.799654+0000","last_peered":"2023-12-08T08:18:53.799654+0000","last_clean":"2023-12-08T08:18:53.799654+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:18:53.799654+0000","last_undegraded":"2023-12-08T08:18:53.799654+0000","last_fullsized":"2023-12-08T08:18:53.799654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:50.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736545+0000","last_change":"2023-12-08T08:18:53.779115+0000","last_active":"2023-12-08T08:18:56.736545+0000","last_peered":"2023-12-08T08:18:56.736545+0000","last_clean":"2023-12-08T08:18:56.736545+0000","last_became_active":"2023-12-08T08:18:53.778078+0000","last_became_peered":"2023-12-08T08:18:53.778078+0000","last_unstale":"2023-12-08T08:18:56.736545+0000","last_undegraded":"2023-12-08T08:18:56.736545+0000","last_fullsized":"2023-12-08T08:18:56.736545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767548+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:53.767548+0000","last_peered":"2023-12-08T08:18:53.767548+0000","last_clean":"2023-12-08T08:18:53.767548+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:53.767548+0000","last_undegraded":"2023-12-08T08:18:53.767548+0000","last_fullsized":"2023-12-08T08:18:53.767548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:13.192235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736794+0000","last_change":"2023-12-08T08:18:53.783741+0000","last_active":"2023-12-08T08:18:56.736794+0000","last_peered":"2023-12-08T08:18:56.736794+0000","last_clean":"2023-12-08T08:18:56.736794+0000","last_became_active":"2023-12-08T08:18:53.783368+0000","last_became_peered":"2023-12-08T08:18:53.783368+0000","last_unstale":"2023-12-08T08:18:56.736794+0000","last_undegraded":"2023-12-08T08:18:56.736794+0000","last_fullsized":"2023-12-08T08:18:56.736794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.773868+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:18:53.773868+0000","last_peered":"2023-12-08T08:18:53.773868+0000","last_clean":"2023-12-08T08:18:53.773868+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:18:53.773868+0000","last_undegraded":"2023-12-08T08:18:53.773868+0000","last_fullsized":"2023-12-08T08:18:53.773868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:11.472054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265982+0000","last_change":"2023-12-08T08:18:53.774648+0000","last_active":"2023-12-08T08:18:55.265982+0000","last_peered":"2023-12-08T08:18:55.265982+0000","last_clean":"2023-12-08T08:18:55.265982+0000","last_became_active":"2023-12-08T08:18:53.774370+0000","last_became_peered":"2023-12-08T08:18:53.774370+0000","last_unstale":"2023-12-08T08:18:55.265982+0000","last_undegraded":"2023-12-08T08:18:55.265982+0000","last_fullsized":"2023-12-08T08:18:55.265982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:12.299840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.766658+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:53.766658+0000","last_peered":"2023-12-08T08:18:53.766658+0000","last_clean":"2023-12-08T08:18:53.766658+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:53.766658+0000","last_undegraded":"2023-12-08T08:18:53.766658+0000","last_fullsized":"2023-12-08T08:18:53.766658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:18.747307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784210+0000","last_change":"2023-12-08T08:18:53.797020+0000","last_active":"2023-12-08T08:18:54.784210+0000","last_peered":"2023-12-08T08:18:54.784210+0000","last_clean":"2023-12-08T08:18:54.784210+0000","last_became_active":"2023-12-08T08:18:53.796346+0000","last_became_peered":"2023-12-08T08:18:53.796346+0000","last_unstale":"2023-12-08T08:18:54.784210+0000","last_undegraded":"2023-12-08T08:18:54.784210+0000","last_fullsized":"2023-12-08T08:18:54.784210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795649+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:53.795649+0000","last_peered":"2023-12-08T08:18:53.795649+0000","last_clean":"2023-12-08T08:18:53.795649+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:53.795649+0000","last_undegraded":"2023-12-08T08:18:53.795649+0000","last_fullsized":"2023-12-08T08:18:53.795649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:38.183707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266763+0000","last_change":"2023-12-08T08:18:53.797033+0000","last_active":"2023-12-08T08:18:55.266763+0000","last_peered":"2023-12-08T08:18:55.266763+0000","last_clean":"2023-12-08T08:18:55.266763+0000","last_became_active":"2023-12-08T08:18:53.791785+0000","last_became_peered":"2023-12-08T08:18:53.791785+0000","last_unstale":"2023-12-08T08:18:55.266763+0000","last_undegraded":"2023-12-08T08:18:55.266763+0000","last_fullsized":"2023-12-08T08:18:55.266763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:55.940558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738333+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:56.738333+0000","last_peered":"2023-12-08T08:18:56.738333+0000","last_clean":"2023-12-08T08:18:56.738333+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:56.738333+0000","last_undegraded":"2023-12-08T08:18:56.738333+0000","last_fullsized":"2023-12-08T08:18:56.738333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266590+0000","last_change":"2023-12-08T08:18:53.782490+0000","last_active":"2023-12-08T08:18:55.266590+0000","last_peered":"2023-12-08T08:18:55.266590+0000","last_clean":"2023-12-08T08:18:55.266590+0000","last_became_active":"2023-12-08T08:18:53.778003+0000","last_became_peered":"2023-12-08T08:18:53.778003+0000","last_unstale":"2023-12-08T08:18:55.266590+0000","last_undegraded":"2023-12-08T08:18:55.266590+0000","last_fullsized":"2023-12-08T08:18:55.266590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:32.849547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767545+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:53.767545+0000","last_peered":"2023-12-08T08:18:53.767545+0000","last_clean":"2023-12-08T08:18:53.767545+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:53.767545+0000","last_undegraded":"2023-12-08T08:18:53.767545+0000","last_fullsized":"2023-12-08T08:18:53.767545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739025+0000","last_change":"2023-12-08T08:18:53.794202+0000","last_active":"2023-12-08T08:18:56.739025+0000","last_peered":"2023-12-08T08:18:56.739025+0000","last_clean":"2023-12-08T08:18:56.739025+0000","last_became_active":"2023-12-08T08:18:53.791356+0000","last_became_peered":"2023-12-08T08:18:53.791356+0000","last_unstale":"2023-12-08T08:18:56.739025+0000","last_undegraded":"2023-12-08T08:18:56.739025+0000","last_fullsized":"2023-12-08T08:18:56.739025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:29.010585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778330+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:53.778330+0000","last_peered":"2023-12-08T08:18:53.778330+0000","last_clean":"2023-12-08T08:18:53.778330+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:53.778330+0000","last_undegraded":"2023-12-08T08:18:53.778330+0000","last_fullsized":"2023-12-08T08:18:53.778330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777845+0000","last_change":"2023-12-08T08:18:53.772714+0000","last_active":"2023-12-08T08:18:54.777845+0000","last_peered":"2023-12-08T08:18:54.777845+0000","last_clean":"2023-12-08T08:18:54.777845+0000","last_became_active":"2023-12-08T08:18:53.772434+0000","last_became_peered":"2023-12-08T08:18:53.772434+0000","last_unstale":"2023-12-08T08:18:54.777845+0000","last_undegraded":"2023-12-08T08:18:54.777845+0000","last_fullsized":"2023-12-08T08:18:54.777845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:22:31.251454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.772950+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:53.772950+0000","last_peered":"2023-12-08T08:18:53.772950+0000","last_clean":"2023-12-08T08:18:53.772950+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:53.772950+0000","last_undegraded":"2023-12-08T08:18:53.772950+0000","last_fullsized":"2023-12-08T08:18:53.772950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:27.663212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738506+0000","last_change":"2023-12-08T08:18:53.776698+0000","last_active":"2023-12-08T08:18:56.738506+0000","last_peered":"2023-12-08T08:18:56.738506+0000","last_clean":"2023-12-08T08:18:56.738506+0000","last_became_active":"2023-12-08T08:18:53.776407+0000","last_became_peered":"2023-12-08T08:18:53.776407+0000","last_unstale":"2023-12-08T08:18:56.738506+0000","last_undegraded":"2023-12-08T08:18:56.738506+0000","last_fullsized":"2023-12-08T08:18:56.738506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:39.190015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778434+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:18:53.778434+0000","last_peered":"2023-12-08T08:18:53.778434+0000","last_clean":"2023-12-08T08:18:53.778434+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:18:53.778434+0000","last_undegraded":"2023-12-08T08:18:53.778434+0000","last_fullsized":"2023-12-08T08:18:53.778434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:13.176435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.783874+0000","last_change":"2023-12-08T08:18:53.793867+0000","last_active":"2023-12-08T08:18:54.783874+0000","last_peered":"2023-12-08T08:18:54.783874+0000","last_clean":"2023-12-08T08:18:54.783874+0000","last_became_active":"2023-12-08T08:18:53.793487+0000","last_became_peered":"2023-12-08T08:18:53.793487+0000","last_unstale":"2023-12-08T08:18:54.783874+0000","last_undegraded":"2023-12-08T08:18:54.783874+0000","last_fullsized":"2023-12-08T08:18:54.783874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.773077+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:53.773077+0000","last_peered":"2023-12-08T08:18:53.773077+0000","last_clean":"2023-12-08T08:18:53.773077+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:53.773077+0000","last_undegraded":"2023-12-08T08:18:53.773077+0000","last_fullsized":"2023-12-08T08:18:53.773077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265983+0000","last_change":"2023-12-08T08:18:53.783184+0000","last_active":"2023-12-08T08:18:55.265983+0000","last_peered":"2023-12-08T08:18:55.265983+0000","last_clean":"2023-12-08T08:18:55.265983+0000","last_became_active":"2023-12-08T08:18:53.782914+0000","last_became_peered":"2023-12-08T08:18:53.782914+0000","last_unstale":"2023-12-08T08:18:55.265983+0000","last_undegraded":"2023-12-08T08:18:55.265983+0000","last_fullsized":"2023-12-08T08:18:55.265983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:58:21.451598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777964+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:53.777964+0000","last_peered":"2023-12-08T08:18:53.777964+0000","last_clean":"2023-12-08T08:18:53.777964+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:53.777964+0000","last_undegraded":"2023-12-08T08:18:53.777964+0000","last_fullsized":"2023-12-08T08:18:53.777964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079216+0000","last_change":"2023-12-08T08:18:53.784995+0000","last_active":"2023-12-08T08:18:56.079216+0000","last_peered":"2023-12-08T08:18:56.079216+0000","last_clean":"2023-12-08T08:18:56.079216+0000","last_became_active":"2023-12-08T08:18:53.784770+0000","last_became_peered":"2023-12-08T08:18:53.784770+0000","last_unstale":"2023-12-08T08:18:56.079216+0000","last_undegraded":"2023-12-08T08:18:56.079216+0000","last_fullsized":"2023-12-08T08:18:56.079216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:48:54.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.752913+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:53.752913+0000","last_peered":"2023-12-08T08:18:53.752913+0000","last_clean":"2023-12-08T08:18:53.752913+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:53.752913+0000","last_undegraded":"2023-12-08T08:18:53.752913+0000","last_fullsized":"2023-12-08T08:18:53.752913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:56:14.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078585+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:56.078585+0000","last_peered":"2023-12-08T08:18:56.078585+0000","last_clean":"2023-12-08T08:18:56.078585+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:56.078585+0000","last_undegraded":"2023-12-08T08:18:56.078585+0000","last_fullsized":"2023-12-08T08:18:56.078585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1572864,"data_stored":1042716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.014,"15min":1.014},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4330000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.095,"15min":1.083},"min":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.823}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.1359999999999999,"15min":1.153},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.7,"5min":1.794,"15min":1.794},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.895,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":2.145}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.181,"15min":1.179},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.8680000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.85199999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.1220000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.321,"15min":1.331},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":2.077},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3939999999999999,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.75,"15min":0.75},"max":{"1min":1.927,"5min":3.524,"15min":3.524},"last":1.504}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.3879999999999999,"15min":1.405},"min":{"1min":0.90600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.7029999999999998,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.365,"15min":1.355},"min":{"1min":0.871,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.9530000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.4710000000000001,"15min":1.4419999999999999},"min":{"1min":1.1559999999999999,"5min":0.752,"15min":0.752},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.921},{"interface":"front","average":{"1min":1.538,"5min":1.5149999999999999,"15min":1.5069999999999999},"min":{"1min":1.0649999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6920000000000002,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":2.758}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.633,"15min":1.653},"min":{"1min":1.089,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":2.2810000000000001},{"interface":"front","average":{"1min":1.629,"5min":1.609,"15min":1.6080000000000001},"min":{"1min":1.1359999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.347}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":454508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.583,"15min":1.8009999999999999},"min":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6020000000000001,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.653,"15min":1.9139999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.532,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.137,"15min":1.113},"min":{"1min":0.74399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5720000000000001,"5min":1.762,"15min":1.762},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2050000000000001,"15min":1.2350000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4990000000000001,"5min":3.4009999999999998,"15min":3.4009999999999998},"last":1.1040000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.2050000000000001,"15min":1.23},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":2.141,"15min":2.141},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.2629999999999999,"15min":1.2649999999999999},"min":{"1min":0.77200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1539999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.361,"15min":1.413},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6910000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.218},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.323,"15min":1.377},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.494,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3240000000000001,"15min":1.3440000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8879999999999999,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.544},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3819999999999999,"15min":1.4079999999999999},"min":{"1min":0.58499999999999996,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.845,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3169999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.431,"15min":1.4810000000000001},"min":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6839999999999999,"5min":2.96,"15min":2.96},"last":1.052},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.488,"15min":1.49},"min":{"1min":0.67900000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0019999999999998,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.603}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.4730000000000001,"15min":1.482},"min":{"1min":0.68500000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9239999999999999,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.415},{"interface":"front","average":{"1min":1.393,"5min":1.548,"15min":1.5980000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8029999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.508}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.63500000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4450000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0309999999999999,"15min":1.03},"min":{"1min":0.72099999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5369999999999999,"5min":1.627,"15min":1.627},"last":2.004}]},{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.036,"15min":1.008},"min":{"1min":0.80700000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.629,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.7629999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.198,"15min":1.23},"min":{"1min":0.73599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.6359999999999999,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.88}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.746,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.92700000000000005,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.516,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":2.827}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.323,"15min":1.345},"min":{"1min":0.749,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.825,"5min":1.96,"15min":1.96},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.4259999999999999},"min":{"1min":1.042,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.7350000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.96}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2669999999999999,"15min":1.2889999999999999},"min":{"1min":0.88600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.474,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3540000000000001,"15min":1.3660000000000001},"min":{"1min":0.88600000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6519999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.663}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3919999999999999,"15min":1.397},"min":{"1min":0.79500000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.8049999999999999,"5min":2.968,"15min":2.968},"last":3.0459999999999998},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.409,"15min":1.4259999999999999},"min":{"1min":0.72999999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.609,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.2430000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4830000000000001,"15min":1.4690000000000001},"min":{"1min":0.82799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.0590000000000002,"5min":3.242,"15min":3.242},"last":2.4950000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.5169999999999999,"15min":1.512},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8600000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":3.5169999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":452452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.022,"15min":1.0069999999999999},"min":{"1min":0.72499999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.641,"5min":1.776,"15min":1.776},"last":1.498},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.133,"15min":1.151},"min":{"1min":0.753,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.702,"5min":2.335,"15min":2.335},"last":0.84299999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.171,"15min":1.1930000000000001},"min":{"1min":0.752,"5min":0.626,"15min":0.626},"max":{"1min":1.575,"5min":1.958,"15min":1.958},"last":1.45},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.1080000000000001},"min":{"1min":0.746,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.236},"min":{"1min":0.71099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.603,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3799999999999999,"15min":1.4039999999999999},"min":{"1min":1.022,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7829999999999999,"5min":2.456,"15min":2.456},"last":1.3280000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.218,"15min":1.214},"min":{"1min":0.86199999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.171},{"interface":"front","average":{"1min":1.333,"5min":1.3129999999999999,"15min":1.3089999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.78,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.218}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.444,"15min":1.476},"min":{"1min":1.014,"5min":0.501,"15min":0.501},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3839999999999999,"15min":1.4279999999999999},"min":{"1min":0.92400000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0019999999999998,"5min":2.137,"15min":2.137},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4399999999999999,"15min":1.494},"min":{"1min":1.0529999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.8779999999999999,"5min":3.016,"15min":3.016},"last":1.387},{"interface":"front","average":{"1min":1.488,"5min":1.54,"15min":1.5780000000000001},"min":{"1min":1.181,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8140000000000001,"5min":2.54,"15min":2.54},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5489999999999999,"15min":1.5900000000000001},"min":{"1min":1.075,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.9470000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.6319999999999999,"15min":1.6759999999999999},"min":{"1min":1.159,"5min":0.5,"15min":0.5},"max":{"1min":1.96,"5min":3.141,"15min":3.141},"last":1.556}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.93200000000000005,"15min":0.95799999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.464,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.98799999999999999,"15min":1.03},"min":{"1min":0.503,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.288,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.476,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1220000000000001},"min":{"1min":0.53500000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.742,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0900000000000001,"15min":1.1160000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.804,"5min":2.121,"15min":2.121},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1559999999999999,"15min":1.1679999999999999},"min":{"1min":0.59199999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.177,"15min":1.1759999999999999},"min":{"1min":0.69399999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.548,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.88},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.361},"min":{"1min":0.83799999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0499999999999998,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4359999999999999,"15min":1.486},"min":{"1min":0.80800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.1640000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.363,"15min":1.377},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.899,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.167},{"interface":"front","average":{"1min":1.458,"5min":1.5289999999999999,"15min":1.575},"min":{"1min":0.95499999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.226,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Dec 8 08:17:59 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.45,"15min":1.4810000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.1800000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.5649999999999999,"15min":1.607},"min":{"1min":0.95599999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.4660000000000002,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.3600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2809999999999999,"5min":1.948,"15min":1.948},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.94799999999999995,"15min":0.90600000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.758,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.94399999999999995,"15min":0.94499999999999995},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2869999999999999,"5min":2.996,"15min":2.996},"last":0.747},{"interface":"front","average":{"1min":1.044,"5min":0.97199999999999998,"15min":0.95799999999999996},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.667,"5min":2.238,"15min":2.238},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.014,"15min":0.997},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0569999999999999,"15min":1.05},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.704,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.325,"15min":1.3180000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.1030000000000002,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.319,"5min":1.3680000000000001,"15min":1.3919999999999999},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7290000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.877}]},{"osd":5,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.361,"15min":1.3720000000000001},"min":{"1min":0.83299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.395,"15min":1.405},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.2149999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.893,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.4039999999999999,"15min":1.4139999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:17:55 2023","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.492,"15min":1.47},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.3260000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.026},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.504,"15min":1.506},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.1760000000000002,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.1930000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":452362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.36399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2569999999999999,"5min":1.585,"15min":1.585},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5429999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.308}]},{"osd":2,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.90200000000000002,"15min":0.91700000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":1.296,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.1120000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.1899999999999999},"min":{"1min":0.57099999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.665,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.501},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.0900000000000001,"15min":1.1279999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.556,"5min":2.327,"15min":2.327},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.266,"15min":1.3109999999999999},"min":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8140000000000001,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.78500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8779999999999999,"5min":2.552,"15min":2.552},"last":0.91500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.411,"15min":1.4830000000000001},"min":{"1min":0.75700000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.25,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3799999999999999,"15min":1.4419999999999999},"min":{"1min":0.63,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.821,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.528,"15min":1.591},"min":{"1min":0.81499999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.3159999999999998,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.5049999999999999,"15min":1.5660000000000001},"min":{"1min":0.80600000000000005,"5min":0.746,"15min":0.746},"max":{"1min":1.998,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:18:00 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.538,"15min":1.5900000000000001},"min":{"1min":0.84399999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.2770000000000001,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.622},{"interface":"front","average":{"1min":1.454,"5min":1.6279999999999999,"15min":1.6699999999999999},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.484,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.76500000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1589248,"data_stored":1044978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.51600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":2.194},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":1.0289999999999999,"15min":1.081},"min":{"1min":0.56399999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.5489999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.1639999999999999},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.524,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.1319999999999999,"15min":1.1699999999999999},"min":{"1min":0.65200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4490000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.3280000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.038,"15min":1.1040000000000001},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.252,"15min":1.3},"min":{"1min":0.61499999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8129999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.431,"15min":1.4950000000000001},"min":{"1min":0.95299999999999996,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.655,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.262},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.294,"15min":1.335},"min":{"1min":0.83699999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.706,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3999999999999999,"15min":1.4419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6859999999999999,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":0.80600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9510000000000001,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.5089999999999999,"15min":1.538},"min":{"1min":0.88500000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.048,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.536,"15min":1.6000000000000001},"min":{"1min":1.0269999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.8640000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.0940000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.6000000000000001,"15min":1.665},"min":{"1min":0.97999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.8009999999999999,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.363},{"interface":"front","average":{"1min":1.359,"5min":1.508,"15min":1.552},"min":{"1min":0.91700000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.742,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:03.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:03.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.615+0000 7f9f47848640 1 Processor -- start 2023-12-08T08:19:03.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.616+0000 7f9f47848640 1 -- start start 2023-12-08T08:19:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.617+0000 7f9f47848640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9f400c5a90 0x7f9f40154730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.617+0000 7f9f47848640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f40070310 0x7f9f400c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.617+0000 7f9f47848640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400a6d30 con 0x7f9f40151f20 2023-12-08T08:19:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.617+0000 7f9f47848640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400a6f80 con 0x7f9f400c5a90 2023-12-08T08:19:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.617+0000 7f9f47848640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400a7260 con 0x7f9f40070310 2023-12-08T08:19:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.618+0000 7f9f44de3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9f400c5a90 0x7f9f40154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.618+0000 7f9f45de5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f40070310 0x7f9f400c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.618+0000 7f9f44de3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9f400c5a90 0x7f9f40154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:37680/0 (socket says 172.21.15.45:37680) 2023-12-08T08:19:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.618+0000 7f9f44de3640 1 -- 172.21.15.45:0/2188713209 learned_addr learned my addr 172.21.15.45:0/2188713209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.619+0000 7f9f44de3640 1 -- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f40070310 msgr2=0x7f9f400c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.619+0000 7f9f44de3640 1 --2- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f40070310 0x7f9f400c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.619+0000 7f9f44de3640 1 -- 172.21.15.45:0/2188713209 >> v1:172.21.15.114:6789/0 conn(0x7f9f40151f20 legacy=0x7f9f40158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.619+0000 7f9f44de3640 1 -- 172.21.15.45:0/2188713209 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40157e40 con 0x7f9f400c5a90 2023-12-08T08:19:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.620+0000 7f9f44de3640 1 --2- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f400c5a90 0x7f9f40154730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009870 tx=0x7f9f3002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158c2bb274e150da server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f37fff640 1 -- 172.21.15.45:0/2188713209 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30031640 con 0x7f9f400c5a90 2023-12-08T08:19:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f37fff640 1 -- 172.21.15.45:0/2188713209 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f300317a0 con 0x7f9f400c5a90 2023-12-08T08:19:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f37fff640 1 -- 172.21.15.45:0/2188713209 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30031b30 con 0x7f9f400c5a90 2023-12-08T08:19:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 -- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f400c5a90 msgr2=0x7f9f40154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 --2- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f400c5a90 0x7f9f40154730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009870 tx=0x7f9f3002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 -- 172.21.15.45:0/2188713209 shutdown_connections 2023-12-08T08:19:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 --2- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f40070310 0x7f9f400c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 --2- 172.21.15.45:0/2188713209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f400c5a90 0x7f9f40154730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.621+0000 7f9f47848640 1 -- 172.21.15.45:0/2188713209 >> 172.21.15.45:0/2188713209 conn(0x7f9f400a98a0 msgr2=0x7f9f400a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.622+0000 7f9f47848640 1 -- 172.21.15.45:0/2188713209 shutdown_connections 2023-12-08T08:19:03.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.622+0000 7f9f47848640 1 -- 172.21.15.45:0/2188713209 wait complete. 2023-12-08T08:19:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.624+0000 7f9f47848640 1 Processor -- start 2023-12-08T08:19:03.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.624+0000 7f9f47848640 1 -- start start 2023-12-08T08:19:03.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.625+0000 7f9f47848640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.625+0000 7f9f47848640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f400c5a90 0x7f9f401ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.625+0000 7f9f47848640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f40151f20 0x7f9f401edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f47848640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4009a1a0 con 0x7f9f40070310 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f47848640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4009b230 con 0x7f9f40151f20 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f47848640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4006dad0 con 0x7f9f400c5a90 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46764/0 (socket says 172.21.15.45:46764) 2023-12-08T08:19:03.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 -- 172.21.15.45:0/3983464476 learned_addr learned my addr 172.21.15.45:0/3983464476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f44de3640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f400c5a90 0x7f9f401ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f45de5640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f40151f20 0x7f9f401edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 -- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f400c5a90 msgr2=0x7f9f401ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f400c5a90 0x7f9f401ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 -- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f40151f20 msgr2=0x7f9f401edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f40151f20 0x7f9f401edbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.626+0000 7f9f455e4640 1 -- 172.21.15.45:0/3983464476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300094d0 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f455e4640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00c760 tx=0x7f9f3c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c006d50 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00ce70 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003b90 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4006f3f0 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.627+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4006dce0 con 0x7f9f40070310 2023-12-08T08:19:03.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.628+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f400a8db0 con 0x7f9f40070310 2023-12-08T08:19:03.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.630+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f3c003cf0 con 0x7f9f40070310 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.631+0000 7f9f35ffb640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.631+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9f3c0892f0 con 0x7f9f40070310 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.631+0000 7f9f44de3640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.632+0000 7f9f44de3640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 0x7f9f2406d300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f30036000 tx=0x7f9f3003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.637+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f3c057d00 con 0x7f9f40070310 2023-12-08T08:19:03.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.831+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f40154c70 con 0x7f9f2406ae40 2023-12-08T08:19:03.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.853+0000 7f9f35ffb640 1 -- 172.21.15.45:0/3983464476 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287167 (secure 0 0 0) 0x7f9f30044400 con 0x7f9f2406ae40 2023-12-08T08:19:03.860 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:19:03.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 msgr2=0x7f9f2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 0x7f9f2406d300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f30036000 tx=0x7f9f3003c040 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 msgr2=0x7f9f4006f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00c760 tx=0x7f9f3c00cc20 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 shutdown_connections 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9f2406ae40 0x7f9f2406d300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9f400c5a90 0x7f9f401ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f40151f20 0x7f9f401edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 --2- 172.21.15.45:0/3983464476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f40070310 0x7f9f4006f880 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 >> 172.21.15.45:0/3983464476 conn(0x7f9f400a98a0 msgr2=0x7f9f40158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 shutdown_connections 2023-12-08T08:19:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:03.859+0000 7f9f47848640 1 -- 172.21.15.45:0/3983464476 wait complete. 2023-12-08T08:19:03.883 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-12-08T08:19:03.784946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254088,"kb_used_data":8808,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720632,"statfs":{"total":773094113280,"available":772833927168,"internally_reserved":0,"allocated":9019392,"data_stored":4803892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004137"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739659+0000","last_change":"2023-12-08T08:18:53.772671+0000","last_active":"2023-12-08T08:18:56.739659+0000","last_peered":"2023-12-08T08:18:56.739659+0000","last_clean":"2023-12-08T08:18:56.739659+0000","last_became_active":"2023-12-08T08:18:53.772403+0000","last_became_peered":"2023-12-08T08:18:53.772403+0000","last_unstale":"2023-12-08T08:18:56.739659+0000","last_undegraded":"2023-12-08T08:18:56.739659+0000","last_fullsized":"2023-12-08T08:18:56.739659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:49.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738717+0000","last_change":"2023-12-08T08:18:53.783694+0000","last_active":"2023-12-08T08:18:56.738717+0000","last_peered":"2023-12-08T08:18:56.738717+0000","last_clean":"2023-12-08T08:18:56.738717+0000","last_became_active":"2023-12-08T08:18:53.782993+0000","last_became_peered":"2023-12-08T08:18:53.782993+0000","last_unstale":"2023-12-08T08:18:56.738717+0000","last_undegraded":"2023-12-08T08:18:56.738717+0000","last_fullsized":"2023-12-08T08:18:56.738717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739466+0000","last_change":"2023-12-08T08:18:53.786844+0000","last_active":"2023-12-08T08:18:56.739466+0000","last_peered":"2023-12-08T08:18:56.739466+0000","last_clean":"2023-12-08T08:18:56.739466+0000","last_became_active":"2023-12-08T08:18:53.786534+0000","last_became_peered":"2023-12-08T08:18:53.786534+0000","last_unstale":"2023-12-08T08:18:56.739466+0000","last_undegraded":"2023-12-08T08:18:56.739466+0000","last_fullsized":"2023-12-08T08:18:56.739466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:41.159908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737406+0000","last_change":"2023-12-08T08:18:53.789128+0000","last_active":"2023-12-08T08:18:56.737406+0000","last_peered":"2023-12-08T08:18:56.737406+0000","last_clean":"2023-12-08T08:18:56.737406+0000","last_became_active":"2023-12-08T08:18:53.788783+0000","last_became_peered":"2023-12-08T08:18:53.788783+0000","last_unstale":"2023-12-08T08:18:56.737406+0000","last_undegraded":"2023-12-08T08:18:56.737406+0000","last_fullsized":"2023-12-08T08:18:56.737406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:26:07.559242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737264+0000","last_change":"2023-12-08T08:18:53.789378+0000","last_active":"2023-12-08T08:18:56.737264+0000","last_peered":"2023-12-08T08:18:56.737264+0000","last_clean":"2023-12-08T08:18:56.737264+0000","last_became_active":"2023-12-08T08:18:53.789113+0000","last_became_peered":"2023-12-08T08:18:53.789113+0000","last_unstale":"2023-12-08T08:18:56.737264+0000","last_undegraded":"2023-12-08T08:18:56.737264+0000","last_fullsized":"2023-12-08T08:18:56.737264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:31.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265640+0000","last_change":"2023-12-08T08:18:53.796019+0000","last_active":"2023-12-08T08:18:55.265640+0000","last_peered":"2023-12-08T08:18:55.265640+0000","last_clean":"2023-12-08T08:18:55.265640+0000","last_became_active":"2023-12-08T08:18:53.788065+0000","last_became_peered":"2023-12-08T08:18:53.788065+0000","last_unstale":"2023-12-08T08:18:55.265640+0000","last_undegraded":"2023-12-08T08:18:55.265640+0000","last_fullsized":"2023-12-08T08:18:55.265640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078751+0000","last_change":"2023-12-08T08:18:53.793006+0000","last_active":"2023-12-08T08:18:56.078751+0000","last_peered":"2023-12-08T08:18:56.078751+0000","last_clean":"2023-12-08T08:18:56.078751+0000","last_became_active":"2023-12-08T08:18:53.792739+0000","last_became_peered":"2023-12-08T08:18:53.792739+0000","last_unstale":"2023-12-08T08:18:56.078751+0000","last_undegraded":"2023-12-08T08:18:56.078751+0000","last_fullsized":"2023-12-08T08:18:56.078751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:16.681517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737401+0000","last_change":"2023-12-08T08:18:53.791174+0000","last_active":"2023-12-08T08:18:56.737401+0000","last_peered":"2023-12-08T08:18:56.737401+0000","last_clean":"2023-12-08T08:18:56.737401+0000","last_became_active":"2023-12-08T08:18:53.788909+0000","last_became_peered":"2023-12-08T08:18:53.788909+0000","last_unstale":"2023-12-08T08:18:56.737401+0000","last_undegraded":"2023-12-08T08:18:56.737401+0000","last_fullsized":"2023-12-08T08:18:56.737401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:49:42.248379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737971+0000","last_change":"2023-12-08T08:18:53.786983+0000","last_active":"2023-12-08T08:18:56.737971+0000","last_peered":"2023-12-08T08:18:56.737971+0000","last_clean":"2023-12-08T08:18:56.737971+0000","last_became_active":"2023-12-08T08:18:53.786722+0000","last_became_peered":"2023-12-08T08:18:53.786722+0000","last_unstale":"2023-12-08T08:18:56.737971+0000","last_undegraded":"2023-12-08T08:18:56.737971+0000","last_fullsized":"2023-12-08T08:18:56.737971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778393+0000","last_change":"2023-12-08T08:18:53.789804+0000","last_active":"2023-12-08T08:18:54.778393+0000","last_peered":"2023-12-08T08:18:54.778393+0000","last_clean":"2023-12-08T08:18:54.778393+0000","last_became_active":"2023-12-08T08:18:53.786215+0000","last_became_peered":"2023-12-08T08:18:53.786215+0000","last_unstale":"2023-12-08T08:18:54.778393+0000","last_undegraded":"2023-12-08T08:18:54.778393+0000","last_fullsized":"2023-12-08T08:18:54.778393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:51.622019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737281+0000","last_change":"2023-12-08T08:18:53.782075+0000","last_active":"2023-12-08T08:18:56.737281+0000","last_peered":"2023-12-08T08:18:56.737281+0000","last_clean":"2023-12-08T08:18:56.737281+0000","last_became_active":"2023-12-08T08:18:53.775721+0000","last_became_peered":"2023-12-08T08:18:53.775721+0000","last_unstale":"2023-12-08T08:18:56.737281+0000","last_undegraded":"2023-12-08T08:18:56.737281+0000","last_fullsized":"2023-12-08T08:18:56.737281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778031+0000","last_change":"2023-12-08T08:18:53.776155+0000","last_active":"2023-12-08T08:18:54.778031+0000","last_peered":"2023-12-08T08:18:54.778031+0000","last_clean":"2023-12-08T08:18:54.778031+0000","last_became_active":"2023-12-08T08:18:53.775833+0000","last_became_peered":"2023-12-08T08:18:53.775833+0000","last_unstale":"2023-12-08T08:18:54.778031+0000","last_undegraded":"2023-12-08T08:18:54.778031+0000","last_fullsized":"2023-12-08T08:18:54.778031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:57.738584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736728+0000","last_change":"2023-12-08T08:18:53.787632+0000","last_active":"2023-12-08T08:18:56.736728+0000","last_peered":"2023-12-08T08:18:56.736728+0000","last_clean":"2023-12-08T08:18:56.736728+0000","last_became_active":"2023-12-08T08:18:53.787135+0000","last_became_peered":"2023-12-08T08:18:53.787135+0000","last_unstale":"2023-12-08T08:18:56.736728+0000","last_undegraded":"2023-12-08T08:18:56.736728+0000","last_fullsized":"2023-12-08T08:18:56.736728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:51:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737235+0000","last_change":"2023-12-08T08:18:53.771818+0000","last_active":"2023-12-08T08:18:56.737235+0000","last_peered":"2023-12-08T08:18:56.737235+0000","last_clean":"2023-12-08T08:18:56.737235+0000","last_became_active":"2023-12-08T08:18:53.771528+0000","last_became_peered":"2023-12-08T08:18:53.771528+0000","last_unstale":"2023-12-08T08:18:56.737235+0000","last_undegraded":"2023-12-08T08:18:56.737235+0000","last_fullsized":"2023-12-08T08:18:56.737235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.782986+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.782641+0000","last_became_peered":"2023-12-08T08:18:53.782641+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:07:35.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265388+0000","last_change":"2023-12-08T08:18:53.783616+0000","last_active":"2023-12-08T08:18:55.265388+0000","last_peered":"2023-12-08T08:18:55.265388+0000","last_clean":"2023-12-08T08:18:55.265388+0000","last_became_active":"2023-12-08T08:18:53.783322+0000","last_became_peered":"2023-12-08T08:18:53.783322+0000","last_unstale":"2023-12-08T08:18:55.265388+0000","last_undegraded":"2023-12-08T08:18:55.265388+0000","last_fullsized":"2023-12-08T08:18:55.265388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:45.651039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267104+0000","last_change":"2023-12-08T08:18:53.795881+0000","last_active":"2023-12-08T08:18:55.267104+0000","last_peered":"2023-12-08T08:18:55.267104+0000","last_clean":"2023-12-08T08:18:55.267104+0000","last_became_active":"2023-12-08T08:18:53.795563+0000","last_became_peered":"2023-12-08T08:18:53.795563+0000","last_unstale":"2023-12-08T08:18:55.267104+0000","last_undegraded":"2023-12-08T08:18:55.267104+0000","last_fullsized":"2023-12-08T08:18:55.267104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:59.236997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739646+0000","last_change":"2023-12-08T08:18:53.783723+0000","last_active":"2023-12-08T08:18:56.739646+0000","last_peered":"2023-12-08T08:18:56.739646+0000","last_clean":"2023-12-08T08:18:56.739646+0000","last_became_active":"2023-12-08T08:18:53.783415+0000","last_became_peered":"2023-12-08T08:18:53.783415+0000","last_unstale":"2023-12-08T08:18:56.739646+0000","last_undegraded":"2023-12-08T08:18:56.739646+0000","last_fullsized":"2023-12-08T08:18:56.739646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:52.604642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737512+0000","last_change":"2023-12-08T08:18:53.784426+0000","last_active":"2023-12-08T08:18:56.737512+0000","last_peered":"2023-12-08T08:18:56.737512+0000","last_clean":"2023-12-08T08:18:56.737512+0000","last_became_active":"2023-12-08T08:18:53.774174+0000","last_became_peered":"2023-12-08T08:18:53.774174+0000","last_unstale":"2023-12-08T08:18:56.737512+0000","last_undegraded":"2023-12-08T08:18:56.737512+0000","last_fullsized":"2023-12-08T08:18:56.737512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737770+0000","last_change":"2023-12-08T08:18:53.775530+0000","last_active":"2023-12-08T08:18:56.737770+0000","last_peered":"2023-12-08T08:18:56.737770+0000","last_clean":"2023-12-08T08:18:56.737770+0000","last_became_active":"2023-12-08T08:18:53.775237+0000","last_became_peered":"2023-12-08T08:18:53.775237+0000","last_unstale":"2023-12-08T08:18:56.737770+0000","last_undegraded":"2023-12-08T08:18:56.737770+0000","last_fullsized":"2023-12-08T08:18:56.737770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:40.484831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737052+0000","last_change":"2023-12-08T08:18:53.791563+0000","last_active":"2023-12-08T08:18:56.737052+0000","last_peered":"2023-12-08T08:18:56.737052+0000","last_clean":"2023-12-08T08:18:56.737052+0000","last_became_active":"2023-12-08T08:18:53.791257+0000","last_became_peered":"2023-12-08T08:18:53.791257+0000","last_unstale":"2023-12-08T08:18:56.737052+0000","last_undegraded":"2023-12-08T08:18:56.737052+0000","last_fullsized":"2023-12-08T08:18:56.737052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:04.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737716+0000","last_change":"2023-12-08T08:18:53.771206+0000","last_active":"2023-12-08T08:18:56.737716+0000","last_peered":"2023-12-08T08:18:56.737716+0000","last_clean":"2023-12-08T08:18:56.737716+0000","last_became_active":"2023-12-08T08:18:53.763984+0000","last_became_peered":"2023-12-08T08:18:53.763984+0000","last_unstale":"2023-12-08T08:18:56.737716+0000","last_undegraded":"2023-12-08T08:18:56.737716+0000","last_fullsized":"2023-12-08T08:18:56.737716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784756+0000","last_change":"2023-12-08T08:18:53.794394+0000","last_active":"2023-12-08T08:18:54.784756+0000","last_peered":"2023-12-08T08:18:54.784756+0000","last_clean":"2023-12-08T08:18:54.784756+0000","last_became_active":"2023-12-08T08:18:53.794138+0000","last_became_peered":"2023-12-08T08:18:53.794138+0000","last_unstale":"2023-12-08T08:18:54.784756+0000","last_undegraded":"2023-12-08T08:18:54.784756+0000","last_fullsized":"2023-12-08T08:18:54.784756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.786075+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.783458+0000","last_became_peered":"2023-12-08T08:18:53.783458+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:12:32.634182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739114+0000","last_change":"2023-12-08T08:18:53.789101+0000","last_active":"2023-12-08T08:18:56.739114+0000","last_peered":"2023-12-08T08:18:56.739114+0000","last_clean":"2023-12-08T08:18:56.739114+0000","last_became_active":"2023-12-08T08:18:53.788487+0000","last_became_peered":"2023-12-08T08:18:53.788487+0000","last_unstale":"2023-12-08T08:18:56.739114+0000","last_undegraded":"2023-12-08T08:18:56.739114+0000","last_fullsized":"2023-12-08T08:18:56.739114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:42.120522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738383+0000","last_change":"2023-12-08T08:18:53.772180+0000","last_active":"2023-12-08T08:18:56.738383+0000","last_peered":"2023-12-08T08:18:56.738383+0000","last_clean":"2023-12-08T08:18:56.738383+0000","last_became_active":"2023-12-08T08:18:53.764066+0000","last_became_peered":"2023-12-08T08:18:53.764066+0000","last_unstale":"2023-12-08T08:18:56.738383+0000","last_undegraded":"2023-12-08T08:18:56.738383+0000","last_fullsized":"2023-12-08T08:18:56.738383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778269+0000","last_change":"2023-12-08T08:18:53.793998+0000","last_active":"2023-12-08T08:18:54.778269+0000","last_peered":"2023-12-08T08:18:54.778269+0000","last_clean":"2023-12-08T08:18:54.778269+0000","last_became_active":"2023-12-08T08:18:53.793584+0000","last_became_peered":"2023-12-08T08:18:53.793584+0000","last_unstale":"2023-12-08T08:18:54.778269+0000","last_undegraded":"2023-12-08T08:18:54.778269+0000","last_fullsized":"2023-12-08T08:18:54.778269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:30:39.090688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738098+0000","last_change":"2023-12-08T08:18:53.768788+0000","last_active":"2023-12-08T08:18:56.738098+0000","last_peered":"2023-12-08T08:18:56.738098+0000","last_clean":"2023-12-08T08:18:56.738098+0000","last_became_active":"2023-12-08T08:18:53.768468+0000","last_became_peered":"2023-12-08T08:18:53.768468+0000","last_unstale":"2023-12-08T08:18:56.738098+0000","last_undegraded":"2023-12-08T08:18:56.738098+0000","last_fullsized":"2023-12-08T08:18:56.738098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:44:42.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079535+0000","last_change":"2023-12-08T08:18:53.786191+0000","last_active":"2023-12-08T08:18:56.079535+0000","last_peered":"2023-12-08T08:18:56.079535+0000","last_clean":"2023-12-08T08:18:56.079535+0000","last_became_active":"2023-12-08T08:18:53.785934+0000","last_became_peered":"2023-12-08T08:18:53.785934+0000","last_unstale":"2023-12-08T08:18:56.079535+0000","last_undegraded":"2023-12-08T08:18:56.079535+0000","last_fullsized":"2023-12-08T08:18:56.079535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:26.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738088+0000","last_change":"2023-12-08T08:18:53.785767+0000","last_active":"2023-12-08T08:18:56.738088+0000","last_peered":"2023-12-08T08:18:56.738088+0000","last_clean":"2023-12-08T08:18:56.738088+0000","last_became_active":"2023-12-08T08:18:53.785369+0000","last_became_peered":"2023-12-08T08:18:53.785369+0000","last_unstale":"2023-12-08T08:18:56.738088+0000","last_undegraded":"2023-12-08T08:18:56.738088+0000","last_fullsized":"2023-12-08T08:18:56.738088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736341+0000","last_change":"2023-12-08T08:18:53.786744+0000","last_active":"2023-12-08T08:18:56.736341+0000","last_peered":"2023-12-08T08:18:56.736341+0000","last_clean":"2023-12-08T08:18:56.736341+0000","last_became_active":"2023-12-08T08:18:53.785499+0000","last_became_peered":"2023-12-08T08:18:53.785499+0000","last_unstale":"2023-12-08T08:18:56.736341+0000","last_undegraded":"2023-12-08T08:18:56.736341+0000","last_fullsized":"2023-12-08T08:18:56.736341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265746+0000","last_change":"2023-12-08T08:18:53.783040+0000","last_active":"2023-12-08T08:18:55.265746+0000","last_peered":"2023-12-08T08:18:55.265746+0000","last_clean":"2023-12-08T08:18:55.265746+0000","last_became_active":"2023-12-08T08:18:53.781940+0000","last_became_peered":"2023-12-08T08:18:53.781940+0000","last_unstale":"2023-12-08T08:18:55.265746+0000","last_undegraded":"2023-12-08T08:18:55.265746+0000","last_fullsized":"2023-12-08T08:18:55.265746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:35.044283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266255+0000","last_change":"2023-12-08T08:18:53.797000+0000","last_active":"2023-12-08T08:18:55.266255+0000","last_peered":"2023-12-08T08:18:55.266255+0000","last_clean":"2023-12-08T08:18:55.266255+0000","last_became_active":"2023-12-08T08:18:53.791588+0000","last_became_peered":"2023-12-08T08:18:53.791588+0000","last_unstale":"2023-12-08T08:18:55.266255+0000","last_undegraded":"2023-12-08T08:18:55.266255+0000","last_fullsized":"2023-12-08T08:18:55.266255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:32.972182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800688+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:53.800688+0000","last_peered":"2023-12-08T08:18:53.800688+0000","last_clean":"2023-12-08T08:18:53.800688+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:53.800688+0000","last_undegraded":"2023-12-08T08:18:53.800688+0000","last_fullsized":"2023-12-08T08:18:53.800688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:03.362667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266519+0000","last_change":"2023-12-08T08:18:53.784523+0000","last_active":"2023-12-08T08:18:55.266519+0000","last_peered":"2023-12-08T08:18:55.266519+0000","last_clean":"2023-12-08T08:18:55.266519+0000","last_became_active":"2023-12-08T08:18:53.784246+0000","last_became_peered":"2023-12-08T08:18:53.784246+0000","last_unstale":"2023-12-08T08:18:55.266519+0000","last_undegraded":"2023-12-08T08:18:55.266519+0000","last_fullsized":"2023-12-08T08:18:55.266519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:09.884228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795005+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:53.795005+0000","last_peered":"2023-12-08T08:18:53.795005+0000","last_clean":"2023-12-08T08:18:53.795005+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:53.795005+0000","last_undegraded":"2023-12-08T08:18:53.795005+0000","last_fullsized":"2023-12-08T08:18:53.795005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079331+0000","last_change":"2023-12-08T08:18:53.796068+0000","last_active":"2023-12-08T08:18:56.079331+0000","last_peered":"2023-12-08T08:18:56.079331+0000","last_clean":"2023-12-08T08:18:56.079331+0000","last_became_active":"2023-12-08T08:18:53.795798+0000","last_became_peered":"2023-12-08T08:18:53.795798+0000","last_unstale":"2023-12-08T08:18:56.079331+0000","last_undegraded":"2023-12-08T08:18:56.079331+0000","last_fullsized":"2023-12-08T08:18:56.079331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:19.902148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799218+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:53.799218+0000","last_peered":"2023-12-08T08:18:53.799218+0000","last_clean":"2023-12-08T08:18:53.799218+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:53.799218+0000","last_undegraded":"2023-12-08T08:18:53.799218+0000","last_fullsized":"2023-12-08T08:18:53.799218+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:38.128264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267110+0000","last_change":"2023-12-08T08:18:53.794864+0000","last_active":"2023-12-08T08:18:55.267110+0000","last_peered":"2023-12-08T08:18:55.267110+0000","last_clean":"2023-12-08T08:18:55.267110+0000","last_became_active":"2023-12-08T08:18:53.794563+0000","last_became_peered":"2023-12-08T08:18:53.794563+0000","last_unstale":"2023-12-08T08:18:55.267110+0000","last_undegraded":"2023-12-08T08:18:55.267110+0000","last_fullsized":"2023-12-08T08:18:55.267110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:24.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.793681+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:53.793681+0000","last_peered":"2023-12-08T08:18:53.793681+0000","last_clean":"2023-12-08T08:18:53.793681+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:53.793681+0000","last_undegraded":"2023-12-08T08:18:53.793681+0000","last_fullsized":"2023-12-08T08:18:53.793681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736727+0000","last_change":"2023-12-08T08:18:53.779851+0000","last_active":"2023-12-08T08:18:56.736727+0000","last_peered":"2023-12-08T08:18:56.736727+0000","last_clean":"2023-12-08T08:18:56.736727+0000","last_became_active":"2023-12-08T08:18:53.775977+0000","last_became_peered":"2023-12-08T08:18:53.775977+0000","last_unstale":"2023-12-08T08:18:56.736727+0000","last_undegraded":"2023-12-08T08:18:56.736727+0000","last_fullsized":"2023-12-08T08:18:56.736727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:05.520867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.785079+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:53.785079+0000","last_peered":"2023-12-08T08:18:53.785079+0000","last_clean":"2023-12-08T08:18:53.785079+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:53.785079+0000","last_undegraded":"2023-12-08T08:18:53.785079+0000","last_fullsized":"2023-12-08T08:18:53.785079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784046+0000","last_change":"2023-12-08T08:18:53.792138+0000","last_active":"2023-12-08T08:18:54.784046+0000","last_peered":"2023-12-08T08:18:54.784046+0000","last_clean":"2023-12-08T08:18:54.784046+0000","last_became_active":"2023-12-08T08:18:53.791865+0000","last_became_peered":"2023-12-08T08:18:53.791865+0000","last_unstale":"2023-12-08T08:18:54.784046+0000","last_undegraded":"2023-12-08T08:18:54.784046+0000","last_fullsized":"2023-12-08T08:18:54.784046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778377+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:53.778377+0000","last_peered":"2023-12-08T08:18:53.778377+0000","last_clean":"2023-12-08T08:18:53.778377+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:53.778377+0000","last_undegraded":"2023-12-08T08:18:53.778377+0000","last_fullsized":"2023-12-08T08:18:53.778377+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:38.922247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265759+0000","last_change":"2023-12-08T08:18:53.789767+0000","last_active":"2023-12-08T08:18:55.265759+0000","last_peered":"2023-12-08T08:18:55.265759+0000","last_clean":"2023-12-08T08:18:55.265759+0000","last_became_active":"2023-12-08T08:18:53.787669+0000","last_became_peered":"2023-12-08T08:18:53.787669+0000","last_unstale":"2023-12-08T08:18:55.265759+0000","last_undegraded":"2023-12-08T08:18:55.265759+0000","last_fullsized":"2023-12-08T08:18:55.265759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:50.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.765578+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:53.765578+0000","last_peered":"2023-12-08T08:18:53.765578+0000","last_clean":"2023-12-08T08:18:53.765578+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:53.765578+0000","last_undegraded":"2023-12-08T08:18:53.765578+0000","last_fullsized":"2023-12-08T08:18:53.765578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:19:13.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737008+0000","last_change":"2023-12-08T08:18:53.792753+0000","last_active":"2023-12-08T08:18:56.737008+0000","last_peered":"2023-12-08T08:18:56.737008+0000","last_clean":"2023-12-08T08:18:56.737008+0000","last_became_active":"2023-12-08T08:18:53.792416+0000","last_became_peered":"2023-12-08T08:18:53.792416+0000","last_unstale":"2023-12-08T08:18:56.737008+0000","last_undegraded":"2023-12-08T08:18:56.737008+0000","last_fullsized":"2023-12-08T08:18:56.737008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:25.085766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777800+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:53.777800+0000","last_peered":"2023-12-08T08:18:53.777800+0000","last_clean":"2023-12-08T08:18:53.777800+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:53.777800+0000","last_undegraded":"2023-12-08T08:18:53.777800+0000","last_fullsized":"2023-12-08T08:18:53.777800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737781+0000","last_change":"2023-12-08T08:18:53.774352+0000","last_active":"2023-12-08T08:18:56.737781+0000","last_peered":"2023-12-08T08:18:56.737781+0000","last_clean":"2023-12-08T08:18:56.737781+0000","last_became_active":"2023-12-08T08:18:53.773904+0000","last_became_peered":"2023-12-08T08:18:53.773904+0000","last_unstale":"2023-12-08T08:18:56.737781+0000","last_undegraded":"2023-12-08T08:18:56.737781+0000","last_fullsized":"2023-12-08T08:18:56.737781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778702+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:18:53.778702+0000","last_peered":"2023-12-08T08:18:53.778702+0000","last_clean":"2023-12-08T08:18:53.778702+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:18:53.778702+0000","last_undegraded":"2023-12-08T08:18:53.778702+0000","last_fullsized":"2023-12-08T08:18:53.778702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079026+0000","last_change":"2023-12-08T08:18:53.792470+0000","last_active":"2023-12-08T08:18:56.079026+0000","last_peered":"2023-12-08T08:18:56.079026+0000","last_clean":"2023-12-08T08:18:56.079026+0000","last_became_active":"2023-12-08T08:18:53.792143+0000","last_became_peered":"2023-12-08T08:18:53.792143+0000","last_unstale":"2023-12-08T08:18:56.079026+0000","last_undegraded":"2023-12-08T08:18:56.079026+0000","last_fullsized":"2023-12-08T08:18:56.079026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:25:20.644648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.763782+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:53.763782+0000","last_peered":"2023-12-08T08:18:53.763782+0000","last_clean":"2023-12-08T08:18:53.763782+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:53.763782+0000","last_undegraded":"2023-12-08T08:18:53.763782+0000","last_fullsized":"2023-12-08T08:18:53.763782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:41.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739816+0000","last_change":"2023-12-08T08:18:53.778524+0000","last_active":"2023-12-08T08:18:56.739816+0000","last_peered":"2023-12-08T08:18:56.739816+0000","last_clean":"2023-12-08T08:18:56.739816+0000","last_became_active":"2023-12-08T08:18:53.778209+0000","last_became_peered":"2023-12-08T08:18:53.778209+0000","last_unstale":"2023-12-08T08:18:56.739816+0000","last_undegraded":"2023-12-08T08:18:56.739816+0000","last_fullsized":"2023-12-08T08:18:56.739816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:42.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.801258+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:53.801258+0000","last_peered":"2023-12-08T08:18:53.801258+0000","last_clean":"2023-12-08T08:18:53.801258+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:53.801258+0000","last_undegraded":"2023-12-08T08:18:53.801258+0000","last_fullsized":"2023-12-08T08:18:53.801258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738456+0000","last_change":"2023-12-08T08:18:53.790906+0000","last_active":"2023-12-08T08:18:56.738456+0000","last_peered":"2023-12-08T08:18:56.738456+0000","last_clean":"2023-12-08T08:18:56.738456+0000","last_became_active":"2023-12-08T08:18:53.790630+0000","last_became_peered":"2023-12-08T08:18:53.790630+0000","last_unstale":"2023-12-08T08:18:56.738456+0000","last_undegraded":"2023-12-08T08:18:56.738456+0000","last_fullsized":"2023-12-08T08:18:56.738456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:59:27.277967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.807037+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:18:53.807037+0000","last_peered":"2023-12-08T08:18:53.807037+0000","last_clean":"2023-12-08T08:18:53.807037+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:18:53.807037+0000","last_undegraded":"2023-12-08T08:18:53.807037+0000","last_fullsized":"2023-12-08T08:18:53.807037+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:18.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737140+0000","last_change":"2023-12-08T08:18:53.785668+0000","last_active":"2023-12-08T08:18:56.737140+0000","last_peered":"2023-12-08T08:18:56.737140+0000","last_clean":"2023-12-08T08:18:56.737140+0000","last_became_active":"2023-12-08T08:18:53.785342+0000","last_became_peered":"2023-12-08T08:18:53.785342+0000","last_unstale":"2023-12-08T08:18:56.737140+0000","last_undegraded":"2023-12-08T08:18:56.737140+0000","last_fullsized":"2023-12-08T08:18:56.737140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:53.630993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.796583+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:53.796583+0000","last_peered":"2023-12-08T08:18:53.796583+0000","last_clean":"2023-12-08T08:18:53.796583+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:53.796583+0000","last_undegraded":"2023-12-08T08:18:53.796583+0000","last_fullsized":"2023-12-08T08:18:53.796583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737237+0000","last_change":"2023-12-08T08:18:53.788006+0000","last_active":"2023-12-08T08:18:56.737237+0000","last_peered":"2023-12-08T08:18:56.737237+0000","last_clean":"2023-12-08T08:18:56.737237+0000","last_became_active":"2023-12-08T08:18:53.787709+0000","last_became_peered":"2023-12-08T08:18:53.787709+0000","last_unstale":"2023-12-08T08:18:56.737237+0000","last_undegraded":"2023-12-08T08:18:56.737237+0000","last_fullsized":"2023-12-08T08:18:56.737237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:55.392551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.764699+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:53.764699+0000","last_peered":"2023-12-08T08:18:53.764699+0000","last_clean":"2023-12-08T08:18:53.764699+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:53.764699+0000","last_undegraded":"2023-12-08T08:18:53.764699+0000","last_fullsized":"2023-12-08T08:18:53.764699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:01.823592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777824+0000","last_change":"2023-12-08T08:18:53.780686+0000","last_active":"2023-12-08T08:18:54.777824+0000","last_peered":"2023-12-08T08:18:54.777824+0000","last_clean":"2023-12-08T08:18:54.777824+0000","last_became_active":"2023-12-08T08:18:53.780408+0000","last_became_peered":"2023-12-08T08:18:53.780408+0000","last_unstale":"2023-12-08T08:18:54.777824+0000","last_undegraded":"2023-12-08T08:18:54.777824+0000","last_fullsized":"2023-12-08T08:18:54.777824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:50.587465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.753049+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:53.753049+0000","last_peered":"2023-12-08T08:18:53.753049+0000","last_clean":"2023-12-08T08:18:53.753049+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:53.753049+0000","last_undegraded":"2023-12-08T08:18:53.753049+0000","last_fullsized":"2023-12-08T08:18:53.753049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:12.525160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778063+0000","last_change":"2023-12-08T08:18:53.774289+0000","last_active":"2023-12-08T08:18:54.778063+0000","last_peered":"2023-12-08T08:18:54.778063+0000","last_clean":"2023-12-08T08:18:54.778063+0000","last_became_active":"2023-12-08T08:18:53.773997+0000","last_became_peered":"2023-12-08T08:18:53.773997+0000","last_unstale":"2023-12-08T08:18:54.778063+0000","last_undegraded":"2023-12-08T08:18:54.778063+0000","last_fullsized":"2023-12-08T08:18:54.778063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:57.939378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799582+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:53.799582+0000","last_peered":"2023-12-08T08:18:53.799582+0000","last_clean":"2023-12-08T08:18:53.799582+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:53.799582+0000","last_undegraded":"2023-12-08T08:18:53.799582+0000","last_fullsized":"2023-12-08T08:18:53.799582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:50.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266509+0000","last_change":"2023-12-08T08:18:53.791859+0000","last_active":"2023-12-08T08:18:55.266509+0000","last_peered":"2023-12-08T08:18:55.266509+0000","last_clean":"2023-12-08T08:18:55.266509+0000","last_became_active":"2023-12-08T08:18:53.791211+0000","last_became_peered":"2023-12-08T08:18:53.791211+0000","last_unstale":"2023-12-08T08:18:55.266509+0000","last_undegraded":"2023-12-08T08:18:55.266509+0000","last_fullsized":"2023-12-08T08:18:55.266509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:58.762577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.791574+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:53.791574+0000","last_peered":"2023-12-08T08:18:53.791574+0000","last_clean":"2023-12-08T08:18:53.791574+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:53.791574+0000","last_undegraded":"2023-12-08T08:18:53.791574+0000","last_fullsized":"2023-12-08T08:18:53.791574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:30.013320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784262+0000","last_change":"2023-12-08T08:18:53.788889+0000","last_active":"2023-12-08T08:18:54.784262+0000","last_peered":"2023-12-08T08:18:54.784262+0000","last_clean":"2023-12-08T08:18:54.784262+0000","last_became_active":"2023-12-08T08:18:53.788322+0000","last_became_peered":"2023-12-08T08:18:53.788322+0000","last_unstale":"2023-12-08T08:18:54.784262+0000","last_undegraded":"2023-12-08T08:18:54.784262+0000","last_fullsized":"2023-12-08T08:18:54.784262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.797401+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:53.797401+0000","last_peered":"2023-12-08T08:18:53.797401+0000","last_clean":"2023-12-08T08:18:53.797401+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:53.797401+0000","last_undegraded":"2023-12-08T08:18:53.797401+0000","last_fullsized":"2023-12-08T08:18:53.797401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:16.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738117+0000","last_change":"2023-12-08T08:18:53.779656+0000","last_active":"2023-12-08T08:18:56.738117+0000","last_peered":"2023-12-08T08:18:56.738117+0000","last_clean":"2023-12-08T08:18:56.738117+0000","last_became_active":"2023-12-08T08:18:53.774380+0000","last_became_peered":"2023-12-08T08:18:53.774380+0000","last_unstale":"2023-12-08T08:18:56.738117+0000","last_undegraded":"2023-12-08T08:18:56.738117+0000","last_fullsized":"2023-12-08T08:18:56.738117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800530+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:53.800530+0000","last_peered":"2023-12-08T08:18:53.800530+0000","last_clean":"2023-12-08T08:18:53.800530+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:53.800530+0000","last_undegraded":"2023-12-08T08:18:53.800530+0000","last_fullsized":"2023-12-08T08:18:53.800530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265782+0000","last_change":"2023-12-08T08:18:53.790829+0000","last_active":"2023-12-08T08:18:55.265782+0000","last_peered":"2023-12-08T08:18:55.265782+0000","last_clean":"2023-12-08T08:18:55.265782+0000","last_became_active":"2023-12-08T08:18:53.790471+0000","last_became_peered":"2023-12-08T08:18:53.790471+0000","last_unstale":"2023-12-08T08:18:55.265782+0000","last_undegraded":"2023-12-08T08:18:55.265782+0000","last_fullsized":"2023-12-08T08:18:55.265782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:53.065257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799654+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:18:53.799654+0000","last_peered":"2023-12-08T08:18:53.799654+0000","last_clean":"2023-12-08T08:18:53.799654+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:18:53.799654+0000","last_undegraded":"2023-12-08T08:18:53.799654+0000","last_fullsized":"2023-12-08T08:18:53.799654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:50.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736545+0000","last_change":"2023-12-08T08:18:53.779115+0000","last_active":"2023-12-08T08:18:56.736545+0000","last_peered":"2023-12-08T08:18:56.736545+0000","last_clean":"2023-12-08T08:18:56.736545+0000","last_became_active":"2023-12-08T08:18:53.778078+0000","last_became_peered":"2023-12-08T08:18:53.778078+0000","last_unstale":"2023-12-08T08:18:56.736545+0000","last_undegraded":"2023-12-08T08:18:56.736545+0000","last_fullsized":"2023-12-08T08:18:56.736545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767548+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:53.767548+0000","last_peered":"2023-12-08T08:18:53.767548+0000","last_clean":"2023-12-08T08:18:53.767548+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:53.767548+0000","last_undegraded":"2023-12-08T08:18:53.767548+0000","last_fullsized":"2023-12-08T08:18:53.767548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:13.192235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736794+0000","last_change":"2023-12-08T08:18:53.783741+0000","last_active":"2023-12-08T08:18:56.736794+0000","last_peered":"2023-12-08T08:18:56.736794+0000","last_clean":"2023-12-08T08:18:56.736794+0000","last_became_active":"2023-12-08T08:18:53.783368+0000","last_became_peered":"2023-12-08T08:18:53.783368+0000","last_unstale":"2023-12-08T08:18:56.736794+0000","last_undegraded":"2023-12-08T08:18:56.736794+0000","last_fullsized":"2023-12-08T08:18:56.736794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.773868+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:18:53.773868+0000","last_peered":"2023-12-08T08:18:53.773868+0000","last_clean":"2023-12-08T08:18:53.773868+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:18:53.773868+0000","last_undegraded":"2023-12-08T08:18:53.773868+0000","last_fullsized":"2023-12-08T08:18:53.773868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:11.472054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265982+0000","last_change":"2023-12-08T08:18:53.774648+0000","last_active":"2023-12-08T08:18:55.265982+0000","last_peered":"2023-12-08T08:18:55.265982+0000","last_clean":"2023-12-08T08:18:55.265982+0000","last_became_active":"2023-12-08T08:18:53.774370+0000","last_became_peered":"2023-12-08T08:18:53.774370+0000","last_unstale":"2023-12-08T08:18:55.265982+0000","last_undegraded":"2023-12-08T08:18:55.265982+0000","last_fullsized":"2023-12-08T08:18:55.265982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:12.299840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.766658+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:53.766658+0000","last_peered":"2023-12-08T08:18:53.766658+0000","last_clean":"2023-12-08T08:18:53.766658+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:53.766658+0000","last_undegraded":"2023-12-08T08:18:53.766658+0000","last_fullsized":"2023-12-08T08:18:53.766658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:18.747307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784210+0000","last_change":"2023-12-08T08:18:53.797020+0000","last_active":"2023-12-08T08:18:54.784210+0000","last_peered":"2023-12-08T08:18:54.784210+0000","last_clean":"2023-12-08T08:18:54.784210+0000","last_became_active":"2023-12-08T08:18:53.796346+0000","last_became_peered":"2023-12-08T08:18:53.796346+0000","last_unstale":"2023-12-08T08:18:54.784210+0000","last_undegraded":"2023-12-08T08:18:54.784210+0000","last_fullsized":"2023-12-08T08:18:54.784210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795649+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:53.795649+0000","last_peered":"2023-12-08T08:18:53.795649+0000","last_clean":"2023-12-08T08:18:53.795649+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:53.795649+0000","last_undegraded":"2023-12-08T08:18:53.795649+0000","last_fullsized":"2023-12-08T08:18:53.795649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:38.183707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266763+0000","last_change":"2023-12-08T08:18:53.797033+0000","last_active":"2023-12-08T08:18:55.266763+0000","last_peered":"2023-12-08T08:18:55.266763+0000","last_clean":"2023-12-08T08:18:55.266763+0000","last_became_active":"2023-12-08T08:18:53.791785+0000","last_became_peered":"2023-12-08T08:18:53.791785+0000","last_unstale":"2023-12-08T08:18:55.266763+0000","last_undegraded":"2023-12-08T08:18:55.266763+0000","last_fullsized":"2023-12-08T08:18:55.266763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:55.940558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738333+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:56.738333+0000","last_peered":"2023-12-08T08:18:56.738333+0000","last_clean":"2023-12-08T08:18:56.738333+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:56.738333+0000","last_undegraded":"2023-12-08T08:18:56.738333+0000","last_fullsized":"2023-12-08T08:18:56.738333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266590+0000","last_change":"2023-12-08T08:18:53.782490+0000","last_active":"2023-12-08T08:18:55.266590+0000","last_peered":"2023-12-08T08:18:55.266590+0000","last_clean":"2023-12-08T08:18:55.266590+0000","last_became_active":"2023-12-08T08:18:53.778003+0000","last_became_peered":"2023-12-08T08:18:53.778003+0000","last_unstale":"2023-12-08T08:18:55.266590+0000","last_undegraded":"2023-12-08T08:18:55.266590+0000","last_fullsized":"2023-12-08T08:18:55.266590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:32.849547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767545+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:53.767545+0000","last_peered":"2023-12-08T08:18:53.767545+0000","last_clean":"2023-12-08T08:18:53.767545+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:53.767545+0000","last_undegraded":"2023-12-08T08:18:53.767545+0000","last_fullsized":"2023-12-08T08:18:53.767545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739025+0000","last_change":"2023-12-08T08:18:53.794202+0000","last_active":"2023-12-08T08:18:56.739025+0000","last_peered":"2023-12-08T08:18:56.739025+0000","last_clean":"2023-12-08T08:18:56.739025+0000","last_became_active":"2023-12-08T08:18:53.791356+0000","last_became_peered":"2023-12-08T08:18:53.791356+0000","last_unstale":"2023-12-08T08:18:56.739025+0000","last_undegraded":"2023-12-08T08:18:56.739025+0000","last_fullsized":"2023-12-08T08:18:56.739025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:29.010585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778330+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:53.778330+0000","last_peered":"2023-12-08T08:18:53.778330+0000","last_clean":"2023-12-08T08:18:53.778330+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:53.778330+0000","last_undegraded":"2023-12-08T08:18:53.778330+0000","last_fullsized":"2023-12-08T08:18:53.778330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777845+0000","last_change":"2023-12-08T08:18:53.772714+0000","last_active":"2023-12-08T08:18:54.777845+0000","last_peered":"2023-12-08T08:18:54.777845+0000","last_clean":"2023-12-08T08:18:54.777845+0000","last_became_active":"2023-12-08T08:18:53.772434+0000","last_became_peered":"2023-12-08T08:18:53.772434+0000","last_unstale":"2023-12-08T08:18:54.777845+0000","last_undegraded":"2023-12-08T08:18:54.777845+0000","last_fullsized":"2023-12-08T08:18:54.777845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:22:31.251454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.772950+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:53.772950+0000","last_peered":"2023-12-08T08:18:53.772950+0000","last_clean":"2023-12-08T08:18:53.772950+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:53.772950+0000","last_undegraded":"2023-12-08T08:18:53.772950+0000","last_fullsized":"2023-12-08T08:18:53.772950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:27.663212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738506+0000","last_change":"2023-12-08T08:18:53.776698+0000","last_active":"2023-12-08T08:18:56.738506+0000","last_peered":"2023-12-08T08:18:56.738506+0000","last_clean":"2023-12-08T08:18:56.738506+0000","last_became_active":"2023-12-08T08:18:53.776407+0000","last_became_peered":"2023-12-08T08:18:53.776407+0000","last_unstale":"2023-12-08T08:18:56.738506+0000","last_undegraded":"2023-12-08T08:18:56.738506+0000","last_fullsized":"2023-12-08T08:18:56.738506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:39.190015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778434+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:18:53.778434+0000","last_peered":"2023-12-08T08:18:53.778434+0000","last_clean":"2023-12-08T08:18:53.778434+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:18:53.778434+0000","last_undegraded":"2023-12-08T08:18:53.778434+0000","last_fullsized":"2023-12-08T08:18:53.778434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:13.176435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.783874+0000","last_change":"2023-12-08T08:18:53.793867+0000","last_active":"2023-12-08T08:18:54.783874+0000","last_peered":"2023-12-08T08:18:54.783874+0000","last_clean":"2023-12-08T08:18:54.783874+0000","last_became_active":"2023-12-08T08:18:53.793487+0000","last_became_peered":"2023-12-08T08:18:53.793487+0000","last_unstale":"2023-12-08T08:18:54.783874+0000","last_undegraded":"2023-12-08T08:18:54.783874+0000","last_fullsized":"2023-12-08T08:18:54.783874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.773077+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:53.773077+0000","last_peered":"2023-12-08T08:18:53.773077+0000","last_clean":"2023-12-08T08:18:53.773077+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:53.773077+0000","last_undegraded":"2023-12-08T08:18:53.773077+0000","last_fullsized":"2023-12-08T08:18:53.773077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265983+0000","last_change":"2023-12-08T08:18:53.783184+0000","last_active":"2023-12-08T08:18:55.265983+0000","last_peered":"2023-12-08T08:18:55.265983+0000","last_clean":"2023-12-08T08:18:55.265983+0000","last_became_active":"2023-12-08T08:18:53.782914+0000","last_became_peered":"2023-12-08T08:18:53.782914+0000","last_unstale":"2023-12-08T08:18:55.265983+0000","last_undegraded":"2023-12-08T08:18:55.265983+0000","last_fullsized":"2023-12-08T08:18:55.265983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:58:21.451598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777964+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:53.777964+0000","last_peered":"2023-12-08T08:18:53.777964+0000","last_clean":"2023-12-08T08:18:53.777964+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:53.777964+0000","last_undegraded":"2023-12-08T08:18:53.777964+0000","last_fullsized":"2023-12-08T08:18:53.777964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079216+0000","last_change":"2023-12-08T08:18:53.784995+0000","last_active":"2023-12-08T08:18:56.079216+0000","last_peered":"2023-12-08T08:18:56.079216+0000","last_clean":"2023-12-08T08:18:56.079216+0000","last_became_active":"2023-12-08T08:18:53.784770+0000","last_became_peered":"2023-12-08T08:18:53.784770+0000","last_unstale":"2023-12-08T08:18:56.079216+0000","last_undegraded":"2023-12-08T08:18:56.079216+0000","last_fullsized":"2023-12-08T08:18:56.079216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:48:54.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.752913+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:53.752913+0000","last_peered":"2023-12-08T08:18:53.752913+0000","last_clean":"2023-12-08T08:18:53.752913+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:53.752913+0000","last_undegraded":"2023-12-08T08:18:53.752913+0000","last_fullsized":"2023-12-08T08:18:53.752913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:56:14.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078585+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:56.078585+0000","last_peered":"2023-12-08T08:18:56.078585+0000","last_clean":"2023-12-08T08:18:56.078585+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:56.078585+0000","last_undegraded":"2023-12-08T08:18:56.078585+0000","last_fullsized":"2023-12-08T08:18:56.078585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1572864,"data_stored":1042716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.099,"15min":1.0840000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.823,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.5029999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.66900000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6599999999999999,"5min":1.794,"15min":1.794},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2090000000000001,"15min":1.2350000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8680000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6639999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.391}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2989999999999999,"15min":1.3240000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.077,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.367,"15min":1.4059999999999999},"min":{"1min":0.76200000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.728,"5min":3.524,"15min":3.524},"last":1.5629999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.367,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.343},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.365,"15min":1.355},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.974,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.6020000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.4950000000000001,"15min":1.45},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5229999999999999,"15min":1.5089999999999999},"min":{"1min":0.71899999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.758,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.4430000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.6279999999999999,"15min":1.6519999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7360000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":0.748,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.347,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.7130000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":454508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.444,"15min":1.7549999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.6319999999999997,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4910000000000001,"15min":1.8600000000000001},"min":{"1min":0.749,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.835,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.5389999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.179,"15min":1.127},"min":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.5620000000000003,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.82399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":7.2539999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.2290000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.2490000000000001,"15min":1.2450000000000001},"min":{"1min":0.754,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.296,"15min":1.276},"min":{"1min":0.83599999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.181}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.319,"15min":1.399},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.8919999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.528,"5min":1.347,"15min":1.385},"min":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.6150000000000002,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.282}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.3620000000000001,"15min":1.3560000000000001},"min":{"1min":0.87,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.4370000000000003,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.486},{"interface":"front","average":{"1min":1.544,"5min":1.4059999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.0430000000000001,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4450000000000001,"15min":1.486},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":8.0039999999999996,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.4890000000000001,"15min":1.4910000000000001},"min":{"1min":0.95699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.605}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5029999999999999,"15min":1.492},"min":{"1min":0.99199999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":7.1989999999999998,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.776,"5min":1.579,"15min":1.609},"min":{"1min":1.0800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":8.532,"5min":8.532,"15min":8.532},"last":1.5720000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98799999999999999,"15min":0.95699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8100000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.0549999999999999,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.022}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.0800000000000001,"15min":1.0229999999999999},"min":{"1min":0.73299999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8049999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.53300000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.5,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.93200000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1859999999999999,"15min":1.1899999999999999},"min":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.542}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3260000000000001,"15min":1.3460000000000001},"min":{"1min":0.95999999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":1.96,"15min":1.96},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.4019999999999999,"15min":1.4219999999999999},"min":{"1min":0.88800000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.96,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.6779999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2549999999999999,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.665,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.458},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":0.80300000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.6359999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.411,"15min":1.403},"min":{"1min":0.73599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.75},{"interface":"front","average":{"1min":1.351,"5min":1.393,"15min":1.421},"min":{"1min":0.84299999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.7549999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.597}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.514,"15min":1.4790000000000001},"min":{"1min":0.86499999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4950000000000001,"5min":3.242,"15min":3.242},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.536,"15min":1.518},"min":{"1min":0.82399999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.857}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":452452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.72699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.54,"5min":1.776,"15min":1.776},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.109,"15min":1.143},"min":{"1min":0.65400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.335,"15min":2.335},"last":0.86799999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.86699999999999999,"5min":0.626,"15min":0.626},"max":{"1min":1.5109999999999999,"5min":1.958,"15min":1.958},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.76500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6040000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":2.2389999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2050000000000001,"15min":1.2370000000000001},"min":{"1min":0.80600000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9319999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.502},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3580000000000001,"15min":1.397},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8200000000000001,"5min":2.456,"15min":2.456},"last":1.236}]},{"osd":3,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.232,"15min":1.218},"min":{"1min":0.82299999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8080000000000001,"5min":1.871,"15min":1.871},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.327,"15min":1.3129999999999999},"min":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.831,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.401}]},{"osd":5,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.4059999999999999,"15min":1.4630000000000001},"min":{"1min":0.94099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.669,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.361,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.798,"5min":2.137,"15min":2.137},"last":1.351}]},{"osd":6,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.407,"15min":1.4830000000000001},"min":{"1min":0.84299999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9350000000000001,"5min":3.016,"15min":3.016},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.413,"5min":1.5029999999999999,"15min":1.5660000000000001},"min":{"1min":0.93000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.802,"5min":2.54,"15min":2.54},"last":0.99299999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5229999999999999,"15min":1.581},"min":{"1min":1.0660000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7709999999999999,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.476},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.609,"15min":1.669},"min":{"1min":1.1599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":2.1200000000000001,"5min":3.141,"15min":3.141},"last":1.087}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.89400000000000002,"15min":0.94499999999999995},"min":{"1min":0.47899999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2490000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.95299999999999996,"15min":1.0189999999999999},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.484,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1950000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96199999999999997,"15min":0.98199999999999998},"min":{"1min":0.51900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5369999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.079,"15min":1.1140000000000001},"min":{"1min":0.60899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6479999999999999,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.018}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8149999999999999,"5min":2.121,"15min":2.121},"last":1.242},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.165},"min":{"1min":0.60499999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.282}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.83399999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8420000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.319},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3360000000000001,"15min":1.361},"min":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8640000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.4590000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.401,"15min":1.4750000000000001},"min":{"1min":0.97199999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.8100000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":0.79300000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.919,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.8919999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4330000000000001,"15min":1.4450000000000001},"min":{"1min":0.85299999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9470000000000001,"5min":2.25,"15min":2.25},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.49,"15min":1.5620000000000001},"min":{"1min":0.83299999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.8180000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.363}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.448,"15min":1.48},"min":{"1min":0.85299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9299999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":2.036},{"interface":"front","average":{"1min":1.595,"5min":1.5580000000000001,"15min":1.605},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0649999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":2.0859999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.772,"5min":1.948,"15min":1.948},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95099999999999996,"15min":0.90700000000000003},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4370000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.89500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.546,"5min":2.996,"15min":2.996},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.0049999999999999,"15min":0.96899999999999997},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.9390000000000001,"5min":2.238,"15min":2.238},"last":1.216}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0389999999999999,"15min":1.0049999999999999},"min":{"1min":0.68500000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.6819999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.0920000000000001,"15min":1.0620000000000001},"min":{"1min":0.68200000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.718,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.3500000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.82899999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9359999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.3600000000000001,"15min":1.389},"min":{"1min":0.86299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8819999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.5860000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3799999999999999,"15min":1.3779999999999999},"min":{"1min":0.99399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3530000000000002,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.401,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.1080000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.637}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4239999999999999,"15min":1.4299999999999999},"min":{"1min":0.78400000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3140000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.819},{"interface":"front","average":{"1min":1.522,"5min":1.425,"15min":1.421},"min":{"1min":0.92400000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.861}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4950000000000001,"15min":1.4710000000000001},"min":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.0760000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":2.0760000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.516,"15min":1.51},"min":{"1min":1.0149999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2549999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":2.0070000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":452362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.6899999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.2110000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":2.2000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":2.0750000000000002},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":1.631}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.972},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":2.2719999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.994},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":2.25}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":2.1600000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":2.3439999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":2.1230000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1589248,"data_stored":1044978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86599999999999999,"15min":0.86699999999999999},"min":{"1min":0.503,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.369,"5min":2.194,"15min":2.194},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.56000000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6619999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.999}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.099,"15min":1.151},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4930000000000001,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.01,"5min":1.0960000000000001,"15min":1.1579999999999999},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3280000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.2629999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1,"15min":1.091},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4059999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.298},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2410000000000001,"15min":1.2969999999999999},"min":{"1min":0.61099999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.9490000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.1950000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.391,"15min":1.4810000000000001},"min":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.712,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.133},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.264,"15min":1.325},"min":{"1min":0.85099999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.4550000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.365,"15min":1.431},"min":{"1min":0.873,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.597},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.389,"15min":1.401},"min":{"1min":0.79400000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5009999999999999,"15min":1.5349999999999999},"min":{"1min":1.1200000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.831,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.639},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.585},"min":{"1min":0.86499999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7989999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.3320000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5549999999999999,"15min":1.6499999999999999},"min":{"1min":1.0669999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.0920000000000001,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4770000000000001,"15min":1.542},"min":{"1min":0.76800000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.804,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:03.888 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:19:03.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:19:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.161+0000 7fef01f67640 1 Processor -- start 2023-12-08T08:19:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.161+0000 7fef01f67640 1 -- start start 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7fef01f67640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feefc071dc0 0x7feefc154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7fef01f67640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feefc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7fef01f67640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0c2400 con 0x7feefc0c5980 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7fef01f67640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0c26e0 con 0x7feefc071dc0 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7fef01f67640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc072ac0 con 0x7feefc157a30 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7feefbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feefc0c5980 0x7feefc14e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56276/0 (socket says 172.21.15.45:56276) 2023-12-08T08:19:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.163+0000 7feefbfff640 1 -- 172.21.15.45:0/720660808 learned_addr learned my addr 172.21.15.45:0/720660808 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7fef00f65640 1 --2- 172.21.15.45:0/720660808 >> v2:172.21.15.114:3300/0 conn(0x7feefc071dc0 0x7feefc154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7fef01766640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feefc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624738703 0 0) 0x7feefc0c2400 con 0x7feefc0c5980 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec003520 con 0x7feefc0c5980 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625201781 0 0) 0x7feeec003520 con 0x7feefc0c5980 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 msgr2=0x7feefc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feefc157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 >> v2:172.21.15.114:3300/0 conn(0x7feefc071dc0 msgr2=0x7feefc154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 --2- 172.21.15.45:0/720660808 >> v2:172.21.15.114:3300/0 conn(0x7feefc071dc0 0x7feefc154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0a6dc0 con 0x7feefc0c5980 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7feee8001670 con 0x7feefc0c5980 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 >> v1:172.21.15.45:6789/0 conn(0x7feefc0c5980 legacy=0x7feefc14e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.164+0000 7feefb7fe640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feeec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefb7fe640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0047c0 0x7feeec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefb7fe640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feeec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0c26e0 con 0x7feeec003970 2023-12-08T08:19:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc072ac0 con 0x7feeec0047c0 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00b9b0 con 0x7feefc157a30 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feeec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef01766640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feeec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefbfff640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0047c0 0x7feeec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 -- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 msgr2=0x7feeec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc157a30 0x7feeec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 -- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0047c0 msgr2=0x7feeec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0047c0 0x7feeec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7fef00f65640 1 -- 172.21.15.45:0/720660808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec003520 con 0x7feeec003970 2023-12-08T08:19:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.165+0000 7feefbfff640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeec0047c0 0x7feeec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.167+0000 7fef00f65640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feeec003d90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7feef0009ac0 tx=0x7feeec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf65db5572b0f8bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.167+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef002c6d0 con 0x7feeec003970 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.167+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef002c830 con 0x7feeec003970 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.167+0000 7feefb7fe640 1 -- 172.21.15.45:0/720660808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef002cbc0 con 0x7feeec003970 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.167+0000 7fef01f67640 1 -- 172.21.15.45:0/720660808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 msgr2=0x7feeec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01f67640 1 --2- 172.21.15.45:0/720660808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feeec003d90 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7feef0009ac0 tx=0x7feeec0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01766640 1 -- 172.21.15.45:0/720660808 reap_dead start 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01f67640 1 -- 172.21.15.45:0/720660808 shutdown_connections 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01f67640 1 -- 172.21.15.45:0/720660808 >> 172.21.15.45:0/720660808 conn(0x7feefc0c7a80 msgr2=0x7feefc0c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01f67640 1 -- 172.21.15.45:0/720660808 shutdown_connections 2023-12-08T08:19:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.168+0000 7fef01f67640 1 -- 172.21.15.45:0/720660808 wait complete. 2023-12-08T08:19:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.170+0000 7fef01f67640 1 Processor -- start 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.170+0000 7fef01f67640 1 -- start start 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feefc14eac0 0x7feefc06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc156f70 0x7feefc1ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc151ed0 con 0x7feeec003970 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc155830 con 0x7feefc14eac0 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01f67640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc1574a0 con 0x7feefc156f70 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46794/0 (socket says 172.21.15.45:46794) 2023-12-08T08:19:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 -- 172.21.15.45:0/710044802 learned_addr learned my addr 172.21.15.45:0/710044802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7feefbfff640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feefc14eac0 0x7feefc06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef01766640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc156f70 0x7feefc1ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 -- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc156f70 msgr2=0x7feefc1ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc156f70 0x7feefc1ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 -- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feefc14eac0 msgr2=0x7feefc06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feefc14eac0 0x7feefc06ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.171+0000 7fef00f65640 1 -- 172.21.15.45:0/710044802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc155aa0 con 0x7feeec003970 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7fef00f65640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7feef0037040 tx=0x7feef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0003810 con 0x7feeec003970 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0003970 con 0x7feeec003970 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc155d80 con 0x7feeec003970 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0003ce0 con 0x7feeec003970 2023-12-08T08:19:04.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.172+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc157780 con 0x7feeec003970 2023-12-08T08:19:04.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.174+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0743e0 con 0x7feeec003970 2023-12-08T08:19:04.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.175+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feef0034440 con 0x7feeec003970 2023-12-08T08:19:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.175+0000 7feef97fa640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 0x7feee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.176+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feef00ab880 con 0x7feeec003970 2023-12-08T08:19:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.176+0000 7feefbfff640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 0x7feee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.177+0000 7feefbfff640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 0x7feee006d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feee80018e0 tx=0x7feee8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.181+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feef0076800 con 0x7feeec003970 2023-12-08T08:19:04.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.445+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7feefc0726a0 con 0x7feeec003970 2023-12-08T08:19:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.449+0000 7feef97fa640 1 -- 172.21.15.45:0/710044802 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+147 (secure 0 0 0) 0x7feef004c0b0 con 0x7feeec003970 2023-12-08T08:19:04.452 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-08T08:19:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBK0HJlo0WvMBAAj0rCm8PVxyUV7gQBuQPzmg== 2023-12-08T08:19:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:19:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:19:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:19:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 msgr2=0x7feee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 0x7feee006d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feee80018e0 tx=0x7feee8009040 comp rx=0 tx=0).stop 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 msgr2=0x7feefc1562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7feef0037040 tx=0x7feef0004730 comp rx=0 tx=0).stop 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 shutdown_connections 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feee006ae40 0x7feee006d300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feefc156f70 0x7feefc1ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feefc14eac0 0x7feefc06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 --2- 172.21.15.45:0/710044802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeec003970 0x7feefc1562a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 >> 172.21.15.45:0/710044802 conn(0x7feefc0c7a80 msgr2=0x7feefc157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.452+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 shutdown_connections 2023-12-08T08:19:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.453+0000 7fef01f67640 1 -- 172.21.15.45:0/710044802 wait complete. 2023-12-08T08:19:04.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:04.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.705+0000 7f9296954640 1 Processor -- start 2023-12-08T08:19:04.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.705+0000 7f9296954640 1 -- start start 2023-12-08T08:19:04.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9296954640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92901521b0 0x7f929014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9296954640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9290155850 con 0x7f929014fb20 2023-12-08T08:19:04.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9296954640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92900c0890 con 0x7f92900a7910 2023-12-08T08:19:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9296954640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900c0b70 con 0x7f92901521b0 2023-12-08T08:19:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92901521b0 0x7f929014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92901521b0 0x7f929014f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46804/0 (socket says 172.21.15.45:46804) 2023-12-08T08:19:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 -- 172.21.15.45:0/3381910828 learned_addr learned my addr 172.21.15.45:0/3381910828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 -- 172.21.15.45:0/3381910828 >> v1:172.21.15.114:6789/0 conn(0x7f92900a7910 legacy=0x7f92900c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 -- 172.21.15.45:0/3381910828 >> v1:172.21.15.45:6789/0 conn(0x7f929014fb20 legacy=0x7f9290155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.707+0000 7f9295151640 1 -- 172.21.15.45:0/3381910828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900c0e50 con 0x7f92901521b0 2023-12-08T08:19:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.709+0000 7f9295151640 1 --2- 172.21.15.45:0/3381910828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014f5e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9280009870 tx=0x7f928002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17aaf3af521d9929 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.709+0000 7f9294950640 1 -- 172.21.15.45:0/3381910828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280031860 con 0x7f92901521b0 2023-12-08T08:19:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.709+0000 7f9294950640 1 -- 172.21.15.45:0/3381910828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800319c0 con 0x7f92901521b0 2023-12-08T08:19:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.709+0000 7f9294950640 1 -- 172.21.15.45:0/3381910828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280031d50 con 0x7f92901521b0 2023-12-08T08:19:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 -- 172.21.15.45:0/3381910828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 msgr2=0x7f929014f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 --2- 172.21.15.45:0/3381910828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014f5e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9280009870 tx=0x7f928002b900 comp rx=0 tx=0).stop 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 -- 172.21.15.45:0/3381910828 shutdown_connections 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 --2- 172.21.15.45:0/3381910828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014f5e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 -- 172.21.15.45:0/3381910828 >> 172.21.15.45:0/3381910828 conn(0x7f92900c5780 msgr2=0x7f92900c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 -- 172.21.15.45:0/3381910828 shutdown_connections 2023-12-08T08:19:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.710+0000 7f9296954640 1 -- 172.21.15.45:0/3381910828 wait complete. 2023-12-08T08:19:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.712+0000 7f9296954640 1 Processor -- start 2023-12-08T08:19:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.712+0000 7f9296954640 1 -- start start 2023-12-08T08:19:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 0x7f92901ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f929014fb20 0x7f9290072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290155680 con 0x7f92901521b0 2023-12-08T08:19:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92900712b0 con 0x7f929014fb20 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296954640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900c4e10 con 0x7f92900a7910 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296153640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296153640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46808/0 (socket says 172.21.15.45:46808) 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296153640 1 -- 172.21.15.45:0/1628968853 learned_addr learned my addr 172.21.15.45:0/1628968853 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9295151640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f929014fb20 0x7f9290072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9295952640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 0x7f92901ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296153640 1 -- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 msgr2=0x7f92901ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.714+0000 7f9296153640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 0x7f92901ed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296153640 1 -- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f929014fb20 msgr2=0x7f9290072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296153640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f929014fb20 0x7f9290072410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296153640 1 -- 172.21.15.45:0/1628968853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800094d0 con 0x7f92901521b0 2023-12-08T08:19:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9295952640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 0x7f92901ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296153640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f928800c7a0 tx=0x7f928800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288003b70 con 0x7f92901521b0 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288003cf0 con 0x7f92901521b0 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92901edd00 con 0x7f92901521b0 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288003ea0 con 0x7f92901521b0 2023-12-08T08:19:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.715+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92901edfa0 con 0x7f92901521b0 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.716+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900aaf70 con 0x7f92901521b0 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.717+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f928800aa90 con 0x7f92901521b0 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.718+0000 7f92867fc640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 0x7f927406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.719+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92880894b0 con 0x7f92901521b0 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.719+0000 7f9295952640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 0x7f927406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.720+0000 7f9295952640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 0x7f927406d350 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f928c003eb0 tx=0x7f928c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.723+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9288054500 con 0x7f92901521b0 2023-12-08T08:19:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.955+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92900c51e0 con 0x7f92901521b0 2023-12-08T08:19:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.956+0000 7f92867fc640 1 -- 172.21.15.45:0/1628968853 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f9288057b20 con 0x7f92901521b0 2023-12-08T08:19:04.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:04.959 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6744,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-08T08:19:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 msgr2=0x7f927406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 0x7f927406d350 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f928c003eb0 tx=0x7f928c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 msgr2=0x7f929014b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f928800c7a0 tx=0x7f928800cc60 comp rx=0 tx=0).stop 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 shutdown_connections 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f927406ae90 0x7f927406d350 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92901521b0 0x7f929014b0f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f929014fb20 0x7f9290072410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 --2- 172.21.15.45:0/1628968853 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f92900a7910 0x7f92901ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 >> 172.21.15.45:0/1628968853 conn(0x7f92900c5780 msgr2=0x7f9290150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 shutdown_connections 2023-12-08T08:19:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:04.959+0000 7f9296954640 1 -- 172.21.15.45:0/1628968853 wait complete. 2023-12-08T08:19:05.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:18:53.238866+0000', 'modified': '2023-12-08T08:18:56.300062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6747}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6747': {'gid': 6747, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6837/2233278871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 2233278871}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 2233278871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:19:05.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:19:05.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T08:19:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.618+0000 7f14bb59e640 1 Processor -- start 2023-12-08T08:19:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.618+0000 7f14bb59e640 1 -- start start 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14e680 0x7f14bc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bb59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14bc06d820 0x7f14bc06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc154b90 con 0x7f14bc14ea60 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bb59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc154e70 con 0x7f14bc06d820 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc155150 con 0x7f14bc14e680 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14bc06d820 0x7f14bc06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14bc06d820 0x7f14bc06c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56178/0 (socket says 172.21.15.45:56178) 2023-12-08T08:19:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 -- 172.21.15.45:0/4011569673 learned_addr learned my addr 172.21.15.45:0/4011569673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14ba59c640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14e680 0x7f14bc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 -- 172.21.15.45:0/4011569673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14e680 msgr2=0x7f14bc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14e680 0x7f14bc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 -- 172.21.15.45:0/4011569673 >> v1:172.21.15.45:6789/0 conn(0x7f14bc14ea60 legacy=0x7f14bc0c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.620+0000 7f14bad9d640 1 -- 172.21.15.45:0/4011569673 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc155430 con 0x7f14bc06d820 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.621+0000 7f14bad9d640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc06c830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009e50 tx=0x7f14b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222570670757d919 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.621+0000 7f14b9d9b640 1 -- 172.21.15.45:0/4011569673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b402ca80 con 0x7f14bc06d820 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.621+0000 7f14b9d9b640 1 -- 172.21.15.45:0/4011569673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b402cbe0 con 0x7f14bc06d820 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.621+0000 7f14b9d9b640 1 -- 172.21.15.45:0/4011569673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40343f0 con 0x7f14bc06d820 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 -- 172.21.15.45:0/4011569673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 msgr2=0x7f14bc06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc06c830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009e50 tx=0x7f14b402bee0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 -- 172.21.15.45:0/4011569673 shutdown_connections 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc06c830 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4011569673 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14e680 0x7f14bc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 -- 172.21.15.45:0/4011569673 >> 172.21.15.45:0/4011569673 conn(0x7f14bc0a7600 msgr2=0x7f14bc0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 -- 172.21.15.45:0/4011569673 shutdown_connections 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.622+0000 7f14bb59e640 1 -- 172.21.15.45:0/4011569673 wait complete. 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 Processor -- start 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 -- start start 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14bc14e680 0x7f14bc149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14ea60 0x7f14bc14a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc071720 con 0x7f14bc06d820 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc150df0 con 0x7f14bc14e680 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.625+0000 7f14bb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc071b20 con 0x7f14bc14ea60 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56190/0 (socket says 172.21.15.45:56190) 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 -- 172.21.15.45:0/4264369585 learned_addr learned my addr 172.21.15.45:0/4264369585 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 -- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14ea60 msgr2=0x7f14bc14a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14ea60 0x7f14bc14a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 -- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14bc14e680 msgr2=0x7f14bc149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14bc14e680 0x7f14bc149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 -- 172.21.15.45:0/4264369585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4009b30 con 0x7f14bc06d820 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.626+0000 7f14ba59c640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00e9b0 tx=0x7f14ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.627+0000 7f14b37fe640 1 -- 172.21.15.45:0/4264369585 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00c9a0 con 0x7f14bc06d820 2023-12-08T08:19:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.627+0000 7f14b37fe640 1 -- 172.21.15.45:0/4264369585 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00cb00 con 0x7f14bc06d820 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.627+0000 7f14b37fe640 1 -- 172.21.15.45:0/4264369585 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac013470 con 0x7f14bc06d820 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.627+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc071e00 con 0x7f14bc06d820 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.627+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0723c0 con 0x7f14bc06d820 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.631+0000 7f14b37fe640 1 -- 172.21.15.45:0/4264369585 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14ac0135d0 con 0x7f14bc06d820 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.631+0000 7f14b37fe640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.631+0000 7f14b37fe640 1 -- 172.21.15.45:0/4264369585 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f14ac089990 con 0x7f14bc06d820 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.631+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.631+0000 7f14c3c34740 1 Processor -- start 2023-12-08T08:19:05.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.632+0000 7f14c3c34740 1 -- start start 2023-12-08T08:19:05.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.632+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 0x7f149c06d300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000f60 tx=0x7f14a40079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.632+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.632+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d94e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d51d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14c3c34740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408cb5880 con 0x55f408d91b30 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408cc4ae0 con 0x55f408d58880 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f408cc21d0 con 0x55f408d95340 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56204/0 (socket says 172.21.15.45:56204) 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 -- 172.21.15.45:0/2222453737 learned_addr learned my addr 172.21.15.45:0/2222453737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d94e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 -- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 msgr2=0x55f408d51d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d51d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 -- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 msgr2=0x55f408d94e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d94e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.633+0000 7f14ba59c640 1 -- 172.21.15.45:0/2222453737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f408c85860 con 0x55f408d91b30 2023-12-08T08:19:05.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f14ba59c640 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f14ac060380 tx=0x7f14ac057f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef661fa675bd2e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f149bfff640 1 -- 172.21.15.45:0/2222453737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0585b0 con 0x55f408d91b30 2023-12-08T08:19:05.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f149bfff640 1 -- 172.21.15.45:0/2222453737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac089040 con 0x55f408d91b30 2023-12-08T08:19:05.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f149bfff640 1 -- 172.21.15.45:0/2222453737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac05c700 con 0x55f408d91b30 2023-12-08T08:19:05.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f14c3c34740 1 -- 172.21.15.45:0/2222453737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 msgr2=0x55f408d91f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.634+0000 7f14c3c34740 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f14ac060380 tx=0x7f14ac057f10 comp rx=0 tx=0).stop 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 -- 172.21.15.45:0/2222453737 shutdown_connections 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d51d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d94e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 --2- 172.21.15.45:0/2222453737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408d91f10 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 -- 172.21.15.45:0/2222453737 >> 172.21.15.45:0/2222453737 conn(0x55f408d18c70 msgr2=0x55f408d788d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 -- 172.21.15.45:0/2222453737 shutdown_connections 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 -- 172.21.15.45:0/2222453737 wait complete. 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.635+0000 7f14c3c34740 1 -- start start 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.636+0000 7f14c3c34740 1 Processor -- start 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d77f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408cbdac0 con 0x55f408d91b30 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408c5a2f0 con 0x55f408d58880 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f408c77c70 con 0x55f408d95340 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 10 client.0 _ll_register_callbacks cb 0x55f408c7c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56212/0 (socket says 172.21.15.45:56212) 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 -- 172.21.15.45:0/3169275068 learned_addr learned my addr 172.21.15.45:0/3169275068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14bad9d640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d77f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 -- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 msgr2=0x55f408d753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 -- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 msgr2=0x55f408d77f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d77f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 -- 172.21.15.45:0/3169275068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0723c0 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0c3d50 tx=0x7f14a4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736e010ca85771c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14997fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4005310 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f14a4005470 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f408cb6aa0 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14a40035f0 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 10 client.6921 fetch_fsmap learned FSMap version 49 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.638+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f408cbc140 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f408cb6aa0 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f14a4003750 con 0x55f408d91b30 2023-12-08T08:19:05.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 10 client.6921 fetch_fsmap finished waiting for FSMap version 49 2023-12-08T08:19:05.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 10 client.6921 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:19:05.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 20 client.6921 populate_metadata read hostname 'smithi045' 2023-12-08T08:19:05.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408da6b40 0x55f408da6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 4 client.6921 mds_command: new command op to 6747 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:19:05.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 --> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f408cb67c0 con 0x55f408da6b40 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.639+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408da6b40 0x55f408da6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.640+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408da6b40 0x55f408da6f20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e68f3b29f0b7c00 server_cookie=f1ef0421be386221 in_seq=0 out_seq=0 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.640+0000 7f14997fa640 10 client.6921 ms_handle_connect on v2:172.21.15.45:6835/2233278871 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14997fa640 1 -- 172.21.15.45:0/3169275068 <== mds.0 v2:172.21.15.45:6835/2233278871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x7f14ac076a90 con 0x55f408da6b40 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14997fa640 10 client.6921 handle_command_reply: tid=0 2023-12-08T08:19:05.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 client.6921 shutdown 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 msgr2=0x55f408da3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0c3d50 tx=0x7f14a4001080 comp rx=0 tx=0).stop 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 shutdown_connections 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408da6b40 0x55f408da6f20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d95340 0x55f408d753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d91b30 0x55f408da3770 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3169275068 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d58880 0x55f408d77f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14997fa640 0 client.6921 ms_handle_reset on v2:172.21.15.45:6835/2233278871 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 >> 172.21.15.45:0/3169275068 conn(0x55f408d18c70 msgr2=0x55f408d96c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 shutdown_connections 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.641+0000 7f14c3c34740 1 -- 172.21.15.45:0/3169275068 wait complete. 2023-12-08T08:19:05.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.642+0000 7f14c3c34740 20 client.6921 trim_cache size 0 max 16384 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 Processor -- start 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 -- start start 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408d50dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408d98e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408a20f20 con 0x55f408d95340 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408c71e30 con 0x55f408d91b30 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f408cc6250 con 0x55f408d58880 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56218/0 (socket says 172.21.15.45:56218) 2023-12-08T08:19:05.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 -- 172.21.15.45:0/1270426814 learned_addr learned my addr 172.21.15.45:0/1270426814 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408d98e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 -- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 msgr2=0x55f408d50dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14ba59c640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408d50dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408d50dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 -- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 msgr2=0x55f408d98e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408d98e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14bad9d640 1 -- 172.21.15.45:0/1270426814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f408c59b80 con 0x55f408d95340 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.660+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408d98e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.661+0000 7f14bad9d640 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f14b4036040 tx=0x7f14b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e265f28b9df15e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.661+0000 7f14b0d99640 1 -- 172.21.15.45:0/1270426814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b402ca80 con 0x55f408d95340 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.661+0000 7f14b0d99640 1 -- 172.21.15.45:0/1270426814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b403e430 con 0x55f408d95340 2023-12-08T08:19:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.661+0000 7f14b0d99640 1 -- 172.21.15.45:0/1270426814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b403e7e0 con 0x55f408d95340 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 -- 172.21.15.45:0/1270426814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 msgr2=0x55f408d99380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f14b4036040 tx=0x7f14b4004ab0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 -- 172.21.15.45:0/1270426814 shutdown_connections 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408d99380 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408d98e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 --2- 172.21.15.45:0/1270426814 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408d50dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 -- 172.21.15.45:0/1270426814 >> 172.21.15.45:0/1270426814 conn(0x55f408d18c70 msgr2=0x55f408d95720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 -- 172.21.15.45:0/1270426814 shutdown_connections 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.662+0000 7f14c3c34740 1 -- 172.21.15.45:0/1270426814 wait complete. 2023-12-08T08:19:05.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.663+0000 7f14c3c34740 1 -- start start 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.663+0000 7f14c3c34740 1 Processor -- start 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408db5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408dfcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408d76d90 con 0x55f408d95340 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f408d999a0 con 0x55f408d91b30 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f408d99bf0 con 0x55f408d58880 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14c3c34740 10 client.0 _ll_register_callbacks cb 0x7f14a4001210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56232/0 (socket says 172.21.15.45:56232) 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 -- 172.21.15.45:0/3449865717 learned_addr learned my addr 172.21.15.45:0/3449865717 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408db5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14b1d9b640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408dfcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 -- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 msgr2=0x55f408db5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408db5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 -- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 msgr2=0x55f408dfcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408dfcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.664+0000 7f14bad9d640 1 -- 172.21.15.45:0/3449865717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc155430 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14bad9d640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009f70 tx=0x7f14b402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e324d55d84a8d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14997fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b404e070 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f14b4054c10 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14ac089040 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14b4054df0 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14c3c34740 10 client.6927 fetch_fsmap learned FSMap version 49 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.665+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f408c7f170 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac089040 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f14b403c040 con 0x55f408d95340 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 10 client.6927 fetch_fsmap finished waiting for FSMap version 49 2023-12-08T08:19:05.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 10 client.6927 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:19:05.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 20 client.6927 populate_metadata read hostname 'smithi045' 2023-12-08T08:19:05.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408e03530 0x55f408dff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 4 client.6927 mds_command: new command op to 6747 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:19:05.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 --> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4089be6c0 con 0x55f408e03530 2023-12-08T08:19:05.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.666+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408e03530 0x55f408dff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14ba59c640 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408e03530 0x55f408dff5b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c314fca0215a3ed8 server_cookie=c3209fd3193a84a2 in_seq=0 out_seq=0 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14997fa640 10 client.6927 ms_handle_connect on v2:172.21.15.45:6835/2233278871 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14997fa640 1 -- 172.21.15.45:0/3449865717 <== mds.0 v2:172.21.15.45:6835/2233278871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f4089be6c0 con 0x55f408e03530 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14997fa640 10 client.6927 handle_command_reply: tid=0 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 client.6927 shutdown 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 msgr2=0x55f408e02b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009f70 tx=0x7f14b402e000 comp rx=0 tx=0).stop 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 shutdown_connections 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:6835/2233278871,v1:172.21.15.45:6837/2233278871] conn(0x55f408e03530 0x55f408dff5b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f408d95340 0x55f408e02b20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f408d91b30 0x55f408dfcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 --2- 172.21.15.45:0/3449865717 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x55f408d58880 0x55f408db5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 >> 172.21.15.45:0/3449865717 conn(0x55f408d18c70 msgr2=0x55f408d52f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14997fa640 0 client.6927 ms_handle_reset on v2:172.21.15.45:6835/2233278871 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.667+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 shutdown_connections 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14c3c34740 1 -- 172.21.15.45:0/3449865717 wait complete. 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14c3c34740 20 client.6927 trim_cache size 0 max 16384 2023-12-08T08:19:05.674 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2", 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6747, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 11.918988541999999, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 49, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 79, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 79, 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 18.210843780000001 2023-12-08T08:19:05.675 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:19:05.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 msgr2=0x7f149c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 0x7f149c06d300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000f60 tx=0x7f14a40079b0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 msgr2=0x7f14bc14d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00e9b0 tx=0x7f14ac00ee70 comp rx=0 tx=0).stop 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 shutdown_connections 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f14bc14ea60 0x7f14bc14a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14bc14e680 0x7f14bc149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 --2- 172.21.15.45:0/4264369585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14bc06d820 0x7f14bc14d450 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.668+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 >> 172.21.15.45:0/4264369585 conn(0x7f14bc0a7600 msgr2=0x7f14bc0c0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.669+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 shutdown_connections 2023-12-08T08:19:05.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.669+0000 7f14bb59e640 1 -- 172.21.15.45:0/4264369585 wait complete. 2023-12-08T08:19:05.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.904+0000 7f33a9227640 1 Processor -- start 2023-12-08T08:19:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.904+0000 7f33a9227640 1 -- start start 2023-12-08T08:19:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.905+0000 7f33a9227640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33a40c2d20 0x7f33a40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.905+0000 7f33a9227640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40a6d30 0x7f33a41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.905+0000 7f33a9227640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a40c78f0 con 0x7f33a40c3100 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.905+0000 7f33a9227640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a40c75f0 con 0x7f33a40c2d20 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.905+0000 7f33a9227640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a406e7e0 con 0x7f33a40a6d30 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33a40c2d20 0x7f33a40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33a40c2d20 0x7f33a40c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:59482/0 (socket says 172.21.15.45:59482) 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 -- 172.21.15.45:0/2282620604 learned_addr learned my addr 172.21.15.45:0/2282620604 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a8a26640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40a6d30 0x7f33a41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2282620604 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199634303 0 0) 0x7f33a40c78f0 con 0x7f33a40c3100 2023-12-08T08:19:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2282620604 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3390003520 con 0x7f33a40c3100 2023-12-08T08:19:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 -- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40a6d30 msgr2=0x7f33a41558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40a6d30 0x7f33a41558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 -- 172.21.15.45:0/2282620604 >> v1:172.21.15.45:6789/0 conn(0x7f33a40c3100 legacy=0x7f33a406e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.906+0000 7f33a3fff640 1 -- 172.21.15.45:0/2282620604 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40c6cc0 con 0x7f33a40c2d20 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a3fff640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a40c7d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f33940098a0 tx=0x7f339402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f99cc7856182cfe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2282620604 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394030840 con 0x7f33a40c2d20 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2282620604 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940309a0 con 0x7f33a40c2d20 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a2ffd640 1 -- 172.21.15.45:0/2282620604 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394030d30 con 0x7f33a40c2d20 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 -- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 msgr2=0x7f33a40c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a40c7d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f33940098a0 tx=0x7f339402b980 comp rx=0 tx=0).stop 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 -- 172.21.15.45:0/2282620604 shutdown_connections 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40a6d30 0x7f33a41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 --2- 172.21.15.45:0/2282620604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a40c7d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 -- 172.21.15.45:0/2282620604 >> 172.21.15.45:0/2282620604 conn(0x7f33a40668b0 msgr2=0x7f33a40a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 -- 172.21.15.45:0/2282620604 shutdown_connections 2023-12-08T08:19:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.909+0000 7f33a9227640 1 -- 172.21.15.45:0/2282620604 wait complete. 2023-12-08T08:19:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.911+0000 7f33a9227640 1 Processor -- start 2023-12-08T08:19:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.911+0000 7f33a9227640 1 -- start start 2023-12-08T08:19:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a41d6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c3100 0x7f33a41ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40ace00 con 0x7f33a40a6d30 2023-12-08T08:19:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41ee810 con 0x7f33a40c2d20 2023-12-08T08:19:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a9227640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40ac460 con 0x7f33a40c3100 2023-12-08T08:19:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56236/0 (socket says 172.21.15.45:56236) 2023-12-08T08:19:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 -- 172.21.15.45:0/1385565247 learned_addr learned my addr 172.21.15.45:0/1385565247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a41d6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 -- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c3100 msgr2=0x7f33a41ea740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c3100 0x7f33a41ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 -- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 msgr2=0x7f33a41d6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a41d6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 -- 172.21.15.45:0/1385565247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940094d0 con 0x7f33a40a6d30 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a41d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.913+0000 7f33a3fff640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f3394004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.914+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394039c90 con 0x7f33a40a6d30 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.914+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3394039e10 con 0x7f33a40a6d30 2023-12-08T08:19:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.914+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394043640 con 0x7f33a40a6d30 2023-12-08T08:19:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.914+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a40ac740 con 0x7f33a40a6d30 2023-12-08T08:19:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.914+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a41dc0f0 con 0x7f33a40a6d30 2023-12-08T08:19:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.915+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40c38f0 con 0x7f33a40a6d30 2023-12-08T08:19:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.916+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33940437a0 con 0x7f33a40a6d30 2023-12-08T08:19:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.918+0000 7f33a0ff9640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 0x7f338406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.918+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f339403e070 con 0x7f33a40a6d30 2023-12-08T08:19:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.918+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 0x7f338406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.918+0000 7f33a37fe640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 0x7f338406d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f338c007fd0 tx=0x7f338c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:05.922+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3394077630 con 0x7f33a40a6d30 2023-12-08T08:19:06.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.155+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33a40673e0 con 0x7f33a40a6d30 2023-12-08T08:19:06.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.156+0000 7f33a0ff9640 1 -- 172.21.15.45:0/1385565247 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f339407ac50 con 0x7f33a40a6d30 2023-12-08T08:19:06.159 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:06.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.158+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 msgr2=0x7f338406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.158+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 0x7f338406d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f338c007fd0 tx=0x7f338c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.158+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 msgr2=0x7f33a41dbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.158+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f3394004730 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 shutdown_connections 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f338406ae40 0x7f338406d300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f33a40c3100 0x7f33a41ea740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33a40c2d20 0x7f33a41d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 --2- 172.21.15.45:0/1385565247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33a40a6d30 0x7f33a41dbbb0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 >> 172.21.15.45:0/1385565247 conn(0x7f33a40668b0 msgr2=0x7f33a40c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 shutdown_connections 2023-12-08T08:19:06.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:06.159+0000 7f33a9227640 1 -- 172.21.15.45:0/1385565247 wait complete. 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:19:06.181 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:19:06.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:06.182 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:06.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.182 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:06.240 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41886sec preferred_lft 41886sec 2023-12-08T08:19:06.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:19:06.242 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:06.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.244 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:06.341 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:19:06.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.345 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:19:06.403 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:19:06.404 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:06.404 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:19:06.404 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:19:06.404 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:06.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.404 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:19:06.404 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:19:06.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:19:06.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:19:06.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:19:06.405 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:19:06.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.600 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:19:06.653 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:19:06.654 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:06.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.654 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:19:06.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:06.758 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:06.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:06.815 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:06.870 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-08T08:19:06.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:06.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:07.021 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:07.021 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:07.057 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:07.057 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:07.057 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:19:07.057 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:19:07.057 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:19:07.061 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-08T08:19:07.061 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:19:07.061 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:19:07.061 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:19:07.061 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:19:07.066 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:19:07.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.066 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:07.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.153 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout:client5279 2023-12-08T08:19:07.226 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:07.226 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:07.281 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.504+0000 7f299ca16640 1 Processor -- start 2023-12-08T08:19:07.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.504+0000 7f299ca16640 1 -- start start 2023-12-08T08:19:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.505+0000 7f299ca16640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2998151aa0 0x7f299806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.505+0000 7f299ca16640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29980a5e40 0x7f2998154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.505+0000 7f299ca16640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2998158a90 con 0x7f299806aab0 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.505+0000 7f299ca16640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998157e80 con 0x7f29980a5e40 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.505+0000 7f299ca16640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998158160 con 0x7f2998151aa0 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29980a5e40 0x7f2998154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29980a5e40 0x7f2998154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56252/0 (socket says 172.21.15.45:56252) 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 -- 172.21.15.45:0/4259089180 learned_addr learned my addr 172.21.15.45:0/4259089180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f2996d9d640 1 --2- 172.21.15.45:0/4259089180 >> v2:172.21.15.114:3300/0 conn(0x7f2998151aa0 0x7f299806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 -- 172.21.15.45:0/4259089180 >> v2:172.21.15.114:3300/0 conn(0x7f2998151aa0 msgr2=0x7f299806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 --2- 172.21.15.45:0/4259089180 >> v2:172.21.15.114:3300/0 conn(0x7f2998151aa0 0x7f299806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 -- 172.21.15.45:0/4259089180 >> v1:172.21.15.114:6789/0 conn(0x7f299806aab0 legacy=0x7f2998154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.506+0000 7f299659c640 1 -- 172.21.15.45:0/4259089180 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998158440 con 0x7f29980a5e40 2023-12-08T08:19:07.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.507+0000 7f299659c640 1 --2- 172.21.15.45:0/4259089180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980a5e40 0x7f2998154830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f29980bfdb0 tx=0x7f298c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af16b8233cded0c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.508+0000 7f2995d9b640 1 -- 172.21.15.45:0/4259089180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c031520 con 0x7f29980a5e40 2023-12-08T08:19:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.508+0000 7f2995d9b640 1 -- 172.21.15.45:0/4259089180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c031680 con 0x7f29980a5e40 2023-12-08T08:19:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.508+0000 7f2995d9b640 1 -- 172.21.15.45:0/4259089180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c031a10 con 0x7f29980a5e40 2023-12-08T08:19:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.508+0000 7f299ca16640 1 -- 172.21.15.45:0/4259089180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980a5e40 msgr2=0x7f2998154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.508+0000 7f299ca16640 1 --2- 172.21.15.45:0/4259089180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980a5e40 0x7f2998154830 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f29980bfdb0 tx=0x7f298c02b7c0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 -- 172.21.15.45:0/4259089180 shutdown_connections 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 --2- 172.21.15.45:0/4259089180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980a5e40 0x7f2998154830 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 --2- 172.21.15.45:0/4259089180 >> v2:172.21.15.114:3300/0 conn(0x7f2998151aa0 0x7f299806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 -- 172.21.15.45:0/4259089180 >> 172.21.15.45:0/4259089180 conn(0x7f29980a87f0 msgr2=0x7f29980a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 -- 172.21.15.45:0/4259089180 shutdown_connections 2023-12-08T08:19:07.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.509+0000 7f299ca16640 1 -- 172.21.15.45:0/4259089180 wait complete. 2023-12-08T08:19:07.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.510+0000 7f299ca16640 1 Processor -- start 2023-12-08T08:19:07.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.511+0000 7f299ca16640 1 -- start start 2023-12-08T08:19:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29980a5e40 0x7f29980a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2998151aa0 0x7f29980a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998071a60 con 0x7f299806aab0 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980a71c0 con 0x7f29980a5e40 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299ca16640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980a76f0 con 0x7f2998151aa0 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56262/0 (socket says 172.21.15.45:56262) 2023-12-08T08:19:07.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 -- 172.21.15.45:0/94523645 learned_addr learned my addr 172.21.15.45:0/94523645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f299659c640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29980a5e40 0x7f29980a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 -- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2998151aa0 msgr2=0x7f29980a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2998151aa0 0x7f29980a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 -- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29980a5e40 msgr2=0x7f29980a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29980a5e40 0x7f29980a7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.512+0000 7f2996d9d640 1 -- 172.21.15.45:0/94523645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0094d0 con 0x7f299806aab0 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f2996d9d640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f298800d800 tx=0x7f298800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800b6c0 con 0x7f299806aab0 2023-12-08T08:19:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800b820 con 0x7f299806aab0 2023-12-08T08:19:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800bbb0 con 0x7f299806aab0 2023-12-08T08:19:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299814ea80 con 0x7f299806aab0 2023-12-08T08:19:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.513+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299814ecd0 con 0x7f299806aab0 2023-12-08T08:19:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.514+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29980678c0 con 0x7f299806aab0 2023-12-08T08:19:07.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.515+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f298800bd10 con 0x7f299806aab0 2023-12-08T08:19:07.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.516+0000 7f297f7fe640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 0x7f298406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.516+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2988089d00 con 0x7f299806aab0 2023-12-08T08:19:07.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.517+0000 7f299659c640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 0x7f298406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.517+0000 7f299659c640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 0x7f298406d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f298c035000 tx=0x7f298c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.521+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2988054c60 con 0x7f299806aab0 2023-12-08T08:19:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.753+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29980c1c50 con 0x7f299806aab0 2023-12-08T08:19:07.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.754+0000 7f297f7fe640 1 -- 172.21.15.45:0/94523645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2988058280 con 0x7f299806aab0 2023-12-08T08:19:07.755 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 msgr2=0x7f298406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 0x7f298406d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f298c035000 tx=0x7f298c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 msgr2=0x7f2998149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f298800d800 tx=0x7f298800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 shutdown_connections 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f298406ae40 0x7f298406d300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2998151aa0 0x7f29980a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29980a5e40 0x7f29980a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 --2- 172.21.15.45:0/94523645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f299806aab0 0x7f2998149320 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.756+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 >> 172.21.15.45:0/94523645 conn(0x7f29980a87f0 msgr2=0x7f29980a8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.757+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 shutdown_connections 2023-12-08T08:19:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:07.757+0000 7f299ca16640 1 -- 172.21.15.45:0/94523645 wait complete. 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:07.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:07.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.780 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:07.840 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41867sec preferred_lft 41867sec 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:07.841 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:19:07.842 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:07.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.843 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:07.930 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:19:07.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.934 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:19:07.986 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:19:07.986 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:07.986 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:19:07.986 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:19:07.987 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:07.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:19:07.987 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:19:08.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:08.169 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:19:08.218 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:19:08.219 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:08.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:08.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:19:08.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:08.305 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:08.357 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:08.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:08.357 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:08.405 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-08T08:19:08.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:08.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:08.540 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:08.541 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:08.574 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:08.574 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:08.574 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:19:08.574 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:19:08.574 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:19:08.576 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:19:08.576 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:19:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:19:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:19:08.577 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:19:08.580 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:19:08.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:08.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:08.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:08.663 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:19:08.719 INFO:teuthology.orchestra.run.smithi114.stdout:client5282 2023-12-08T08:19:08.720 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:08.720 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:08.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-08T08:19:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.004+0000 7fbfe7fff640 1 Processor -- start 2023-12-08T08:19:09.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.004+0000 7fbfe7fff640 1 -- start start 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.005+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814e680 0x7fbfe81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe806d820 0x7fbfe806c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe7fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8154b90 con 0x7fbfe814ea60 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe7fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe8154e70 con 0x7fbfe806d820 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8155150 con 0x7fbfe814e680 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe806d820 0x7fbfe806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfe806d820 0x7fbfe806c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56270/0 (socket says 172.21.15.45:56270) 2023-12-08T08:19:09.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.006+0000 7fbfe77fe640 1 -- 172.21.15.45:0/2191951613 learned_addr learned my addr 172.21.15.45:0/2191951613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:09.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.007+0000 7fbfe77fe640 1 -- 172.21.15.45:0/2191951613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814e680 msgr2=0x7fbfe81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.007+0000 7fbfe6ffd640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814e680 0x7fbfe81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.007+0000 7fbfe77fe640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814e680 0x7fbfe81545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.007+0000 7fbfe77fe640 1 -- 172.21.15.45:0/2191951613 >> v1:172.21.15.114:6789/0 conn(0x7fbfe814ea60 legacy=0x7fbfe80c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.007+0000 7fbfe77fe640 1 -- 172.21.15.45:0/2191951613 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8155430 con 0x7fbfe806d820 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.008+0000 7fbfe77fe640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe806c830 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009e50 tx=0x7fbfe002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51370456a151d95 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.008+0000 7fbfe5ffb640 1 -- 172.21.15.45:0/2191951613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe002ca70 con 0x7fbfe806d820 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.008+0000 7fbfe5ffb640 1 -- 172.21.15.45:0/2191951613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe002cbd0 con 0x7fbfe806d820 2023-12-08T08:19:09.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.008+0000 7fbfe5ffb640 1 -- 172.21.15.45:0/2191951613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00343f0 con 0x7fbfe806d820 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 -- 172.21.15.45:0/2191951613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 msgr2=0x7fbfe806c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe806c830 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009e50 tx=0x7fbfe002bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 -- 172.21.15.45:0/2191951613 shutdown_connections 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe806c830 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/2191951613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814e680 0x7fbfe81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 -- 172.21.15.45:0/2191951613 >> 172.21.15.45:0/2191951613 conn(0x7fbfe80a7600 msgr2=0x7fbfe80a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 -- 172.21.15.45:0/2191951613 shutdown_connections 2023-12-08T08:19:09.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.009+0000 7fbfe7fff640 1 -- 172.21.15.45:0/2191951613 wait complete. 2023-12-08T08:19:09.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.011+0000 7fbfe7fff640 1 Processor -- start 2023-12-08T08:19:09.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.011+0000 7fbfe7fff640 1 -- start start 2023-12-08T08:19:09.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 0x7fbfe80bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 0x7fbfe8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81e8690 con 0x7fbfe806d820 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81da380 con 0x7fbfe814e680 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.012+0000 7fbfe7fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81dac20 con 0x7fbfe814ea60 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56284/0 (socket says 172.21.15.45:56284) 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 -- 172.21.15.45:0/998857444 learned_addr learned my addr 172.21.15.45:0/998857444 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe67fc640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 0x7fbfe80bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 -- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 msgr2=0x7fbfe8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe77fe640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 0x7fbfe8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 0x7fbfe8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 -- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 msgr2=0x7fbfe80bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 0x7fbfe80bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 -- 172.21.15.45:0/998857444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009b30 con 0x7fbfe806d820 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe77fe640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 0x7fbfe8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe67fc640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 0x7fbfe80bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.013+0000 7fbfe6ffd640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c820 tx=0x7fbfd800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.014+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8004220 con 0x7fbfe806d820 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.014+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd80043a0 con 0x7fbfe806d820 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.014+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8007a70 con 0x7fbfe806d820 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.014+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe814e1a0 con 0x7fbfe806d820 2023-12-08T08:19:09.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.014+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe81da8b0 con 0x7fbfe806d820 2023-12-08T08:19:09.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.015+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe80743e0 con 0x7fbfe806d820 2023-12-08T08:19:09.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.016+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfd8007bd0 con 0x7fbfe806d820 2023-12-08T08:19:09.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.017+0000 7fbfcf7fe640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 0x7fbfd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.017+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbfd8089520 con 0x7fbfe806d820 2023-12-08T08:19:09.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.017+0000 7fbfe67fc640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 0x7fbfd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.018+0000 7fbfe67fc640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 0x7fbfd406d300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8154760 tx=0x7fbfdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.022+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfd8054480 con 0x7fbfe806d820 2023-12-08T08:19:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.286+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fbfe80c5e80 con 0x7fbfe806d820 2023-12-08T08:19:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.287+0000 7fbfcf7fe640 1 -- 172.21.15.45:0/998857444 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v23) v1 ==== 84+0+0 (secure 0 0 0) 0x7fbfd8057aa0 con 0x7fbfe806d820 2023-12-08T08:19:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 msgr2=0x7fbfd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 0x7fbfd406d300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8154760 tx=0x7fbfdc009040 comp rx=0 tx=0).stop 2023-12-08T08:19:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 msgr2=0x7fbfe81e8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfd800c820 tx=0x7fbfd800cce0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 shutdown_connections 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbfd406ae40 0x7fbfd406d300 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbfe814ea60 0x7fbfe8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe814e680 0x7fbfe80bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 --2- 172.21.15.45:0/998857444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfe806d820 0x7fbfe81e8150 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 >> 172.21.15.45:0/998857444 conn(0x7fbfe80a7600 msgr2=0x7fbfe80a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 shutdown_connections 2023-12-08T08:19:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.290+0000 7fbfe7fff640 1 -- 172.21.15.45:0/998857444 wait complete. 2023-12-08T08:19:09.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.528+0000 7f377d57a640 1 Processor -- start 2023-12-08T08:19:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.528+0000 7f377d57a640 1 -- start start 2023-12-08T08:19:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f377d57a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37780aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f377d57a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778154850 con 0x7f377814e840 2023-12-08T08:19:09.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f377d57a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778154b30 con 0x7f37780c1210 2023-12-08T08:19:09.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f377d57a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377814ec20 con 0x7f37780c16a0 2023-12-08T08:19:09.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f3777fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f377814e840 0x7f3778151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44688/0 (socket says 172.21.15.45:44688) 2023-12-08T08:19:09.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f3777fff640 1 -- 172.21.15.45:0/250654142 learned_addr learned my addr 172.21.15.45:0/250654142 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f377cd79640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37780aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.530+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679423455 0 0) 0x7f3778154850 con 0x7f377814e840 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3760003520 con 0x7f377814e840 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875095990 0 0) 0x7f3760003520 con 0x7f377814e840 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 msgr2=0x7f37780aa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37780aa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 >> v1:172.21.15.114:6789/0 conn(0x7f37780c1210 legacy=0x7f37780a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778154e10 con 0x7f377814e840 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f3768001670 con 0x7f377814e840 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 >> v1:172.21.15.45:6789/0 conn(0x7f377814e840 legacy=0x7f3778151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f3760003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377814ec20 con 0x7f37600039a0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376000bab0 con 0x7f3760004d00 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376000bc70 con 0x7f37780c16a0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.531+0000 7f3777fff640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f3760003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f37777fe640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f377cd79640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f3777fff640 1 -- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 msgr2=0x7f37600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f3777fff640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37780c16a0 0x7f37600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f3777fff640 1 -- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3760004d00 msgr2=0x7f3760005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f3777fff640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f3777fff640 1 -- 172.21.15.45:0/250654142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760003520 con 0x7f37600039a0 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.532+0000 7f377cd79640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3760004d00 0x7f3760005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.533+0000 7f3777fff640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f3760003dc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f376800c240 tx=0x7f37600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb9aa96cdfa5caf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.533+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768005ad0 con 0x7f37600039a0 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.533+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768005c50 con 0x7f37600039a0 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.533+0000 7f3776ffd640 1 -- 172.21.15.45:0/250654142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376802c810 con 0x7f37600039a0 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 -- 172.21.15.45:0/250654142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 msgr2=0x7f3760003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 --2- 172.21.15.45:0/250654142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f3760003dc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f376800c240 tx=0x7f37600057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377cd79640 1 -- 172.21.15.45:0/250654142 reap_dead start 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 -- 172.21.15.45:0/250654142 shutdown_connections 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 -- 172.21.15.45:0/250654142 >> 172.21.15.45:0/250654142 conn(0x7f37780c5780 msgr2=0x7f37780c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 -- 172.21.15.45:0/250654142 shutdown_connections 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.534+0000 7f377d57a640 1 -- 172.21.15.45:0/250654142 wait complete. 2023-12-08T08:19:09.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.536+0000 7f377d57a640 1 Processor -- start 2023-12-08T08:19:09.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.536+0000 7f377d57a640 1 -- start start 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37781466f0 0x7f37780c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37780c40a0 0x7f37781eccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780bfd30 con 0x7f37600039a0 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37780bf770 con 0x7f37780c40a0 2023-12-08T08:19:09.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f377d57a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37780bfa50 con 0x7f37781466f0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f3777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f3777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56294/0 (socket says 172.21.15.45:56294) 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f3777fff640 1 -- 172.21.15.45:0/2395349204 learned_addr learned my addr 172.21.15.45:0/2395349204 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.537+0000 7f37777fe640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37781466f0 0x7f37780c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f377cd79640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37780c40a0 0x7f37781eccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 -- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37781466f0 msgr2=0x7f37780c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37781466f0 0x7f37780c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 -- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37780c40a0 msgr2=0x7f37781eccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37780c40a0 0x7f37781eccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 -- 172.21.15.45:0/2395349204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37781421b0 con 0x7f37600039a0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3777fff640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f376800c240 tx=0x7f3768001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768039070 con 0x7f37600039a0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376802cc20 con 0x7f37600039a0 2023-12-08T08:19:09.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376803c040 con 0x7f37600039a0 2023-12-08T08:19:09.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3778142490 con 0x7f37600039a0 2023-12-08T08:19:09.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.538+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377814fe70 con 0x7f37600039a0 2023-12-08T08:19:09.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.539+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778142620 con 0x7f37600039a0 2023-12-08T08:19:09.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.540+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3768032070 con 0x7f37600039a0 2023-12-08T08:19:09.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.541+0000 7f3774ff9640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.541+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f37680aaaf0 con 0x7f37600039a0 2023-12-08T08:19:09.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.542+0000 7f37777fe640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.542+0000 7f37777fe640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 0x7f376406d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f37780c2e10 tx=0x7f376c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.546+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3768075930 con 0x7f37600039a0 2023-12-08T08:19:09.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.732+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3778141fe0 con 0x7f37600039a0 2023-12-08T08:19:09.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.736+0000 7f3774ff9640 1 -- 172.21.15.45:0/2395349204 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f3768078f50 con 0x7f37600039a0 2023-12-08T08:19:09.738 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:09.738 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":79,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:18:54.765032+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 msgr2=0x7f376406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 0x7f376406d330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f37780c2e10 tx=0x7f376c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 msgr2=0x7f37780beda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f376800c240 tx=0x7f3768001a00 comp rx=0 tx=0).stop 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 shutdown_connections 2023-12-08T08:19:09.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f376406ae70 0x7f376406d330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37781466f0 0x7f37780c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37780c40a0 0x7f37781eccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 --2- 172.21.15.45:0/2395349204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37600039a0 0x7f37780beda0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 >> 172.21.15.45:0/2395349204 conn(0x7f37780c5780 msgr2=0x7f37780c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 shutdown_connections 2023-12-08T08:19:09.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.738+0000 7f377d57a640 1 -- 172.21.15.45:0/2395349204 wait complete. 2023-12-08T08:19:09.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:09.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.977+0000 7f19e1f75640 1 Processor -- start 2023-12-08T08:19:09.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.977+0000 7f19e1f75640 1 -- start start 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e1f75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19dc0c58c0 0x7f19dc0c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e1f75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 0x7f19dc0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e1f75640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0a74a0 con 0x7f19dc151970 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e1f75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0c5e60 con 0x7f19dc0c58c0 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e1f75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc151d50 con 0x7f19dc0a6d30 2023-12-08T08:19:09.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.979+0000 7f19e0f73640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f19dc151970 0x7f19dc071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:39290/0 (socket says 172.21.15.45:39290) 2023-12-08T08:19:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.980+0000 7f19e0f73640 1 -- 172.21.15.45:0/1840360779 learned_addr learned my addr 172.21.15.45:0/1840360779 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.980+0000 7f19e1774640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 0x7f19dc0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.980+0000 7f19d3fff640 1 --2- 172.21.15.45:0/1840360779 >> v2:172.21.15.114:3300/0 conn(0x7f19dc0c58c0 0x7f19dc0c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.980+0000 7f19d37fe640 1 -- 172.21.15.45:0/1840360779 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058602831 0 0) 0x7f19dc0a74a0 con 0x7f19dc151970 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.980+0000 7f19d37fe640 1 -- 172.21.15.45:0/1840360779 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c4003520 con 0x7f19dc151970 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.981+0000 7f19d3fff640 1 -- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 msgr2=0x7f19dc0c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.981+0000 7f19d3fff640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 0x7f19dc0c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.981+0000 7f19d3fff640 1 -- 172.21.15.45:0/1840360779 >> v1:172.21.15.114:6789/0 conn(0x7f19dc151970 legacy=0x7f19dc071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.981+0000 7f19d3fff640 1 -- 172.21.15.45:0/1840360779 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc1544a0 con 0x7f19dc0c58c0 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.981+0000 7f19e1774640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 0x7f19dc0c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:09.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.982+0000 7f19d3fff640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc0c0df0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0097a0 tx=0x7f19cc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e8289e43e4c3ae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.982+0000 7f19d37fe640 1 -- 172.21.15.45:0/1840360779 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc031780 con 0x7f19dc0c58c0 2023-12-08T08:19:09.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.982+0000 7f19d37fe640 1 -- 172.21.15.45:0/1840360779 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0318e0 con 0x7f19dc0c58c0 2023-12-08T08:19:09.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.982+0000 7f19d37fe640 1 -- 172.21.15.45:0/1840360779 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc031c70 con 0x7f19dc0c58c0 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 -- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 msgr2=0x7f19dc0c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc0c0df0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0097a0 tx=0x7f19cc02b820 comp rx=0 tx=0).stop 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 -- 172.21.15.45:0/1840360779 shutdown_connections 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc0a6d30 0x7f19dc0c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 --2- 172.21.15.45:0/1840360779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc0c0df0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.983+0000 7f19e1f75640 1 -- 172.21.15.45:0/1840360779 >> 172.21.15.45:0/1840360779 conn(0x7f19dc0c44c0 msgr2=0x7f19dc0c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.984+0000 7f19e1f75640 1 -- 172.21.15.45:0/1840360779 shutdown_connections 2023-12-08T08:19:09.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.984+0000 7f19e1f75640 1 -- 172.21.15.45:0/1840360779 wait complete. 2023-12-08T08:19:09.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.986+0000 7f19e1f75640 1 Processor -- start 2023-12-08T08:19:09.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.986+0000 7f19e1f75640 1 -- start start 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc1e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc151970 0x7f19dc1ea370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc149d50 con 0x7f19dc0a6d30 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0ab230 con 0x7f19dc0c58c0 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1f75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc14a5b0 con 0x7f19dc151970 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e0f73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e0f73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56308/0 (socket says 172.21.15.45:56308) 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e0f73640 1 -- 172.21.15.45:0/3740627299 learned_addr learned my addr 172.21.15.45:0/3740627299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19d3fff640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc1e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.988+0000 7f19e1774640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc151970 0x7f19dc1ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 -- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc151970 msgr2=0x7f19dc1ea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc151970 0x7f19dc1ea370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 -- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 msgr2=0x7f19dc1e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc1e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 -- 172.21.15.45:0/3740627299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4009a70 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e0f73640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c530 tx=0x7f19d800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8005ce0 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8005e40 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8007290 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.989+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc009400 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.990+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc149f60 con 0x7f19dc0a6d30 2023-12-08T08:19:09.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.991+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc1e9c10 con 0x7f19dc0a6d30 2023-12-08T08:19:09.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.992+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19d80073f0 con 0x7f19dc0a6d30 2023-12-08T08:19:09.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.993+0000 7f19d17fa640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.993+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19d8088be0 con 0x7f19dc0a6d30 2023-12-08T08:19:09.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.994+0000 7f19d3fff640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.995+0000 7f19d3fff640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 0x7f19c806d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036000 tx=0x7f19cc03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:09.998+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19d8053cb0 con 0x7f19dc0a6d30 2023-12-08T08:19:10.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.188+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19dc0743e0 con 0x7f19dc0a6d30 2023-12-08T08:19:10.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.189+0000 7f19d17fa640 1 -- 172.21.15.45:0/3740627299 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19d8017020 con 0x7f19dc0a6d30 2023-12-08T08:19:10.191 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 msgr2=0x7f19c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 0x7f19c806d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19cc036000 tx=0x7f19cc03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 msgr2=0x7f19dc0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c530 tx=0x7f19d800c930 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 shutdown_connections 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f19c806ae40 0x7f19c806d300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f19dc151970 0x7f19dc1ea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19dc0c58c0 0x7f19dc1e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 --2- 172.21.15.45:0/3740627299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0a6d30 0x7f19dc0c76a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 >> 172.21.15.45:0/3740627299 conn(0x7f19dc0c44c0 msgr2=0x7f19dc150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 shutdown_connections 2023-12-08T08:19:10.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.192+0000 7f19e1f75640 1 -- 172.21.15.45:0/3740627299 wait complete. 2023-12-08T08:19:10.211 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:10.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.431+0000 7f569de59640 1 Processor -- start 2023-12-08T08:19:10.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.431+0000 7f569de59640 1 -- start start 2023-12-08T08:19:10.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569de59640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 0x7f569806a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569de59640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f56980c0e10 0x7f569815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569de59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5698158360 con 0x7f56980c2600 2023-12-08T08:19:10.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569de59640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5698073c30 con 0x7f56980c0e10 2023-12-08T08:19:10.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569de59640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569814e8d0 con 0x7f569806a4c0 2023-12-08T08:19:10.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f568ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f56980c2600 0x7f5698154360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44702/0 (socket says 172.21.15.45:44702) 2023-12-08T08:19:10.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f568ffff640 1 -- 172.21.15.45:0/1990018640 learned_addr learned my addr 172.21.15.45:0/1990018640 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:10.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.433+0000 7f569ce57640 1 --2- 172.21.15.45:0/1990018640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 0x7f569806a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f569d658640 1 --2- 172.21.15.45:0/1990018640 >> v2:172.21.15.114:3300/0 conn(0x7f56980c0e10 0x7f569815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483034969 0 0) 0x7f5698158360 con 0x7f56980c2600 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5680003520 con 0x7f56980c2600 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f569ce57640 1 -- 172.21.15.45:0/1990018640 >> v2:172.21.15.114:3300/0 conn(0x7f56980c0e10 msgr2=0x7f569815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f569ce57640 1 --2- 172.21.15.45:0/1990018640 >> v2:172.21.15.114:3300/0 conn(0x7f56980c0e10 0x7f569815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161515489 0 0) 0x7f5680003520 con 0x7f56980c2600 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f569ce57640 1 -- 172.21.15.45:0/1990018640 >> v1:172.21.15.45:6789/0 conn(0x7f56980c2600 legacy=0x7f5698154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.434+0000 7f569ce57640 1 -- 172.21.15.45:0/1990018640 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698072300 con 0x7f569806a4c0 2023-12-08T08:19:10.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.436+0000 7f569ce57640 1 --2- 172.21.15.45:0/1990018640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 0x7f569806a8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569402bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81addbe373c9092d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.436+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880017f0 con 0x7f569806a4c0 2023-12-08T08:19:10.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.436+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569402c780 con 0x7f569806a4c0 2023-12-08T08:19:10.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.436+0000 7f568f7fe640 1 -- 172.21.15.45:0/1990018640 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569402cb10 con 0x7f569806a4c0 2023-12-08T08:19:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 -- 172.21.15.45:0/1990018640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 msgr2=0x7f569806a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 --2- 172.21.15.45:0/1990018640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 0x7f569806a8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5694009d90 tx=0x7f569402bc50 comp rx=0 tx=0).stop 2023-12-08T08:19:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 -- 172.21.15.45:0/1990018640 shutdown_connections 2023-12-08T08:19:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 --2- 172.21.15.45:0/1990018640 >> v2:172.21.15.114:3300/0 conn(0x7f56980c0e10 0x7f569815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 --2- 172.21.15.45:0/1990018640 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f569806a4c0 0x7f569806a8a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 -- 172.21.15.45:0/1990018640 >> 172.21.15.45:0/1990018640 conn(0x7f56980c60a0 msgr2=0x7f56980c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 -- 172.21.15.45:0/1990018640 shutdown_connections 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.437+0000 7f569de59640 1 -- 172.21.15.45:0/1990018640 wait complete. 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.439+0000 7f569de59640 1 Processor -- start 2023-12-08T08:19:10.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.439+0000 7f569de59640 1 -- start start 2023-12-08T08:19:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806a4c0 0x7f569814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c2600 0x7f5698155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698149a80 con 0x7f56980c0e10 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698157490 con 0x7f569806a4c0 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569de59640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56981ea710 con 0x7f56980c2600 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f568ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f568ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56320/0 (socket says 172.21.15.45:56320) 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f568ffff640 1 -- 172.21.15.45:0/515425176 learned_addr learned my addr 172.21.15.45:0/515425176 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569d658640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c2600 0x7f5698155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f569ce57640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806a4c0 0x7f569814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f568ffff640 1 -- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c2600 msgr2=0x7f5698155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.440+0000 7f568ffff640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c2600 0x7f5698155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568ffff640 1 -- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806a4c0 msgr2=0x7f569814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568ffff640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806a4c0 0x7f569814ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568ffff640 1 -- 172.21.15.45:0/515425176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009a70 con 0x7f56980c0e10 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568ffff640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f568800c750 tx=0x7f568800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688007270 con 0x7f56980c0e10 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880073d0 con 0x7f56980c0e10 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880057a0 con 0x7f56980c0e10 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5698157730 con 0x7f56980c0e10 2023-12-08T08:19:10.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.441+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980aaf70 con 0x7f56980c0e10 2023-12-08T08:19:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.442+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980ab630 con 0x7f56980c0e10 2023-12-08T08:19:10.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.444+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5688005900 con 0x7f56980c0e10 2023-12-08T08:19:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.445+0000 7f568d7fa640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 0x7f568406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.445+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5688089580 con 0x7f56980c0e10 2023-12-08T08:19:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.445+0000 7f569ce57640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 0x7f568406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.446+0000 7f569ce57640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 0x7f568406d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5694036000 tx=0x7f5694030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.450+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5688054450 con 0x7f56980c0e10 2023-12-08T08:19:10.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.642+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56981578c0 con 0x7f56980c0e10 2023-12-08T08:19:10.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.643+0000 7f568d7fa640 1 -- 172.21.15.45:0/515425176 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5688057a70 con 0x7f56980c0e10 2023-12-08T08:19:10.645 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 msgr2=0x7f568406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 0x7f568406d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5694036000 tx=0x7f5694030000 comp rx=0 tx=0).stop 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 msgr2=0x7f56980aaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f568800c750 tx=0x7f568800cc10 comp rx=0 tx=0).stop 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 shutdown_connections 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f568406ae40 0x7f568406d300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f56980c2600 0x7f5698155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56980c0e10 0x7f56980aaa30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 --2- 172.21.15.45:0/515425176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f569806a4c0 0x7f569814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 >> 172.21.15.45:0/515425176 conn(0x7f56980c60a0 msgr2=0x7f56980c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 shutdown_connections 2023-12-08T08:19:10.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.646+0000 7f569de59640 1 -- 172.21.15.45:0/515425176 wait complete. 2023-12-08T08:19:10.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.894+0000 7f37db59e640 1 Processor -- start 2023-12-08T08:19:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.894+0000 7f37db59e640 1 -- start start 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.895+0000 7f37db59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37dc14c280 0x7f37dc0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.895+0000 7f37db59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37dc06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.895+0000 7f37db59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0c60c0 con 0x7f37dc06d3e0 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.895+0000 7f37db59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc152dc0 con 0x7f37dc14c280 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.895+0000 7f37db59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1521d0 con 0x7f37dc0c4970 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37dad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37dc06d3e0 0x7f37dc155790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44704/0 (socket says 172.21.15.45:44704) 2023-12-08T08:19:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37dad9d640 1 -- 172.21.15.45:0/3421003229 learned_addr learned my addr 172.21.15.45:0/3421003229 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37d9d9b640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37dc06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37da59c640 1 --2- 172.21.15.45:0/3421003229 >> v2:172.21.15.114:3300/0 conn(0x7f37dc14c280 0x7f37dc0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652232776 0 0) 0x7f37d4001490 con 0x7f37dc06d3e0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c4003520 con 0x7f37dc06d3e0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.896+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405030352 0 0) 0x7f37c4003520 con 0x7f37dc06d3e0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 msgr2=0x7f37dc06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37dc06cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 >> v2:172.21.15.114:3300/0 conn(0x7f37dc14c280 msgr2=0x7f37dc0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 --2- 172.21.15.45:0/3421003229 >> v2:172.21.15.114:3300/0 conn(0x7f37dc14c280 0x7f37dc0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc14c660 con 0x7f37dc06d3e0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f37d4001b80 con 0x7f37dc06d3e0 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 >> v1:172.21.15.45:6789/0 conn(0x7f37dc06d3e0 legacy=0x7f37dc155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37c4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37c4003f40 0x7f37c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc152dc0 con 0x7f37c4004d00 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1521d0 con 0x7f37c4003f40 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c400ba30 con 0x7f37dc0c4970 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37d9d9b640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37c4003f40 0x7f37c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37da59c640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37c4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 -- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 msgr2=0x7f37c4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37c4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 -- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37c4003f40 msgr2=0x7f37c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37c4003f40 0x7f37c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.897+0000 7f37dad9d640 1 -- 172.21.15.45:0/3421003229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4003520 con 0x7f37c4004d00 2023-12-08T08:19:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.898+0000 7f37da59c640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc0c4970 0x7f37c4003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37dad9d640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37c4005180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f37d400a780 tx=0x7f37c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586e68170f2f3cf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4034630 con 0x7f37c4004d00 2023-12-08T08:19:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d402f070 con 0x7f37c4004d00 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37d959a640 1 -- 172.21.15.45:0/3421003229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4034a30 con 0x7f37c4004d00 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37db59e640 1 -- 172.21.15.45:0/3421003229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 msgr2=0x7f37c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37db59e640 1 --2- 172.21.15.45:0/3421003229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37c4005180 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f37d400a780 tx=0x7f37c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37dad9d640 1 -- 172.21.15.45:0/3421003229 reap_dead start 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37db59e640 1 -- 172.21.15.45:0/3421003229 shutdown_connections 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.899+0000 7f37db59e640 1 -- 172.21.15.45:0/3421003229 >> 172.21.15.45:0/3421003229 conn(0x7f37dc066ce0 msgr2=0x7f37dc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.900+0000 7f37db59e640 1 -- 172.21.15.45:0/3421003229 shutdown_connections 2023-12-08T08:19:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.900+0000 7f37db59e640 1 -- 172.21.15.45:0/3421003229 wait complete. 2023-12-08T08:19:10.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.901+0000 7f37db59e640 1 Processor -- start 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.901+0000 7f37db59e640 1 -- start start 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc154c20 0x7f37dc1ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc156340 0x7f37dc1edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1ed4f0 con 0x7f37c4004d00 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc153fb0 con 0x7f37dc156340 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.902+0000 7f37db59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc153710 con 0x7f37dc154c20 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56346/0 (socket says 172.21.15.45:56346) 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 -- 172.21.15.45:0/72910212 learned_addr learned my addr 172.21.15.45:0/72910212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37d9d9b640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc154c20 0x7f37dc1ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 -- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc154c20 msgr2=0x7f37dc1ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc154c20 0x7f37dc1ed980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 -- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc156340 msgr2=0x7f37dc1edec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc156340 0x7f37dc1edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 -- 172.21.15.45:0/72910212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc1539f0 con 0x7f37c4004d00 2023-12-08T08:19:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.903+0000 7f37da59c640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0109d0 tx=0x7f37cc010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.904+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00eba0 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.904+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00ed00 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.904+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc01c620 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.904+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc153cd0 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.904+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0727d0 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.905+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0678c0 con 0x7f37c4004d00 2023-12-08T08:19:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.906+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37cc01c780 con 0x7f37c4004d00 2023-12-08T08:19:10.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.907+0000 7f37caffd640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 0x7f37bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.907+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f37cc089d00 con 0x7f37c4004d00 2023-12-08T08:19:10.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.907+0000 7f37d9d9b640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 0x7f37bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.908+0000 7f37d9d9b640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 0x7f37bc06d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f37dc155020 tx=0x7f37d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:10.912+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37cc054d20 con 0x7f37c4004d00 2023-12-08T08:19:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.100+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37dc0743e0 con 0x7f37c4004d00 2023-12-08T08:19:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.101+0000 7f37caffd640 1 -- 172.21.15.45:0/72910212 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37cc058340 con 0x7f37c4004d00 2023-12-08T08:19:11.103 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:11.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 msgr2=0x7f37bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 0x7f37bc06d330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f37dc155020 tx=0x7f37d0008040 comp rx=0 tx=0).stop 2023-12-08T08:19:11.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 msgr2=0x7f37dc0a6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0109d0 tx=0x7f37cc010e90 comp rx=0 tx=0).stop 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 shutdown_connections 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f37bc06ae70 0x7f37bc06d330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f37dc154c20 0x7f37dc1ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37dc156340 0x7f37dc1edec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 --2- 172.21.15.45:0/72910212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37c4004d00 0x7f37dc0a6890 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.103+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 >> 172.21.15.45:0/72910212 conn(0x7f37dc066ce0 msgr2=0x7f37dc0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.104+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 shutdown_connections 2023-12-08T08:19:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.104+0000 7f37db59e640 1 -- 172.21.15.45:0/72910212 wait complete. 2023-12-08T08:19:11.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:19:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.345+0000 7f509a99a640 1 Processor -- start 2023-12-08T08:19:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.345+0000 7f509a99a640 1 -- start start 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a99a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f50941587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a99a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5094159e50 0x7f509415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a99a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940c0870 con 0x7f50940c0100 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a99a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940a79d0 con 0x7f5094159e50 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a99a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940c0b50 con 0x7f509415b580 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f5099197640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50940c0100 0x7f509406c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44708/0 (socket says 172.21.15.45:44708) 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f5099197640 1 -- 172.21.15.45:0/151028501 learned_addr learned my addr 172.21.15.45:0/151028501 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:11.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.347+0000 7f509a199640 1 --2- 172.21.15.45:0/151028501 >> v2:172.21.15.45:3300/0 conn(0x7f5094159e50 0x7f509415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f5099998640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f50941587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f5098996640 1 -- 172.21.15.45:0/151028501 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465020294 0 0) 0x7f50940c0870 con 0x7f50940c0100 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f5098996640 1 -- 172.21.15.45:0/151028501 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5080003520 con 0x7f50940c0100 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f509a199640 1 -- 172.21.15.45:0/151028501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 msgr2=0x7f50941587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f509a199640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f50941587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f509a199640 1 -- 172.21.15.45:0/151028501 >> v1:172.21.15.45:6789/0 conn(0x7f50940c0100 legacy=0x7f509406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.348+0000 7f509a199640 1 -- 172.21.15.45:0/151028501 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940c0e30 con 0x7f5094159e50 2023-12-08T08:19:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f509a199640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094159e50 0x7f509415a2e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f508c009d90 tx=0x7f508c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688625705bf0d5d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f5098996640 1 -- 172.21.15.45:0/151028501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c02cbd0 con 0x7f5094159e50 2023-12-08T08:19:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f5098996640 1 -- 172.21.15.45:0/151028501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c02cd30 con 0x7f5094159e50 2023-12-08T08:19:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f5098996640 1 -- 172.21.15.45:0/151028501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c02cea0 con 0x7f5094159e50 2023-12-08T08:19:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f509a99a640 1 -- 172.21.15.45:0/151028501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094159e50 msgr2=0x7f509415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.350+0000 7f509a99a640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094159e50 0x7f509415a2e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f508c009d90 tx=0x7f508c02be20 comp rx=0 tx=0).stop 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 -- 172.21.15.45:0/151028501 shutdown_connections 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094159e50 0x7f509415a2e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 --2- 172.21.15.45:0/151028501 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f50941587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 -- 172.21.15.45:0/151028501 >> 172.21.15.45:0/151028501 conn(0x7f50940c5780 msgr2=0x7f50940c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 -- 172.21.15.45:0/151028501 shutdown_connections 2023-12-08T08:19:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.351+0000 7f509a99a640 1 -- 172.21.15.45:0/151028501 wait complete. 2023-12-08T08:19:11.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.352+0000 7f509a99a640 1 Processor -- start 2023-12-08T08:19:11.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.352+0000 7f509a99a640 1 -- start start 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5094159e50 0x7f50941f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f5094159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50941514c0 con 0x7f50940c0100 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940a8d70 con 0x7f5094159e50 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.353+0000 7f509a99a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50941519f0 con 0x7f509415b580 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56362/0 (socket says 172.21.15.45:56362) 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 -- 172.21.15.45:0/3489888487 learned_addr learned my addr 172.21.15.45:0/3489888487 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 -- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 msgr2=0x7f5094159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f509a199640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f5094159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f5094159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 -- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5094159e50 msgr2=0x7f50941f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5094159e50 0x7f50941f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 -- 172.21.15.45:0/3489888487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c009a70 con 0x7f50940c0100 2023-12-08T08:19:11.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.354+0000 7f5099998640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f509000d5f0 tx=0x7f509000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.355+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900125f0 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.355+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090012750 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.355+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50941f2200 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.355+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090012b00 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.355+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50940a8850 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.356+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50940a89e0 con 0x7f50940c0100 2023-12-08T08:19:11.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.357+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5090012c60 con 0x7f50940c0100 2023-12-08T08:19:11.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.358+0000 7f508a7fc640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 0x7f507806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.358+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5090089c50 con 0x7f50940c0100 2023-12-08T08:19:11.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.359+0000 7f5099197640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 0x7f507806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.359+0000 7f5099197640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 0x7f507806d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5094155970 tx=0x7f5084007930 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.363+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5090054bb0 con 0x7f50940c0100 2023-12-08T08:19:11.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.554+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50940743e0 con 0x7f50940c0100 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.555+0000 7f508a7fc640 1 -- 172.21.15.45:0/3489888487 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+209 (secure 0 0 0) 0x7f50900581d0 con 0x7f50940c0100 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 13, 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_metadata" 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 14, 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "cephfs_data" 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 msgr2=0x7f507806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 0x7f507806d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5094155970 tx=0x7f5084007930 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 msgr2=0x7f5094072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f509000d5f0 tx=0x7f509000dab0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 shutdown_connections 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f507806ae40 0x7f507806d300 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f509415b580 0x7f5094159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5094159e50 0x7f50941f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 --2- 172.21.15.45:0/3489888487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50940c0100 0x7f5094072250 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 >> 172.21.15.45:0/3489888487 conn(0x7f50940c5780 msgr2=0x7f5094154560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 shutdown_connections 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.558+0000 7f509a99a640 1 -- 172.21.15.45:0/3489888487 wait complete. 2023-12-08T08:19:11.577 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-08T08:19:11.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-08T08:19:11.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.800+0000 7fc0d4b81640 1 Processor -- start 2023-12-08T08:19:11.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.801+0000 7fc0d4b81640 1 -- start start 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d00c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d00c5c50 0x7fc0d0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 0x7fc0d01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d0158940 con 0x7fc0d00c5c50 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00c2210 con 0x7fc0d00c60b0 2023-12-08T08:19:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.802+0000 7fc0d4b81640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0157cc0 con 0x7fc0d00c5870 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d00c5c50 0x7fc0d0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d00c5c50 0x7fc0d0154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56376/0 (socket says 172.21.15.45:56376) 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 -- 172.21.15.45:0/2229085111 learned_addr learned my addr 172.21.15.45:0/2229085111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0cffff640 1 --2- 172.21.15.45:0/2229085111 >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 0x7fc0d01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0cf7fe640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d00c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 -- 172.21.15.45:0/2229085111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 msgr2=0x7fc0d00c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d00c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 -- 172.21.15.45:0/2229085111 >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 msgr2=0x7fc0d01551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/2229085111 >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 0x7fc0d01551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0c7fff640 1 -- 172.21.15.45:0/2229085111 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0157fa0 con 0x7fc0d00c5c50 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0cffff640 1 --2- 172.21.15.45:0/2229085111 >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 0x7fc0d01551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.803+0000 7fc0cf7fe640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d00c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.804+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d0154c70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc0d006e090 tx=0x7fc0b802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18774b369df8fc00 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0ceffd640 1 -- 172.21.15.45:0/2229085111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8033620 con 0x7fc0d00c5c50 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0ceffd640 1 -- 172.21.15.45:0/2229085111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8033780 con 0x7fc0d00c5c50 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0ceffd640 1 -- 172.21.15.45:0/2229085111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8033b10 con 0x7fc0d00c5c50 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 -- 172.21.15.45:0/2229085111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 msgr2=0x7fc0d0154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d0154c70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc0d006e090 tx=0x7fc0b802b7d0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 -- 172.21.15.45:0/2229085111 shutdown_connections 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/2229085111 >> v2:172.21.15.114:3300/0 conn(0x7fc0d00c60b0 0x7fc0d01551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d0154c70 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/2229085111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d00c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.805+0000 7fc0d4b81640 1 -- 172.21.15.45:0/2229085111 >> 172.21.15.45:0/2229085111 conn(0x7fc0d0066df0 msgr2=0x7fc0d00a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.806+0000 7fc0d4b81640 1 -- 172.21.15.45:0/2229085111 shutdown_connections 2023-12-08T08:19:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.806+0000 7fc0d4b81640 1 -- 172.21.15.45:0/2229085111 wait complete. 2023-12-08T08:19:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.807+0000 7fc0d4b81640 1 Processor -- start 2023-12-08T08:19:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.807+0000 7fc0d4b81640 1 -- start start 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d01ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d00c60b0 0x7fc0d0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00a8af0 con 0x7fc0d00c5c50 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00a8dd0 con 0x7fc0d00c60b0 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0d4b81640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d006fbb0 con 0x7fc0d00c5870 2023-12-08T08:19:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56384/0 (socket says 172.21.15.45:56384) 2023-12-08T08:19:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.808+0000 7fc0c7fff640 1 -- 172.21.15.45:0/446825102 learned_addr learned my addr 172.21.15.45:0/446825102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0cf7fe640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d01ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 -- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 msgr2=0x7fc0d01ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d01ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0cffff640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d00c60b0 0x7fc0d0150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 -- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d00c60b0 msgr2=0x7fc0d0150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d00c60b0 0x7fc0d0150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 -- 172.21.15.45:0/446825102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80094d0 con 0x7fc0d00c5c50 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.809+0000 7fc0c7fff640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8000c00 tx=0x7fc0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.810+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8032c00 con 0x7fc0d00c5c50 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.810+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8032d80 con 0x7fc0d00c5c50 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.810+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b803c640 con 0x7fc0d00c5c50 2023-12-08T08:19:11.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.810+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d0156e00 con 0x7fc0d00c5c50 2023-12-08T08:19:11.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.810+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d01e7200 con 0x7fc0d00c5c50 2023-12-08T08:19:11.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.811+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d0067900 con 0x7fc0d00c5c50 2023-12-08T08:19:11.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.812+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0b803a040 con 0x7fc0d00c5c50 2023-12-08T08:19:11.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.813+0000 7fc0ccff9640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 0x7fc0b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.813+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0b80ab410 con 0x7fc0d00c5c50 2023-12-08T08:19:11.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.813+0000 7fc0cf7fe640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 0x7fc0b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.814+0000 7fc0cf7fe640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 0x7fc0b006d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0006fd0 tx=0x7fc0c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:11.817+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0b8076490 con 0x7fc0d00c5c50 2023-12-08T08:19:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.013+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0d00a8c30 con 0x7fc0d00c5c50 2023-12-08T08:19:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.890+0000 7fc0ccff9640 1 -- 172.21.15.45:0/446825102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v80) v1 ==== 140+0+0 (secure 0 0 0) 0x7fc0d00a8c30 con 0x7fc0d00c5c50 2023-12-08T08:19:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' created 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 msgr2=0x7fc0b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 0x7fc0b006d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0006fd0 tx=0x7fc0c0008040 comp rx=0 tx=0).stop 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 msgr2=0x7fc0d01e6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8000c00 tx=0x7fc0b80046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 shutdown_connections 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc0b006ae40 0x7fc0b006d300 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d00c60b0 0x7fc0d0150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d00c5c50 0x7fc0d01e6ae0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 --2- 172.21.15.45:0/446825102 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0d00c5870 0x7fc0d01ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.894+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 >> 172.21.15.45:0/446825102 conn(0x7fc0d0066df0 msgr2=0x7fc0d0155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.895+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 shutdown_connections 2023-12-08T08:19:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:12.896+0000 7fc0d4b81640 1 -- 172.21.15.45:0/446825102 wait complete. 2023-12-08T08:19:12.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:19:13.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.135+0000 7f43d8eda640 1 Processor -- start 2023-12-08T08:19:13.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.135+0000 7f43d8eda640 1 -- start start 2023-12-08T08:19:13.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.137+0000 7f43d8eda640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 0x7f43d406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.137+0000 7f43d8eda640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43d4157da0 0x7f43d4158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.137+0000 7f43d8eda640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4155230 con 0x7f43d40c64f0 2023-12-08T08:19:13.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.137+0000 7f43d8eda640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40c45b0 con 0x7f43d4157da0 2023-12-08T08:19:13.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.137+0000 7f43d8eda640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c4890 con 0x7f43d4154ce0 2023-12-08T08:19:13.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.138+0000 7f43d37fe640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f43d40c64f0 0x7f43d413d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:39304/0 (socket says 172.21.15.45:39304) 2023-12-08T08:19:13.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.138+0000 7f43d37fe640 1 -- 172.21.15.45:0/2266176615 learned_addr learned my addr 172.21.15.45:0/2266176615 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:13.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.138+0000 7f43cbfff640 1 --2- 172.21.15.45:0/2266176615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 0x7f43d406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.138+0000 7f43d3fff640 1 --2- 172.21.15.45:0/2266176615 >> v2:172.21.15.114:3300/0 conn(0x7f43d4157da0 0x7f43d4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43d2ffd640 1 -- 172.21.15.45:0/2266176615 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765109686 0 0) 0x7f43d4155230 con 0x7f43d40c64f0 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43d2ffd640 1 -- 172.21.15.45:0/2266176615 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c0003520 con 0x7f43d40c64f0 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43cbfff640 1 -- 172.21.15.45:0/2266176615 >> v2:172.21.15.114:3300/0 conn(0x7f43d4157da0 msgr2=0x7f43d4158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43cbfff640 1 --2- 172.21.15.45:0/2266176615 >> v2:172.21.15.114:3300/0 conn(0x7f43d4157da0 0x7f43d4158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43cbfff640 1 -- 172.21.15.45:0/2266176615 >> v1:172.21.15.114:6789/0 conn(0x7f43d40c64f0 legacy=0x7f43d413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.139+0000 7f43cbfff640 1 -- 172.21.15.45:0/2266176615 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40c4b70 con 0x7f43d4154ce0 2023-12-08T08:19:13.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.140+0000 7f43cbfff640 1 --2- 172.21.15.45:0/2266176615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 0x7f43d406c400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097a0 tx=0x7f43bc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959054ab970ea108 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.141+0000 7f43d2ffd640 1 -- 172.21.15.45:0/2266176615 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc02f050 con 0x7f43d4154ce0 2023-12-08T08:19:13.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.141+0000 7f43d2ffd640 1 -- 172.21.15.45:0/2266176615 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc031700 con 0x7f43d4154ce0 2023-12-08T08:19:13.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.141+0000 7f43d2ffd640 1 -- 172.21.15.45:0/2266176615 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc031a70 con 0x7f43d4154ce0 2023-12-08T08:19:13.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.141+0000 7f43d8eda640 1 -- 172.21.15.45:0/2266176615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 msgr2=0x7f43d406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.141+0000 7f43d8eda640 1 --2- 172.21.15.45:0/2266176615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 0x7f43d406c400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097a0 tx=0x7f43bc02b7a0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 -- 172.21.15.45:0/2266176615 shutdown_connections 2023-12-08T08:19:13.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 --2- 172.21.15.45:0/2266176615 >> v2:172.21.15.114:3300/0 conn(0x7f43d4157da0 0x7f43d4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 --2- 172.21.15.45:0/2266176615 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d4154ce0 0x7f43d406c400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 -- 172.21.15.45:0/2266176615 >> 172.21.15.45:0/2266176615 conn(0x7f43d40661f0 msgr2=0x7f43d4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:13.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 -- 172.21.15.45:0/2266176615 shutdown_connections 2023-12-08T08:19:13.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.142+0000 7f43d8eda640 1 -- 172.21.15.45:0/2266176615 wait complete. 2023-12-08T08:19:13.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.143+0000 7f43d8eda640 1 Processor -- start 2023-12-08T08:19:13.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 -- start start 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d40c64f0 0x7f43d40af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d4154ce0 0x7f43d40ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40af1f0 con 0x7f43d4157da0 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4150950 con 0x7f43d4154ce0 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.144+0000 7f43d8eda640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41ed8f0 con 0x7f43d40c64f0 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56394/0 (socket says 172.21.15.45:56394) 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 -- 172.21.15.45:0/3805065181 learned_addr learned my addr 172.21.15.45:0/3805065181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d37fe640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d40c64f0 0x7f43d40af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43cbfff640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d4154ce0 0x7f43d40ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 -- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d40c64f0 msgr2=0x7f43d40af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d40c64f0 0x7f43d40af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 -- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d4154ce0 msgr2=0x7f43d40ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d4154ce0 0x7f43d40ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.145+0000 7f43d3fff640 1 -- 172.21.15.45:0/3805065181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009400 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d3fff640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00efc0 tx=0x7f43cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc014480 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00f040 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc014820 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4150bf0 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.146+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4154610 con 0x7f43d4157da0 2023-12-08T08:19:13.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.148+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4150d80 con 0x7f43d4157da0 2023-12-08T08:19:13.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.150+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43cc014980 con 0x7f43d4157da0 2023-12-08T08:19:13.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.151+0000 7f43d0ff9640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 0x7f43b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.151+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f43cc08ab50 con 0x7f43d4157da0 2023-12-08T08:19:13.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.151+0000 7f43d37fe640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 0x7f43b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.152+0000 7f43d37fe640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 0x7f43b406d300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43c40011e0 tx=0x7f43c4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.155+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43cc055ae0 con 0x7f43d4157da0 2023-12-08T08:19:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.351+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f43d40c7b60 con 0x7f43d4157da0 2023-12-08T08:19:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.897+0000 7f43d0ff9640 1 -- 172.21.15.45:0/3805065181 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v81) v1 ==== 172+0+0 (secure 0 0 0) 0x7f43cc0180d0 con 0x7f43d4157da0 2023-12-08T08:19:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' created 2023-12-08T08:19:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 msgr2=0x7f43b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 0x7f43b406d300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43c40011e0 tx=0x7f43c4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 msgr2=0x7f43d41ecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00efc0 tx=0x7f43cc00c490 comp rx=0 tx=0).stop 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 shutdown_connections 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f43b406ae40 0x7f43b406d300 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d4157da0 0x7f43d41ecfb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d4154ce0 0x7f43d40ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 --2- 172.21.15.45:0/3805065181 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43d40c64f0 0x7f43d40af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.901+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 >> 172.21.15.45:0/3805065181 conn(0x7f43d40661f0 msgr2=0x7f43d4156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.902+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 shutdown_connections 2023-12-08T08:19:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:13.902+0000 7f43d8eda640 1 -- 172.21.15.45:0/3805065181 wait complete. 2023-12-08T08:19:13.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-08T08:19:14.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.130+0000 7fdf5bfff640 1 Processor -- start 2023-12-08T08:19:14.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.130+0000 7fdf5bfff640 1 -- start start 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c06ba10 0x7fdf5c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdf5c0a4d10 0x7fdf5c0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf5c06c330 0x7fdf5c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c150a90 con 0x7fdf5c06c330 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0c0890 con 0x7fdf5c0a4d10 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0c0b70 con 0x7fdf5c06ba10 2023-12-08T08:19:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf5c06c330 0x7fdf5c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf5c06c330 0x7fdf5c0c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56408/0 (socket says 172.21.15.45:56408) 2023-12-08T08:19:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.132+0000 7fdf5b7fe640 1 -- 172.21.15.45:0/1209782164 learned_addr learned my addr 172.21.15.45:0/1209782164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5affd640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c06ba10 0x7fdf5c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf53fff640 1 --2- 172.21.15.45:0/1209782164 >> v2:172.21.15.114:3300/0 conn(0x7fdf5c0a4d10 0x7fdf5c0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5b7fe640 1 -- 172.21.15.45:0/1209782164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c06ba10 msgr2=0x7fdf5c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5b7fe640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c06ba10 0x7fdf5c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5b7fe640 1 -- 172.21.15.45:0/1209782164 >> v2:172.21.15.114:3300/0 conn(0x7fdf5c0a4d10 msgr2=0x7fdf5c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5b7fe640 1 --2- 172.21.15.45:0/1209782164 >> v2:172.21.15.114:3300/0 conn(0x7fdf5c0a4d10 0x7fdf5c0c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.133+0000 7fdf5b7fe640 1 -- 172.21.15.45:0/1209782164 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0c0e50 con 0x7fdf5c06c330 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.134+0000 7fdf5b7fe640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c0c18b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c06dee0 tx=0x7fdf5402dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041fa70963ca798 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.134+0000 7fdf5a7fc640 1 -- 172.21.15.45:0/1209782164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5402ed80 con 0x7fdf5c06c330 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5a7fc640 1 -- 172.21.15.45:0/1209782164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54032070 con 0x7fdf5c06c330 2023-12-08T08:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5a7fc640 1 -- 172.21.15.45:0/1209782164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54038620 con 0x7fdf5c06c330 2023-12-08T08:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 -- 172.21.15.45:0/1209782164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 msgr2=0x7fdf5c0c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c0c18b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c06dee0 tx=0x7fdf5402dfd0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 -- 172.21.15.45:0/1209782164 shutdown_connections 2023-12-08T08:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/1209782164 >> v2:172.21.15.114:3300/0 conn(0x7fdf5c0a4d10 0x7fdf5c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c0c18b0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/1209782164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c06ba10 0x7fdf5c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.135+0000 7fdf5bfff640 1 -- 172.21.15.45:0/1209782164 >> 172.21.15.45:0/1209782164 conn(0x7fdf5c066ce0 msgr2=0x7fdf5c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.136+0000 7fdf5bfff640 1 -- 172.21.15.45:0/1209782164 shutdown_connections 2023-12-08T08:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.136+0000 7fdf5bfff640 1 -- 172.21.15.45:0/1209782164 wait complete. 2023-12-08T08:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.138+0000 7fdf5bfff640 1 Processor -- start 2023-12-08T08:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.138+0000 7fdf5bfff640 1 -- start start 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf5c06ba10 0x7fdf5c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c0a4d10 0x7fdf5c1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c0a9880 con 0x7fdf5c06c330 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c146ea0 con 0x7fdf5c06ba10 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.139+0000 7fdf5bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c147180 con 0x7fdf5c0a4d10 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56412/0 (socket says 172.21.15.45:56412) 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 -- 172.21.15.45:0/3180304521 learned_addr learned my addr 172.21.15.45:0/3180304521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf5affd640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf5c06ba10 0x7fdf5c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 -- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c0a4d10 msgr2=0x7fdf5c1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c0a4d10 0x7fdf5c1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 -- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf5c06ba10 msgr2=0x7fdf5c150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf5c06ba10 0x7fdf5c150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 -- 172.21.15.45:0/3180304521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5400bd40 con 0x7fdf5c06c330 2023-12-08T08:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.140+0000 7fdf53fff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400d5d0 tx=0x7fdf4400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.141+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44004240 con 0x7fdf5c06c330 2023-12-08T08:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.141+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf440043a0 con 0x7fdf5c06c330 2023-12-08T08:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.141+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44003830 con 0x7fdf5c06c330 2023-12-08T08:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.141+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c0a9a70 con 0x7fdf5c06c330 2023-12-08T08:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.141+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c0a93f0 con 0x7fdf5c06c330 2023-12-08T08:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.142+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5c0678c0 con 0x7fdf5c06c330 2023-12-08T08:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.143+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf44003990 con 0x7fdf5c06c330 2023-12-08T08:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.144+0000 7fdf537fe640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.144+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6783+0+0 (secure 0 0 0) 0x7fdf44089c10 con 0x7fdf5c06c330 2023-12-08T08:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.145+0000 7fdf5affd640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.145+0000 7fdf5affd640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.149+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf44054880 con 0x7fdf5c06c330 2023-12-08T08:19:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.386+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fdf5c0743e0 con 0x7fdf5c06c330 2023-12-08T08:19:14.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.927+0000 7fdf537fe640 1 -- 172.21.15.45:0/3180304521 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) v1 ==== 177+0+0 (secure 0 0 0) 0x7fdf44057ea0 con 0x7fdf5c06c330 2023-12-08T08:19:14.930 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 15 and data pool 16 2023-12-08T08:19:14.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.931+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 msgr2=0x7fdf3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.931+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:14.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 msgr2=0x7fdf5c1e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400d5d0 tx=0x7fdf4400da90 comp rx=0 tx=0).stop 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 shutdown_connections 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdf3c06ae40 0x7fdf3c06d300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf5c0a4d10 0x7fdf5c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf5c06c330 0x7fdf5c1e8d80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 --2- 172.21.15.45:0/3180304521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf5c06ba10 0x7fdf5c150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 >> 172.21.15.45:0/3180304521 conn(0x7fdf5c066ce0 msgr2=0x7fdf5c14b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.932+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 shutdown_connections 2023-12-08T08:19:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:14.933+0000 7fdf5bfff640 1 -- 172.21.15.45:0/3180304521 wait complete. 2023-12-08T08:19:14.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.167+0000 7fcf349eb640 1 Processor -- start 2023-12-08T08:19:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.167+0000 7fcf349eb640 1 -- start start 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf349eb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf3014e260 0x7fcf301542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf349eb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf3006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf349eb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300a7300 con 0x7fcf3006ce20 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf349eb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300bfb90 con 0x7fcf3014e260 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf349eb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300bf010 con 0x7fcf300beb30 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf2ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf3014e260 0x7fcf301542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf2ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf3014e260 0x7fcf301542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33794/0 (socket says 172.21.15.45:33794) 2023-12-08T08:19:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf2ed9d640 1 -- 172.21.15.45:0/65981579 learned_addr learned my addr 172.21.15.45:0/65981579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.169+0000 7fcf2e59c640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf3006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.170+0000 7fcf2ed9d640 1 -- 172.21.15.45:0/65981579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 msgr2=0x7fcf3006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.170+0000 7fcf2ed9d640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf3006c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.170+0000 7fcf2ed9d640 1 -- 172.21.15.45:0/65981579 >> v1:172.21.15.114:6789/0 conn(0x7fcf3006ce20 legacy=0x7fcf300a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.170+0000 7fcf2ed9d640 1 -- 172.21.15.45:0/65981579 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300bf2f0 con 0x7fcf3014e260 2023-12-08T08:19:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.171+0000 7fcf2ed9d640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf301542a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8d2ce154c81440 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.171+0000 7fcf2dd9b640 1 -- 172.21.15.45:0/65981579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20031640 con 0x7fcf3014e260 2023-12-08T08:19:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.171+0000 7fcf2dd9b640 1 -- 172.21.15.45:0/65981579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200317a0 con 0x7fcf3014e260 2023-12-08T08:19:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.171+0000 7fcf2dd9b640 1 -- 172.21.15.45:0/65981579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20031b30 con 0x7fcf3014e260 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 -- 172.21.15.45:0/65981579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 msgr2=0x7fcf301542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf301542a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 -- 172.21.15.45:0/65981579 shutdown_connections 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf3006c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 --2- 172.21.15.45:0/65981579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf301542a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 -- 172.21.15.45:0/65981579 >> 172.21.15.45:0/65981579 conn(0x7fcf300c5780 msgr2=0x7fcf300c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 -- 172.21.15.45:0/65981579 shutdown_connections 2023-12-08T08:19:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.172+0000 7fcf349eb640 1 -- 172.21.15.45:0/65981579 wait complete. 2023-12-08T08:19:15.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.174+0000 7fcf349eb640 1 Processor -- start 2023-12-08T08:19:15.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.174+0000 7fcf349eb640 1 -- start start 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3006ce20 0x7fcf301ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf30144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf301454c0 con 0x7fcf3014e260 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300c54a0 con 0x7fcf3006ce20 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf349eb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30155710 con 0x7fcf300beb30 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf2f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf2f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33806/0 (socket says 172.21.15.45:33806) 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.175+0000 7fcf2f59e640 1 -- 172.21.15.45:0/1510065024 learned_addr learned my addr 172.21.15.45:0/1510065024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2ed9d640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3006ce20 0x7fcf301ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2e59c640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf30144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 -- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 msgr2=0x7fcf30144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf30144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 -- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3006ce20 msgr2=0x7fcf301ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3006ce20 0x7fcf301ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 -- 172.21.15.45:0/1510065024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200094d0 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.176+0000 7fcf2f59e640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c780 tx=0x7fcf2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.177+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28004b60 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.177+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800ce90 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.177+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800a850 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.177+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf301edc10 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.177+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf301edef0 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.178+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30155bf0 con 0x7fcf3014e260 2023-12-08T08:19:15.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.179+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf2800a9b0 con 0x7fcf3014e260 2023-12-08T08:19:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.180+0000 7fcf177fe640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.180+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fcf28089cb0 con 0x7fcf3014e260 2023-12-08T08:19:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.180+0000 7fcf2ed9d640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.181+0000 7fcf2ed9d640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 0x7fcf1c06d300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf20036000 tx=0x7fcf2003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.184+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf30155bf0 con 0x7fcf3014e260 2023-12-08T08:19:15.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.375+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf30155bf0 con 0x7fcf3014e260 2023-12-08T08:19:15.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.377+0000 7fcf177fe640 1 -- 172.21.15.45:0/1510065024 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20352 (secure 0 0 0) 0x7fcf30155bf0 con 0x7fcf3014e260 2023-12-08T08:19:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:15.380 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":82,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:14.387018+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.379+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 msgr2=0x7fcf1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.379+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 0x7fcf1c06d300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf20036000 tx=0x7fcf2003c040 comp rx=0 tx=0).stop 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 msgr2=0x7fcf30144f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c780 tx=0x7fcf2800cc40 comp rx=0 tx=0).stop 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 shutdown_connections 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcf1c06ae40 0x7fcf1c06d300 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcf300beb30 0x7fcf30144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf3014e260 0x7fcf30144f80 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 --2- 172.21.15.45:0/1510065024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3006ce20 0x7fcf301ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 >> 172.21.15.45:0/1510065024 conn(0x7fcf300c5780 msgr2=0x7fcf3014d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 shutdown_connections 2023-12-08T08:19:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.380+0000 7fcf349eb640 1 -- 172.21.15.45:0/1510065024 wait complete. 2023-12-08T08:19:15.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:15.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.619+0000 7f8411127640 1 Processor -- start 2023-12-08T08:19:15.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.619+0000 7f8411127640 1 -- start start 2023-12-08T08:19:15.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.620+0000 7f8411127640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 0x7f840c14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.620+0000 7f8411127640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840c14fb20 0x7f840c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.620+0000 7f8411127640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c155850 con 0x7f840c0a7910 2023-12-08T08:19:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.620+0000 7f8411127640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c0c0890 con 0x7f840c14fb20 2023-12-08T08:19:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.620+0000 7f8411127640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0c0b70 con 0x7f840c1521b0 2023-12-08T08:19:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840c14fb20 0x7f840c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840c14fb20 0x7f840c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33810/0 (socket says 172.21.15.45:33810) 2023-12-08T08:19:15.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 -- 172.21.15.45:0/3857954132 learned_addr learned my addr 172.21.15.45:0/3857954132 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f840b7fe640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 0x7f840c14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 -- 172.21.15.45:0/3857954132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 msgr2=0x7f840c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 0x7f840c14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 -- 172.21.15.45:0/3857954132 >> v1:172.21.15.114:6789/0 conn(0x7f840c0a7910 legacy=0x7f840c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f8410926640 1 -- 172.21.15.45:0/3857954132 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0c0e50 con 0x7f840c14fb20 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.621+0000 7f840b7fe640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 0x7f840c14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:15.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.622+0000 7f8410926640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c155ce0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8404009e50 tx=0x7f840402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec422c9927f6f3b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.623+0000 7f840affd640 1 -- 172.21.15.45:0/3857954132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840402c9f0 con 0x7f840c14fb20 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.623+0000 7f840affd640 1 -- 172.21.15.45:0/3857954132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840402cb50 con 0x7f840c14fb20 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.623+0000 7f840affd640 1 -- 172.21.15.45:0/3857954132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040343f0 con 0x7f840c14fb20 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 -- 172.21.15.45:0/3857954132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 msgr2=0x7f840c155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c155ce0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8404009e50 tx=0x7f840402be50 comp rx=0 tx=0).stop 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 -- 172.21.15.45:0/3857954132 shutdown_connections 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c155ce0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 --2- 172.21.15.45:0/3857954132 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c1521b0 0x7f840c14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 -- 172.21.15.45:0/3857954132 >> 172.21.15.45:0/3857954132 conn(0x7f840c0c5780 msgr2=0x7f840c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 -- 172.21.15.45:0/3857954132 shutdown_connections 2023-12-08T08:19:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.624+0000 7f8411127640 1 -- 172.21.15.45:0/3857954132 wait complete. 2023-12-08T08:19:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.626+0000 7f8411127640 1 Processor -- start 2023-12-08T08:19:15.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.626+0000 7f8411127640 1 -- start start 2023-12-08T08:19:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c0a7910 0x7f840c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f840c1521b0 0x7f840c1e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0707a0 con 0x7f840c14fb20 2023-12-08T08:19:15.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1e9660 con 0x7f840c1521b0 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8411127640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1514f0 con 0x7f840c0a7910 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33816/0 (socket says 172.21.15.45:33816) 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 -- 172.21.15.45:0/3557744282 learned_addr learned my addr 172.21.15.45:0/3557744282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840bfff640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c0a7910 0x7f840c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f8410926640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f840c1521b0 0x7f840c1e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 -- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c0a7910 msgr2=0x7f840c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c0a7910 0x7f840c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 -- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f840c1521b0 msgr2=0x7f840c1e56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f840c1521b0 0x7f840c1e56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.627+0000 7f840b7fe640 1 -- 172.21.15.45:0/3557744282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404009b30 con 0x7f840c14fb20 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f840b7fe640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f840000c7f0 tx=0x7f840000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400007820 con 0x7f840c14fb20 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400007980 con 0x7f840c14fb20 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c1e8cc0 con 0x7f840c14fb20 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400007d10 con 0x7f840c14fb20 2023-12-08T08:19:15.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.628+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c1e9280 con 0x7f840c14fb20 2023-12-08T08:19:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.629+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c1e98d0 con 0x7f840c14fb20 2023-12-08T08:19:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.630+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84000113f0 con 0x7f840c14fb20 2023-12-08T08:19:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.631+0000 7f8408ff9640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 0x7f83f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.631+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f8400089ae0 con 0x7f840c14fb20 2023-12-08T08:19:15.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.631+0000 7f840bfff640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 0x7f83f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.632+0000 7f840bfff640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 0x7f83f806d300 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f83fc004ea0 tx=0x7f83fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.636+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f840008e070 con 0x7f840c14fb20 2023-12-08T08:19:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.835+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f840c0aa4c0 con 0x7f840c14fb20 2023-12-08T08:19:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.839+0000 7f8408ff9640 1 -- 172.21.15.45:0/3557744282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+20352 (secure 0 0 0) 0x7f8400054780 con 0x7f840c14fb20 2023-12-08T08:19:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:15.842 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":82,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:14.387018+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 msgr2=0x7f83f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 0x7f83f806d300 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f83fc004ea0 tx=0x7f83fc009040 comp rx=0 tx=0).stop 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 msgr2=0x7f840c0c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f840000c7f0 tx=0x7f840000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 shutdown_connections 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f83f806ae40 0x7f83f806d300 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f840c1521b0 0x7f840c1e56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c14fb20 0x7f840c0c4e30 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 --2- 172.21.15.45:0/3557744282 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f840c0a7910 0x7f840c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.842+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 >> 172.21.15.45:0/3557744282 conn(0x7f840c0c5780 msgr2=0x7f840c14e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.843+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 shutdown_connections 2023-12-08T08:19:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:15.843+0000 7f8411127640 1 -- 172.21.15.45:0/3557744282 wait complete. 2023-12-08T08:19:15.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-08T08:19:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.090+0000 7f7533fff640 1 Processor -- start 2023-12-08T08:19:16.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.091+0000 7f7533fff640 1 -- start start 2023-12-08T08:19:16.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.092+0000 7f7533fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75340c4970 0x7f75340a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.092+0000 7f7533fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340c60c0 con 0x7f7534155790 2023-12-08T08:19:16.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.092+0000 7f7533fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7534152dc0 con 0x7f753414c280 2023-12-08T08:19:16.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.092+0000 7f7533fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75341521d0 con 0x7f75340c4970 2023-12-08T08:19:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f75337fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7534155790 0x7f7534155ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52516/0 (socket says 172.21.15.45:52516) 2023-12-08T08:19:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f75337fe640 1 -- 172.21.15.45:0/2370260000 learned_addr learned my addr 172.21.15.45:0/2370260000 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f75327fc640 1 --2- 172.21.15.45:0/2370260000 >> v2:172.21.15.45:3300/0 conn(0x7f75340c4970 0x7f75340a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f7531ffb640 1 -- 172.21.15.45:0/2370260000 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620615992 0 0) 0x7f752c001490 con 0x7f7534155790 2023-12-08T08:19:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f7531ffb640 1 -- 172.21.15.45:0/2370260000 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f751c003520 con 0x7f7534155790 2023-12-08T08:19:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f75327fc640 1 -- 172.21.15.45:0/2370260000 >> v1:172.21.15.114:6789/0 conn(0x7f753414c280 legacy=0x7f753406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.093+0000 7f75327fc640 1 -- 172.21.15.45:0/2370260000 >> v1:172.21.15.45:6789/0 conn(0x7f7534155790 legacy=0x7f7534155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.094+0000 7f75327fc640 1 -- 172.21.15.45:0/2370260000 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753414c660 con 0x7f75340c4970 2023-12-08T08:19:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.095+0000 7f75327fc640 1 --2- 172.21.15.45:0/2370260000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75340c4970 0x7f75340a4d10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f75280097a0 tx=0x7f752802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351e501d5dc2fad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.095+0000 7f7531ffb640 1 -- 172.21.15.45:0/2370260000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528031830 con 0x7f75340c4970 2023-12-08T08:19:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.095+0000 7f7531ffb640 1 -- 172.21.15.45:0/2370260000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7528031990 con 0x7f75340c4970 2023-12-08T08:19:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.095+0000 7f7531ffb640 1 -- 172.21.15.45:0/2370260000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528031d20 con 0x7f75340c4970 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 -- 172.21.15.45:0/2370260000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75340c4970 msgr2=0x7f75340a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 --2- 172.21.15.45:0/2370260000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75340c4970 0x7f75340a4d10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f75280097a0 tx=0x7f752802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 -- 172.21.15.45:0/2370260000 shutdown_connections 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 --2- 172.21.15.45:0/2370260000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75340c4970 0x7f75340a4d10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 -- 172.21.15.45:0/2370260000 >> 172.21.15.45:0/2370260000 conn(0x7f7534066ce0 msgr2=0x7f75340a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 -- 172.21.15.45:0/2370260000 shutdown_connections 2023-12-08T08:19:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.096+0000 7f7533fff640 1 -- 172.21.15.45:0/2370260000 wait complete. 2023-12-08T08:19:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.098+0000 7f7533fff640 1 Processor -- start 2023-12-08T08:19:16.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.098+0000 7f7533fff640 1 -- start start 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 0x7f75340c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 0x7f75340a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340c1950 con 0x7f753414c280 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534145b50 con 0x7f75340c4970 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7533fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75341458b0 con 0x7f7534155790 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f75327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f75327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33836/0 (socket says 172.21.15.45:33836) 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f75327fc640 1 -- 172.21.15.45:0/1496285440 learned_addr learned my addr 172.21.15.45:0/1496285440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.099+0000 7f7532ffd640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 0x7f75340c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 -- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 msgr2=0x7f75340a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75337fe640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 0x7f75340a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 0x7f75340a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 -- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 msgr2=0x7f75340c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 0x7f75340c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 -- 172.21.15.45:0/1496285440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528009400 con 0x7f753414c280 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f7532ffd640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 0x7f75340c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75337fe640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 0x7f75340a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f75327fc640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7528034040 tx=0x7f75280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752803a8f0 con 0x7f753414c280 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752803aa70 con 0x7f753414c280 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752803ae20 con 0x7f753414c280 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.100+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75341518e0 con 0x7f753414c280 2023-12-08T08:19:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.101+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340c1ca0 con 0x7f753414c280 2023-12-08T08:19:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.102+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75340c0bf0 con 0x7f753414c280 2023-12-08T08:19:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.103+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f752804d440 con 0x7f753414c280 2023-12-08T08:19:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.104+0000 7f751b7fe640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.104+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f75280abc10 con 0x7f753414c280 2023-12-08T08:19:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.104+0000 7f7532ffd640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.105+0000 7f7532ffd640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 0x7f752006d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7534155470 tx=0x7f7524009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.109+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75340c0bf0 con 0x7f753414c280 2023-12-08T08:19:16.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.341+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f75340c0bf0 con 0x7f753414c280 2023-12-08T08:19:16.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.979+0000 7f751b7fe640 1 -- 172.21.15.45:0/1496285440 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7f75340c0bf0 con 0x7f753414c280 2023-12-08T08:19:16.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 msgr2=0x7f752006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 0x7f752006d330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7534155470 tx=0x7f7524009040 comp rx=0 tx=0).stop 2023-12-08T08:19:16.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 msgr2=0x7f75340c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f7528034040 tx=0x7f75280046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 shutdown_connections 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f752006ae70 0x7f752006d330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7534155790 0x7f75340a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753414c280 0x7f75340c1410 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 --2- 172.21.15.45:0/1496285440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75340c4970 0x7f75340c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 >> 172.21.15.45:0/1496285440 conn(0x7f7534066ce0 msgr2=0x7f7534155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 shutdown_connections 2023-12-08T08:19:16.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:16.983+0000 7f7533fff640 1 -- 172.21.15.45:0/1496285440 wait complete. 2023-12-08T08:19:17.007 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:19:17.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-08T08:19:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.238+0000 7fb72e963640 1 Processor -- start 2023-12-08T08:19:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.238+0000 7fb72e963640 1 -- start start 2023-12-08T08:19:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.240+0000 7fb72e963640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 0x7fb7280ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.240+0000 7fb72e963640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb7280ca610 0x7fb728155040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.240+0000 7fb72e963640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728151eb0 con 0x7fb728157a20 2023-12-08T08:19:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.240+0000 7fb72e963640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280c56a0 con 0x7fb7280ca610 2023-12-08T08:19:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.240+0000 7fb72e963640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c80d0 con 0x7fb728151ad0 2023-12-08T08:19:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.241+0000 7fb72d961640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 0x7fb7280ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.241+0000 7fb72e162640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb7280ca610 0x7fb728155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.241+0000 7fb72d961640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 0x7fb7280ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58294/0 (socket says 172.21.15.45:58294) 2023-12-08T08:19:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.241+0000 7fb72d961640 1 -- 172.21.15.45:0/3288947996 learned_addr learned my addr 172.21.15.45:0/3288947996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.242+0000 7fb72e162640 1 -- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 msgr2=0x7fb7280ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.242+0000 7fb72e162640 1 --2- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 0x7fb7280ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.242+0000 7fb72e162640 1 -- 172.21.15.45:0/3288947996 >> v1:172.21.15.114:6789/0 conn(0x7fb728157a20 legacy=0x7fb728154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.242+0000 7fb72e162640 1 -- 172.21.15.45:0/3288947996 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728154430 con 0x7fb7280ca610 2023-12-08T08:19:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.243+0000 7fb72e162640 1 --2- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb728155040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb720009d90 tx=0x7fb72002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ffe6a366fe706e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.243+0000 7fb72c95f640 1 -- 172.21.15.45:0/3288947996 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72002cc50 con 0x7fb7280ca610 2023-12-08T08:19:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72c95f640 1 -- 172.21.15.45:0/3288947996 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72002cdb0 con 0x7fb7280ca610 2023-12-08T08:19:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72c95f640 1 -- 172.21.15.45:0/3288947996 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720034660 con 0x7fb7280ca610 2023-12-08T08:19:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 -- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 msgr2=0x7fb728155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 --2- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb728155040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb720009d90 tx=0x7fb72002bea0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 -- 172.21.15.45:0/3288947996 shutdown_connections 2023-12-08T08:19:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 --2- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb728155040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 --2- 172.21.15.45:0/3288947996 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728151ad0 0x7fb7280ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 -- 172.21.15.45:0/3288947996 >> 172.21.15.45:0/3288947996 conn(0x7fb728066610 msgr2=0x7fb728066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 -- 172.21.15.45:0/3288947996 shutdown_connections 2023-12-08T08:19:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.244+0000 7fb72e963640 1 -- 172.21.15.45:0/3288947996 wait complete. 2023-12-08T08:19:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.246+0000 7fb72e963640 1 Processor -- start 2023-12-08T08:19:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.246+0000 7fb72e963640 1 -- start start 2023-12-08T08:19:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb7280c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728157a20 0x7fb7280c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c2c40 con 0x7fb728151ad0 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c1430 con 0x7fb7280ca610 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72e963640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c0c10 con 0x7fb728157a20 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72d160640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72d160640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33848/0 (socket says 172.21.15.45:33848) 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.247+0000 7fb72d160640 1 -- 172.21.15.45:0/4007653369 learned_addr learned my addr 172.21.15.45:0/4007653369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d961640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb7280c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72e162640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728157a20 0x7fb7280c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 -- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728157a20 msgr2=0x7fb7280c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728157a20 0x7fb7280c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 -- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 msgr2=0x7fb7280c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb7280c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 -- 172.21.15.45:0/4007653369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009a70 con 0x7fb728151ad0 2023-12-08T08:19:17.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.248+0000 7fb72d160640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c430 tx=0x7fb71c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.249+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0052d0 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.249+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c005430 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.249+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb728149610 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.249+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c003830 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.249+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7280ac3e0 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.250+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7280ac5a0 con 0x7fb728151ad0 2023-12-08T08:19:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.251+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb71c003990 con 0x7fb728151ad0 2023-12-08T08:19:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.252+0000 7fb71a7fc640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 0x7fb70c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.252+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb71c088fe0 con 0x7fb728151ad0 2023-12-08T08:19:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.253+0000 7fb72d961640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 0x7fb70c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.253+0000 7fb72d961640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 0x7fb70c06d300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb7280c34f0 tx=0x7fb724008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.257+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb71c053c20 con 0x7fb728151ad0 2023-12-08T08:19:17.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.493+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7280743e0 con 0x7fb728151ad0 2023-12-08T08:19:17.888 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-08T08:19:17.886+0000 7fad1245b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:19:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.991+0000 7fb71a7fc640 1 -- 172.21.15.45:0/4007653369 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb71c0170c0 con 0x7fb728151ad0 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.994+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 msgr2=0x7fb70c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.994+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 0x7fb70c06d300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb7280c34f0 tx=0x7fb724008040 comp rx=0 tx=0).stop 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.994+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 msgr2=0x7fb7280c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.994+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c430 tx=0x7fb71c00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 shutdown_connections 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb70c06ae40 0x7fb70c06d300 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb728157a20 0x7fb7280c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb728151ad0 0x7fb7280c1e00 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 --2- 172.21.15.45:0/4007653369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280ca610 0x7fb7280c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 >> 172.21.15.45:0/4007653369 conn(0x7fb728066610 msgr2=0x7fb72814e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 shutdown_connections 2023-12-08T08:19:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:17.995+0000 7fb72e963640 1 -- 172.21.15.45:0/4007653369 wait complete. 2023-12-08T08:19:18.064 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-08T08:19:18.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.299+0000 7f6de3fff640 1 Processor -- start 2023-12-08T08:19:18.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.300+0000 7f6de3fff640 1 -- start start 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6de41587e0 0x7f6de40c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de3fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40c0640 con 0x7f6de415b580 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de3fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40c0870 con 0x7f6de4159e50 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de3fff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de40a79d0 con 0x7f6de41587e0 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6de41587e0 0x7f6de40c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6de415b580 0x7f6de406c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52524/0 (socket says 172.21.15.45:52524) 2023-12-08T08:19:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.301+0000 7f6de2ffd640 1 -- 172.21.15.45:0/392119523 learned_addr learned my addr 172.21.15.45:0/392119523 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.302+0000 7f6de27fc640 1 -- 172.21.15.45:0/392119523 >> v1:172.21.15.114:6789/0 conn(0x7f6de4159e50 legacy=0x7f6de415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.302+0000 7f6de27fc640 1 -- 172.21.15.45:0/392119523 >> v1:172.21.15.45:6789/0 conn(0x7f6de415b580 legacy=0x7f6de406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.302+0000 7f6de27fc640 1 -- 172.21.15.45:0/392119523 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40c0b50 con 0x7f6de41587e0 2023-12-08T08:19:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.302+0000 7f6de1ffb640 1 -- 172.21.15.45:0/392119523 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005816985 0 0) 0x7f6de40c0640 con 0x7f6de415b580 2023-12-08T08:19:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.303+0000 7f6de27fc640 1 --2- 172.21.15.45:0/392119523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de40c0100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0097d0 tx=0x7f6dcc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26990e737aa5be6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.303+0000 7f6de1ffb640 1 -- 172.21.15.45:0/392119523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc031780 con 0x7f6de41587e0 2023-12-08T08:19:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.303+0000 7f6de1ffb640 1 -- 172.21.15.45:0/392119523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0318e0 con 0x7f6de41587e0 2023-12-08T08:19:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.303+0000 7f6de1ffb640 1 -- 172.21.15.45:0/392119523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc031c70 con 0x7f6de41587e0 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 -- 172.21.15.45:0/392119523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 msgr2=0x7f6de40c0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 --2- 172.21.15.45:0/392119523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de40c0100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0097d0 tx=0x7f6dcc02b820 comp rx=0 tx=0).stop 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 -- 172.21.15.45:0/392119523 shutdown_connections 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 --2- 172.21.15.45:0/392119523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de40c0100 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 -- 172.21.15.45:0/392119523 >> 172.21.15.45:0/392119523 conn(0x7f6de40c5780 msgr2=0x7f6de40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 -- 172.21.15.45:0/392119523 shutdown_connections 2023-12-08T08:19:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.304+0000 7f6de3fff640 1 -- 172.21.15.45:0/392119523 wait complete. 2023-12-08T08:19:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.306+0000 7f6de3fff640 1 Processor -- start 2023-12-08T08:19:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.306+0000 7f6de3fff640 1 -- start start 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 0x7f6de406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 0x7f6de40a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40a7050 con 0x7f6de41587e0 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41f1350 con 0x7f6de4159e50 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de3fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41f1630 con 0x7f6de415b580 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33872/0 (socket says 172.21.15.45:33872) 2023-12-08T08:19:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de2ffd640 1 -- 172.21.15.45:0/533782350 learned_addr learned my addr 172.21.15.45:0/533782350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.307+0000 7f6de27fc640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 0x7f6de406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 -- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 msgr2=0x7f6de40a3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de37fe640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 0x7f6de40a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 0x7f6de40a3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 -- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 msgr2=0x7f6de406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 0x7f6de406f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 -- 172.21.15.45:0/533782350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009400 con 0x7f6de41587e0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de27fc640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 0x7f6de406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de37fe640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 0x7f6de40a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400c7c0 tx=0x7f6dd400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400a640 con 0x7f6de41587e0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400a7c0 con 0x7f6de41587e0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400ab70 con 0x7f6de41587e0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de41f1910 con 0x7f6de41587e0 2023-12-08T08:19:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.308+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de4072260 con 0x7f6de41587e0 2023-12-08T08:19:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.310+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de40743e0 con 0x7f6de41587e0 2023-12-08T08:19:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.311+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dd400acd0 con 0x7f6de41587e0 2023-12-08T08:19:18.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.312+0000 7f6ddb7fe640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 0x7f6dc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.312+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6dd4088fe0 con 0x7f6de41587e0 2023-12-08T08:19:18.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.312+0000 7f6de27fc640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 0x7f6dc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.313+0000 7f6de27fc640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 0x7f6dc406d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc036000 tx=0x7f6dcc03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.317+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dd4053b70 con 0x7f6de41587e0 2023-12-08T08:19:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.547+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6de41560f0 con 0x7f6de41587e0 2023-12-08T08:19:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.548+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/533782350 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f6dd4018020 con 0x7f6de41587e0 2023-12-08T08:19:18.550 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:18.551 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-12-08T08:19:18.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 msgr2=0x7f6dc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 0x7f6dc406d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc036000 tx=0x7f6dcc03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:18.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 msgr2=0x7f6de415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400c7c0 tx=0x7f6dd400cc80 comp rx=0 tx=0).stop 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 shutdown_connections 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6dc406ae70 0x7f6dc406d330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6de415b580 0x7f6de40a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6de4159e50 0x7f6de406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 --2- 172.21.15.45:0/533782350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de41587e0 0x7f6de415a4f0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 >> 172.21.15.45:0/533782350 conn(0x7f6de40c5780 msgr2=0x7f6de40c0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.551+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 shutdown_connections 2023-12-08T08:19:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.552+0000 7f6de3fff640 1 -- 172.21.15.45:0/533782350 wait complete. 2023-12-08T08:19:18.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:18.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.796+0000 7f7d98871640 1 Processor -- start 2023-12-08T08:19:18.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.796+0000 7f7d98871640 1 -- start start 2023-12-08T08:19:18.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.797+0000 7f7d98871640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d9414e840 0x7f7d94151960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d98871640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 0x7f7d940c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d98871640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d94151ea0 con 0x7f7d940a9e80 2023-12-08T08:19:18.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d98871640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9414ec20 con 0x7f7d9414e840 2023-12-08T08:19:18.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d98871640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d94154850 con 0x7f7d940c1210 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d93fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d940a9e80 0x7f7d940aa310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52540/0 (socket says 172.21.15.45:52540) 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d93fff640 1 -- 172.21.15.45:0/3316714337 learned_addr learned my addr 172.21.15.45:0/3316714337 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d937fe640 1 --2- 172.21.15.45:0/3316714337 >> v2:172.21.15.114:3300/0 conn(0x7f7d9414e840 0x7f7d94151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.798+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/3316714337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 0x7f7d940c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d927fc640 1 -- 172.21.15.45:0/3316714337 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874199027 0 0) 0x7f7d94151ea0 con 0x7f7d940a9e80 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d927fc640 1 -- 172.21.15.45:0/3316714337 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d7c003520 con 0x7f7d940a9e80 2023-12-08T08:19:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d92ffd640 1 -- 172.21.15.45:0/3316714337 >> v2:172.21.15.114:3300/0 conn(0x7f7d9414e840 msgr2=0x7f7d94151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:18.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/3316714337 >> v2:172.21.15.114:3300/0 conn(0x7f7d9414e840 0x7f7d94151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d92ffd640 1 -- 172.21.15.45:0/3316714337 >> v1:172.21.15.45:6789/0 conn(0x7f7d940a9e80 legacy=0x7f7d940aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.799+0000 7f7d92ffd640 1 -- 172.21.15.45:0/3316714337 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94154b30 con 0x7f7d940c1210 2023-12-08T08:19:18.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.801+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/3316714337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 0x7f7d940c1670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d880097a0 tx=0x7f7d8802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84de6563b62d8d18 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.801+0000 7f7d927fc640 1 -- 172.21.15.45:0/3316714337 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88031780 con 0x7f7d940c1210 2023-12-08T08:19:18.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.801+0000 7f7d927fc640 1 -- 172.21.15.45:0/3316714337 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d880318e0 con 0x7f7d940c1210 2023-12-08T08:19:18.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.801+0000 7f7d927fc640 1 -- 172.21.15.45:0/3316714337 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88031c50 con 0x7f7d940c1210 2023-12-08T08:19:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 -- 172.21.15.45:0/3316714337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 msgr2=0x7f7d940c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 --2- 172.21.15.45:0/3316714337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 0x7f7d940c1670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d880097a0 tx=0x7f7d8802b820 comp rx=0 tx=0).stop 2023-12-08T08:19:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 -- 172.21.15.45:0/3316714337 shutdown_connections 2023-12-08T08:19:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 --2- 172.21.15.45:0/3316714337 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940c1210 0x7f7d940c1670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 --2- 172.21.15.45:0/3316714337 >> v2:172.21.15.114:3300/0 conn(0x7f7d9414e840 0x7f7d94151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 -- 172.21.15.45:0/3316714337 >> 172.21.15.45:0/3316714337 conn(0x7f7d940c5780 msgr2=0x7f7d940c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 -- 172.21.15.45:0/3316714337 shutdown_connections 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.802+0000 7f7d98871640 1 -- 172.21.15.45:0/3316714337 wait complete. 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.804+0000 7f7d98871640 1 Processor -- start 2023-12-08T08:19:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.804+0000 7f7d98871640 1 -- start start 2023-12-08T08:19:18.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940a9e80 0x7f7d9415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9414e840 0x7f7d9415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9415c8c0 con 0x7f7d940c1210 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9414dce0 con 0x7f7d9414e840 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d98871640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9414da00 con 0x7f7d940a9e80 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d92ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33888/0 (socket says 172.21.15.45:33888) 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4232593751 learned_addr learned my addr 172.21.15.45:0/4232593751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940a9e80 0x7f7d9415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.805+0000 7f7d93fff640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9414e840 0x7f7d9415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940a9e80 msgr2=0x7f7d9415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940a9e80 0x7f7d9415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9414e840 msgr2=0x7f7d9415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9414e840 0x7f7d9415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 -- 172.21.15.45:0/4232593751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009400 con 0x7f7d940c1210 2023-12-08T08:19:18.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d92ffd640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7d88034040 tx=0x7f7d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88032820 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88032980 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88032cf0 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.806+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940bfb40 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.807+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9415e750 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.808+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d940bf9a0 con 0x7f7d940c1210 2023-12-08T08:19:18.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.809+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d8804e440 con 0x7f7d940c1210 2023-12-08T08:19:18.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.810+0000 7f7d7bfff640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 0x7f7d8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.810+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7d880abb60 con 0x7f7d940c1210 2023-12-08T08:19:18.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.810+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 0x7f7d8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.811+0000 7f7d937fe640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 0x7f7d8006d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009a30 tx=0x7f7d84008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:18.814+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d940bf9a0 con 0x7f7d940c1210 2023-12-08T08:19:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.012+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d9415cd10 con 0x7f7d940c1210 2023-12-08T08:19:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.016+0000 7f7d7bfff640 1 -- 172.21.15.45:0/4232593751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f7d9415cd10 con 0x7f7d940c1210 2023-12-08T08:19:19.019 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:19.019 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 msgr2=0x7f7d8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 0x7f7d8006d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009a30 tx=0x7f7d84008040 comp rx=0 tx=0).stop 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 msgr2=0x7f7d9415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7d88034040 tx=0x7f7d880046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 shutdown_connections 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7d8006ae40 0x7f7d8006d300 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9414e840 0x7f7d9415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d940c1210 0x7f7d9415cff0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 --2- 172.21.15.45:0/4232593751 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7d940a9e80 0x7f7d9415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 >> 172.21.15.45:0/4232593751 conn(0x7f7d940c5780 msgr2=0x7f7d940c28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 shutdown_connections 2023-12-08T08:19:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.019+0000 7f7d98871640 1 -- 172.21.15.45:0/4232593751 wait complete. 2023-12-08T08:19:19.043 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:19:19.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:19.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.270+0000 7fbd206bb640 1 Processor -- start 2023-12-08T08:19:19.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.271+0000 7fbd206bb640 1 -- start start 2023-12-08T08:19:19.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd1806a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd180c6580 0x7fbd180c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd181518e0 0x7fbd18151d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd181522d0 con 0x7fbd180c6580 2023-12-08T08:19:19.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180c1930 con 0x7fbd181518e0 2023-12-08T08:19:19.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd206bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd18155580 con 0x7fbd1806a4c0 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd1dc56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd180c6580 0x7fbd180c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd1dc56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd180c6580 0x7fbd180c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33900/0 (socket says 172.21.15.45:33900) 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.272+0000 7fbd1dc56640 1 -- 172.21.15.45:0/2697181828 learned_addr learned my addr 172.21.15.45:0/2697181828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1ec58640 1 --2- 172.21.15.45:0/2697181828 >> v2:172.21.15.114:3300/0 conn(0x7fbd181518e0 0x7fbd18151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1e457640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd1806a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1dc56640 1 -- 172.21.15.45:0/2697181828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 msgr2=0x7fbd1806a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd1806a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1dc56640 1 -- 172.21.15.45:0/2697181828 >> v2:172.21.15.114:3300/0 conn(0x7fbd181518e0 msgr2=0x7fbd18151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/2697181828 >> v2:172.21.15.114:3300/0 conn(0x7fbd181518e0 0x7fbd18151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.273+0000 7fbd1dc56640 1 -- 172.21.15.45:0/2697181828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18154970 con 0x7fbd180c6580 2023-12-08T08:19:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.274+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd180c13f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbd18158be0 tx=0x7fbd0c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c1a1e0c1d2b92f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.274+0000 7fbd1d455640 1 -- 172.21.15.45:0/2697181828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c031520 con 0x7fbd180c6580 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd1d455640 1 -- 172.21.15.45:0/2697181828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c031680 con 0x7fbd180c6580 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd1d455640 1 -- 172.21.15.45:0/2697181828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c031a10 con 0x7fbd180c6580 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 -- 172.21.15.45:0/2697181828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 msgr2=0x7fbd180c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd180c13f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fbd18158be0 tx=0x7fbd0c02b7c0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 -- 172.21.15.45:0/2697181828 shutdown_connections 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 --2- 172.21.15.45:0/2697181828 >> v2:172.21.15.114:3300/0 conn(0x7fbd181518e0 0x7fbd18151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd180c13f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 --2- 172.21.15.45:0/2697181828 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd1806a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 -- 172.21.15.45:0/2697181828 >> 172.21.15.45:0/2697181828 conn(0x7fbd180a8960 msgr2=0x7fbd180a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 -- 172.21.15.45:0/2697181828 shutdown_connections 2023-12-08T08:19:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.275+0000 7fbd206bb640 1 -- 172.21.15.45:0/2697181828 wait complete. 2023-12-08T08:19:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.277+0000 7fbd206bb640 1 Processor -- start 2023-12-08T08:19:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.277+0000 7fbd206bb640 1 -- start start 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd181ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd181518e0 0x7fbd181eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd181dd290 con 0x7fbd180c6580 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd181ea060 con 0x7fbd181518e0 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd206bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd181e9a30 con 0x7fbd1806a4c0 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd1dc56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd1dc56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33902/0 (socket says 172.21.15.45:33902) 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.278+0000 7fbd1dc56640 1 -- 172.21.15.45:0/3376904963 learned_addr learned my addr 172.21.15.45:0/3376904963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1e457640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd181ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 -- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 msgr2=0x7fbd181ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd181ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 -- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd181518e0 msgr2=0x7fbd181eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd181518e0 0x7fbd181eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 -- 172.21.15.45:0/3376904963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0094d0 con 0x7fbd180c6580 2023-12-08T08:19:19.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd1dc56640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c000c00 tx=0x7fbd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c031520 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c033c70 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03c400 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.279+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd181eda50 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.280+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd181e9cf0 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.281+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd181e9e80 con 0x7fbd180c6580 2023-12-08T08:19:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.282+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd0c03a040 con 0x7fbd180c6580 2023-12-08T08:19:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.283+0000 7fbd0affd640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 0x7fbcfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.283+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbd0c0ab340 con 0x7fbd180c6580 2023-12-08T08:19:19.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.283+0000 7fbd1e457640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 0x7fbcfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.284+0000 7fbd1e457640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 0x7fbcfc06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.287+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd0c075f40 con 0x7fbd180c6580 2023-12-08T08:19:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.476+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd18155210 con 0x7fbcfc06ae40 2023-12-08T08:19:19.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.514+0000 7fbd0affd640 1 -- 172.21.15.45:0/3376904963 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+512447 (secure 0 0 0) 0x7fbd1400e4b0 con 0x7fbcfc06ae40 2023-12-08T08:19:19.525 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:19.529 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 msgr2=0x7fbcfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 0x7fbcfc06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd14006fd0 tx=0x7fbd14008040 comp rx=0 tx=0).stop 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 msgr2=0x7fbd1806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c000c00 tx=0x7fbd0c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 shutdown_connections 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbcfc06ae40 0x7fbcfc06d300 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd181518e0 0x7fbd181eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd180c6580 0x7fbd1806e520 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 --2- 172.21.15.45:0/3376904963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd1806a4c0 0x7fbd181ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.522+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 >> 172.21.15.45:0/3376904963 conn(0x7fbd180a8960 msgr2=0x7fbd18152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.523+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 shutdown_connections 2023-12-08T08:19:19.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.523+0000 7fbd206bb640 1 -- 172.21.15.45:0/3376904963 wait complete. 2023-12-08T08:19:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-12-08T08:19:17.789040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":212,"acting":212,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254128,"kb_used_data":8856,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720592,"statfs":{"total":773094113280,"available":772833886208,"internally_reserved":0,"allocated":9068544,"data_stored":4836753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.895229"},"pg_stats":[{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739659+0000","last_change":"2023-12-08T08:18:53.772671+0000","last_active":"2023-12-08T08:18:56.739659+0000","last_peered":"2023-12-08T08:18:56.739659+0000","last_clean":"2023-12-08T08:18:56.739659+0000","last_became_active":"2023-12-08T08:18:53.772403+0000","last_became_peered":"2023-12-08T08:18:53.772403+0000","last_unstale":"2023-12-08T08:18:56.739659+0000","last_undegraded":"2023-12-08T08:18:56.739659+0000","last_fullsized":"2023-12-08T08:18:56.739659+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:49.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960709+0000","last_change":"2023-12-08T08:18:53.783694+0000","last_active":"2023-12-08T08:19:14.960709+0000","last_peered":"2023-12-08T08:19:14.960709+0000","last_clean":"2023-12-08T08:19:14.960709+0000","last_became_active":"2023-12-08T08:18:53.782993+0000","last_became_peered":"2023-12-08T08:18:53.782993+0000","last_unstale":"2023-12-08T08:19:14.960709+0000","last_undegraded":"2023-12-08T08:19:14.960709+0000","last_fullsized":"2023-12-08T08:19:14.960709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739466+0000","last_change":"2023-12-08T08:18:53.786844+0000","last_active":"2023-12-08T08:18:56.739466+0000","last_peered":"2023-12-08T08:18:56.739466+0000","last_clean":"2023-12-08T08:18:56.739466+0000","last_became_active":"2023-12-08T08:18:53.786534+0000","last_became_peered":"2023-12-08T08:18:53.786534+0000","last_unstale":"2023-12-08T08:18:56.739466+0000","last_undegraded":"2023-12-08T08:18:56.739466+0000","last_fullsized":"2023-12-08T08:18:56.739466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:41.159908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737406+0000","last_change":"2023-12-08T08:18:53.789128+0000","last_active":"2023-12-08T08:18:56.737406+0000","last_peered":"2023-12-08T08:18:56.737406+0000","last_clean":"2023-12-08T08:18:56.737406+0000","last_became_active":"2023-12-08T08:18:53.788783+0000","last_became_peered":"2023-12-08T08:18:53.788783+0000","last_unstale":"2023-12-08T08:18:56.737406+0000","last_undegraded":"2023-12-08T08:18:56.737406+0000","last_fullsized":"2023-12-08T08:18:56.737406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:26:07.559242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604541+0000","last_change":"2023-12-08T08:19:14.971606+0000","last_active":"2023-12-08T08:19:16.604541+0000","last_peered":"2023-12-08T08:19:16.604541+0000","last_clean":"2023-12-08T08:19:16.604541+0000","last_became_active":"2023-12-08T08:19:14.971304+0000","last_became_peered":"2023-12-08T08:19:14.971304+0000","last_unstale":"2023-12-08T08:19:16.604541+0000","last_undegraded":"2023-12-08T08:19:16.604541+0000","last_fullsized":"2023-12-08T08:19:16.604541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:22.450691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737264+0000","last_change":"2023-12-08T08:18:53.789378+0000","last_active":"2023-12-08T08:18:56.737264+0000","last_peered":"2023-12-08T08:18:56.737264+0000","last_clean":"2023-12-08T08:18:56.737264+0000","last_became_active":"2023-12-08T08:18:53.789113+0000","last_became_peered":"2023-12-08T08:18:53.789113+0000","last_unstale":"2023-12-08T08:18:56.737264+0000","last_undegraded":"2023-12-08T08:18:56.737264+0000","last_fullsized":"2023-12-08T08:18:56.737264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:31.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265640+0000","last_change":"2023-12-08T08:18:53.796019+0000","last_active":"2023-12-08T08:18:55.265640+0000","last_peered":"2023-12-08T08:18:55.265640+0000","last_clean":"2023-12-08T08:18:55.265640+0000","last_became_active":"2023-12-08T08:18:53.788065+0000","last_became_peered":"2023-12-08T08:18:53.788065+0000","last_unstale":"2023-12-08T08:18:55.265640+0000","last_undegraded":"2023-12-08T08:18:55.265640+0000","last_fullsized":"2023-12-08T08:18:55.265640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078751+0000","last_change":"2023-12-08T08:18:53.793006+0000","last_active":"2023-12-08T08:18:56.078751+0000","last_peered":"2023-12-08T08:18:56.078751+0000","last_clean":"2023-12-08T08:18:56.078751+0000","last_became_active":"2023-12-08T08:18:53.792739+0000","last_became_peered":"2023-12-08T08:18:53.792739+0000","last_unstale":"2023-12-08T08:18:56.078751+0000","last_undegraded":"2023-12-08T08:18:56.078751+0000","last_fullsized":"2023-12-08T08:18:56.078751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:16.681517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737401+0000","last_change":"2023-12-08T08:18:53.791174+0000","last_active":"2023-12-08T08:18:56.737401+0000","last_peered":"2023-12-08T08:18:56.737401+0000","last_clean":"2023-12-08T08:18:56.737401+0000","last_became_active":"2023-12-08T08:18:53.788909+0000","last_became_peered":"2023-12-08T08:18:53.788909+0000","last_unstale":"2023-12-08T08:18:56.737401+0000","last_undegraded":"2023-12-08T08:18:56.737401+0000","last_fullsized":"2023-12-08T08:18:56.737401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:49:42.248379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737971+0000","last_change":"2023-12-08T08:18:53.786983+0000","last_active":"2023-12-08T08:18:56.737971+0000","last_peered":"2023-12-08T08:18:56.737971+0000","last_clean":"2023-12-08T08:18:56.737971+0000","last_became_active":"2023-12-08T08:18:53.786722+0000","last_became_peered":"2023-12-08T08:18:53.786722+0000","last_unstale":"2023-12-08T08:18:56.737971+0000","last_undegraded":"2023-12-08T08:18:56.737971+0000","last_fullsized":"2023-12-08T08:18:56.737971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778393+0000","last_change":"2023-12-08T08:18:53.789804+0000","last_active":"2023-12-08T08:18:54.778393+0000","last_peered":"2023-12-08T08:18:54.778393+0000","last_clean":"2023-12-08T08:18:54.778393+0000","last_became_active":"2023-12-08T08:18:53.786215+0000","last_became_peered":"2023-12-08T08:18:53.786215+0000","last_unstale":"2023-12-08T08:18:54.778393+0000","last_undegraded":"2023-12-08T08:18:54.778393+0000","last_fullsized":"2023-12-08T08:18:54.778393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:51.622019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737281+0000","last_change":"2023-12-08T08:18:53.782075+0000","last_active":"2023-12-08T08:18:56.737281+0000","last_peered":"2023-12-08T08:18:56.737281+0000","last_clean":"2023-12-08T08:18:56.737281+0000","last_became_active":"2023-12-08T08:18:53.775721+0000","last_became_peered":"2023-12-08T08:18:53.775721+0000","last_unstale":"2023-12-08T08:18:56.737281+0000","last_undegraded":"2023-12-08T08:18:56.737281+0000","last_fullsized":"2023-12-08T08:18:56.737281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778031+0000","last_change":"2023-12-08T08:18:53.776155+0000","last_active":"2023-12-08T08:18:54.778031+0000","last_peered":"2023-12-08T08:18:54.778031+0000","last_clean":"2023-12-08T08:18:54.778031+0000","last_became_active":"2023-12-08T08:18:53.775833+0000","last_became_peered":"2023-12-08T08:18:53.775833+0000","last_unstale":"2023-12-08T08:18:54.778031+0000","last_undegraded":"2023-12-08T08:18:54.778031+0000","last_fullsized":"2023-12-08T08:18:54.778031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:57.738584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736728+0000","last_change":"2023-12-08T08:18:53.787632+0000","last_active":"2023-12-08T08:18:56.736728+0000","last_peered":"2023-12-08T08:18:56.736728+0000","last_clean":"2023-12-08T08:18:56.736728+0000","last_became_active":"2023-12-08T08:18:53.787135+0000","last_became_peered":"2023-12-08T08:18:53.787135+0000","last_unstale":"2023-12-08T08:18:56.736728+0000","last_undegraded":"2023-12-08T08:18:56.736728+0000","last_fullsized":"2023-12-08T08:18:56.736728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:51:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737235+0000","last_change":"2023-12-08T08:18:53.771818+0000","last_active":"2023-12-08T08:18:56.737235+0000","last_peered":"2023-12-08T08:18:56.737235+0000","last_clean":"2023-12-08T08:18:56.737235+0000","last_became_active":"2023-12-08T08:18:53.771528+0000","last_became_peered":"2023-12-08T08:18:53.771528+0000","last_unstale":"2023-12-08T08:18:56.737235+0000","last_undegraded":"2023-12-08T08:18:56.737235+0000","last_fullsized":"2023-12-08T08:18:56.737235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.782986+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.782641+0000","last_became_peered":"2023-12-08T08:18:53.782641+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:07:35.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265388+0000","last_change":"2023-12-08T08:18:53.783616+0000","last_active":"2023-12-08T08:18:55.265388+0000","last_peered":"2023-12-08T08:18:55.265388+0000","last_clean":"2023-12-08T08:18:55.265388+0000","last_became_active":"2023-12-08T08:18:53.783322+0000","last_became_peered":"2023-12-08T08:18:53.783322+0000","last_unstale":"2023-12-08T08:18:55.265388+0000","last_undegraded":"2023-12-08T08:18:55.265388+0000","last_fullsized":"2023-12-08T08:18:55.265388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:45.651039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267104+0000","last_change":"2023-12-08T08:18:53.795881+0000","last_active":"2023-12-08T08:18:55.267104+0000","last_peered":"2023-12-08T08:18:55.267104+0000","last_clean":"2023-12-08T08:18:55.267104+0000","last_became_active":"2023-12-08T08:18:53.795563+0000","last_became_peered":"2023-12-08T08:18:53.795563+0000","last_unstale":"2023-12-08T08:18:55.267104+0000","last_undegraded":"2023-12-08T08:18:55.267104+0000","last_fullsized":"2023-12-08T08:18:55.267104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:59.236997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739646+0000","last_change":"2023-12-08T08:18:53.783723+0000","last_active":"2023-12-08T08:18:56.739646+0000","last_peered":"2023-12-08T08:18:56.739646+0000","last_clean":"2023-12-08T08:18:56.739646+0000","last_became_active":"2023-12-08T08:18:53.783415+0000","last_became_peered":"2023-12-08T08:18:53.783415+0000","last_unstale":"2023-12-08T08:18:56.739646+0000","last_undegraded":"2023-12-08T08:18:56.739646+0000","last_fullsized":"2023-12-08T08:18:56.739646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:52.604642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737512+0000","last_change":"2023-12-08T08:18:53.784426+0000","last_active":"2023-12-08T08:18:56.737512+0000","last_peered":"2023-12-08T08:18:56.737512+0000","last_clean":"2023-12-08T08:18:56.737512+0000","last_became_active":"2023-12-08T08:18:53.774174+0000","last_became_peered":"2023-12-08T08:18:53.774174+0000","last_unstale":"2023-12-08T08:18:56.737512+0000","last_undegraded":"2023-12-08T08:18:56.737512+0000","last_fullsized":"2023-12-08T08:18:56.737512+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737770+0000","last_change":"2023-12-08T08:18:53.775530+0000","last_active":"2023-12-08T08:18:56.737770+0000","last_peered":"2023-12-08T08:18:56.737770+0000","last_clean":"2023-12-08T08:18:56.737770+0000","last_became_active":"2023-12-08T08:18:53.775237+0000","last_became_peered":"2023-12-08T08:18:53.775237+0000","last_unstale":"2023-12-08T08:18:56.737770+0000","last_undegraded":"2023-12-08T08:18:56.737770+0000","last_fullsized":"2023-12-08T08:18:56.737770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:40.484831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604154+0000","last_change":"2023-12-08T08:19:14.973251+0000","last_active":"2023-12-08T08:19:16.604154+0000","last_peered":"2023-12-08T08:19:16.604154+0000","last_clean":"2023-12-08T08:19:16.604154+0000","last_became_active":"2023-12-08T08:19:14.972915+0000","last_became_peered":"2023-12-08T08:19:14.972915+0000","last_unstale":"2023-12-08T08:19:16.604154+0000","last_undegraded":"2023-12-08T08:19:16.604154+0000","last_fullsized":"2023-12-08T08:19:16.604154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:43:47.167235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737052+0000","last_change":"2023-12-08T08:18:53.791563+0000","last_active":"2023-12-08T08:18:56.737052+0000","last_peered":"2023-12-08T08:18:56.737052+0000","last_clean":"2023-12-08T08:18:56.737052+0000","last_became_active":"2023-12-08T08:18:53.791257+0000","last_became_peered":"2023-12-08T08:18:53.791257+0000","last_unstale":"2023-12-08T08:18:56.737052+0000","last_undegraded":"2023-12-08T08:18:56.737052+0000","last_fullsized":"2023-12-08T08:18:56.737052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:04.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737716+0000","last_change":"2023-12-08T08:18:53.771206+0000","last_active":"2023-12-08T08:18:56.737716+0000","last_peered":"2023-12-08T08:18:56.737716+0000","last_clean":"2023-12-08T08:18:56.737716+0000","last_became_active":"2023-12-08T08:18:53.763984+0000","last_became_peered":"2023-12-08T08:18:53.763984+0000","last_unstale":"2023-12-08T08:18:56.737716+0000","last_undegraded":"2023-12-08T08:18:56.737716+0000","last_fullsized":"2023-12-08T08:18:56.737716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784756+0000","last_change":"2023-12-08T08:18:53.794394+0000","last_active":"2023-12-08T08:18:54.784756+0000","last_peered":"2023-12-08T08:18:54.784756+0000","last_clean":"2023-12-08T08:18:54.784756+0000","last_became_active":"2023-12-08T08:18:53.794138+0000","last_became_peered":"2023-12-08T08:18:53.794138+0000","last_unstale":"2023-12-08T08:18:54.784756+0000","last_undegraded":"2023-12-08T08:18:54.784756+0000","last_fullsized":"2023-12-08T08:18:54.784756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736874+0000","last_change":"2023-12-08T08:18:53.786075+0000","last_active":"2023-12-08T08:18:56.736874+0000","last_peered":"2023-12-08T08:18:56.736874+0000","last_clean":"2023-12-08T08:18:56.736874+0000","last_became_active":"2023-12-08T08:18:53.783458+0000","last_became_peered":"2023-12-08T08:18:53.783458+0000","last_unstale":"2023-12-08T08:18:56.736874+0000","last_undegraded":"2023-12-08T08:18:56.736874+0000","last_fullsized":"2023-12-08T08:18:56.736874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:12:32.634182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.963867+0000","last_change":"2023-12-08T08:18:53.789101+0000","last_active":"2023-12-08T08:19:14.963867+0000","last_peered":"2023-12-08T08:19:14.963867+0000","last_clean":"2023-12-08T08:19:14.963867+0000","last_became_active":"2023-12-08T08:18:53.788487+0000","last_became_peered":"2023-12-08T08:18:53.788487+0000","last_unstale":"2023-12-08T08:19:14.963867+0000","last_undegraded":"2023-12-08T08:19:14.963867+0000","last_fullsized":"2023-12-08T08:19:14.963867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:42.120522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738383+0000","last_change":"2023-12-08T08:18:53.772180+0000","last_active":"2023-12-08T08:18:56.738383+0000","last_peered":"2023-12-08T08:18:56.738383+0000","last_clean":"2023-12-08T08:18:56.738383+0000","last_became_active":"2023-12-08T08:18:53.764066+0000","last_became_peered":"2023-12-08T08:18:53.764066+0000","last_unstale":"2023-12-08T08:18:56.738383+0000","last_undegraded":"2023-12-08T08:18:56.738383+0000","last_fullsized":"2023-12-08T08:18:56.738383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778269+0000","last_change":"2023-12-08T08:18:53.793998+0000","last_active":"2023-12-08T08:18:54.778269+0000","last_peered":"2023-12-08T08:18:54.778269+0000","last_clean":"2023-12-08T08:18:54.778269+0000","last_became_active":"2023-12-08T08:18:53.793584+0000","last_became_peered":"2023-12-08T08:18:53.793584+0000","last_unstale":"2023-12-08T08:18:54.778269+0000","last_undegraded":"2023-12-08T08:18:54.778269+0000","last_fullsized":"2023-12-08T08:18:54.778269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:30:39.090688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738098+0000","last_change":"2023-12-08T08:18:53.768788+0000","last_active":"2023-12-08T08:18:56.738098+0000","last_peered":"2023-12-08T08:18:56.738098+0000","last_clean":"2023-12-08T08:18:56.738098+0000","last_became_active":"2023-12-08T08:18:53.768468+0000","last_became_peered":"2023-12-08T08:18:53.768468+0000","last_unstale":"2023-12-08T08:18:56.738098+0000","last_undegraded":"2023-12-08T08:18:56.738098+0000","last_fullsized":"2023-12-08T08:18:56.738098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:44:42.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079535+0000","last_change":"2023-12-08T08:18:53.786191+0000","last_active":"2023-12-08T08:18:56.079535+0000","last_peered":"2023-12-08T08:18:56.079535+0000","last_clean":"2023-12-08T08:18:56.079535+0000","last_became_active":"2023-12-08T08:18:53.785934+0000","last_became_peered":"2023-12-08T08:18:53.785934+0000","last_unstale":"2023-12-08T08:18:56.079535+0000","last_undegraded":"2023-12-08T08:18:56.079535+0000","last_fullsized":"2023-12-08T08:18:56.079535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:26.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738088+0000","last_change":"2023-12-08T08:18:53.785767+0000","last_active":"2023-12-08T08:18:56.738088+0000","last_peered":"2023-12-08T08:18:56.738088+0000","last_clean":"2023-12-08T08:18:56.738088+0000","last_became_active":"2023-12-08T08:18:53.785369+0000","last_became_peered":"2023-12-08T08:18:53.785369+0000","last_unstale":"2023-12-08T08:18:56.738088+0000","last_undegraded":"2023-12-08T08:18:56.738088+0000","last_fullsized":"2023-12-08T08:18:56.738088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959812+0000","last_change":"2023-12-08T08:18:53.786744+0000","last_active":"2023-12-08T08:19:14.959812+0000","last_peered":"2023-12-08T08:19:14.959812+0000","last_clean":"2023-12-08T08:19:14.959812+0000","last_became_active":"2023-12-08T08:18:53.785499+0000","last_became_peered":"2023-12-08T08:18:53.785499+0000","last_unstale":"2023-12-08T08:19:14.959812+0000","last_undegraded":"2023-12-08T08:19:14.959812+0000","last_fullsized":"2023-12-08T08:19:14.959812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265746+0000","last_change":"2023-12-08T08:18:53.783040+0000","last_active":"2023-12-08T08:18:55.265746+0000","last_peered":"2023-12-08T08:18:55.265746+0000","last_clean":"2023-12-08T08:18:55.265746+0000","last_became_active":"2023-12-08T08:18:53.781940+0000","last_became_peered":"2023-12-08T08:18:53.781940+0000","last_unstale":"2023-12-08T08:18:55.265746+0000","last_undegraded":"2023-12-08T08:18:55.265746+0000","last_fullsized":"2023-12-08T08:18:55.265746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:35.044283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266255+0000","last_change":"2023-12-08T08:18:53.797000+0000","last_active":"2023-12-08T08:18:55.266255+0000","last_peered":"2023-12-08T08:18:55.266255+0000","last_clean":"2023-12-08T08:18:55.266255+0000","last_became_active":"2023-12-08T08:18:53.791588+0000","last_became_peered":"2023-12-08T08:18:53.791588+0000","last_unstale":"2023-12-08T08:18:55.266255+0000","last_undegraded":"2023-12-08T08:18:55.266255+0000","last_fullsized":"2023-12-08T08:18:55.266255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:32.972182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800688+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:18:53.800688+0000","last_peered":"2023-12-08T08:18:53.800688+0000","last_clean":"2023-12-08T08:18:53.800688+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:18:53.800688+0000","last_undegraded":"2023-12-08T08:18:53.800688+0000","last_fullsized":"2023-12-08T08:18:53.800688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:03.362667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603392+0000","last_change":"2023-12-08T08:19:14.967704+0000","last_active":"2023-12-08T08:19:16.603392+0000","last_peered":"2023-12-08T08:19:16.603392+0000","last_clean":"2023-12-08T08:19:16.603392+0000","last_became_active":"2023-12-08T08:19:14.967369+0000","last_became_peered":"2023-12-08T08:19:14.967369+0000","last_unstale":"2023-12-08T08:19:16.603392+0000","last_undegraded":"2023-12-08T08:19:16.603392+0000","last_fullsized":"2023-12-08T08:19:16.603392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:12.457958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266519+0000","last_change":"2023-12-08T08:18:53.784523+0000","last_active":"2023-12-08T08:18:55.266519+0000","last_peered":"2023-12-08T08:18:55.266519+0000","last_clean":"2023-12-08T08:18:55.266519+0000","last_became_active":"2023-12-08T08:18:53.784246+0000","last_became_peered":"2023-12-08T08:18:53.784246+0000","last_unstale":"2023-12-08T08:18:55.266519+0000","last_undegraded":"2023-12-08T08:18:55.266519+0000","last_fullsized":"2023-12-08T08:18:55.266519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:09.884228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795005+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:18:53.795005+0000","last_peered":"2023-12-08T08:18:53.795005+0000","last_clean":"2023-12-08T08:18:53.795005+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:18:53.795005+0000","last_undegraded":"2023-12-08T08:18:53.795005+0000","last_fullsized":"2023-12-08T08:18:53.795005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079331+0000","last_change":"2023-12-08T08:18:53.796068+0000","last_active":"2023-12-08T08:18:56.079331+0000","last_peered":"2023-12-08T08:18:56.079331+0000","last_clean":"2023-12-08T08:18:56.079331+0000","last_became_active":"2023-12-08T08:18:53.795798+0000","last_became_peered":"2023-12-08T08:18:53.795798+0000","last_unstale":"2023-12-08T08:18:56.079331+0000","last_undegraded":"2023-12-08T08:18:56.079331+0000","last_fullsized":"2023-12-08T08:18:56.079331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:19.902148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799218+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:18:53.799218+0000","last_peered":"2023-12-08T08:18:53.799218+0000","last_clean":"2023-12-08T08:18:53.799218+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:18:53.799218+0000","last_undegraded":"2023-12-08T08:18:53.799218+0000","last_fullsized":"2023-12-08T08:18:53.799218+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:38.128264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.267110+0000","last_change":"2023-12-08T08:18:53.794864+0000","last_active":"2023-12-08T08:18:55.267110+0000","last_peered":"2023-12-08T08:18:55.267110+0000","last_clean":"2023-12-08T08:18:55.267110+0000","last_became_active":"2023-12-08T08:18:53.794563+0000","last_became_peered":"2023-12-08T08:18:53.794563+0000","last_unstale":"2023-12-08T08:18:55.267110+0000","last_undegraded":"2023-12-08T08:18:55.267110+0000","last_fullsized":"2023-12-08T08:18:55.267110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:24.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.793681+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:18:53.793681+0000","last_peered":"2023-12-08T08:18:53.793681+0000","last_clean":"2023-12-08T08:18:53.793681+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:18:53.793681+0000","last_undegraded":"2023-12-08T08:18:53.793681+0000","last_fullsized":"2023-12-08T08:18:53.793681+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.736727+0000","last_change":"2023-12-08T08:18:53.779851+0000","last_active":"2023-12-08T08:18:56.736727+0000","last_peered":"2023-12-08T08:18:56.736727+0000","last_clean":"2023-12-08T08:18:56.736727+0000","last_became_active":"2023-12-08T08:18:53.775977+0000","last_became_peered":"2023-12-08T08:18:53.775977+0000","last_unstale":"2023-12-08T08:18:56.736727+0000","last_undegraded":"2023-12-08T08:18:56.736727+0000","last_fullsized":"2023-12-08T08:18:56.736727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:05.520867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.785079+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:18:53.785079+0000","last_peered":"2023-12-08T08:18:53.785079+0000","last_clean":"2023-12-08T08:18:53.785079+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:18:53.785079+0000","last_undegraded":"2023-12-08T08:18:53.785079+0000","last_fullsized":"2023-12-08T08:18:53.785079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784046+0000","last_change":"2023-12-08T08:18:53.792138+0000","last_active":"2023-12-08T08:18:54.784046+0000","last_peered":"2023-12-08T08:18:54.784046+0000","last_clean":"2023-12-08T08:18:54.784046+0000","last_became_active":"2023-12-08T08:18:53.791865+0000","last_became_peered":"2023-12-08T08:18:53.791865+0000","last_unstale":"2023-12-08T08:18:54.784046+0000","last_undegraded":"2023-12-08T08:18:54.784046+0000","last_fullsized":"2023-12-08T08:18:54.784046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778377+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:18:53.778377+0000","last_peered":"2023-12-08T08:18:53.778377+0000","last_clean":"2023-12-08T08:18:53.778377+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:18:53.778377+0000","last_undegraded":"2023-12-08T08:18:53.778377+0000","last_fullsized":"2023-12-08T08:18:53.778377+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:38.922247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265759+0000","last_change":"2023-12-08T08:18:53.789767+0000","last_active":"2023-12-08T08:18:55.265759+0000","last_peered":"2023-12-08T08:18:55.265759+0000","last_clean":"2023-12-08T08:18:55.265759+0000","last_became_active":"2023-12-08T08:18:53.787669+0000","last_became_peered":"2023-12-08T08:18:53.787669+0000","last_unstale":"2023-12-08T08:18:55.265759+0000","last_undegraded":"2023-12-08T08:18:55.265759+0000","last_fullsized":"2023-12-08T08:18:55.265759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:50.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.765578+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:18:53.765578+0000","last_peered":"2023-12-08T08:18:53.765578+0000","last_clean":"2023-12-08T08:18:53.765578+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:18:53.765578+0000","last_undegraded":"2023-12-08T08:18:53.765578+0000","last_fullsized":"2023-12-08T08:18:53.765578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:19:13.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600710+0000","last_change":"2023-12-08T08:19:13.943485+0000","last_active":"2023-12-08T08:19:16.600710+0000","last_peered":"2023-12-08T08:19:16.600710+0000","last_clean":"2023-12-08T08:19:16.600710+0000","last_became_active":"2023-12-08T08:19:13.943170+0000","last_became_peered":"2023-12-08T08:19:13.943170+0000","last_unstale":"2023-12-08T08:19:16.600710+0000","last_undegraded":"2023-12-08T08:19:16.600710+0000","last_fullsized":"2023-12-08T08:19:16.600710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:46.404258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737008+0000","last_change":"2023-12-08T08:18:53.792753+0000","last_active":"2023-12-08T08:18:56.737008+0000","last_peered":"2023-12-08T08:18:56.737008+0000","last_clean":"2023-12-08T08:18:56.737008+0000","last_became_active":"2023-12-08T08:18:53.792416+0000","last_became_peered":"2023-12-08T08:18:53.792416+0000","last_unstale":"2023-12-08T08:18:56.737008+0000","last_undegraded":"2023-12-08T08:18:56.737008+0000","last_fullsized":"2023-12-08T08:18:56.737008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:25.085766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777800+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:18:53.777800+0000","last_peered":"2023-12-08T08:18:53.777800+0000","last_clean":"2023-12-08T08:18:53.777800+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:18:53.777800+0000","last_undegraded":"2023-12-08T08:18:53.777800+0000","last_fullsized":"2023-12-08T08:18:53.777800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737781+0000","last_change":"2023-12-08T08:18:53.774352+0000","last_active":"2023-12-08T08:18:56.737781+0000","last_peered":"2023-12-08T08:18:56.737781+0000","last_clean":"2023-12-08T08:18:56.737781+0000","last_became_active":"2023-12-08T08:18:53.773904+0000","last_became_peered":"2023-12-08T08:18:53.773904+0000","last_unstale":"2023-12-08T08:18:56.737781+0000","last_undegraded":"2023-12-08T08:18:56.737781+0000","last_fullsized":"2023-12-08T08:18:56.737781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.964044+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:19:14.964044+0000","last_peered":"2023-12-08T08:19:14.964044+0000","last_clean":"2023-12-08T08:19:14.964044+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:19:14.964044+0000","last_undegraded":"2023-12-08T08:19:14.964044+0000","last_fullsized":"2023-12-08T08:19:14.964044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079026+0000","last_change":"2023-12-08T08:18:53.792470+0000","last_active":"2023-12-08T08:18:56.079026+0000","last_peered":"2023-12-08T08:18:56.079026+0000","last_clean":"2023-12-08T08:18:56.079026+0000","last_became_active":"2023-12-08T08:18:53.792143+0000","last_became_peered":"2023-12-08T08:18:53.792143+0000","last_unstale":"2023-12-08T08:18:56.079026+0000","last_undegraded":"2023-12-08T08:18:56.079026+0000","last_fullsized":"2023-12-08T08:18:56.079026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:25:20.644648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.763782+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:18:53.763782+0000","last_peered":"2023-12-08T08:18:53.763782+0000","last_clean":"2023-12-08T08:18:53.763782+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:18:53.763782+0000","last_undegraded":"2023-12-08T08:18:53.763782+0000","last_fullsized":"2023-12-08T08:18:53.763782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:41.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.739816+0000","last_change":"2023-12-08T08:18:53.778524+0000","last_active":"2023-12-08T08:18:56.739816+0000","last_peered":"2023-12-08T08:18:56.739816+0000","last_clean":"2023-12-08T08:18:56.739816+0000","last_became_active":"2023-12-08T08:18:53.778209+0000","last_became_peered":"2023-12-08T08:18:53.778209+0000","last_unstale":"2023-12-08T08:18:56.739816+0000","last_undegraded":"2023-12-08T08:18:56.739816+0000","last_fullsized":"2023-12-08T08:18:56.739816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:42.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.801258+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:18:53.801258+0000","last_peered":"2023-12-08T08:18:53.801258+0000","last_clean":"2023-12-08T08:18:53.801258+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:18:53.801258+0000","last_undegraded":"2023-12-08T08:18:53.801258+0000","last_fullsized":"2023-12-08T08:18:53.801258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738456+0000","last_change":"2023-12-08T08:18:53.790906+0000","last_active":"2023-12-08T08:18:56.738456+0000","last_peered":"2023-12-08T08:18:56.738456+0000","last_clean":"2023-12-08T08:18:56.738456+0000","last_became_active":"2023-12-08T08:18:53.790630+0000","last_became_peered":"2023-12-08T08:18:53.790630+0000","last_unstale":"2023-12-08T08:18:56.738456+0000","last_undegraded":"2023-12-08T08:18:56.738456+0000","last_fullsized":"2023-12-08T08:18:56.738456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:59:27.277967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"79'9","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:19:07.466320+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:19:07.466320+0000","last_peered":"2023-12-08T08:19:07.466320+0000","last_clean":"2023-12-08T08:19:07.466320+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:19:07.466320+0000","last_undegraded":"2023-12-08T08:19:07.466320+0000","last_fullsized":"2023-12-08T08:19:07.466320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:18.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737140+0000","last_change":"2023-12-08T08:18:53.785668+0000","last_active":"2023-12-08T08:18:56.737140+0000","last_peered":"2023-12-08T08:18:56.737140+0000","last_clean":"2023-12-08T08:18:56.737140+0000","last_became_active":"2023-12-08T08:18:53.785342+0000","last_became_peered":"2023-12-08T08:18:53.785342+0000","last_unstale":"2023-12-08T08:18:56.737140+0000","last_undegraded":"2023-12-08T08:18:56.737140+0000","last_fullsized":"2023-12-08T08:18:56.737140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:53.630993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.796583+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:18:53.796583+0000","last_peered":"2023-12-08T08:18:53.796583+0000","last_clean":"2023-12-08T08:18:53.796583+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:18:53.796583+0000","last_undegraded":"2023-12-08T08:18:53.796583+0000","last_fullsized":"2023-12-08T08:18:53.796583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.737237+0000","last_change":"2023-12-08T08:18:53.788006+0000","last_active":"2023-12-08T08:18:56.737237+0000","last_peered":"2023-12-08T08:18:56.737237+0000","last_clean":"2023-12-08T08:18:56.737237+0000","last_became_active":"2023-12-08T08:18:53.787709+0000","last_became_peered":"2023-12-08T08:18:53.787709+0000","last_unstale":"2023-12-08T08:18:56.737237+0000","last_undegraded":"2023-12-08T08:18:56.737237+0000","last_fullsized":"2023-12-08T08:18:56.737237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:55.392551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.764699+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:18:53.764699+0000","last_peered":"2023-12-08T08:18:53.764699+0000","last_clean":"2023-12-08T08:18:53.764699+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:18:53.764699+0000","last_undegraded":"2023-12-08T08:18:53.764699+0000","last_fullsized":"2023-12-08T08:18:53.764699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:01.823592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600841+0000","last_change":"2023-12-08T08:19:14.980900+0000","last_active":"2023-12-08T08:19:16.600841+0000","last_peered":"2023-12-08T08:19:16.600841+0000","last_clean":"2023-12-08T08:19:16.600841+0000","last_became_active":"2023-12-08T08:19:14.980615+0000","last_became_peered":"2023-12-08T08:19:14.980615+0000","last_unstale":"2023-12-08T08:19:16.600841+0000","last_undegraded":"2023-12-08T08:19:16.600841+0000","last_fullsized":"2023-12-08T08:19:16.600841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:25.711750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777824+0000","last_change":"2023-12-08T08:18:53.780686+0000","last_active":"2023-12-08T08:18:54.777824+0000","last_peered":"2023-12-08T08:18:54.777824+0000","last_clean":"2023-12-08T08:18:54.777824+0000","last_became_active":"2023-12-08T08:18:53.780408+0000","last_became_peered":"2023-12-08T08:18:53.780408+0000","last_unstale":"2023-12-08T08:18:54.777824+0000","last_undegraded":"2023-12-08T08:18:54.777824+0000","last_fullsized":"2023-12-08T08:18:54.777824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:50.587465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.753049+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:18:53.753049+0000","last_peered":"2023-12-08T08:18:53.753049+0000","last_clean":"2023-12-08T08:18:53.753049+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:18:53.753049+0000","last_undegraded":"2023-12-08T08:18:53.753049+0000","last_fullsized":"2023-12-08T08:18:53.753049+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:12.525160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.778063+0000","last_change":"2023-12-08T08:18:53.774289+0000","last_active":"2023-12-08T08:18:54.778063+0000","last_peered":"2023-12-08T08:18:54.778063+0000","last_clean":"2023-12-08T08:18:54.778063+0000","last_became_active":"2023-12-08T08:18:53.773997+0000","last_became_peered":"2023-12-08T08:18:53.773997+0000","last_unstale":"2023-12-08T08:18:54.778063+0000","last_undegraded":"2023-12-08T08:18:54.778063+0000","last_fullsized":"2023-12-08T08:18:54.778063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:57.939378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.799582+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:18:53.799582+0000","last_peered":"2023-12-08T08:18:53.799582+0000","last_clean":"2023-12-08T08:18:53.799582+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:18:53.799582+0000","last_undegraded":"2023-12-08T08:18:53.799582+0000","last_fullsized":"2023-12-08T08:18:53.799582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:50.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266509+0000","last_change":"2023-12-08T08:18:53.791859+0000","last_active":"2023-12-08T08:18:55.266509+0000","last_peered":"2023-12-08T08:18:55.266509+0000","last_clean":"2023-12-08T08:18:55.266509+0000","last_became_active":"2023-12-08T08:18:53.791211+0000","last_became_peered":"2023-12-08T08:18:53.791211+0000","last_unstale":"2023-12-08T08:18:55.266509+0000","last_undegraded":"2023-12-08T08:18:55.266509+0000","last_fullsized":"2023-12-08T08:18:55.266509+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:58.762577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.791574+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:18:53.791574+0000","last_peered":"2023-12-08T08:18:53.791574+0000","last_clean":"2023-12-08T08:18:53.791574+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:18:53.791574+0000","last_undegraded":"2023-12-08T08:18:53.791574+0000","last_fullsized":"2023-12-08T08:18:53.791574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:30.013320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604037+0000","last_change":"2023-12-08T08:19:13.940480+0000","last_active":"2023-12-08T08:19:16.604037+0000","last_peered":"2023-12-08T08:19:16.604037+0000","last_clean":"2023-12-08T08:19:16.604037+0000","last_became_active":"2023-12-08T08:19:13.939553+0000","last_became_peered":"2023-12-08T08:19:13.939553+0000","last_unstale":"2023-12-08T08:19:16.604037+0000","last_undegraded":"2023-12-08T08:19:16.604037+0000","last_fullsized":"2023-12-08T08:19:16.604037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:40.049995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784262+0000","last_change":"2023-12-08T08:18:53.788889+0000","last_active":"2023-12-08T08:18:54.784262+0000","last_peered":"2023-12-08T08:18:54.784262+0000","last_clean":"2023-12-08T08:18:54.784262+0000","last_became_active":"2023-12-08T08:18:53.788322+0000","last_became_peered":"2023-12-08T08:18:53.788322+0000","last_unstale":"2023-12-08T08:18:54.784262+0000","last_undegraded":"2023-12-08T08:18:54.784262+0000","last_fullsized":"2023-12-08T08:18:54.784262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.797401+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:18:53.797401+0000","last_peered":"2023-12-08T08:18:53.797401+0000","last_clean":"2023-12-08T08:18:53.797401+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:18:53.797401+0000","last_undegraded":"2023-12-08T08:18:53.797401+0000","last_fullsized":"2023-12-08T08:18:53.797401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:16.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738117+0000","last_change":"2023-12-08T08:18:53.779656+0000","last_active":"2023-12-08T08:18:56.738117+0000","last_peered":"2023-12-08T08:18:56.738117+0000","last_clean":"2023-12-08T08:18:56.738117+0000","last_became_active":"2023-12-08T08:18:53.774380+0000","last_became_peered":"2023-12-08T08:18:53.774380+0000","last_unstale":"2023-12-08T08:18:56.738117+0000","last_undegraded":"2023-12-08T08:18:56.738117+0000","last_fullsized":"2023-12-08T08:18:56.738117+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.800530+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:18:53.800530+0000","last_peered":"2023-12-08T08:18:53.800530+0000","last_clean":"2023-12-08T08:18:53.800530+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:18:53.800530+0000","last_undegraded":"2023-12-08T08:18:53.800530+0000","last_fullsized":"2023-12-08T08:18:53.800530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265782+0000","last_change":"2023-12-08T08:18:53.790829+0000","last_active":"2023-12-08T08:18:55.265782+0000","last_peered":"2023-12-08T08:18:55.265782+0000","last_clean":"2023-12-08T08:18:55.265782+0000","last_became_active":"2023-12-08T08:18:53.790471+0000","last_became_peered":"2023-12-08T08:18:53.790471+0000","last_unstale":"2023-12-08T08:18:55.265782+0000","last_undegraded":"2023-12-08T08:18:55.265782+0000","last_fullsized":"2023-12-08T08:18:55.265782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:53.065257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960463+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:19:14.960463+0000","last_peered":"2023-12-08T08:19:14.960463+0000","last_clean":"2023-12-08T08:19:14.960463+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:19:14.960463+0000","last_undegraded":"2023-12-08T08:19:14.960463+0000","last_fullsized":"2023-12-08T08:19:14.960463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:50.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959905+0000","last_change":"2023-12-08T08:18:53.779115+0000","last_active":"2023-12-08T08:19:14.959905+0000","last_peered":"2023-12-08T08:19:14.959905+0000","last_clean":"2023-12-08T08:19:14.959905+0000","last_became_active":"2023-12-08T08:18:53.778078+0000","last_became_peered":"2023-12-08T08:18:53.778078+0000","last_unstale":"2023-12-08T08:19:14.959905+0000","last_undegraded":"2023-12-08T08:19:14.959905+0000","last_fullsized":"2023-12-08T08:19:14.959905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767548+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:18:53.767548+0000","last_peered":"2023-12-08T08:18:53.767548+0000","last_clean":"2023-12-08T08:18:53.767548+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:18:53.767548+0000","last_undegraded":"2023-12-08T08:18:53.767548+0000","last_fullsized":"2023-12-08T08:18:53.767548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:13.192235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.961216+0000","last_change":"2023-12-08T08:18:53.783741+0000","last_active":"2023-12-08T08:19:14.961216+0000","last_peered":"2023-12-08T08:19:14.961216+0000","last_clean":"2023-12-08T08:19:14.961216+0000","last_became_active":"2023-12-08T08:18:53.783368+0000","last_became_peered":"2023-12-08T08:18:53.783368+0000","last_unstale":"2023-12-08T08:19:14.961216+0000","last_undegraded":"2023-12-08T08:19:14.961216+0000","last_fullsized":"2023-12-08T08:19:14.961216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960002+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:19:14.960002+0000","last_peered":"2023-12-08T08:19:14.960002+0000","last_clean":"2023-12-08T08:19:14.960002+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:19:14.960002+0000","last_undegraded":"2023-12-08T08:19:14.960002+0000","last_fullsized":"2023-12-08T08:19:14.960002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:11.472054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265982+0000","last_change":"2023-12-08T08:18:53.774648+0000","last_active":"2023-12-08T08:18:55.265982+0000","last_peered":"2023-12-08T08:18:55.265982+0000","last_clean":"2023-12-08T08:18:55.265982+0000","last_became_active":"2023-12-08T08:18:53.774370+0000","last_became_peered":"2023-12-08T08:18:53.774370+0000","last_unstale":"2023-12-08T08:18:55.265982+0000","last_undegraded":"2023-12-08T08:18:55.265982+0000","last_fullsized":"2023-12-08T08:18:55.265982+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:12.299840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.766658+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:18:53.766658+0000","last_peered":"2023-12-08T08:18:53.766658+0000","last_clean":"2023-12-08T08:18:53.766658+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:18:53.766658+0000","last_undegraded":"2023-12-08T08:18:53.766658+0000","last_fullsized":"2023-12-08T08:18:53.766658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:18.747307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.784210+0000","last_change":"2023-12-08T08:18:53.797020+0000","last_active":"2023-12-08T08:18:54.784210+0000","last_peered":"2023-12-08T08:18:54.784210+0000","last_clean":"2023-12-08T08:18:54.784210+0000","last_became_active":"2023-12-08T08:18:53.796346+0000","last_became_peered":"2023-12-08T08:18:53.796346+0000","last_unstale":"2023-12-08T08:18:54.784210+0000","last_undegraded":"2023-12-08T08:18:54.784210+0000","last_fullsized":"2023-12-08T08:18:54.784210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.795649+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:18:53.795649+0000","last_peered":"2023-12-08T08:18:53.795649+0000","last_clean":"2023-12-08T08:18:53.795649+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:18:53.795649+0000","last_undegraded":"2023-12-08T08:18:53.795649+0000","last_fullsized":"2023-12-08T08:18:53.795649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:38.183707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603027+0000","last_change":"2023-12-08T08:19:14.977387+0000","last_active":"2023-12-08T08:19:16.603027+0000","last_peered":"2023-12-08T08:19:16.603027+0000","last_clean":"2023-12-08T08:19:16.603027+0000","last_became_active":"2023-12-08T08:19:14.976778+0000","last_became_peered":"2023-12-08T08:19:14.976778+0000","last_unstale":"2023-12-08T08:19:16.603027+0000","last_undegraded":"2023-12-08T08:19:16.603027+0000","last_fullsized":"2023-12-08T08:19:16.603027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:23.992888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266763+0000","last_change":"2023-12-08T08:18:53.797033+0000","last_active":"2023-12-08T08:18:55.266763+0000","last_peered":"2023-12-08T08:18:55.266763+0000","last_clean":"2023-12-08T08:18:55.266763+0000","last_became_active":"2023-12-08T08:18:53.791785+0000","last_became_peered":"2023-12-08T08:18:53.791785+0000","last_unstale":"2023-12-08T08:18:55.266763+0000","last_undegraded":"2023-12-08T08:18:55.266763+0000","last_fullsized":"2023-12-08T08:18:55.266763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:55.940558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738333+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:18:56.738333+0000","last_peered":"2023-12-08T08:18:56.738333+0000","last_clean":"2023-12-08T08:18:56.738333+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:18:56.738333+0000","last_undegraded":"2023-12-08T08:18:56.738333+0000","last_fullsized":"2023-12-08T08:18:56.738333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.266590+0000","last_change":"2023-12-08T08:18:53.782490+0000","last_active":"2023-12-08T08:18:55.266590+0000","last_peered":"2023-12-08T08:18:55.266590+0000","last_clean":"2023-12-08T08:18:55.266590+0000","last_became_active":"2023-12-08T08:18:53.778003+0000","last_became_peered":"2023-12-08T08:18:53.778003+0000","last_unstale":"2023-12-08T08:18:55.266590+0000","last_undegraded":"2023-12-08T08:18:55.266590+0000","last_fullsized":"2023-12-08T08:18:55.266590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:32.849547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.767545+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:18:53.767545+0000","last_peered":"2023-12-08T08:18:53.767545+0000","last_clean":"2023-12-08T08:18:53.767545+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:18:53.767545+0000","last_undegraded":"2023-12-08T08:18:53.767545+0000","last_fullsized":"2023-12-08T08:18:53.767545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.963958+0000","last_change":"2023-12-08T08:18:53.794202+0000","last_active":"2023-12-08T08:19:14.963958+0000","last_peered":"2023-12-08T08:19:14.963958+0000","last_clean":"2023-12-08T08:19:14.963958+0000","last_became_active":"2023-12-08T08:18:53.791356+0000","last_became_peered":"2023-12-08T08:18:53.791356+0000","last_unstale":"2023-12-08T08:19:14.963958+0000","last_undegraded":"2023-12-08T08:19:14.963958+0000","last_fullsized":"2023-12-08T08:19:14.963958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:29.010585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.778330+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:18:53.778330+0000","last_peered":"2023-12-08T08:18:53.778330+0000","last_clean":"2023-12-08T08:18:53.778330+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:18:53.778330+0000","last_undegraded":"2023-12-08T08:18:53.778330+0000","last_fullsized":"2023-12-08T08:18:53.778330+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.777845+0000","last_change":"2023-12-08T08:18:53.772714+0000","last_active":"2023-12-08T08:18:54.777845+0000","last_peered":"2023-12-08T08:18:54.777845+0000","last_clean":"2023-12-08T08:18:54.777845+0000","last_became_active":"2023-12-08T08:18:53.772434+0000","last_became_peered":"2023-12-08T08:18:53.772434+0000","last_unstale":"2023-12-08T08:18:54.777845+0000","last_undegraded":"2023-12-08T08:18:54.777845+0000","last_fullsized":"2023-12-08T08:18:54.777845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:22:31.251454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.772950+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:18:53.772950+0000","last_peered":"2023-12-08T08:18:53.772950+0000","last_clean":"2023-12-08T08:18:53.772950+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:18:53.772950+0000","last_undegraded":"2023-12-08T08:18:53.772950+0000","last_fullsized":"2023-12-08T08:18:53.772950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:27.663212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605015+0000","last_change":"2023-12-08T08:19:14.979285+0000","last_active":"2023-12-08T08:19:16.605015+0000","last_peered":"2023-12-08T08:19:16.605015+0000","last_clean":"2023-12-08T08:19:16.605015+0000","last_became_active":"2023-12-08T08:19:14.978955+0000","last_became_peered":"2023-12-08T08:19:14.978955+0000","last_unstale":"2023-12-08T08:19:16.605015+0000","last_undegraded":"2023-12-08T08:19:16.605015+0000","last_fullsized":"2023-12-08T08:19:16.605015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:23.141539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.738506+0000","last_change":"2023-12-08T08:18:53.776698+0000","last_active":"2023-12-08T08:18:56.738506+0000","last_peered":"2023-12-08T08:18:56.738506+0000","last_clean":"2023-12-08T08:18:56.738506+0000","last_became_active":"2023-12-08T08:18:53.776407+0000","last_became_peered":"2023-12-08T08:18:53.776407+0000","last_unstale":"2023-12-08T08:18:56.738506+0000","last_undegraded":"2023-12-08T08:18:56.738506+0000","last_fullsized":"2023-12-08T08:18:56.738506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:39.190015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.961306+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:19:14.961306+0000","last_peered":"2023-12-08T08:19:14.961306+0000","last_clean":"2023-12-08T08:19:14.961306+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:19:14.961306+0000","last_undegraded":"2023-12-08T08:19:14.961306+0000","last_fullsized":"2023-12-08T08:19:14.961306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:13.176435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:54.783874+0000","last_change":"2023-12-08T08:18:53.793867+0000","last_active":"2023-12-08T08:18:54.783874+0000","last_peered":"2023-12-08T08:18:54.783874+0000","last_clean":"2023-12-08T08:18:54.783874+0000","last_became_active":"2023-12-08T08:18:53.793487+0000","last_became_peered":"2023-12-08T08:18:53.793487+0000","last_unstale":"2023-12-08T08:18:54.783874+0000","last_undegraded":"2023-12-08T08:18:54.783874+0000","last_fullsized":"2023-12-08T08:18:54.783874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.773077+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:18:53.773077+0000","last_peered":"2023-12-08T08:18:53.773077+0000","last_clean":"2023-12-08T08:18:53.773077+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:18:53.773077+0000","last_undegraded":"2023-12-08T08:18:53.773077+0000","last_fullsized":"2023-12-08T08:18:53.773077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:13.890246+0000","last_change":"2023-12-08T08:19:13.890246+0000","last_active":"2023-12-08T08:19:13.890246+0000","last_peered":"2023-12-08T08:19:13.890246+0000","last_clean":"2023-12-08T08:19:13.890246+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:13.890246+0000","last_undegraded":"2023-12-08T08:19:13.890246+0000","last_fullsized":"2023-12-08T08:19:13.890246+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:55.265983+0000","last_change":"2023-12-08T08:18:53.783184+0000","last_active":"2023-12-08T08:18:55.265983+0000","last_peered":"2023-12-08T08:18:55.265983+0000","last_clean":"2023-12-08T08:18:55.265983+0000","last_became_active":"2023-12-08T08:18:53.782914+0000","last_became_peered":"2023-12-08T08:18:53.782914+0000","last_unstale":"2023-12-08T08:18:55.265983+0000","last_undegraded":"2023-12-08T08:18:55.265983+0000","last_fullsized":"2023-12-08T08:18:55.265983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:58:21.451598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.777964+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:18:53.777964+0000","last_peered":"2023-12-08T08:18:53.777964+0000","last_clean":"2023-12-08T08:18:53.777964+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:18:53.777964+0000","last_undegraded":"2023-12-08T08:18:53.777964+0000","last_fullsized":"2023-12-08T08:18:53.777964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598318+0000","last_change":"2023-12-08T08:19:14.967989+0000","last_active":"2023-12-08T08:19:16.598318+0000","last_peered":"2023-12-08T08:19:16.598318+0000","last_clean":"2023-12-08T08:19:16.598318+0000","last_became_active":"2023-12-08T08:19:14.967708+0000","last_became_peered":"2023-12-08T08:19:14.967708+0000","last_unstale":"2023-12-08T08:19:16.598318+0000","last_undegraded":"2023-12-08T08:19:16.598318+0000","last_fullsized":"2023-12-08T08:19:16.598318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:52.706874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:12.875104+0000","last_change":"2023-12-08T08:19:12.875104+0000","last_active":"2023-12-08T08:19:12.875104+0000","last_peered":"2023-12-08T08:19:12.875104+0000","last_clean":"2023-12-08T08:19:12.875104+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:12.875104+0000","last_undegraded":"2023-12-08T08:19:12.875104+0000","last_fullsized":"2023-12-08T08:19:12.875104+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.079216+0000","last_change":"2023-12-08T08:18:53.784995+0000","last_active":"2023-12-08T08:18:56.079216+0000","last_peered":"2023-12-08T08:18:56.079216+0000","last_clean":"2023-12-08T08:18:56.079216+0000","last_became_active":"2023-12-08T08:18:53.784770+0000","last_became_peered":"2023-12-08T08:18:53.784770+0000","last_unstale":"2023-12-08T08:18:56.079216+0000","last_undegraded":"2023-12-08T08:18:56.079216+0000","last_fullsized":"2023-12-08T08:18:56.079216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:48:54.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-08T08:18:53.752913+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:18:53.752913+0000","last_peered":"2023-12-08T08:18:53.752913+0000","last_clean":"2023-12-08T08:18:53.752913+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:18:53.752913+0000","last_undegraded":"2023-12-08T08:18:53.752913+0000","last_fullsized":"2023-12-08T08:18:53.752913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:56:14.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-08T08:18:56.078585+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:18:56.078585+0000","last_peered":"2023-12-08T08:18:56.078585+0000","last_clean":"2023-12-08T08:18:56.078585+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:18:56.078585+0000","last_undegraded":"2023-12-08T08:18:56.078585+0000","last_fullsized":"2023-12-08T08:18:56.078585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":4,"acting":4,"num_store_stats":1},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542198,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1572864,"data_stored":1042716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.298},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.099,"15min":1.0840000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.823,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.1339999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.66900000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6599999999999999,"5min":1.794,"15min":1.794},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2090000000000001,"15min":1.2350000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8680000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.349},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6639999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.401}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2989999999999999,"15min":1.3240000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.077,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.367,"15min":1.4059999999999999},"min":{"1min":0.76200000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.728,"5min":3.524,"15min":3.524},"last":1.702}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.367,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.246},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.365,"15min":1.355},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.974,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5820000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.4950000000000001,"15min":1.45},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.484},{"interface":"front","average":{"1min":1.544,"5min":1.5229999999999999,"15min":1.5089999999999999},"min":{"1min":0.71899999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.758,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.7490000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.6279999999999999,"15min":1.6519999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7360000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.641},{"interface":"front","average":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":0.748,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.347,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.819}]}]},{"osd":6,"up_from":14,"seq":60129542198,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":991232,"data_stored":456003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.444,"15min":1.7549999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.6319999999999997,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.367},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4910000000000001,"15min":1.8600000000000001},"min":{"1min":0.749,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.835,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.0920000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.179,"15min":1.127},"min":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.5620000000000003,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.24},{"interface":"front","average":{"1min":1.431,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.82399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":7.2539999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.2490000000000001,"15min":1.2450000000000001},"min":{"1min":0.754,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.296,"15min":1.276},"min":{"1min":0.83599999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.3140000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.319,"15min":1.399},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.8919999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.149},{"interface":"front","average":{"1min":1.528,"5min":1.347,"15min":1.385},"min":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.6150000000000002,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.1890000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.3620000000000001,"15min":1.3560000000000001},"min":{"1min":0.87,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.4370000000000003,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.415},{"interface":"front","average":{"1min":1.544,"5min":1.4059999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.0430000000000001,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4450000000000001,"15min":1.486},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":8.0039999999999996,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.034},{"interface":"front","average":{"1min":1.496,"5min":1.4890000000000001,"15min":1.4910000000000001},"min":{"1min":0.95699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.468}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5029999999999999,"15min":1.492},"min":{"1min":0.99199999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":7.1989999999999998,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.776,"5min":1.579,"15min":1.609},"min":{"1min":1.0800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":8.532,"5min":8.532,"15min":8.532},"last":1.3340000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542199,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":482163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98799999999999999,"15min":0.95699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8100000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0549999999999999,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.0800000000000001,"15min":1.0229999999999999},"min":{"1min":0.73299999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8049999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.641},{"interface":"front","average":{"1min":1.046,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.53300000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.5,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1859999999999999,"15min":1.1899999999999999},"min":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.1970000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3260000000000001,"15min":1.3460000000000001},"min":{"1min":0.95999999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":1.96,"15min":1.96},"last":1.095},{"interface":"front","average":{"1min":1.383,"5min":1.4019999999999999,"15min":1.4219999999999999},"min":{"1min":0.88800000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.96,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4550000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2549999999999999,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.665,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.165},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":0.80300000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.2490000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.411,"15min":1.403},"min":{"1min":0.73599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.393,"15min":1.421},"min":{"1min":0.84299999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.7549999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.514,"15min":1.4790000000000001},"min":{"1min":0.86499999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4950000000000001,"5min":3.242,"15min":3.242},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.536,"15min":1.518},"min":{"1min":0.82399999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.704}]}]},{"osd":4,"up_from":14,"seq":60129542198,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":452452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.72699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.54,"5min":1.776,"15min":1.776},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.042,"5min":1.109,"15min":1.143},"min":{"1min":0.65400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.335,"15min":2.335},"last":0.877}]},{"osd":1,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.86699999999999999,"5min":0.626,"15min":0.626},"max":{"1min":1.5109999999999999,"5min":1.958,"15min":1.958},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.76500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6040000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.96899999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2050000000000001,"15min":1.2370000000000001},"min":{"1min":0.80600000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9319999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3580000000000001,"15min":1.397},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8200000000000001,"5min":2.456,"15min":2.456},"last":1.2829999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.232,"15min":1.218},"min":{"1min":0.82299999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8080000000000001,"5min":1.871,"15min":1.871},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.327,"15min":1.3129999999999999},"min":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.831,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.599}]},{"osd":5,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.4059999999999999,"15min":1.4630000000000001},"min":{"1min":0.94099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.669,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.075},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.361,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.798,"5min":2.137,"15min":2.137},"last":1.141}]},{"osd":6,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.407,"15min":1.4830000000000001},"min":{"1min":0.84299999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9350000000000001,"5min":3.016,"15min":3.016},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.5029999999999999,"15min":1.5660000000000001},"min":{"1min":0.93000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.802,"5min":2.54,"15min":2.54},"last":1.3759999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5229999999999999,"15min":1.581},"min":{"1min":1.0660000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7709999999999999,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.609,"15min":1.669},"min":{"1min":1.1599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":2.1200000000000001,"5min":3.141,"15min":3.141},"last":1.7509999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.89400000000000002,"15min":0.94499999999999995},"min":{"1min":0.47899999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2490000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.95299999999999996,"15min":1.0189999999999999},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.484,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96199999999999997,"15min":0.98199999999999998},"min":{"1min":0.51900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5369999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.28},{"interface":"front","average":{"1min":1.004,"5min":1.079,"15min":1.1140000000000001},"min":{"1min":0.60899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6479999999999999,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.375}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8149999999999999,"5min":2.121,"15min":2.121},"last":1.004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.165},"min":{"1min":0.60499999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.6870000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.83399999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8420000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.423},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3360000000000001,"15min":1.361},"min":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8640000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.4790000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.401,"15min":1.4750000000000001},"min":{"1min":0.97199999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.8100000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.9019999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":0.79300000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.919,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4330000000000001,"15min":1.4450000000000001},"min":{"1min":0.85299999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9470000000000001,"5min":2.25,"15min":2.25},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.49,"15min":1.5620000000000001},"min":{"1min":0.83299999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.8180000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.9710000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.448,"15min":1.48},"min":{"1min":0.85299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9299999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.532},{"interface":"front","average":{"1min":1.595,"5min":1.5580000000000001,"15min":1.605},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0649999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6579999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":452292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.772,"5min":1.948,"15min":1.948},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95099999999999996,"15min":0.90700000000000003},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4370000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.546,"5min":2.996,"15min":2.996},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.0049999999999999,"15min":0.96899999999999997},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.9390000000000001,"5min":2.238,"15min":2.238},"last":0.77500000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0389999999999999,"15min":1.0049999999999999},"min":{"1min":0.68500000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.6819999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.0920000000000001,"15min":1.0620000000000001},"min":{"1min":0.68200000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.718,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.4239999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.82899999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9359999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.353},{"interface":"front","average":{"1min":1.367,"5min":1.3600000000000001,"15min":1.389},"min":{"1min":0.86299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8819999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.093}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3799999999999999,"15min":1.3779999999999999},"min":{"1min":0.99399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3530000000000002,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.401,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.1080000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.266}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4239999999999999,"15min":1.4299999999999999},"min":{"1min":0.78400000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3140000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.522,"5min":1.425,"15min":1.421},"min":{"1min":0.92400000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.665}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4950000000000001,"15min":1.4710000000000001},"min":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.0760000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.486},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.516,"15min":1.51},"min":{"1min":1.0149999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2549999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.5189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":452362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.179}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":0.95199999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.038},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":0.873}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.753}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.107},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.3420000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1589248,"data_stored":1046473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86599999999999999,"15min":0.86699999999999999},"min":{"1min":0.503,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.369,"5min":2.194,"15min":2.194},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.56000000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6619999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.88400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.099,"15min":1.151},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4930000000000001,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.276},{"interface":"front","average":{"1min":1.01,"5min":1.0960000000000001,"15min":1.1579999999999999},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3280000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1,"15min":1.091},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4059999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":1.494},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2410000000000001,"15min":1.2969999999999999},"min":{"1min":0.61099999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.9490000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.5369999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.391,"15min":1.4810000000000001},"min":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.712,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.03},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.264,"15min":1.325},"min":{"1min":0.85099999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.353}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.365,"15min":1.431},"min":{"1min":0.873,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.669},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.389,"15min":1.401},"min":{"1min":0.79400000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.5980000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5009999999999999,"15min":1.5349999999999999},"min":{"1min":1.1200000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.831,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.585},"min":{"1min":0.86499999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7989999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.627}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5549999999999999,"15min":1.6499999999999999},"min":{"1min":1.0669999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.0920000000000001,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.413},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4770000000000001,"15min":1.542},"min":{"1min":0.76800000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.804,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:19.555 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.818+0000 7fe0ecab4640 1 Processor -- start 2023-12-08T08:19:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.818+0000 7fe0ecab4640 1 -- start start 2023-12-08T08:19:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.819+0000 7fe0ecab4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0e80c16a0 0x7fe0e80aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.819+0000 7fe0ecab4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8154850 con 0x7fe0e814e840 2023-12-08T08:19:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.819+0000 7fe0ecab4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e8154b30 con 0x7fe0e80c1210 2023-12-08T08:19:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.819+0000 7fe0ecab4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e814ec20 con 0x7fe0e80c16a0 2023-12-08T08:19:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe0e814e840 0x7fe0e8151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52542/0 (socket says 172.21.15.45:52542) 2023-12-08T08:19:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e77fe640 1 -- 172.21.15.45:0/3336113792 learned_addr learned my addr 172.21.15.45:0/3336113792 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e7fff640 1 --2- 172.21.15.45:0/3336113792 >> v2:172.21.15.45:3300/0 conn(0x7fe0e80c16a0 0x7fe0e80aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e67fc640 1 -- 172.21.15.45:0/3336113792 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828042510 0 0) 0x7fe0e8154850 con 0x7fe0e814e840 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e67fc640 1 -- 172.21.15.45:0/3336113792 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d0003520 con 0x7fe0e814e840 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e7fff640 1 -- 172.21.15.45:0/3336113792 >> v1:172.21.15.114:6789/0 conn(0x7fe0e80c1210 legacy=0x7fe0e80a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e7fff640 1 -- 172.21.15.45:0/3336113792 >> v1:172.21.15.45:6789/0 conn(0x7fe0e814e840 legacy=0x7fe0e8151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.820+0000 7fe0e7fff640 1 -- 172.21.15.45:0/3336113792 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8154e10 con 0x7fe0e80c16a0 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.821+0000 7fe0e7fff640 1 --2- 172.21.15.45:0/3336113792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80aa590 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009d90 tx=0x7fe0e002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326331dad330314a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.822+0000 7fe0e67fc640 1 -- 172.21.15.45:0/3336113792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e002cbd0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.822+0000 7fe0e67fc640 1 -- 172.21.15.45:0/3336113792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e002cd30 con 0x7fe0e80c16a0 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.822+0000 7fe0e67fc640 1 -- 172.21.15.45:0/3336113792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e002cea0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.822+0000 7fe0ecab4640 1 -- 172.21.15.45:0/3336113792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 msgr2=0x7fe0e80aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.822+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/3336113792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80aa590 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009d90 tx=0x7fe0e002be20 comp rx=0 tx=0).stop 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.823+0000 7fe0ecab4640 1 -- 172.21.15.45:0/3336113792 shutdown_connections 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.823+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/3336113792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80aa590 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.823+0000 7fe0ecab4640 1 -- 172.21.15.45:0/3336113792 >> 172.21.15.45:0/3336113792 conn(0x7fe0e80c5780 msgr2=0x7fe0e80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.823+0000 7fe0ecab4640 1 -- 172.21.15.45:0/3336113792 shutdown_connections 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.823+0000 7fe0ecab4640 1 -- 172.21.15.45:0/3336113792 wait complete. 2023-12-08T08:19:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.825+0000 7fe0ecab4640 1 Processor -- start 2023-12-08T08:19:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.825+0000 7fe0ecab4640 1 -- start start 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 0x7fe0e81ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e814e840 0x7fe0e81e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e814d650 con 0x7fe0e80c16a0 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e81ee090 con 0x7fe0e814e840 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.826+0000 7fe0ecab4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c3340 con 0x7fe0e80c1210 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33924/0 (socket says 172.21.15.45:33924) 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 -- 172.21.15.45:0/2517373579 learned_addr learned my addr 172.21.15.45:0/2517373579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 -- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 msgr2=0x7fe0e81ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e77fe640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 0x7fe0e81ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e7fff640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e814e840 0x7fe0e81e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 0x7fe0e81ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 -- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e814e840 msgr2=0x7fe0e81e9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e814e840 0x7fe0e81e9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 -- 172.21.15.45:0/2517373579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009a70 con 0x7fe0e80c16a0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e77fe640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 0x7fe0e81ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.827+0000 7fe0e6ffd640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c440 tx=0x7fe0dc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.828+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc005480 con 0x7fe0e80c16a0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.828+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0035f0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.828+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e814f040 con 0x7fe0e80c16a0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.828+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0039c0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.828+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80c2e20 con 0x7fe0e80c16a0 2023-12-08T08:19:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.829+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e80743e0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.830+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0dc003b20 con 0x7fe0e80c16a0 2023-12-08T08:19:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.831+0000 7fe0cffff640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 0x7fe0d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.831+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe0dc088cd0 con 0x7fe0e80c16a0 2023-12-08T08:19:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.831+0000 7fe0e77fe640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 0x7fe0d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.832+0000 7fe0e77fe640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 0x7fe0d406d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8007fd0 tx=0x7fe0d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:19.836+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0dc0538d0 con 0x7fe0e80c16a0 2023-12-08T08:19:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.028+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0e80c1af0 con 0x7fe0d406ae40 2023-12-08T08:19:20.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.045+0000 7fe0cffff640 1 -- 172.21.15.45:0/2517373579 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525784 (secure 0 0 0) 0x7fe0e80c1af0 con 0x7fe0d406ae40 2023-12-08T08:19:20.056 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:19:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 msgr2=0x7fe0d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 0x7fe0d406d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8007fd0 tx=0x7fe0d8009040 comp rx=0 tx=0).stop 2023-12-08T08:19:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 msgr2=0x7fe0e80c4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c440 tx=0x7fe0dc00c900 comp rx=0 tx=0).stop 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 shutdown_connections 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0d406ae40 0x7fe0d406d300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e814e840 0x7fe0e81e9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0e80c16a0 0x7fe0e80c4960 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 --2- 172.21.15.45:0/2517373579 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe0e80c1210 0x7fe0e81ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 >> 172.21.15.45:0/2517373579 conn(0x7fe0e80c5780 msgr2=0x7fe0e8072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.054+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 shutdown_connections 2023-12-08T08:19:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.055+0000 7fe0ecab4640 1 -- 172.21.15.45:0/2517373579 wait complete. 2023-12-08T08:19:20.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2023-12-08T08:19:19.790093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":252,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":357,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254536,"kb_used_data":9256,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720184,"statfs":{"total":773094113280,"available":772833468416,"internally_reserved":0,"allocated":9478144,"data_stored":5050670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002355"},"pg_stats":[{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599617+0000","last_change":"2023-12-08T08:19:14.966991+0000","last_active":"2023-12-08T08:19:16.599617+0000","last_peered":"2023-12-08T08:19:16.599617+0000","last_clean":"2023-12-08T08:19:16.599617+0000","last_became_active":"2023-12-08T08:19:14.966672+0000","last_became_peered":"2023-12-08T08:19:14.966672+0000","last_unstale":"2023-12-08T08:19:16.599617+0000","last_undegraded":"2023-12-08T08:19:16.599617+0000","last_fullsized":"2023-12-08T08:19:16.599617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:12.457958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.950847+0000","last_change":"2023-12-08T08:18:53.772671+0000","last_active":"2023-12-08T08:19:14.950847+0000","last_peered":"2023-12-08T08:19:14.950847+0000","last_clean":"2023-12-08T08:19:14.950847+0000","last_became_active":"2023-12-08T08:18:53.772403+0000","last_became_peered":"2023-12-08T08:18:53.772403+0000","last_unstale":"2023-12-08T08:19:14.950847+0000","last_undegraded":"2023-12-08T08:19:14.950847+0000","last_fullsized":"2023-12-08T08:19:14.950847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:49.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600721+0000","last_change":"2023-12-08T08:19:14.964048+0000","last_active":"2023-12-08T08:19:16.600721+0000","last_peered":"2023-12-08T08:19:16.600721+0000","last_clean":"2023-12-08T08:19:16.600721+0000","last_became_active":"2023-12-08T08:19:14.963756+0000","last_became_peered":"2023-12-08T08:19:14.963756+0000","last_unstale":"2023-12-08T08:19:16.600721+0000","last_undegraded":"2023-12-08T08:19:16.600721+0000","last_fullsized":"2023-12-08T08:19:16.600721+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:01.932233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960709+0000","last_change":"2023-12-08T08:18:53.783694+0000","last_active":"2023-12-08T08:19:14.960709+0000","last_peered":"2023-12-08T08:19:14.960709+0000","last_clean":"2023-12-08T08:19:14.960709+0000","last_became_active":"2023-12-08T08:18:53.782993+0000","last_became_peered":"2023-12-08T08:18:53.782993+0000","last_unstale":"2023-12-08T08:19:14.960709+0000","last_undegraded":"2023-12-08T08:19:14.960709+0000","last_fullsized":"2023-12-08T08:19:14.960709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.606000+0000","last_change":"2023-12-08T08:19:14.969867+0000","last_active":"2023-12-08T08:19:16.606000+0000","last_peered":"2023-12-08T08:19:16.606000+0000","last_clean":"2023-12-08T08:19:16.606000+0000","last_became_active":"2023-12-08T08:19:14.969223+0000","last_became_peered":"2023-12-08T08:19:14.969223+0000","last_unstale":"2023-12-08T08:19:16.606000+0000","last_undegraded":"2023-12-08T08:19:16.606000+0000","last_fullsized":"2023-12-08T08:19:16.606000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:24.573846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.952286+0000","last_change":"2023-12-08T08:18:53.786844+0000","last_active":"2023-12-08T08:19:14.952286+0000","last_peered":"2023-12-08T08:19:14.952286+0000","last_clean":"2023-12-08T08:19:14.952286+0000","last_became_active":"2023-12-08T08:18:53.786534+0000","last_became_peered":"2023-12-08T08:18:53.786534+0000","last_unstale":"2023-12-08T08:19:14.952286+0000","last_undegraded":"2023-12-08T08:19:14.952286+0000","last_fullsized":"2023-12-08T08:19:14.952286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:49:41.159908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.962948+0000","last_change":"2023-12-08T08:19:14.975118+0000","last_active":"2023-12-08T08:19:15.962948+0000","last_peered":"2023-12-08T08:19:15.962948+0000","last_clean":"2023-12-08T08:19:15.962948+0000","last_became_active":"2023-12-08T08:19:14.974820+0000","last_became_peered":"2023-12-08T08:19:14.974820+0000","last_unstale":"2023-12-08T08:19:15.962948+0000","last_undegraded":"2023-12-08T08:19:15.962948+0000","last_fullsized":"2023-12-08T08:19:15.962948+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:22.450691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.934849+0000","last_change":"2023-12-08T08:18:53.789128+0000","last_active":"2023-12-08T08:19:14.934849+0000","last_peered":"2023-12-08T08:19:14.934849+0000","last_clean":"2023-12-08T08:19:14.934849+0000","last_became_active":"2023-12-08T08:18:53.788783+0000","last_became_peered":"2023-12-08T08:18:53.788783+0000","last_unstale":"2023-12-08T08:19:14.934849+0000","last_undegraded":"2023-12-08T08:19:14.934849+0000","last_fullsized":"2023-12-08T08:19:14.934849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:26:07.559242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604541+0000","last_change":"2023-12-08T08:19:14.971606+0000","last_active":"2023-12-08T08:19:16.604541+0000","last_peered":"2023-12-08T08:19:16.604541+0000","last_clean":"2023-12-08T08:19:16.604541+0000","last_became_active":"2023-12-08T08:19:14.971304+0000","last_became_peered":"2023-12-08T08:19:14.971304+0000","last_unstale":"2023-12-08T08:19:16.604541+0000","last_undegraded":"2023-12-08T08:19:16.604541+0000","last_fullsized":"2023-12-08T08:19:16.604541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:22.450691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941699+0000","last_change":"2023-12-08T08:18:53.789378+0000","last_active":"2023-12-08T08:19:14.941699+0000","last_peered":"2023-12-08T08:19:14.941699+0000","last_clean":"2023-12-08T08:19:14.941699+0000","last_became_active":"2023-12-08T08:18:53.789113+0000","last_became_peered":"2023-12-08T08:18:53.789113+0000","last_unstale":"2023-12-08T08:19:14.941699+0000","last_undegraded":"2023-12-08T08:19:14.941699+0000","last_fullsized":"2023-12-08T08:19:14.941699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:31.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603686+0000","last_change":"2023-12-08T08:19:14.975274+0000","last_active":"2023-12-08T08:19:16.603686+0000","last_peered":"2023-12-08T08:19:16.603686+0000","last_clean":"2023-12-08T08:19:16.603686+0000","last_became_active":"2023-12-08T08:19:14.974993+0000","last_became_peered":"2023-12-08T08:19:14.974993+0000","last_unstale":"2023-12-08T08:19:16.603686+0000","last_undegraded":"2023-12-08T08:19:16.603686+0000","last_fullsized":"2023-12-08T08:19:16.603686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:06.814028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942366+0000","last_change":"2023-12-08T08:18:53.796019+0000","last_active":"2023-12-08T08:19:14.942366+0000","last_peered":"2023-12-08T08:19:14.942366+0000","last_clean":"2023-12-08T08:19:14.942366+0000","last_became_active":"2023-12-08T08:18:53.788065+0000","last_became_peered":"2023-12-08T08:18:53.788065+0000","last_unstale":"2023-12-08T08:19:14.942366+0000","last_undegraded":"2023-12-08T08:19:14.942366+0000","last_fullsized":"2023-12-08T08:19:14.942366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.964886+0000","last_change":"2023-12-08T08:19:14.975411+0000","last_active":"2023-12-08T08:19:15.964886+0000","last_peered":"2023-12-08T08:19:15.964886+0000","last_clean":"2023-12-08T08:19:15.964886+0000","last_became_active":"2023-12-08T08:19:14.974859+0000","last_became_peered":"2023-12-08T08:19:14.974859+0000","last_unstale":"2023-12-08T08:19:15.964886+0000","last_undegraded":"2023-12-08T08:19:15.964886+0000","last_fullsized":"2023-12-08T08:19:15.964886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:16:06.814028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.954011+0000","last_change":"2023-12-08T08:18:53.793006+0000","last_active":"2023-12-08T08:19:14.954011+0000","last_peered":"2023-12-08T08:19:14.954011+0000","last_clean":"2023-12-08T08:19:14.954011+0000","last_became_active":"2023-12-08T08:18:53.792739+0000","last_became_peered":"2023-12-08T08:18:53.792739+0000","last_unstale":"2023-12-08T08:19:14.954011+0000","last_undegraded":"2023-12-08T08:19:14.954011+0000","last_fullsized":"2023-12-08T08:19:14.954011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:16.681517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.964626+0000","last_change":"2023-12-08T08:19:14.982643+0000","last_active":"2023-12-08T08:19:15.964626+0000","last_peered":"2023-12-08T08:19:15.964626+0000","last_clean":"2023-12-08T08:19:15.964626+0000","last_became_active":"2023-12-08T08:19:14.979304+0000","last_became_peered":"2023-12-08T08:19:14.979304+0000","last_unstale":"2023-12-08T08:19:15.964626+0000","last_undegraded":"2023-12-08T08:19:15.964626+0000","last_fullsized":"2023-12-08T08:19:15.964626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:35.068536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.933922+0000","last_change":"2023-12-08T08:18:53.791174+0000","last_active":"2023-12-08T08:19:14.933922+0000","last_peered":"2023-12-08T08:19:14.933922+0000","last_clean":"2023-12-08T08:19:14.933922+0000","last_became_active":"2023-12-08T08:18:53.788909+0000","last_became_peered":"2023-12-08T08:18:53.788909+0000","last_unstale":"2023-12-08T08:19:14.933922+0000","last_undegraded":"2023-12-08T08:19:14.933922+0000","last_fullsized":"2023-12-08T08:19:14.933922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:49:42.248379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.957322+0000","last_change":"2023-12-08T08:19:14.971395+0000","last_active":"2023-12-08T08:19:15.957322+0000","last_peered":"2023-12-08T08:19:15.957322+0000","last_clean":"2023-12-08T08:19:15.957322+0000","last_became_active":"2023-12-08T08:19:14.968585+0000","last_became_peered":"2023-12-08T08:19:14.968585+0000","last_unstale":"2023-12-08T08:19:15.957322+0000","last_undegraded":"2023-12-08T08:19:15.957322+0000","last_fullsized":"2023-12-08T08:19:15.957322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:00:22.408111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943949+0000","last_change":"2023-12-08T08:18:53.786983+0000","last_active":"2023-12-08T08:19:14.943949+0000","last_peered":"2023-12-08T08:19:14.943949+0000","last_clean":"2023-12-08T08:19:14.943949+0000","last_became_active":"2023-12-08T08:18:53.786722+0000","last_became_peered":"2023-12-08T08:18:53.786722+0000","last_unstale":"2023-12-08T08:19:14.943949+0000","last_undegraded":"2023-12-08T08:19:14.943949+0000","last_fullsized":"2023-12-08T08:19:14.943949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599161+0000","last_change":"2023-12-08T08:19:14.950812+0000","last_active":"2023-12-08T08:19:16.599161+0000","last_peered":"2023-12-08T08:19:16.599161+0000","last_clean":"2023-12-08T08:19:16.599161+0000","last_became_active":"2023-12-08T08:19:14.950489+0000","last_became_peered":"2023-12-08T08:19:14.950489+0000","last_unstale":"2023-12-08T08:19:16.599161+0000","last_undegraded":"2023-12-08T08:19:16.599161+0000","last_fullsized":"2023-12-08T08:19:16.599161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:03.757795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.948803+0000","last_change":"2023-12-08T08:18:53.789804+0000","last_active":"2023-12-08T08:19:14.948803+0000","last_peered":"2023-12-08T08:19:14.948803+0000","last_clean":"2023-12-08T08:19:14.948803+0000","last_became_active":"2023-12-08T08:18:53.786215+0000","last_became_peered":"2023-12-08T08:18:53.786215+0000","last_unstale":"2023-12-08T08:19:14.948803+0000","last_undegraded":"2023-12-08T08:19:14.948803+0000","last_fullsized":"2023-12-08T08:19:14.948803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:32:51.622019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605297+0000","last_change":"2023-12-08T08:19:14.970090+0000","last_active":"2023-12-08T08:19:16.605297+0000","last_peered":"2023-12-08T08:19:16.605297+0000","last_clean":"2023-12-08T08:19:16.605297+0000","last_became_active":"2023-12-08T08:19:14.969591+0000","last_became_peered":"2023-12-08T08:19:14.969591+0000","last_unstale":"2023-12-08T08:19:16.605297+0000","last_undegraded":"2023-12-08T08:19:16.605297+0000","last_fullsized":"2023-12-08T08:19:16.605297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:35.345731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943087+0000","last_change":"2023-12-08T08:18:53.782075+0000","last_active":"2023-12-08T08:19:14.943087+0000","last_peered":"2023-12-08T08:19:14.943087+0000","last_clean":"2023-12-08T08:19:14.943087+0000","last_became_active":"2023-12-08T08:18:53.775721+0000","last_became_peered":"2023-12-08T08:18:53.775721+0000","last_unstale":"2023-12-08T08:19:14.943087+0000","last_undegraded":"2023-12-08T08:19:14.943087+0000","last_fullsized":"2023-12-08T08:19:14.943087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600834+0000","last_change":"2023-12-08T08:19:14.973029+0000","last_active":"2023-12-08T08:19:16.600834+0000","last_peered":"2023-12-08T08:19:16.600834+0000","last_clean":"2023-12-08T08:19:16.600834+0000","last_became_active":"2023-12-08T08:19:14.972734+0000","last_became_peered":"2023-12-08T08:19:14.972734+0000","last_unstale":"2023-12-08T08:19:16.600834+0000","last_undegraded":"2023-12-08T08:19:16.600834+0000","last_fullsized":"2023-12-08T08:19:16.600834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:10:20.091249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.944023+0000","last_change":"2023-12-08T08:18:53.776155+0000","last_active":"2023-12-08T08:19:14.944023+0000","last_peered":"2023-12-08T08:19:14.944023+0000","last_clean":"2023-12-08T08:19:14.944023+0000","last_became_active":"2023-12-08T08:18:53.775833+0000","last_became_peered":"2023-12-08T08:18:53.775833+0000","last_unstale":"2023-12-08T08:19:14.944023+0000","last_undegraded":"2023-12-08T08:19:14.944023+0000","last_fullsized":"2023-12-08T08:19:14.944023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:38:57.738584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.957635+0000","last_change":"2023-12-08T08:19:14.980998+0000","last_active":"2023-12-08T08:19:15.957635+0000","last_peered":"2023-12-08T08:19:15.957635+0000","last_clean":"2023-12-08T08:19:15.957635+0000","last_became_active":"2023-12-08T08:19:14.980660+0000","last_became_peered":"2023-12-08T08:19:14.980660+0000","last_unstale":"2023-12-08T08:19:15.957635+0000","last_undegraded":"2023-12-08T08:19:15.957635+0000","last_fullsized":"2023-12-08T08:19:15.957635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:16:29.713852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.935963+0000","last_change":"2023-12-08T08:18:53.787632+0000","last_active":"2023-12-08T08:19:14.935963+0000","last_peered":"2023-12-08T08:19:14.935963+0000","last_clean":"2023-12-08T08:19:14.935963+0000","last_became_active":"2023-12-08T08:18:53.787135+0000","last_became_peered":"2023-12-08T08:18:53.787135+0000","last_unstale":"2023-12-08T08:19:14.935963+0000","last_undegraded":"2023-12-08T08:19:14.935963+0000","last_fullsized":"2023-12-08T08:19:14.935963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:51:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.963890+0000","last_change":"2023-12-08T08:19:14.970691+0000","last_active":"2023-12-08T08:19:15.963890+0000","last_peered":"2023-12-08T08:19:15.963890+0000","last_clean":"2023-12-08T08:19:15.963890+0000","last_became_active":"2023-12-08T08:19:14.970339+0000","last_became_peered":"2023-12-08T08:19:14.970339+0000","last_unstale":"2023-12-08T08:19:15.963890+0000","last_undegraded":"2023-12-08T08:19:15.963890+0000","last_fullsized":"2023-12-08T08:19:15.963890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:40.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.940670+0000","last_change":"2023-12-08T08:18:53.771818+0000","last_active":"2023-12-08T08:19:14.940670+0000","last_peered":"2023-12-08T08:19:14.940670+0000","last_clean":"2023-12-08T08:19:14.940670+0000","last_became_active":"2023-12-08T08:18:53.771528+0000","last_became_peered":"2023-12-08T08:18:53.771528+0000","last_unstale":"2023-12-08T08:19:14.940670+0000","last_undegraded":"2023-12-08T08:19:14.940670+0000","last_fullsized":"2023-12-08T08:19:14.940670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.959175+0000","last_change":"2023-12-08T08:19:14.978970+0000","last_active":"2023-12-08T08:19:15.959175+0000","last_peered":"2023-12-08T08:19:15.959175+0000","last_clean":"2023-12-08T08:19:15.959175+0000","last_became_active":"2023-12-08T08:19:14.978423+0000","last_became_peered":"2023-12-08T08:19:14.978423+0000","last_unstale":"2023-12-08T08:19:15.959175+0000","last_undegraded":"2023-12-08T08:19:15.959175+0000","last_fullsized":"2023-12-08T08:19:15.959175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:20.780616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.933482+0000","last_change":"2023-12-08T08:18:53.782986+0000","last_active":"2023-12-08T08:19:14.933482+0000","last_peered":"2023-12-08T08:19:14.933482+0000","last_clean":"2023-12-08T08:19:14.933482+0000","last_became_active":"2023-12-08T08:18:53.782641+0000","last_became_peered":"2023-12-08T08:18:53.782641+0000","last_unstale":"2023-12-08T08:19:14.933482+0000","last_undegraded":"2023-12-08T08:19:14.933482+0000","last_fullsized":"2023-12-08T08:19:14.933482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:07:35.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603177+0000","last_change":"2023-12-08T08:19:14.972433+0000","last_active":"2023-12-08T08:19:16.603177+0000","last_peered":"2023-12-08T08:19:16.603177+0000","last_clean":"2023-12-08T08:19:16.603177+0000","last_became_active":"2023-12-08T08:19:14.972085+0000","last_became_peered":"2023-12-08T08:19:14.972085+0000","last_unstale":"2023-12-08T08:19:16.603177+0000","last_undegraded":"2023-12-08T08:19:16.603177+0000","last_fullsized":"2023-12-08T08:19:16.603177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:40.829289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941822+0000","last_change":"2023-12-08T08:18:53.783616+0000","last_active":"2023-12-08T08:19:14.941822+0000","last_peered":"2023-12-08T08:19:14.941822+0000","last_clean":"2023-12-08T08:19:14.941822+0000","last_became_active":"2023-12-08T08:18:53.783322+0000","last_became_peered":"2023-12-08T08:18:53.783322+0000","last_unstale":"2023-12-08T08:19:14.941822+0000","last_undegraded":"2023-12-08T08:19:14.941822+0000","last_fullsized":"2023-12-08T08:19:14.941822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:45.651039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598882+0000","last_change":"2023-12-08T08:19:14.971508+0000","last_active":"2023-12-08T08:19:16.598882+0000","last_peered":"2023-12-08T08:19:16.598882+0000","last_clean":"2023-12-08T08:19:16.598882+0000","last_became_active":"2023-12-08T08:19:14.971215+0000","last_became_peered":"2023-12-08T08:19:14.971215+0000","last_unstale":"2023-12-08T08:19:16.598882+0000","last_undegraded":"2023-12-08T08:19:16.598882+0000","last_fullsized":"2023-12-08T08:19:16.598882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:31.047217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943688+0000","last_change":"2023-12-08T08:18:53.795881+0000","last_active":"2023-12-08T08:19:14.943688+0000","last_peered":"2023-12-08T08:19:14.943688+0000","last_clean":"2023-12-08T08:19:14.943688+0000","last_became_active":"2023-12-08T08:18:53.795563+0000","last_became_peered":"2023-12-08T08:18:53.795563+0000","last_unstale":"2023-12-08T08:19:14.943688+0000","last_undegraded":"2023-12-08T08:19:14.943688+0000","last_fullsized":"2023-12-08T08:19:14.943688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:59.236997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598546+0000","last_change":"2023-12-08T08:19:14.964068+0000","last_active":"2023-12-08T08:19:16.598546+0000","last_peered":"2023-12-08T08:19:16.598546+0000","last_clean":"2023-12-08T08:19:16.598546+0000","last_became_active":"2023-12-08T08:19:14.963776+0000","last_became_peered":"2023-12-08T08:19:14.963776+0000","last_unstale":"2023-12-08T08:19:16.598546+0000","last_undegraded":"2023-12-08T08:19:16.598546+0000","last_fullsized":"2023-12-08T08:19:16.598546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:50:19.925566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.949684+0000","last_change":"2023-12-08T08:18:53.783723+0000","last_active":"2023-12-08T08:19:14.949684+0000","last_peered":"2023-12-08T08:19:14.949684+0000","last_clean":"2023-12-08T08:19:14.949684+0000","last_became_active":"2023-12-08T08:18:53.783415+0000","last_became_peered":"2023-12-08T08:18:53.783415+0000","last_unstale":"2023-12-08T08:19:14.949684+0000","last_undegraded":"2023-12-08T08:19:14.949684+0000","last_fullsized":"2023-12-08T08:19:14.949684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:52.604642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600021+0000","last_change":"2023-12-08T08:19:14.976532+0000","last_active":"2023-12-08T08:19:16.600021+0000","last_peered":"2023-12-08T08:19:16.600021+0000","last_clean":"2023-12-08T08:19:16.600021+0000","last_became_active":"2023-12-08T08:19:14.976236+0000","last_became_peered":"2023-12-08T08:19:14.976236+0000","last_unstale":"2023-12-08T08:19:16.600021+0000","last_undegraded":"2023-12-08T08:19:16.600021+0000","last_fullsized":"2023-12-08T08:19:16.600021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:11.351864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943288+0000","last_change":"2023-12-08T08:18:53.784426+0000","last_active":"2023-12-08T08:19:14.943288+0000","last_peered":"2023-12-08T08:19:14.943288+0000","last_clean":"2023-12-08T08:19:14.943288+0000","last_became_active":"2023-12-08T08:18:53.774174+0000","last_became_peered":"2023-12-08T08:18:53.774174+0000","last_unstale":"2023-12-08T08:19:14.943288+0000","last_undegraded":"2023-12-08T08:19:14.943288+0000","last_fullsized":"2023-12-08T08:19:14.943288+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599634+0000","last_change":"2023-12-08T08:19:14.967559+0000","last_active":"2023-12-08T08:19:16.599634+0000","last_peered":"2023-12-08T08:19:16.599634+0000","last_clean":"2023-12-08T08:19:16.599634+0000","last_became_active":"2023-12-08T08:19:14.967072+0000","last_became_peered":"2023-12-08T08:19:14.967072+0000","last_unstale":"2023-12-08T08:19:16.599634+0000","last_undegraded":"2023-12-08T08:19:16.599634+0000","last_fullsized":"2023-12-08T08:19:16.599634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:54.012535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.934959+0000","last_change":"2023-12-08T08:18:53.775530+0000","last_active":"2023-12-08T08:19:14.934959+0000","last_peered":"2023-12-08T08:19:14.934959+0000","last_clean":"2023-12-08T08:19:14.934959+0000","last_became_active":"2023-12-08T08:18:53.775237+0000","last_became_peered":"2023-12-08T08:18:53.775237+0000","last_unstale":"2023-12-08T08:19:14.934959+0000","last_undegraded":"2023-12-08T08:19:14.934959+0000","last_fullsized":"2023-12-08T08:19:14.934959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:33:40.484831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604154+0000","last_change":"2023-12-08T08:19:14.973251+0000","last_active":"2023-12-08T08:19:16.604154+0000","last_peered":"2023-12-08T08:19:16.604154+0000","last_clean":"2023-12-08T08:19:16.604154+0000","last_became_active":"2023-12-08T08:19:14.972915+0000","last_became_peered":"2023-12-08T08:19:14.972915+0000","last_unstale":"2023-12-08T08:19:16.604154+0000","last_undegraded":"2023-12-08T08:19:16.604154+0000","last_fullsized":"2023-12-08T08:19:16.604154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:43:47.167235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941599+0000","last_change":"2023-12-08T08:18:53.791563+0000","last_active":"2023-12-08T08:19:14.941599+0000","last_peered":"2023-12-08T08:19:14.941599+0000","last_clean":"2023-12-08T08:19:14.941599+0000","last_became_active":"2023-12-08T08:18:53.791257+0000","last_became_peered":"2023-12-08T08:18:53.791257+0000","last_unstale":"2023-12-08T08:19:14.941599+0000","last_undegraded":"2023-12-08T08:19:14.941599+0000","last_fullsized":"2023-12-08T08:19:14.941599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:04.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.963049+0000","last_change":"2023-12-08T08:19:14.965561+0000","last_active":"2023-12-08T08:19:15.963049+0000","last_peered":"2023-12-08T08:19:15.963049+0000","last_clean":"2023-12-08T08:19:15.963049+0000","last_became_active":"2023-12-08T08:19:14.965049+0000","last_became_peered":"2023-12-08T08:19:14.965049+0000","last_unstale":"2023-12-08T08:19:15.963049+0000","last_undegraded":"2023-12-08T08:19:15.963049+0000","last_fullsized":"2023-12-08T08:19:15.963049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:23.141539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.940936+0000","last_change":"2023-12-08T08:18:53.771206+0000","last_active":"2023-12-08T08:19:14.940936+0000","last_peered":"2023-12-08T08:19:14.940936+0000","last_clean":"2023-12-08T08:19:14.940936+0000","last_became_active":"2023-12-08T08:18:53.763984+0000","last_became_peered":"2023-12-08T08:18:53.763984+0000","last_unstale":"2023-12-08T08:19:14.940936+0000","last_undegraded":"2023-12-08T08:19:14.940936+0000","last_fullsized":"2023-12-08T08:19:14.940936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601918+0000","last_change":"2023-12-08T08:19:14.971331+0000","last_active":"2023-12-08T08:19:16.601918+0000","last_peered":"2023-12-08T08:19:16.601918+0000","last_clean":"2023-12-08T08:19:16.601918+0000","last_became_active":"2023-12-08T08:19:14.970955+0000","last_became_peered":"2023-12-08T08:19:14.970955+0000","last_unstale":"2023-12-08T08:19:16.601918+0000","last_undegraded":"2023-12-08T08:19:16.601918+0000","last_fullsized":"2023-12-08T08:19:16.601918+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:22.450691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957422+0000","last_change":"2023-12-08T08:18:53.794394+0000","last_active":"2023-12-08T08:19:14.957422+0000","last_peered":"2023-12-08T08:19:14.957422+0000","last_clean":"2023-12-08T08:19:14.957422+0000","last_became_active":"2023-12-08T08:18:53.794138+0000","last_became_peered":"2023-12-08T08:18:53.794138+0000","last_unstale":"2023-12-08T08:19:14.957422+0000","last_undegraded":"2023-12-08T08:19:14.957422+0000","last_fullsized":"2023-12-08T08:19:14.957422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603967+0000","last_change":"2023-12-08T08:19:14.978331+0000","last_active":"2023-12-08T08:19:16.603967+0000","last_peered":"2023-12-08T08:19:16.603967+0000","last_clean":"2023-12-08T08:19:16.603967+0000","last_became_active":"2023-12-08T08:19:14.978001+0000","last_became_peered":"2023-12-08T08:19:14.978001+0000","last_unstale":"2023-12-08T08:19:16.603967+0000","last_undegraded":"2023-12-08T08:19:16.603967+0000","last_fullsized":"2023-12-08T08:19:16.603967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:17:19.493515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.949436+0000","last_change":"2023-12-08T08:18:53.786075+0000","last_active":"2023-12-08T08:19:14.949436+0000","last_peered":"2023-12-08T08:19:14.949436+0000","last_clean":"2023-12-08T08:19:14.949436+0000","last_became_active":"2023-12-08T08:18:53.783458+0000","last_became_peered":"2023-12-08T08:18:53.783458+0000","last_unstale":"2023-12-08T08:19:14.949436+0000","last_undegraded":"2023-12-08T08:19:14.949436+0000","last_fullsized":"2023-12-08T08:19:14.949436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:12:32.634182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598992+0000","last_change":"2023-12-08T08:19:14.968980+0000","last_active":"2023-12-08T08:19:16.598992+0000","last_peered":"2023-12-08T08:19:16.598992+0000","last_clean":"2023-12-08T08:19:16.598992+0000","last_became_active":"2023-12-08T08:19:14.968646+0000","last_became_peered":"2023-12-08T08:19:14.968646+0000","last_unstale":"2023-12-08T08:19:16.598992+0000","last_undegraded":"2023-12-08T08:19:16.598992+0000","last_fullsized":"2023-12-08T08:19:16.598992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:23.992888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.963867+0000","last_change":"2023-12-08T08:18:53.789101+0000","last_active":"2023-12-08T08:19:14.963867+0000","last_peered":"2023-12-08T08:19:14.963867+0000","last_clean":"2023-12-08T08:19:14.963867+0000","last_became_active":"2023-12-08T08:18:53.788487+0000","last_became_peered":"2023-12-08T08:18:53.788487+0000","last_unstale":"2023-12-08T08:19:14.963867+0000","last_undegraded":"2023-12-08T08:19:14.963867+0000","last_fullsized":"2023-12-08T08:19:14.963867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:42.120522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602534+0000","last_change":"2023-12-08T08:19:14.963422+0000","last_active":"2023-12-08T08:19:16.602534+0000","last_peered":"2023-12-08T08:19:16.602534+0000","last_clean":"2023-12-08T08:19:16.602534+0000","last_became_active":"2023-12-08T08:19:14.963073+0000","last_became_peered":"2023-12-08T08:19:14.963073+0000","last_unstale":"2023-12-08T08:19:16.602534+0000","last_undegraded":"2023-12-08T08:19:16.602534+0000","last_fullsized":"2023-12-08T08:19:16.602534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:35.228965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943226+0000","last_change":"2023-12-08T08:18:53.772180+0000","last_active":"2023-12-08T08:19:14.943226+0000","last_peered":"2023-12-08T08:19:14.943226+0000","last_clean":"2023-12-08T08:19:14.943226+0000","last_became_active":"2023-12-08T08:18:53.764066+0000","last_became_peered":"2023-12-08T08:18:53.764066+0000","last_unstale":"2023-12-08T08:19:14.943226+0000","last_undegraded":"2023-12-08T08:19:14.943226+0000","last_fullsized":"2023-12-08T08:19:14.943226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:54:00.977650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602570+0000","last_change":"2023-12-08T08:19:14.947618+0000","last_active":"2023-12-08T08:19:16.602570+0000","last_peered":"2023-12-08T08:19:16.602570+0000","last_clean":"2023-12-08T08:19:16.602570+0000","last_became_active":"2023-12-08T08:19:14.947284+0000","last_became_peered":"2023-12-08T08:19:14.947284+0000","last_unstale":"2023-12-08T08:19:16.602570+0000","last_undegraded":"2023-12-08T08:19:16.602570+0000","last_fullsized":"2023-12-08T08:19:16.602570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:29:18.589779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.949096+0000","last_change":"2023-12-08T08:18:53.793998+0000","last_active":"2023-12-08T08:19:14.949096+0000","last_peered":"2023-12-08T08:19:14.949096+0000","last_clean":"2023-12-08T08:19:14.949096+0000","last_became_active":"2023-12-08T08:18:53.793584+0000","last_became_peered":"2023-12-08T08:18:53.793584+0000","last_unstale":"2023-12-08T08:19:14.949096+0000","last_undegraded":"2023-12-08T08:19:14.949096+0000","last_fullsized":"2023-12-08T08:19:14.949096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:30:39.090688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599892+0000","last_change":"2023-12-08T08:19:14.964355+0000","last_active":"2023-12-08T08:19:16.599892+0000","last_peered":"2023-12-08T08:19:16.599892+0000","last_clean":"2023-12-08T08:19:16.599892+0000","last_became_active":"2023-12-08T08:19:14.963707+0000","last_became_peered":"2023-12-08T08:19:14.963707+0000","last_unstale":"2023-12-08T08:19:16.599892+0000","last_undegraded":"2023-12-08T08:19:16.599892+0000","last_fullsized":"2023-12-08T08:19:16.599892+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:43:47.167235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.935053+0000","last_change":"2023-12-08T08:18:53.768788+0000","last_active":"2023-12-08T08:19:14.935053+0000","last_peered":"2023-12-08T08:19:14.935053+0000","last_clean":"2023-12-08T08:19:14.935053+0000","last_became_active":"2023-12-08T08:18:53.768468+0000","last_became_peered":"2023-12-08T08:18:53.768468+0000","last_unstale":"2023-12-08T08:19:14.935053+0000","last_undegraded":"2023-12-08T08:19:14.935053+0000","last_fullsized":"2023-12-08T08:19:14.935053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:44:42.572251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.958733+0000","last_change":"2023-12-08T08:19:14.975119+0000","last_active":"2023-12-08T08:19:15.958733+0000","last_peered":"2023-12-08T08:19:15.958733+0000","last_clean":"2023-12-08T08:19:15.958733+0000","last_became_active":"2023-12-08T08:19:14.974497+0000","last_became_peered":"2023-12-08T08:19:14.974497+0000","last_unstale":"2023-12-08T08:19:15.958733+0000","last_undegraded":"2023-12-08T08:19:15.958733+0000","last_fullsized":"2023-12-08T08:19:15.958733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:21:34.744567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957062+0000","last_change":"2023-12-08T08:18:53.786191+0000","last_active":"2023-12-08T08:19:14.957062+0000","last_peered":"2023-12-08T08:19:14.957062+0000","last_clean":"2023-12-08T08:19:14.957062+0000","last_became_active":"2023-12-08T08:18:53.785934+0000","last_became_peered":"2023-12-08T08:18:53.785934+0000","last_unstale":"2023-12-08T08:19:14.957062+0000","last_undegraded":"2023-12-08T08:19:14.957062+0000","last_fullsized":"2023-12-08T08:19:14.957062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:26.256411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601817+0000","last_change":"2023-12-08T08:19:14.967125+0000","last_active":"2023-12-08T08:19:16.601817+0000","last_peered":"2023-12-08T08:19:16.601817+0000","last_clean":"2023-12-08T08:19:16.601817+0000","last_became_active":"2023-12-08T08:19:14.966857+0000","last_became_peered":"2023-12-08T08:19:14.966857+0000","last_unstale":"2023-12-08T08:19:16.601817+0000","last_undegraded":"2023-12-08T08:19:16.601817+0000","last_fullsized":"2023-12-08T08:19:16.601817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:14.228246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941356+0000","last_change":"2023-12-08T08:18:53.785767+0000","last_active":"2023-12-08T08:19:14.941356+0000","last_peered":"2023-12-08T08:19:14.941356+0000","last_clean":"2023-12-08T08:19:14.941356+0000","last_became_active":"2023-12-08T08:18:53.785369+0000","last_became_peered":"2023-12-08T08:18:53.785369+0000","last_unstale":"2023-12-08T08:19:14.941356+0000","last_undegraded":"2023-12-08T08:19:14.941356+0000","last_fullsized":"2023-12-08T08:19:14.941356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.959004+0000","last_change":"2023-12-08T08:19:14.959785+0000","last_active":"2023-12-08T08:19:15.959004+0000","last_peered":"2023-12-08T08:19:15.959004+0000","last_clean":"2023-12-08T08:19:15.959004+0000","last_became_active":"2023-12-08T08:19:14.959500+0000","last_became_peered":"2023-12-08T08:19:14.959500+0000","last_unstale":"2023-12-08T08:19:15.959004+0000","last_undegraded":"2023-12-08T08:19:15.959004+0000","last_fullsized":"2023-12-08T08:19:15.959004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:06.687570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959812+0000","last_change":"2023-12-08T08:18:53.786744+0000","last_active":"2023-12-08T08:19:14.959812+0000","last_peered":"2023-12-08T08:19:14.959812+0000","last_clean":"2023-12-08T08:19:14.959812+0000","last_became_active":"2023-12-08T08:18:53.785499+0000","last_became_peered":"2023-12-08T08:18:53.785499+0000","last_unstale":"2023-12-08T08:19:14.959812+0000","last_undegraded":"2023-12-08T08:19:14.959812+0000","last_fullsized":"2023-12-08T08:19:14.959812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:23:11.105855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603057+0000","last_change":"2023-12-08T08:19:14.973818+0000","last_active":"2023-12-08T08:19:16.603057+0000","last_peered":"2023-12-08T08:19:16.603057+0000","last_clean":"2023-12-08T08:19:16.603057+0000","last_became_active":"2023-12-08T08:19:14.973467+0000","last_became_peered":"2023-12-08T08:19:14.973467+0000","last_unstale":"2023-12-08T08:19:16.603057+0000","last_undegraded":"2023-12-08T08:19:16.603057+0000","last_fullsized":"2023-12-08T08:19:16.603057+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:49.832509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941918+0000","last_change":"2023-12-08T08:18:53.783040+0000","last_active":"2023-12-08T08:19:14.941918+0000","last_peered":"2023-12-08T08:19:14.941918+0000","last_clean":"2023-12-08T08:19:14.941918+0000","last_became_active":"2023-12-08T08:18:53.781940+0000","last_became_peered":"2023-12-08T08:18:53.781940+0000","last_unstale":"2023-12-08T08:19:14.941918+0000","last_undegraded":"2023-12-08T08:19:14.941918+0000","last_fullsized":"2023-12-08T08:19:14.941918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:35.044283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.963430+0000","last_change":"2023-12-08T08:19:14.953008+0000","last_active":"2023-12-08T08:19:15.963430+0000","last_peered":"2023-12-08T08:19:15.963430+0000","last_clean":"2023-12-08T08:19:15.963430+0000","last_became_active":"2023-12-08T08:19:14.949303+0000","last_became_peered":"2023-12-08T08:19:14.949303+0000","last_unstale":"2023-12-08T08:19:15.963430+0000","last_undegraded":"2023-12-08T08:19:15.963430+0000","last_fullsized":"2023-12-08T08:19:15.963430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:49.832509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.964004+0000","last_change":"2023-12-08T08:19:13.938989+0000","last_active":"2023-12-08T08:19:15.964004+0000","last_peered":"2023-12-08T08:19:15.964004+0000","last_clean":"2023-12-08T08:19:15.964004+0000","last_became_active":"2023-12-08T08:19:13.938276+0000","last_became_peered":"2023-12-08T08:19:13.938276+0000","last_unstale":"2023-12-08T08:19:15.964004+0000","last_undegraded":"2023-12-08T08:19:15.964004+0000","last_fullsized":"2023-12-08T08:19:15.964004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:11.442816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943489+0000","last_change":"2023-12-08T08:18:53.797000+0000","last_active":"2023-12-08T08:19:14.943489+0000","last_peered":"2023-12-08T08:19:14.943489+0000","last_clean":"2023-12-08T08:19:14.943489+0000","last_became_active":"2023-12-08T08:18:53.791588+0000","last_became_peered":"2023-12-08T08:18:53.791588+0000","last_unstale":"2023-12-08T08:19:14.943489+0000","last_undegraded":"2023-12-08T08:19:14.943489+0000","last_fullsized":"2023-12-08T08:19:14.943489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:32.972182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"78'4","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.965673+0000","last_change":"2023-12-08T08:18:52.779491+0000","last_active":"2023-12-08T08:19:14.965673+0000","last_peered":"2023-12-08T08:19:14.965673+0000","last_clean":"2023-12-08T08:19:14.965673+0000","last_became_active":"2023-12-08T08:18:52.776482+0000","last_became_peered":"2023-12-08T08:18:52.776482+0000","last_unstale":"2023-12-08T08:19:14.965673+0000","last_undegraded":"2023-12-08T08:19:14.965673+0000","last_fullsized":"2023-12-08T08:19:14.965673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:03.362667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603392+0000","last_change":"2023-12-08T08:19:14.967704+0000","last_active":"2023-12-08T08:19:16.603392+0000","last_peered":"2023-12-08T08:19:16.603392+0000","last_clean":"2023-12-08T08:19:16.603392+0000","last_became_active":"2023-12-08T08:19:14.967369+0000","last_became_peered":"2023-12-08T08:19:14.967369+0000","last_unstale":"2023-12-08T08:19:16.603392+0000","last_undegraded":"2023-12-08T08:19:16.603392+0000","last_fullsized":"2023-12-08T08:19:16.603392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:12.457958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604624+0000","last_change":"2023-12-08T08:19:13.925746+0000","last_active":"2023-12-08T08:19:16.604624+0000","last_peered":"2023-12-08T08:19:16.604624+0000","last_clean":"2023-12-08T08:19:16.604624+0000","last_became_active":"2023-12-08T08:19:13.925469+0000","last_became_peered":"2023-12-08T08:19:13.925469+0000","last_unstale":"2023-12-08T08:19:16.604624+0000","last_undegraded":"2023-12-08T08:19:16.604624+0000","last_fullsized":"2023-12-08T08:19:16.604624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:01:47.414158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942371+0000","last_change":"2023-12-08T08:18:53.784523+0000","last_active":"2023-12-08T08:19:14.942371+0000","last_peered":"2023-12-08T08:19:14.942371+0000","last_clean":"2023-12-08T08:19:14.942371+0000","last_became_active":"2023-12-08T08:18:53.784246+0000","last_became_peered":"2023-12-08T08:18:53.784246+0000","last_unstale":"2023-12-08T08:19:14.942371+0000","last_undegraded":"2023-12-08T08:19:14.942371+0000","last_fullsized":"2023-12-08T08:19:14.942371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:09.884228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"78'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943704+0000","last_change":"2023-12-08T08:18:52.774720+0000","last_active":"2023-12-08T08:19:14.943704+0000","last_peered":"2023-12-08T08:19:14.943704+0000","last_clean":"2023-12-08T08:19:14.943704+0000","last_became_active":"2023-12-08T08:18:52.772085+0000","last_became_peered":"2023-12-08T08:18:52.772085+0000","last_unstale":"2023-12-08T08:19:14.943704+0000","last_undegraded":"2023-12-08T08:19:14.943704+0000","last_fullsized":"2023-12-08T08:19:14.943704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.958744+0000","last_change":"2023-12-08T08:19:14.979345+0000","last_active":"2023-12-08T08:19:15.958744+0000","last_peered":"2023-12-08T08:19:15.958744+0000","last_clean":"2023-12-08T08:19:15.958744+0000","last_became_active":"2023-12-08T08:19:14.978603+0000","last_became_peered":"2023-12-08T08:19:14.978603+0000","last_unstale":"2023-12-08T08:19:15.958744+0000","last_undegraded":"2023-12-08T08:19:15.958744+0000","last_fullsized":"2023-12-08T08:19:15.958744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:54:02.401203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"82'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604182+0000","last_change":"2023-12-08T08:19:13.939946+0000","last_active":"2023-12-08T08:19:16.604182+0000","last_peered":"2023-12-08T08:19:16.604182+0000","last_clean":"2023-12-08T08:19:16.604182+0000","last_became_active":"2023-12-08T08:19:13.939529+0000","last_became_peered":"2023-12-08T08:19:13.939529+0000","last_unstale":"2023-12-08T08:19:16.604182+0000","last_undegraded":"2023-12-08T08:19:16.604182+0000","last_fullsized":"2023-12-08T08:19:16.604182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:48.817366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.958039+0000","last_change":"2023-12-08T08:18:53.796068+0000","last_active":"2023-12-08T08:19:14.958039+0000","last_peered":"2023-12-08T08:19:14.958039+0000","last_clean":"2023-12-08T08:19:14.958039+0000","last_became_active":"2023-12-08T08:18:53.795798+0000","last_became_peered":"2023-12-08T08:18:53.795798+0000","last_unstale":"2023-12-08T08:19:14.958039+0000","last_undegraded":"2023-12-08T08:19:14.958039+0000","last_fullsized":"2023-12-08T08:19:14.958039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:19.902148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957831+0000","last_change":"2023-12-08T08:18:52.782611+0000","last_active":"2023-12-08T08:19:14.957831+0000","last_peered":"2023-12-08T08:19:14.957831+0000","last_clean":"2023-12-08T08:19:14.957831+0000","last_became_active":"2023-12-08T08:18:52.782269+0000","last_became_peered":"2023-12-08T08:18:52.782269+0000","last_unstale":"2023-12-08T08:19:14.957831+0000","last_undegraded":"2023-12-08T08:19:14.957831+0000","last_fullsized":"2023-12-08T08:19:14.957831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:16:38.128264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600722+0000","last_change":"2023-12-08T08:19:14.968935+0000","last_active":"2023-12-08T08:19:16.600722+0000","last_peered":"2023-12-08T08:19:16.600722+0000","last_clean":"2023-12-08T08:19:16.600722+0000","last_became_active":"2023-12-08T08:19:14.966604+0000","last_became_peered":"2023-12-08T08:19:14.966604+0000","last_unstale":"2023-12-08T08:19:16.600722+0000","last_undegraded":"2023-12-08T08:19:16.600722+0000","last_fullsized":"2023-12-08T08:19:16.600722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:00:17.110877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.606239+0000","last_change":"2023-12-08T08:19:13.937681+0000","last_active":"2023-12-08T08:19:16.606239+0000","last_peered":"2023-12-08T08:19:16.606239+0000","last_clean":"2023-12-08T08:19:16.606239+0000","last_became_active":"2023-12-08T08:19:13.936216+0000","last_became_peered":"2023-12-08T08:19:13.936216+0000","last_unstale":"2023-12-08T08:19:16.606239+0000","last_undegraded":"2023-12-08T08:19:16.606239+0000","last_fullsized":"2023-12-08T08:19:16.606239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:29.259205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943777+0000","last_change":"2023-12-08T08:18:53.794864+0000","last_active":"2023-12-08T08:19:14.943777+0000","last_peered":"2023-12-08T08:19:14.943777+0000","last_clean":"2023-12-08T08:19:14.943777+0000","last_became_active":"2023-12-08T08:18:53.794563+0000","last_became_peered":"2023-12-08T08:18:53.794563+0000","last_unstale":"2023-12-08T08:19:14.943777+0000","last_undegraded":"2023-12-08T08:19:14.943777+0000","last_fullsized":"2023-12-08T08:19:14.943777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:24.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959895+0000","last_change":"2023-12-08T08:18:52.780142+0000","last_active":"2023-12-08T08:19:14.959895+0000","last_peered":"2023-12-08T08:19:14.959895+0000","last_clean":"2023-12-08T08:19:14.959895+0000","last_became_active":"2023-12-08T08:18:52.779795+0000","last_became_peered":"2023-12-08T08:18:52.779795+0000","last_unstale":"2023-12-08T08:19:14.959895+0000","last_undegraded":"2023-12-08T08:19:14.959895+0000","last_fullsized":"2023-12-08T08:19:14.959895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:59:54.941581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603390+0000","last_change":"2023-12-08T08:19:14.970793+0000","last_active":"2023-12-08T08:19:16.603390+0000","last_peered":"2023-12-08T08:19:16.603390+0000","last_clean":"2023-12-08T08:19:16.603390+0000","last_became_active":"2023-12-08T08:19:14.970524+0000","last_became_peered":"2023-12-08T08:19:14.970524+0000","last_unstale":"2023-12-08T08:19:16.603390+0000","last_undegraded":"2023-12-08T08:19:16.603390+0000","last_fullsized":"2023-12-08T08:19:16.603390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:35.068536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.962899+0000","last_change":"2023-12-08T08:19:13.934978+0000","last_active":"2023-12-08T08:19:15.962899+0000","last_peered":"2023-12-08T08:19:15.962899+0000","last_clean":"2023-12-08T08:19:15.962899+0000","last_became_active":"2023-12-08T08:19:13.934665+0000","last_became_peered":"2023-12-08T08:19:13.934665+0000","last_unstale":"2023-12-08T08:19:15.962899+0000","last_undegraded":"2023-12-08T08:19:15.962899+0000","last_fullsized":"2023-12-08T08:19:15.962899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:51.691732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.933500+0000","last_change":"2023-12-08T08:18:53.779851+0000","last_active":"2023-12-08T08:19:14.933500+0000","last_peered":"2023-12-08T08:19:14.933500+0000","last_clean":"2023-12-08T08:19:14.933500+0000","last_became_active":"2023-12-08T08:18:53.775977+0000","last_became_peered":"2023-12-08T08:18:53.775977+0000","last_unstale":"2023-12-08T08:19:14.933500+0000","last_undegraded":"2023-12-08T08:19:14.933500+0000","last_fullsized":"2023-12-08T08:19:14.933500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:33:05.520867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"78'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.941959+0000","last_change":"2023-12-08T08:18:52.773342+0000","last_active":"2023-12-08T08:19:14.941959+0000","last_peered":"2023-12-08T08:19:14.941959+0000","last_clean":"2023-12-08T08:19:14.941959+0000","last_became_active":"2023-12-08T08:18:52.772931+0000","last_became_peered":"2023-12-08T08:18:52.772931+0000","last_unstale":"2023-12-08T08:19:14.941959+0000","last_undegraded":"2023-12-08T08:19:14.941959+0000","last_fullsized":"2023-12-08T08:19:14.941959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:10:08.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604876+0000","last_change":"2023-12-08T08:19:14.954861+0000","last_active":"2023-12-08T08:19:16.604876+0000","last_peered":"2023-12-08T08:19:16.604876+0000","last_clean":"2023-12-08T08:19:16.604876+0000","last_became_active":"2023-12-08T08:19:14.954411+0000","last_became_peered":"2023-12-08T08:19:14.954411+0000","last_unstale":"2023-12-08T08:19:16.604876+0000","last_undegraded":"2023-12-08T08:19:16.604876+0000","last_fullsized":"2023-12-08T08:19:16.604876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:58:42.614586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598694+0000","last_change":"2023-12-08T08:19:13.923488+0000","last_active":"2023-12-08T08:19:16.598694+0000","last_peered":"2023-12-08T08:19:16.598694+0000","last_clean":"2023-12-08T08:19:16.598694+0000","last_became_active":"2023-12-08T08:19:13.921527+0000","last_became_peered":"2023-12-08T08:19:13.921527+0000","last_unstale":"2023-12-08T08:19:16.598694+0000","last_undegraded":"2023-12-08T08:19:16.598694+0000","last_fullsized":"2023-12-08T08:19:16.598694+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:11.442816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957561+0000","last_change":"2023-12-08T08:18:53.792138+0000","last_active":"2023-12-08T08:19:14.957561+0000","last_peered":"2023-12-08T08:19:14.957561+0000","last_clean":"2023-12-08T08:19:14.957561+0000","last_became_active":"2023-12-08T08:18:53.791865+0000","last_became_peered":"2023-12-08T08:18:53.791865+0000","last_unstale":"2023-12-08T08:19:14.957561+0000","last_undegraded":"2023-12-08T08:19:14.957561+0000","last_fullsized":"2023-12-08T08:19:14.957561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:12.478361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"78'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.934835+0000","last_change":"2023-12-08T08:18:52.775267+0000","last_active":"2023-12-08T08:19:14.934835+0000","last_peered":"2023-12-08T08:19:14.934835+0000","last_clean":"2023-12-08T08:19:14.934835+0000","last_became_active":"2023-12-08T08:18:52.774956+0000","last_became_peered":"2023-12-08T08:18:52.774956+0000","last_unstale":"2023-12-08T08:19:14.934835+0000","last_undegraded":"2023-12-08T08:19:14.934835+0000","last_fullsized":"2023-12-08T08:19:14.934835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:38.922247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601161+0000","last_change":"2023-12-08T08:19:14.966092+0000","last_active":"2023-12-08T08:19:16.601161+0000","last_peered":"2023-12-08T08:19:16.601161+0000","last_clean":"2023-12-08T08:19:16.601161+0000","last_became_active":"2023-12-08T08:19:14.965700+0000","last_became_peered":"2023-12-08T08:19:14.965700+0000","last_unstale":"2023-12-08T08:19:16.601161+0000","last_undegraded":"2023-12-08T08:19:16.601161+0000","last_fullsized":"2023-12-08T08:19:16.601161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:56.207272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601557+0000","last_change":"2023-12-08T08:19:13.941553+0000","last_active":"2023-12-08T08:19:16.601557+0000","last_peered":"2023-12-08T08:19:16.601557+0000","last_clean":"2023-12-08T08:19:16.601557+0000","last_became_active":"2023-12-08T08:19:13.941221+0000","last_became_peered":"2023-12-08T08:19:13.941221+0000","last_unstale":"2023-12-08T08:19:16.601557+0000","last_undegraded":"2023-12-08T08:19:16.601557+0000","last_fullsized":"2023-12-08T08:19:16.601557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:55.192130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942462+0000","last_change":"2023-12-08T08:18:53.789767+0000","last_active":"2023-12-08T08:19:14.942462+0000","last_peered":"2023-12-08T08:19:14.942462+0000","last_clean":"2023-12-08T08:19:14.942462+0000","last_became_active":"2023-12-08T08:18:53.787669+0000","last_became_peered":"2023-12-08T08:18:53.787669+0000","last_unstale":"2023-12-08T08:19:14.942462+0000","last_undegraded":"2023-12-08T08:19:14.942462+0000","last_fullsized":"2023-12-08T08:19:14.942462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:09:50.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.951386+0000","last_change":"2023-12-08T08:18:52.777375+0000","last_active":"2023-12-08T08:19:14.951386+0000","last_peered":"2023-12-08T08:19:14.951386+0000","last_clean":"2023-12-08T08:19:14.951386+0000","last_became_active":"2023-12-08T08:18:52.774534+0000","last_became_peered":"2023-12-08T08:18:52.774534+0000","last_unstale":"2023-12-08T08:19:14.951386+0000","last_undegraded":"2023-12-08T08:19:14.951386+0000","last_fullsized":"2023-12-08T08:19:14.951386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:19:13.831894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.958586+0000","last_change":"2023-12-08T08:19:14.969234+0000","last_active":"2023-12-08T08:19:15.958586+0000","last_peered":"2023-12-08T08:19:15.958586+0000","last_clean":"2023-12-08T08:19:15.958586+0000","last_became_active":"2023-12-08T08:19:14.965239+0000","last_became_peered":"2023-12-08T08:19:14.965239+0000","last_unstale":"2023-12-08T08:19:15.958586+0000","last_undegraded":"2023-12-08T08:19:15.958586+0000","last_fullsized":"2023-12-08T08:19:15.958586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:44:36.223571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600710+0000","last_change":"2023-12-08T08:19:13.943485+0000","last_active":"2023-12-08T08:19:16.600710+0000","last_peered":"2023-12-08T08:19:16.600710+0000","last_clean":"2023-12-08T08:19:16.600710+0000","last_became_active":"2023-12-08T08:19:13.943170+0000","last_became_peered":"2023-12-08T08:19:13.943170+0000","last_unstale":"2023-12-08T08:19:16.600710+0000","last_undegraded":"2023-12-08T08:19:16.600710+0000","last_fullsized":"2023-12-08T08:19:16.600710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:46.404258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.936031+0000","last_change":"2023-12-08T08:18:53.792753+0000","last_active":"2023-12-08T08:19:14.936031+0000","last_peered":"2023-12-08T08:19:14.936031+0000","last_clean":"2023-12-08T08:19:14.936031+0000","last_became_active":"2023-12-08T08:18:53.792416+0000","last_became_peered":"2023-12-08T08:18:53.792416+0000","last_unstale":"2023-12-08T08:19:14.936031+0000","last_undegraded":"2023-12-08T08:19:14.936031+0000","last_fullsized":"2023-12-08T08:19:14.936031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:27:25.085766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.956296+0000","last_change":"2023-12-08T08:18:52.784528+0000","last_active":"2023-12-08T08:19:14.956296+0000","last_peered":"2023-12-08T08:19:14.956296+0000","last_clean":"2023-12-08T08:19:14.956296+0000","last_became_active":"2023-12-08T08:18:52.784107+0000","last_became_peered":"2023-12-08T08:18:52.784107+0000","last_unstale":"2023-12-08T08:19:14.956296+0000","last_undegraded":"2023-12-08T08:19:14.956296+0000","last_fullsized":"2023-12-08T08:19:14.956296+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:48.898931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602432+0000","last_change":"2023-12-08T08:19:14.961781+0000","last_active":"2023-12-08T08:19:16.602432+0000","last_peered":"2023-12-08T08:19:16.602432+0000","last_clean":"2023-12-08T08:19:16.602432+0000","last_became_active":"2023-12-08T08:19:14.961493+0000","last_became_peered":"2023-12-08T08:19:14.961493+0000","last_unstale":"2023-12-08T08:19:16.602432+0000","last_undegraded":"2023-12-08T08:19:16.602432+0000","last_fullsized":"2023-12-08T08:19:16.602432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"82'3","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601269+0000","last_change":"2023-12-08T08:19:13.939643+0000","last_active":"2023-12-08T08:19:16.601269+0000","last_peered":"2023-12-08T08:19:16.601269+0000","last_clean":"2023-12-08T08:19:16.601269+0000","last_became_active":"2023-12-08T08:19:13.936926+0000","last_became_peered":"2023-12-08T08:19:13.936926+0000","last_unstale":"2023-12-08T08:19:16.601269+0000","last_undegraded":"2023-12-08T08:19:16.601269+0000","last_fullsized":"2023-12-08T08:19:16.601269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:38:13.213104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942804+0000","last_change":"2023-12-08T08:18:53.774352+0000","last_active":"2023-12-08T08:19:14.942804+0000","last_peered":"2023-12-08T08:19:14.942804+0000","last_clean":"2023-12-08T08:19:14.942804+0000","last_became_active":"2023-12-08T08:18:53.773904+0000","last_became_peered":"2023-12-08T08:18:53.773904+0000","last_unstale":"2023-12-08T08:19:14.942804+0000","last_undegraded":"2023-12-08T08:19:14.942804+0000","last_fullsized":"2023-12-08T08:19:14.942804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:03.410858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.964044+0000","last_change":"2023-12-08T08:18:52.778934+0000","last_active":"2023-12-08T08:19:14.964044+0000","last_peered":"2023-12-08T08:19:14.964044+0000","last_clean":"2023-12-08T08:19:14.964044+0000","last_became_active":"2023-12-08T08:18:52.778599+0000","last_became_peered":"2023-12-08T08:18:52.778599+0000","last_unstale":"2023-12-08T08:19:14.964044+0000","last_undegraded":"2023-12-08T08:19:14.964044+0000","last_fullsized":"2023-12-08T08:19:14.964044+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:02.404550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603270+0000","last_change":"2023-12-08T08:19:14.964516+0000","last_active":"2023-12-08T08:19:16.603270+0000","last_peered":"2023-12-08T08:19:16.603270+0000","last_clean":"2023-12-08T08:19:16.603270+0000","last_became_active":"2023-12-08T08:19:14.963656+0000","last_became_peered":"2023-12-08T08:19:14.963656+0000","last_unstale":"2023-12-08T08:19:16.603270+0000","last_undegraded":"2023-12-08T08:19:16.603270+0000","last_fullsized":"2023-12-08T08:19:16.603270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:25:07.848802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"82'6","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600926+0000","last_change":"2023-12-08T08:19:13.938304+0000","last_active":"2023-12-08T08:19:16.600926+0000","last_peered":"2023-12-08T08:19:16.600926+0000","last_clean":"2023-12-08T08:19:16.600926+0000","last_became_active":"2023-12-08T08:19:13.937851+0000","last_became_peered":"2023-12-08T08:19:13.937851+0000","last_unstale":"2023-12-08T08:19:16.600926+0000","last_undegraded":"2023-12-08T08:19:16.600926+0000","last_fullsized":"2023-12-08T08:19:16.600926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:24.696608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957769+0000","last_change":"2023-12-08T08:18:53.792470+0000","last_active":"2023-12-08T08:19:14.957769+0000","last_peered":"2023-12-08T08:19:14.957769+0000","last_clean":"2023-12-08T08:19:14.957769+0000","last_became_active":"2023-12-08T08:18:53.792143+0000","last_became_peered":"2023-12-08T08:18:53.792143+0000","last_unstale":"2023-12-08T08:19:14.957769+0000","last_undegraded":"2023-12-08T08:19:14.957769+0000","last_fullsized":"2023-12-08T08:19:14.957769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:25:20.644648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.949941+0000","last_change":"2023-12-08T08:18:52.772130+0000","last_active":"2023-12-08T08:19:14.949941+0000","last_peered":"2023-12-08T08:19:14.949941+0000","last_clean":"2023-12-08T08:19:14.949941+0000","last_became_active":"2023-12-08T08:18:52.771674+0000","last_became_peered":"2023-12-08T08:18:52.771674+0000","last_unstale":"2023-12-08T08:19:14.949941+0000","last_undegraded":"2023-12-08T08:19:14.949941+0000","last_fullsized":"2023-12-08T08:19:14.949941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:03:41.114214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.958007+0000","last_change":"2023-12-08T08:19:14.979554+0000","last_active":"2023-12-08T08:19:15.958007+0000","last_peered":"2023-12-08T08:19:15.958007+0000","last_clean":"2023-12-08T08:19:15.958007+0000","last_became_active":"2023-12-08T08:19:14.979015+0000","last_became_peered":"2023-12-08T08:19:14.979015+0000","last_unstale":"2023-12-08T08:19:15.958007+0000","last_undegraded":"2023-12-08T08:19:15.958007+0000","last_fullsized":"2023-12-08T08:19:15.958007+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:29:45.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.964802+0000","last_change":"2023-12-08T08:19:13.941085+0000","last_active":"2023-12-08T08:19:15.964802+0000","last_peered":"2023-12-08T08:19:15.964802+0000","last_clean":"2023-12-08T08:19:15.964802+0000","last_became_active":"2023-12-08T08:19:13.940798+0000","last_became_peered":"2023-12-08T08:19:13.940798+0000","last_unstale":"2023-12-08T08:19:15.964802+0000","last_undegraded":"2023-12-08T08:19:15.964802+0000","last_fullsized":"2023-12-08T08:19:15.964802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:22.977746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.949769+0000","last_change":"2023-12-08T08:18:53.778524+0000","last_active":"2023-12-08T08:19:14.949769+0000","last_peered":"2023-12-08T08:19:14.949769+0000","last_clean":"2023-12-08T08:19:14.949769+0000","last_became_active":"2023-12-08T08:18:53.778209+0000","last_became_peered":"2023-12-08T08:18:53.778209+0000","last_unstale":"2023-12-08T08:19:14.949769+0000","last_undegraded":"2023-12-08T08:19:14.949769+0000","last_fullsized":"2023-12-08T08:19:14.949769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:42.080006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"78'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943706+0000","last_change":"2023-12-08T08:18:52.768239+0000","last_active":"2023-12-08T08:19:14.943706+0000","last_peered":"2023-12-08T08:19:14.943706+0000","last_clean":"2023-12-08T08:19:14.943706+0000","last_became_active":"2023-12-08T08:18:52.767760+0000","last_became_peered":"2023-12-08T08:18:52.767760+0000","last_unstale":"2023-12-08T08:19:14.943706+0000","last_undegraded":"2023-12-08T08:19:14.943706+0000","last_fullsized":"2023-12-08T08:19:14.943706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:26.322461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599534+0000","last_change":"2023-12-08T08:19:14.961445+0000","last_active":"2023-12-08T08:19:16.599534+0000","last_peered":"2023-12-08T08:19:16.599534+0000","last_clean":"2023-12-08T08:19:16.599534+0000","last_became_active":"2023-12-08T08:19:14.960560+0000","last_became_peered":"2023-12-08T08:19:14.960560+0000","last_unstale":"2023-12-08T08:19:16.599534+0000","last_undegraded":"2023-12-08T08:19:16.599534+0000","last_fullsized":"2023-12-08T08:19:16.599534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:10.741829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.958886+0000","last_change":"2023-12-08T08:19:13.934149+0000","last_active":"2023-12-08T08:19:15.958886+0000","last_peered":"2023-12-08T08:19:15.958886+0000","last_clean":"2023-12-08T08:19:15.958886+0000","last_became_active":"2023-12-08T08:19:13.933785+0000","last_became_peered":"2023-12-08T08:19:13.933785+0000","last_unstale":"2023-12-08T08:19:15.958886+0000","last_undegraded":"2023-12-08T08:19:15.958886+0000","last_fullsized":"2023-12-08T08:19:15.958886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:26:42.817398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.936388+0000","last_change":"2023-12-08T08:18:53.790906+0000","last_active":"2023-12-08T08:19:14.936388+0000","last_peered":"2023-12-08T08:19:14.936388+0000","last_clean":"2023-12-08T08:19:14.936388+0000","last_became_active":"2023-12-08T08:18:53.790630+0000","last_became_peered":"2023-12-08T08:18:53.790630+0000","last_unstale":"2023-12-08T08:19:14.936388+0000","last_undegraded":"2023-12-08T08:19:14.936388+0000","last_fullsized":"2023-12-08T08:19:14.936388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:59:27.277967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"79'9","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943695+0000","last_change":"2023-12-08T08:18:52.780216+0000","last_active":"2023-12-08T08:19:14.943695+0000","last_peered":"2023-12-08T08:19:14.943695+0000","last_clean":"2023-12-08T08:19:14.943695+0000","last_became_active":"2023-12-08T08:18:52.779882+0000","last_became_peered":"2023-12-08T08:18:52.779882+0000","last_unstale":"2023-12-08T08:19:14.943695+0000","last_undegraded":"2023-12-08T08:19:14.943695+0000","last_fullsized":"2023-12-08T08:19:14.943695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:18.659992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605938+0000","last_change":"2023-12-08T08:19:14.964205+0000","last_active":"2023-12-08T08:19:16.605938+0000","last_peered":"2023-12-08T08:19:16.605938+0000","last_clean":"2023-12-08T08:19:16.605938+0000","last_became_active":"2023-12-08T08:19:14.963791+0000","last_became_peered":"2023-12-08T08:19:14.963791+0000","last_unstale":"2023-12-08T08:19:16.605938+0000","last_undegraded":"2023-12-08T08:19:16.605938+0000","last_fullsized":"2023-12-08T08:19:16.605938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:16:12.348049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601393+0000","last_change":"2023-12-08T08:19:13.932334+0000","last_active":"2023-12-08T08:19:16.601393+0000","last_peered":"2023-12-08T08:19:16.601393+0000","last_clean":"2023-12-08T08:19:16.601393+0000","last_became_active":"2023-12-08T08:19:13.932046+0000","last_became_peered":"2023-12-08T08:19:13.932046+0000","last_unstale":"2023-12-08T08:19:16.601393+0000","last_undegraded":"2023-12-08T08:19:16.601393+0000","last_fullsized":"2023-12-08T08:19:16.601393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:52:14.900460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.934108+0000","last_change":"2023-12-08T08:18:53.785668+0000","last_active":"2023-12-08T08:19:14.934108+0000","last_peered":"2023-12-08T08:19:14.934108+0000","last_clean":"2023-12-08T08:19:14.934108+0000","last_became_active":"2023-12-08T08:18:53.785342+0000","last_became_peered":"2023-12-08T08:18:53.785342+0000","last_unstale":"2023-12-08T08:19:14.934108+0000","last_undegraded":"2023-12-08T08:19:14.934108+0000","last_fullsized":"2023-12-08T08:19:14.934108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:06:53.630993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957165+0000","last_change":"2023-12-08T08:18:52.784586+0000","last_active":"2023-12-08T08:19:14.957165+0000","last_peered":"2023-12-08T08:19:14.957165+0000","last_clean":"2023-12-08T08:19:14.957165+0000","last_became_active":"2023-12-08T08:18:52.784265+0000","last_became_peered":"2023-12-08T08:18:52.784265+0000","last_unstale":"2023-12-08T08:19:14.957165+0000","last_undegraded":"2023-12-08T08:19:14.957165+0000","last_fullsized":"2023-12-08T08:19:14.957165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:08:51.598334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.959373+0000","last_change":"2023-12-08T08:19:14.974909+0000","last_active":"2023-12-08T08:19:15.959373+0000","last_peered":"2023-12-08T08:19:15.959373+0000","last_clean":"2023-12-08T08:19:15.959373+0000","last_became_active":"2023-12-08T08:19:14.974551+0000","last_became_peered":"2023-12-08T08:19:14.974551+0000","last_unstale":"2023-12-08T08:19:15.959373+0000","last_undegraded":"2023-12-08T08:19:15.959373+0000","last_fullsized":"2023-12-08T08:19:15.959373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:41:04.326460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"82'8","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.962405+0000","last_change":"2023-12-08T08:19:13.932197+0000","last_active":"2023-12-08T08:19:15.962405+0000","last_peered":"2023-12-08T08:19:15.962405+0000","last_clean":"2023-12-08T08:19:15.962405+0000","last_became_active":"2023-12-08T08:19:13.931655+0000","last_became_peered":"2023-12-08T08:19:13.931655+0000","last_unstale":"2023-12-08T08:19:15.962405+0000","last_undegraded":"2023-12-08T08:19:15.962405+0000","last_fullsized":"2023-12-08T08:19:15.962405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:11:01.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.939716+0000","last_change":"2023-12-08T08:18:53.788006+0000","last_active":"2023-12-08T08:19:14.939716+0000","last_peered":"2023-12-08T08:19:14.939716+0000","last_clean":"2023-12-08T08:19:14.939716+0000","last_became_active":"2023-12-08T08:18:53.787709+0000","last_became_peered":"2023-12-08T08:18:53.787709+0000","last_unstale":"2023-12-08T08:19:14.939716+0000","last_undegraded":"2023-12-08T08:19:14.939716+0000","last_fullsized":"2023-12-08T08:19:14.939716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:57:55.392551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942556+0000","last_change":"2023-12-08T08:18:52.778951+0000","last_active":"2023-12-08T08:19:14.942556+0000","last_peered":"2023-12-08T08:19:14.942556+0000","last_clean":"2023-12-08T08:19:14.942556+0000","last_became_active":"2023-12-08T08:18:52.778043+0000","last_became_peered":"2023-12-08T08:18:52.778043+0000","last_unstale":"2023-12-08T08:19:14.942556+0000","last_undegraded":"2023-12-08T08:19:14.942556+0000","last_fullsized":"2023-12-08T08:19:14.942556+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:01.823592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600841+0000","last_change":"2023-12-08T08:19:14.980900+0000","last_active":"2023-12-08T08:19:16.600841+0000","last_peered":"2023-12-08T08:19:16.600841+0000","last_clean":"2023-12-08T08:19:16.600841+0000","last_became_active":"2023-12-08T08:19:14.980615+0000","last_became_peered":"2023-12-08T08:19:14.980615+0000","last_unstale":"2023-12-08T08:19:16.600841+0000","last_undegraded":"2023-12-08T08:19:16.600841+0000","last_fullsized":"2023-12-08T08:19:16.600841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:25.711750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603542+0000","last_change":"2023-12-08T08:19:13.931599+0000","last_active":"2023-12-08T08:19:16.603542+0000","last_peered":"2023-12-08T08:19:16.603542+0000","last_clean":"2023-12-08T08:19:16.603542+0000","last_became_active":"2023-12-08T08:19:13.930881+0000","last_became_peered":"2023-12-08T08:19:13.930881+0000","last_unstale":"2023-12-08T08:19:16.603542+0000","last_undegraded":"2023-12-08T08:19:16.603542+0000","last_fullsized":"2023-12-08T08:19:16.603542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:55:27.166708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.944443+0000","last_change":"2023-12-08T08:18:53.780686+0000","last_active":"2023-12-08T08:19:14.944443+0000","last_peered":"2023-12-08T08:19:14.944443+0000","last_clean":"2023-12-08T08:19:14.944443+0000","last_became_active":"2023-12-08T08:18:53.780408+0000","last_became_peered":"2023-12-08T08:18:53.780408+0000","last_unstale":"2023-12-08T08:19:14.944443+0000","last_undegraded":"2023-12-08T08:19:14.944443+0000","last_fullsized":"2023-12-08T08:19:14.944443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:16:50.587465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.933712+0000","last_change":"2023-12-08T08:18:52.780500+0000","last_active":"2023-12-08T08:19:14.933712+0000","last_peered":"2023-12-08T08:19:14.933712+0000","last_clean":"2023-12-08T08:19:14.933712+0000","last_became_active":"2023-12-08T08:18:52.780227+0000","last_became_peered":"2023-12-08T08:18:52.780227+0000","last_unstale":"2023-12-08T08:19:14.933712+0000","last_undegraded":"2023-12-08T08:19:14.933712+0000","last_fullsized":"2023-12-08T08:19:14.933712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:27:12.525160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602053+0000","last_change":"2023-12-08T08:19:14.970413+0000","last_active":"2023-12-08T08:19:16.602053+0000","last_peered":"2023-12-08T08:19:16.602053+0000","last_clean":"2023-12-08T08:19:16.602053+0000","last_became_active":"2023-12-08T08:19:14.970108+0000","last_became_peered":"2023-12-08T08:19:14.970108+0000","last_unstale":"2023-12-08T08:19:16.602053+0000","last_undegraded":"2023-12-08T08:19:16.602053+0000","last_fullsized":"2023-12-08T08:19:16.602053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:23.141539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.600227+0000","last_change":"2023-12-08T08:19:13.930559+0000","last_active":"2023-12-08T08:19:16.600227+0000","last_peered":"2023-12-08T08:19:16.600227+0000","last_clean":"2023-12-08T08:19:16.600227+0000","last_became_active":"2023-12-08T08:19:13.927544+0000","last_became_peered":"2023-12-08T08:19:13.927544+0000","last_unstale":"2023-12-08T08:19:16.600227+0000","last_undegraded":"2023-12-08T08:19:16.600227+0000","last_fullsized":"2023-12-08T08:19:16.600227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:39.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.948021+0000","last_change":"2023-12-08T08:18:53.774289+0000","last_active":"2023-12-08T08:19:14.948021+0000","last_peered":"2023-12-08T08:19:14.948021+0000","last_clean":"2023-12-08T08:19:14.948021+0000","last_became_active":"2023-12-08T08:18:53.773997+0000","last_became_peered":"2023-12-08T08:18:53.773997+0000","last_unstale":"2023-12-08T08:19:14.948021+0000","last_undegraded":"2023-12-08T08:19:14.948021+0000","last_fullsized":"2023-12-08T08:19:14.948021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:36:57.939378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"78'8","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.934989+0000","last_change":"2023-12-08T08:18:52.768815+0000","last_active":"2023-12-08T08:19:14.934989+0000","last_peered":"2023-12-08T08:19:14.934989+0000","last_clean":"2023-12-08T08:19:14.934989+0000","last_became_active":"2023-12-08T08:18:52.767356+0000","last_became_peered":"2023-12-08T08:18:52.767356+0000","last_unstale":"2023-12-08T08:19:14.934989+0000","last_undegraded":"2023-12-08T08:19:14.934989+0000","last_fullsized":"2023-12-08T08:19:14.934989+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:34:50.401710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603766+0000","last_change":"2023-12-08T08:19:14.964570+0000","last_active":"2023-12-08T08:19:16.603766+0000","last_peered":"2023-12-08T08:19:16.603766+0000","last_clean":"2023-12-08T08:19:16.603766+0000","last_became_active":"2023-12-08T08:19:14.964077+0000","last_became_peered":"2023-12-08T08:19:14.964077+0000","last_unstale":"2023-12-08T08:19:16.603766+0000","last_undegraded":"2023-12-08T08:19:16.603766+0000","last_fullsized":"2023-12-08T08:19:16.603766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:49.079681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601540+0000","last_change":"2023-12-08T08:19:13.944198+0000","last_active":"2023-12-08T08:19:16.601540+0000","last_peered":"2023-12-08T08:19:16.601540+0000","last_clean":"2023-12-08T08:19:16.601540+0000","last_became_active":"2023-12-08T08:19:13.943678+0000","last_became_peered":"2023-12-08T08:19:13.943678+0000","last_unstale":"2023-12-08T08:19:16.601540+0000","last_undegraded":"2023-12-08T08:19:16.601540+0000","last_fullsized":"2023-12-08T08:19:16.601540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:32.447686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943589+0000","last_change":"2023-12-08T08:18:53.791859+0000","last_active":"2023-12-08T08:19:14.943589+0000","last_peered":"2023-12-08T08:19:14.943589+0000","last_clean":"2023-12-08T08:19:14.943589+0000","last_became_active":"2023-12-08T08:18:53.791211+0000","last_became_peered":"2023-12-08T08:18:53.791211+0000","last_unstale":"2023-12-08T08:19:14.943589+0000","last_undegraded":"2023-12-08T08:19:14.943589+0000","last_fullsized":"2023-12-08T08:19:14.943589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:49:58.762577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"78'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.965823+0000","last_change":"2023-12-08T08:18:52.780101+0000","last_active":"2023-12-08T08:19:14.965823+0000","last_peered":"2023-12-08T08:19:14.965823+0000","last_clean":"2023-12-08T08:19:14.965823+0000","last_became_active":"2023-12-08T08:18:52.779101+0000","last_became_peered":"2023-12-08T08:18:52.779101+0000","last_unstale":"2023-12-08T08:19:14.965823+0000","last_undegraded":"2023-12-08T08:19:14.965823+0000","last_fullsized":"2023-12-08T08:19:14.965823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:30.013320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602901+0000","last_change":"2023-12-08T08:19:14.970016+0000","last_active":"2023-12-08T08:19:16.602901+0000","last_peered":"2023-12-08T08:19:16.602901+0000","last_clean":"2023-12-08T08:19:16.602901+0000","last_became_active":"2023-12-08T08:19:14.969623+0000","last_became_peered":"2023-12-08T08:19:14.969623+0000","last_unstale":"2023-12-08T08:19:16.602901+0000","last_undegraded":"2023-12-08T08:19:16.602901+0000","last_fullsized":"2023-12-08T08:19:16.602901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:15:00.262930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.604037+0000","last_change":"2023-12-08T08:19:13.940480+0000","last_active":"2023-12-08T08:19:16.604037+0000","last_peered":"2023-12-08T08:19:16.604037+0000","last_clean":"2023-12-08T08:19:16.604037+0000","last_became_active":"2023-12-08T08:19:13.939553+0000","last_became_peered":"2023-12-08T08:19:13.939553+0000","last_unstale":"2023-12-08T08:19:16.604037+0000","last_undegraded":"2023-12-08T08:19:16.604037+0000","last_fullsized":"2023-12-08T08:19:16.604037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:40.049995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960972+0000","last_change":"2023-12-08T08:18:53.788889+0000","last_active":"2023-12-08T08:19:14.960972+0000","last_peered":"2023-12-08T08:19:14.960972+0000","last_clean":"2023-12-08T08:19:14.960972+0000","last_became_active":"2023-12-08T08:18:53.788322+0000","last_became_peered":"2023-12-08T08:18:53.788322+0000","last_unstale":"2023-12-08T08:19:14.960972+0000","last_undegraded":"2023-12-08T08:19:14.960972+0000","last_fullsized":"2023-12-08T08:19:14.960972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:51.185060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.958166+0000","last_change":"2023-12-08T08:18:52.784626+0000","last_active":"2023-12-08T08:19:14.958166+0000","last_peered":"2023-12-08T08:19:14.958166+0000","last_clean":"2023-12-08T08:19:14.958166+0000","last_became_active":"2023-12-08T08:18:52.784266+0000","last_became_peered":"2023-12-08T08:18:52.784266+0000","last_unstale":"2023-12-08T08:19:14.958166+0000","last_undegraded":"2023-12-08T08:19:14.958166+0000","last_fullsized":"2023-12-08T08:19:14.958166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:34:16.869514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601456+0000","last_change":"2023-12-08T08:19:14.962077+0000","last_active":"2023-12-08T08:19:16.601456+0000","last_peered":"2023-12-08T08:19:16.601456+0000","last_clean":"2023-12-08T08:19:16.601456+0000","last_became_active":"2023-12-08T08:19:14.961444+0000","last_became_peered":"2023-12-08T08:19:14.961444+0000","last_unstale":"2023-12-08T08:19:16.601456+0000","last_undegraded":"2023-12-08T08:19:16.601456+0000","last_fullsized":"2023-12-08T08:19:16.601456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:45:19.501989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"82'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602123+0000","last_change":"2023-12-08T08:19:13.942559+0000","last_active":"2023-12-08T08:19:16.602123+0000","last_peered":"2023-12-08T08:19:16.602123+0000","last_clean":"2023-12-08T08:19:16.602123+0000","last_became_active":"2023-12-08T08:19:13.942160+0000","last_became_peered":"2023-12-08T08:19:13.942160+0000","last_unstale":"2023-12-08T08:19:16.602123+0000","last_undegraded":"2023-12-08T08:19:16.602123+0000","last_fullsized":"2023-12-08T08:19:16.602123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:51.691732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943420+0000","last_change":"2023-12-08T08:18:53.779656+0000","last_active":"2023-12-08T08:19:14.943420+0000","last_peered":"2023-12-08T08:19:14.943420+0000","last_clean":"2023-12-08T08:19:14.943420+0000","last_became_active":"2023-12-08T08:18:53.774380+0000","last_became_peered":"2023-12-08T08:18:53.774380+0000","last_unstale":"2023-12-08T08:19:14.943420+0000","last_undegraded":"2023-12-08T08:19:14.943420+0000","last_fullsized":"2023-12-08T08:19:14.943420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"78'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943952+0000","last_change":"2023-12-08T08:18:52.770626+0000","last_active":"2023-12-08T08:19:14.943952+0000","last_peered":"2023-12-08T08:19:14.943952+0000","last_clean":"2023-12-08T08:19:14.943952+0000","last_became_active":"2023-12-08T08:18:52.769857+0000","last_became_peered":"2023-12-08T08:18:52.769857+0000","last_unstale":"2023-12-08T08:19:14.943952+0000","last_undegraded":"2023-12-08T08:19:14.943952+0000","last_fullsized":"2023-12-08T08:19:14.943952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603239+0000","last_change":"2023-12-08T08:19:14.975757+0000","last_active":"2023-12-08T08:19:16.603239+0000","last_peered":"2023-12-08T08:19:16.603239+0000","last_clean":"2023-12-08T08:19:16.603239+0000","last_became_active":"2023-12-08T08:19:14.975401+0000","last_became_peered":"2023-12-08T08:19:14.975401+0000","last_unstale":"2023-12-08T08:19:16.603239+0000","last_undegraded":"2023-12-08T08:19:16.603239+0000","last_fullsized":"2023-12-08T08:19:16.603239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:33.462828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598478+0000","last_change":"2023-12-08T08:19:13.939857+0000","last_active":"2023-12-08T08:19:16.598478+0000","last_peered":"2023-12-08T08:19:16.598478+0000","last_clean":"2023-12-08T08:19:16.598478+0000","last_became_active":"2023-12-08T08:19:13.938312+0000","last_became_peered":"2023-12-08T08:19:13.938312+0000","last_unstale":"2023-12-08T08:19:16.598478+0000","last_undegraded":"2023-12-08T08:19:16.598478+0000","last_fullsized":"2023-12-08T08:19:16.598478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:40.049995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942010+0000","last_change":"2023-12-08T08:18:53.790829+0000","last_active":"2023-12-08T08:19:14.942010+0000","last_peered":"2023-12-08T08:19:14.942010+0000","last_clean":"2023-12-08T08:19:14.942010+0000","last_became_active":"2023-12-08T08:18:53.790471+0000","last_became_peered":"2023-12-08T08:18:53.790471+0000","last_unstale":"2023-12-08T08:19:14.942010+0000","last_undegraded":"2023-12-08T08:19:14.942010+0000","last_fullsized":"2023-12-08T08:19:14.942010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:37:53.065257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960463+0000","last_change":"2023-12-08T08:18:52.781143+0000","last_active":"2023-12-08T08:19:14.960463+0000","last_peered":"2023-12-08T08:19:14.960463+0000","last_clean":"2023-12-08T08:19:14.960463+0000","last_became_active":"2023-12-08T08:18:52.780865+0000","last_became_peered":"2023-12-08T08:18:52.780865+0000","last_unstale":"2023-12-08T08:19:14.960463+0000","last_undegraded":"2023-12-08T08:19:14.960463+0000","last_fullsized":"2023-12-08T08:19:14.960463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:50.178752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605148+0000","last_change":"2023-12-08T08:19:14.967958+0000","last_active":"2023-12-08T08:19:16.605148+0000","last_peered":"2023-12-08T08:19:16.605148+0000","last_clean":"2023-12-08T08:19:16.605148+0000","last_became_active":"2023-12-08T08:19:14.967656+0000","last_became_peered":"2023-12-08T08:19:14.967656+0000","last_unstale":"2023-12-08T08:19:16.605148+0000","last_undegraded":"2023-12-08T08:19:16.605148+0000","last_fullsized":"2023-12-08T08:19:16.605148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:33.641350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601696+0000","last_change":"2023-12-08T08:19:13.936273+0000","last_active":"2023-12-08T08:19:16.601696+0000","last_peered":"2023-12-08T08:19:16.601696+0000","last_clean":"2023-12-08T08:19:16.601696+0000","last_became_active":"2023-12-08T08:19:13.934452+0000","last_became_peered":"2023-12-08T08:19:13.934452+0000","last_unstale":"2023-12-08T08:19:16.601696+0000","last_undegraded":"2023-12-08T08:19:16.601696+0000","last_fullsized":"2023-12-08T08:19:16.601696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:37.226917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959905+0000","last_change":"2023-12-08T08:18:53.779115+0000","last_active":"2023-12-08T08:19:14.959905+0000","last_peered":"2023-12-08T08:19:14.959905+0000","last_clean":"2023-12-08T08:19:14.959905+0000","last_became_active":"2023-12-08T08:18:53.778078+0000","last_became_peered":"2023-12-08T08:18:53.778078+0000","last_unstale":"2023-12-08T08:19:14.959905+0000","last_undegraded":"2023-12-08T08:19:14.959905+0000","last_fullsized":"2023-12-08T08:19:14.959905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:44:04.654255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.944557+0000","last_change":"2023-12-08T08:18:52.772960+0000","last_active":"2023-12-08T08:19:14.944557+0000","last_peered":"2023-12-08T08:19:14.944557+0000","last_clean":"2023-12-08T08:19:14.944557+0000","last_became_active":"2023-12-08T08:18:52.772660+0000","last_became_peered":"2023-12-08T08:18:52.772660+0000","last_unstale":"2023-12-08T08:19:14.944557+0000","last_undegraded":"2023-12-08T08:19:14.944557+0000","last_fullsized":"2023-12-08T08:19:14.944557+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:55:13.192235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.957498+0000","last_change":"2023-12-08T08:19:14.970771+0000","last_active":"2023-12-08T08:19:15.957498+0000","last_peered":"2023-12-08T08:19:15.957498+0000","last_clean":"2023-12-08T08:19:15.957498+0000","last_became_active":"2023-12-08T08:19:14.970486+0000","last_became_peered":"2023-12-08T08:19:14.970486+0000","last_unstale":"2023-12-08T08:19:15.957498+0000","last_undegraded":"2023-12-08T08:19:15.957498+0000","last_fullsized":"2023-12-08T08:19:15.957498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:27:42.412518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605813+0000","last_change":"2023-12-08T08:19:13.931285+0000","last_active":"2023-12-08T08:19:16.605813+0000","last_peered":"2023-12-08T08:19:16.605813+0000","last_clean":"2023-12-08T08:19:16.605813+0000","last_became_active":"2023-12-08T08:19:13.930995+0000","last_became_peered":"2023-12-08T08:19:13.930995+0000","last_unstale":"2023-12-08T08:19:16.605813+0000","last_undegraded":"2023-12-08T08:19:16.605813+0000","last_fullsized":"2023-12-08T08:19:16.605813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:15:32.845564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.961216+0000","last_change":"2023-12-08T08:18:53.783741+0000","last_active":"2023-12-08T08:19:14.961216+0000","last_peered":"2023-12-08T08:19:14.961216+0000","last_clean":"2023-12-08T08:19:14.961216+0000","last_became_active":"2023-12-08T08:18:53.783368+0000","last_became_peered":"2023-12-08T08:18:53.783368+0000","last_unstale":"2023-12-08T08:19:14.961216+0000","last_undegraded":"2023-12-08T08:19:14.961216+0000","last_fullsized":"2023-12-08T08:19:14.961216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:12:09.708757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.960002+0000","last_change":"2023-12-08T08:18:52.780121+0000","last_active":"2023-12-08T08:19:14.960002+0000","last_peered":"2023-12-08T08:19:14.960002+0000","last_clean":"2023-12-08T08:19:14.960002+0000","last_became_active":"2023-12-08T08:18:52.778349+0000","last_became_peered":"2023-12-08T08:18:52.778349+0000","last_unstale":"2023-12-08T08:19:14.960002+0000","last_undegraded":"2023-12-08T08:19:14.960002+0000","last_fullsized":"2023-12-08T08:19:14.960002+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:11.472054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.957795+0000","last_change":"2023-12-08T08:19:14.949880+0000","last_active":"2023-12-08T08:19:15.957795+0000","last_peered":"2023-12-08T08:19:15.957795+0000","last_clean":"2023-12-08T08:19:15.957795+0000","last_became_active":"2023-12-08T08:19:14.949553+0000","last_became_peered":"2023-12-08T08:19:14.949553+0000","last_unstale":"2023-12-08T08:19:15.957795+0000","last_undegraded":"2023-12-08T08:19:15.957795+0000","last_fullsized":"2023-12-08T08:19:15.957795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:03:02.530380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602025+0000","last_change":"2023-12-08T08:19:13.936821+0000","last_active":"2023-12-08T08:19:16.602025+0000","last_peered":"2023-12-08T08:19:16.602025+0000","last_clean":"2023-12-08T08:19:16.602025+0000","last_became_active":"2023-12-08T08:19:13.935835+0000","last_became_peered":"2023-12-08T08:19:13.935835+0000","last_unstale":"2023-12-08T08:19:16.602025+0000","last_undegraded":"2023-12-08T08:19:16.602025+0000","last_fullsized":"2023-12-08T08:19:16.602025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:32.795899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942826+0000","last_change":"2023-12-08T08:18:53.774648+0000","last_active":"2023-12-08T08:19:14.942826+0000","last_peered":"2023-12-08T08:19:14.942826+0000","last_clean":"2023-12-08T08:19:14.942826+0000","last_became_active":"2023-12-08T08:18:53.774370+0000","last_became_peered":"2023-12-08T08:18:53.774370+0000","last_unstale":"2023-12-08T08:19:14.942826+0000","last_undegraded":"2023-12-08T08:19:14.942826+0000","last_fullsized":"2023-12-08T08:19:14.942826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:12.299840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.951763+0000","last_change":"2023-12-08T08:18:52.777371+0000","last_active":"2023-12-08T08:19:14.951763+0000","last_peered":"2023-12-08T08:19:14.951763+0000","last_clean":"2023-12-08T08:19:14.951763+0000","last_became_active":"2023-12-08T08:18:52.774955+0000","last_became_peered":"2023-12-08T08:18:52.774955+0000","last_unstale":"2023-12-08T08:19:14.951763+0000","last_undegraded":"2023-12-08T08:19:14.951763+0000","last_fullsized":"2023-12-08T08:19:14.951763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:28:18.747307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.599955+0000","last_change":"2023-12-08T08:19:14.971278+0000","last_active":"2023-12-08T08:19:16.599955+0000","last_peered":"2023-12-08T08:19:16.599955+0000","last_clean":"2023-12-08T08:19:16.599955+0000","last_became_active":"2023-12-08T08:19:14.970980+0000","last_became_peered":"2023-12-08T08:19:14.970980+0000","last_unstale":"2023-12-08T08:19:16.599955+0000","last_undegraded":"2023-12-08T08:19:16.599955+0000","last_fullsized":"2023-12-08T08:19:16.599955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:49.079681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601515+0000","last_change":"2023-12-08T08:19:13.935638+0000","last_active":"2023-12-08T08:19:16.601515+0000","last_peered":"2023-12-08T08:19:16.601515+0000","last_clean":"2023-12-08T08:19:16.601515+0000","last_became_active":"2023-12-08T08:19:13.935281+0000","last_became_peered":"2023-12-08T08:19:13.935281+0000","last_unstale":"2023-12-08T08:19:16.601515+0000","last_undegraded":"2023-12-08T08:19:16.601515+0000","last_fullsized":"2023-12-08T08:19:16.601515+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:11:01.639047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.959712+0000","last_change":"2023-12-08T08:18:53.797020+0000","last_active":"2023-12-08T08:19:14.959712+0000","last_peered":"2023-12-08T08:19:14.959712+0000","last_clean":"2023-12-08T08:19:14.959712+0000","last_became_active":"2023-12-08T08:18:53.796346+0000","last_became_peered":"2023-12-08T08:18:53.796346+0000","last_unstale":"2023-12-08T08:19:14.959712+0000","last_undegraded":"2023-12-08T08:19:14.959712+0000","last_fullsized":"2023-12-08T08:19:14.959712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:14.182743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"78'2","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.958132+0000","last_change":"2023-12-08T08:18:52.787903+0000","last_active":"2023-12-08T08:19:14.958132+0000","last_peered":"2023-12-08T08:19:14.958132+0000","last_clean":"2023-12-08T08:19:14.958132+0000","last_became_active":"2023-12-08T08:18:52.787528+0000","last_became_peered":"2023-12-08T08:18:52.787528+0000","last_unstale":"2023-12-08T08:19:14.958132+0000","last_undegraded":"2023-12-08T08:19:14.958132+0000","last_fullsized":"2023-12-08T08:19:14.958132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:38.183707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603027+0000","last_change":"2023-12-08T08:19:14.977387+0000","last_active":"2023-12-08T08:19:16.603027+0000","last_peered":"2023-12-08T08:19:16.603027+0000","last_clean":"2023-12-08T08:19:16.603027+0000","last_became_active":"2023-12-08T08:19:14.976778+0000","last_became_peered":"2023-12-08T08:19:14.976778+0000","last_unstale":"2023-12-08T08:19:16.603027+0000","last_undegraded":"2023-12-08T08:19:16.603027+0000","last_fullsized":"2023-12-08T08:19:16.603027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:46:23.992888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605044+0000","last_change":"2023-12-08T08:19:13.933362+0000","last_active":"2023-12-08T08:19:16.605044+0000","last_peered":"2023-12-08T08:19:16.605044+0000","last_clean":"2023-12-08T08:19:16.605044+0000","last_became_active":"2023-12-08T08:19:13.933071+0000","last_became_peered":"2023-12-08T08:19:13.933071+0000","last_unstale":"2023-12-08T08:19:16.605044+0000","last_undegraded":"2023-12-08T08:19:16.605044+0000","last_fullsized":"2023-12-08T08:19:16.605044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:19:01.936036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942563+0000","last_change":"2023-12-08T08:18:53.797033+0000","last_active":"2023-12-08T08:19:14.942563+0000","last_peered":"2023-12-08T08:19:14.942563+0000","last_clean":"2023-12-08T08:19:14.942563+0000","last_became_active":"2023-12-08T08:18:53.791785+0000","last_became_peered":"2023-12-08T08:18:53.791785+0000","last_unstale":"2023-12-08T08:19:14.942563+0000","last_undegraded":"2023-12-08T08:19:14.942563+0000","last_fullsized":"2023-12-08T08:19:14.942563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:55.940558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"79'1","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.943950+0000","last_change":"2023-12-08T08:18:52.780204+0000","last_active":"2023-12-08T08:19:14.943950+0000","last_peered":"2023-12-08T08:19:14.943950+0000","last_clean":"2023-12-08T08:19:14.943950+0000","last_became_active":"2023-12-08T08:18:52.779727+0000","last_became_peered":"2023-12-08T08:18:52.779727+0000","last_unstale":"2023-12-08T08:19:14.943950+0000","last_undegraded":"2023-12-08T08:19:14.943950+0000","last_fullsized":"2023-12-08T08:19:14.943950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.959150+0000","last_change":"2023-12-08T08:19:14.953914+0000","last_active":"2023-12-08T08:19:15.959150+0000","last_peered":"2023-12-08T08:19:15.959150+0000","last_clean":"2023-12-08T08:19:15.959150+0000","last_became_active":"2023-12-08T08:19:14.953394+0000","last_became_peered":"2023-12-08T08:19:14.953394+0000","last_unstale":"2023-12-08T08:19:15.959150+0000","last_undegraded":"2023-12-08T08:19:15.959150+0000","last_fullsized":"2023-12-08T08:19:15.959150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:46:34.876164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.603922+0000","last_change":"2023-12-08T08:19:13.931821+0000","last_active":"2023-12-08T08:19:16.603922+0000","last_peered":"2023-12-08T08:19:16.603922+0000","last_clean":"2023-12-08T08:19:16.603922+0000","last_became_active":"2023-12-08T08:19:13.930700+0000","last_became_peered":"2023-12-08T08:19:13.930700+0000","last_unstale":"2023-12-08T08:19:16.603922+0000","last_undegraded":"2023-12-08T08:19:16.603922+0000","last_fullsized":"2023-12-08T08:19:16.603922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:49.949043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942587+0000","last_change":"2023-12-08T08:18:53.782490+0000","last_active":"2023-12-08T08:19:14.942587+0000","last_peered":"2023-12-08T08:19:14.942587+0000","last_clean":"2023-12-08T08:19:14.942587+0000","last_became_active":"2023-12-08T08:18:53.778003+0000","last_became_peered":"2023-12-08T08:18:53.778003+0000","last_unstale":"2023-12-08T08:19:14.942587+0000","last_undegraded":"2023-12-08T08:19:14.942587+0000","last_fullsized":"2023-12-08T08:19:14.942587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:32.849547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.944171+0000","last_change":"2023-12-08T08:18:52.767276+0000","last_active":"2023-12-08T08:19:14.944171+0000","last_peered":"2023-12-08T08:19:14.944171+0000","last_clean":"2023-12-08T08:19:14.944171+0000","last_became_active":"2023-12-08T08:18:52.766485+0000","last_became_peered":"2023-12-08T08:18:52.766485+0000","last_unstale":"2023-12-08T08:19:14.944171+0000","last_undegraded":"2023-12-08T08:19:14.944171+0000","last_fullsized":"2023-12-08T08:19:14.944171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:26:39.762936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.962671+0000","last_change":"2023-12-08T08:19:14.964751+0000","last_active":"2023-12-08T08:19:15.962671+0000","last_peered":"2023-12-08T08:19:15.962671+0000","last_clean":"2023-12-08T08:19:15.962671+0000","last_became_active":"2023-12-08T08:19:14.964336+0000","last_became_peered":"2023-12-08T08:19:14.964336+0000","last_unstale":"2023-12-08T08:19:15.962671+0000","last_undegraded":"2023-12-08T08:19:15.962671+0000","last_fullsized":"2023-12-08T08:19:15.962671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:43:47.167235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:17.464563+0000","last_change":"2023-12-08T08:19:13.933757+0000","last_active":"2023-12-08T08:19:17.464563+0000","last_peered":"2023-12-08T08:19:17.464563+0000","last_clean":"2023-12-08T08:19:17.464563+0000","last_became_active":"2023-12-08T08:19:13.932838+0000","last_became_peered":"2023-12-08T08:19:13.932838+0000","last_unstale":"2023-12-08T08:19:17.464563+0000","last_undegraded":"2023-12-08T08:19:17.464563+0000","last_fullsized":"2023-12-08T08:19:17.464563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:47:41.148044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.963958+0000","last_change":"2023-12-08T08:18:53.794202+0000","last_active":"2023-12-08T08:19:14.963958+0000","last_peered":"2023-12-08T08:19:14.963958+0000","last_clean":"2023-12-08T08:19:14.963958+0000","last_became_active":"2023-12-08T08:18:53.791356+0000","last_became_peered":"2023-12-08T08:18:53.791356+0000","last_unstale":"2023-12-08T08:19:14.963958+0000","last_undegraded":"2023-12-08T08:19:14.963958+0000","last_fullsized":"2023-12-08T08:19:14.963958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:43:29.010585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.966273+0000","last_change":"2023-12-08T08:18:52.772559+0000","last_active":"2023-12-08T08:19:14.966273+0000","last_peered":"2023-12-08T08:19:14.966273+0000","last_clean":"2023-12-08T08:19:14.966273+0000","last_became_active":"2023-12-08T08:18:52.771986+0000","last_became_peered":"2023-12-08T08:18:52.771986+0000","last_unstale":"2023-12-08T08:19:14.966273+0000","last_undegraded":"2023-12-08T08:19:14.966273+0000","last_fullsized":"2023-12-08T08:19:14.966273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:44:57.332692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602221+0000","last_change":"2023-12-08T08:19:14.977247+0000","last_active":"2023-12-08T08:19:16.602221+0000","last_peered":"2023-12-08T08:19:16.602221+0000","last_clean":"2023-12-08T08:19:16.602221+0000","last_became_active":"2023-12-08T08:19:14.975897+0000","last_became_peered":"2023-12-08T08:19:14.975897+0000","last_unstale":"2023-12-08T08:19:16.602221+0000","last_undegraded":"2023-12-08T08:19:16.602221+0000","last_fullsized":"2023-12-08T08:19:16.602221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:21:17.103547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598710+0000","last_change":"2023-12-08T08:19:13.938031+0000","last_active":"2023-12-08T08:19:16.598710+0000","last_peered":"2023-12-08T08:19:16.598710+0000","last_clean":"2023-12-08T08:19:16.598710+0000","last_became_active":"2023-12-08T08:19:13.937716+0000","last_became_peered":"2023-12-08T08:19:13.937716+0000","last_unstale":"2023-12-08T08:19:16.598710+0000","last_undegraded":"2023-12-08T08:19:16.598710+0000","last_fullsized":"2023-12-08T08:19:16.598710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:46.404258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.951673+0000","last_change":"2023-12-08T08:18:53.772714+0000","last_active":"2023-12-08T08:19:14.951673+0000","last_peered":"2023-12-08T08:19:14.951673+0000","last_clean":"2023-12-08T08:19:14.951673+0000","last_became_active":"2023-12-08T08:18:53.772434+0000","last_became_peered":"2023-12-08T08:18:53.772434+0000","last_unstale":"2023-12-08T08:19:14.951673+0000","last_undegraded":"2023-12-08T08:19:14.951673+0000","last_fullsized":"2023-12-08T08:19:14.951673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:22:31.251454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942991+0000","last_change":"2023-12-08T08:18:52.774119+0000","last_active":"2023-12-08T08:19:14.942991+0000","last_peered":"2023-12-08T08:19:14.942991+0000","last_clean":"2023-12-08T08:19:14.942991+0000","last_became_active":"2023-12-08T08:18:52.773855+0000","last_became_peered":"2023-12-08T08:18:52.773855+0000","last_unstale":"2023-12-08T08:19:14.942991+0000","last_undegraded":"2023-12-08T08:19:14.942991+0000","last_fullsized":"2023-12-08T08:19:14.942991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:22:27.663212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605015+0000","last_change":"2023-12-08T08:19:14.979285+0000","last_active":"2023-12-08T08:19:16.605015+0000","last_peered":"2023-12-08T08:19:16.605015+0000","last_clean":"2023-12-08T08:19:16.605015+0000","last_became_active":"2023-12-08T08:19:14.978955+0000","last_became_peered":"2023-12-08T08:19:14.978955+0000","last_unstale":"2023-12-08T08:19:16.605015+0000","last_undegraded":"2023-12-08T08:19:16.605015+0000","last_fullsized":"2023-12-08T08:19:16.605015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:20:23.141539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601920+0000","last_change":"2023-12-08T08:19:13.939729+0000","last_active":"2023-12-08T08:19:16.601920+0000","last_peered":"2023-12-08T08:19:16.601920+0000","last_clean":"2023-12-08T08:19:16.601920+0000","last_became_active":"2023-12-08T08:19:13.939296+0000","last_became_peered":"2023-12-08T08:19:13.939296+0000","last_unstale":"2023-12-08T08:19:16.601920+0000","last_undegraded":"2023-12-08T08:19:16.601920+0000","last_fullsized":"2023-12-08T08:19:16.601920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:06:13.795221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.951243+0000","last_change":"2023-12-08T08:18:53.776698+0000","last_active":"2023-12-08T08:19:14.951243+0000","last_peered":"2023-12-08T08:19:14.951243+0000","last_clean":"2023-12-08T08:19:14.951243+0000","last_became_active":"2023-12-08T08:18:53.776407+0000","last_became_peered":"2023-12-08T08:18:53.776407+0000","last_unstale":"2023-12-08T08:19:14.951243+0000","last_undegraded":"2023-12-08T08:19:14.951243+0000","last_fullsized":"2023-12-08T08:19:14.951243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:58:39.190015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.961306+0000","last_change":"2023-12-08T08:18:52.779279+0000","last_active":"2023-12-08T08:19:14.961306+0000","last_peered":"2023-12-08T08:19:14.961306+0000","last_clean":"2023-12-08T08:19:14.961306+0000","last_became_active":"2023-12-08T08:18:52.778978+0000","last_became_peered":"2023-12-08T08:18:52.778978+0000","last_unstale":"2023-12-08T08:19:14.961306+0000","last_undegraded":"2023-12-08T08:19:14.961306+0000","last_fullsized":"2023-12-08T08:19:14.961306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:40:13.176435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.601607+0000","last_change":"2023-12-08T08:19:14.959848+0000","last_active":"2023-12-08T08:19:16.601607+0000","last_peered":"2023-12-08T08:19:16.601607+0000","last_clean":"2023-12-08T08:19:16.601607+0000","last_became_active":"2023-12-08T08:19:14.959557+0000","last_became_peered":"2023-12-08T08:19:14.959557+0000","last_unstale":"2023-12-08T08:19:16.601607+0000","last_undegraded":"2023-12-08T08:19:16.601607+0000","last_fullsized":"2023-12-08T08:19:16.601607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:01.050120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:15.963335+0000","last_change":"2023-12-08T08:19:13.940014+0000","last_active":"2023-12-08T08:19:15.963335+0000","last_peered":"2023-12-08T08:19:15.963335+0000","last_clean":"2023-12-08T08:19:15.963335+0000","last_became_active":"2023-12-08T08:19:13.939240+0000","last_became_peered":"2023-12-08T08:19:13.939240+0000","last_unstale":"2023-12-08T08:19:15.963335+0000","last_undegraded":"2023-12-08T08:19:15.963335+0000","last_fullsized":"2023-12-08T08:19:15.963335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:22:24.696608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957724+0000","last_change":"2023-12-08T08:18:53.793867+0000","last_active":"2023-12-08T08:19:14.957724+0000","last_peered":"2023-12-08T08:19:14.957724+0000","last_clean":"2023-12-08T08:19:14.957724+0000","last_became_active":"2023-12-08T08:18:53.793487+0000","last_became_peered":"2023-12-08T08:18:53.793487+0000","last_unstale":"2023-12-08T08:19:14.957724+0000","last_undegraded":"2023-12-08T08:19:14.957724+0000","last_fullsized":"2023-12-08T08:19:14.957724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:14.065977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.957699+0000","last_change":"2023-12-08T08:18:52.775993+0000","last_active":"2023-12-08T08:19:14.957699+0000","last_peered":"2023-12-08T08:19:14.957699+0000","last_clean":"2023-12-08T08:19:14.957699+0000","last_became_active":"2023-12-08T08:18:52.775713+0000","last_became_peered":"2023-12-08T08:18:52.775713+0000","last_unstale":"2023-12-08T08:19:14.957699+0000","last_undegraded":"2023-12-08T08:19:14.957699+0000","last_fullsized":"2023-12-08T08:19:14.957699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:09:27.546443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602495+0000","last_change":"2023-12-08T08:19:14.962563+0000","last_active":"2023-12-08T08:19:16.602495+0000","last_peered":"2023-12-08T08:19:16.602495+0000","last_clean":"2023-12-08T08:19:16.602495+0000","last_became_active":"2023-12-08T08:19:14.962209+0000","last_became_peered":"2023-12-08T08:19:14.962209+0000","last_unstale":"2023-12-08T08:19:16.602495+0000","last_undegraded":"2023-12-08T08:19:16.602495+0000","last_fullsized":"2023-12-08T08:19:16.602495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:49:52.182616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.602315+0000","last_change":"2023-12-08T08:19:13.936906+0000","last_active":"2023-12-08T08:19:16.602315+0000","last_peered":"2023-12-08T08:19:16.602315+0000","last_clean":"2023-12-08T08:19:16.602315+0000","last_became_active":"2023-12-08T08:19:13.936619+0000","last_became_peered":"2023-12-08T08:19:13.936619+0000","last_unstale":"2023-12-08T08:19:16.602315+0000","last_undegraded":"2023-12-08T08:19:16.602315+0000","last_fullsized":"2023-12-08T08:19:16.602315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:10:45.286889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.942909+0000","last_change":"2023-12-08T08:18:53.783184+0000","last_active":"2023-12-08T08:19:14.942909+0000","last_peered":"2023-12-08T08:19:14.942909+0000","last_clean":"2023-12-08T08:19:14.942909+0000","last_became_active":"2023-12-08T08:18:53.782914+0000","last_became_peered":"2023-12-08T08:18:53.782914+0000","last_unstale":"2023-12-08T08:19:14.942909+0000","last_undegraded":"2023-12-08T08:19:14.942909+0000","last_fullsized":"2023-12-08T08:19:14.942909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:58:21.451598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.956387+0000","last_change":"2023-12-08T08:18:52.783037+0000","last_active":"2023-12-08T08:19:14.956387+0000","last_peered":"2023-12-08T08:19:14.956387+0000","last_clean":"2023-12-08T08:19:14.956387+0000","last_became_active":"2023-12-08T08:18:52.782742+0000","last_became_peered":"2023-12-08T08:18:52.782742+0000","last_unstale":"2023-12-08T08:19:14.956387+0000","last_undegraded":"2023-12-08T08:19:14.956387+0000","last_fullsized":"2023-12-08T08:19:14.956387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:36:41.073698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.598318+0000","last_change":"2023-12-08T08:19:14.967989+0000","last_active":"2023-12-08T08:19:16.598318+0000","last_peered":"2023-12-08T08:19:16.598318+0000","last_clean":"2023-12-08T08:19:16.598318+0000","last_became_active":"2023-12-08T08:19:14.967708+0000","last_became_peered":"2023-12-08T08:19:14.967708+0000","last_unstale":"2023-12-08T08:19:16.598318+0000","last_undegraded":"2023-12-08T08:19:16.598318+0000","last_fullsized":"2023-12-08T08:19:16.598318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:13.890246+0000","last_clean_scrub_stamp":"2023-12-08T08:19:13.890246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:13:52.706874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"82'2","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-08T08:19:16.605267+0000","last_change":"2023-12-08T08:19:13.935658+0000","last_active":"2023-12-08T08:19:16.605267+0000","last_peered":"2023-12-08T08:19:16.605267+0000","last_clean":"2023-12-08T08:19:16.605267+0000","last_became_active":"2023-12-08T08:19:13.935378+0000","last_became_peered":"2023-12-08T08:19:13.935378+0000","last_unstale":"2023-12-08T08:19:16.605267+0000","last_undegraded":"2023-12-08T08:19:16.605267+0000","last_fullsized":"2023-12-08T08:19:16.605267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:12.875104+0000","last_clean_scrub_stamp":"2023-12-08T08:19:12.875104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:59:29.773276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.958039+0000","last_change":"2023-12-08T08:18:53.784995+0000","last_active":"2023-12-08T08:19:14.958039+0000","last_peered":"2023-12-08T08:19:14.958039+0000","last_clean":"2023-12-08T08:19:14.958039+0000","last_became_active":"2023-12-08T08:18:53.784770+0000","last_became_peered":"2023-12-08T08:18:53.784770+0000","last_unstale":"2023-12-08T08:19:14.958039+0000","last_undegraded":"2023-12-08T08:19:14.958039+0000","last_fullsized":"2023-12-08T08:19:14.958039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:52.727257+0000","last_clean_scrub_stamp":"2023-12-08T08:18:52.727257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:48:54.331306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.935149+0000","last_change":"2023-12-08T08:18:52.782170+0000","last_active":"2023-12-08T08:19:14.935149+0000","last_peered":"2023-12-08T08:19:14.935149+0000","last_clean":"2023-12-08T08:19:14.935149+0000","last_became_active":"2023-12-08T08:18:52.781621+0000","last_became_peered":"2023-12-08T08:18:52.781621+0000","last_unstale":"2023-12-08T08:19:14.935149+0000","last_undegraded":"2023-12-08T08:19:14.935149+0000","last_fullsized":"2023-12-08T08:19:14.935149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:51.720950+0000","last_clean_scrub_stamp":"2023-12-08T08:18:51.720950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:56:14.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.956495+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:19:14.956495+0000","last_peered":"2023-12-08T08:19:14.956495+0000","last_clean":"2023-12-08T08:19:14.956495+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:19:14.956495+0000","last_undegraded":"2023-12-08T08:19:14.956495+0000","last_fullsized":"2023-12-08T08:19:14.956495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542199,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":1072747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.099,"15min":1.0840000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.823,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.4610000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.1479999999999999},"min":{"1min":0.66900000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.6599999999999999,"5min":1.794,"15min":1.794},"last":1.694},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2090000000000001,"15min":1.2350000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.044}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1619999999999999,"15min":1.173},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8680000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.861},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.198,"15min":1.198},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.6639999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.284}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2989999999999999,"15min":1.3240000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.077,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.367,"15min":1.4059999999999999},"min":{"1min":0.76200000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.728,"5min":3.524,"15min":3.524},"last":1.5209999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.367,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.591},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.365,"15min":1.355},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.974,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.97}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.4950000000000001,"15min":1.45},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5229999999999999,"15min":1.5089999999999999},"min":{"1min":0.71899999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.758,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":2.0739999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6419999999999999,"5min":1.6279999999999999,"15min":1.6519999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7360000000000002,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":2.032},{"interface":"front","average":{"1min":1.585,"5min":1.6040000000000001,"15min":1.6060000000000001},"min":{"1min":0.748,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.347,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.157}]}]},{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":488090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.444,"15min":1.7549999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.6319999999999997,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4910000000000001,"15min":1.8600000000000001},"min":{"1min":0.749,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.835,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.1899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.179,"15min":1.127},"min":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.5620000000000003,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.82399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":7.2539999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.2829999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.2490000000000001,"15min":1.2450000000000001},"min":{"1min":0.754,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.296,"15min":1.276},"min":{"1min":0.83599999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.127}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.319,"15min":1.399},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.8919999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.528,"5min":1.347,"15min":1.385},"min":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.6150000000000002,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.5820000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.3620000000000001,"15min":1.3560000000000001},"min":{"1min":0.87,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.4370000000000003,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.4059999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.0430000000000001,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":1.073}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4450000000000001,"15min":1.486},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":8.0039999999999996,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.639},{"interface":"front","average":{"1min":1.496,"5min":1.4890000000000001,"15min":1.4910000000000001},"min":{"1min":0.95699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.335}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5029999999999999,"15min":1.492},"min":{"1min":0.99199999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":7.1989999999999998,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.407},{"interface":"front","average":{"1min":1.776,"5min":1.579,"15min":1.609},"min":{"1min":1.0800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":8.532,"5min":8.532,"15min":8.532},"last":1.6870000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542199,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":482163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98799999999999999,"15min":0.95699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8100000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0549999999999999,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.89800000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.0800000000000001,"15min":1.0229999999999999},"min":{"1min":0.73299999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8049999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.641},{"interface":"front","average":{"1min":1.046,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.53300000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.5,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1859999999999999,"15min":1.1899999999999999},"min":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.1970000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3260000000000001,"15min":1.3460000000000001},"min":{"1min":0.95999999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":1.96,"15min":1.96},"last":1.095},{"interface":"front","average":{"1min":1.383,"5min":1.4019999999999999,"15min":1.4219999999999999},"min":{"1min":0.88800000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.96,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.4550000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2549999999999999,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.665,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.165},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":0.80300000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.2490000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.411,"15min":1.403},"min":{"1min":0.73599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.393,"15min":1.421},"min":{"1min":0.84299999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.7549999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.514,"15min":1.4790000000000001},"min":{"1min":0.86499999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4950000000000001,"5min":3.242,"15min":3.242},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.536,"15min":1.518},"min":{"1min":0.82399999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.704}]}]},{"osd":4,"up_from":14,"seq":60129542199,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":482415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0409999999999999,"15min":1.0129999999999999},"min":{"1min":0.72699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.54,"5min":1.776,"15min":1.776},"last":1.982},{"interface":"front","average":{"1min":1.042,"5min":1.109,"15min":1.143},"min":{"1min":0.65400000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5600000000000001,"5min":2.335,"15min":2.335},"last":1.069}]},{"osd":1,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.86699999999999999,"5min":0.626,"15min":0.626},"max":{"1min":1.5109999999999999,"5min":1.958,"15min":1.958},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.76500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.6040000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.319}]},{"osd":2,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.2050000000000001,"15min":1.2370000000000001},"min":{"1min":0.80600000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.9319999999999999,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3580000000000001,"15min":1.397},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8200000000000001,"5min":2.456,"15min":2.456},"last":1.875}]},{"osd":3,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.232,"15min":1.218},"min":{"1min":0.82299999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8080000000000001,"5min":1.871,"15min":1.871},"last":1.764},{"interface":"front","average":{"1min":1.381,"5min":1.327,"15min":1.3129999999999999},"min":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.831,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":2.1440000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.4059999999999999,"15min":1.4630000000000001},"min":{"1min":0.94099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.669,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":2.097},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.361,"15min":1.421},"min":{"1min":0.89700000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.798,"5min":2.137,"15min":2.137},"last":1.4730000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.407,"15min":1.4830000000000001},"min":{"1min":0.84299999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9350000000000001,"5min":3.016,"15min":3.016},"last":1.133},{"interface":"front","average":{"1min":1.413,"5min":1.5029999999999999,"15min":1.5660000000000001},"min":{"1min":0.93000000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.802,"5min":2.54,"15min":2.54},"last":1.5980000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:18:57 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.5229999999999999,"15min":1.581},"min":{"1min":1.0660000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7709999999999999,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.917},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.609,"15min":1.669},"min":{"1min":1.1599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":2.1200000000000001,"5min":3.141,"15min":3.141},"last":2.1970000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":482745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.89400000000000002,"15min":0.94499999999999995},"min":{"1min":0.47899999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2490000000000001,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.95299999999999996,"15min":1.0189999999999999},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.484,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.196}]},{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.96199999999999997,"15min":0.98199999999999998},"min":{"1min":0.51900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5369999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.079,"15min":1.1140000000000001},"min":{"1min":0.60899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6479999999999999,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0800000000000001,"15min":1.113},"min":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8149999999999999,"5min":2.121,"15min":2.121},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.165},"min":{"1min":0.60499999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.613,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1379999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.202,"15min":1.1839999999999999},"min":{"1min":0.83399999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8420000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3360000000000001,"15min":1.361},"min":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.8640000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.5860000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.401,"15min":1.4750000000000001},"min":{"1min":0.97199999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.8100000000000001,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":0.79300000000000004,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.919,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3779999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4330000000000001,"15min":1.4450000000000001},"min":{"1min":0.85299999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9470000000000001,"5min":2.25,"15min":2.25},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.49,"15min":1.5620000000000001},"min":{"1min":0.83299999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.8180000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.623}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.448,"15min":1.48},"min":{"1min":0.85299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.9299999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.5580000000000001,"15min":1.605},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0649999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6950000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":482197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.80600000000000005,"15min":0.78700000000000003},"min":{"1min":0.45300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.772,"5min":1.948,"15min":1.948},"last":1.171},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.95099999999999996,"15min":0.90700000000000003},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4370000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.546,"5min":2.996,"15min":2.996},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.0049999999999999,"15min":0.96899999999999997},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.9390000000000001,"5min":2.238,"15min":2.238},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0389999999999999,"15min":1.0049999999999999},"min":{"1min":0.68500000000000005,"5min":0.436,"15min":0.436},"max":{"1min":1.6819999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.0920000000000001,"15min":1.0620000000000001},"min":{"1min":0.68200000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.718,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.3300000000000001,"15min":1.3200000000000001},"min":{"1min":0.82899999999999996,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9359999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3600000000000001,"15min":1.389},"min":{"1min":0.86299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8819999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.2}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.3799999999999999,"15min":1.3779999999999999},"min":{"1min":0.99399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.3530000000000002,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.034},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.401,"15min":1.407},"min":{"1min":0.89400000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.1080000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.252}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4239999999999999,"15min":1.4299999999999999},"min":{"1min":0.78400000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.3140000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.339},{"interface":"front","average":{"1min":1.522,"5min":1.425,"15min":1.421},"min":{"1min":0.92400000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.4950000000000001,"15min":1.4710000000000001},"min":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.0760000000000001,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.516,"15min":1.51},"min":{"1min":1.0149999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2549999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.2849999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1028096,"data_stored":482267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":1.2210000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.0700000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.462},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":1.3580000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":1.325}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.502},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.377}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.579},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.4390000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.544},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.419}]}]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1654784,"data_stored":1078046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86599999999999999,"15min":0.86699999999999999},"min":{"1min":0.503,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.369,"5min":2.194,"15min":2.194},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0740000000000001},"min":{"1min":0.56000000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.6619999999999999,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":0.97499999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.099,"15min":1.151},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4930000000000001,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.155},{"interface":"front","average":{"1min":1.01,"5min":1.0960000000000001,"15min":1.1579999999999999},"min":{"1min":0.52300000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3280000000000001,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":1.381}]},{"osd":3,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1,"15min":1.091},"min":{"1min":0.48199999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4059999999999999,"5min":2.5350000000000001,"15min":2.5350000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2410000000000001,"15min":1.2969999999999999},"min":{"1min":0.61099999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.9490000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.2390000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.391,"15min":1.4810000000000001},"min":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.712,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.264,"15min":1.325},"min":{"1min":0.85099999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.593,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.343}]},{"osd":5,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.365,"15min":1.431},"min":{"1min":0.873,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.6910000000000001,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.389,"15min":1.401},"min":{"1min":0.79400000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":2.5449999999999999,"15min":2.5449999999999999},"last":1.649}]},{"osd":6,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5009999999999999,"15min":1.5349999999999999},"min":{"1min":1.1200000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.831,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.585},"min":{"1min":0.86499999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.7989999999999999,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":1.49}]},{"osd":7,"last update":"Fri Dec 8 08:18:59 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.5549999999999999,"15min":1.6499999999999999},"min":{"1min":1.0669999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.0920000000000001,"5min":4.6559999999999997,"15min":4.6559999999999997},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4770000000000001,"15min":1.542},"min":{"1min":0.76800000000000002,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.804,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2929999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:20.088 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:19:20.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-08T08:19:20.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.351+0000 7fb758448640 1 Processor -- start 2023-12-08T08:19:20.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.352+0000 7fb758448640 1 -- start start 2023-12-08T08:19:20.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb758448640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7500aaf60 0x7fb7500c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb758448640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb750152660 con 0x7fb7500c1930 2023-12-08T08:19:20.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb758448640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb750153200 con 0x7fb75006d960 2023-12-08T08:19:20.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb758448640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7500a4d10 con 0x7fb7500aaf60 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb7561e4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7500aaf60 0x7fb7500c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb7569e5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb7500c1930 0x7fb75015cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52554/0 (socket says 172.21.15.45:52554) 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.353+0000 7fb7569e5640 1 -- 172.21.15.45:0/604370396 learned_addr learned my addr 172.21.15.45:0/604370396 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.354+0000 7fb7561e4640 1 -- 172.21.15.45:0/604370396 >> v1:172.21.15.114:6789/0 conn(0x7fb75006d960 legacy=0x7fb750152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.354+0000 7fb7561e4640 1 -- 172.21.15.45:0/604370396 >> v1:172.21.15.45:6789/0 conn(0x7fb7500c1930 legacy=0x7fb75015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.354+0000 7fb7551e2640 1 -- 172.21.15.45:0/604370396 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939736979 0 0) 0x7fb750152660 con 0x7fb7500c1930 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.354+0000 7fb7561e4640 1 -- 172.21.15.45:0/604370396 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500c3310 con 0x7fb7500aaf60 2023-12-08T08:19:20.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.355+0000 7fb7561e4640 1 --2- 172.21.15.45:0/604370396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7500aaf60 0x7fb7500c3830 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009d90 tx=0x7fb74c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40503c72a621592a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.355+0000 7fb7551e2640 1 -- 172.21.15.45:0/604370396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c02cbd0 con 0x7fb7500aaf60 2023-12-08T08:19:20.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.355+0000 7fb7551e2640 1 -- 172.21.15.45:0/604370396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c02cd30 con 0x7fb7500aaf60 2023-12-08T08:19:20.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.355+0000 7fb7551e2640 1 -- 172.21.15.45:0/604370396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c02cea0 con 0x7fb7500aaf60 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 -- 172.21.15.45:0/604370396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7500aaf60 msgr2=0x7fb7500c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 --2- 172.21.15.45:0/604370396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7500aaf60 0x7fb7500c3830 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009d90 tx=0x7fb74c02be20 comp rx=0 tx=0).stop 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 -- 172.21.15.45:0/604370396 shutdown_connections 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 --2- 172.21.15.45:0/604370396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7500aaf60 0x7fb7500c3830 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 -- 172.21.15.45:0/604370396 >> 172.21.15.45:0/604370396 conn(0x7fb7500c2430 msgr2=0x7fb7500c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 -- 172.21.15.45:0/604370396 shutdown_connections 2023-12-08T08:19:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.356+0000 7fb758448640 1 -- 172.21.15.45:0/604370396 wait complete. 2023-12-08T08:19:20.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.358+0000 7fb758448640 1 Processor -- start 2023-12-08T08:19:20.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.358+0000 7fb758448640 1 -- start start 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7500aaf60 0x7fb750150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7500c1930 0x7fb7501536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501ea3c0 con 0x7fb75006d960 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501e9d20 con 0x7fb7500c1930 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb758448640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501edd40 con 0x7fb7500aaf60 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb7561e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb7561e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33950/0 (socket says 172.21.15.45:33950) 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.359+0000 7fb7561e4640 1 -- 172.21.15.45:0/2708165627 learned_addr learned my addr 172.21.15.45:0/2708165627 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7559e3640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7500aaf60 0x7fb750150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7569e5640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7500c1930 0x7fb7501536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 -- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7500aaf60 msgr2=0x7fb750150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7500aaf60 0x7fb750150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 -- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7500c1930 msgr2=0x7fb7501536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7500c1930 0x7fb7501536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 -- 172.21.15.45:0/2708165627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c009a70 con 0x7fb75006d960 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb7561e4640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009d90 tx=0x7fb74c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c02cea0 con 0x7fb75006d960 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c03e610 con 0x7fb75006d960 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7501ee020 con 0x7fb75006d960 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.360+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c03e9c0 con 0x7fb75006d960 2023-12-08T08:19:20.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.361+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750150ac0 con 0x7fb75006d960 2023-12-08T08:19:20.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.362+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7500a6650 con 0x7fb75006d960 2023-12-08T08:19:20.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.363+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb74c03b050 con 0x7fb75006d960 2023-12-08T08:19:20.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.363+0000 7fb746ffd640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.364+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb74c0ac3a0 con 0x7fb75006d960 2023-12-08T08:19:20.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.364+0000 7fb7559e3640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.365+0000 7fb7559e3640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 0x7fb73406d300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb740006fd0 tx=0x7fb740008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.368+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb74c077040 con 0x7fb75006d960 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.626+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fb750074670 con 0x7fb75006d960 2023-12-08T08:19:20.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.630+0000 7fb746ffd640 1 -- 172.21.15.45:0/2708165627 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v24) v1 ==== 185+0+142 (secure 0 0 0) 0x7fb74c07a660 con 0x7fb75006d960 2023-12-08T08:19:20.633 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-08T08:19:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBL0HJlULaIABAAmWm0u3FYd7vBt77fx0gSfA== 2023-12-08T08:19:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-12-08T08:19:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:19:20.634 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-08T08:19:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.1 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 msgr2=0x7fb73406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 0x7fb73406d300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb740006fd0 tx=0x7fb740008040 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 msgr2=0x7fb7501ea7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009d90 tx=0x7fb74c004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 shutdown_connections 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7500aaf60 0x7fb750150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7500c1930 0x7fb7501536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 --2- 172.21.15.45:0/2708165627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb75006d960 0x7fb7501ea7e0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 >> 172.21.15.45:0/2708165627 conn(0x7fb7500c2430 msgr2=0x7fb7500c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 shutdown_connections 2023-12-08T08:19:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.634+0000 7fb758448640 1 -- 172.21.15.45:0/2708165627 wait complete. 2023-12-08T08:19:20.655 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:20.655 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:20.715 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:20.716 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:20.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:20.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.991+0000 7f0149078640 1 Processor -- start 2023-12-08T08:19:20.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.991+0000 7f0149078640 1 -- start start 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.992+0000 7f0149078640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0144151aa0 0x7f014406a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f0149078640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0144158a90 con 0x7f01440a5e40 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f0149078640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0144157e80 con 0x7f014406aab0 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f0149078640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0144158160 con 0x7f0144151aa0 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f013bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01440a5e40 0x7f0144154830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52562/0 (socket says 172.21.15.45:52562) 2023-12-08T08:19:21.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f013bfff640 1 -- 172.21.15.45:0/149685531 learned_addr learned my addr 172.21.15.45:0/149685531 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f0143fff640 1 --2- 172.21.15.45:0/149685531 >> v2:172.21.15.114:3300/0 conn(0x7f0144151aa0 0x7f014406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037872723 0 0) 0x7f0144158a90 con 0x7f01440a5e40 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.993+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0130003520 con 0x7f01440a5e40 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978252309 0 0) 0x7f0130003520 con 0x7f01440a5e40 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 >> v2:172.21.15.114:3300/0 conn(0x7f0144151aa0 msgr2=0x7f014406a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 --2- 172.21.15.45:0/149685531 >> v2:172.21.15.114:3300/0 conn(0x7f0144151aa0 0x7f014406a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 >> v1:172.21.15.114:6789/0 conn(0x7f014406aab0 legacy=0x7f0144154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0144158440 con 0x7f01440a5e40 2023-12-08T08:19:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f012c001690 con 0x7f01440a5e40 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 >> v1:172.21.15.45:6789/0 conn(0x7f01440a5e40 legacy=0x7f0144154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0130003970 0x7f0130003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f0130004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01300052a0 0x7f013000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144158160 con 0x7f01300047c0 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013000c170 con 0x7f0130003970 2023-12-08T08:19:21.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013000c330 con 0x7f01300052a0 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.994+0000 7f013bfff640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f0130004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f013bfff640 1 -- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01300052a0 msgr2=0x7f013000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f0143fff640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0130003970 0x7f0130003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f0148877640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01300052a0 0x7f013000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f013bfff640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01300052a0 0x7f013000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f013bfff640 1 -- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0130003970 msgr2=0x7f0130003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f013bfff640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0130003970 0x7f0130003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f013bfff640 1 -- 172.21.15.45:0/149685531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130003520 con 0x7f01300047c0 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.995+0000 7f0148877640 1 -- 172.21.15.45:0/149685531 reap_dead start 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.996+0000 7f013bfff640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f0130004c40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f012c001eb0 tx=0x7f01300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78d948dc1f508a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.996+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c005ad0 con 0x7f01300047c0 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.996+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c005c30 con 0x7f01300047c0 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.996+0000 7f01437fe640 1 -- 172.21.15.45:0/149685531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c02ca50 con 0x7f01300047c0 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 -- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 msgr2=0x7f0130004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f0130004c40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f012c001eb0 tx=0x7f01300057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 -- 172.21.15.45:0/149685531 shutdown_connections 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 --2- 172.21.15.45:0/149685531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f0130004c40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 -- 172.21.15.45:0/149685531 >> 172.21.15.45:0/149685531 conn(0x7f01440a87f0 msgr2=0x7f01440a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 -- 172.21.15.45:0/149685531 shutdown_connections 2023-12-08T08:19:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.997+0000 7f0149078640 1 -- 172.21.15.45:0/149685531 wait complete. 2023-12-08T08:19:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.999+0000 7f0149078640 1 Processor -- start 2023-12-08T08:19:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:20.999+0000 7f0149078640 1 -- start start 2023-12-08T08:19:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0144155bc0 0x7f0144145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01441e9980 0x7f01441e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014406e210 con 0x7f01300047c0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440ac9d0 con 0x7f0144155bc0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0149078640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014406e740 con 0x7f01441e9980 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0143fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0143fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33968/0 (socket says 172.21.15.45:33968) 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.000+0000 7f0143fff640 1 -- 172.21.15.45:0/2937712518 learned_addr learned my addr 172.21.15.45:0/2937712518 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 -- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01441e9980 msgr2=0x7f01441e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01441e9980 0x7f01441e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f013bfff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0144155bc0 0x7f0144145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 -- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0144155bc0 msgr2=0x7f0144145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0144155bc0 0x7f0144145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 -- 172.21.15.45:0/2937712518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014406d4e0 con 0x7f01300047c0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0143fff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f01340108e0 tx=0x7f0134010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400eb60 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400ecc0 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014406d7c0 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.001+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013401c400 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.002+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0144146320 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.003+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440678c0 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.004+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f013401c560 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.004+0000 7f01417fa640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 0x7f012406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.005+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f013408a140 con 0x7f01300047c0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.005+0000 7f013bfff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 0x7f012406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.006+0000 7f013bfff640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 0x7f012406d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f012c034000 tx=0x7f012c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.009+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0134054dc0 con 0x7f01300047c0 2023-12-08T08:19:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.204+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0144157ae0 con 0x7f01300047c0 2023-12-08T08:19:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.206+0000 7f01417fa640 1 -- 172.21.15.45:0/2937712518 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f01340583e0 con 0x7f01300047c0 2023-12-08T08:19:21.209 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:21.210 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 msgr2=0x7f012406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 0x7f012406d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f012c034000 tx=0x7f012c009030 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 msgr2=0x7f01441573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f01340108e0 tx=0x7f0134010da0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 shutdown_connections 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f012406ae40 0x7f012406d300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01441e9980 0x7f01441e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0144155bc0 0x7f0144145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 --2- 172.21.15.45:0/2937712518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01300047c0 0x7f01441573d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 >> 172.21.15.45:0/2937712518 conn(0x7f01440a87f0 msgr2=0x7f01441551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 shutdown_connections 2023-12-08T08:19:21.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.209+0000 7f0149078640 1 -- 172.21.15.45:0/2937712518 wait complete. 2023-12-08T08:19:21.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:21.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.466+0000 7f022cc2e640 1 Processor -- start 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.466+0000 7f022cc2e640 1 -- start start 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.467+0000 7f022cc2e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f0228156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.467+0000 7f022cc2e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02280c3220 con 0x7f02281532b0 2023-12-08T08:19:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f022cc2e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02280a6dc0 con 0x7f02280c5e70 2023-12-08T08:19:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f022cc2e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02281568b0 con 0x7f02280c66a0 2023-12-08T08:19:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f0227fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02281532b0 0x7f022806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52568/0 (socket says 172.21.15.45:52568) 2023-12-08T08:19:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f0227fff640 1 -- 172.21.15.45:0/2489908727 learned_addr learned my addr 172.21.15.45:0/2489908727 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f0226ffd640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f0228156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841581502 0 0) 0x7f02280c3220 con 0x7f02281532b0 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.468+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0214003520 con 0x7f02281532b0 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 701024043 0 0) 0x7f0214003520 con 0x7f02281532b0 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 msgr2=0x7f0228156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f0228156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 >> v1:172.21.15.114:6789/0 conn(0x7f02280c5e70 legacy=0x7f0228152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280a70a0 con 0x7f02281532b0 2023-12-08T08:19:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f0220001670 con 0x7f02281532b0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 >> v1:172.21.15.45:6789/0 conn(0x7f02281532b0 legacy=0x7f022806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02140039a0 0x7f0214003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f02140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0214004d00 0x7f0214005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021400ba80 con 0x7f0214004d00 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021400bbf0 con 0x7f02140039a0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021400bdb0 con 0x7f02280c66a0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.469+0000 7f0227fff640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0214004d00 0x7f0214005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f02277fe640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02140039a0 0x7f0214003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0226ffd640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f02140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0227fff640 1 -- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 msgr2=0x7f02140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0227fff640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280c66a0 0x7f02140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0227fff640 1 -- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02140039a0 msgr2=0x7f0214003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0227fff640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02140039a0 0x7f0214003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.470+0000 7f0227fff640 1 -- 172.21.15.45:0/2489908727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214003520 con 0x7f0214004d00 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.471+0000 7f0227fff640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0214004d00 0x7f0214005180 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f022000c240 tx=0x7f02140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee62ecdd87eab8c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.471+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220005ad0 con 0x7f0214004d00 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.471+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220005c30 con 0x7f0214004d00 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.471+0000 7f02267fc640 1 -- 172.21.15.45:0/2489908727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022002c8b0 con 0x7f0214004d00 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 -- 172.21.15.45:0/2489908727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0214004d00 msgr2=0x7f0214005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 --2- 172.21.15.45:0/2489908727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0214004d00 0x7f0214005180 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f022000c240 tx=0x7f02140057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f0227fff640 1 -- 172.21.15.45:0/2489908727 reap_dead start 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 -- 172.21.15.45:0/2489908727 shutdown_connections 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 -- 172.21.15.45:0/2489908727 >> 172.21.15.45:0/2489908727 conn(0x7f0228066960 msgr2=0x7f02280a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 -- 172.21.15.45:0/2489908727 shutdown_connections 2023-12-08T08:19:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.472+0000 7f022cc2e640 1 -- 172.21.15.45:0/2489908727 wait complete. 2023-12-08T08:19:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.474+0000 7f022cc2e640 1 Processor -- start 2023-12-08T08:19:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.474+0000 7f022cc2e640 1 -- start start 2023-12-08T08:19:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0214004d00 0x7f02281eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280a9960 0x7f02280a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02281edad0 con 0x7f022814e030 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022814ecb0 con 0x7f0214004d00 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f022cc2e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022814dae0 con 0x7f02280a9960 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f0227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f0227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33982/0 (socket says 172.21.15.45:33982) 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f0227fff640 1 -- 172.21.15.45:0/3365064352 learned_addr learned my addr 172.21.15.45:0/3365064352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f02277fe640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0214004d00 0x7f02281eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.475+0000 7f0226ffd640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280a9960 0x7f02280a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 -- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280a9960 msgr2=0x7f02280a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280a9960 0x7f02280a8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 -- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0214004d00 msgr2=0x7f02281eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0214004d00 0x7f02281eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 -- 172.21.15.45:0/3365064352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022814e9d0 con 0x7f022814e030 2023-12-08T08:19:21.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f0227fff640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f022002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022003c040 con 0x7f022814e030 2023-12-08T08:19:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022002ccc0 con 0x7f022814e030 2023-12-08T08:19:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02281ed6f0 con 0x7f022814e030 2023-12-08T08:19:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.476+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220007290 con 0x7f022814e030 2023-12-08T08:19:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.477+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02281ed3f0 con 0x7f022814e030 2023-12-08T08:19:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.478+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02281ed8b0 con 0x7f022814e030 2023-12-08T08:19:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.479+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0220032070 con 0x7f022814e030 2023-12-08T08:19:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.480+0000 7f021ffff640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 0x7f020806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.480+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f02200aa490 con 0x7f022814e030 2023-12-08T08:19:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.480+0000 7f02277fe640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 0x7f020806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.481+0000 7f02277fe640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 0x7f020806d300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0218007fd0 tx=0x7f0218009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.485+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0220075090 con 0x7f022814e030 2023-12-08T08:19:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.680+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02280743e0 con 0x7f022814e030 2023-12-08T08:19:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.681+0000 7f021ffff640 1 -- 172.21.15.45:0/3365064352 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02200786b0 con 0x7f022814e030 2023-12-08T08:19:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:21.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 msgr2=0x7f020806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 0x7f020806d300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0218007fd0 tx=0x7f0218009040 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 msgr2=0x7f02280a8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f022002e070 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 shutdown_connections 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f020806ae40 0x7f020806d300 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f02280a9960 0x7f02280a8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022814e030 0x7f02280a8770 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 --2- 172.21.15.45:0/3365064352 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0214004d00 0x7f02281eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 >> 172.21.15.45:0/3365064352 conn(0x7f0228066960 msgr2=0x7f02280c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 shutdown_connections 2023-12-08T08:19:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.684+0000 7f022cc2e640 1 -- 172.21.15.45:0/3365064352 wait complete. 2023-12-08T08:19:21.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.908+0000 7fbd3bfff640 1 Processor -- start 2023-12-08T08:19:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.908+0000 7fbd3bfff640 1 -- start start 2023-12-08T08:19:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd3c0c59e0 0x7fbd3c158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3c0c51f0 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3bfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c1ce0 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3bfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c0c54d0 con 0x7fbd3c0c59e0 2023-12-08T08:19:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3a7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33992/0 (socket says 172.21.15.45:33992) 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/3669609151 learned_addr learned my addr 172.21.15.45:0/3669609151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3b7fe640 1 --1- 172.21.15.45:0/3669609151 >> v1:172.21.15.45:6789/0 conn(0x7fbd3c06bdd0 0x7fbd3c154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52578/0 (socket says 172.21.15.45:52578) 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.910+0000 7fbd3affd640 1 --2- 172.21.15.45:0/3669609151 >> v2:172.21.15.114:3300/0 conn(0x7fbd3c0c59e0 0x7fbd3c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.911+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/3669609151 >> v2:172.21.15.114:3300/0 conn(0x7fbd3c0c59e0 msgr2=0x7fbd3c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.911+0000 7fbd3a7fc640 1 --2- 172.21.15.45:0/3669609151 >> v2:172.21.15.114:3300/0 conn(0x7fbd3c0c59e0 0x7fbd3c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.911+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/3669609151 >> v1:172.21.15.45:6789/0 conn(0x7fbd3c06bdd0 legacy=0x7fbd3c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.911+0000 7fbd3a7fc640 1 -- 172.21.15.45:0/3669609151 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c157ba0 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.912+0000 7fbd3a7fc640 1 --2- 172.21.15.45:0/3669609151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c06df30 tx=0x7fbd2402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4189db287d3a934 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd39ffb640 1 -- 172.21.15.45:0/3669609151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2402cbb0 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd39ffb640 1 -- 172.21.15.45:0/3669609151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2402cd10 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd39ffb640 1 -- 172.21.15.45:0/3669609151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24034610 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd3bfff640 1 -- 172.21.15.45:0/3669609151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06d1d0 msgr2=0x7fbd3c0c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/3669609151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c06df30 tx=0x7fbd2402c010 comp rx=0 tx=0).stop 2023-12-08T08:19:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd3bfff640 1 -- 172.21.15.45:0/3669609151 shutdown_connections 2023-12-08T08:19:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/3669609151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06d1d0 0x7fbd3c0c0bf0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.913+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/3669609151 >> v2:172.21.15.114:3300/0 conn(0x7fbd3c0c59e0 0x7fbd3c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.914+0000 7fbd3bfff640 1 -- 172.21.15.45:0/3669609151 >> 172.21.15.45:0/3669609151 conn(0x7fbd3c066ce0 msgr2=0x7fbd3c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.914+0000 7fbd3bfff640 1 -- 172.21.15.45:0/3669609151 shutdown_connections 2023-12-08T08:19:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.914+0000 7fbd3bfff640 1 -- 172.21.15.45:0/3669609151 wait complete. 2023-12-08T08:19:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.915+0000 7fbd3bfff640 1 Processor -- start 2023-12-08T08:19:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 -- start start 2023-12-08T08:19:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd3c06d1d0 0x7fbd3c0a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0c59e0 0x7fbd3c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c151a90 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c071a20 con 0x7fbd3c0c59e0 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.916+0000 7fbd3bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c1e9980 con 0x7fbd3c06d1d0 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33998/0 (socket says 172.21.15.45:33998) 2023-12-08T08:19:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 -- 172.21.15.45:0/1201600411 learned_addr learned my addr 172.21.15.45:0/1201600411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 -- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd3c06d1d0 msgr2=0x7fbd3c0a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3a7fc640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd3c06d1d0 0x7fbd3c0a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3b7fe640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0c59e0 0x7fbd3c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd3c06d1d0 0x7fbd3c0a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 -- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0c59e0 msgr2=0x7fbd3c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0c59e0 0x7fbd3c14db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.917+0000 7fbd3affd640 1 -- 172.21.15.45:0/1201600411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009b30 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd3affd640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e870 tx=0x7fbd2c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0094f0 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00c940 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00ccf0 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c1e9c60 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.918+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c1ea220 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.919+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c0678c0 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.920+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd2c013470 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.922+0000 7fbd337fe640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 0x7fbd1c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.922+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbd2c089bc0 con 0x7fbd3c06bdd0 2023-12-08T08:19:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.922+0000 7fbd3a7fc640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 0x7fbd1c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.923+0000 7fbd3a7fc640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 0x7fbd1c06d350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd24035000 tx=0x7fbd24030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:21.927+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd2c0547b0 con 0x7fbd3c06bdd0 2023-12-08T08:19:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.126+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd3c1ea410 con 0x7fbd3c06bdd0 2023-12-08T08:19:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.128+0000 7fbd337fe640 1 -- 172.21.15.45:0/1201600411 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd2c057dd0 con 0x7fbd3c06bdd0 2023-12-08T08:19:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 msgr2=0x7fbd1c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 0x7fbd1c06d350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbd24035000 tx=0x7fbd24030000 comp rx=0 tx=0).stop 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 msgr2=0x7fbd3c150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00e870 tx=0x7fbd2c00ed30 comp rx=0 tx=0).stop 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 shutdown_connections 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbd1c06ae90 0x7fbd1c06d350 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbd3c06d1d0 0x7fbd3c0a7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0c59e0 0x7fbd3c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 --2- 172.21.15.45:0/1201600411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd3c06bdd0 0x7fbd3c150e60 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.130+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 >> 172.21.15.45:0/1201600411 conn(0x7fbd3c066ce0 msgr2=0x7fbd3c154140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.131+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 shutdown_connections 2023-12-08T08:19:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.131+0000 7fbd3bfff640 1 -- 172.21.15.45:0/1201600411 wait complete. 2023-12-08T08:19:22.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:22.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.379+0000 7f01affff640 1 Processor -- start 2023-12-08T08:19:22.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.380+0000 7f01affff640 1 -- start start 2023-12-08T08:19:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.381+0000 7f01affff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01b0151ad0 0x7f01b00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.381+0000 7f01affff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01affff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b0151eb0 con 0x7f01b00ca610 2023-12-08T08:19:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01affff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00c56a0 con 0x7f01b0151ad0 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01affff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00c80d0 con 0x7f01b0157a20 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01aeffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01b0151ad0 0x7f01b00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01a67fc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01aeffd640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01b0151ad0 0x7f01b00ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:44790/0 (socket says 172.21.15.45:44790) 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01aeffd640 1 -- 172.21.15.45:0/3684143614 learned_addr learned my addr 172.21.15.45:0/3684143614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.382+0000 7f01a67fc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58436/0 (socket says 172.21.15.45:58436) 2023-12-08T08:19:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.383+0000 7f01aeffd640 1 -- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 msgr2=0x7f01b0154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.383+0000 7f01aeffd640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.383+0000 7f01aeffd640 1 -- 172.21.15.45:0/3684143614 >> v1:172.21.15.114:6789/0 conn(0x7f01b00ca610 legacy=0x7f01b0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.383+0000 7f01aeffd640 1 -- 172.21.15.45:0/3684143614 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0154430 con 0x7f01b0151ad0 2023-12-08T08:19:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.383+0000 7f01a67fc640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.385+0000 7f01aeffd640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b00ca0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009870 tx=0x7f01a002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=175c332aeed873f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.385+0000 7f01ae7fc640 1 -- 172.21.15.45:0/3684143614 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0030840 con 0x7f01b0151ad0 2023-12-08T08:19:22.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.385+0000 7f01ae7fc640 1 -- 172.21.15.45:0/3684143614 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00309a0 con 0x7f01b0151ad0 2023-12-08T08:19:22.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.385+0000 7f01ae7fc640 1 -- 172.21.15.45:0/3684143614 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0030d30 con 0x7f01b0151ad0 2023-12-08T08:19:22.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 -- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 msgr2=0x7f01b00ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b00ca0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009870 tx=0x7f01a002b980 comp rx=0 tx=0).stop 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 -- 172.21.15.45:0/3684143614 shutdown_connections 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b0157a20 0x7f01b0154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 --2- 172.21.15.45:0/3684143614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b00ca0d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 -- 172.21.15.45:0/3684143614 >> 172.21.15.45:0/3684143614 conn(0x7f01b0066610 msgr2=0x7f01b0066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 -- 172.21.15.45:0/3684143614 shutdown_connections 2023-12-08T08:19:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.386+0000 7f01affff640 1 -- 172.21.15.45:0/3684143614 wait complete. 2023-12-08T08:19:22.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.388+0000 7f01affff640 1 Processor -- start 2023-12-08T08:19:22.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.389+0000 7f01affff640 1 -- start start 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b00ca610 0x7f01b00af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b0149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01edd70 con 0x7f01b0157a20 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01ed160 con 0x7f01b0151ad0 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01affff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01ed440 con 0x7f01b00ca610 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34014/0 (socket says 172.21.15.45:34014) 2023-12-08T08:19:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.390+0000 7f01af7fe640 1 -- 172.21.15.45:0/1490376580 learned_addr learned my addr 172.21.15.45:0/1490376580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01aeffd640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b00ca610 0x7f01b00af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01a67fc640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b0149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 -- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b00ca610 msgr2=0x7f01b00af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b00ca610 0x7f01b00af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 -- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 msgr2=0x7f01b0149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b0149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 -- 172.21.15.45:0/1490376580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009400 con 0x7f01b0157a20 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01a67fc640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b0149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.391+0000 7f01af7fe640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c7a0 tx=0x7f01a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.392+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8003b70 con 0x7f01b0157a20 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.392+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8003cf0 con 0x7f01b0157a20 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.392+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8003ea0 con 0x7f01b0157a20 2023-12-08T08:19:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.392+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a00094d0 con 0x7f01b0157a20 2023-12-08T08:19:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.392+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b01eda00 con 0x7f01b0157a20 2023-12-08T08:19:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.393+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b01edee0 con 0x7f01b0157a20 2023-12-08T08:19:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.394+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01a800aa90 con 0x7f01b0157a20 2023-12-08T08:19:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.395+0000 7f01acff9640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 0x7f019006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.395+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f01a80898e0 con 0x7f01b0157a20 2023-12-08T08:19:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.395+0000 7f01aeffd640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 0x7f019006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.396+0000 7f01aeffd640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 0x7f019006d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f01a0036000 tx=0x7f01a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.400+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01a80544e0 con 0x7f01b0157a20 2023-12-08T08:19:22.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.599+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01b00743e0 con 0x7f01b0157a20 2023-12-08T08:19:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.600+0000 7f01acff9640 1 -- 172.21.15.45:0/1490376580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01a8057b00 con 0x7f01b0157a20 2023-12-08T08:19:22.603 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 msgr2=0x7f019006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 0x7f019006d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f01a0036000 tx=0x7f01a0008030 comp rx=0 tx=0).stop 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 msgr2=0x7f01b00abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c7a0 tx=0x7f01a800cc60 comp rx=0 tx=0).stop 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 shutdown_connections 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f019006ae70 0x7f019006d330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0157a20 0x7f01b00abaa0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01b0151ad0 0x7f01b0149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 --2- 172.21.15.45:0/1490376580 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f01b00ca610 0x7f01b00af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 >> 172.21.15.45:0/1490376580 conn(0x7f01b0066610 msgr2=0x7f01b014f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 shutdown_connections 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.603+0000 7f01affff640 1 -- 172.21.15.45:0/1490376580 wait complete. 2023-12-08T08:19:22.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:22.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.848+0000 7fd7cac94640 1 Processor -- start 2023-12-08T08:19:22.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.848+0000 7fd7cac94640 1 -- start start 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7cac94640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40c51d0 0x7fd7c4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7cac94640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40c0d40 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7cac94640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c41555c0 con 0x7fd7c4147bb0 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7cac94640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40a4d10 con 0x7fd7c40c51d0 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7c3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7c40c1ff0 0x7fd7c4154840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52582/0 (socket says 172.21.15.45:52582) 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.850+0000 7fd7c3fff640 1 -- 172.21.15.45:0/3283333667 learned_addr learned my addr 172.21.15.45:0/3283333667 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40c51d0 0x7fd7c4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369811043 0 0) 0x7fd7c40c0d40 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b4003520 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186304760 0 0) 0x7fd7c41555c0 con 0x7fd7c4147bb0 2023-12-08T08:19:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c40c0d40 con 0x7fd7c4147bb0 2023-12-08T08:19:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861777909 0 0) 0x7fd7b4003520 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40c51d0 msgr2=0x7fd7c4154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40c51d0 0x7fd7c4154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 >> v1:172.21.15.114:6789/0 conn(0x7fd7c4147bb0 legacy=0x7fd7c40c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40a4ff0 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd7b0001690 con 0x7fd7c40c1ff0 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.851+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 >> v1:172.21.15.45:6789/0 conn(0x7fd7c40c1ff0 legacy=0x7fd7c4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4003b30 0x7fd7b4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7b40047c0 0x7fd7b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b4005180 0x7fd7b400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40a4d10 con 0x7fd7b4005180 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b400e260 con 0x7fd7b4003b30 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b400e420 con 0x7fd7b40047c0 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40c51d0 0x7fd7c4154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b4005180 0x7fd7b400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4003b30 0x7fd7b4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c3fff640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7b40047c0 0x7fd7b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.852+0000 7fd7c9231640 1 -- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7b40047c0 msgr2=0x7fd7b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.853+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7b40047c0 0x7fd7b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.853+0000 7fd7c9231640 1 -- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4003b30 msgr2=0x7fd7b4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.853+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4003b30 0x7fd7b4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.853+0000 7fd7c9231640 1 -- 172.21.15.45:0/3283333667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4003520 con 0x7fd7b4005180 2023-12-08T08:19:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.853+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4003b30 0x7fd7b4003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7c9231640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b4005180 0x7fd7b400db90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00e1f0 tx=0x7fd7b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40217ed1adcfdef server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc02cce0 con 0x7fd7b4005180 2023-12-08T08:19:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00f040 con 0x7fd7b4005180 2023-12-08T08:19:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7c37fe640 1 -- 172.21.15.45:0/3283333667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc003bb0 con 0x7fd7b4005180 2023-12-08T08:19:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7cac94640 1 -- 172.21.15.45:0/3283333667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b4005180 msgr2=0x7fd7b400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.854+0000 7fd7cac94640 1 --2- 172.21.15.45:0/3283333667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b4005180 0x7fd7b400db90 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00e1f0 tx=0x7fd7b40057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.855+0000 7fd7c9231640 1 -- 172.21.15.45:0/3283333667 reap_dead start 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.855+0000 7fd7cac94640 1 -- 172.21.15.45:0/3283333667 shutdown_connections 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.855+0000 7fd7cac94640 1 -- 172.21.15.45:0/3283333667 >> 172.21.15.45:0/3283333667 conn(0x7fd7c40c2430 msgr2=0x7fd7c40c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.855+0000 7fd7cac94640 1 -- 172.21.15.45:0/3283333667 shutdown_connections 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.855+0000 7fd7cac94640 1 -- 172.21.15.45:0/3283333667 wait complete. 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.856+0000 7fd7cac94640 1 Processor -- start 2023-12-08T08:19:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.857+0000 7fd7cac94640 1 -- start start 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.857+0000 7fd7cac94640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 0x7fd7c4151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.857+0000 7fd7cac94640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40bfc40 0x7fd7c4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7cac94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7cac94640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c414f0c0 con 0x7fd7c41526d0 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7cac94640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4151b90 con 0x7fd7b4005180 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7cac94640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41e65b0 con 0x7fd7c40bfc40 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34046/0 (socket says 172.21.15.45:34046) 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 -- 172.21.15.45:0/2754131380 learned_addr learned my addr 172.21.15.45:0/2754131380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 0x7fd7c4151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c3fff640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40bfc40 0x7fd7c4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 -- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40bfc40 msgr2=0x7fd7c4151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40bfc40 0x7fd7c4151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 -- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 msgr2=0x7fd7c4151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 0x7fd7c4151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c9231640 1 -- 172.21.15.45:0/2754131380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c41e6890 con 0x7fd7c41526d0 2023-12-08T08:19:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.858+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 0x7fd7c4151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7c9231640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00e2e0 tx=0x7fd7bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc004240 con 0x7fd7c41526d0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0043a0 con 0x7fd7c41526d0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c414f310 con 0x7fd7c41526d0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc004730 con 0x7fd7c41526d0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.859+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c41542c0 con 0x7fd7c41526d0 2023-12-08T08:19:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.860+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c414f830 con 0x7fd7c41526d0 2023-12-08T08:19:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.861+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7bc04b460 con 0x7fd7c41526d0 2023-12-08T08:19:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.862+0000 7fd7c17fa640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 0x7fd7a806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.863+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fd7bc0ac530 con 0x7fd7c41526d0 2023-12-08T08:19:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.863+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 0x7fd7a806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.863+0000 7fd7c8a30640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 0x7fd7a806d2c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8000f60 tx=0x7fd7b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:22.866+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7c414f830 con 0x7fd7c41526d0 2023-12-08T08:19:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.073+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7c414f830 con 0x7fd7c41526d0 2023-12-08T08:19:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.074+0000 7fd7c17fa640 1 -- 172.21.15.45:0/2754131380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v83) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd7c414f830 con 0x7fd7c41526d0 2023-12-08T08:19:23.076 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.076+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 msgr2=0x7fd7a806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.076+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 0x7fd7a806d2c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8000f60 tx=0x7fd7b8009040 comp rx=0 tx=0).stop 2023-12-08T08:19:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.076+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 msgr2=0x7fd7c4152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00e2e0 tx=0x7fd7bc009750 comp rx=0 tx=0).stop 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 shutdown_connections 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd7a806ae00 0x7fd7a806d2c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd7c40bfc40 0x7fd7c4151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c41526d0 0x7fd7c4152b50 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 --2- 172.21.15.45:0/2754131380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7b4005180 0x7fd7c4151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 >> 172.21.15.45:0/2754131380 conn(0x7fd7c40c2430 msgr2=0x7fd7c4154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 shutdown_connections 2023-12-08T08:19:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.077+0000 7fd7cac94640 1 -- 172.21.15.45:0/2754131380 wait complete. 2023-12-08T08:19:23.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:23.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.329+0000 7fecdeb75640 1 Processor -- start 2023-12-08T08:19:23.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.329+0000 7fecdeb75640 1 -- start start 2023-12-08T08:19:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.330+0000 7fecdeb75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.330+0000 7fecdeb75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.330+0000 7fecdeb75640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80c51f0 con 0x7fecd806d1d0 2023-12-08T08:19:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.330+0000 7fecdeb75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80c1ce0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.330+0000 7fecdeb75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c54d0 con 0x7fecd80c59e0 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecde374640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecddb73640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecddb73640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58480/0 (socket says 172.21.15.45:58480) 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecde374640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:44824/0 (socket says 172.21.15.45:44824) 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecdd372640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fecd806d1d0 0x7fecd806bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:54226/0 (socket says 172.21.15.45:54226) 2023-12-08T08:19:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.331+0000 7fecddb73640 1 -- 172.21.15.45:0/4212256485 learned_addr learned my addr 172.21.15.45:0/4212256485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecdcb71640 1 -- 172.21.15.45:0/4212256485 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701982405 0 0) 0x7fecd80c51f0 con 0x7fecd806d1d0 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecdcb71640 1 -- 172.21.15.45:0/4212256485 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc4003520 con 0x7fecd806d1d0 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecddb73640 1 -- 172.21.15.45:0/4212256485 >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 msgr2=0x7fecd8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecddb73640 1 --2- 172.21.15.45:0/4212256485 >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecddb73640 1 -- 172.21.15.45:0/4212256485 >> v1:172.21.15.114:6789/0 conn(0x7fecd806d1d0 legacy=0x7fecd806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecddb73640 1 -- 172.21.15.45:0/4212256485 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8157ba0 con 0x7fecd80c59e0 2023-12-08T08:19:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.332+0000 7fecde374640 1 --2- 172.21.15.45:0/4212256485 >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.334+0000 7fecddb73640 1 --2- 172.21.15.45:0/4212256485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feccc009870 tx=0x7feccc02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42ada2e220bf501 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.335+0000 7fecdcb71640 1 -- 172.21.15.45:0/4212256485 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc02f830 con 0x7fecd80c59e0 2023-12-08T08:19:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.335+0000 7fecdcb71640 1 -- 172.21.15.45:0/4212256485 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc02f990 con 0x7fecd80c59e0 2023-12-08T08:19:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.335+0000 7fecdcb71640 1 -- 172.21.15.45:0/4212256485 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc02fd20 con 0x7fecd80c59e0 2023-12-08T08:19:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 -- 172.21.15.45:0/4212256485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 msgr2=0x7fecd8158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 --2- 172.21.15.45:0/4212256485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feccc009870 tx=0x7feccc02ba10 comp rx=0 tx=0).stop 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 -- 172.21.15.45:0/4212256485 shutdown_connections 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 --2- 172.21.15.45:0/4212256485 >> v2:172.21.15.114:3300/0 conn(0x7fecd80c0bf0 0x7fecd8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 --2- 172.21.15.45:0/4212256485 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd8158680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 -- 172.21.15.45:0/4212256485 >> 172.21.15.45:0/4212256485 conn(0x7fecd8066ce0 msgr2=0x7fecd80a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 -- 172.21.15.45:0/4212256485 shutdown_connections 2023-12-08T08:19:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.336+0000 7fecdeb75640 1 -- 172.21.15.45:0/4212256485 wait complete. 2023-12-08T08:19:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.338+0000 7fecdeb75640 1 Processor -- start 2023-12-08T08:19:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.338+0000 7fecdeb75640 1 -- start start 2023-12-08T08:19:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.339+0000 7fecdeb75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecd806d1d0 0x7fecd81570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.339+0000 7fecdeb75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdeb75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd81e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdeb75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81ed620 con 0x7fecd80c0bf0 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdeb75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a8890 con 0x7fecd806d1d0 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdeb75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81edb40 con 0x7fecd80c59e0 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdd372640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdd372640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34056/0 (socket says 172.21.15.45:34056) 2023-12-08T08:19:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecdd372640 1 -- 172.21.15.45:0/3064154204 learned_addr learned my addr 172.21.15.45:0/3064154204 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:23.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.340+0000 7fecddb73640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecd806d1d0 0x7fecd81570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecde374640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd81e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 -- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 msgr2=0x7fecd81e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd81e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 -- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecd806d1d0 msgr2=0x7fecd81570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecd806d1d0 0x7fecd81570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 -- 172.21.15.45:0/3064154204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009a70 con 0x7fecd80c0bf0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.341+0000 7fecdd372640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c430 tx=0x7fecd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.342+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40074e0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.342+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4007660 con 0x7fecd80c0bf0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.342+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004a20 con 0x7fecd80c0bf0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.342+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc0094d0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.342+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80a8ae0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.343+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd806fc60 con 0x7fecd80c0bf0 2023-12-08T08:19:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.344+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecd4004b80 con 0x7fecd80c0bf0 2023-12-08T08:19:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.345+0000 7fecca7fc640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.345+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fecd40895e0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.345+0000 7fecddb73640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.346+0000 7fecddb73640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 0x7fecbc06d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feccc036000 tx=0x7feccc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.349+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecd4057cb0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.539+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fecd80678c0 con 0x7fecd80c0bf0 2023-12-08T08:19:23.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.540+0000 7fecca7fc640 1 -- 172.21.15.45:0/3064154204 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v83) v1 ==== 101+0+11 (secure 0 0 0) 0x7fecd4057840 con 0x7fecd80c0bf0 2023-12-08T08:19:23.543 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 msgr2=0x7fecbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 0x7fecbc06d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feccc036000 tx=0x7feccc008030 comp rx=0 tx=0).stop 2023-12-08T08:19:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 msgr2=0x7fecd81e96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c430 tx=0x7fecd400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 shutdown_connections 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fecd80c59e0 0x7fecd81e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecd80c0bf0 0x7fecd81e96d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 --2- 172.21.15.45:0/3064154204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecd806d1d0 0x7fecd81570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 >> 172.21.15.45:0/3064154204 conn(0x7fecd8066ce0 msgr2=0x7fecd81530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 shutdown_connections 2023-12-08T08:19:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.543+0000 7fecdeb75640 1 -- 172.21.15.45:0/3064154204 wait complete. 2023-12-08T08:19:23.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.775+0000 7fb77759e640 1 Processor -- start 2023-12-08T08:19:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.775+0000 7fb77759e640 1 -- start start 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb77759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7780c50b0 0x7fb77806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb77759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7781521e0 con 0x7fb778155dd0 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb77759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7781524c0 con 0x7fb7780c5600 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb77759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb778152b80 con 0x7fb7780c50b0 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb775d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7780c50b0 0x7fb77806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb775d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7780c50b0 0x7fb77806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34064/0 (socket says 172.21.15.45:34064) 2023-12-08T08:19:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb775d9b640 1 -- 172.21.15.45:0/766360460 learned_addr learned my addr 172.21.15.45:0/766360460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb775d9b640 1 -- 172.21.15.45:0/766360460 >> v1:172.21.15.114:6789/0 conn(0x7fb7780c5600 legacy=0x7fb7781556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.777+0000 7fb775d9b640 1 -- 172.21.15.45:0/766360460 >> v1:172.21.15.45:6789/0 conn(0x7fb778155dd0 legacy=0x7fb77815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.778+0000 7fb775d9b640 1 -- 172.21.15.45:0/766360460 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7781527a0 con 0x7fb7780c50b0 2023-12-08T08:19:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.778+0000 7fb77559a640 1 -- 172.21.15.45:0/766360460 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446019704 0 0) 0x7fb7781521e0 con 0x7fb778155dd0 2023-12-08T08:19:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb775d9b640 1 --2- 172.21.15.45:0/766360460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780c50b0 0x7fb77806db60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb760009870 tx=0x7fb76002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe57d5fe780292f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb77559a640 1 -- 172.21.15.45:0/766360460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760031870 con 0x7fb7780c50b0 2023-12-08T08:19:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb77559a640 1 -- 172.21.15.45:0/766360460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600319d0 con 0x7fb7780c50b0 2023-12-08T08:19:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb77559a640 1 -- 172.21.15.45:0/766360460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760031d60 con 0x7fb7780c50b0 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb77759e640 1 -- 172.21.15.45:0/766360460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780c50b0 msgr2=0x7fb77806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.779+0000 7fb77759e640 1 --2- 172.21.15.45:0/766360460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780c50b0 0x7fb77806db60 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb760009870 tx=0x7fb76002b910 comp rx=0 tx=0).stop 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.780+0000 7fb77759e640 1 -- 172.21.15.45:0/766360460 shutdown_connections 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.780+0000 7fb77759e640 1 --2- 172.21.15.45:0/766360460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780c50b0 0x7fb77806db60 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.780+0000 7fb77759e640 1 -- 172.21.15.45:0/766360460 >> 172.21.15.45:0/766360460 conn(0x7fb7780a7600 msgr2=0x7fb7780a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.780+0000 7fb77759e640 1 -- 172.21.15.45:0/766360460 shutdown_connections 2023-12-08T08:19:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.780+0000 7fb77759e640 1 -- 172.21.15.45:0/766360460 wait complete. 2023-12-08T08:19:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.781+0000 7fb77759e640 1 Processor -- start 2023-12-08T08:19:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.781+0000 7fb77759e640 1 -- start start 2023-12-08T08:19:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7780c50b0 0x7fb7781deff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7780c5600 0x7fb77814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778150290 con 0x7fb778155dd0 2023-12-08T08:19:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7781508d0 con 0x7fb7780c5600 2023-12-08T08:19:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.782+0000 7fb77759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77814d180 con 0x7fb7780c50b0 2023-12-08T08:19:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34076/0 (socket says 172.21.15.45:34076) 2023-12-08T08:19:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 -- 172.21.15.45:0/3211316928 learned_addr learned my addr 172.21.15.45:0/3211316928 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb77659c640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7780c50b0 0x7fb7781deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 -- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7780c50b0 msgr2=0x7fb7781deff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb775d9b640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7780c5600 0x7fb77814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7780c50b0 0x7fb7781deff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 -- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7780c5600 msgr2=0x7fb77814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7780c5600 0x7fb77814c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 -- 172.21.15.45:0/3211316928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600094d0 con 0x7fb778155dd0 2023-12-08T08:19:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.783+0000 7fb776d9d640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c710 tx=0x7fb77000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.784+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770003da0 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.784+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77000ce20 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.784+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb778150b20 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.784+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770005290 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.784+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77806fad0 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.785+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77806f930 con 0x7fb778155dd0 2023-12-08T08:19:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.786+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb770005410 con 0x7fb778155dd0 2023-12-08T08:19:23.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.787+0000 7fb76effd640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 0x7fb75806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.787+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb7700892b0 con 0x7fb778155dd0 2023-12-08T08:19:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.787+0000 7fb77659c640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 0x7fb75806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.789+0000 7fb77659c640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 0x7fb75806d300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb768003d90 tx=0x7fb768009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:23.797+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb77806f930 con 0x7fb778155dd0 2023-12-08T08:19:24.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.004+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb77806f930 con 0x7fb778155dd0 2023-12-08T08:19:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.005+0000 7fb76effd640 1 -- 172.21.15.45:0/3211316928 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb77806f930 con 0x7fb778155dd0 2023-12-08T08:19:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 msgr2=0x7fb75806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 0x7fb75806d300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb768003d90 tx=0x7fb768009040 comp rx=0 tx=0).stop 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 msgr2=0x7fb77814cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c710 tx=0x7fb77000cbd0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 shutdown_connections 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb75806ae40 0x7fb75806d300 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb778155dd0 0x7fb77814cc40 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7780c5600 0x7fb77814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 --2- 172.21.15.45:0/3211316928 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb7780c50b0 0x7fb7781deff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 >> 172.21.15.45:0/3211316928 conn(0x7fb7780a7600 msgr2=0x7fb7780c0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 shutdown_connections 2023-12-08T08:19:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.008+0000 7fb77759e640 1 -- 172.21.15.45:0/3211316928 wait complete. 2023-12-08T08:19:24.028 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:19:24.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:24.142 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:19:24.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.142 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:19:24.198 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:24.198 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:24.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:19:24.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.479+0000 7fbc35f75640 1 Processor -- start 2023-12-08T08:19:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.480+0000 7fbc35f75640 1 -- start start 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc301519c0 0x7fbc301584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc300c44d0 0x7fbc30154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc300c7a50 0x7fbc300ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc301553b0 con 0x7fbc301519c0 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300c4a00 con 0x7fbc300c44d0 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc35f75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300c4ce0 con 0x7fbc300c7a50 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc34f73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc301519c0 0x7fbc301584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc34f73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc301519c0 0x7fbc301584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34078/0 (socket says 172.21.15.45:34078) 2023-12-08T08:19:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.481+0000 7fbc34f73640 1 -- 172.21.15.45:0/614595038 learned_addr learned my addr 172.21.15.45:0/614595038 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc35774640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc300c7a50 0x7fbc300ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc27fff640 1 --2- 172.21.15.45:0/614595038 >> v2:172.21.15.114:3300/0 conn(0x7fbc300c44d0 0x7fbc30154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc34f73640 1 -- 172.21.15.45:0/614595038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc300c7a50 msgr2=0x7fbc300ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc34f73640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc300c7a50 0x7fbc300ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc34f73640 1 -- 172.21.15.45:0/614595038 >> v2:172.21.15.114:3300/0 conn(0x7fbc300c44d0 msgr2=0x7fbc30154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc34f73640 1 --2- 172.21.15.45:0/614595038 >> v2:172.21.15.114:3300/0 conn(0x7fbc300c44d0 0x7fbc30154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.482+0000 7fbc34f73640 1 -- 172.21.15.45:0/614595038 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc301579e0 con 0x7fbc301519c0 2023-12-08T08:19:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.483+0000 7fbc34f73640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc301519c0 0x7fbc301584c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ac250 tx=0x7fbc2c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63d43bd676bc20 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.483+0000 7fbc277fe640 1 -- 172.21.15.45:0/614595038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c02c9f0 con 0x7fbc301519c0 2023-12-08T08:19:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.483+0000 7fbc277fe640 1 -- 172.21.15.45:0/614595038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c02cb50 con 0x7fbc301519c0 2023-12-08T08:19:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.483+0000 7fbc277fe640 1 -- 172.21.15.45:0/614595038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0343f0 con 0x7fbc301519c0 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 -- 172.21.15.45:0/614595038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc301519c0 msgr2=0x7fbc301584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc301519c0 0x7fbc301584c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fbc300ac250 tx=0x7fbc2c02be50 comp rx=0 tx=0).stop 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 -- 172.21.15.45:0/614595038 shutdown_connections 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 --2- 172.21.15.45:0/614595038 >> v2:172.21.15.114:3300/0 conn(0x7fbc300c44d0 0x7fbc30154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc300c7a50 0x7fbc300ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 --2- 172.21.15.45:0/614595038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc301519c0 0x7fbc301584c0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 -- 172.21.15.45:0/614595038 >> 172.21.15.45:0/614595038 conn(0x7fbc300661f0 msgr2=0x7fbc30066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 -- 172.21.15.45:0/614595038 shutdown_connections 2023-12-08T08:19:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.484+0000 7fbc35f75640 1 -- 172.21.15.45:0/614595038 wait complete. 2023-12-08T08:19:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.486+0000 7fbc35f75640 1 Processor -- start 2023-12-08T08:19:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.486+0000 7fbc35f75640 1 -- start start 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc300c44d0 0x7fbc300bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc301519c0 0x7fbc300c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc30067510 con 0x7fbc300c7a50 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301ea4b0 con 0x7fbc300c44d0 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.487+0000 7fbc35f75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300c0cc0 con 0x7fbc301519c0 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34094/0 (socket says 172.21.15.45:34094) 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 -- 172.21.15.45:0/699830016 learned_addr learned my addr 172.21.15.45:0/699830016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc34f73640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc300c44d0 0x7fbc300bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc35774640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc301519c0 0x7fbc300c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 -- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc301519c0 msgr2=0x7fbc300c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc301519c0 0x7fbc300c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 -- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc300c44d0 msgr2=0x7fbc300bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc300c44d0 0x7fbc300bfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.488+0000 7fbc27fff640 1 -- 172.21.15.45:0/699830016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009b30 con 0x7fbc300c7a50 2023-12-08T08:19:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc27fff640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d800 tx=0x7fbc2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200096a0 con 0x7fbc300c7a50 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20009800 con 0x7fbc300c7a50 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20009b90 con 0x7fbc300c7a50 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc300c0fa0 con 0x7fbc300c7a50 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.489+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300c1560 con 0x7fbc300c7a50 2023-12-08T08:19:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.490+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300743e0 con 0x7fbc300c7a50 2023-12-08T08:19:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.491+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc20009cf0 con 0x7fbc300c7a50 2023-12-08T08:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.492+0000 7fbc257fa640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 0x7fbc1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.492+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbc20089ea0 con 0x7fbc300c7a50 2023-12-08T08:19:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.493+0000 7fbc34f73640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 0x7fbc1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.493+0000 7fbc34f73640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 0x7fbc1c06d300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c035000 tx=0x7fbc2c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.497+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc20054b40 con 0x7fbc300c7a50 2023-12-08T08:19:24.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.727+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc300c7190 con 0x7fbc300c7a50 2023-12-08T08:19:24.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.728+0000 7fbc257fa640 1 -- 172.21.15.45:0/699830016 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fbc2000b440 con 0x7fbc300c7a50 2023-12-08T08:19:24.731 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:24.731 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:19:24.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.730+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 msgr2=0x7fbc1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.730+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 0x7fbc1c06d300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c035000 tx=0x7fbc2c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.730+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 msgr2=0x7fbc300c0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.730+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d800 tx=0x7fbc2000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 shutdown_connections 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbc1c06ae40 0x7fbc1c06d300 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbc301519c0 0x7fbc300c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc300c7a50 0x7fbc300c0030 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 --2- 172.21.15.45:0/699830016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc300c44d0 0x7fbc300bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 >> 172.21.15.45:0/699830016 conn(0x7fbc300661f0 msgr2=0x7fbc30152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 shutdown_connections 2023-12-08T08:19:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:24.731+0000 7fbc35f75640 1 -- 172.21.15.45:0/699830016 wait complete. 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:24.751 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:24.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.752 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:24.811 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41850sec preferred_lft 41850sec 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:24.812 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:24.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.813 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:24.895 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:19:24.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.899 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:19:24.949 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:19:24.949 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:24.949 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:19:24.950 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:19:24.950 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:24.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:19:24.950 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:19:25.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.130 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:19:25.178 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:19:25.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:25.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:19:25.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:25.272 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:25.324 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:25.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:25.324 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:25.375 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-08T08:19:25.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:25.510 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:25.510 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:25.547 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:25.547 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:25.547 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:19:25.547 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 1@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:19:25.547 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:19:25.549 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:19:25.549 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:19:25.549 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:19:25.549 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:19:25.549 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:19:25.554 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:19:25.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.554 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:25.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.643 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:19:25.714 INFO:teuthology.orchestra.run.smithi114.stdout:client7104 2023-12-08T08:19:25.715 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:25.715 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:25.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.771 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-08T08:19:25.845 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:25.846 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-08T08:19:25.913 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:25.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:25.913 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-08T08:19:25.991 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:25.991 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-08T08:19:26.055 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:26.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-08T08:19:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.296+0000 7ff419b83640 1 Processor -- start 2023-12-08T08:19:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.296+0000 7ff419b83640 1 -- start start 2023-12-08T08:19:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff419b83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4140aaf60 0x7ff4140c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff419b83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff4140c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff419b83640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414152660 con 0x7ff41406d960 2023-12-08T08:19:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff419b83640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140a4d10 con 0x7ff4140aaf60 2023-12-08T08:19:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff419b83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff414153200 con 0x7ff4140c1930 2023-12-08T08:19:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff412ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff41406d960 0x7ff414152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33190/0 (socket says 172.21.15.45:33190) 2023-12-08T08:19:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.298+0000 7ff412ffd640 1 -- 172.21.15.45:0/777268800 learned_addr learned my addr 172.21.15.45:0/777268800 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4137fe640 1 --2- 172.21.15.45:0/777268800 >> v2:172.21.15.114:3300/0 conn(0x7ff4140aaf60 0x7ff4140c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff413fff640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff4140c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950478364 0 0) 0x7ff414152660 con 0x7ff41406d960 2023-12-08T08:19:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3fc003520 con 0x7ff41406d960 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585853256 0 0) 0x7ff3fc003520 con 0x7ff41406d960 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 msgr2=0x7ff4140c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.299+0000 7ff4127fc640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff4140c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 >> v2:172.21.15.114:3300/0 conn(0x7ff4140aaf60 msgr2=0x7ff4140c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 --2- 172.21.15.45:0/777268800 >> v2:172.21.15.114:3300/0 conn(0x7ff4140aaf60 0x7ff4140c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140c3310 con 0x7ff41406d960 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ff408001670 con 0x7ff41406d960 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 >> v1:172.21.15.45:6789/0 conn(0x7ff41406d960 legacy=0x7ff414152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff3fc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc003ef0 0x7ff3fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3fc004d00 0x7ff3fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140a4d10 con 0x7ff3fc004d00 2023-12-08T08:19:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414153200 con 0x7ff3fc003ef0 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc00fde0 con 0x7ff4140c1930 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff413fff640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3fc004d00 0x7ff3fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff4137fe640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff3fc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.300+0000 7ff412ffd640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc003ef0 0x7ff3fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff413fff640 1 -- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 msgr2=0x7ff3fc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff413fff640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4140c1930 0x7ff3fc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff413fff640 1 -- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc003ef0 msgr2=0x7ff3fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff413fff640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc003ef0 0x7ff3fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff413fff640 1 -- 172.21.15.45:0/777268800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc003520 con 0x7ff3fc004d00 2023-12-08T08:19:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.301+0000 7ff412ffd640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc003ef0 0x7ff3fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.302+0000 7ff413fff640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3fc004d00 0x7ff3fc005180 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e170 tx=0x7ff3fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aae9fca7272e9b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.302+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c02cbf0 con 0x7ff3fc004d00 2023-12-08T08:19:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.302+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00f040 con 0x7ff3fc004d00 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.302+0000 7ff4127fc640 1 -- 172.21.15.45:0/777268800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c034440 con 0x7ff3fc004d00 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 -- 172.21.15.45:0/777268800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3fc004d00 msgr2=0x7ff3fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 --2- 172.21.15.45:0/777268800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3fc004d00 0x7ff3fc005180 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e170 tx=0x7ff3fc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff413fff640 1 -- 172.21.15.45:0/777268800 reap_dead start 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 -- 172.21.15.45:0/777268800 shutdown_connections 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 -- 172.21.15.45:0/777268800 >> 172.21.15.45:0/777268800 conn(0x7ff4140c2430 msgr2=0x7ff4140c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 -- 172.21.15.45:0/777268800 shutdown_connections 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.303+0000 7ff419b83640 1 -- 172.21.15.45:0/777268800 wait complete. 2023-12-08T08:19:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.305+0000 7ff419b83640 1 Processor -- start 2023-12-08T08:19:26.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.305+0000 7ff419b83640 1 -- start start 2023-12-08T08:19:26.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d00 0x7ff41406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff41414b340 0x7ff4140c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141e6360 con 0x7ff414143e50 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141e6890 con 0x7ff3fc004d00 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff419b83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140a8ba0 con 0x7ff41414b340 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.306+0000 7ff413fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39636/0 (socket says 172.21.15.45:39636) 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 -- 172.21.15.45:0/2696592956 learned_addr learned my addr 172.21.15.45:0/2696592956 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff4137fe640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d00 0x7ff41406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff412ffd640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff41414b340 0x7ff4140c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 -- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff41414b340 msgr2=0x7ff4140c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff41414b340 0x7ff4140c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 -- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d00 msgr2=0x7ff41406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d00 0x7ff41406faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 -- 172.21.15.45:0/2696592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414072830 con 0x7ff414143e50 2023-12-08T08:19:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.307+0000 7ff413fff640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e170 tx=0x7ff40c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.308+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c034ad0 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.308+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c034c30 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.308+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c003990 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.308+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4141e65b0 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.308+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4140aaa60 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.309+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4140a8d10 con 0x7ff414143e50 2023-12-08T08:19:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.310+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff40c03e440 con 0x7ff414143e50 2023-12-08T08:19:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.311+0000 7ff3fbfff640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 0x7ff40006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.311+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ff40c0abd00 con 0x7ff414143e50 2023-12-08T08:19:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.311+0000 7ff4137fe640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 0x7ff40006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.312+0000 7ff4137fe640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 0x7ff40006d300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff404009a90 tx=0x7ff404008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.316+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff40c076ac0 con 0x7ff414143e50 2023-12-08T08:19:26.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.577+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7ff414074670 con 0x7ff414143e50 2023-12-08T08:19:26.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.582+0000 7ff3fbfff640 1 -- 172.21.15.45:0/2696592956 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v25) v1 ==== 272+0+0 (secure 0 0 0) 0x7ff40c07a0e0 con 0x7ff414143e50 2023-12-08T08:19:26.585 INFO:teuthology.orchestra.run.smithi045.stderr:added key for client.testuser 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 msgr2=0x7ff40006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 0x7ff40006d300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff404009a90 tx=0x7ff404008040 comp rx=0 tx=0).stop 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 msgr2=0x7ff4141442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e170 tx=0x7ff40c009750 comp rx=0 tx=0).stop 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 shutdown_connections 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40006ae40 0x7ff40006d300 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff41414b340 0x7ff4140c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414143e50 0x7ff4141442e0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 --2- 172.21.15.45:0/2696592956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d00 0x7ff41406faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.585+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 >> 172.21.15.45:0/2696592956 conn(0x7ff4140c2430 msgr2=0x7ff414072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:26.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.586+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 shutdown_connections 2023-12-08T08:19:26.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.586+0000 7ff419b83640 1 -- 172.21.15.45:0/2696592956 wait complete. 2023-12-08T08:19:26.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-08T08:19:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.824+0000 7f9ee5839640 1 Processor -- start 2023-12-08T08:19:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.825+0000 7f9ee5839640 1 -- start start 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee5839640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ee0155d40 0x7f9ee00c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee5839640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ee0159500 0x7f9ee00c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee5839640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee00aa8e0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee5839640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee00a9780 con 0x7f9ee0155d40 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee5839640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee0158760 con 0x7f9ee0159500 2023-12-08T08:19:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.826+0000 7f9ee4837640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ee0155d40 0x7f9ee00c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ee0155d40 0x7f9ee00c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39640/0 (socket says 172.21.15.45:39640) 2023-12-08T08:19:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 -- 172.21.15.45:0/1082221461 learned_addr learned my addr 172.21.15.45:0/1082221461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9edffff640 1 --2- 172.21.15.45:0/1082221461 >> v2:172.21.15.114:3300/0 conn(0x7f9ee0159500 0x7f9ee00c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 -- 172.21.15.45:0/1082221461 >> v2:172.21.15.114:3300/0 conn(0x7f9ee0159500 msgr2=0x7f9ee00c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 --2- 172.21.15.45:0/1082221461 >> v2:172.21.15.114:3300/0 conn(0x7f9ee0159500 0x7f9ee00c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 -- 172.21.15.45:0/1082221461 >> v1:172.21.15.114:6789/0 conn(0x7f9ee00c5d20 legacy=0x7f9ee015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.827+0000 7f9ee4837640 1 -- 172.21.15.45:0/1082221461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00c5010 con 0x7f9ee0155d40 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.828+0000 7f9ee4837640 1 --2- 172.21.15.45:0/1082221461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee0155d40 0x7f9ee00c57e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00c6340 tx=0x7f9ed402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e169861c28292d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9edf7fe640 1 -- 172.21.15.45:0/1082221461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40317e0 con 0x7f9ee0155d40 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9edf7fe640 1 -- 172.21.15.45:0/1082221461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4031940 con 0x7f9ee0155d40 2023-12-08T08:19:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9edf7fe640 1 -- 172.21.15.45:0/1082221461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4031cd0 con 0x7f9ee0155d40 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9ee5839640 1 -- 172.21.15.45:0/1082221461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee0155d40 msgr2=0x7f9ee00c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1082221461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee0155d40 0x7f9ee00c57e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00c6340 tx=0x7f9ed402b880 comp rx=0 tx=0).stop 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9ee5839640 1 -- 172.21.15.45:0/1082221461 shutdown_connections 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.829+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1082221461 >> v2:172.21.15.114:3300/0 conn(0x7f9ee0159500 0x7f9ee00c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.830+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1082221461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee0155d40 0x7f9ee00c57e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.830+0000 7f9ee5839640 1 -- 172.21.15.45:0/1082221461 >> 172.21.15.45:0/1082221461 conn(0x7f9ee00a7600 msgr2=0x7f9ee00a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.830+0000 7f9ee5839640 1 -- 172.21.15.45:0/1082221461 shutdown_connections 2023-12-08T08:19:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.830+0000 7f9ee5839640 1 -- 172.21.15.45:0/1082221461 wait complete. 2023-12-08T08:19:26.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.831+0000 7f9ee5839640 1 Processor -- start 2023-12-08T08:19:26.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.831+0000 7f9ee5839640 1 -- start start 2023-12-08T08:19:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 0x7f9ee01f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 0x7f9ee01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee015a730 con 0x7f9ee00c5d20 2023-12-08T08:19:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee015acf0 con 0x7f9ee0159500 2023-12-08T08:19:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.832+0000 7f9ee5839640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00a5210 con 0x7f9ee0155d40 2023-12-08T08:19:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39648/0 (socket says 172.21.15.45:39648) 2023-12-08T08:19:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 -- 172.21.15.45:0/1259263610 learned_addr learned my addr 172.21.15.45:0/1259263610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee5038640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 0x7f9ee01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 -- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 msgr2=0x7f9ee01f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9edffff640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 0x7f9ee01f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 0x7f9ee01f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 -- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 msgr2=0x7f9ee01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 0x7f9ee01522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee4837640 1 -- 172.21.15.45:0/1259263610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40094d0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9ee5038640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 0x7f9ee01522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.833+0000 7f9edffff640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 0x7f9ee01f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9ee4837640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9ed402b8c0 tx=0x7f9ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4032880 con 0x7f9ee00c5d20 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40329e0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4032d90 con 0x7f9ee00c5d20 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee01f23a0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.834+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee015a980 con 0x7f9ee00c5d20 2023-12-08T08:19:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.835+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee00a92c0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.836+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ed404e450 con 0x7f9ee00c5d20 2023-12-08T08:19:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.838+0000 7f9edd7fa640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 0x7f9ec406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.838+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9ed40abbc0 con 0x7f9ee00c5d20 2023-12-08T08:19:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.838+0000 7f9edffff640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 0x7f9ec406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.839+0000 7f9edffff640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 0x7f9ec406d300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006fd0 tx=0x7f9ecc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:26.842+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ed4076870 con 0x7f9ee00c5d20 2023-12-08T08:19:27.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.108+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f9ee00c5270 con 0x7f9ee00c5d20 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.108+0000 7f9edd7fa640 1 -- 172.21.15.45:0/1259263610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v25) v1 ==== 85+0+226 (secure 0 0 0) 0x7f9ed4079e90 con 0x7f9ee00c5d20 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stdout:[client.testuser] 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA== 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-12-08T08:19:27.114 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 msgr2=0x7f9ec406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 0x7f9ec406d300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc006fd0 tx=0x7f9ecc008040 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 msgr2=0x7f9ee00a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9ed402b8c0 tx=0x7f9ed40046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 shutdown_connections 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9ec406ae40 0x7f9ec406d300 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9ee0155d40 0x7f9ee01f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ee0159500 0x7f9ee01522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 --2- 172.21.15.45:0/1259263610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ee00c5d20 0x7f9ee00a4bd0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 >> 172.21.15.45:0/1259263610 conn(0x7f9ee00a7600 msgr2=0x7f9ee00bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 shutdown_connections 2023-12-08T08:19:27.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.111+0000 7f9ee5839640 1 -- 172.21.15.45:0/1259263610 wait complete. 2023-12-08T08:19:27.134 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:19:27.134 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:19:27.186 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.HvuU8cxwl6 2023-12-08T08:19:27.186 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:27.186 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/tmp/tmp.HvuU8cxwl6 2023-12-08T08:19:27.237 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:27.237 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:27.338 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:27.338 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:27.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.624+0000 7fdb214e6640 1 Processor -- start 2023-12-08T08:19:27.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.624+0000 7fdb214e6640 1 -- start start 2023-12-08T08:19:27.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb214e6640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb1c0c1210 0x7fdb1c0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb214e6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c154850 con 0x7fdb1c14e840 2023-12-08T08:19:27.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb214e6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c154b30 con 0x7fdb1c0a9e80 2023-12-08T08:19:27.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb214e6640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c14ec20 con 0x7fdb1c0c1210 2023-12-08T08:19:27.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb1bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb1c14e840 0x7fdb1c151960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33196/0 (socket says 172.21.15.45:33196) 2023-12-08T08:19:27.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb1bfff640 1 -- 172.21.15.45:0/951680223 learned_addr learned my addr 172.21.15.45:0/951680223 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.626+0000 7fdb137fe640 1 --2- 172.21.15.45:0/951680223 >> v2:172.21.15.114:3300/0 conn(0x7fdb1c0c1210 0x7fdb1c0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492600713 0 0) 0x7fdb1c154850 con 0x7fdb1c14e840 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb08003520 con 0x7fdb1c14e840 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1220491044 0 0) 0x7fdb08003520 con 0x7fdb1c14e840 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 >> v2:172.21.15.114:3300/0 conn(0x7fdb1c0c1210 msgr2=0x7fdb1c0c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 --2- 172.21.15.45:0/951680223 >> v2:172.21.15.114:3300/0 conn(0x7fdb1c0c1210 0x7fdb1c0c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 >> v1:172.21.15.114:6789/0 conn(0x7fdb1c0a9e80 legacy=0x7fdb1c0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c154e10 con 0x7fdb1c14e840 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdb0c001a10 con 0x7fdb1c14e840 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 >> v1:172.21.15.45:6789/0 conn(0x7fdb1c14e840 legacy=0x7fdb1c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 0x7fdb08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080047c0 0x7fdb08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb080051d0 0x7fdb0800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c14ec20 con 0x7fdb080039c0 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0800c120 con 0x7fdb080051d0 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0800c2e0 con 0x7fdb080047c0 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.627+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 0x7fdb08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb137fe640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080047c0 0x7fdb08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb1bfff640 1 -- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080047c0 msgr2=0x7fdb08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080047c0 0x7fdb08004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb1bfff640 1 -- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb080051d0 msgr2=0x7fdb0800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb20ce5640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb080051d0 0x7fdb0800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb080051d0 0x7fdb0800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb1bfff640 1 -- 172.21.15.45:0/951680223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08003520 con 0x7fdb080039c0 2023-12-08T08:19:27.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb20ce5640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb080051d0 0x7fdb0800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:27.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.628+0000 7fdb20ce5640 1 -- 172.21.15.45:0/951680223 reap_dead start 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.629+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 0x7fdb08003de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06e0c0 tx=0x7fdb080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e07786ce0f6cda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.629+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c034630 con 0x7fdb080039c0 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.629+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c02f070 con 0x7fdb080039c0 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.629+0000 7fdb1b7fe640 1 -- 172.21.15.45:0/951680223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0349d0 con 0x7fdb080039c0 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 -- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 msgr2=0x7fdb08003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 0x7fdb08003de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06e0c0 tx=0x7fdb080057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 -- 172.21.15.45:0/951680223 shutdown_connections 2023-12-08T08:19:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 --2- 172.21.15.45:0/951680223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080039c0 0x7fdb08003de0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 -- 172.21.15.45:0/951680223 >> 172.21.15.45:0/951680223 conn(0x7fdb1c0c5780 msgr2=0x7fdb1c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 -- 172.21.15.45:0/951680223 shutdown_connections 2023-12-08T08:19:27.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.630+0000 7fdb214e6640 1 -- 172.21.15.45:0/951680223 wait complete. 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.632+0000 7fdb214e6640 1 Processor -- start 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.632+0000 7fdb214e6640 1 -- start start 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 0x7fdb1c1deb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c14c2d0 0x7fdb1c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1de770 con 0x7fdb1c06f920 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1dd7b0 con 0x7fdb1c14c2d0 2023-12-08T08:19:27.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb214e6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1eb040 con 0x7fdb080039c0 2023-12-08T08:19:27.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb20ce5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb20ce5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39672/0 (socket says 172.21.15.45:39672) 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.633+0000 7fdb20ce5640 1 -- 172.21.15.45:0/32954062 learned_addr learned my addr 172.21.15.45:0/32954062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 0x7fdb1c1deb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 -- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 msgr2=0x7fdb1c1deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 0x7fdb1c1deb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 -- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c14c2d0 msgr2=0x7fdb1c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c14c2d0 0x7fdb1c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 -- 172.21.15.45:0/32954062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c1dddd0 con 0x7fdb1c06f920 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 0x7fdb1c1deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb20ce5640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0a52e0 tx=0x7fdb1400d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400b070 con 0x7fdb1c06f920 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400de60 con 0x7fdb1c06f920 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14003830 con 0x7fdb1c06f920 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.634+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c1de0b0 con 0x7fdb1c06f920 2023-12-08T08:19:27.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.635+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c072900 con 0x7fdb1c06f920 2023-12-08T08:19:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.636+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c1de8b0 con 0x7fdb1c06f920 2023-12-08T08:19:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.637+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb14003990 con 0x7fdb1c06f920 2023-12-08T08:19:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.638+0000 7fdb197fa640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 0x7fdafc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:27.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.638+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdb14088f90 con 0x7fdb1c06f920 2023-12-08T08:19:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.638+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 0x7fdafc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:27.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.639+0000 7fdb1bfff640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 0x7fdafc06d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c034000 tx=0x7fdb0c036040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:27.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.643+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb1c1de8b0 con 0x7fdb1c06f920 2023-12-08T08:19:27.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.840+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb1c1de8b0 con 0x7fdb1c06f920 2023-12-08T08:19:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.844+0000 7fdb197fa640 1 -- 172.21.15.45:0/32954062 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7fdb1c1de8b0 con 0x7fdb1c06f920 2023-12-08T08:19:27.847 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:27.847 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 msgr2=0x7fdafc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 0x7fdafc06d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c034000 tx=0x7fdb0c036040 comp rx=0 tx=0).stop 2023-12-08T08:19:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 msgr2=0x7fdb1c14b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0a52e0 tx=0x7fdb1400d660 comp rx=0 tx=0).stop 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 shutdown_connections 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdafc06ae70 0x7fdafc06d330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.846+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c06f920 0x7fdb1c14b6b0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.847+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb1c14c2d0 0x7fdb1c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.847+0000 7fdb214e6640 1 --2- 172.21.15.45:0/32954062 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdb080039c0 0x7fdb1c1deb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.847+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 >> 172.21.15.45:0/32954062 conn(0x7fdb1c0c5780 msgr2=0x7fdb1c153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.847+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 shutdown_connections 2023-12-08T08:19:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:27.847+0000 7fdb214e6640 1 -- 172.21.15.45:0/32954062 wait complete. 2023-12-08T08:19:27.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:27.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:28.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.095+0000 7f6d094cf640 1 Processor -- start 2023-12-08T08:19:28.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.095+0000 7f6d094cf640 1 -- start start 2023-12-08T08:19:28.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d04147bb0 0x7f6d040c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d040c1ff0 0x7f6d040c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040c0d40 con 0x7f6d040c1ff0 2023-12-08T08:19:28.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040c1c50 con 0x7f6d04147bb0 2023-12-08T08:19:28.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d094cf640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041555c0 con 0x7f6d040c51d0 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d027fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d040c1ff0 0x7f6d040c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d027fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d040c1ff0 0x7f6d040c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39674/0 (socket says 172.21.15.45:39674) 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d027fc640 1 -- 172.21.15.45:0/1663765079 learned_addr learned my addr 172.21.15.45:0/1663765079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d02ffd640 1 --2- 172.21.15.45:0/1663765079 >> v2:172.21.15.114:3300/0 conn(0x7f6d04147bb0 0x7f6d040c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.097+0000 7f6d037fe640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.098+0000 7f6d027fc640 1 -- 172.21.15.45:0/1663765079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 msgr2=0x7f6d04154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.098+0000 7f6d027fc640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.098+0000 7f6d027fc640 1 -- 172.21.15.45:0/1663765079 >> v2:172.21.15.114:3300/0 conn(0x7f6d04147bb0 msgr2=0x7f6d040c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.098+0000 7f6d027fc640 1 --2- 172.21.15.45:0/1663765079 >> v2:172.21.15.114:3300/0 conn(0x7f6d04147bb0 0x7f6d040c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.098+0000 7f6d027fc640 1 -- 172.21.15.45:0/1663765079 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040a4d10 con 0x7f6d040c1ff0 2023-12-08T08:19:28.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.099+0000 7f6d027fc640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d040c1ff0 0x7f6d040c1710 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6d040c1f80 tx=0x7f6cec02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc70543eb39809d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.099+0000 7f6d01ffb640 1 -- 172.21.15.45:0/1663765079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec02ee90 con 0x7f6d040c1ff0 2023-12-08T08:19:28.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.099+0000 7f6d01ffb640 1 -- 172.21.15.45:0/1663765079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec036440 con 0x7f6d040c1ff0 2023-12-08T08:19:28.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.099+0000 7f6d01ffb640 1 -- 172.21.15.45:0/1663765079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0367d0 con 0x7f6d040c1ff0 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 -- 172.21.15.45:0/1663765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d040c1ff0 msgr2=0x7f6d040c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d040c1ff0 0x7f6d040c1710 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6d040c1f80 tx=0x7f6cec02e0e0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 -- 172.21.15.45:0/1663765079 shutdown_connections 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 --2- 172.21.15.45:0/1663765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d040c1ff0 0x7f6d040c1710 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 --2- 172.21.15.45:0/1663765079 >> v2:172.21.15.114:3300/0 conn(0x7f6d04147bb0 0x7f6d040c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 -- 172.21.15.45:0/1663765079 >> 172.21.15.45:0/1663765079 conn(0x7f6d040c2430 msgr2=0x7f6d040c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 -- 172.21.15.45:0/1663765079 shutdown_connections 2023-12-08T08:19:28.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.100+0000 7f6d094cf640 1 -- 172.21.15.45:0/1663765079 wait complete. 2023-12-08T08:19:28.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.102+0000 7f6d094cf640 1 Processor -- start 2023-12-08T08:19:28.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.102+0000 7f6d094cf640 1 -- start start 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d04147bb0 0x7f6d04146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0414db70 con 0x7f6d041471e0 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d04071a40 con 0x7f6d04147bb0 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d094cf640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0414eab0 con 0x7f6d040c51d0 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d037fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39676/0 (socket says 172.21.15.45:39676) 2023-12-08T08:19:28.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.103+0000 7f6d037fe640 1 -- 172.21.15.45:0/2760381188 learned_addr learned my addr 172.21.15.45:0/2760381188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d02ffd640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d027fc640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d04147bb0 0x7f6d04146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 -- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 msgr2=0x7f6d04151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 -- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d04147bb0 msgr2=0x7f6d04146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d04147bb0 0x7f6d04146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 -- 172.21.15.45:0/2760381188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec00b770 con 0x7f6d041471e0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d02ffd640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6d037fe640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d830 tx=0x7f6cfc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.104+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc009660 con 0x7f6d041471e0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.105+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc0097e0 con 0x7f6d041471e0 2023-12-08T08:19:28.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.105+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc009b90 con 0x7f6d041471e0 2023-12-08T08:19:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.105+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0414ed90 con 0x7f6d041471e0 2023-12-08T08:19:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.105+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040716d0 con 0x7f6d041471e0 2023-12-08T08:19:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.106+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d04071b80 con 0x7f6d041471e0 2023-12-08T08:19:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.107+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cfc014410 con 0x7f6d041471e0 2023-12-08T08:19:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.108+0000 7f6cfb7fe640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 0x7f6ce406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.108+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6cfc08a350 con 0x7f6d041471e0 2023-12-08T08:19:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.108+0000 7f6d02ffd640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 0x7f6ce406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.109+0000 7f6d02ffd640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 0x7f6ce406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6d0414e700 tx=0x7f6cf400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.112+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d04071b80 con 0x7f6d041471e0 2023-12-08T08:19:28.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.306+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d04071b80 con 0x7f6d041471e0 2023-12-08T08:19:28.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.307+0000 7f6cfb7fe640 1 -- 172.21.15.45:0/2760381188 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d04071b80 con 0x7f6d041471e0 2023-12-08T08:19:28.310 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 msgr2=0x7f6ce406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 0x7f6ce406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6d0414e700 tx=0x7f6cf400b040 comp rx=0 tx=0).stop 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 msgr2=0x7f6d04146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00d830 tx=0x7f6cfc00dcf0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 shutdown_connections 2023-12-08T08:19:28.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f6ce406ae70 0x7f6ce406d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d041471e0 0x7f6d04146090 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d04147bb0 0x7f6d04146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 --2- 172.21.15.45:0/2760381188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6d040c51d0 0x7f6d04151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.309+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 >> 172.21.15.45:0/2760381188 conn(0x7f6d040c2430 msgr2=0x7f6d040a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.310+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 shutdown_connections 2023-12-08T08:19:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.310+0000 7f6d094cf640 1 -- 172.21.15.45:0/2760381188 wait complete. 2023-12-08T08:19:28.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:28.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.547+0000 7fdebf59e640 1 Processor -- start 2023-12-08T08:19:28.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.547+0000 7fdebf59e640 1 -- start start 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebf59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec0158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebf59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec00c0bf0 0x7fdec0154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebf59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00c51f0 con 0x7fdec00c59e0 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebf59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec00c1ce0 con 0x7fdec00c0bf0 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebf59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00c54d0 con 0x7fdec006d1d0 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec00c0bf0 0x7fdec0154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec00c0bf0 0x7fdec0154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39678/0 (socket says 172.21.15.45:39678) 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebed9d640 1 -- 172.21.15.45:0/3817399291 learned_addr learned my addr 172.21.15.45:0/3817399291 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.549+0000 7fdebdd9b640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.550+0000 7fdebed9d640 1 -- 172.21.15.45:0/3817399291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 msgr2=0x7fdec0158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.550+0000 7fdebed9d640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec0158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.550+0000 7fdebed9d640 1 -- 172.21.15.45:0/3817399291 >> v1:172.21.15.114:6789/0 conn(0x7fdec00c59e0 legacy=0x7fdec006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.550+0000 7fdebed9d640 1 -- 172.21.15.45:0/3817399291 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0157ba0 con 0x7fdec00c0bf0 2023-12-08T08:19:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.551+0000 7fdebed9d640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c0bf0 0x7fdec0154bc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd3f2664a4feaf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.551+0000 7fdebd59a640 1 -- 172.21.15.45:0/3817399291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb802f840 con 0x7fdec00c0bf0 2023-12-08T08:19:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.551+0000 7fdebd59a640 1 -- 172.21.15.45:0/3817399291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb802f9a0 con 0x7fdec00c0bf0 2023-12-08T08:19:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.551+0000 7fdebd59a640 1 -- 172.21.15.45:0/3817399291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb802fd30 con 0x7fdec00c0bf0 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 -- 172.21.15.45:0/3817399291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c0bf0 msgr2=0x7fdec0154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c0bf0 0x7fdec0154bc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb802ba20 comp rx=0 tx=0).stop 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 -- 172.21.15.45:0/3817399291 shutdown_connections 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c0bf0 0x7fdec0154bc0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 --2- 172.21.15.45:0/3817399291 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec0158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 -- 172.21.15.45:0/3817399291 >> 172.21.15.45:0/3817399291 conn(0x7fdec0066ce0 msgr2=0x7fdec00a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 -- 172.21.15.45:0/3817399291 shutdown_connections 2023-12-08T08:19:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.552+0000 7fdebf59e640 1 -- 172.21.15.45:0/3817399291 wait complete. 2023-12-08T08:19:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.554+0000 7fdebf59e640 1 Processor -- start 2023-12-08T08:19:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.554+0000 7fdebf59e640 1 -- start start 2023-12-08T08:19:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec00a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec00c0bf0 0x7fdec00703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0071430 con 0x7fdec00c59e0 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec014dd40 con 0x7fdec00c0bf0 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.555+0000 7fdebf59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec006fdf0 con 0x7fdec006d1d0 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39680/0 (socket says 172.21.15.45:39680) 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 -- 172.21.15.45:0/4153038285 learned_addr learned my addr 172.21.15.45:0/4153038285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebe59c640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec00a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebdd9b640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec00c0bf0 0x7fdec00703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 -- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 msgr2=0x7fdec00a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec00a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 -- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec00c0bf0 msgr2=0x7fdec00703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec00c0bf0 0x7fdec00703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.556+0000 7fdebed9d640 1 -- 172.21.15.45:0/4153038285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80094d0 con 0x7fdec00c59e0 2023-12-08T08:19:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdebed9d640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8037d00 con 0x7fdec00c59e0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8037e80 con 0x7fdec00c59e0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8041640 con 0x7fdec00c59e0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec00a9580 con 0x7fdec00c59e0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.557+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec014df10 con 0x7fdec00c59e0 2023-12-08T08:19:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.558+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec00678c0 con 0x7fdec00c59e0 2023-12-08T08:19:28.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.559+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdeb80417a0 con 0x7fdec00c59e0 2023-12-08T08:19:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.560+0000 7fdeb6ffd640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.560+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdeb803c070 con 0x7fdec00c59e0 2023-12-08T08:19:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.561+0000 7fdebe59c640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.561+0000 7fdebe59c640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 0x7fdea006d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a4da0 tx=0x7fdeb0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.565+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdeb8077560 con 0x7fdec00c59e0 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.764+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdec00c00e0 con 0x7fdec00c59e0 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.765+0000 7fdeb6ffd640 1 -- 172.21.15.45:0/4153038285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdeb807ab80 con 0x7fdec00c59e0 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 msgr2=0x7fdea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 0x7fdea006d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdec00a4da0 tx=0x7fdeb0009040 comp rx=0 tx=0).stop 2023-12-08T08:19:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 msgr2=0x7fdec0072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb8004730 comp rx=0 tx=0).stop 2023-12-08T08:19:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 shutdown_connections 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdea006ae40 0x7fdea006d300 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec00c59e0 0x7fdec0072260 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec00c0bf0 0x7fdec00703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 --2- 172.21.15.45:0/4153038285 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdec006d1d0 0x7fdec00a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.768+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 >> 172.21.15.45:0/4153038285 conn(0x7fdec0066ce0 msgr2=0x7fdec01540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.769+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 shutdown_connections 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:28.769+0000 7fdebf59e640 1 -- 172.21.15.45:0/4153038285 wait complete. 2023-12-08T08:19:28.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.012+0000 7f03c8b4e640 1 Processor -- start 2023-12-08T08:19:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.013+0000 7f03c8b4e640 1 -- start start 2023-12-08T08:19:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c8b4e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 0x7f03c4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c8b4e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03c40c10d0 0x7f03c40c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c8b4e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40a94d0 con 0x7f03c40c02f0 2023-12-08T08:19:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c8b4e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40c2770 con 0x7f03c40c10d0 2023-12-08T08:19:29.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c8b4e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40c07f0 con 0x7f03c4151800 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03c40c10d0 0x7f03c40c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f03c40c02f0 0x7f03c40bf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33202/0 (socket says 172.21.15.45:33202) 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.014+0000 7f03c2ffd640 1 -- 172.21.15.45:0/3695371174 learned_addr learned my addr 172.21.15.45:0/3695371174 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c37fe640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 0x7f03c4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c3fff640 1 -- 172.21.15.45:0/3695371174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 msgr2=0x7f03c4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c3fff640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 0x7f03c4154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c3fff640 1 -- 172.21.15.45:0/3695371174 >> v1:172.21.15.45:6789/0 conn(0x7f03c40c02f0 legacy=0x7f03c40bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c3fff640 1 -- 172.21.15.45:0/3695371174 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40c21b0 con 0x7f03c40c10d0 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c27fc640 1 -- 172.21.15.45:0/3695371174 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020978803 0 0) 0x7f03c40a94d0 con 0x7f03c40c02f0 2023-12-08T08:19:29.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.015+0000 7f03c37fe640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 0x7f03c4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.016+0000 7f03c3fff640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c10d0 0x7f03c40c1540 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e712d12f6c883d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.016+0000 7f03c27fc640 1 -- 172.21.15.45:0/3695371174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc031780 con 0x7f03c40c10d0 2023-12-08T08:19:29.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.016+0000 7f03c27fc640 1 -- 172.21.15.45:0/3695371174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc0318e0 con 0x7f03c40c10d0 2023-12-08T08:19:29.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.016+0000 7f03c27fc640 1 -- 172.21.15.45:0/3695371174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc031c70 con 0x7f03c40c10d0 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 -- 172.21.15.45:0/3695371174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c10d0 msgr2=0x7f03c40c1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c10d0 0x7f03c40c1540 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0097a0 tx=0x7f03bc02b820 comp rx=0 tx=0).stop 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 -- 172.21.15.45:0/3695371174 shutdown_connections 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c10d0 0x7f03c40c1540 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/3695371174 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c4151800 0x7f03c4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 -- 172.21.15.45:0/3695371174 >> 172.21.15.45:0/3695371174 conn(0x7f03c40c6110 msgr2=0x7f03c40c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 -- 172.21.15.45:0/3695371174 shutdown_connections 2023-12-08T08:19:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.017+0000 7f03c8b4e640 1 -- 172.21.15.45:0/3695371174 wait complete. 2023-12-08T08:19:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.019+0000 7f03c8b4e640 1 Processor -- start 2023-12-08T08:19:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.019+0000 7f03c8b4e640 1 -- start start 2023-12-08T08:19:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 0x7f03c4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 0x7f03c414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4155a80 con 0x7f03c40c02f0 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c41ed750 con 0x7f03c4151800 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c8b4e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4154490 con 0x7f03c40c10d0 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39706/0 (socket says 172.21.15.45:39706) 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.020+0000 7f03c37fe640 1 -- 172.21.15.45:0/2778182912 learned_addr learned my addr 172.21.15.45:0/2778182912 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c2ffd640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 0x7f03c4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 -- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 msgr2=0x7f03c4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 0x7f03c4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 -- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 msgr2=0x7f03c414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c3fff640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 0x7f03c414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 0x7f03c414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 -- 172.21.15.45:0/2778182912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc009400 con 0x7f03c40c02f0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c2ffd640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 0x7f03c4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c3fff640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 0x7f03c414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03c37fe640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f03b400cf90 tx=0x7f03b400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.021+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400d840 con 0x7f03c40c02f0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.022+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b400d9a0 con 0x7f03c40c02f0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.022+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c406e4e0 con 0x7f03c40c02f0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.022+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400dd30 con 0x7f03c40c02f0 2023-12-08T08:19:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.022+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c40c5a80 con 0x7f03c40c02f0 2023-12-08T08:19:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.023+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c40673e0 con 0x7f03c40c02f0 2023-12-08T08:19:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.024+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03b4015440 con 0x7f03c40c02f0 2023-12-08T08:19:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.025+0000 7f03bbfff640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.025+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f03b408a4a0 con 0x7f03c40c02f0 2023-12-08T08:19:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.025+0000 7f03c2ffd640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.026+0000 7f03c2ffd640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 0x7f03a406d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f03c414bb70 tx=0x7f03ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.029+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03b4055150 con 0x7f03c40c02f0 2023-12-08T08:19:29.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:29.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.225+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03c40aa510 con 0x7f03c40c02f0 2023-12-08T08:19:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.226+0000 7f03bbfff640 1 -- 172.21.15.45:0/2778182912 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03b4058770 con 0x7f03c40c02f0 2023-12-08T08:19:29.229 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 msgr2=0x7f03a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 0x7f03a406d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f03c414bb70 tx=0x7f03ac009040 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 msgr2=0x7f03c41522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f03b400cf90 tx=0x7f03b400a7d0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 shutdown_connections 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03a406ae40 0x7f03a406d300 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03c40c10d0 0x7f03c4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03c4151800 0x7f03c414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 --2- 172.21.15.45:0/2778182912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03c40c02f0 0x7f03c41522a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.229+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 >> 172.21.15.45:0/2778182912 conn(0x7f03c40c6110 msgr2=0x7f03c41506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.230+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 shutdown_connections 2023-12-08T08:19:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.230+0000 7f03c8b4e640 1 -- 172.21.15.45:0/2778182912 wait complete. 2023-12-08T08:19:29.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:29.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.514+0000 7f63669e5640 1 Processor -- start 2023-12-08T08:19:29.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.514+0000 7f63669e5640 1 -- start start 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f63669e5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f636006d960 0x7f63600c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f63669e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f63600c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f63669e5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6360152660 con 0x7f63600aaf60 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f63669e5640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63600a4d10 con 0x7f636006d960 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f63669e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6360153200 con 0x7f63600c1930 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f635ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63600aaf60 0x7f6360152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33216/0 (socket says 172.21.15.45:33216) 2023-12-08T08:19:29.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.516+0000 7f635ffff640 1 -- 172.21.15.45:0/1406089787 learned_addr learned my addr 172.21.15.45:0/1406089787 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f6357fff640 1 --2- 172.21.15.45:0/1406089787 >> v2:172.21.15.114:3300/0 conn(0x7f636006d960 0x7f63600c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f6364f82640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f63600c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700248744 0 0) 0x7f6360152660 con 0x7f63600aaf60 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f634c003520 con 0x7f63600aaf60 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1381485437 0 0) 0x7f634c003520 con 0x7f63600aaf60 2023-12-08T08:19:29.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 msgr2=0x7f63600c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f63600c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 >> v2:172.21.15.114:3300/0 conn(0x7f636006d960 msgr2=0x7f63600c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 --2- 172.21.15.45:0/1406089787 >> v2:172.21.15.114:3300/0 conn(0x7f636006d960 0x7f63600c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63600c3310 con 0x7f63600aaf60 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f6350001670 con 0x7f63600aaf60 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 >> v1:172.21.15.45:6789/0 conn(0x7f63600aaf60 legacy=0x7f6360152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c003970 0x7f634c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c0047c0 0x7f634c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.517+0000 7f635f7fe640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f634c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63600a4d10 con 0x7f634c003970 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6360153200 con 0x7f634c0047c0 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c00b9b0 con 0x7f63600c1930 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c003970 0x7f634c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f6357fff640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c0047c0 0x7f634c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f6364f82640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f634c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 -- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 msgr2=0x7f634c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f634c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 -- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c0047c0 msgr2=0x7f634c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c0047c0 0x7f634c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f635ffff640 1 -- 172.21.15.45:0/1406089787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c003520 con 0x7f634c003970 2023-12-08T08:19:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.518+0000 7f6364f82640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f63600c1930 0x7f634c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.519+0000 7f635ffff640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c003970 0x7f634c003d90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f635000c210 tx=0x7f634c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db3df1401270e15 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350005ad0 con 0x7f634c003970 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350005c30 con 0x7f634c003970 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f635f7fe640 1 -- 172.21.15.45:0/1406089787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635002c8d0 con 0x7f634c003970 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f63669e5640 1 -- 172.21.15.45:0/1406089787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c003970 msgr2=0x7f634c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f63669e5640 1 --2- 172.21.15.45:0/1406089787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c003970 0x7f634c003d90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f635000c210 tx=0x7f634c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f6364f82640 1 -- 172.21.15.45:0/1406089787 reap_dead start 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f63669e5640 1 -- 172.21.15.45:0/1406089787 shutdown_connections 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f63669e5640 1 -- 172.21.15.45:0/1406089787 >> 172.21.15.45:0/1406089787 conn(0x7f63600c2430 msgr2=0x7f63600c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.520+0000 7f63669e5640 1 -- 172.21.15.45:0/1406089787 shutdown_connections 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.521+0000 7f63669e5640 1 -- 172.21.15.45:0/1406089787 wait complete. 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.522+0000 7f63669e5640 1 Processor -- start 2023-12-08T08:19:29.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.523+0000 7f63669e5640 1 -- start start 2023-12-08T08:19:29.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.523+0000 7f63669e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 0x7f63601ea650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.523+0000 7f63669e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.523+0000 7f63669e5640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6360156210 0x7f636014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f63669e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63601dca80 con 0x7f6360154140 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f63669e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63601eab90 con 0x7f634c003970 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f63669e5640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63601dbe20 con 0x7f6360156210 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39726/0 (socket says 172.21.15.45:39726) 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 -- 172.21.15.45:0/1687224905 learned_addr learned my addr 172.21.15.45:0/1687224905 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 -- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6360156210 msgr2=0x7f636014e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6364f82640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6360156210 0x7f636014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6360156210 0x7f636014e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f635ffff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 0x7f63601ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 -- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 msgr2=0x7f63601ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 0x7f63601ea650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f6357fff640 1 -- 172.21.15.45:0/1687224905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360156690 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.524+0000 7f635ffff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 0x7f63601ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f6357fff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6348011590 tx=0x7f6348011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348004220 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348004380 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348015930 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6360155210 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.525+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63601554d0 con 0x7f6360154140 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.526+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6360152280 con 0x7f6360154140 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.527+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6348015a90 con 0x7f6360154140 2023-12-08T08:19:29.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.528+0000 7f635d7fa640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 0x7f634006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.528+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f6348089aa0 con 0x7f6360154140 2023-12-08T08:19:29.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.529+0000 7f635ffff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 0x7f634006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.530+0000 7f635ffff640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 0x7f634006d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6350034000 tx=0x7f6350037040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.533+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6348054740 con 0x7f6360154140 2023-12-08T08:19:29.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.726+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63600673e0 con 0x7f6360154140 2023-12-08T08:19:29.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.727+0000 7f635d7fa640 1 -- 172.21.15.45:0/1687224905 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v83) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6348057d60 con 0x7f6360154140 2023-12-08T08:19:29.730 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.729+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 msgr2=0x7f634006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.729+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 0x7f634006d330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6350034000 tx=0x7f6350037040 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.729+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 msgr2=0x7f6360155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.729+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6348011590 tx=0x7f6348011a50 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 shutdown_connections 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f634006ae70 0x7f634006d330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6360156210 0x7f636014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6360154140 0x7f6360155cd0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 --2- 172.21.15.45:0/1687224905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f634c003970 0x7f63601ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 >> 172.21.15.45:0/1687224905 conn(0x7f63600c2430 msgr2=0x7f6360150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 shutdown_connections 2023-12-08T08:19:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.730+0000 7f63669e5640 1 -- 172.21.15.45:0/1687224905 wait complete. 2023-12-08T08:19:29.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:29.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.987+0000 7fb1c929b640 1 Processor -- start 2023-12-08T08:19:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.987+0000 7fb1c929b640 1 -- start start 2023-12-08T08:19:29.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c929b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 0x7fb1c40c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c929b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1c40c1930 0x7fb1c40c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c929b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c4152660 con 0x7fb1c40aaf60 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c929b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c40a4d10 con 0x7fb1c40c1930 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c929b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4153200 con 0x7fb1c406d960 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c2ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1c40aaf60 0x7fb1c4152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33226/0 (socket says 172.21.15.45:33226) 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c2ffd640 1 -- 172.21.15.45:0/521781566 learned_addr learned my addr 172.21.15.45:0/521781566 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c37fe640 1 --2- 172.21.15.45:0/521781566 >> v2:172.21.15.45:3300/0 conn(0x7fb1c40c1930 0x7fb1c40c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c27fc640 1 -- 172.21.15.45:0/521781566 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256529128 0 0) 0x7fb1c4152660 con 0x7fb1c40aaf60 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.989+0000 7fb1c27fc640 1 -- 172.21.15.45:0/521781566 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b0003520 con 0x7fb1c40aaf60 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1bbfff640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 0x7fb1c40c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1c37fe640 1 -- 172.21.15.45:0/521781566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 msgr2=0x7fb1c40c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1c37fe640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 0x7fb1c40c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1c37fe640 1 -- 172.21.15.45:0/521781566 >> v1:172.21.15.45:6789/0 conn(0x7fb1c40aaf60 legacy=0x7fb1c4152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1c37fe640 1 -- 172.21.15.45:0/521781566 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40c3310 con 0x7fb1c40c1930 2023-12-08T08:19:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.990+0000 7fb1bbfff640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 0x7fb1c40c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.991+0000 7fb1c37fe640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40c1930 0x7fb1c40c1de0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009d90 tx=0x7fb1bc02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8c4a8836b32ae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.991+0000 7fb1c27fc640 1 -- 172.21.15.45:0/521781566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc02cbc0 con 0x7fb1c40c1930 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.991+0000 7fb1c27fc640 1 -- 172.21.15.45:0/521781566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc02cd20 con 0x7fb1c40c1930 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.991+0000 7fb1c27fc640 1 -- 172.21.15.45:0/521781566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc034660 con 0x7fb1c40c1930 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 -- 172.21.15.45:0/521781566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40c1930 msgr2=0x7fb1c40c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40c1930 0x7fb1c40c1de0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009d90 tx=0x7fb1bc02be10 comp rx=0 tx=0).stop 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 -- 172.21.15.45:0/521781566 shutdown_connections 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40c1930 0x7fb1c40c1de0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 --2- 172.21.15.45:0/521781566 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c406d960 0x7fb1c40c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 -- 172.21.15.45:0/521781566 >> 172.21.15.45:0/521781566 conn(0x7fb1c40c2430 msgr2=0x7fb1c40c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 -- 172.21.15.45:0/521781566 shutdown_connections 2023-12-08T08:19:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.992+0000 7fb1c929b640 1 -- 172.21.15.45:0/521781566 wait complete. 2023-12-08T08:19:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.994+0000 7fb1c929b640 1 Processor -- start 2023-12-08T08:19:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.994+0000 7fb1c929b640 1 -- start start 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1c406d960 0x7fb1c41ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c40c1930 0x7fb1c414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4072360 con 0x7fb1c40aaf60 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4072640 con 0x7fb1c406d960 2023-12-08T08:19:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1c929b640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4072920 con 0x7fb1c40c1930 2023-12-08T08:19:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39754/0 (socket says 172.21.15.45:39754) 2023-12-08T08:19:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.995+0000 7fb1bbfff640 1 -- 172.21.15.45:0/1970634522 learned_addr learned my addr 172.21.15.45:0/1970634522 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1c2ffd640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1c406d960 0x7fb1c41ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1c37fe640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c40c1930 0x7fb1c414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 -- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c40c1930 msgr2=0x7fb1c414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c40c1930 0x7fb1c414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 -- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1c406d960 msgr2=0x7fb1c41ecb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1c406d960 0x7fb1c41ecb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 -- 172.21.15.45:0/1970634522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc009a70 con 0x7fb1c40aaf60 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.996+0000 7fb1bbfff640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c7f0 tx=0x7fb1ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.997+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac007a30 con 0x7fb1c40aaf60 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.997+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac007b90 con 0x7fb1c40aaf60 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.997+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00ce40 con 0x7fb1c40aaf60 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.997+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c414e9c0 con 0x7fb1c40aaf60 2023-12-08T08:19:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.997+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c4151930 con 0x7fb1c40aaf60 2023-12-08T08:19:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.998+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c406cb00 con 0x7fb1c40aaf60 2023-12-08T08:19:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:29.999+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1ac0113f0 con 0x7fb1c40aaf60 2023-12-08T08:19:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.000+0000 7fb1bb7fe640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.000+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb1ac089d20 con 0x7fb1c40aaf60 2023-12-08T08:19:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.000+0000 7fb1c2ffd640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.001+0000 7fb1c2ffd640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40011e0 tx=0x7fb1b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.004+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1ac054890 con 0x7fb1c40aaf60 2023-12-08T08:19:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.204+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb1c414eee0 con 0x7fb1c40aaf60 2023-12-08T08:19:30.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.205+0000 7fb1bb7fe640 1 -- 172.21.15.45:0/1970634522 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v83) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb1c414eee0 con 0x7fb1c40aaf60 2023-12-08T08:19:30.208 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 msgr2=0x7fb1a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 0x7fb1a406d330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40011e0 tx=0x7fb1b4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 msgr2=0x7fb1c41513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c7f0 tx=0x7fb1ac00cbf0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 shutdown_connections 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb1a406ae70 0x7fb1a406d330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb1c40c1930 0x7fb1c414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c40aaf60 0x7fb1c41513f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 --2- 172.21.15.45:0/1970634522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1c406d960 0x7fb1c41ecb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 >> 172.21.15.45:0/1970634522 conn(0x7fb1c40c2430 msgr2=0x7fb1c4152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 shutdown_connections 2023-12-08T08:19:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.208+0000 7fb1c929b640 1 -- 172.21.15.45:0/1970634522 wait complete. 2023-12-08T08:19:30.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:30.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.463+0000 7eff56202640 1 Processor -- start 2023-12-08T08:19:30.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.463+0000 7eff56202640 1 -- start start 2023-12-08T08:19:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.464+0000 7eff56202640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 0x7eff500c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.464+0000 7eff56202640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff56202640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500c7ec0 con 0x7eff5006b960 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff56202640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff50155310 con 0x7eff5014e310 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff56202640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500c6b30 con 0x7eff500c7a40 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff549ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff55200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 0x7eff500c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff549ff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:55016/0 (socket says 172.21.15.45:55016) 2023-12-08T08:19:30.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.465+0000 7eff549ff640 1 -- 172.21.15.45:0/2049496564 learned_addr learned my addr 172.21.15.45:0/2049496564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.466+0000 7eff549ff640 1 -- 172.21.15.45:0/2049496564 >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 msgr2=0x7eff500c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.466+0000 7eff549ff640 1 --2- 172.21.15.45:0/2049496564 >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 0x7eff500c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.466+0000 7eff549ff640 1 -- 172.21.15.45:0/2049496564 >> v1:172.21.15.114:6789/0 conn(0x7eff5006b960 legacy=0x7eff500c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.466+0000 7eff549ff640 1 -- 172.21.15.45:0/2049496564 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500c6e10 con 0x7eff500c7a40 2023-12-08T08:19:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.466+0000 7eff55200640 1 --2- 172.21.15.45:0/2049496564 >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 0x7eff500c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.467+0000 7eff549ff640 1 --2- 172.21.15.45:0/2049496564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff40009870 tx=0x7eff4002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4141325539d85d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.468+0000 7eff47fff640 1 -- 172.21.15.45:0/2049496564 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40031640 con 0x7eff500c7a40 2023-12-08T08:19:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.468+0000 7eff47fff640 1 -- 172.21.15.45:0/2049496564 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400317a0 con 0x7eff500c7a40 2023-12-08T08:19:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.468+0000 7eff47fff640 1 -- 172.21.15.45:0/2049496564 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40031b30 con 0x7eff500c7a40 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 -- 172.21.15.45:0/2049496564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 msgr2=0x7eff50154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 --2- 172.21.15.45:0/2049496564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff40009870 tx=0x7eff4002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 -- 172.21.15.45:0/2049496564 shutdown_connections 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 --2- 172.21.15.45:0/2049496564 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff500c7a40 0x7eff50154dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 --2- 172.21.15.45:0/2049496564 >> v2:172.21.15.114:3300/0 conn(0x7eff5014e310 0x7eff500c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 -- 172.21.15.45:0/2049496564 >> 172.21.15.45:0/2049496564 conn(0x7eff500ab710 msgr2=0x7eff500abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 -- 172.21.15.45:0/2049496564 shutdown_connections 2023-12-08T08:19:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.469+0000 7eff56202640 1 -- 172.21.15.45:0/2049496564 wait complete. 2023-12-08T08:19:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.471+0000 7eff56202640 1 Processor -- start 2023-12-08T08:19:30.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.471+0000 7eff56202640 1 -- start start 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 0x7eff501edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 0x7eff50153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff501e9ec0 con 0x7eff5006b960 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50150690 con 0x7eff500c7a40 2023-12-08T08:19:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.472+0000 7eff56202640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501ee010 con 0x7eff5014e310 2023-12-08T08:19:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39770/0 (socket says 172.21.15.45:39770) 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 -- 172.21.15.45:0/2721237590 learned_addr learned my addr 172.21.15.45:0/2721237590 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff549ff640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 0x7eff501edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55a01640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 0x7eff50153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 -- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 msgr2=0x7eff50153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 0x7eff50153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 -- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 msgr2=0x7eff501edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 0x7eff501edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55200640 1 -- 172.21.15.45:0/2721237590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009a70 con 0x7eff5006b960 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff55a01640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 0x7eff50153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.473+0000 7eff549ff640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 0x7eff501edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff55200640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efc0 tx=0x7eff4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c014680 con 0x7eff5006b960 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00f040 con 0x7eff5006b960 2023-12-08T08:19:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c014a00 con 0x7eff5006b960 2023-12-08T08:19:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400094d0 con 0x7eff5006b960 2023-12-08T08:19:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.474+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50157890 con 0x7eff5006b960 2023-12-08T08:19:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.475+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff500c3f70 con 0x7eff5006b960 2023-12-08T08:19:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.476+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff4c014b60 con 0x7eff5006b960 2023-12-08T08:19:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.477+0000 7eff45ffb640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 0x7eff3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.477+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7eff4c08ab60 con 0x7eff5006b960 2023-12-08T08:19:30.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.478+0000 7eff549ff640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 0x7eff3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.478+0000 7eff549ff640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 0x7eff3406d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7eff40036000 tx=0x7eff4003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.481+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff4c055760 con 0x7eff5006b960 2023-12-08T08:19:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.688+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7eff500743e0 con 0x7eff5006b960 2023-12-08T08:19:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.689+0000 7eff45ffb640 1 -- 172.21.15.45:0/2721237590 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7eff4c058d80 con 0x7eff5006b960 2023-12-08T08:19:30.692 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 msgr2=0x7eff3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 0x7eff3406d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7eff40036000 tx=0x7eff4003c040 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 msgr2=0x7eff5014e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efc0 tx=0x7eff4c00c490 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 shutdown_connections 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff3406ae40 0x7eff3406d300 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff5014e310 0x7eff50153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500c7a40 0x7eff501edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 --2- 172.21.15.45:0/2721237590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff5006b960 0x7eff5014e6f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 >> 172.21.15.45:0/2721237590 conn(0x7eff500ab710 msgr2=0x7eff500c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 shutdown_connections 2023-12-08T08:19:30.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:30.692+0000 7eff56202640 1 -- 172.21.15.45:0/2721237590 wait complete. 2023-12-08T08:19:30.711 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-08T08:19:30.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:30.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:19:30.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.872 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:19:30.924 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:30.924 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:30.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:19:30.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.192+0000 7f7b0b547640 1 Processor -- start 2023-12-08T08:19:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.192+0000 7f7b0b547640 1 -- start start 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0b547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b040aa0a0 0x7f7b040c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0b547640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b041556a0 con 0x7f7b041552c0 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0b547640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04158790 con 0x7f7b040c5d10 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0b547640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040c38a0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0ad46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b040aa0a0 0x7f7b040c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0a545640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b041552c0 0x7f7b040c6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33230/0 (socket says 172.21.15.45:33230) 2023-12-08T08:19:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.194+0000 7f7b0a545640 1 -- 172.21.15.45:0/2599761383 learned_addr learned my addr 172.21.15.45:0/2599761383 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.195+0000 7f7b0ad46640 1 -- 172.21.15.45:0/2599761383 >> v1:172.21.15.114:6789/0 conn(0x7f7b040c5d10 legacy=0x7f7b040c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.195+0000 7f7b0ad46640 1 -- 172.21.15.45:0/2599761383 >> v1:172.21.15.45:6789/0 conn(0x7f7b041552c0 legacy=0x7f7b040c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.195+0000 7f7b0ad46640 1 -- 172.21.15.45:0/2599761383 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04157b80 con 0x7f7b040aa0a0 2023-12-08T08:19:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.196+0000 7f7b0ad46640 1 --2- 172.21.15.45:0/2599761383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b040c2c80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009d90 tx=0x7f7afc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9537bb05a6d244b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.196+0000 7f7b09543640 1 -- 172.21.15.45:0/2599761383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc02cc60 con 0x7f7b040aa0a0 2023-12-08T08:19:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.196+0000 7f7b09543640 1 -- 172.21.15.45:0/2599761383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc02cdc0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.196+0000 7f7b09543640 1 -- 172.21.15.45:0/2599761383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc034660 con 0x7f7b040aa0a0 2023-12-08T08:19:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 -- 172.21.15.45:0/2599761383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 msgr2=0x7f7b040c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2599761383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b040c2c80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009d90 tx=0x7f7afc02beb0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 -- 172.21.15.45:0/2599761383 shutdown_connections 2023-12-08T08:19:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2599761383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b040c2c80 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 -- 172.21.15.45:0/2599761383 >> 172.21.15.45:0/2599761383 conn(0x7f7b040c79b0 msgr2=0x7f7b040c7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 -- 172.21.15.45:0/2599761383 shutdown_connections 2023-12-08T08:19:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.197+0000 7f7b0b547640 1 -- 172.21.15.45:0/2599761383 wait complete. 2023-12-08T08:19:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.198+0000 7f7b0b547640 1 Processor -- start 2023-12-08T08:19:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.199+0000 7f7b0b547640 1 -- start start 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.199+0000 7f7b0b547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.199+0000 7f7b0b547640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b040c5d10 0x7f7b041e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0b547640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b041552c0 0x7f7b041de250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0b547640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041e18f0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0b547640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041dddc0 con 0x7f7b041552c0 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0b547640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041dda90 con 0x7f7b040c5d10 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39788/0 (socket says 172.21.15.45:39788) 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 -- 172.21.15.45:0/2625040500 learned_addr learned my addr 172.21.15.45:0/2625040500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 -- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b040c5d10 msgr2=0x7f7b041e1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b040c5d10 0x7f7b041e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 -- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b041552c0 msgr2=0x7f7b041de250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b041552c0 0x7f7b041de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 -- 172.21.15.45:0/2625040500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc009a70 con 0x7f7b040aa0a0 2023-12-08T08:19:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.200+0000 7f7b0a545640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c4b0 tx=0x7f7b0000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.201+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00005ce0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.201+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00005e40 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.201+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00007270 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.201+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b041eabf0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.201+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0406ff20 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.202+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b040adcf0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.203+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b000073d0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.204+0000 7f7afaffd640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 0x7f7ae806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.204+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f7b00088f10 con 0x7f7b040aa0a0 2023-12-08T08:19:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.204+0000 7f7b09d44640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 0x7f7ae806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.205+0000 7f7b09d44640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 0x7f7ae806d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7b040ad170 tx=0x7f7af4007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.209+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b00053bc0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.443+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b040743e0 con 0x7f7b040aa0a0 2023-12-08T08:19:31.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.444+0000 7f7afaffd640 1 -- 172.21.15.45:0/2625040500 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f7b00017020 con 0x7f7b040aa0a0 2023-12-08T08:19:31.447 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:31.447 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 msgr2=0x7f7ae806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 0x7f7ae806d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7b040ad170 tx=0x7f7af4007a00 comp rx=0 tx=0).stop 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 msgr2=0x7f7b041e0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c4b0 tx=0x7f7b0000c970 comp rx=0 tx=0).stop 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 shutdown_connections 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f7ae806ae40 0x7f7ae806d300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f7b040c5d10 0x7f7b041e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b041552c0 0x7f7b041de250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 --2- 172.21.15.45:0/2625040500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b040aa0a0 0x7f7b041e0cc0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 >> 172.21.15.45:0/2625040500 conn(0x7f7b040c79b0 msgr2=0x7f7b040c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 shutdown_connections 2023-12-08T08:19:31.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:31.447+0000 7f7b0b547640 1 -- 172.21.15.45:0/2625040500 wait complete. 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:19:31.469 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.HvuU8cxwl6 2023-12-08T08:19:31.469 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:19:31.528 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.DvsxJhs7YX 2023-12-08T08:19:31.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /tmp/tmp.HvuU8cxwl6 /tmp/tmp.DvsxJhs7YX 2023-12-08T08:19:31.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.DvsxJhs7YX 2023-12-08T08:19:31.794 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.DvsxJhs7YX is 226B 2023-12-08T08:19:31.859 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.DvsxJhs7YX 2023-12-08T08:19:31.913 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:19:31.913 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:31.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:31.913 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:31.969 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41860sec preferred_lft 41860sec 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:31.970 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c840:90ff:fe61:a1b6/64 scope link 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether e2:7f:28:fb:e5:07 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::e07f:28ff:fefb:e507/64 scope link 2023-12-08T08:19:31.971 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:31.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:31.972 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:32.070 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-08T08:19:32.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.073 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:32.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.133 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-08T08:19:32.134 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-08T08:19:32.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:19:32.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:19:32.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:19:32.134 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-08T08:19:32.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.333 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:19:32.388 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:19:32.389 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:32.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-08T08:19:32.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:32.489 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:32.549 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:32.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:32.549 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:32.605 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:32.605 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/tmp/tmp.HvuU8cxwl6 of=/dev/stdout 2023-12-08T08:19:32.662 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-08T08:19:32.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:32.813 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:32.813 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:32.813 INFO:teuthology.orchestra.run.smithi045.stdout:keyring.get_secret failed 2023-12-08T08:19:32.850 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:32.850 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:32.850 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:19:32.850 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: testuser@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs=/ 2023-12-08T08:19:32.850 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:19:32.852 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-08T08:19:32.852 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:19:32.852 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:19:32.852 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:19:32.852 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:19:32.857 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:19:32.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-08T08:19:32.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:32.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:32.948 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:19:33.009 INFO:teuthology.orchestra.run.smithi045.stdout:client5947 2023-12-08T08:19:33.010 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:33.010 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:33.063 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-12-08T08:19:33.124 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.3uUBnjSsM1 2023-12-08T08:19:33.124 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:33.124 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/tmp/tmp.3uUBnjSsM1 2023-12-08T08:19:33.175 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:33.175 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:33.273 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:33.273 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:33.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.554+0000 7f48920b4640 1 Processor -- start 2023-12-08T08:19:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.554+0000 7f48920b4640 1 -- start start 2023-12-08T08:19:33.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f48920b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f488c0a4d10 0x7f488c156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f48920b4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f48920b4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c14c880 con 0x7f488c14c4a0 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f48920b4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0c4730 con 0x7f488c0a4d10 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f48920b4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c56e0 con 0x7f488c153880 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f488affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f488c0a4d10 0x7f488c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f488affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f488c0a4d10 0x7f488c156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39790/0 (socket says 172.21.15.45:39790) 2023-12-08T08:19:33.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.556+0000 7f488affd640 1 -- 172.21.15.45:0/2035959491 learned_addr learned my addr 172.21.15.45:0/2035959491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488bfff640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488affd640 1 -- 172.21.15.45:0/2035959491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 msgr2=0x7f488c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488affd640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488affd640 1 -- 172.21.15.45:0/2035959491 >> v1:172.21.15.114:6789/0 conn(0x7f488c14c4a0 legacy=0x7f488c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488affd640 1 -- 172.21.15.45:0/2035959491 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0c63b0 con 0x7f488c0a4d10 2023-12-08T08:19:33.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.557+0000 7f488bfff640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.558+0000 7f488affd640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c156490 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4880009870 tx=0x7f488002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2181aa2b09c9486 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.558+0000 7f488a7fc640 1 -- 172.21.15.45:0/2035959491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800317c0 con 0x7f488c0a4d10 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.558+0000 7f488a7fc640 1 -- 172.21.15.45:0/2035959491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880031920 con 0x7f488c0a4d10 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.558+0000 7f488a7fc640 1 -- 172.21.15.45:0/2035959491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880031cb0 con 0x7f488c0a4d10 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 -- 172.21.15.45:0/2035959491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 msgr2=0x7f488c156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c156490 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4880009870 tx=0x7f488002b860 comp rx=0 tx=0).stop 2023-12-08T08:19:33.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 -- 172.21.15.45:0/2035959491 shutdown_connections 2023-12-08T08:19:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 --2- 172.21.15.45:0/2035959491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c156490 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 -- 172.21.15.45:0/2035959491 >> 172.21.15.45:0/2035959491 conn(0x7f488c0661f0 msgr2=0x7f488c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 -- 172.21.15.45:0/2035959491 shutdown_connections 2023-12-08T08:19:33.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.559+0000 7f48920b4640 1 -- 172.21.15.45:0/2035959491 wait complete. 2023-12-08T08:19:33.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.561+0000 7f48920b4640 1 Processor -- start 2023-12-08T08:19:33.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.561+0000 7f48920b4640 1 -- start start 2023-12-08T08:19:33.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c14c4a0 0x7f488c0a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0a9bc0 con 0x7f488c0a4d10 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0a78d0 con 0x7f488c14c4a0 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.562+0000 7f48920b4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0a7b70 con 0x7f488c153880 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39800/0 (socket says 172.21.15.45:39800) 2023-12-08T08:19:33.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 -- 172.21.15.45:0/3520711229 learned_addr learned my addr 172.21.15.45:0/3520711229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:33.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488affd640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c14c4a0 0x7f488c0a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488bfff640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 -- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 msgr2=0x7f488c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 -- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c14c4a0 msgr2=0x7f488c0a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c14c4a0 0x7f488c0a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.563+0000 7f488b7fe640 1 -- 172.21.15.45:0/3520711229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800094d0 con 0x7f488c0a4d10 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f488b7fe640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f487c00c430 tx=0x7f487c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c011790 con 0x7f488c0a4d10 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0118f0 con 0x7f488c0a4d10 2023-12-08T08:19:33.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c011ce0 con 0x7f488c0a4d10 2023-12-08T08:19:33.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c1edb40 con 0x7f488c0a4d10 2023-12-08T08:19:33.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.564+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c0c2390 con 0x7f488c0a4d10 2023-12-08T08:19:33.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.566+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c074600 con 0x7f488c0a4d10 2023-12-08T08:19:33.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.566+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f487c01c460 con 0x7f488c0a4d10 2023-12-08T08:19:33.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.567+0000 7f4873fff640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 0x7f487806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.567+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f487c089a60 con 0x7f488c0a4d10 2023-12-08T08:19:33.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.568+0000 7f488affd640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 0x7f487806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.568+0000 7f488affd640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 0x7f487806d300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4880036000 tx=0x7f488003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.571+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f487c054660 con 0x7f488c0a4d10 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.770+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488c0a9d00 con 0x7f488c0a4d10 2023-12-08T08:19:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.773+0000 7f4873fff640 1 -- 172.21.15.45:0/3520711229 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f487c057c80 con 0x7f488c0a4d10 2023-12-08T08:19:33.776 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 msgr2=0x7f487806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 0x7f487806d300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4880036000 tx=0x7f488003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 msgr2=0x7f488c0aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f487c00c430 tx=0x7f487c00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 shutdown_connections 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f487806ae40 0x7f487806d300 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f488c153880 0x7f488c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f488c14c4a0 0x7f488c0a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 --2- 172.21.15.45:0/3520711229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c0a4d10 0x7f488c0aa050 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 >> 172.21.15.45:0/3520711229 conn(0x7f488c0661f0 msgr2=0x7f488c0665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 shutdown_connections 2023-12-08T08:19:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:33.776+0000 7f48920b4640 1 -- 172.21.15.45:0/3520711229 wait complete. 2023-12-08T08:19:33.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:33.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.009+0000 7fdd55b41640 1 Processor -- start 2023-12-08T08:19:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.009+0000 7fdd55b41640 1 -- start start 2023-12-08T08:19:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd55b41640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 0x7fdd500c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd55b41640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd5006d960 0x7fdd50152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd55b41640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd50152660 con 0x7fdd500c1930 2023-12-08T08:19:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd55b41640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500a4d10 con 0x7fdd5006d960 2023-12-08T08:19:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd55b41640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500c3310 con 0x7fdd500aaf60 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd4effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd5006d960 0x7fdd50152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd4ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd500c1930 0x7fdd501558b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33244/0 (socket says 172.21.15.45:33244) 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.011+0000 7fdd4ffff640 1 -- 172.21.15.45:0/1428836598 learned_addr learned my addr 172.21.15.45:0/1428836598 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4f7fe640 1 --2- 172.21.15.45:0/1428836598 >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 0x7fdd500c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4effd640 1 -- 172.21.15.45:0/1428836598 >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 msgr2=0x7fdd500c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4effd640 1 --2- 172.21.15.45:0/1428836598 >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 0x7fdd500c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4effd640 1 -- 172.21.15.45:0/1428836598 >> v1:172.21.15.45:6789/0 conn(0x7fdd500c1930 legacy=0x7fdd501558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4effd640 1 -- 172.21.15.45:0/1428836598 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500a4ef0 con 0x7fdd5006d960 2023-12-08T08:19:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.012+0000 7fdd4f7fe640 1 --2- 172.21.15.45:0/1428836598 >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 0x7fdd500c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.013+0000 7fdd4effd640 1 --2- 172.21.15.45:0/1428836598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd50152af0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c2390 tx=0x7fdd4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53607b747948cbc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.013+0000 7fdd4e7fc640 1 -- 172.21.15.45:0/1428836598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4402e070 con 0x7fdd5006d960 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.013+0000 7fdd4e7fc640 1 -- 172.21.15.45:0/1428836598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd440315a0 con 0x7fdd5006d960 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.013+0000 7fdd4e7fc640 1 -- 172.21.15.45:0/1428836598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44031930 con 0x7fdd5006d960 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 -- 172.21.15.45:0/1428836598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 msgr2=0x7fdd50152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 --2- 172.21.15.45:0/1428836598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd50152af0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c2390 tx=0x7fdd4402b840 comp rx=0 tx=0).stop 2023-12-08T08:19:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 -- 172.21.15.45:0/1428836598 shutdown_connections 2023-12-08T08:19:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 --2- 172.21.15.45:0/1428836598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd50152af0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 --2- 172.21.15.45:0/1428836598 >> v2:172.21.15.114:3300/0 conn(0x7fdd500aaf60 0x7fdd500c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 -- 172.21.15.45:0/1428836598 >> 172.21.15.45:0/1428836598 conn(0x7fdd500c2430 msgr2=0x7fdd500c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 -- 172.21.15.45:0/1428836598 shutdown_connections 2023-12-08T08:19:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.014+0000 7fdd55b41640 1 -- 172.21.15.45:0/1428836598 wait complete. 2023-12-08T08:19:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.016+0000 7fdd55b41640 1 Processor -- start 2023-12-08T08:19:34.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.016+0000 7fdd55b41640 1 -- start start 2023-12-08T08:19:34.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 0x7fdd5014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 0x7fdd5014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501edbd0 con 0x7fdd5006d960 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5006f9c0 con 0x7fdd500aaf60 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd55b41640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5006fc80 con 0x7fdd500c1930 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39824/0 (socket says 172.21.15.45:39824) 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd4f7fe640 1 -- 172.21.15.45:0/645300663 learned_addr learned my addr 172.21.15.45:0/645300663 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd4effd640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 0x7fdd5014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.017+0000 7fdd4ffff640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 0x7fdd5014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 -- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 msgr2=0x7fdd5014dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 0x7fdd5014dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 -- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 msgr2=0x7fdd5014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 0x7fdd5014d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 -- 172.21.15.45:0/645300663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009400 con 0x7fdd5006d960 2023-12-08T08:19:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4effd640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 0x7fdd5014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4ffff640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 0x7fdd5014dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd4f7fe640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c7f0 tx=0x7fdd4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40007a30 con 0x7fdd5006d960 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40007b90 con 0x7fdd5006d960 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd500c0bb0 con 0x7fdd5006d960 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000ce40 con 0x7fdd5006d960 2023-12-08T08:19:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.018+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd501ed860 con 0x7fdd5006d960 2023-12-08T08:19:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.020+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5006cb00 con 0x7fdd5006d960 2023-12-08T08:19:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.021+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd400113f0 con 0x7fdd5006d960 2023-12-08T08:19:34.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.022+0000 7fdd37fff640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.022+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fdd40089c60 con 0x7fdd5006d960 2023-12-08T08:19:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.022+0000 7fdd4effd640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.023+0000 7fdd4effd640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd4403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.026+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd40054860 con 0x7fdd5006d960 2023-12-08T08:19:34.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.219+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd50074670 con 0x7fdd5006d960 2023-12-08T08:19:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.221+0000 7fdd37fff640 1 -- 172.21.15.45:0/645300663 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd4001f0a0 con 0x7fdd5006d960 2023-12-08T08:19:34.224 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.223+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 msgr2=0x7fdd3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.223+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 0x7fdd3c06d300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd4403d040 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.223+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 msgr2=0x7fdd500aa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.223+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c7f0 tx=0x7fdd4000cbf0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 shutdown_connections 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd3c06ae40 0x7fdd3c06d300 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd500c1930 0x7fdd5014dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd500aaf60 0x7fdd5014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 --2- 172.21.15.45:0/645300663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd5006d960 0x7fdd500aa1e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 >> 172.21.15.45:0/645300663 conn(0x7fdd500c2430 msgr2=0x7fdd50151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 shutdown_connections 2023-12-08T08:19:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.224+0000 7fdd55b41640 1 -- 172.21.15.45:0/645300663 wait complete. 2023-12-08T08:19:34.245 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:34.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.472+0000 7fb871c17640 1 Processor -- start 2023-12-08T08:19:34.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.472+0000 7fb871c17640 1 -- start start 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb871c17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb86c0aaf60 0x7fb86c0c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb871c17640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c152660 con 0x7fb86c06d960 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb871c17640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c153200 con 0x7fb86c0c1930 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb871c17640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c0a4d10 con 0x7fb86c0aaf60 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb86b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb86c0aaf60 0x7fb86c0c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb863fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb86c06d960 0x7fb86c152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33248/0 (socket says 172.21.15.45:33248) 2023-12-08T08:19:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.474+0000 7fb863fff640 1 -- 172.21.15.45:0/4108389060 learned_addr learned my addr 172.21.15.45:0/4108389060 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.475+0000 7fb86affd640 1 -- 172.21.15.45:0/4108389060 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190601679 0 0) 0x7fb86c152660 con 0x7fb86c06d960 2023-12-08T08:19:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.475+0000 7fb86b7fe640 1 -- 172.21.15.45:0/4108389060 >> v1:172.21.15.114:6789/0 conn(0x7fb86c0c1930 legacy=0x7fb86c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.475+0000 7fb86b7fe640 1 -- 172.21.15.45:0/4108389060 >> v1:172.21.15.45:6789/0 conn(0x7fb86c06d960 legacy=0x7fb86c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.475+0000 7fb86b7fe640 1 -- 172.21.15.45:0/4108389060 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0c3310 con 0x7fb86c0aaf60 2023-12-08T08:19:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.476+0000 7fb86b7fe640 1 --2- 172.21.15.45:0/4108389060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c0aaf60 0x7fb86c0c3830 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78a91df56b70719 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb86affd640 1 -- 172.21.15.45:0/4108389060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c02e070 con 0x7fb86c0aaf60 2023-12-08T08:19:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb86affd640 1 -- 172.21.15.45:0/4108389060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0315a0 con 0x7fb86c0aaf60 2023-12-08T08:19:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb86affd640 1 -- 172.21.15.45:0/4108389060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c031930 con 0x7fb86c0aaf60 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb871c17640 1 -- 172.21.15.45:0/4108389060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c0aaf60 msgr2=0x7fb86c0c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb871c17640 1 --2- 172.21.15.45:0/4108389060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c0aaf60 0x7fb86c0c3830 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c02b840 comp rx=0 tx=0).stop 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb871c17640 1 -- 172.21.15.45:0/4108389060 shutdown_connections 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb871c17640 1 --2- 172.21.15.45:0/4108389060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c0aaf60 0x7fb86c0c3830 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.477+0000 7fb871c17640 1 -- 172.21.15.45:0/4108389060 >> 172.21.15.45:0/4108389060 conn(0x7fb86c0c2430 msgr2=0x7fb86c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.478+0000 7fb871c17640 1 -- 172.21.15.45:0/4108389060 shutdown_connections 2023-12-08T08:19:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.478+0000 7fb871c17640 1 -- 172.21.15.45:0/4108389060 wait complete. 2023-12-08T08:19:34.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.479+0000 7fb871c17640 1 Processor -- start 2023-12-08T08:19:34.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.479+0000 7fb871c17640 1 -- start start 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86c0aaf60 0x7fb86c071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 0x7fb86c0bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0711b0 con 0x7fb86c06d960 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c142c00 con 0x7fb86c0c1930 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.480+0000 7fb871c17640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0a8eb0 con 0x7fb86c0aaf60 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39840/0 (socket says 172.21.15.45:39840) 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 -- 172.21.15.45:0/631713556 learned_addr learned my addr 172.21.15.45:0/631713556 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86bfff640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 0x7fb86c0bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb863fff640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86c0aaf60 0x7fb86c071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 -- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86c0aaf60 msgr2=0x7fb86c071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86c0aaf60 0x7fb86c071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 -- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 msgr2=0x7fb86c0bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 0x7fb86c0bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86b7fe640 1 -- 172.21.15.45:0/631713556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c009400 con 0x7fb86c06d960 2023-12-08T08:19:34.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.481+0000 7fb86bfff640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 0x7fb86c0bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb86b7fe640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c004230 con 0x7fb86c06d960 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0043b0 con 0x7fb86c06d960 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c004520 con 0x7fb86c06d960 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c1e9860 con 0x7fb86c06d960 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.482+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c070e40 con 0x7fb86c06d960 2023-12-08T08:19:34.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.483+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c074670 con 0x7fb86c06d960 2023-12-08T08:19:34.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.484+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb85c032880 con 0x7fb86c06d960 2023-12-08T08:19:34.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.485+0000 7fb868ff9640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.485+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fb85c0abc60 con 0x7fb86c06d960 2023-12-08T08:19:34.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.485+0000 7fb863fff640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.486+0000 7fb863fff640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb86c14b480 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.490+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb85c076860 con 0x7fb86c06d960 2023-12-08T08:19:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.686+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb86c074670 con 0x7fb86c06d960 2023-12-08T08:19:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.687+0000 7fb868ff9640 1 -- 172.21.15.45:0/631713556 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb85c079e80 con 0x7fb86c06d960 2023-12-08T08:19:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 msgr2=0x7fb84c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb86c14b480 tx=0x7fb854009040 comp rx=0 tx=0).stop 2023-12-08T08:19:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 msgr2=0x7fb86c1426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 shutdown_connections 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fb86c0aaf60 0x7fb86c071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb86c0c1930 0x7fb86c0bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 --2- 172.21.15.45:0/631713556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb86c06d960 0x7fb86c1426c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 >> 172.21.15.45:0/631713556 conn(0x7fb86c0c2430 msgr2=0x7fb86c152af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 shutdown_connections 2023-12-08T08:19:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.690+0000 7fb871c17640 1 -- 172.21.15.45:0/631713556 wait complete. 2023-12-08T08:19:34.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:34.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.930+0000 7f0fd8bc1640 1 Processor -- start 2023-12-08T08:19:34.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.930+0000 7f0fd8bc1640 1 -- start start 2023-12-08T08:19:34.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.931+0000 7f0fd8bc1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0fd40c1d60 0x7f0fd406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.931+0000 7f0fd8bc1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40c16b0 con 0x7f0fd4151ec0 2023-12-08T08:19:34.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.931+0000 7f0fd8bc1640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40c65d0 con 0x7f0fd40aa2d0 2023-12-08T08:19:34.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.931+0000 7f0fd8bc1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd40a8b30 con 0x7f0fd40c1d60 2023-12-08T08:19:34.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0fd4151ec0 0x7f0fd40c47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33260/0 (socket says 172.21.15.45:33260) 2023-12-08T08:19:34.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd37fe640 1 -- 172.21.15.45:0/3645687602 learned_addr learned my addr 172.21.15.45:0/3645687602 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd2ffd640 1 --2- 172.21.15.45:0/3645687602 >> v2:172.21.15.45:3300/0 conn(0x7f0fd40c1d60 0x7f0fd406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd27fc640 1 -- 172.21.15.45:0/3645687602 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308627066 0 0) 0x7f0fd40c16b0 con 0x7f0fd4151ec0 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd27fc640 1 -- 172.21.15.45:0/3645687602 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0003520 con 0x7f0fd4151ec0 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/3645687602 >> v1:172.21.15.114:6789/0 conn(0x7f0fd40aa2d0 legacy=0x7f0fd406bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/3645687602 >> v1:172.21.15.45:6789/0 conn(0x7f0fd4151ec0 legacy=0x7f0fd40c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.932+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/3645687602 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40c5810 con 0x7f0fd40c1d60 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd2ffd640 1 --2- 172.21.15.45:0/3645687602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd406ba10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0097a0 tx=0x7f0fbc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e0fbb5ffd999e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd27fc640 1 -- 172.21.15.45:0/3645687602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc02e070 con 0x7f0fd40c1d60 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd27fc640 1 -- 172.21.15.45:0/3645687602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0315a0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd27fc640 1 -- 172.21.15.45:0/3645687602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc031930 con 0x7f0fd40c1d60 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/3645687602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 msgr2=0x7f0fd406ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.934+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/3645687602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd406ba10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0097a0 tx=0x7f0fbc02b840 comp rx=0 tx=0).stop 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.935+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/3645687602 shutdown_connections 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.935+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/3645687602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd406ba10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.935+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/3645687602 >> 172.21.15.45:0/3645687602 conn(0x7f0fd4066ce0 msgr2=0x7f0fd40a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.935+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/3645687602 shutdown_connections 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.935+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/3645687602 wait complete. 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.936+0000 7f0fd8bc1640 1 Processor -- start 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 -- start start 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40aa2d0 0x7f0fd414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fd4151ec0 0x7f0fd41485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4155200 con 0x7f0fd40c1d60 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4154c40 con 0x7f0fd40aa2d0 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.937+0000 7f0fd8bc1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41eabf0 con 0x7f0fd4151ec0 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39848/0 (socket says 172.21.15.45:39848) 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/1760914095 learned_addr learned my addr 172.21.15.45:0/1760914095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd37fe640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40aa2d0 0x7f0fd414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd3fff640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fd4151ec0 0x7f0fd41485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fd4151ec0 msgr2=0x7f0fd41485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fd4151ec0 0x7f0fd41485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40aa2d0 msgr2=0x7f0fd414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40aa2d0 0x7f0fd414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.938+0000 7f0fd2ffd640 1 -- 172.21.15.45:0/1760914095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc009400 con 0x7f0fd40c1d60 2023-12-08T08:19:34.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fd2ffd640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc034040 tx=0x7f0fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc032840 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0329c0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc032d70 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd41eaed0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.939+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd41492e0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.940+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd40678c0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.941+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fbc03b3f0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.942+0000 7f0fcbfff640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 0x7f0fb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.943+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f0fbc0ab9e0 con 0x7f0fd40c1d60 2023-12-08T08:19:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.943+0000 7f0fd37fe640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 0x7f0fb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.943+0000 7f0fd37fe640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 0x7f0fb406d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4001560 tx=0x7f0fc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:34.947+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fbc0765f0 con 0x7f0fd40c1d60 2023-12-08T08:19:35.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.142+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fd40743e0 con 0x7f0fd40c1d60 2023-12-08T08:19:35.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.143+0000 7f0fcbfff640 1 -- 172.21.15.45:0/1760914095 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fbc079c10 con 0x7f0fd40c1d60 2023-12-08T08:19:35.145 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:35.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 msgr2=0x7f0fb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 0x7f0fb406d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4001560 tx=0x7f0fc4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:35.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 msgr2=0x7f0fd41501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc034040 tx=0x7f0fbc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 shutdown_connections 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fb406ae40 0x7f0fb406d300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fd4151ec0 0x7f0fd41485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fd40c1d60 0x7f0fd41501d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 --2- 172.21.15.45:0/1760914095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40aa2d0 0x7f0fd414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 >> 172.21.15.45:0/1760914095 conn(0x7f0fd4066ce0 msgr2=0x7f0fd40a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 shutdown_connections 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.145+0000 7f0fd8bc1640 1 -- 172.21.15.45:0/1760914095 wait complete. 2023-12-08T08:19:35.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:35.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.382+0000 7fe33b59e640 1 Processor -- start 2023-12-08T08:19:35.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.382+0000 7fe33b59e640 1 -- start start 2023-12-08T08:19:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.384+0000 7fe33b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 0x7fe33c06c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.384+0000 7fe33b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0c16b0 con 0x7fe33c151ec0 2023-12-08T08:19:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.384+0000 7fe33b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0c65d0 con 0x7fe33c0c1d60 2023-12-08T08:19:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.384+0000 7fe33b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0a8b30 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.385+0000 7fe33a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe33c151ec0 0x7fe33c0c47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43346/0 (socket says 172.21.15.45:43346) 2023-12-08T08:19:35.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.385+0000 7fe33a59c640 1 -- 172.21.15.45:0/437304203 learned_addr learned my addr 172.21.15.45:0/437304203 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:35.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.385+0000 7fe33ad9d640 1 --2- 172.21.15.45:0/437304203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 0x7fe33c06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.385+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579857678 0 0) 0x7fe33c0c16b0 con 0x7fe33c151ec0 2023-12-08T08:19:35.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.385+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe324005730 con 0x7fe33c151ec0 2023-12-08T08:19:35.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.386+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640036979 0 0) 0x7fe33c0c65d0 con 0x7fe33c0c1d60 2023-12-08T08:19:35.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.386+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0c16b0 con 0x7fe33c0c1d60 2023-12-08T08:19:35.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.386+0000 7fe33ad9d640 1 -- 172.21.15.45:0/437304203 >> v1:172.21.15.114:6789/0 conn(0x7fe33c0c1d60 legacy=0x7fe33c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.386+0000 7fe33ad9d640 1 -- 172.21.15.45:0/437304203 >> v1:172.21.15.45:6789/0 conn(0x7fe33c151ec0 legacy=0x7fe33c0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.386+0000 7fe33ad9d640 1 -- 172.21.15.45:0/437304203 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0c5810 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.387+0000 7fe33ad9d640 1 --2- 172.21.15.45:0/437304203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 0x7fe33c06c120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe334009dc0 tx=0x7fe33402bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b6e2e430fa4698 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33402cba0 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33402cd00 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33959a640 1 -- 172.21.15.45:0/437304203 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334034660 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33b59e640 1 -- 172.21.15.45:0/437304203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 msgr2=0x7fe33c06c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33b59e640 1 --2- 172.21.15.45:0/437304203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 0x7fe33c06c120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe334009dc0 tx=0x7fe33402bdf0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33b59e640 1 -- 172.21.15.45:0/437304203 shutdown_connections 2023-12-08T08:19:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33b59e640 1 --2- 172.21.15.45:0/437304203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0aa2d0 0x7fe33c06c120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.388+0000 7fe33b59e640 1 -- 172.21.15.45:0/437304203 >> 172.21.15.45:0/437304203 conn(0x7fe33c066ce0 msgr2=0x7fe33c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.389+0000 7fe33b59e640 1 -- 172.21.15.45:0/437304203 shutdown_connections 2023-12-08T08:19:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.389+0000 7fe33b59e640 1 -- 172.21.15.45:0/437304203 wait complete. 2023-12-08T08:19:35.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.391+0000 7fe33b59e640 1 Processor -- start 2023-12-08T08:19:35.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.391+0000 7fe33b59e640 1 -- start start 2023-12-08T08:19:35.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe33c0aa2d0 0x7fe33c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0c1d60 0x7fe33c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1e32b0 con 0x7fe33c151ec0 2023-12-08T08:19:35.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c155480 con 0x7fe33c0aa2d0 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.392+0000 7fe33b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0bf8f0 con 0x7fe33c0c1d60 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37362/0 (socket says 172.21.15.45:37362) 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 -- 172.21.15.45:0/868891895 learned_addr learned my addr 172.21.15.45:0/868891895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33a59c640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe33c0aa2d0 0x7fe33c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe339d9b640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0c1d60 0x7fe33c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 -- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0c1d60 msgr2=0x7fe33c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0c1d60 0x7fe33c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 -- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe33c0aa2d0 msgr2=0x7fe33c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe33c0aa2d0 0x7fe33c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.393+0000 7fe33ad9d640 1 -- 172.21.15.45:0/868891895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe334009a70 con 0x7fe33c151ec0 2023-12-08T08:19:35.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe33ad9d640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe334009eb0 tx=0x7fe334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33403e610 con 0x7fe33c151ec0 2023-12-08T08:19:35.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33403e770 con 0x7fe33c151ec0 2023-12-08T08:19:35.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33403eb00 con 0x7fe33c151ec0 2023-12-08T08:19:35.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1e9670 con 0x7fe33c151ec0 2023-12-08T08:19:35.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.394+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c155110 con 0x7fe33c151ec0 2023-12-08T08:19:35.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.396+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c1552d0 con 0x7fe33c151ec0 2023-12-08T08:19:35.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.396+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe33403b050 con 0x7fe33c151ec0 2023-12-08T08:19:35.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.397+0000 7fe32affd640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 0x7fe31c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.397+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe3340abfe0 con 0x7fe33c151ec0 2023-12-08T08:19:35.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.398+0000 7fe33a59c640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 0x7fe31c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.398+0000 7fe33a59c640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 0x7fe31c06d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe32c000f60 tx=0x7fe32c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.402+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe334076c00 con 0x7fe33c151ec0 2023-12-08T08:19:35.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.596+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe33c0678c0 con 0x7fe33c151ec0 2023-12-08T08:19:35.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.597+0000 7fe32affd640 1 -- 172.21.15.45:0/868891895 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v83) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe33407a220 con 0x7fe33c151ec0 2023-12-08T08:19:35.600 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.599+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 msgr2=0x7fe31c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.599+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 0x7fe31c06d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe32c000f60 tx=0x7fe32c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.599+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 msgr2=0x7fe33c0718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.599+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe334009eb0 tx=0x7fe334004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 shutdown_connections 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe31c06ae40 0x7fe31c06d300 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe33c0c1d60 0x7fe33c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe33c151ec0 0x7fe33c0718b0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 --2- 172.21.15.45:0/868891895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe33c0aa2d0 0x7fe33c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 >> 172.21.15.45:0/868891895 conn(0x7fe33c066ce0 msgr2=0x7fe33c0a9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 shutdown_connections 2023-12-08T08:19:35.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.600+0000 7fe33b59e640 1 -- 172.21.15.45:0/868891895 wait complete. 2023-12-08T08:19:35.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:35.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.847+0000 7fe11ca48640 1 Processor -- start 2023-12-08T08:19:35.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.848+0000 7fe11ca48640 1 -- start start 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.849+0000 7fe11ca48640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe11815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.849+0000 7fe11ca48640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118152660 con 0x7fe1180aaf60 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.849+0000 7fe11ca48640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118153200 con 0x7fe11806d960 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.849+0000 7fe11ca48640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180a4d10 con 0x7fe1180c3830 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe1180aaf60 0x7fe118152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43352/0 (socket says 172.21.15.45:43352) 2023-12-08T08:19:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11659c640 1 -- 172.21.15.45:0/3887760613 learned_addr learned my addr 172.21.15.45:0/3887760613 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe116d9d640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe11815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029294066 0 0) 0x7fe118152660 con 0x7fe1180aaf60 2023-12-08T08:19:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe104003520 con 0x7fe1180aaf60 2023-12-08T08:19:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827451491 0 0) 0x7fe104003520 con 0x7fe1180aaf60 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 msgr2=0x7fe11815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe11815dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 >> v1:172.21.15.114:6789/0 conn(0x7fe11806d960 legacy=0x7fe1180c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.850+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180c3310 con 0x7fe1180aaf60 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe1080019f0 con 0x7fe1180aaf60 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 >> v1:172.21.15.45:6789/0 conn(0x7fe1180aaf60 legacy=0x7fe118152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe1040039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe104003f70 0x7fe1040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe104004d00 0x7fe104005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180a4d10 con 0x7fe104004d00 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10400bac0 con 0x7fe104003f70 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10400bc80 con 0x7fe1180c3830 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe104004d00 0x7fe104005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe11659c640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe1040039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe115d9b640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe104003f70 0x7fe1040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 -- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 msgr2=0x7fe1040039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe1180c3830 0x7fe1040039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 -- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe104003f70 msgr2=0x7fe1040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe104003f70 0x7fe1040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.851+0000 7fe116d9d640 1 -- 172.21.15.45:0/3887760613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104003520 con 0x7fe104004d00 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe116d9d640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe104004d00 0x7fe104005180 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe110009ac0 tx=0x7fe1040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d394b592c1ea1f03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11002c6b0 con 0x7fe104004d00 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11002c810 con 0x7fe104004d00 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe11559a640 1 -- 172.21.15.45:0/3887760613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11002cba0 con 0x7fe104004d00 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe11ca48640 1 -- 172.21.15.45:0/3887760613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe104004d00 msgr2=0x7fe104005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe11ca48640 1 --2- 172.21.15.45:0/3887760613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe104004d00 0x7fe104005180 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe110009ac0 tx=0x7fe1040057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.853+0000 7fe116d9d640 1 -- 172.21.15.45:0/3887760613 reap_dead start 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.854+0000 7fe11ca48640 1 -- 172.21.15.45:0/3887760613 shutdown_connections 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.854+0000 7fe11ca48640 1 -- 172.21.15.45:0/3887760613 >> 172.21.15.45:0/3887760613 conn(0x7fe1180c2430 msgr2=0x7fe1180c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.854+0000 7fe11ca48640 1 -- 172.21.15.45:0/3887760613 shutdown_connections 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.854+0000 7fe11ca48640 1 -- 172.21.15.45:0/3887760613 wait complete. 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.855+0000 7fe11ca48640 1 Processor -- start 2023-12-08T08:19:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.856+0000 7fe11ca48640 1 -- start start 2023-12-08T08:19:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.856+0000 7fe11ca48640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe104004d00 0x7fe11814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.856+0000 7fe11ca48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe11ca48640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1180aa610 0x7fe1180bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe11ca48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11814b970 con 0x7fe1181ea020 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe11ca48640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181e9b90 con 0x7fe1180aa610 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe11ca48640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180a93e0 con 0x7fe104004d00 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37392/0 (socket says 172.21.15.45:37392) 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 -- 172.21.15.45:0/52721541 learned_addr learned my addr 172.21.15.45:0/52721541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe116d9d640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1180aa610 0x7fe1180bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 -- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe104004d00 msgr2=0x7fe11814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe104004d00 0x7fe11814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 -- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1180aa610 msgr2=0x7fe1180bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1180aa610 0x7fe1180bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.857+0000 7fe115d9b640 1 -- 172.21.15.45:0/52721541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180a96c0 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe115d9b640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e5b0 tx=0x7fe10000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000052e0 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100005440 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100003810 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1181e9820 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.858+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11814d290 con 0x7fe1181ea020 2023-12-08T08:19:35.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.859+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe118074670 con 0x7fe1181ea020 2023-12-08T08:19:35.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.860+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe100003970 con 0x7fe1181ea020 2023-12-08T08:19:35.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.861+0000 7fe10effd640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 0x7fe0f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.861+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fe100089900 con 0x7fe1181ea020 2023-12-08T08:19:35.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.861+0000 7fe11659c640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 0x7fe0f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.862+0000 7fe11659c640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 0x7fe0f806d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe1080013d0 tx=0x7fe1080012c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:35.866+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe100054480 con 0x7fe1181ea020 2023-12-08T08:19:36.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.058+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe1181e9cd0 con 0x7fe1181ea020 2023-12-08T08:19:36.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.059+0000 7fe10effd640 1 -- 172.21.15.45:0/52721541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v83) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe100057aa0 con 0x7fe1181ea020 2023-12-08T08:19:36.062 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.061+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 msgr2=0x7fe0f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.061+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 0x7fe0f806d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe1080013d0 tx=0x7fe1080012c0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.061+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 msgr2=0x7fe1180aa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.061+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e5b0 tx=0x7fe10000ea70 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 shutdown_connections 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe0f806ae40 0x7fe0f806d300 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1180aa610 0x7fe1180bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1181ea020 0x7fe1180aa0d0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 --2- 172.21.15.45:0/52721541 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe104004d00 0x7fe11814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 >> 172.21.15.45:0/52721541 conn(0x7fe1180c2430 msgr2=0x7fe118150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 shutdown_connections 2023-12-08T08:19:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.062+0000 7fe11ca48640 1 -- 172.21.15.45:0/52721541 wait complete. 2023-12-08T08:19:36.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:36.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.294+0000 7f99d6106640 1 Processor -- start 2023-12-08T08:19:36.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.294+0000 7f99d6106640 1 -- start start 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d6106640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99d014e310 0x7f99d00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d6106640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d00c7a40 0x7f99d0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d6106640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d00c7ec0 con 0x7f99d006b960 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d6106640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d0155310 con 0x7f99d014e310 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d6106640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00c6b30 con 0x7f99d00c7a40 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99d014e310 0x7f99d00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99d014e310 0x7f99d00c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37394/0 (socket says 172.21.15.45:37394) 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 -- 172.21.15.45:0/2533935613 learned_addr learned my addr 172.21.15.45:0/2533935613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 -- 172.21.15.45:0/2533935613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d00c7a40 msgr2=0x7f99d0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 --2- 172.21.15.45:0/2533935613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d00c7a40 0x7f99d0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 -- 172.21.15.45:0/2533935613 >> v1:172.21.15.114:6789/0 conn(0x7f99d006b960 legacy=0x7f99d00c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.296+0000 7f99d5104640 1 -- 172.21.15.45:0/2533935613 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00c6e10 con 0x7f99d014e310 2023-12-08T08:19:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.298+0000 7f99d5104640 1 --2- 172.21.15.45:0/2533935613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014e310 0x7f99d00c6550 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6266257ab7140e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.298+0000 7f99c7fff640 1 -- 172.21.15.45:0/2533935613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0317c0 con 0x7f99d014e310 2023-12-08T08:19:36.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.298+0000 7f99c7fff640 1 -- 172.21.15.45:0/2533935613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc031920 con 0x7f99d014e310 2023-12-08T08:19:36.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.298+0000 7f99c7fff640 1 -- 172.21.15.45:0/2533935613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc031cb0 con 0x7f99d014e310 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 -- 172.21.15.45:0/2533935613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014e310 msgr2=0x7f99d00c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 --2- 172.21.15.45:0/2533935613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014e310 0x7f99d00c6550 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc02b860 comp rx=0 tx=0).stop 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 -- 172.21.15.45:0/2533935613 shutdown_connections 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 --2- 172.21.15.45:0/2533935613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d00c7a40 0x7f99d0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 --2- 172.21.15.45:0/2533935613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d014e310 0x7f99d00c6550 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 -- 172.21.15.45:0/2533935613 >> 172.21.15.45:0/2533935613 conn(0x7f99d00ab710 msgr2=0x7f99d00abb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 -- 172.21.15.45:0/2533935613 shutdown_connections 2023-12-08T08:19:36.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.299+0000 7f99d6106640 1 -- 172.21.15.45:0/2533935613 wait complete. 2023-12-08T08:19:36.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.301+0000 7f99d6106640 1 Processor -- start 2023-12-08T08:19:36.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.302+0000 7f99d6106640 1 -- start start 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d006b960 0x7f99d0156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d014e310 0x7f99d014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01ed210 con 0x7f99d00c7a40 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01ed4f0 con 0x7f99d006b960 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d6106640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d01ed7d0 con 0x7f99d014e310 2023-12-08T08:19:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d4903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d4903640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37402/0 (socket says 172.21.15.45:37402) 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.303+0000 7f99d4903640 1 -- 172.21.15.45:0/3659010453 learned_addr learned my addr 172.21.15.45:0/3659010453 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d5905640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d014e310 0x7f99d014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d5104640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d006b960 0x7f99d0156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 -- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d014e310 msgr2=0x7f99d014ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d014e310 0x7f99d014ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 -- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d006b960 msgr2=0x7f99d0156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d006b960 0x7f99d0156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 -- 172.21.15.45:0/3659010453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0094d0 con 0x7f99d00c7a40 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d4903640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f99c000b410 tx=0x7f99c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011830 con 0x7f99d00c7a40 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c00119b0 con 0x7f99d00c7a40 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011d60 con 0x7f99d00c7a40 2023-12-08T08:19:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.304+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d01edab0 con 0x7f99d00c7a40 2023-12-08T08:19:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.305+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d0157420 con 0x7f99d00c7a40 2023-12-08T08:19:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.306+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d01edfd0 con 0x7f99d00c7a40 2023-12-08T08:19:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.307+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99c001a400 con 0x7f99d00c7a40 2023-12-08T08:19:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.307+0000 7f99c5ffb640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 0x7f99b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.308+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f99c0089c80 con 0x7f99d00c7a40 2023-12-08T08:19:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.308+0000 7f99d5104640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 0x7f99b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.308+0000 7f99d5104640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 0x7f99b406d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f99cc036000 tx=0x7f99cc03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.314+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99d01edfd0 con 0x7f99d00c7a40 2023-12-08T08:19:36.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.521+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99d01edfd0 con 0x7f99d00c7a40 2023-12-08T08:19:36.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.522+0000 7f99c5ffb640 1 -- 172.21.15.45:0/3659010453 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99d01edfd0 con 0x7f99d00c7a40 2023-12-08T08:19:36.525 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 msgr2=0x7f99b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 0x7f99b406d330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f99cc036000 tx=0x7f99cc03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 msgr2=0x7f99d00af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f99c000b410 tx=0x7f99c000b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 shutdown_connections 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f99b406ae70 0x7f99b406d330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f99d014e310 0x7f99d014ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d00c7a40 0x7f99d00af3f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 --2- 172.21.15.45:0/3659010453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d006b960 0x7f99d0156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 >> 172.21.15.45:0/3659010453 conn(0x7f99d00ab710 msgr2=0x7f99d00aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 shutdown_connections 2023-12-08T08:19:36.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:36.525+0000 7f99d6106640 1 -- 172.21.15.45:0/3659010453 wait complete. 2023-12-08T08:19:36.548 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-08T08:19:36.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:36.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:36.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:19:36.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:36.706 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:19:36.753 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:36.753 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:36.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:19:36.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.033+0000 7f22bb03d640 1 Processor -- start 2023-12-08T08:19:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.034+0000 7f22bb03d640 1 -- start start 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.035+0000 7f22bb03d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22b4151d20 0x7f22b406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.035+0000 7f22bb03d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b4158530 con 0x7f22b40c0db0 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.035+0000 7f22bb03d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b4158810 con 0x7f22b40bedd0 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.035+0000 7f22bb03d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b406d800 con 0x7f22b4151d20 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.036+0000 7f22b3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f22b40c0db0 0x7f22b40c03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43360/0 (socket says 172.21.15.45:43360) 2023-12-08T08:19:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.036+0000 7f22b3fff640 1 -- 172.21.15.45:0/1069597684 learned_addr learned my addr 172.21.15.45:0/1069597684 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.036+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/1069597684 >> v2:172.21.15.114:3300/0 conn(0x7f22b4151d20 0x7f22b406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.036+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209217515 0 0) 0x7f22b4158530 con 0x7f22b40c0db0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.036+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f229c003520 con 0x7f22b40c0db0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107329908 0 0) 0x7f229c003520 con 0x7f22b40c0db0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 >> v2:172.21.15.114:3300/0 conn(0x7f22b4151d20 msgr2=0x7f22b406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 --2- 172.21.15.45:0/1069597684 >> v2:172.21.15.114:3300/0 conn(0x7f22b4151d20 0x7f22b406d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 >> v1:172.21.15.114:6789/0 conn(0x7f22b40bedd0 legacy=0x7f22b40c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40bf8d0 con 0x7f22b40c0db0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f22a4001670 con 0x7f22b40c0db0 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 >> v1:172.21.15.45:6789/0 conn(0x7f22b40c0db0 legacy=0x7f22b40c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f229c0047c0 0x7f229c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0051d0 0x7f229c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b406d800 con 0x7f229c0039c0 2023-12-08T08:19:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c00c120 con 0x7f229c0051d0 2023-12-08T08:19:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c00c2e0 con 0x7f229c0047c0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b95da640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0051d0 0x7f229c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.037+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b3fff640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f229c0047c0 0x7f229c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b8dd9640 1 -- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f229c0047c0 msgr2=0x7f229c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f229c0047c0 0x7f229c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b8dd9640 1 -- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0051d0 msgr2=0x7f229c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0051d0 0x7f229c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b8dd9640 1 -- 172.21.15.45:0/1069597684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c003520 con 0x7f229c0039c0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.038+0000 7f22b95da640 1 -- 172.21.15.45:0/1069597684 reap_dead start 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.039+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009a90 tx=0x7f229c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdc1afa0f711bdd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.039+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a802c680 con 0x7f229c0039c0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.039+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a802c7e0 con 0x7f229c0039c0 2023-12-08T08:19:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.039+0000 7f22b37fe640 1 -- 172.21.15.45:0/1069597684 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a802cb70 con 0x7f229c0039c0 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 -- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 msgr2=0x7f229c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009a90 tx=0x7f229c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 -- 172.21.15.45:0/1069597684 shutdown_connections 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 --2- 172.21.15.45:0/1069597684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f229c0039c0 0x7f229c003de0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 -- 172.21.15.45:0/1069597684 >> 172.21.15.45:0/1069597684 conn(0x7f22b40661f0 msgr2=0x7f22b4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 -- 172.21.15.45:0/1069597684 shutdown_connections 2023-12-08T08:19:37.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.040+0000 7f22bb03d640 1 -- 172.21.15.45:0/1069597684 wait complete. 2023-12-08T08:19:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.042+0000 7f22bb03d640 1 Processor -- start 2023-12-08T08:19:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.042+0000 7f22bb03d640 1 -- start start 2023-12-08T08:19:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0039c0 0x7f22b40a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22b414e370 0x7f22b41ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b414e1e0 con 0x7f22b41edd40 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4155660 con 0x7f229c0039c0 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22bb03d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41551d0 con 0x7f22b414e370 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37420/0 (socket says 172.21.15.45:37420) 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 -- 172.21.15.45:0/223873893 learned_addr learned my addr 172.21.15.45:0/223873893 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0039c0 0x7f22b40a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b3fff640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22b414e370 0x7f22b41ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 -- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22b414e370 msgr2=0x7f22b41ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22b414e370 0x7f22b41ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 -- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0039c0 msgr2=0x7f22b40a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0039c0 0x7f22b40a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.043+0000 7f22b95da640 1 -- 172.21.15.45:0/223873893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b414e9a0 con 0x7f22b41edd40 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22b95da640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00f750 tx=0x7f22ac00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac006d60 con 0x7f22b41edd40 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac003970 con 0x7f22b41edd40 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac003d20 con 0x7f22b41edd40 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b4072660 con 0x7f22b41edd40 2023-12-08T08:19:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.044+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40aa4d0 con 0x7f22b41edd40 2023-12-08T08:19:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.045+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4155380 con 0x7f22b41edd40 2023-12-08T08:19:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.046+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22ac005070 con 0x7f22b41edd40 2023-12-08T08:19:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.047+0000 7f22b17fa640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 0x7f22a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.047+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f22ac088fb0 con 0x7f22b41edd40 2023-12-08T08:19:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.047+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 0x7f22a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.048+0000 7f22b8dd9640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 0x7f22a006d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f22a8036000 tx=0x7f22a8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.051+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22b4155380 con 0x7f22b41edd40 2023-12-08T08:19:37.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.282+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22b4155380 con 0x7f22b41edd40 2023-12-08T08:19:37.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.283+0000 7f22b17fa640 1 -- 172.21.15.45:0/223873893 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f22b4155380 con 0x7f22b41edd40 2023-12-08T08:19:37.286 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:37.286 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-08T08:19:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 msgr2=0x7f22a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 0x7f22a006d330 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f22a8036000 tx=0x7f22a8030000 comp rx=0 tx=0).stop 2023-12-08T08:19:37.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 msgr2=0x7f22b406fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00f750 tx=0x7f22ac00fc10 comp rx=0 tx=0).stop 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 shutdown_connections 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f22a006ae70 0x7f22a006d330 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f22b414e370 0x7f22b41ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22b41edd40 0x7f22b406fae0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 --2- 172.21.15.45:0/223873893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f229c0039c0 0x7f22b40a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.285+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 >> 172.21.15.45:0/223873893 conn(0x7f22b40661f0 msgr2=0x7f22b40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.286+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 shutdown_connections 2023-12-08T08:19:37.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:37.286+0000 7f22bb03d640 1 -- 172.21.15.45:0/223873893 wait complete. 2023-12-08T08:19:37.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-08T08:19:37.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:37.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-12-08T08:19:37.307 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-08T08:19:37.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:37.308 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-08T08:19:37.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-08T08:19:37.308 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.3uUBnjSsM1 2023-12-08T08:19:37.308 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-12-08T08:19:37.368 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.zj9UWtWDJO 2023-12-08T08:19:37.368 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /tmp/tmp.3uUBnjSsM1 /tmp/tmp.zj9UWtWDJO 2023-12-08T08:19:37.468 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.zj9UWtWDJO 2023-12-08T08:19:37.626 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.zj9UWtWDJO is 226B 2023-12-08T08:19:37.686 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.zj9UWtWDJO 2023-12-08T08:19:37.740 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-08T08:19:37.740 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:37.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:37.740 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-12-08T08:19:37.790 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:37.790 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:37.790 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:37.791 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41837sec preferred_lft 41837sec 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9438:8aff:fe97:9885/64 scope link 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether a2:2e:09:3a:55:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::a02e:9ff:fe3a:55ea/64 scope link 2023-12-08T08:19:37.792 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:37.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:37.794 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:37.878 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-12-08T08:19:37.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:37.882 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-12-08T08:19:37.935 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-12-08T08:19:37.935 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:37.935 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:19:37.935 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:19:37.935 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:37.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:19:37.936 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-12-08T08:19:38.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.115 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:19:38.167 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:19:38.168 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:38.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-12-08T08:19:38.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:38.258 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:38.311 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:19:38.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:38.311 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:38.360 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:38.360 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/tmp/tmp.3uUBnjSsM1 of=/dev/stdout 2023-12-08T08:19:38.411 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-08T08:19:38.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:38.546 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:38.547 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:38.547 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2023-12-08T08:19:38.580 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQCO0XJloACUIhAAbBjvQ25HuzuuLzr2QuyvIA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-08T08:19:38.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-08T08:19:38.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.114:3300,172.21.15.114:3301" 2023-12-08T08:19:38.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: testuser@0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2.cephfs2=/ 2023-12-08T08:19:38.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.45:3300/172.21.15.114:3300/172.21.15.114:3301" will pass to kernel 2023-12-08T08:19:38.582 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-08T08:19:38.582 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2023-12-08T08:19:38.582 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-08T08:19:38.582 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2023-12-08T08:19:38.582 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-08T08:19:38.586 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-08T08:19:38.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:38.666 INFO:teuthology.orchestra.run.smithi114.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-08T08:19:38.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:38.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.670 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-08T08:19:38.726 INFO:teuthology.orchestra.run.smithi114.stdout:client7230 2023-12-08T08:19:38.727 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:38.727 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:38.781 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-08T08:19:38.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:38.781 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-08T08:19:38.849 INFO:teuthology.orchestra.run.smithi045.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-08T08:19:38.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:38.851 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:38.851 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:38.910 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:38.910 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:38.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.192+0000 7f18cede2640 1 Processor -- start 2023-12-08T08:19:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.193+0000 7f18cede2640 1 -- start start 2023-12-08T08:19:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.194+0000 7f18cede2640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18c80c44d0 0x7f18c81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.194+0000 7f18cede2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18c80c7a50 0x7f18c80ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.194+0000 7f18cede2640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c80c4a00 con 0x7f18c81519c0 2023-12-08T08:19:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.194+0000 7f18cede2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c80c4ce0 con 0x7f18c80c7a50 2023-12-08T08:19:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.194+0000 7f18cede2640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c81579e0 con 0x7f18c80c44d0 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18c80c7a50 0x7f18c80ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18c80c7a50 0x7f18c80ab6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37436/0 (socket says 172.21.15.45:37436) 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 -- 172.21.15.45:0/3817071380 learned_addr learned my addr 172.21.15.45:0/3817071380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18cd5df640 1 --2- 172.21.15.45:0/3817071380 >> v2:172.21.15.114:3300/0 conn(0x7f18c80c44d0 0x7f18c81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 -- 172.21.15.45:0/3817071380 >> v2:172.21.15.114:3300/0 conn(0x7f18c80c44d0 msgr2=0x7f18c81584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 --2- 172.21.15.45:0/3817071380 >> v2:172.21.15.114:3300/0 conn(0x7f18c80c44d0 0x7f18c81584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 -- 172.21.15.45:0/3817071380 >> v1:172.21.15.114:6789/0 conn(0x7f18c81519c0 legacy=0x7f18c8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.195+0000 7f18ce5e1640 1 -- 172.21.15.45:0/3817071380 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8157cc0 con 0x7f18c80c7a50 2023-12-08T08:19:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.196+0000 7f18ce5e1640 1 --2- 172.21.15.45:0/3817071380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c7a50 0x7f18c80ab6b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f18c80ac250 tx=0x7f18c002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15dbfbabe39e6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18ccdde640 1 -- 172.21.15.45:0/3817071380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0031750 con 0x7f18c80c7a50 2023-12-08T08:19:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18ccdde640 1 -- 172.21.15.45:0/3817071380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00318b0 con 0x7f18c80c7a50 2023-12-08T08:19:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18ccdde640 1 -- 172.21.15.45:0/3817071380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0031c40 con 0x7f18c80c7a50 2023-12-08T08:19:39.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 -- 172.21.15.45:0/3817071380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c7a50 msgr2=0x7f18c80ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 --2- 172.21.15.45:0/3817071380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c7a50 0x7f18c80ab6b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f18c80ac250 tx=0x7f18c002b7f0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 -- 172.21.15.45:0/3817071380 shutdown_connections 2023-12-08T08:19:39.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 --2- 172.21.15.45:0/3817071380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c7a50 0x7f18c80ab6b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 --2- 172.21.15.45:0/3817071380 >> v2:172.21.15.114:3300/0 conn(0x7f18c80c44d0 0x7f18c81584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.197+0000 7f18cede2640 1 -- 172.21.15.45:0/3817071380 >> 172.21.15.45:0/3817071380 conn(0x7f18c80661f0 msgr2=0x7f18c8066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.198+0000 7f18cede2640 1 -- 172.21.15.45:0/3817071380 shutdown_connections 2023-12-08T08:19:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.198+0000 7f18cede2640 1 -- 172.21.15.45:0/3817071380 wait complete. 2023-12-08T08:19:39.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.199+0000 7f18cede2640 1 Processor -- start 2023-12-08T08:19:39.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 -- start start 2023-12-08T08:19:39.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 0x7f18c8153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18c81519c0 0x7f18c80c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c80c3800 con 0x7f18c80c44d0 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c81eb2e0 con 0x7f18c80c7a50 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.200+0000 7f18cede2640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8155bd0 con 0x7f18c81519c0 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37448/0 (socket says 172.21.15.45:37448) 2023-12-08T08:19:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 -- 172.21.15.45:0/4088634548 learned_addr learned my addr 172.21.15.45:0/4088634548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cd5df640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 0x7f18c8153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18ce5e1640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18c81519c0 0x7f18c80c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 -- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18c81519c0 msgr2=0x7f18c80c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18c81519c0 0x7f18c80c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 -- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 msgr2=0x7f18c8153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 0x7f18c8153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cdde0640 1 -- 172.21.15.45:0/4088634548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00094d0 con 0x7f18c80c44d0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.201+0000 7f18cd5df640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 0x7f18c8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18cdde0640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00ba80 tx=0x7f18bc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00cc00 con 0x7f18c80c44d0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00cd60 con 0x7f18c80c44d0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc003bb0 con 0x7f18c80c44d0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c81552a0 con 0x7f18c80c44d0 2023-12-08T08:19:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.202+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c8155860 con 0x7f18c80c44d0 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.204+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c80743e0 con 0x7f18c80c44d0 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.204+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18bc014440 con 0x7f18c80c44d0 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.205+0000 7f18c67fc640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 0x7f18ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.205+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f18bc0898e0 con 0x7f18c80c44d0 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.206+0000 7f18cd5df640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 0x7f18ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.206+0000 7f18cd5df640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 0x7f18ac06d300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f18c81570e0 tx=0x7f18b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.210+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18bc0544e0 con 0x7f18c80c44d0 2023-12-08T08:19:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.408+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18c80c7190 con 0x7f18c80c44d0 2023-12-08T08:19:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.412+0000 7f18c67fc640 1 -- 172.21.15.45:0/4088634548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f18bc057b00 con 0x7f18c80c44d0 2023-12-08T08:19:39.416 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:39.416 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 msgr2=0x7f18ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 0x7f18ac06d300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f18c81570e0 tx=0x7f18b4008040 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 msgr2=0x7f18c8156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00ba80 tx=0x7f18bc00bf40 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 shutdown_connections 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f18ac06ae40 0x7f18ac06d300 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f18c81519c0 0x7f18c80c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c80c7a50 0x7f18c8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 --2- 172.21.15.45:0/4088634548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18c80c44d0 0x7f18c8156060 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.415+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 >> 172.21.15.45:0/4088634548 conn(0x7f18c80661f0 msgr2=0x7f18c814c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.416+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 shutdown_connections 2023-12-08T08:19:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.416+0000 7f18cede2640 1 -- 172.21.15.45:0/4088634548 wait complete. 2023-12-08T08:19:39.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:39.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:39.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.675+0000 7f9ba1375640 1 Processor -- start 2023-12-08T08:19:39.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.675+0000 7f9ba1375640 1 -- start start 2023-12-08T08:19:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.676+0000 7f9ba1375640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b9c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9ba1375640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c151eb0 con 0x7f9b9c0ca610 2023-12-08T08:19:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9ba1375640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c0c80d0 con 0x7f9b9c157a20 2023-12-08T08:19:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9ba1375640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0c56a0 con 0x7f9b9c151ad0 2023-12-08T08:19:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9ba0b74640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b9c0ca610 0x7f9b9c15edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43372/0 (socket says 172.21.15.45:43372) 2023-12-08T08:19:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9ba0b74640 1 -- 172.21.15.45:0/4027182636 learned_addr learned my addr 172.21.15.45:0/4027182636 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b9c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.677+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93677107 0 0) 0x7f9b9c151eb0 con 0x7f9b9c0ca610 2023-12-08T08:19:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b88003520 con 0x7f9b9c0ca610 2023-12-08T08:19:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494503589 0 0) 0x7f9b88003520 con 0x7f9b9c0ca610 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 msgr2=0x7f9b9c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b9c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 >> v1:172.21.15.114:6789/0 conn(0x7f9b9c157a20 legacy=0x7f9b9c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c154430 con 0x7f9b9c0ca610 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9b940019f0 con 0x7f9b9c0ca610 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 >> v1:172.21.15.45:6789/0 conn(0x7f9b9c0ca610 legacy=0x7f9b9c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880039a0 0x7f9b88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880047c0 0x7f9b88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8800ba30 con 0x7f9b880039a0 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8800bba0 con 0x7f9b880047c0 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8800bd60 con 0x7f9b9c151ad0 2023-12-08T08:19:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.678+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880039a0 0x7f9b88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9ba0b74640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b937fe640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880047c0 0x7f9b88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b9bfff640 1 -- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 msgr2=0x7f9b88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c151ad0 0x7f9b88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b9bfff640 1 -- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880047c0 msgr2=0x7f9b88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880047c0 0x7f9b88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.679+0000 7f9b9bfff640 1 -- 172.21.15.45:0/4027182636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88003520 con 0x7f9b880039a0 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.680+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880039a0 0x7f9b88003dc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009a90 tx=0x7f9b880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3841bdc1671b9b70 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.680+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c02c680 con 0x7f9b880039a0 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.680+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c02c7e0 con 0x7f9b880039a0 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.680+0000 7f9b9b7fe640 1 -- 172.21.15.45:0/4027182636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c02cb70 con 0x7f9b880039a0 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 -- 172.21.15.45:0/4027182636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880039a0 msgr2=0x7f9b88003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 --2- 172.21.15.45:0/4027182636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880039a0 0x7f9b88003dc0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009a90 tx=0x7f9b880057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba0b74640 1 -- 172.21.15.45:0/4027182636 reap_dead start 2023-12-08T08:19:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 -- 172.21.15.45:0/4027182636 shutdown_connections 2023-12-08T08:19:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 -- 172.21.15.45:0/4027182636 >> 172.21.15.45:0/4027182636 conn(0x7f9b9c066610 msgr2=0x7f9b9c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 -- 172.21.15.45:0/4027182636 shutdown_connections 2023-12-08T08:19:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.681+0000 7f9ba1375640 1 -- 172.21.15.45:0/4027182636 wait complete. 2023-12-08T08:19:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.683+0000 7f9ba1375640 1 Processor -- start 2023-12-08T08:19:39.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.683+0000 7f9ba1375640 1 -- start start 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880039a0 0x7f9b9c0a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14bd70 0x7f9b9c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c14c630 con 0x7f9b9c14d230 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1ea210 con 0x7f9b880039a0 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.684+0000 7f9ba1375640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1ea4f0 con 0x7f9b9c14bd70 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37460/0 (socket says 172.21.15.45:37460) 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 -- 172.21.15.45:0/3879658571 learned_addr learned my addr 172.21.15.45:0/3879658571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880039a0 0x7f9b9c0a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9b937fe640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14bd70 0x7f9b9c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 -- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14bd70 msgr2=0x7f9b9c14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14bd70 0x7f9b9c14ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 -- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880039a0 msgr2=0x7f9b9c0a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880039a0 0x7f9b9c0a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 -- 172.21.15.45:0/3879658571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c0c9750 con 0x7f9b9c14d230 2023-12-08T08:19:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.685+0000 7f9ba0b74640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0c7e90 tx=0x7f9b9400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.686+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400ec10 con 0x7f9b9c14d230 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.686+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9400ed70 con 0x7f9b9c14d230 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.686+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400eee0 con 0x7f9b9c14d230 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.686+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c14c910 con 0x7f9b9c14d230 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.686+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c156f50 con 0x7f9b9c14d230 2023-12-08T08:19:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.687+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c1ea350 con 0x7f9b9c14d230 2023-12-08T08:19:39.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.688+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b94013640 con 0x7f9b9c14d230 2023-12-08T08:19:39.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.690+0000 7f9b997fa640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 0x7f9b7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:39.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.690+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9b94089f70 con 0x7f9b9c14d230 2023-12-08T08:19:39.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.690+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 0x7f9b7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:39.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.691+0000 7f9b9bfff640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 0x7f9b7c06d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c036000 tx=0x7f9b8c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:39.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.694+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b9c1ea350 con 0x7f9b9c14d230 2023-12-08T08:19:39.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.889+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b9c1ea6b0 con 0x7f9b9c14d230 2023-12-08T08:19:39.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.890+0000 7f9b997fa640 1 -- 172.21.15.45:0/3879658571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b9c1ea6b0 con 0x7f9b9c14d230 2023-12-08T08:19:39.893 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 msgr2=0x7f9b7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 0x7f9b7c06d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c036000 tx=0x7f9b8c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 msgr2=0x7f9b9c156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0c7e90 tx=0x7f9b9400e530 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 shutdown_connections 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9b7c06ae40 0x7f9b7c06d300 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9b9c14bd70 0x7f9b9c14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b9c14d230 0x7f9b9c156830 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 --2- 172.21.15.45:0/3879658571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b880039a0 0x7f9b9c0a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:39.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 >> 172.21.15.45:0/3879658571 conn(0x7f9b9c066610 msgr2=0x7f9b9c0c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 shutdown_connections 2023-12-08T08:19:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:39.893+0000 7f9ba1375640 1 -- 172.21.15.45:0/3879658571 wait complete. 2023-12-08T08:19:39.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.144+0000 7f5210f54640 1 Processor -- start 2023-12-08T08:19:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.144+0000 7f5210f54640 1 -- start start 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5210f54640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f520c0c1d60 0x7f520c06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5210f54640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f520c0aa2d0 0x7f520c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5210f54640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0c16b0 con 0x7f520c151ec0 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5210f54640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0a8b30 con 0x7f520c0c1d60 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5210f54640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0c65d0 con 0x7f520c0aa2d0 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5202ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f520c0c1d60 0x7f520c06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5202ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f520c0c1d60 0x7f520c06ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37468/0 (socket says 172.21.15.45:37468) 2023-12-08T08:19:40.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.146+0000 7f5202ffd640 1 -- 172.21.15.45:0/3644774221 learned_addr learned my addr 172.21.15.45:0/3644774221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.147+0000 7f520bfff640 1 --2- 172.21.15.45:0/3644774221 >> v2:172.21.15.114:3300/0 conn(0x7f520c0aa2d0 0x7f520c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.147+0000 7f5202ffd640 1 -- 172.21.15.45:0/3644774221 >> v2:172.21.15.114:3300/0 conn(0x7f520c0aa2d0 msgr2=0x7f520c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.147+0000 7f5202ffd640 1 --2- 172.21.15.45:0/3644774221 >> v2:172.21.15.114:3300/0 conn(0x7f520c0aa2d0 0x7f520c06bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.147+0000 7f5202ffd640 1 -- 172.21.15.45:0/3644774221 >> v1:172.21.15.114:6789/0 conn(0x7f520c151ec0 legacy=0x7f520c0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.147+0000 7f5202ffd640 1 -- 172.21.15.45:0/3644774221 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c06c490 con 0x7f520c0c1d60 2023-12-08T08:19:40.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.148+0000 7f5202ffd640 1 --2- 172.21.15.45:0/3644774221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c06ba10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f520c06d720 tx=0x7f51f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bac24be76927561 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.148+0000 7f520affd640 1 -- 172.21.15.45:0/3644774221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40317e0 con 0x7f520c0c1d60 2023-12-08T08:19:40.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.148+0000 7f520affd640 1 -- 172.21.15.45:0/3644774221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4031940 con 0x7f520c0c1d60 2023-12-08T08:19:40.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.148+0000 7f520affd640 1 -- 172.21.15.45:0/3644774221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4031cd0 con 0x7f520c0c1d60 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 -- 172.21.15.45:0/3644774221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 msgr2=0x7f520c06ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 --2- 172.21.15.45:0/3644774221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c06ba10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f520c06d720 tx=0x7f51f402b880 comp rx=0 tx=0).stop 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 -- 172.21.15.45:0/3644774221 shutdown_connections 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 --2- 172.21.15.45:0/3644774221 >> v2:172.21.15.114:3300/0 conn(0x7f520c0aa2d0 0x7f520c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 --2- 172.21.15.45:0/3644774221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c06ba10 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 -- 172.21.15.45:0/3644774221 >> 172.21.15.45:0/3644774221 conn(0x7f520c066ce0 msgr2=0x7f520c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 -- 172.21.15.45:0/3644774221 shutdown_connections 2023-12-08T08:19:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.149+0000 7f5210f54640 1 -- 172.21.15.45:0/3644774221 wait complete. 2023-12-08T08:19:40.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.151+0000 7f5210f54640 1 Processor -- start 2023-12-08T08:19:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.151+0000 7f5210f54640 1 -- start start 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 0x7f520c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c151ec0 0x7f520c1db550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1536f0 con 0x7f520c0c1d60 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c153b10 con 0x7f520c151ec0 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5210f54640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1500c0 con 0x7f520c0aa2d0 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37482/0 (socket says 172.21.15.45:37482) 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.152+0000 7f5202ffd640 1 -- 172.21.15.45:0/2738466202 learned_addr learned my addr 172.21.15.45:0/2738466202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f520b7fe640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 0x7f520c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 -- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 msgr2=0x7f520c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f520bfff640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c151ec0 0x7f520c1db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 0x7f520c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 -- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c151ec0 msgr2=0x7f520c1db550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c151ec0 0x7f520c1db550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 -- 172.21.15.45:0/2738466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40094d0 con 0x7f520c0c1d60 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f520b7fe640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 0x7f520c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5202ffd640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.153+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4032880 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.154+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f40329e0 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.154+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4032d90 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.154+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c152d50 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.154+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c153310 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.155+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c153830 con 0x7f520c0c1d60 2023-12-08T08:19:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.156+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51f404d3f0 con 0x7f520c0c1d60 2023-12-08T08:19:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.157+0000 7f5208ff9640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 0x7f51ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.157+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f51f40ab870 con 0x7f520c0c1d60 2023-12-08T08:19:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.157+0000 7f520b7fe640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 0x7f51ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.158+0000 7f520b7fe640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 0x7f51ec06d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f520c1e1270 tx=0x7f51fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.161+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f520c153830 con 0x7f520c0c1d60 2023-12-08T08:19:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.357+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f520c153830 con 0x7f520c0c1d60 2023-12-08T08:19:40.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.358+0000 7f5208ff9640 1 -- 172.21.15.45:0/2738466202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f520c153830 con 0x7f520c0c1d60 2023-12-08T08:19:40.361 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 msgr2=0x7f51ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 0x7f51ec06d330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f520c1e1270 tx=0x7f51fc008040 comp rx=0 tx=0).stop 2023-12-08T08:19:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 msgr2=0x7f520c1db010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f40046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 shutdown_connections 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f51ec06ae70 0x7f51ec06d330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f520c151ec0 0x7f520c1db550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f520c0c1d60 0x7f520c1db010 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 --2- 172.21.15.45:0/2738466202 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f520c0aa2d0 0x7f520c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 >> 172.21.15.45:0/2738466202 conn(0x7f520c066ce0 msgr2=0x7f520c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 shutdown_connections 2023-12-08T08:19:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.361+0000 7f5210f54640 1 -- 172.21.15.45:0/2738466202 wait complete. 2023-12-08T08:19:40.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.609+0000 7f3e6989f640 1 Processor -- start 2023-12-08T08:19:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.609+0000 7f3e6989f640 1 -- start start 2023-12-08T08:19:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e640c3e50 0x7f3e6406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e64152e00 0x7f3e64155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 0x7f3e640a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e64152110 con 0x7f3e640c3e50 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6414fbb0 con 0x7f3e64152e00 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6989f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640c7520 con 0x7f3e64155c40 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6889d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e640c3e50 0x7f3e6406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6889d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e640c3e50 0x7f3e6406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37496/0 (socket says 172.21.15.45:37496) 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6889d640 1 -- 172.21.15.45:0/979239048 learned_addr learned my addr 172.21.15.45:0/979239048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e5bfff640 1 --2- 172.21.15.45:0/979239048 >> v2:172.21.15.114:3300/0 conn(0x7f3e64152e00 0x7f3e64155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6909e640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 0x7f3e640a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.611+0000 7f3e6889d640 1 -- 172.21.15.45:0/979239048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 msgr2=0x7f3e640a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.612+0000 7f3e6889d640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 0x7f3e640a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.612+0000 7f3e6889d640 1 -- 172.21.15.45:0/979239048 >> v2:172.21.15.114:3300/0 conn(0x7f3e64152e00 msgr2=0x7f3e64155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.612+0000 7f3e6889d640 1 --2- 172.21.15.45:0/979239048 >> v2:172.21.15.114:3300/0 conn(0x7f3e64152e00 0x7f3e64155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.612+0000 7f3e6889d640 1 -- 172.21.15.45:0/979239048 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64152320 con 0x7f3e640c3e50 2023-12-08T08:19:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.612+0000 7f3e6909e640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 0x7f3e640a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.613+0000 7f3e6889d640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e640c3e50 0x7f3e6406f810 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3e640aa690 tx=0x7f3e6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d6ace5b68812e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.613+0000 7f3e5b7fe640 1 -- 172.21.15.45:0/979239048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600317e0 con 0x7f3e640c3e50 2023-12-08T08:19:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.613+0000 7f3e5b7fe640 1 -- 172.21.15.45:0/979239048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e60031940 con 0x7f3e640c3e50 2023-12-08T08:19:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.613+0000 7f3e5b7fe640 1 -- 172.21.15.45:0/979239048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60031cd0 con 0x7f3e640c3e50 2023-12-08T08:19:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 -- 172.21.15.45:0/979239048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e640c3e50 msgr2=0x7f3e6406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e640c3e50 0x7f3e6406f810 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3e640aa690 tx=0x7f3e6002b880 comp rx=0 tx=0).stop 2023-12-08T08:19:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 -- 172.21.15.45:0/979239048 shutdown_connections 2023-12-08T08:19:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 --2- 172.21.15.45:0/979239048 >> v2:172.21.15.114:3300/0 conn(0x7f3e64152e00 0x7f3e64155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64155c40 0x7f3e640a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 --2- 172.21.15.45:0/979239048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e640c3e50 0x7f3e6406f810 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 -- 172.21.15.45:0/979239048 >> 172.21.15.45:0/979239048 conn(0x7f3e640c4840 msgr2=0x7f3e640c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 -- 172.21.15.45:0/979239048 shutdown_connections 2023-12-08T08:19:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.614+0000 7f3e6989f640 1 -- 172.21.15.45:0/979239048 wait complete. 2023-12-08T08:19:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.617+0000 7f3e6989f640 1 Processor -- start 2023-12-08T08:19:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.617+0000 7f3e6989f640 1 -- start start 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e640c3e50 0x7f3e640a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 0x7f3e6414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6414c780 con 0x7f3e64155c40 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640c0df0 con 0x7f3e640c3e50 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.618+0000 7f3e6989f640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641eced0 con 0x7f3e64152e00 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37510/0 (socket says 172.21.15.45:37510) 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 -- 172.21.15.45:0/2272765847 learned_addr learned my addr 172.21.15.45:0/2272765847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6889d640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e640c3e50 0x7f3e640a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e5bfff640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 0x7f3e6414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 -- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 msgr2=0x7f3e6414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 0x7f3e6414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 -- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e640c3e50 msgr2=0x7f3e640a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e640c3e50 0x7f3e640a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 -- 172.21.15.45:0/2272765847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600094d0 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e5bfff640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 0x7f3e6414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.619+0000 7f3e6909e640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00cef0 tx=0x7f3e5c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.620+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00d840 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.620+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00d9c0 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.620+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00dd70 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.620+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641ed1b0 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.620+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e641ed770 con 0x7f3e64155c40 2023-12-08T08:19:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.621+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e640673e0 con 0x7f3e64155c40 2023-12-08T08:19:40.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.622+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e5c01e3b0 con 0x7f3e64155c40 2023-12-08T08:19:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.623+0000 7f3e597fa640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 0x7f3e5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.623+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3e5c08a560 con 0x7f3e64155c40 2023-12-08T08:19:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.623+0000 7f3e6889d640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 0x7f3e5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.624+0000 7f3e6889d640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 0x7f3e5006d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3e60036000 tx=0x7f3e6003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.627+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e5c055220 con 0x7f3e64155c40 2023-12-08T08:19:40.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.825+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e640c6630 con 0x7f3e64155c40 2023-12-08T08:19:40.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.826+0000 7f3e597fa640 1 -- 172.21.15.45:0/2272765847 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e5c058840 con 0x7f3e64155c40 2023-12-08T08:19:40.829 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:40.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 msgr2=0x7f3e5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 0x7f3e5006d330 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3e60036000 tx=0x7f3e6003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 msgr2=0x7f3e6414c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00cef0 tx=0x7f3e5c00a710 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 shutdown_connections 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e5006ae70 0x7f3e5006d330 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e64152e00 0x7f3e6414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.829+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e64155c40 0x7f3e6414c240 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.830+0000 7f3e6989f640 1 --2- 172.21.15.45:0/2272765847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e640c3e50 0x7f3e640a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.830+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 >> 172.21.15.45:0/2272765847 conn(0x7f3e640c4840 msgr2=0x7f3e640a8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.830+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 shutdown_connections 2023-12-08T08:19:40.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:40.830+0000 7f3e6989f640 1 -- 172.21.15.45:0/2272765847 wait complete. 2023-12-08T08:19:40.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:41.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.069+0000 7fba46fa9640 1 Processor -- start 2023-12-08T08:19:41.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.069+0000 7fba46fa9640 1 -- start start 2023-12-08T08:19:41.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba46fa9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba4006d960 0x7fba400c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba46fa9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba400c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba46fa9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba40152660 con 0x7fba400aaf60 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba46fa9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400a4d10 con 0x7fba4006d960 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba46fa9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba40153200 con 0x7fba400c1930 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba44d45640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba400aaf60 0x7fba40152af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43386/0 (socket says 172.21.15.45:43386) 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.071+0000 7fba44d45640 1 -- 172.21.15.45:0/1739672652 learned_addr learned my addr 172.21.15.45:0/1739672652 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3ffff640 1 --2- 172.21.15.45:0/1739672652 >> v2:172.21.15.114:3300/0 conn(0x7fba4006d960 0x7fba400c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba45546640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba400c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245264384 0 0) 0x7fba40152660 con 0x7fba400aaf60 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba30003520 con 0x7fba400aaf60 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2295859769 0 0) 0x7fba30003520 con 0x7fba400aaf60 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 msgr2=0x7fba400c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba400c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 >> v2:172.21.15.114:3300/0 conn(0x7fba4006d960 msgr2=0x7fba400c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.072+0000 7fba3f7fe640 1 --2- 172.21.15.45:0/1739672652 >> v2:172.21.15.114:3300/0 conn(0x7fba4006d960 0x7fba400c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400c3310 con 0x7fba400aaf60 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fba34001670 con 0x7fba400aaf60 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 >> v1:172.21.15.45:6789/0 conn(0x7fba400aaf60 legacy=0x7fba40152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba300047c0 0x7fba30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400a4d10 con 0x7fba30003970 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40153200 con 0x7fba300047c0 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3000ba00 con 0x7fba400c1930 2023-12-08T08:19:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.073+0000 7fba44d45640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba3ffff640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba300047c0 0x7fba30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba45546640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba44d45640 1 -- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 msgr2=0x7fba30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba44d45640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c1930 0x7fba30005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba44d45640 1 -- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba300047c0 msgr2=0x7fba30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba44d45640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba300047c0 0x7fba30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba44d45640 1 -- 172.21.15.45:0/1739672652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30003520 con 0x7fba30003970 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.074+0000 7fba3ffff640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba300047c0 0x7fba30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.075+0000 7fba44d45640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba30003d90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fba3400c190 tx=0x7fba300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d71688f8b4c56ab server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.075+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34005ad0 con 0x7fba30003970 2023-12-08T08:19:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.075+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba34005c30 con 0x7fba30003970 2023-12-08T08:19:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.075+0000 7fba3f7fe640 1 -- 172.21.15.45:0/1739672652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3402c810 con 0x7fba30003970 2023-12-08T08:19:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 -- 172.21.15.45:0/1739672652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 msgr2=0x7fba30003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 --2- 172.21.15.45:0/1739672652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba30003d90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fba3400c190 tx=0x7fba300057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba45546640 1 -- 172.21.15.45:0/1739672652 reap_dead start 2023-12-08T08:19:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 -- 172.21.15.45:0/1739672652 shutdown_connections 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 -- 172.21.15.45:0/1739672652 >> 172.21.15.45:0/1739672652 conn(0x7fba400c2430 msgr2=0x7fba400c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 -- 172.21.15.45:0/1739672652 shutdown_connections 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.076+0000 7fba46fa9640 1 -- 172.21.15.45:0/1739672652 wait complete. 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.078+0000 7fba46fa9640 1 Processor -- start 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.078+0000 7fba46fa9640 1 -- start start 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4014e460 0x7fba4006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 0x7fba40149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba401ed490 con 0x7fba30003970 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40071f40 con 0x7fba4014e460 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba46fa9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba401e9ba0 con 0x7fba400c2ab0 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba44d45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba44d45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37526/0 (socket says 172.21.15.45:37526) 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba44d45640 1 -- 172.21.15.45:0/3138615963 learned_addr learned my addr 172.21.15.45:0/3138615963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba45546640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 0x7fba40149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.079+0000 7fba3ffff640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4014e460 0x7fba4006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 -- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 msgr2=0x7fba40149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 0x7fba40149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 -- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4014e460 msgr2=0x7fba4006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4014e460 0x7fba4006faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 -- 172.21.15.45:0/3138615963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba401eaaf0 con 0x7fba30003970 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba45546640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 0x7fba40149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba44d45640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fba3402c3b0 tx=0x7fba4006cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34039070 con 0x7fba30003970 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3402cc20 con 0x7fba30003970 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4006ffe0 con 0x7fba30003970 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.080+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34007070 con 0x7fba30003970 2023-12-08T08:19:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.081+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401ed1b0 con 0x7fba30003970 2023-12-08T08:19:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.082+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba40074670 con 0x7fba30003970 2023-12-08T08:19:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.083+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba34032070 con 0x7fba30003970 2023-12-08T08:19:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.084+0000 7fba3d7fa640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.084+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fba3403c040 con 0x7fba30003970 2023-12-08T08:19:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.084+0000 7fba3ffff640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.085+0000 7fba3ffff640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 0x7fba2406d300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fba4014db10 tx=0x7fba2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.089+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba34075910 con 0x7fba30003970 2023-12-08T08:19:41.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.280+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba401513e0 con 0x7fba30003970 2023-12-08T08:19:41.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.281+0000 7fba3d7fa640 1 -- 172.21.15.45:0/3138615963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v83) v1 ==== 105+0+11 (secure 0 0 0) 0x7fba34078f30 con 0x7fba30003970 2023-12-08T08:19:41.284 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:41.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 msgr2=0x7fba2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 0x7fba2406d300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fba4014db10 tx=0x7fba2c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:41.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 msgr2=0x7fba401ea5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fba3402c3b0 tx=0x7fba4006cee0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 shutdown_connections 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fba2406ae40 0x7fba2406d300 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fba400c2ab0 0x7fba40149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4014e460 0x7fba4006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 --2- 172.21.15.45:0/3138615963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba30003970 0x7fba401ea5b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 >> 172.21.15.45:0/3138615963 conn(0x7fba400c2430 msgr2=0x7fba400c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 shutdown_connections 2023-12-08T08:19:41.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.284+0000 7fba46fa9640 1 -- 172.21.15.45:0/3138615963 wait complete. 2023-12-08T08:19:41.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.532+0000 7f9d2b07e640 1 Processor -- start 2023-12-08T08:19:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.532+0000 7f9d2b07e640 1 -- start start 2023-12-08T08:19:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.533+0000 7f9d2b07e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d24158680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2b07e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240c51f0 con 0x7f9d240c0bf0 2023-12-08T08:19:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2b07e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240c54d0 con 0x7f9d2406d1d0 2023-12-08T08:19:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2b07e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c1ce0 con 0x7f9d240c59e0 2023-12-08T08:19:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2a87d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9d240c0bf0 0x7f9d24154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43388/0 (socket says 172.21.15.45:43388) 2023-12-08T08:19:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2a87d640 1 -- 172.21.15.45:0/3131526632 learned_addr learned my addr 172.21.15.45:0/3131526632 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.534+0000 7f9d2a07c640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d24158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622830777 0 0) 0x7f9d240c51f0 con 0x7f9d240c0bf0 2023-12-08T08:19:41.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d10003520 con 0x7f9d240c0bf0 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649866872 0 0) 0x7f9d10003520 con 0x7f9d240c0bf0 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 msgr2=0x7f9d24158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d24158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 >> v1:172.21.15.114:6789/0 conn(0x7f9d2406d1d0 legacy=0x7f9d2406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24157ba0 con 0x7f9d240c0bf0 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9d1c0019f0 con 0x7f9d240c0bf0 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 >> v1:172.21.15.45:6789/0 conn(0x7f9d240c0bf0 legacy=0x7f9d24154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d100039a0 0x7f9d10003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d10004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d10005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1000b980 con 0x7f9d10004350 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1000bac0 con 0x7f9d100039a0 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.535+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1000bc80 con 0x7f9d240c59e0 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d10004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2a07c640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d100039a0 0x7f9d10003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2a87d640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d10005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 -- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 msgr2=0x7f9d10005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d10005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 -- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d100039a0 msgr2=0x7f9d10003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d100039a0 0x7f9d10003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2987b640 1 -- 172.21.15.45:0/3131526632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10003520 con 0x7f9d10004350 2023-12-08T08:19:41.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.536+0000 7f9d2a87d640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d240c59e0 0x7f9d10005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:41.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.537+0000 7f9d2987b640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d10004820 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001860 tx=0x7f9d100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe7cf4ad018cf26 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14033410 con 0x7f9d10004350 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14033590 con 0x7f9d10004350 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2907a640 1 -- 172.21.15.45:0/3131526632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14033940 con 0x7f9d10004350 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2b07e640 1 -- 172.21.15.45:0/3131526632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 msgr2=0x7f9d10004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/3131526632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d10004820 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001860 tx=0x7f9d100057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.538+0000 7f9d2a87d640 1 -- 172.21.15.45:0/3131526632 reap_dead start 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.539+0000 7f9d2b07e640 1 -- 172.21.15.45:0/3131526632 shutdown_connections 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.539+0000 7f9d2b07e640 1 -- 172.21.15.45:0/3131526632 >> 172.21.15.45:0/3131526632 conn(0x7f9d24066ce0 msgr2=0x7f9d240a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.539+0000 7f9d2b07e640 1 -- 172.21.15.45:0/3131526632 shutdown_connections 2023-12-08T08:19:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.539+0000 7f9d2b07e640 1 -- 172.21.15.45:0/3131526632 wait complete. 2023-12-08T08:19:41.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.540+0000 7f9d2b07e640 1 Processor -- start 2023-12-08T08:19:41.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.541+0000 7f9d2b07e640 1 -- start start 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.541+0000 7f9d2b07e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2b07e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d2406f950 0x7f9d240a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2b07e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 0x7f9d2414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2b07e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d241edaa0 con 0x7f9d10004350 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2b07e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240a5fb0 con 0x7f9d241ecdd0 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2b07e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d241ed7c0 con 0x7f9d2406f950 2023-12-08T08:19:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37534/0 (socket says 172.21.15.45:37534) 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 -- 172.21.15.45:0/908447228 learned_addr learned my addr 172.21.15.45:0/908447228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a87d640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 0x7f9d2414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 -- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d2406f950 msgr2=0x7f9d240a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2987b640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d2406f950 0x7f9d240a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d2406f950 0x7f9d240a6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 -- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 msgr2=0x7f9d2414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 0x7f9d2414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a07c640 1 -- 172.21.15.45:0/908447228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240a6250 con 0x7f9d10004350 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.542+0000 7f9d2a87d640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 0x7f9d2414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d2a07c640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9d200119a0 tx=0x7f9d20011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000faf0 con 0x7f9d10004350 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000fc50 con 0x7f9d10004350 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20014440 con 0x7f9d10004350 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d241e7120 con 0x7f9d10004350 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.543+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2409a4b0 con 0x7f9d10004350 2023-12-08T08:19:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.544+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d240a5e10 con 0x7f9d10004350 2023-12-08T08:19:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.546+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d200145a0 con 0x7f9d10004350 2023-12-08T08:19:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.547+0000 7f9d1affd640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 0x7f9d0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.547+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f9d2008a440 con 0x7f9d10004350 2023-12-08T08:19:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.547+0000 7f9d2987b640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 0x7f9d0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.548+0000 7f9d2987b640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 0x7f9d0806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001860 tx=0x7f9d14009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.551+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d240a5e10 con 0x7f9d10004350 2023-12-08T08:19:41.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.745+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9d240a5e10 con 0x7f9d10004350 2023-12-08T08:19:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.746+0000 7f9d1affd640 1 -- 172.21.15.45:0/908447228 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v83) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9d240a5e10 con 0x7f9d10004350 2023-12-08T08:19:41.749 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.748+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 msgr2=0x7f9d0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.748+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 0x7f9d0806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9d14001860 tx=0x7f9d14009030 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.748+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 msgr2=0x7f9d240708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.748+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f9d200119a0 tx=0x7f9d20011e60 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 shutdown_connections 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9d0806ae40 0x7f9d0806d300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9d2406f950 0x7f9d240a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d241ecdd0 0x7f9d2414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 --2- 172.21.15.45:0/908447228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10004350 0x7f9d240708b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 >> 172.21.15.45:0/908447228 conn(0x7f9d24066ce0 msgr2=0x7f9d2406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 shutdown_connections 2023-12-08T08:19:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.749+0000 7f9d2b07e640 1 -- 172.21.15.45:0/908447228 wait complete. 2023-12-08T08:19:41.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:41.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.983+0000 7ffbd7aad640 1 Processor -- start 2023-12-08T08:19:41.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.984+0000 7ffbd7aad640 1 -- start start 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd7aad640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffbd006f130 0x7ffbd0071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd7aad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 0x7ffbd01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd7aad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd00c1440 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd7aad640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd014ea60 con 0x7ffbd006f130 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd7aad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0154f60 con 0x7ffbd0157d20 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd5048640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffbd00c0bf0 0x7ffbd0072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43392/0 (socket says 172.21.15.45:43392) 2023-12-08T08:19:41.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.985+0000 7ffbd5048640 1 -- 172.21.15.45:0/2306971364 learned_addr learned my addr 172.21.15.45:0/2306971364 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd604a640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 0x7ffbd01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd5849640 1 --2- 172.21.15.45:0/2306971364 >> v2:172.21.15.114:3300/0 conn(0x7ffbd006f130 0x7ffbd0071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688742884 0 0) 0x7ffbd00c1440 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbbc003520 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2932985795 0 0) 0x7ffbbc003520 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 msgr2=0x7ffbd01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 0x7ffbd01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 >> v2:172.21.15.114:3300/0 conn(0x7ffbd006f130 msgr2=0x7ffbd0071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 --2- 172.21.15.45:0/2306971364 >> v2:172.21.15.114:3300/0 conn(0x7ffbd006f130 0x7ffbd0071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0155240 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7ffbc0001670 con 0x7ffbd00c0bf0 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 >> v1:172.21.15.45:6789/0 conn(0x7ffbd00c0bf0 legacy=0x7ffbd0072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc003970 0x7ffbbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc0047c0 0x7ffbbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 0x7ffbbc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd014ea60 con 0x7ffbbc0047c0 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0154f60 con 0x7ffbbc003970 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.986+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc00ba60 con 0x7ffbd0157d20 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc0047c0 0x7ffbbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5849640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc003970 0x7ffbbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 -- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 msgr2=0x7ffbbc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd0157d20 0x7ffbbc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 -- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc003970 msgr2=0x7ffbbc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc003970 0x7ffbbc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.987+0000 7ffbd5048640 1 -- 172.21.15.45:0/2306971364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc003520 con 0x7ffbbc0047c0 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.988+0000 7ffbd5048640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc0047c0 0x7ffbbc004c40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00c1060 tx=0x7ffbbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb06503ceb10de5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.988+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0005ad0 con 0x7ffbbc0047c0 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0005c50 con 0x7ffbbc0047c0 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd4847640 1 -- 172.21.15.45:0/2306971364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0007070 con 0x7ffbbc0047c0 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 -- 172.21.15.45:0/2306971364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc0047c0 msgr2=0x7ffbbc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/2306971364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc0047c0 0x7ffbbc004c40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00c1060 tx=0x7ffbbc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd604a640 1 -- 172.21.15.45:0/2306971364 reap_dead start 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 -- 172.21.15.45:0/2306971364 shutdown_connections 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 -- 172.21.15.45:0/2306971364 >> 172.21.15.45:0/2306971364 conn(0x7ffbd00c6c20 msgr2=0x7ffbd00c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 -- 172.21.15.45:0/2306971364 shutdown_connections 2023-12-08T08:19:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.989+0000 7ffbd7aad640 1 -- 172.21.15.45:0/2306971364 wait complete. 2023-12-08T08:19:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.991+0000 7ffbd7aad640 1 Processor -- start 2023-12-08T08:19:41.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.991+0000 7ffbd7aad640 1 -- start start 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc0047c0 0x7ffbd01dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd01edb70 0x7ffbd006dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd01dda40 con 0x7ffbd00a7000 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd01edff0 con 0x7ffbbc0047c0 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd7aad640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd01def70 con 0x7ffbd01edb70 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd5048640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd5048640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37550/0 (socket says 172.21.15.45:37550) 2023-12-08T08:19:41.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.992+0000 7ffbd5048640 1 -- 172.21.15.45:0/409440164 learned_addr learned my addr 172.21.15.45:0/409440164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:41.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 -- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd01edb70 msgr2=0x7ffbd006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd01edb70 0x7ffbd006dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 -- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc0047c0 msgr2=0x7ffbd01dd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc0047c0 0x7ffbd01dd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 -- 172.21.15.45:0/409440164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd014c9d0 con 0x7ffbd00a7000 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd5048640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0072810 tx=0x7ffbc0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0007480 con 0x7ffbd00a7000 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00075e0 con 0x7ffbd00a7000 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc002c9b0 con 0x7ffbd00a7000 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.993+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd01dec40 con 0x7ffbd00a7000 2023-12-08T08:19:41.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.994+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd01ee4c0 con 0x7ffbd00a7000 2023-12-08T08:19:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.995+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd0074600 con 0x7ffbd00a7000 2023-12-08T08:19:41.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.996+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbc0032070 con 0x7ffbd00a7000 2023-12-08T08:19:42.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.997+0000 7ffbc67fc640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 0x7ffbb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.997+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7ffbc003c040 con 0x7ffbd00a7000 2023-12-08T08:19:42.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.997+0000 7ffbd5849640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 0x7ffbb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:41.998+0000 7ffbd5849640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 0x7ffbb406d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc007440 tx=0x7ffbcc009750 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:42.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.002+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbc0075a20 con 0x7ffbd00a7000 2023-12-08T08:19:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.208+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffbd00c09d0 con 0x7ffbd00a7000 2023-12-08T08:19:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.209+0000 7ffbc67fc640 1 -- 172.21.15.45:0/409440164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffbc0045080 con 0x7ffbd00a7000 2023-12-08T08:19:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:19:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 msgr2=0x7ffbb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 0x7ffbb406d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc007440 tx=0x7ffbcc009750 comp rx=0 tx=0).stop 2023-12-08T08:19:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 msgr2=0x7ffbd01ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0072810 tx=0x7ffbc0001930 comp rx=0 tx=0).stop 2023-12-08T08:19:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 shutdown_connections 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbb406ae40 0x7ffbb406d300 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbd01edb70 0x7ffbd006dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00a7000 0x7ffbd01ed630 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 --2- 172.21.15.45:0/409440164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbbc0047c0 0x7ffbd01dd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.211+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 >> 172.21.15.45:0/409440164 conn(0x7ffbd00c6c20 msgr2=0x7ffbd00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.212+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 shutdown_connections 2023-12-08T08:19:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.212+0000 7ffbd7aad640 1 -- 172.21.15.45:0/409440164 wait complete. 2023-12-08T08:19:42.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-08T08:19:42.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:42.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:42.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:19:42.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:42.344 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:19:42.400 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:42.400 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:42.461 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:42.461 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:42.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:42.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.750+0000 7eff42a6d640 1 Processor -- start 2023-12-08T08:19:42.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.750+0000 7eff42a6d640 1 -- start start 2023-12-08T08:19:42.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 0x7eff3c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c1553b0 con 0x7eff3c0c7a50 2023-12-08T08:19:42.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0c4a00 con 0x7eff3c1519c0 2023-12-08T08:19:42.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff42a6d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0c4ce0 con 0x7eff3c0c44d0 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff4226c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff4226c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37558/0 (socket says 172.21.15.45:37558) 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.751+0000 7eff4226c640 1 -- 172.21.15.45:0/1417161043 learned_addr learned my addr 172.21.15.45:0/1417161043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff41a6b640 1 --2- 172.21.15.45:0/1417161043 >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 0x7eff3c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4226c640 1 -- 172.21.15.45:0/1417161043 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 msgr2=0x7eff3c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4126a640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4226c640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4226c640 1 -- 172.21.15.45:0/1417161043 >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 msgr2=0x7eff3c1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4226c640 1 --2- 172.21.15.45:0/1417161043 >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 0x7eff3c1584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4226c640 1 -- 172.21.15.45:0/1417161043 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c1579e0 con 0x7eff3c0c7a50 2023-12-08T08:19:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff41a6b640 1 --2- 172.21.15.45:0/1417161043 >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 0x7eff3c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:42.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.752+0000 7eff4126a640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.753+0000 7eff4226c640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c6cb0 tx=0x7eff3402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce25646f39373907 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.753+0000 7eff40a69640 1 -- 172.21.15.45:0/1417161043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3402c9f0 con 0x7eff3c0c7a50 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.753+0000 7eff40a69640 1 -- 172.21.15.45:0/1417161043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3402cb50 con 0x7eff3c0c7a50 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.753+0000 7eff40a69640 1 -- 172.21.15.45:0/1417161043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340343f0 con 0x7eff3c0c7a50 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 -- 172.21.15.45:0/1417161043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c0c7a50 msgr2=0x7eff3c0ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0c6cb0 tx=0x7eff3402be50 comp rx=0 tx=0).stop 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 -- 172.21.15.45:0/1417161043 shutdown_connections 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0ab6b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 --2- 172.21.15.45:0/1417161043 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 --2- 172.21.15.45:0/1417161043 >> v2:172.21.15.114:3300/0 conn(0x7eff3c1519c0 0x7eff3c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 -- 172.21.15.45:0/1417161043 >> 172.21.15.45:0/1417161043 conn(0x7eff3c0661f0 msgr2=0x7eff3c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 -- 172.21.15.45:0/1417161043 shutdown_connections 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.754+0000 7eff42a6d640 1 -- 172.21.15.45:0/1417161043 wait complete. 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.756+0000 7eff42a6d640 1 Processor -- start 2023-12-08T08:19:42.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.756+0000 7eff42a6d640 1 -- start start 2023-12-08T08:19:42.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c1edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1ee130 con 0x7eff3c1519c0 2023-12-08T08:19:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0ab240 con 0x7eff3c0c7a50 2023-12-08T08:19:42.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff42a6d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0a9fc0 con 0x7eff3c0c44d0 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff4226c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff4226c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37566/0 (socket says 172.21.15.45:37566) 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff4226c640 1 -- 172.21.15.45:0/692065686 learned_addr learned my addr 172.21.15.45:0/692065686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.757+0000 7eff41a6b640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c1edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4126a640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 -- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 msgr2=0x7eff3c1edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c1edbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 -- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3c0c7a50 msgr2=0x7eff3c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 -- 172.21.15.45:0/692065686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009b30 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff4226c640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7eff34036040 tx=0x7eff34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.758+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34009510 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.759+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3403e450 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.759+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3403e800 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.759+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c0ab470 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.759+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0a9970 con 0x7eff3c1519c0 2023-12-08T08:19:42.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.760+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0aa170 con 0x7eff3c1519c0 2023-12-08T08:19:42.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.761+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff3403e960 con 0x7eff3c1519c0 2023-12-08T08:19:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.761+0000 7eff327fc640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 0x7eff2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.762+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7eff340ac8e0 con 0x7eff3c1519c0 2023-12-08T08:19:42.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.762+0000 7eff41a6b640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 0x7eff2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:42.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.763+0000 7eff41a6b640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 0x7eff2006d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff3800a950 tx=0x7eff38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:42.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.766+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff3c0aa170 con 0x7eff3c1519c0 2023-12-08T08:19:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.965+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff3c151da0 con 0x7eff3c1519c0 2023-12-08T08:19:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.968+0000 7eff327fc640 1 -- 172.21.15.45:0/692065686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7eff34077590 con 0x7eff3c1519c0 2023-12-08T08:19:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:42.971 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 msgr2=0x7eff2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 0x7eff2006d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff3800a950 tx=0x7eff38008040 comp rx=0 tx=0).stop 2023-12-08T08:19:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 msgr2=0x7eff3c1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7eff34036040 tx=0x7eff34004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 shutdown_connections 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7eff2006ae70 0x7eff2006d330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff3c1519c0 0x7eff3c1504a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff3c0c7a50 0x7eff3c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 --2- 172.21.15.45:0/692065686 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7eff3c0c44d0 0x7eff3c1edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.970+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 >> 172.21.15.45:0/692065686 conn(0x7eff3c0661f0 msgr2=0x7eff3c153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.971+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 shutdown_connections 2023-12-08T08:19:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:42.971+0000 7eff42a6d640 1 -- 172.21.15.45:0/692065686 wait complete. 2023-12-08T08:19:42.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:42.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.219+0000 7fec8725d640 1 Processor -- start 2023-12-08T08:19:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.219+0000 7fec8725d640 1 -- start start 2023-12-08T08:19:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec8725d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec800c1ff0 0x7fec80154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec8725d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800c0d40 con 0x7fec800c51d0 2023-12-08T08:19:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec8725d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec801555c0 con 0x7fec80147bb0 2023-12-08T08:19:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec8725d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800a4d10 con 0x7fec800c1ff0 2023-12-08T08:19:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec857fa640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec800c51d0 0x7fec80154d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43402/0 (socket says 172.21.15.45:43402) 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec857fa640 1 -- 172.21.15.45:0/2709715121 learned_addr learned my addr 172.21.15.45:0/2709715121 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.221+0000 7fec7ffff640 1 --2- 172.21.15.45:0/2709715121 >> v2:172.21.15.45:3300/0 conn(0x7fec800c1ff0 0x7fec80154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.222+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2709715121 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821628558 0 0) 0x7fec800c0d40 con 0x7fec800c51d0 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.222+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2709715121 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec70003520 con 0x7fec800c51d0 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.222+0000 7fec7ffff640 1 -- 172.21.15.45:0/2709715121 >> v1:172.21.15.114:6789/0 conn(0x7fec80147bb0 legacy=0x7fec800c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.222+0000 7fec7ffff640 1 -- 172.21.15.45:0/2709715121 >> v1:172.21.15.45:6789/0 conn(0x7fec800c51d0 legacy=0x7fec80154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.222+0000 7fec7ffff640 1 -- 172.21.15.45:0/2709715121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800a4ff0 con 0x7fec800c1ff0 2023-12-08T08:19:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.223+0000 7fec7ffff640 1 --2- 172.21.15.45:0/2709715121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec800c1ff0 0x7fec80154840 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0097a0 tx=0x7fec6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411a8556e3e717e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.224+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2709715121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c031830 con 0x7fec800c1ff0 2023-12-08T08:19:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.224+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2709715121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c031990 con 0x7fec800c1ff0 2023-12-08T08:19:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.224+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2709715121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c031d20 con 0x7fec800c1ff0 2023-12-08T08:19:43.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.224+0000 7fec8725d640 1 -- 172.21.15.45:0/2709715121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec800c1ff0 msgr2=0x7fec80154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.224+0000 7fec8725d640 1 --2- 172.21.15.45:0/2709715121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec800c1ff0 0x7fec80154840 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0097a0 tx=0x7fec6c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.225+0000 7fec8725d640 1 -- 172.21.15.45:0/2709715121 shutdown_connections 2023-12-08T08:19:43.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.225+0000 7fec8725d640 1 --2- 172.21.15.45:0/2709715121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec800c1ff0 0x7fec80154840 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.225+0000 7fec8725d640 1 -- 172.21.15.45:0/2709715121 >> 172.21.15.45:0/2709715121 conn(0x7fec800c2430 msgr2=0x7fec800c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.225+0000 7fec8725d640 1 -- 172.21.15.45:0/2709715121 shutdown_connections 2023-12-08T08:19:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.225+0000 7fec8725d640 1 -- 172.21.15.45:0/2709715121 wait complete. 2023-12-08T08:19:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.226+0000 7fec8725d640 1 Processor -- start 2023-12-08T08:19:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.227+0000 7fec8725d640 1 -- start start 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.227+0000 7fec8725d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec800c51d0 0x7fec80146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec8725d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec80147bb0 0x7fec80070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec8725d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec8725d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80148290 con 0x7fec80071160 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec8725d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80148570 con 0x7fec80147bb0 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec8725d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec80147280 con 0x7fec800c51d0 2023-12-08T08:19:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37580/0 (socket says 172.21.15.45:37580) 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 -- 172.21.15.45:0/1558812466 learned_addr learned my addr 172.21.15.45:0/1558812466 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec7ffff640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec80147bb0 0x7fec80070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec84ff9640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec800c51d0 0x7fec80146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 -- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec800c51d0 msgr2=0x7fec80146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec800c51d0 0x7fec80146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 -- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec80147bb0 msgr2=0x7fec80070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec80147bb0 0x7fec80070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.228+0000 7fec857fa640 1 -- 172.21.15.45:0/1558812466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009400 con 0x7fec80071160 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec857fa640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec7800cb70 tx=0x7fec7800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800ace0 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800ae40 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78012620 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec80146fa0 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.229+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec801e8d80 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.231+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80074670 con 0x7fec80071160 2023-12-08T08:19:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.231+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec78007070 con 0x7fec80071160 2023-12-08T08:19:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.233+0000 7fec7d7fa640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 0x7fec6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.233+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fec78089b60 con 0x7fec80071160 2023-12-08T08:19:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.233+0000 7fec84ff9640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 0x7fec6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.234+0000 7fec84ff9640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 0x7fec6406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec74000f60 tx=0x7fec74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.237+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec780546d0 con 0x7fec80071160 2023-12-08T08:19:43.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.429+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec801486b0 con 0x7fec80071160 2023-12-08T08:19:43.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.430+0000 7fec7d7fa640 1 -- 172.21.15.45:0/1558812466 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec780170a0 con 0x7fec80071160 2023-12-08T08:19:43.433 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:43.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.432+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 msgr2=0x7fec6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.432+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 0x7fec6406d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fec74000f60 tx=0x7fec74009040 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.432+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 msgr2=0x7fec80149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.432+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec7800cb70 tx=0x7fec7800a430 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 shutdown_connections 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fec6406ae70 0x7fec6406d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec80071160 0x7fec80149fe0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec80147bb0 0x7fec80070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 --2- 172.21.15.45:0/1558812466 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fec800c51d0 0x7fec80146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 >> 172.21.15.45:0/1558812466 conn(0x7fec800c2430 msgr2=0x7fec800c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 shutdown_connections 2023-12-08T08:19:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.433+0000 7fec8725d640 1 -- 172.21.15.45:0/1558812466 wait complete. 2023-12-08T08:19:43.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.688+0000 7fbbce775640 1 Processor -- start 2023-12-08T08:19:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.688+0000 7fbbce775640 1 -- start start 2023-12-08T08:19:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.689+0000 7fbbce775640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc814f680 0x7fbbc81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.689+0000 7fbbce775640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 0x7fbbc806a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.689+0000 7fbbce775640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80c7170 con 0x7fbbc806e720 2023-12-08T08:19:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.689+0000 7fbbce775640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc806d1b0 con 0x7fbbc814f680 2023-12-08T08:19:43.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.689+0000 7fbbce775640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814fa60 con 0x7fbbc806e160 2023-12-08T08:19:43.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc814f680 0x7fbbc81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc814f680 0x7fbbc81561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37582/0 (socket says 172.21.15.45:37582) 2023-12-08T08:19:43.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 -- 172.21.15.45:0/4193539389 learned_addr learned my addr 172.21.15.45:0/4193539389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcdf74640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 0x7fbbc806a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 -- 172.21.15.45:0/4193539389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 msgr2=0x7fbbc806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 0x7fbbc806a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 -- 172.21.15.45:0/4193539389 >> v1:172.21.15.114:6789/0 conn(0x7fbbc806e720 legacy=0x7fbbc8152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcd773640 1 -- 172.21.15.45:0/4193539389 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80c76a0 con 0x7fbbc814f680 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.690+0000 7fbbcdf74640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 0x7fbbc806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.692+0000 7fbbcd773640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc81561d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c204d4daa0c48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.692+0000 7fbbbffff640 1 -- 172.21.15.45:0/4193539389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40317c0 con 0x7fbbc814f680 2023-12-08T08:19:43.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.692+0000 7fbbbffff640 1 -- 172.21.15.45:0/4193539389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc4031920 con 0x7fbbc814f680 2023-12-08T08:19:43.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.692+0000 7fbbbffff640 1 -- 172.21.15.45:0/4193539389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4031cb0 con 0x7fbbc814f680 2023-12-08T08:19:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 -- 172.21.15.45:0/4193539389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 msgr2=0x7fbbc81561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc81561d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009870 tx=0x7fbbc402b860 comp rx=0 tx=0).stop 2023-12-08T08:19:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 -- 172.21.15.45:0/4193539389 shutdown_connections 2023-12-08T08:19:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e160 0x7fbbc806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 --2- 172.21.15.45:0/4193539389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc81561d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 -- 172.21.15.45:0/4193539389 >> 172.21.15.45:0/4193539389 conn(0x7fbbc80a85a0 msgr2=0x7fbbc80a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 -- 172.21.15.45:0/4193539389 shutdown_connections 2023-12-08T08:19:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.693+0000 7fbbce775640 1 -- 172.21.15.45:0/4193539389 wait complete. 2023-12-08T08:19:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.695+0000 7fbbce775640 1 Processor -- start 2023-12-08T08:19:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.695+0000 7fbbce775640 1 -- start start 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc806e160 0x7fbbc81edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e720 0x7fbbc80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81ee0a0 con 0x7fbbc814f680 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81eab40 con 0x7fbbc806e160 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbce775640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80a8190 con 0x7fbbc806e720 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbcdf74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbcdf74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37598/0 (socket says 172.21.15.45:37598) 2023-12-08T08:19:43.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.696+0000 7fbbcdf74640 1 -- 172.21.15.45:0/4071826175 learned_addr learned my addr 172.21.15.45:0/4071826175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcd773640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc806e160 0x7fbbc81edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbccf72640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e720 0x7fbbc80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 -- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e720 msgr2=0x7fbbc80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e720 0x7fbbc80c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 -- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc806e160 msgr2=0x7fbbc81edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc806e160 0x7fbbc81edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 -- 172.21.15.45:0/4071826175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40094d0 con 0x7fbbc814f680 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.697+0000 7fbbcdf74640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000cdb0 tx=0x7fbbc000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.698+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003b90 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.698+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0003d10 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.698+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0004260 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.698+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc81e9f30 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.698+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc81ea4f0 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.699+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc80a7220 con 0x7fbbc814f680 2023-12-08T08:19:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.700+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbc000b040 con 0x7fbbc814f680 2023-12-08T08:19:43.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.701+0000 7fbbbdffb640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.702+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fbbc008a1a0 con 0x7fbbc814f680 2023-12-08T08:19:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.702+0000 7fbbcd773640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.703+0000 7fbbcd773640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 0x7fbbac06d300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4036000 tx=0x7fbbc403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:43.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.706+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbc0054da0 con 0x7fbbc814f680 2023-12-08T08:19:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.905+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbc80673e0 con 0x7fbbc814f680 2023-12-08T08:19:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.906+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4071826175 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbc0003e80 con 0x7fbbc814f680 2023-12-08T08:19:43.909 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 msgr2=0x7fbbac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 0x7fbbac06d300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4036000 tx=0x7fbbc403d040 comp rx=0 tx=0).stop 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 msgr2=0x7fbbc80a7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000cdb0 tx=0x7fbbc000a650 comp rx=0 tx=0).stop 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 shutdown_connections 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fbbc806e720 0x7fbbc80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc814f680 0x7fbbc80a7500 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 --2- 172.21.15.45:0/4071826175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc806e160 0x7fbbc81edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 >> 172.21.15.45:0/4071826175 conn(0x7fbbc80a85a0 msgr2=0x7fbbc80a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 shutdown_connections 2023-12-08T08:19:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:43.909+0000 7fbbce775640 1 -- 172.21.15.45:0/4071826175 wait complete. 2023-12-08T08:19:43.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.159+0000 7fea0b59e640 1 Processor -- start 2023-12-08T08:19:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.159+0000 7fea0b59e640 1 -- start start 2023-12-08T08:19:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c14c280 0x7fea0c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0c0c60c0 con 0x7fea0c155790 2023-12-08T08:19:44.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0c152dc0 con 0x7fea0c0c4970 2023-12-08T08:19:44.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1521d0 con 0x7fea0c14c280 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea0c155790 0x7fea0c155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43418/0 (socket says 172.21.15.45:43418) 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0ad9d640 1 -- 172.21.15.45:0/2168779801 learned_addr learned my addr 172.21.15.45:0/2168779801 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.161+0000 7fea0a59c640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c14c280 0x7fea0c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094765103 0 0) 0x7fea04001490 con 0x7fea0c155790 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003520 con 0x7fea0c155790 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361660851 0 0) 0x7fea0c152dc0 con 0x7fea0c0c4970 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea04001490 con 0x7fea0c0c4970 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049898523 0 0) 0x7fe9f4003520 con 0x7fea0c155790 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c14c280 msgr2=0x7fea0c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c14c280 0x7fea0c0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 >> v1:172.21.15.114:6789/0 conn(0x7fea0c0c4970 legacy=0x7fea0c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c14c660 con 0x7fea0c155790 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.162+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fea04001b80 con 0x7fea0c155790 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 >> v1:172.21.15.45:6789/0 conn(0x7fea0c155790 legacy=0x7fea0c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f4003b30 0x7fe9f4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9f40047c0 0x7fe9f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9f4005180 0x7fe9f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1521d0 con 0x7fe9f40047c0 2023-12-08T08:19:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400c050 con 0x7fe9f4003b30 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400c210 con 0x7fe9f4005180 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0a59c640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c14c280 0x7fea0c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea09d9b640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9f40047c0 0x7fe9f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0ad9d640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9f4005180 0x7fe9f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.163+0000 7fea0a59c640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f4003b30 0x7fe9f4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea09d9b640 1 -- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9f4005180 msgr2=0x7fe9f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea09d9b640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9f4005180 0x7fe9f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea09d9b640 1 -- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f4003b30 msgr2=0x7fe9f4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea09d9b640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f4003b30 0x7fe9f4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea09d9b640 1 -- 172.21.15.45:0/2168779801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4003520 con 0x7fe9f40047c0 2023-12-08T08:19:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea0ad9d640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe9f4005180 0x7fe9f400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.164+0000 7fea0a59c640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f4003b30 0x7fe9f4003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.165+0000 7fea09d9b640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9f40047c0 0x7fe9f4004c40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fea000018d0 tx=0x7fe9f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe789c27470325a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.166+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000052d0 con 0x7fe9f40047c0 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.166+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00005430 con 0x7fe9f40047c0 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.166+0000 7fea0959a640 1 -- 172.21.15.45:0/2168779801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00003810 con 0x7fe9f40047c0 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 -- 172.21.15.45:0/2168779801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9f40047c0 msgr2=0x7fe9f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 --2- 172.21.15.45:0/2168779801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9f40047c0 0x7fe9f4004c40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fea000018d0 tx=0x7fe9f40057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0ad9d640 1 -- 172.21.15.45:0/2168779801 reap_dead start 2023-12-08T08:19:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 -- 172.21.15.45:0/2168779801 shutdown_connections 2023-12-08T08:19:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 -- 172.21.15.45:0/2168779801 >> 172.21.15.45:0/2168779801 conn(0x7fea0c066ce0 msgr2=0x7fea0c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 -- 172.21.15.45:0/2168779801 shutdown_connections 2023-12-08T08:19:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.167+0000 7fea0b59e640 1 -- 172.21.15.45:0/2168779801 wait complete. 2023-12-08T08:19:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.169+0000 7fea0b59e640 1 Processor -- start 2023-12-08T08:19:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.169+0000 7fea0b59e640 1 -- start start 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 0x7fea0c0c13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c1499e0 0x7fea0c149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1eb880 con 0x7fea0c0a56a0 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1eaf50 con 0x7fe9f40047c0 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea0b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1eb230 con 0x7fea0c1499e0 2023-12-08T08:19:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea09d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea09d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37614/0 (socket says 172.21.15.45:37614) 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.170+0000 7fea09d9b640 1 -- 172.21.15.45:0/1607674602 learned_addr learned my addr 172.21.15.45:0/1607674602 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea0a59c640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 0x7fea0c0c13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 -- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c1499e0 msgr2=0x7fea0c149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea0ad9d640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c1499e0 0x7fea0c149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c1499e0 0x7fea0c149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 -- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 msgr2=0x7fea0c0c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 0x7fea0c0c13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 -- 172.21.15.45:0/1607674602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c1eb510 con 0x7fea0c0a56a0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea0a59c640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 0x7fea0c0c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fea09d9b640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea00005040 tx=0x7fea000012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.171+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00006ea0 con 0x7fea0c0a56a0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.172+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00007450 con 0x7fea0c0a56a0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.172+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000035f0 con 0x7fea0c0a56a0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.172+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c0c2050 con 0x7fea0c0a56a0 2023-12-08T08:19:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.172+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c1ebd10 con 0x7fea0c0a56a0 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.173+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0c1eba30 con 0x7fea0c0a56a0 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.174+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea00003750 con 0x7fea0c0a56a0 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.175+0000 7fe9faffd640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 0x7fe9ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.175+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fea000ab7c0 con 0x7fea0c0a56a0 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.175+0000 7fea0a59c640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 0x7fe9ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.176+0000 7fea0a59c640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 0x7fe9ec06d330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0c1bd0 tx=0x7fe9fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.179+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea0c1eba30 con 0x7fea0c0a56a0 2023-12-08T08:19:44.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.370+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea0c0678c0 con 0x7fea0c0a56a0 2023-12-08T08:19:44.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.371+0000 7fe9faffd640 1 -- 172.21.15.45:0/1607674602 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea00079fa0 con 0x7fea0c0a56a0 2023-12-08T08:19:44.374 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 msgr2=0x7fe9ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 0x7fe9ec06d330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0c1bd0 tx=0x7fe9fc008040 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 msgr2=0x7fea0c0a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea00005040 tx=0x7fea000012d0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 shutdown_connections 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe9ec06ae70 0x7fe9ec06d330 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fea0c1499e0 0x7fea0c149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea0c0a56a0 0x7fea0c0a5b20 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 --2- 172.21.15.45:0/1607674602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9f40047c0 0x7fea0c0c13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 >> 172.21.15.45:0/1607674602 conn(0x7fea0c066ce0 msgr2=0x7fea0c148fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 shutdown_connections 2023-12-08T08:19:44.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.374+0000 7fea0b59e640 1 -- 172.21.15.45:0/1607674602 wait complete. 2023-12-08T08:19:44.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:44.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.625+0000 7fc70b59e640 1 Processor -- start 2023-12-08T08:19:44.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.625+0000 7fc70b59e640 1 -- start start 2023-12-08T08:19:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.626+0000 7fc70b59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc70c0c3e50 0x7fc70c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.626+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c155700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.626+0000 7fc70b59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c14fbb0 con 0x7fc70c155c40 2023-12-08T08:19:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.626+0000 7fc70b59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c152110 con 0x7fc70c0c3e50 2023-12-08T08:19:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.626+0000 7fc70b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c7520 con 0x7fc70c152e00 2023-12-08T08:19:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc70c0c3e50 0x7fc70c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc70c0c3e50 0x7fc70c06f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37630/0 (socket says 172.21.15.45:37630) 2023-12-08T08:19:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 -- 172.21.15.45:0/1425587086 learned_addr learned my addr 172.21.15.45:0/1425587086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc709d9b640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 -- 172.21.15.45:0/1425587086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 msgr2=0x7fc70c155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 -- 172.21.15.45:0/1425587086 >> v1:172.21.15.114:6789/0 conn(0x7fc70c155c40 legacy=0x7fc70c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc70a59c640 1 -- 172.21.15.45:0/1425587086 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c152320 con 0x7fc70c0c3e50 2023-12-08T08:19:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.627+0000 7fc709d9b640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.628+0000 7fc70a59c640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c06f810 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49381bbee0a1ee2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.629+0000 7fc70959a640 1 -- 172.21.15.45:0/1425587086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc02c950 con 0x7fc70c0c3e50 2023-12-08T08:19:44.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.629+0000 7fc70959a640 1 -- 172.21.15.45:0/1425587086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc02cab0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.629+0000 7fc70959a640 1 -- 172.21.15.45:0/1425587086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc02ce40 con 0x7fc70c0c3e50 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 -- 172.21.15.45:0/1425587086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 msgr2=0x7fc70c06f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c06f810 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc02bdb0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 -- 172.21.15.45:0/1425587086 shutdown_connections 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 --2- 172.21.15.45:0/1425587086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c06f810 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 -- 172.21.15.45:0/1425587086 >> 172.21.15.45:0/1425587086 conn(0x7fc70c0c4840 msgr2=0x7fc70c0c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 -- 172.21.15.45:0/1425587086 shutdown_connections 2023-12-08T08:19:44.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.630+0000 7fc70b59e640 1 -- 172.21.15.45:0/1425587086 wait complete. 2023-12-08T08:19:44.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.632+0000 7fc70b59e640 1 Processor -- start 2023-12-08T08:19:44.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.632+0000 7fc70b59e640 1 -- start start 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 0x7fc70c145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c1493a0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0ab940 con 0x7fc70c155c40 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c145940 con 0x7fc70c152e00 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37636/0 (socket says 172.21.15.45:37636) 2023-12-08T08:19:44.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc70a59c640 1 -- 172.21.15.45:0/2362293674 learned_addr learned my addr 172.21.15.45:0/2362293674 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.633+0000 7fc709d9b640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70ad9d640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 0x7fc70c145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 -- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 msgr2=0x7fc70c144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 -- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 msgr2=0x7fc70c145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 0x7fc70c145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 -- 172.21.15.45:0/2362293674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009b30 con 0x7fc70c0c3e50 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70ad9d640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 0x7fc70c145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70a59c640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc03e450 con 0x7fc70c0c3e50 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc03e5f0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc03e9a0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.634+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c0ab010 con 0x7fc70c0c3e50 2023-12-08T08:19:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.635+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c0ab5d0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.636+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c0abab0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.637+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6fc03eb00 con 0x7fc70c0c3e50 2023-12-08T08:19:44.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.638+0000 7fc702ffd640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.638+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7fc6fc0ac730 con 0x7fc70c0c3e50 2023-12-08T08:19:44.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.638+0000 7fc709d9b640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.639+0000 7fc709d9b640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 0x7fc6ec06d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0c8780 tx=0x7fc6f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.643+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6fc077330 con 0x7fc70c0c3e50 2023-12-08T08:19:44.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.837+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc70c0673e0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.838+0000 7fc702ffd640 1 -- 172.21.15.45:0/2362293674 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v83) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc6fc03edb0 con 0x7fc70c0c3e50 2023-12-08T08:19:44.841 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 msgr2=0x7fc6ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 0x7fc6ec06d330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0c8780 tx=0x7fc6f4008040 comp rx=0 tx=0).stop 2023-12-08T08:19:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 msgr2=0x7fc70c0c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009e50 tx=0x7fc6fc004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 shutdown_connections 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc6ec06ae70 0x7fc6ec06d330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc70c152e00 0x7fc70c144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc70c155c40 0x7fc70c145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 --2- 172.21.15.45:0/2362293674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c0c3e50 0x7fc70c0c28b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 >> 172.21.15.45:0/2362293674 conn(0x7fc70c0c4840 msgr2=0x7fc70c0c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 shutdown_connections 2023-12-08T08:19:44.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:44.841+0000 7fc70b59e640 1 -- 172.21.15.45:0/2362293674 wait complete. 2023-12-08T08:19:44.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.082+0000 7f3db1175640 1 Processor -- start 2023-12-08T08:19:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.082+0000 7f3db1175640 1 -- start start 2023-12-08T08:19:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.083+0000 7f3db1175640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3dac14c280 0x7f3dac0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.083+0000 7f3db1175640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dac155790 0x7f3dac155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.083+0000 7f3db1175640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac0c60c0 con 0x7f3dac0c4970 2023-12-08T08:19:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.083+0000 7f3db1175640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac152dc0 con 0x7f3dac14c280 2023-12-08T08:19:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.083+0000 7f3db1175640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac1521d0 con 0x7f3dac155790 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3dac14c280 0x7f3dac0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3dac14c280 0x7f3dac0a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44298/0 (socket says 172.21.15.45:44298) 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 -- 172.21.15.45:0/1858759076 learned_addr learned my addr 172.21.15.45:0/1858759076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 -- 172.21.15.45:0/1858759076 >> v2:172.21.15.114:3300/0 conn(0x7f3dac155790 msgr2=0x7f3dac155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 --2- 172.21.15.45:0/1858759076 >> v2:172.21.15.114:3300/0 conn(0x7f3dac155790 0x7f3dac155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 -- 172.21.15.45:0/1858759076 >> v1:172.21.15.114:6789/0 conn(0x7f3dac0c4970 legacy=0x7f3dac06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.084+0000 7f3dabfff640 1 -- 172.21.15.45:0/1858759076 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac14c660 con 0x7f3dac14c280 2023-12-08T08:19:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.085+0000 7f3dabfff640 1 --2- 172.21.15.45:0/1858759076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac14c280 0x7f3dac0a4d10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06dbe0 tx=0x7f3d9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d644d01526fe3c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.085+0000 7f3daaffd640 1 -- 172.21.15.45:0/1858759076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0317e0 con 0x7f3dac14c280 2023-12-08T08:19:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3daaffd640 1 -- 172.21.15.45:0/1858759076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c031940 con 0x7f3dac14c280 2023-12-08T08:19:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3daaffd640 1 -- 172.21.15.45:0/1858759076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c031cd0 con 0x7f3dac14c280 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 -- 172.21.15.45:0/1858759076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac14c280 msgr2=0x7f3dac0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 --2- 172.21.15.45:0/1858759076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac14c280 0x7f3dac0a4d10 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f3dac06dbe0 tx=0x7f3d9c02b880 comp rx=0 tx=0).stop 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 -- 172.21.15.45:0/1858759076 shutdown_connections 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 --2- 172.21.15.45:0/1858759076 >> v2:172.21.15.114:3300/0 conn(0x7f3dac155790 0x7f3dac155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 --2- 172.21.15.45:0/1858759076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac14c280 0x7f3dac0a4d10 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 -- 172.21.15.45:0/1858759076 >> 172.21.15.45:0/1858759076 conn(0x7f3dac066ce0 msgr2=0x7f3dac0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 -- 172.21.15.45:0/1858759076 shutdown_connections 2023-12-08T08:19:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.086+0000 7f3db1175640 1 -- 172.21.15.45:0/1858759076 wait complete. 2023-12-08T08:19:45.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.088+0000 7f3db1175640 1 Processor -- start 2023-12-08T08:19:45.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.088+0000 7f3db1175640 1 -- start start 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dac14c280 0x7f3dac153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dac155790 0x7f3dac1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac0aa250 con 0x7f3dac0c4970 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1ed500 con 0x7f3dac14c280 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3db1175640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1459b0 con 0x7f3dac155790 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44306/0 (socket says 172.21.15.45:44306) 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.089+0000 7f3dabfff640 1 -- 172.21.15.45:0/2512217481 learned_addr learned my addr 172.21.15.45:0/2512217481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dab7fe640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dac14c280 0x7f3dac153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3db0974640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dac155790 0x7f3dac1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 -- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dac155790 msgr2=0x7f3dac1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dac155790 0x7f3dac1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 -- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dac14c280 msgr2=0x7f3dac153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dac14c280 0x7f3dac153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 -- 172.21.15.45:0/2512217481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0094d0 con 0x7f3dac0c4970 2023-12-08T08:19:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.090+0000 7f3dabfff640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c02b8c0 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.091+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032940 con 0x7f3dac0c4970 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.091+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c032aa0 con 0x7f3dac0c4970 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.091+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032e50 con 0x7f3dac0c4970 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.091+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac1eceb0 con 0x7f3dac0c4970 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.091+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac155540 con 0x7f3dac0c4970 2023-12-08T08:19:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.092+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac0678c0 con 0x7f3dac0c4970 2023-12-08T08:19:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.093+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d9c04e450 con 0x7f3dac0c4970 2023-12-08T08:19:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.094+0000 7f3da8ff9640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.094+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f3d9c0abab0 con 0x7f3dac0c4970 2023-12-08T08:19:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.094+0000 7f3dab7fe640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.095+0000 7f3dab7fe640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3dac145fa0 tx=0x7f3da0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.099+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d9c076750 con 0x7f3dac0c4970 2023-12-08T08:19:45.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.291+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3dac0c60c0 con 0x7f3dac0c4970 2023-12-08T08:19:45.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.292+0000 7f3da8ff9640 1 -- 172.21.15.45:0/2512217481 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v83) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3dac0c60c0 con 0x7f3dac0c4970 2023-12-08T08:19:45.294 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 msgr2=0x7f3d9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 0x7f3d9806d330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3dac145fa0 tx=0x7f3da0009040 comp rx=0 tx=0).stop 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 msgr2=0x7f3dac14b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c02b8c0 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 shutdown_connections 2023-12-08T08:19:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3d9806ae70 0x7f3d9806d330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3dac155790 0x7f3dac1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dac14c280 0x7f3dac153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 --2- 172.21.15.45:0/2512217481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dac0c4970 0x7f3dac14b4f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.294+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 >> 172.21.15.45:0/2512217481 conn(0x7f3dac066ce0 msgr2=0x7f3dac0c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.295+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 shutdown_connections 2023-12-08T08:19:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.295+0000 7f3db1175640 1 -- 172.21.15.45:0/2512217481 wait complete. 2023-12-08T08:19:45.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:45.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.541+0000 7feeee6da640 1 Processor -- start 2023-12-08T08:19:45.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.541+0000 7feeee6da640 1 -- start start 2023-12-08T08:19:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feeee6da640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feee80c4f00 0x7feee81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feeee6da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feee80a8ac0 0x7feee80c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feeee6da640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee8153160 con 0x7feee81521e0 2023-12-08T08:19:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feeee6da640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8152ba0 con 0x7feee80a8ac0 2023-12-08T08:19:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feeee6da640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8152e80 con 0x7feee80c4f00 2023-12-08T08:19:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feedffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feee80a8ac0 0x7feee80c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feedffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feee80a8ac0 0x7feee80c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44312/0 (socket says 172.21.15.45:44312) 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feedffff640 1 -- 172.21.15.45:0/4098584188 learned_addr learned my addr 172.21.15.45:0/4098584188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.543+0000 7feee7fff640 1 --2- 172.21.15.45:0/4098584188 >> v2:172.21.15.114:3300/0 conn(0x7feee80c4f00 0x7feee81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.544+0000 7feedffff640 1 -- 172.21.15.45:0/4098584188 >> v2:172.21.15.114:3300/0 conn(0x7feee80c4f00 msgr2=0x7feee81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.544+0000 7feedffff640 1 --2- 172.21.15.45:0/4098584188 >> v2:172.21.15.114:3300/0 conn(0x7feee80c4f00 0x7feee81536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.544+0000 7feedffff640 1 -- 172.21.15.45:0/4098584188 >> v1:172.21.15.114:6789/0 conn(0x7feee81521e0 legacy=0x7feee80c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.544+0000 7feedffff640 1 -- 172.21.15.45:0/4098584188 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80c38d0 con 0x7feee80a8ac0 2023-12-08T08:19:45.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.545+0000 7feedffff640 1 --2- 172.21.15.45:0/4098584188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80a8ac0 0x7feee80c52e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7feee80c6660 tx=0x7feed002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2516f679f8c4569c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.545+0000 7feee77fe640 1 -- 172.21.15.45:0/4098584188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00317e0 con 0x7feee80a8ac0 2023-12-08T08:19:45.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.545+0000 7feee77fe640 1 -- 172.21.15.45:0/4098584188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0031940 con 0x7feee80a8ac0 2023-12-08T08:19:45.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.545+0000 7feee77fe640 1 -- 172.21.15.45:0/4098584188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0031cd0 con 0x7feee80a8ac0 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 -- 172.21.15.45:0/4098584188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80a8ac0 msgr2=0x7feee80c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 --2- 172.21.15.45:0/4098584188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80a8ac0 0x7feee80c52e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7feee80c6660 tx=0x7feed002b880 comp rx=0 tx=0).stop 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 -- 172.21.15.45:0/4098584188 shutdown_connections 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 --2- 172.21.15.45:0/4098584188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80a8ac0 0x7feee80c52e0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 --2- 172.21.15.45:0/4098584188 >> v2:172.21.15.114:3300/0 conn(0x7feee80c4f00 0x7feee81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 -- 172.21.15.45:0/4098584188 >> 172.21.15.45:0/4098584188 conn(0x7feee8066db0 msgr2=0x7feee80c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 -- 172.21.15.45:0/4098584188 shutdown_connections 2023-12-08T08:19:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.546+0000 7feeee6da640 1 -- 172.21.15.45:0/4098584188 wait complete. 2023-12-08T08:19:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.548+0000 7feeee6da640 1 Processor -- start 2023-12-08T08:19:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.548+0000 7feeee6da640 1 -- start start 2023-12-08T08:19:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feee80a8ac0 0x7feee814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feee81521e0 0x7feee8140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8144210 con 0x7feee80c4f00 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee81443e0 con 0x7feee81521e0 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feeee6da640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c2650 con 0x7feee80a8ac0 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.549+0000 7feedffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44318/0 (socket says 172.21.15.45:44318) 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 -- 172.21.15.45:0/1252259581 learned_addr learned my addr 172.21.15.45:0/1252259581 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 -- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feee80a8ac0 msgr2=0x7feee814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feee80a8ac0 0x7feee814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 -- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feee81521e0 msgr2=0x7feee8140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feee81521e0 0x7feee8140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 -- 172.21.15.45:0/1252259581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00094d0 con 0x7feee80c4f00 2023-12-08T08:19:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.550+0000 7feedffff640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7feed0000c00 tx=0x7feed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.551+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0032880 con 0x7feee80c4f00 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.551+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0032a20 con 0x7feee80c4f00 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.551+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0032dd0 con 0x7feee80c4f00 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.551+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8143f30 con 0x7feee80c4f00 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.551+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee814a7b0 con 0x7feee80c4f00 2023-12-08T08:19:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.552+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee80c2140 con 0x7feee80c4f00 2023-12-08T08:19:45.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.553+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feed00453f0 con 0x7feee80c4f00 2023-12-08T08:19:45.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.554+0000 7feee57fa640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 0x7feec806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.554+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7feed00abc60 con 0x7feee80c4f00 2023-12-08T08:19:45.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.555+0000 7feee7fff640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 0x7feec806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.555+0000 7feee7fff640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 0x7feec806d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7feed8006a90 tx=0x7feed8006a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.558+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feee80c2140 con 0x7feee80c4f00 2023-12-08T08:19:45.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.772+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feee80c2140 con 0x7feee80c4f00 2023-12-08T08:19:45.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.773+0000 7feee57fa640 1 -- 172.21.15.45:0/1252259581 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7feee80c2140 con 0x7feee80c4f00 2023-12-08T08:19:45.776 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-08T08:19:45.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.776+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 msgr2=0x7feec806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.776+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 0x7feec806d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7feed8006a90 tx=0x7feed8006a20 comp rx=0 tx=0).stop 2023-12-08T08:19:45.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.776+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 msgr2=0x7feee813fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.776+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7feed0000c00 tx=0x7feed00046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 shutdown_connections 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7feec806ae40 0x7feec806d300 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feee81521e0 0x7feee8140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feee80c4f00 0x7feee813fdd0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 --2- 172.21.15.45:0/1252259581 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7feee80a8ac0 0x7feee814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 >> 172.21.15.45:0/1252259581 conn(0x7feee8066db0 msgr2=0x7feee81516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 shutdown_connections 2023-12-08T08:19:45.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:45.777+0000 7feeee6da640 1 -- 172.21.15.45:0/1252259581 wait complete. 2023-12-08T08:19:45.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-08T08:19:45.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-08T08:19:45.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:19:45.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.915 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:19:45.965 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:19:45.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:19:46.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:19:46.226 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:19:46.226 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:19:46.226 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:46.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:19:46.291 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:19:46.291 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:46.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:19:46.351 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.583+0000 7f517f59e640 1 Processor -- start 2023-12-08T08:19:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.584+0000 7f517f59e640 1 -- start start 2023-12-08T08:19:46.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517f59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f51800c6b70 0x7f518006e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517f59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518006ed70 con 0x7f5180156490 2023-12-08T08:19:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517f59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c3c30 con 0x7f51800c6b70 2023-12-08T08:19:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800c5a20 con 0x7f51800c5bd0 2023-12-08T08:19:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517dd9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517e59c640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5180156490 0x7f51800c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.45:39196/0 (socket says 172.21.15.45:39196) 2023-12-08T08:19:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517dd9b640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:59978/0 (socket says 172.21.15.45:59978) 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.585+0000 7f517e59c640 1 -- 172.21.15.45:0/3322822190 learned_addr learned my addr 172.21.15.45:0/3322822190 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.586+0000 7f517ed9d640 1 --2- 172.21.15.45:0/3322822190 >> v2:172.21.15.114:3300/0 conn(0x7f51800c6b70 0x7f518006e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.586+0000 7f517dd9b640 1 -- 172.21.15.45:0/3322822190 >> v2:172.21.15.114:3300/0 conn(0x7f51800c6b70 msgr2=0x7f518006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.586+0000 7f517dd9b640 1 --2- 172.21.15.45:0/3322822190 >> v2:172.21.15.114:3300/0 conn(0x7f51800c6b70 0x7f518006e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.586+0000 7f517dd9b640 1 -- 172.21.15.45:0/3322822190 >> v1:172.21.15.114:6789/0 conn(0x7f5180156490 legacy=0x7f51800c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.586+0000 7f517dd9b640 1 -- 172.21.15.45:0/3322822190 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800c6890 con 0x7f51800c5bd0 2023-12-08T08:19:46.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.588+0000 7f517dd9b640 1 --2- 172.21.15.45:0/3322822190 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51800c5b60 tx=0x7f516802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c2ca3321c8e184 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.588+0000 7f517d59a640 1 -- 172.21.15.45:0/3322822190 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168031800 con 0x7f51800c5bd0 2023-12-08T08:19:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.588+0000 7f517d59a640 1 -- 172.21.15.45:0/3322822190 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5168031960 con 0x7f51800c5bd0 2023-12-08T08:19:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.588+0000 7f517d59a640 1 -- 172.21.15.45:0/3322822190 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168031cf0 con 0x7f51800c5bd0 2023-12-08T08:19:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 -- 172.21.15.45:0/3322822190 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 msgr2=0x7f518006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 --2- 172.21.15.45:0/3322822190 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51800c5b60 tx=0x7f516802b8a0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 -- 172.21.15.45:0/3322822190 shutdown_connections 2023-12-08T08:19:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 --2- 172.21.15.45:0/3322822190 >> v2:172.21.15.114:3300/0 conn(0x7f51800c6b70 0x7f518006e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 --2- 172.21.15.45:0/3322822190 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f518006e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 -- 172.21.15.45:0/3322822190 >> 172.21.15.45:0/3322822190 conn(0x7f51800a9770 msgr2=0x7f51800a9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 -- 172.21.15.45:0/3322822190 shutdown_connections 2023-12-08T08:19:46.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.589+0000 7f517f59e640 1 -- 172.21.15.45:0/3322822190 wait complete. 2023-12-08T08:19:46.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.591+0000 7f517f59e640 1 Processor -- start 2023-12-08T08:19:46.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.591+0000 7f517f59e640 1 -- start start 2023-12-08T08:19:46.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f51801edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5180156490 0x7f518014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518014fc50 con 0x7f51800c6b70 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518006c830 con 0x7f5180156490 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517f59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518014f690 con 0x7f51800c5bd0 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44328/0 (socket says 172.21.15.45:44328) 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.592+0000 7f517dd9b640 1 -- 172.21.15.45:0/960107977 learned_addr learned my addr 172.21.15.45:0/960107977 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517e59c640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f51801edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517ed9d640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5180156490 0x7f518014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517dd9b640 1 -- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 msgr2=0x7f51801edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517dd9b640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f51801edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517dd9b640 1 -- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5180156490 msgr2=0x7f518014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517dd9b640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5180156490 0x7f518014ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.593+0000 7f517dd9b640 1 -- 172.21.15.45:0/960107977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5168009400 con 0x7f51800c6b70 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f517dd9b640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5168009890 tx=0x7f51680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516803bc30 con 0x7f51800c6b70 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516803bd90 con 0x7f51800c6b70 2023-12-08T08:19:46.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168045630 con 0x7f51800c6b70 2023-12-08T08:19:46.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518014f970 con 0x7f51800c6b70 2023-12-08T08:19:46.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.594+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180155a50 con 0x7f51800c6b70 2023-12-08T08:19:46.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.595+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5180155c40 con 0x7f51800c6b70 2023-12-08T08:19:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.596+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5168045790 con 0x7f51800c6b70 2023-12-08T08:19:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.597+0000 7f5176ffd640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.597+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f516802e070 con 0x7f51800c6b70 2023-12-08T08:19:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.598+0000 7f517e59c640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.598+0000 7f517e59c640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f51700012e0 tx=0x7f5170001990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.602+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5168076a40 con 0x7f51800c6b70 2023-12-08T08:19:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.840+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51800c7020 con 0x7f51800c6b70 2023-12-08T08:19:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.842+0000 7f5176ffd640 1 -- 172.21.15.45:0/960107977 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f516807a060 con 0x7f51800c6b70 2023-12-08T08:19:46.844 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:46.845 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.844+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 msgr2=0x7f516006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f51700012e0 tx=0x7f5170001990 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 msgr2=0x7f51800c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5168009890 tx=0x7f51680046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 shutdown_connections 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f516006ae40 0x7f516006d300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5180156490 0x7f518014ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51800c6b70 0x7f51800c7a10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 --2- 172.21.15.45:0/960107977 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f51800c5bd0 0x7f51801edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 >> 172.21.15.45:0/960107977 conn(0x7f51800a9770 msgr2=0x7f51800aca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 shutdown_connections 2023-12-08T08:19:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:46.845+0000 7f517f59e640 1 -- 172.21.15.45:0/960107977 wait complete. 2023-12-08T08:19:46.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.082+0000 7f885dabb640 1 Processor -- start 2023-12-08T08:19:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.082+0000 7f885dabb640 1 -- start start 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f885806d450 0x7f8858153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 0x7f8858150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8858151210 0x7f885814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8858151660 con 0x7f885806d450 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580a59a0 con 0x7f88580a5140 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885dabb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858150840 con 0x7f8858151210 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885cab9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f885806d450 0x7f8858153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885cab9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f885806d450 0x7f8858153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44336/0 (socket says 172.21.15.45:44336) 2023-12-08T08:19:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885cab9640 1 -- 172.21.15.45:0/593945596 learned_addr learned my addr 172.21.15.45:0/593945596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:47.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f885d2ba640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8858151210 0x7f885814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.084+0000 7f8857fff640 1 --2- 172.21.15.45:0/593945596 >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 0x7f8858150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f885cab9640 1 -- 172.21.15.45:0/593945596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8858151210 msgr2=0x7f885814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f885cab9640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8858151210 0x7f885814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f885cab9640 1 -- 172.21.15.45:0/593945596 >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 msgr2=0x7f8858150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f885cab9640 1 --2- 172.21.15.45:0/593945596 >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 0x7f8858150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f885cab9640 1 -- 172.21.15.45:0/593945596 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858154b40 con 0x7f885806d450 2023-12-08T08:19:47.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.085+0000 7f8857fff640 1 --2- 172.21.15.45:0/593945596 >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 0x7f8858150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:47.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.086+0000 7f885cab9640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885806d450 0x7f8858153bc0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f88580a8190 tx=0x7f884c02cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2a1d333d1f3ee2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.086+0000 7f88577fe640 1 -- 172.21.15.45:0/593945596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c02db00 con 0x7f885806d450 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.086+0000 7f88577fe640 1 -- 172.21.15.45:0/593945596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c02dc60 con 0x7f885806d450 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.086+0000 7f88577fe640 1 -- 172.21.15.45:0/593945596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c035440 con 0x7f885806d450 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 -- 172.21.15.45:0/593945596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885806d450 msgr2=0x7f8858153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885806d450 0x7f8858153bc0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f88580a8190 tx=0x7f884c02cd50 comp rx=0 tx=0).stop 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 -- 172.21.15.45:0/593945596 shutdown_connections 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 --2- 172.21.15.45:0/593945596 >> v2:172.21.15.114:3300/0 conn(0x7f88580a5140 0x7f8858150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8858151210 0x7f885814d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 --2- 172.21.15.45:0/593945596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885806d450 0x7f8858153bc0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 -- 172.21.15.45:0/593945596 >> 172.21.15.45:0/593945596 conn(0x7f88580c5780 msgr2=0x7f88580c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 -- 172.21.15.45:0/593945596 shutdown_connections 2023-12-08T08:19:47.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.087+0000 7f885dabb640 1 -- 172.21.15.45:0/593945596 wait complete. 2023-12-08T08:19:47.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.089+0000 7f885dabb640 1 Processor -- start 2023-12-08T08:19:47.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.089+0000 7f885dabb640 1 -- start start 2023-12-08T08:19:47.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f885806d450 0x7f885814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88580a5140 0x7f88581df470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581df050 con 0x7f8858151210 2023-12-08T08:19:47.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581dfef0 con 0x7f88580a5140 2023-12-08T08:19:47.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885dabb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580a4f10 con 0x7f885806d450 2023-12-08T08:19:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885d2ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885d2ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44352/0 (socket says 172.21.15.45:44352) 2023-12-08T08:19:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885d2ba640 1 -- 172.21.15.45:0/1832719514 learned_addr learned my addr 172.21.15.45:0/1832719514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.090+0000 7f885cab9640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f885806d450 0x7f885814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f8857fff640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88580a5140 0x7f88581df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 -- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f885806d450 msgr2=0x7f885814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f885806d450 0x7f885814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 -- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88580a5140 msgr2=0x7f88581df470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88580a5140 0x7f88581df470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 -- 172.21.15.45:0/1832719514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c00a670 con 0x7f8858151210 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885d2ba640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8850007e60 tx=0x7f885000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850014420 con 0x7f8858151210 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88500145a0 con 0x7f8858151210 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850014950 con 0x7f8858151210 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.091+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88581dac20 con 0x7f8858151210 2023-12-08T08:19:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.092+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581db1e0 con 0x7f8858151210 2023-12-08T08:19:47.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.093+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88581df190 con 0x7f8858151210 2023-12-08T08:19:47.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.093+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8850014ab0 con 0x7f8858151210 2023-12-08T08:19:47.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.094+0000 7f88557fa640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 0x7f883c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.095+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f885008a4e0 con 0x7f8858151210 2023-12-08T08:19:47.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.095+0000 7f885cab9640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 0x7f883c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.096+0000 7f885cab9640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 0x7f883c06d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f884c037000 tx=0x7f884c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.099+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88581df190 con 0x7f8858151210 2023-12-08T08:19:47.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.294+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88581df190 con 0x7f8858151210 2023-12-08T08:19:47.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.298+0000 7f88557fa640 1 -- 172.21.15.45:0/1832719514 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+20339 (secure 0 0 0) 0x7f88581df190 con 0x7f8858151210 2023-12-08T08:19:47.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:47.301 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:15.944914+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:47.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.300+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 msgr2=0x7f883c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.300+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 0x7f883c06d330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f884c037000 tx=0x7f884c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.300+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 msgr2=0x7f88581df9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.300+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8850007e60 tx=0x7f885000e4b0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.300+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 shutdown_connections 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f883c06ae70 0x7f883c06d330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858151210 0x7f88581df9b0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88580a5140 0x7f88581df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 --2- 172.21.15.45:0/1832719514 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f885806d450 0x7f885814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 >> 172.21.15.45:0/1832719514 conn(0x7f88580c5780 msgr2=0x7f88580c1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 shutdown_connections 2023-12-08T08:19:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.301+0000 7f885dabb640 1 -- 172.21.15.45:0/1832719514 wait complete. 2023-12-08T08:19:47.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:18:50.840681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:18:52.232940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:47.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:47.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.545+0000 7f82d1e25640 1 Processor -- start 2023-12-08T08:19:47.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.545+0000 7f82d1e25640 1 -- start start 2023-12-08T08:19:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.547+0000 7f82d1e25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82cc155e40 0x7f82cc1591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.547+0000 7f82d1e25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.547+0000 7f82d1e25640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc06d2d0 con 0x7f82cc0c5cb0 2023-12-08T08:19:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.547+0000 7f82d1e25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc1597a0 con 0x7f82cc155e40 2023-12-08T08:19:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.547+0000 7f82d1e25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc156220 con 0x7f82cc06ba10 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.548+0000 7f82cbfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.548+0000 7f82d0e23640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82cc155e40 0x7f82cc1591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.548+0000 7f82cbfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:60010/0 (socket says 172.21.15.45:60010) 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.548+0000 7f82cbfff640 1 -- 172.21.15.45:0/2752601944 learned_addr learned my addr 172.21.15.45:0/2752601944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.549+0000 7f82d0e23640 1 -- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 msgr2=0x7f82cc0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.549+0000 7f82d0e23640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.549+0000 7f82d0e23640 1 -- 172.21.15.45:0/2752601944 >> v1:172.21.15.114:6789/0 conn(0x7f82cc0c5cb0 legacy=0x7f82cc0c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.549+0000 7f82d0e23640 1 -- 172.21.15.45:0/2752601944 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0c5470 con 0x7f82cc155e40 2023-12-08T08:19:47.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.549+0000 7f82cbfff640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:47.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.550+0000 7f82d0e23640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc155e40 0x7f82cc1591c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097a0 tx=0x7f82c002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56ed1f6277c5a67 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82cb7fe640 1 -- 172.21.15.45:0/2752601944 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c002d040 con 0x7f82cc155e40 2023-12-08T08:19:47.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82cb7fe640 1 -- 172.21.15.45:0/2752601944 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0031810 con 0x7f82cc155e40 2023-12-08T08:19:47.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82cb7fe640 1 -- 172.21.15.45:0/2752601944 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031ba0 con 0x7f82cc155e40 2023-12-08T08:19:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 -- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc155e40 msgr2=0x7f82cc1591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc155e40 0x7f82cc1591c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097a0 tx=0x7f82c002b8b0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 -- 172.21.15.45:0/2752601944 shutdown_connections 2023-12-08T08:19:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc06ba10 0x7f82cc0c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2752601944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc155e40 0x7f82cc1591c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 -- 172.21.15.45:0/2752601944 >> 172.21.15.45:0/2752601944 conn(0x7f82cc066ce0 msgr2=0x7f82cc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.551+0000 7f82d1e25640 1 -- 172.21.15.45:0/2752601944 shutdown_connections 2023-12-08T08:19:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.552+0000 7f82d1e25640 1 -- 172.21.15.45:0/2752601944 wait complete. 2023-12-08T08:19:47.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.553+0000 7f82d1e25640 1 Processor -- start 2023-12-08T08:19:47.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.553+0000 7f82d1e25640 1 -- start start 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc0c5cb0 0x7f82cc0aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc155e40 0x7f82cc0a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0a27a0 con 0x7f82cc06ba10 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1ee1e0 con 0x7f82cc0c5cb0 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.554+0000 7f82d1e25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1ee4a0 con 0x7f82cc155e40 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44358/0 (socket says 172.21.15.45:44358) 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 -- 172.21.15.45:0/2656787054 learned_addr learned my addr 172.21.15.45:0/2656787054 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82cbfff640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc0c5cb0 0x7f82cc0aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d1624640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc155e40 0x7f82cc0a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 -- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc155e40 msgr2=0x7f82cc0a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc155e40 0x7f82cc0a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 -- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc0c5cb0 msgr2=0x7f82cc0aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc0c5cb0 0x7f82cc0aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.555+0000 7f82d0e23640 1 -- 172.21.15.45:0/2656787054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094d0 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82d0e23640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000c00 tx=0x7f82c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0006e10 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c003ad60 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0044630 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c0009400 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.556+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc1eea60 con 0x7f82cc06ba10 2023-12-08T08:19:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.557+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc0678c0 con 0x7f82cc06ba10 2023-12-08T08:19:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.558+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82c004d450 con 0x7f82cc06ba10 2023-12-08T08:19:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.559+0000 7f82c97fa640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 0x7f82b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.559+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6885+0+0 (secure 0 0 0) 0x7f82c00abb10 con 0x7f82cc06ba10 2023-12-08T08:19:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.560+0000 7f82cbfff640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 0x7f82b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.560+0000 7f82cbfff640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 0x7f82b006d300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0a6060 tx=0x7f82b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.564+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82c0076710 con 0x7f82cc06ba10 2023-12-08T08:19:47.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.758+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82cc0c5470 con 0x7f82cc06ba10 2023-12-08T08:19:47.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.763+0000 7f82c97fa640 1 -- 172.21.15.45:0/2656787054 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82cc0c5470 con 0x7f82cc06ba10 2023-12-08T08:19:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:47.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 msgr2=0x7f82b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 0x7f82b006d300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0a6060 tx=0x7f82b8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 msgr2=0x7f82cc0a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000c00 tx=0x7f82c00046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 shutdown_connections 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f82b006ae40 0x7f82b006d300 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f82cc155e40 0x7f82cc0a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82cc0c5cb0 0x7f82cc0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 --2- 172.21.15.45:0/2656787054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82cc06ba10 0x7f82cc0a2260 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 >> 172.21.15.45:0/2656787054 conn(0x7f82cc066ce0 msgr2=0x7f82cc0a53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.766+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 shutdown_connections 2023-12-08T08:19:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:47.767+0000 7f82d1e25640 1 -- 172.21.15.45:0/2656787054 wait complete. 2023-12-08T08:19:47.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.004+0000 7fa9ebfff640 1 Processor -- start 2023-12-08T08:19:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.004+0000 7fa9ebfff640 1 -- start start 2023-12-08T08:19:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.005+0000 7fa9ebfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9ec14c280 0x7fa9ec0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9ebfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec0c60c0 con 0x7fa9ec155790 2023-12-08T08:19:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9ebfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec152dc0 con 0x7fa9ec0c4970 2023-12-08T08:19:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9ebfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec1521d0 con 0x7fa9ec14c280 2023-12-08T08:19:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9eb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa9ec155790 0x7fa9ec155ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51466/0 (socket says 172.21.15.45:51466) 2023-12-08T08:19:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9eb7fe640 1 -- 172.21.15.45:0/4041800455 learned_addr learned my addr 172.21.15.45:0/4041800455 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:48.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/4041800455 >> v2:172.21.15.114:3300/0 conn(0x7fa9ec14c280 0x7fa9ec0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275697410 0 0) 0x7fa9e4001110 con 0x7fa9ec155790 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.006+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d8003520 con 0x7fa9ec155790 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979049039 0 0) 0x7fa9d8003520 con 0x7fa9ec155790 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 >> v2:172.21.15.114:3300/0 conn(0x7fa9ec14c280 msgr2=0x7fa9ec0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 --2- 172.21.15.45:0/4041800455 >> v2:172.21.15.114:3300/0 conn(0x7fa9ec14c280 0x7fa9ec0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 >> v1:172.21.15.114:6789/0 conn(0x7fa9ec0c4970 legacy=0x7fa9ec06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec14c660 con 0x7fa9ec155790 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fa9e4001800 con 0x7fa9ec155790 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 >> v1:172.21.15.45:6789/0 conn(0x7fa9ec155790 legacy=0x7fa9ec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80047c0 0x7fa9d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9d80051d0 0x7fa9d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec1521d0 con 0x7fa9d80039c0 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d800c120 con 0x7fa9d80047c0 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d800c2e0 con 0x7fa9d80051d0 2023-12-08T08:19:48.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.007+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eaffd640 1 -- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9d80051d0 msgr2=0x7fa9d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9d80051d0 0x7fa9d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eaffd640 1 -- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80047c0 msgr2=0x7fa9d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80047c0 0x7fa9d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eaffd640 1 -- 172.21.15.45:0/4041800455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8003520 con 0x7fa9d80039c0 2023-12-08T08:19:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.008+0000 7fa9eb7fe640 1 -- 172.21.15.45:0/4041800455 reap_dead start 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.009+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9d8003de0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009a90 tx=0x7fa9d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca6a61daf2ed4b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.009+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc02c680 con 0x7fa9d80039c0 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.009+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc02c7e0 con 0x7fa9d80039c0 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.009+0000 7fa9e9ffb640 1 -- 172.21.15.45:0/4041800455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc02cb70 con 0x7fa9d80039c0 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 -- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 msgr2=0x7fa9d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9d8003de0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009a90 tx=0x7fa9d80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 -- 172.21.15.45:0/4041800455 shutdown_connections 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/4041800455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9d8003de0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 -- 172.21.15.45:0/4041800455 >> 172.21.15.45:0/4041800455 conn(0x7fa9ec066ce0 msgr2=0x7fa9ec0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 -- 172.21.15.45:0/4041800455 shutdown_connections 2023-12-08T08:19:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.010+0000 7fa9ebfff640 1 -- 172.21.15.45:0/4041800455 wait complete. 2023-12-08T08:19:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.012+0000 7fa9ebfff640 1 Processor -- start 2023-12-08T08:19:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.012+0000 7fa9ebfff640 1 -- start start 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9ec145ad0 0x7fa9ec0a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9ec150bc0 0x7fa9ec151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec145960 con 0x7fa9d80039c0 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec1edf00 con 0x7fa9ec145ad0 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ebfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec1ee430 con 0x7fa9ec150bc0 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44372/0 (socket says 172.21.15.45:44372) 2023-12-08T08:19:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 -- 172.21.15.45:0/1533790945 learned_addr learned my addr 172.21.15.45:0/1533790945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9ea7fc640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9ec145ad0 0x7fa9ec0a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 -- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9ec150bc0 msgr2=0x7fa9ec151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9ec150bc0 0x7fa9ec151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 -- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9ec145ad0 msgr2=0x7fa9ec0a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9ec145ad0 0x7fa9ec0a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.013+0000 7fa9eaffd640 1 -- 172.21.15.45:0/1533790945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec14ba60 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9eaffd640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009bb0 tx=0x7fa9dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc003810 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc003970 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc003d00 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec1ee150 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.014+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec14af70 con 0x7fa9d80039c0 2023-12-08T08:19:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.016+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec0678c0 con 0x7fa9d80039c0 2023-12-08T08:19:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.016+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9dc034440 con 0x7fa9d80039c0 2023-12-08T08:19:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.017+0000 7fa9e37fe640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 0x7fa9cc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.017+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7030+0+0 (secure 0 0 0) 0x7fa9dc0ab900 con 0x7fa9d80039c0 2023-12-08T08:19:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.018+0000 7fa9ea7fc640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 0x7fa9cc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.019+0000 7fa9ea7fc640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 0x7fa9cc06d380 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0a75a0 tx=0x7fa9d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.022+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9dc0766c0 con 0x7fa9d80039c0 2023-12-08T08:19:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.216+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9ec0743e0 con 0x7fa9d80039c0 2023-12-08T08:19:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.216+0000 7fa9e37fe640 1 -- 172.21.15.45:0/1533790945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9dc079ce0 con 0x7fa9d80039c0 2023-12-08T08:19:48.219 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 msgr2=0x7fa9cc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 0x7fa9cc06d380 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0a75a0 tx=0x7fa9d4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 msgr2=0x7fa9ec146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009bb0 tx=0x7fa9dc004730 comp rx=0 tx=0).stop 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 shutdown_connections 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa9cc06aec0 0x7fa9cc06d380 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa9ec150bc0 0x7fa9ec151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9ec145ad0 0x7fa9ec0a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 --2- 172.21.15.45:0/1533790945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9d80039c0 0x7fa9ec146020 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 >> 172.21.15.45:0/1533790945 conn(0x7fa9ec066ce0 msgr2=0x7fa9ec146690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 shutdown_connections 2023-12-08T08:19:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.219+0000 7fa9ebfff640 1 -- 172.21.15.45:0/1533790945 wait complete. 2023-12-08T08:19:48.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.466+0000 7f501486a640 1 Processor -- start 2023-12-08T08:19:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.466+0000 7f501486a640 1 -- start start 2023-12-08T08:19:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.467+0000 7f501486a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5010151ec0 0x7f50100c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.467+0000 7f501486a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50100c4d30 0x7f501006c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.467+0000 7f501486a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100c16b0 con 0x7f50100c1d60 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.467+0000 7f501486a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50100a8b30 con 0x7f50100c4d30 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.467+0000 7f501486a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50100c65d0 con 0x7f5010151ec0 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50100c4d30 0x7f501006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50100c4d30 0x7f501006c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44380/0 (socket says 172.21.15.45:44380) 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 -- 172.21.15.45:0/2195884500 learned_addr learned my addr 172.21.15.45:0/2195884500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500ed9d640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5010151ec0 0x7f50100c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 -- 172.21.15.45:0/2195884500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5010151ec0 msgr2=0x7f50100c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5010151ec0 0x7f50100c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 -- 172.21.15.45:0/2195884500 >> v1:172.21.15.114:6789/0 conn(0x7f50100c1d60 legacy=0x7f501006ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.468+0000 7f500f59e640 1 -- 172.21.15.45:0/2195884500 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100c5810 con 0x7f50100c4d30 2023-12-08T08:19:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.470+0000 7f500f59e640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50100c4d30 0x7f501006c120 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f500800bb10 tx=0x7f500802e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cdfc644db318f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f500dd9b640 1 -- 172.21.15.45:0/2195884500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500802ede0 con 0x7f50100c4d30 2023-12-08T08:19:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f500dd9b640 1 -- 172.21.15.45:0/2195884500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008036440 con 0x7f50100c4d30 2023-12-08T08:19:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f500dd9b640 1 -- 172.21.15.45:0/2195884500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080367d0 con 0x7f50100c4d30 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 -- 172.21.15.45:0/2195884500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50100c4d30 msgr2=0x7f501006c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50100c4d30 0x7f501006c120 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f500800bb10 tx=0x7f500802e030 comp rx=0 tx=0).stop 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 -- 172.21.15.45:0/2195884500 shutdown_connections 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50100c4d30 0x7f501006c120 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 --2- 172.21.15.45:0/2195884500 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5010151ec0 0x7f50100c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.471+0000 7f501486a640 1 -- 172.21.15.45:0/2195884500 >> 172.21.15.45:0/2195884500 conn(0x7f5010066ce0 msgr2=0x7f50100a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.472+0000 7f501486a640 1 -- 172.21.15.45:0/2195884500 shutdown_connections 2023-12-08T08:19:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.472+0000 7f501486a640 1 -- 172.21.15.45:0/2195884500 wait complete. 2023-12-08T08:19:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.473+0000 7f501486a640 1 Processor -- start 2023-12-08T08:19:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.473+0000 7f501486a640 1 -- start start 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50100c1d60 0x7f50100c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50100c4d30 0x7f5010071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501014bb20 con 0x7f5010151ec0 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50101ea680 con 0x7f50100c1d60 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.474+0000 7f501486a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50101ea960 con 0x7f50100c4d30 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44396/0 (socket says 172.21.15.45:44396) 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 -- 172.21.15.45:0/1747881821 learned_addr learned my addr 172.21.15.45:0/1747881821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500ed9d640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50100c1d60 0x7f50100c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500e59c640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50100c4d30 0x7f5010071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 -- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50100c4d30 msgr2=0x7f5010071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50100c4d30 0x7f5010071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 -- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50100c1d60 msgr2=0x7f50100c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50100c1d60 0x7f50100c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.475+0000 7f500f59e640 1 -- 172.21.15.45:0/1747881821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500800b770 con 0x7f5010151ec0 2023-12-08T08:19:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f500f59e640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f500802e070 tx=0x7f50080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008041640 con 0x7f5010151ec0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50080417a0 con 0x7f5010151ec0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008041b50 con 0x7f5010151ec0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50100725a0 con 0x7f5010151ec0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.476+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50100c4280 con 0x7f5010151ec0 2023-12-08T08:19:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.477+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50100c6090 con 0x7f5010151ec0 2023-12-08T08:19:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.478+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50080403e0 con 0x7f5010151ec0 2023-12-08T08:19:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.479+0000 7f50077fe640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 0x7f4ff006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.480+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f50080ac090 con 0x7f5010151ec0 2023-12-08T08:19:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.480+0000 7f500ed9d640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 0x7f4ff006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.480+0000 7f500ed9d640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 0x7f4ff006d350 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5000009a60 tx=0x7f5000003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.484+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50100c6090 con 0x7f5010151ec0 2023-12-08T08:19:48.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.677+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50100c6090 con 0x7f5010151ec0 2023-12-08T08:19:48.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.678+0000 7f50077fe640 1 -- 172.21.15.45:0/1747881821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50100c6090 con 0x7f5010151ec0 2023-12-08T08:19:48.681 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.680+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 msgr2=0x7f4ff006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.680+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 0x7f4ff006d350 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5000009a60 tx=0x7f5000003990 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.680+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 msgr2=0x7f5010144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.680+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f500802e070 tx=0x7f50080046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 shutdown_connections 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ff006ae90 0x7f4ff006d350 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f50100c4d30 0x7f5010071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5010151ec0 0x7f5010144950 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 --2- 172.21.15.45:0/1747881821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50100c1d60 0x7f50100c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 >> 172.21.15.45:0/1747881821 conn(0x7f5010066ce0 msgr2=0x7f501006ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 shutdown_connections 2023-12-08T08:19:48.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.681+0000 7f501486a640 1 -- 172.21.15.45:0/1747881821 wait complete. 2023-12-08T08:19:48.701 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.921+0000 7f3febfff640 1 Processor -- start 2023-12-08T08:19:48.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.921+0000 7f3febfff640 1 -- start start 2023-12-08T08:19:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.922+0000 7f3febfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fec0c4970 0x7f3fec0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.922+0000 7f3febfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0c60c0 con 0x7f3fec14c280 2023-12-08T08:19:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.922+0000 7f3febfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec152dc0 con 0x7f3fec155790 2023-12-08T08:19:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.922+0000 7f3febfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec1521d0 con 0x7f3fec0c4970 2023-12-08T08:19:48.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3feaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3fec14c280 0x7f3fec06cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51478/0 (socket says 172.21.15.45:51478) 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3feaffd640 1 -- 172.21.15.45:0/3724526012 learned_addr learned my addr 172.21.15.45:0/3724526012 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fea7fc640 1 --2- 172.21.15.45:0/3724526012 >> v2:172.21.15.45:3300/0 conn(0x7f3fec0c4970 0x7f3fec0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fe9ffb640 1 -- 172.21.15.45:0/3724526012 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465000494 0 0) 0x7f3fdc001110 con 0x7f3fec14c280 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fe9ffb640 1 -- 172.21.15.45:0/3724526012 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd8003520 con 0x7f3fec14c280 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fea7fc640 1 -- 172.21.15.45:0/3724526012 >> v1:172.21.15.114:6789/0 conn(0x7f3fec155790 legacy=0x7f3fec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fea7fc640 1 -- 172.21.15.45:0/3724526012 >> v1:172.21.15.45:6789/0 conn(0x7f3fec14c280 legacy=0x7f3fec06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.923+0000 7f3fea7fc640 1 -- 172.21.15.45:0/3724526012 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec14c660 con 0x7f3fec0c4970 2023-12-08T08:19:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.925+0000 7f3fea7fc640 1 --2- 172.21.15.45:0/3724526012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec0c4970 0x7f3fec0a4d10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009d90 tx=0x7f3fd402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaa672fda12d9ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.925+0000 7f3fe9ffb640 1 -- 172.21.15.45:0/3724526012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd402cbd0 con 0x7f3fec0c4970 2023-12-08T08:19:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.925+0000 7f3fe9ffb640 1 -- 172.21.15.45:0/3724526012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd402cd30 con 0x7f3fec0c4970 2023-12-08T08:19:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.925+0000 7f3fe9ffb640 1 -- 172.21.15.45:0/3724526012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd402cea0 con 0x7f3fec0c4970 2023-12-08T08:19:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 -- 172.21.15.45:0/3724526012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec0c4970 msgr2=0x7f3fec0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 --2- 172.21.15.45:0/3724526012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec0c4970 0x7f3fec0a4d10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009d90 tx=0x7f3fd402be20 comp rx=0 tx=0).stop 2023-12-08T08:19:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 -- 172.21.15.45:0/3724526012 shutdown_connections 2023-12-08T08:19:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 --2- 172.21.15.45:0/3724526012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec0c4970 0x7f3fec0a4d10 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 -- 172.21.15.45:0/3724526012 >> 172.21.15.45:0/3724526012 conn(0x7f3fec066ce0 msgr2=0x7f3fec0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 -- 172.21.15.45:0/3724526012 shutdown_connections 2023-12-08T08:19:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.926+0000 7f3febfff640 1 -- 172.21.15.45:0/3724526012 wait complete. 2023-12-08T08:19:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.927+0000 7f3febfff640 1 Processor -- start 2023-12-08T08:19:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 -- start start 2023-12-08T08:19:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fec0c4970 0x7f3fec0c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fec14c280 0x7f3fec142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0aa600 con 0x7f3fec155790 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.928+0000 7f3febfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0a93b0 con 0x7f3fec0c4970 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3febfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec143550 con 0x7f3fec14c280 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44412/0 (socket says 172.21.15.45:44412) 2023-12-08T08:19:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 -- 172.21.15.45:0/2740617813 learned_addr learned my addr 172.21.15.45:0/2740617813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3fea7fc640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fec14c280 0x7f3fec142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feaffd640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fec0c4970 0x7f3fec0c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 -- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fec14c280 msgr2=0x7f3fec142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fec14c280 0x7f3fec142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 -- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fec0c4970 msgr2=0x7f3fec0c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fec0c4970 0x7f3fec0c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.929+0000 7f3feb7fe640 1 -- 172.21.15.45:0/2740617813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009a70 con 0x7f3fec155790 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3feb7fe640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c410 tx=0x7f3fe400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4011790 con 0x7f3fec155790 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe40118f0 con 0x7f3fec155790 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4011ce0 con 0x7f3fec155790 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec0a8b10 con 0x7f3fec155790 2023-12-08T08:19:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.930+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0a90d0 con 0x7f3fec155790 2023-12-08T08:19:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.931+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec154480 con 0x7f3fec155790 2023-12-08T08:19:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.932+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fe401c460 con 0x7f3fec155790 2023-12-08T08:19:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.933+0000 7f3fe37fe640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 0x7f3fcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.933+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f3fe4089860 con 0x7f3fec155790 2023-12-08T08:19:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.934+0000 7f3feaffd640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 0x7f3fcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.934+0000 7f3feaffd640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 0x7f3fcc06d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc001370 tx=0x7f3fdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:48.938+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fec154480 con 0x7f3fec155790 2023-12-08T08:19:49.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.128+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fec154480 con 0x7f3fec155790 2023-12-08T08:19:49.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.129+0000 7f3fe37fe640 1 -- 172.21.15.45:0/2740617813 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v85) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3fec154480 con 0x7f3fec155790 2023-12-08T08:19:49.132 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.131+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 msgr2=0x7f3fcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.131+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 0x7f3fcc06d330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc001370 tx=0x7f3fdc009040 comp rx=0 tx=0).stop 2023-12-08T08:19:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.131+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 msgr2=0x7f3fec143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.131+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c410 tx=0x7f3fe400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 shutdown_connections 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3fcc06ae70 0x7f3fcc06d330 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3fec14c280 0x7f3fec142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fec155790 0x7f3fec143010 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 --2- 172.21.15.45:0/2740617813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fec0c4970 0x7f3fec0c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 >> 172.21.15.45:0/2740617813 conn(0x7f3fec066ce0 msgr2=0x7f3fec150c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 shutdown_connections 2023-12-08T08:19:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.132+0000 7f3febfff640 1 -- 172.21.15.45:0/2740617813 wait complete. 2023-12-08T08:19:49.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.379+0000 7fdd4cc94640 1 Processor -- start 2023-12-08T08:19:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.379+0000 7fdd4cc94640 1 -- start start 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd4cc94640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 0x7fdd480c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd4cc94640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48152660 con 0x7fdd480c1930 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd4cc94640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48153200 con 0x7fdd4806d960 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd4cc94640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a4d10 con 0x7fdd480aaf60 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd46d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd480c1930 0x7fdd4815cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51484/0 (socket says 172.21.15.45:51484) 2023-12-08T08:19:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.381+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2609940818 learned_addr learned my addr 172.21.15.45:0/2609940818 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 0x7fdd480c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084805365 0 0) 0x7fdd48152660 con 0x7fdd480c1930 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd34003520 con 0x7fdd480c1930 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145499971 0 0) 0x7fdd34003520 con 0x7fdd480c1930 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 msgr2=0x7fdd480c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 0x7fdd480c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 >> v1:172.21.15.114:6789/0 conn(0x7fdd4806d960 legacy=0x7fdd48152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480c3310 con 0x7fdd480c1930 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdd40001670 con 0x7fdd480c1930 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 >> v1:172.21.15.45:6789/0 conn(0x7fdd480c1930 legacy=0x7fdd4815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd340039a0 0x7fdd34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.382+0000 7fdd4559a640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340047c0 0x7fdd34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4559a640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 0x7fdd34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a4d10 con 0x7fdd340039a0 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3400bb10 con 0x7fdd340047c0 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3400bcd0 con 0x7fdd480aaf60 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd340039a0 0x7fdd34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 -- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 msgr2=0x7fdd34005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd480aaf60 0x7fdd34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 -- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340047c0 msgr2=0x7fdd34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340047c0 0x7fdd34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.383+0000 7fdd4659c640 1 -- 172.21.15.45:0/2609940818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34003520 con 0x7fdd340039a0 2023-12-08T08:19:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.384+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd340039a0 0x7fdd34003dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009ac0 tx=0x7fdd340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc579cc5868fd418 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3802c710 con 0x7fdd340039a0 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3802c870 con 0x7fdd340039a0 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4559a640 1 -- 172.21.15.45:0/2609940818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3802cc00 con 0x7fdd340039a0 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2609940818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd340039a0 msgr2=0x7fdd34003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2609940818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd340039a0 0x7fdd34003dc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009ac0 tx=0x7fdd340057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2609940818 reap_dead start 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2609940818 shutdown_connections 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2609940818 >> 172.21.15.45:0/2609940818 conn(0x7fdd480c2430 msgr2=0x7fdd480c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2609940818 shutdown_connections 2023-12-08T08:19:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.385+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2609940818 wait complete. 2023-12-08T08:19:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.387+0000 7fdd4cc94640 1 Processor -- start 2023-12-08T08:19:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.387+0000 7fdd4cc94640 1 -- start start 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 0x7fdd48071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd481df230 0x7fdd481eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481552e0 con 0x7fdd481edfd0 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4806d770 con 0x7fdd340039a0 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd4cc94640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481546b0 con 0x7fdd481df230 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44442/0 (socket says 172.21.15.45:44442) 2023-12-08T08:19:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.388+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2970399465 learned_addr learned my addr 172.21.15.45:0/2970399465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 0x7fdd48071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd481df230 msgr2=0x7fdd481eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd45d9b640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd481df230 0x7fdd481eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd481df230 0x7fdd481eda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 msgr2=0x7fdd48071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 0x7fdd48071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 -- 172.21.15.45:0/2970399465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd481ed320 con 0x7fdd481edfd0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 0x7fdd48071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd46d9d640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fdd4806fa50 tx=0x7fdd4000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.389+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400074e0 con 0x7fdd481edfd0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.390+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40007640 con 0x7fdd481edfd0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.390+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48153e10 con 0x7fdd481edfd0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.390+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40004a00 con 0x7fdd481edfd0 2023-12-08T08:19:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.390+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd481543d0 con 0x7fdd481edfd0 2023-12-08T08:19:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.391+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd480c5570 con 0x7fdd481edfd0 2023-12-08T08:19:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.392+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd40004b60 con 0x7fdd481edfd0 2023-12-08T08:19:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.393+0000 7fdd3effd640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 0x7fdd2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.393+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7fdd400897b0 con 0x7fdd481edfd0 2023-12-08T08:19:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.393+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 0x7fdd2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.394+0000 7fdd4659c640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 0x7fdd2806d300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009ac0 tx=0x7fdd38030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.397+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd400543e0 con 0x7fdd481edfd0 2023-12-08T08:19:49.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.590+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fdd48074670 con 0x7fdd481edfd0 2023-12-08T08:19:49.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.591+0000 7fdd3effd640 1 -- 172.21.15.45:0/2970399465 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v85) v1 ==== 101+0+11 (secure 0 0 0) 0x7fdd40057a00 con 0x7fdd481edfd0 2023-12-08T08:19:49.594 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 msgr2=0x7fdd2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 0x7fdd2806d300 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009ac0 tx=0x7fdd38030000 comp rx=0 tx=0).stop 2023-12-08T08:19:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 msgr2=0x7fdd480bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fdd4806fa50 tx=0x7fdd4000c900 comp rx=0 tx=0).stop 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 shutdown_connections 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.593+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdd2806ae40 0x7fdd2806d300 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdd481df230 0x7fdd481eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd481edfd0 0x7fdd480bed60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 --2- 172.21.15.45:0/2970399465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd340039a0 0x7fdd48071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 >> 172.21.15.45:0/2970399465 conn(0x7fdd480c2430 msgr2=0x7fdd480c0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 shutdown_connections 2023-12-08T08:19:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.594+0000 7fdd4cc94640 1 -- 172.21.15.45:0/2970399465 wait complete. 2023-12-08T08:19:49.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.844+0000 7f59ac47c640 1 Processor -- start 2023-12-08T08:19:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.845+0000 7f59ac47c640 1 -- start start 2023-12-08T08:19:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.846+0000 7f59ac47c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59a415c220 0x7f59a415c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.846+0000 7f59ac47c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a41560a0 0x7f59a415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.846+0000 7f59ac47c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a406d230 con 0x7f59a4155bf0 2023-12-08T08:19:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.846+0000 7f59ac47c640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a40c6090 con 0x7f59a415c220 2023-12-08T08:19:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.846+0000 7f59ac47c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40c46c0 con 0x7f59a41560a0 2023-12-08T08:19:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.847+0000 7f59aa218640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59a415c220 0x7f59a415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.847+0000 7f59aa218640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59a415c220 0x7f59a415c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:49316/0 (socket says 172.21.15.45:49316) 2023-12-08T08:19:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.847+0000 7f59aa218640 1 -- 172.21.15.45:0/648867658 learned_addr learned my addr 172.21.15.45:0/648867658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.847+0000 7f59aaa19640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a41560a0 0x7f59a415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59a9216640 1 -- 172.21.15.45:0/648867658 <== mon.1 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195045666 0 0) 0x7f59a406d230 con 0x7f59a4155bf0 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59a9216640 1 -- 172.21.15.45:0/648867658 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5994003520 con 0x7f59a4155bf0 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59aa218640 1 -- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a41560a0 msgr2=0x7f59a415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59aa218640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a41560a0 0x7f59a415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59aa218640 1 -- 172.21.15.45:0/648867658 >> v1:172.21.15.114:6789/0 conn(0x7f59a4155bf0 legacy=0x7f59a4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.848+0000 7f59aa218640 1 -- 172.21.15.45:0/648867658 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a406d480 con 0x7f59a415c220 2023-12-08T08:19:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.849+0000 7f59aa218640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a415c220 0x7f59a415c600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa7f2dcb7d3bd6b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59a9216640 1 -- 172.21.15.45:0/648867658 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998031640 con 0x7f59a415c220 2023-12-08T08:19:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59a9216640 1 -- 172.21.15.45:0/648867658 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59980317a0 con 0x7f59a415c220 2023-12-08T08:19:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59a9216640 1 -- 172.21.15.45:0/648867658 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5998031b10 con 0x7f59a415c220 2023-12-08T08:19:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 -- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a415c220 msgr2=0x7f59a415c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a415c220 0x7f59a415c600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 -- 172.21.15.45:0/648867658 shutdown_connections 2023-12-08T08:19:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a41560a0 0x7f59a415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 --2- 172.21.15.45:0/648867658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a415c220 0x7f59a415c600 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.850+0000 7f59ac47c640 1 -- 172.21.15.45:0/648867658 >> 172.21.15.45:0/648867658 conn(0x7f59a40661f0 msgr2=0x7f59a4066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.851+0000 7f59ac47c640 1 -- 172.21.15.45:0/648867658 shutdown_connections 2023-12-08T08:19:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.851+0000 7f59ac47c640 1 -- 172.21.15.45:0/648867658 wait complete. 2023-12-08T08:19:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.852+0000 7f59ac47c640 1 Processor -- start 2023-12-08T08:19:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.852+0000 7f59ac47c640 1 -- start start 2023-12-08T08:19:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 0x7f59a4151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a41560a0 0x7f59a41523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40a4f80 con 0x7f59a415c220 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a41597d0 con 0x7f59a41560a0 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.853+0000 7f59ac47c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40a4ca0 con 0x7f59a4155bf0 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44454/0 (socket says 172.21.15.45:44454) 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 -- 172.21.15.45:0/4261850376 learned_addr learned my addr 172.21.15.45:0/4261850376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59a9a17640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a41560a0 0x7f59a41523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aa218640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 0x7f59a4151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 -- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 msgr2=0x7f59a4151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 0x7f59a4151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 -- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a41560a0 msgr2=0x7f59a41523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a41560a0 0x7f59a41523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aaa19640 1 -- 172.21.15.45:0/4261850376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980094d0 con 0x7f59a415c220 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.854+0000 7f59aa218640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 0x7f59a4151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59aaa19640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e930 tx=0x7f599c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c009690 con 0x7f59a415c220 2023-12-08T08:19:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00c980 con 0x7f59a415c220 2023-12-08T08:19:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00cd30 con 0x7f59a415c220 2023-12-08T08:19:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a41f2400 con 0x7f59a415c220 2023-12-08T08:19:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.855+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a406fae0 con 0x7f59a415c220 2023-12-08T08:19:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.856+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a406fd00 con 0x7f59a415c220 2023-12-08T08:19:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.857+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f599c013470 con 0x7f59a415c220 2023-12-08T08:19:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.858+0000 7f59a2ffd640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 0x7f598806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.858+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f599c089d00 con 0x7f59a415c220 2023-12-08T08:19:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.859+0000 7f59aa218640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 0x7f598806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.859+0000 7f59aa218640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 0x7f598806d300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5998036000 tx=0x7f5998008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:49.862+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f599c0549d0 con 0x7f59a415c220 2023-12-08T08:19:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.093+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59a40c59a0 con 0x7f59a415c220 2023-12-08T08:19:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.094+0000 7f59a2ffd640 1 -- 172.21.15.45:0/4261850376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f599c017090 con 0x7f59a415c220 2023-12-08T08:19:50.098 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:50.098 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:50.098 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 msgr2=0x7f598806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 0x7f598806d300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5998036000 tx=0x7f5998008030 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 msgr2=0x7f59a4071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e930 tx=0x7f599c00edf0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 shutdown_connections 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f598806ae40 0x7f598806d300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59a415c220 0x7f59a4071f60 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59a41560a0 0x7f59a41523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 --2- 172.21.15.45:0/4261850376 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f59a4155bf0 0x7f59a4151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.097+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 >> 172.21.15.45:0/4261850376 conn(0x7f59a40661f0 msgr2=0x7f59a40a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.098+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 shutdown_connections 2023-12-08T08:19:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.098+0000 7f59ac47c640 1 -- 172.21.15.45:0/4261850376 wait complete. 2023-12-08T08:19:50.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:50.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.342+0000 7fd9f9b83640 1 Processor -- start 2023-12-08T08:19:50.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.343+0000 7fd9f9b83640 1 -- start start 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.344+0000 7fd9f9b83640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9f40a7910 0x7fd9f40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.344+0000 7fd9f9b83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9f414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.344+0000 7fd9f9b83640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4155850 con 0x7fd9f41521b0 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.344+0000 7fd9f9b83640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40c0890 con 0x7fd9f40a7910 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.344+0000 7fd9f9b83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c0b70 con 0x7fd9f40c1dc0 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f9382640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9f41521b0 0x7fd9f4155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51490/0 (socket says 172.21.15.45:51490) 2023-12-08T08:19:50.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f9382640 1 -- 172.21.15.45:0/2972631871 learned_addr learned my addr 172.21.15.45:0/2972631871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f3fff640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9f414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/2972631871 >> v2:172.21.15.114:3300/0 conn(0x7fd9f40a7910 0x7fd9f40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190745678 0 0) 0x7fd9f4155850 con 0x7fd9f41521b0 2023-12-08T08:19:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e0003520 con 0x7fd9f41521b0 2023-12-08T08:19:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446984157 0 0) 0x7fd9e0003520 con 0x7fd9f41521b0 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 msgr2=0x7fd9f414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9f414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 >> v2:172.21.15.114:3300/0 conn(0x7fd9f40a7910 msgr2=0x7fd9f40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 --2- 172.21.15.45:0/2972631871 >> v2:172.21.15.114:3300/0 conn(0x7fd9f40a7910 0x7fd9f40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.345+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40c0e50 con 0x7fd9f41521b0 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fd9ec001670 con 0x7fd9f41521b0 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 >> v1:172.21.15.45:6789/0 conn(0x7fd9f41521b0 legacy=0x7fd9f4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e0003970 0x7fd9e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0004d00 0x7fd9e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c0890 con 0x7fd9e0003970 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c0b70 con 0x7fd9e0004d00 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e000b980 con 0x7fd9f40c1dc0 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e0003970 0x7fd9e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f9382640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0004d00 0x7fd9e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f8b81640 1 -- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 msgr2=0x7fd9e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f3fff640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.346+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f40c1dc0 0x7fd9e00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.347+0000 7fd9f8b81640 1 -- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0004d00 msgr2=0x7fd9e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.347+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0004d00 0x7fd9e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.347+0000 7fd9f8b81640 1 -- 172.21.15.45:0/2972631871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0003520 con 0x7fd9e0003970 2023-12-08T08:19:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.347+0000 7fd9f9382640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0004d00 0x7fd9e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.348+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e0003970 0x7fd9e0003d90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009fc0 tx=0x7fd9e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d575cb23fb038fda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.348+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e402cc60 con 0x7fd9e0003970 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.348+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e400f040 con 0x7fd9e0003970 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.348+0000 7fd9f37fe640 1 -- 172.21.15.45:0/2972631871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4034440 con 0x7fd9e0003970 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 -- 172.21.15.45:0/2972631871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e0003970 msgr2=0x7fd9e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/2972631871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e0003970 0x7fd9e0003d90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009fc0 tx=0x7fd9e00057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9382640 1 -- 172.21.15.45:0/2972631871 reap_dead start 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 -- 172.21.15.45:0/2972631871 shutdown_connections 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 -- 172.21.15.45:0/2972631871 >> 172.21.15.45:0/2972631871 conn(0x7fd9f40c5780 msgr2=0x7fd9f40c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 -- 172.21.15.45:0/2972631871 shutdown_connections 2023-12-08T08:19:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.349+0000 7fd9f9b83640 1 -- 172.21.15.45:0/2972631871 wait complete. 2023-12-08T08:19:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.351+0000 7fd9f9b83640 1 Processor -- start 2023-12-08T08:19:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.351+0000 7fd9f9b83640 1 -- start start 2023-12-08T08:19:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0003970 0x7fd9f414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f414c040 0x7fd9f414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41509c0 con 0x7fd9f40bf570 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f414d280 con 0x7fd9e0003970 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9b83640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f41ea540 con 0x7fd9f414c040 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44472/0 (socket says 172.21.15.45:44472) 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f3fff640 1 -- 172.21.15.45:0/783707398 learned_addr learned my addr 172.21.15.45:0/783707398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0003970 0x7fd9f414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f9382640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f414c040 0x7fd9f414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.352+0000 7fd9f3fff640 1 -- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f414c040 msgr2=0x7fd9f414c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f3fff640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f414c040 0x7fd9f414c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f3fff640 1 -- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0003970 msgr2=0x7fd9f414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f3fff640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0003970 0x7fd9f414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f3fff640 1 -- 172.21.15.45:0/783707398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f41ea7b0 con 0x7fd9f40bf570 2023-12-08T08:19:50.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f3fff640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc010890 tx=0x7fd9dc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0095b0 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00eb80 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc01c400 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f40a5630 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.353+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f41504b0 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.355+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f40a5490 con 0x7fd9f40bf570 2023-12-08T08:19:50.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.355+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9dc0143f0 con 0x7fd9f40bf570 2023-12-08T08:19:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.356+0000 7fd9f17fa640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.357+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7fd9dc089cc0 con 0x7fd9f40bf570 2023-12-08T08:19:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.357+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.358+0000 7fd9f8b81640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 0x7fd9d406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4036000 tx=0x7fd9e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.361+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9f40a5490 con 0x7fd9f40bf570 2023-12-08T08:19:50.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.554+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9f40a5490 con 0x7fd9f40bf570 2023-12-08T08:19:50.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.558+0000 7fd9f17fa640 1 -- 172.21.15.45:0/783707398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20581 (secure 0 0 0) 0x7fd9f40a5490 con 0x7fd9f40bf570 2023-12-08T08:19:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:50.562 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:48.757800+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.17","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":5}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"16.1b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:50.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 msgr2=0x7fd9d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 0x7fd9d406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4036000 tx=0x7fd9e402e000 comp rx=0 tx=0).stop 2023-12-08T08:19:50.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 msgr2=0x7fd9f414ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc010890 tx=0x7fd9dc010d50 comp rx=0 tx=0).stop 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 shutdown_connections 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fd9f414c040 0x7fd9f414c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9f40bf570 0x7fd9f414ff70 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 --2- 172.21.15.45:0/783707398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e0003970 0x7fd9f414cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 >> 172.21.15.45:0/783707398 conn(0x7fd9f40c5780 msgr2=0x7fd9f40a9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.561+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 shutdown_connections 2023-12-08T08:19:50.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.562+0000 7fd9f9b83640 1 -- 172.21.15.45:0/783707398 wait complete. 2023-12-08T08:19:50.583 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:19:50.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.808+0000 7f06b281e640 1 Processor -- start 2023-12-08T08:19:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.808+0000 7f06b281e640 1 -- start start 2023-12-08T08:19:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.809+0000 7f06b281e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06ac0aa2b0 0x7f06ac0a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06b281e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0c63b0 con 0x7f06ac154190 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06b281e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0a9580 con 0x7f06ac154a20 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06b281e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0a9f20 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06abfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f06ac154190 0x7f06ac0c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51494/0 (socket says 172.21.15.45:51494) 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06abfff640 1 -- 172.21.15.45:0/3455784899 learned_addr learned my addr 172.21.15.45:0/3455784899 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06ab7fe640 1 --2- 172.21.15.45:0/3455784899 >> v2:172.21.15.45:3300/0 conn(0x7f06ac0aa2b0 0x7f06ac0a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06aaffd640 1 -- 172.21.15.45:0/3455784899 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505048485 0 0) 0x7f06ac0c63b0 con 0x7f06ac154190 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.810+0000 7f06aaffd640 1 -- 172.21.15.45:0/3455784899 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0694003520 con 0x7f06ac154190 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.811+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3455784899 >> v1:172.21.15.114:6789/0 conn(0x7f06ac154a20 legacy=0x7f06ac154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.811+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3455784899 >> v1:172.21.15.45:6789/0 conn(0x7f06ac154190 legacy=0x7f06ac0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.811+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3455784899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0a9860 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.812+0000 7f06ab7fe640 1 --2- 172.21.15.45:0/3455784899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac0aa2b0 0x7f06ac0a4f30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097a0 tx=0x7f06a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b26b8aaa9b24687 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.812+0000 7f06aaffd640 1 -- 172.21.15.45:0/3455784899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0031830 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.812+0000 7f06aaffd640 1 -- 172.21.15.45:0/3455784899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a0031990 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.812+0000 7f06aaffd640 1 -- 172.21.15.45:0/3455784899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0031d20 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 -- 172.21.15.45:0/3455784899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac0aa2b0 msgr2=0x7f06ac0a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 --2- 172.21.15.45:0/3455784899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac0aa2b0 0x7f06ac0a4f30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097a0 tx=0x7f06a002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 -- 172.21.15.45:0/3455784899 shutdown_connections 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 --2- 172.21.15.45:0/3455784899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac0aa2b0 0x7f06ac0a4f30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 -- 172.21.15.45:0/3455784899 >> 172.21.15.45:0/3455784899 conn(0x7f06ac0661f0 msgr2=0x7f06ac066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 -- 172.21.15.45:0/3455784899 shutdown_connections 2023-12-08T08:19:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.813+0000 7f06b281e640 1 -- 172.21.15.45:0/3455784899 wait complete. 2023-12-08T08:19:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.815+0000 7f06b281e640 1 Processor -- start 2023-12-08T08:19:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.815+0000 7f06b281e640 1 -- start start 2023-12-08T08:19:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 0x7f06ac150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 0x7f06ac1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1ecf20 con 0x7f06ac154190 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1ede30 con 0x7f06ac154a20 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06b281e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac14ef90 con 0x7f06ac0aa2b0 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44494/0 (socket says 172.21.15.45:44494) 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.816+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3675516044 learned_addr learned my addr 172.21.15.45:0/3675516044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06abfff640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 0x7f06ac150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06b0dbb640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 0x7f06ac1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 msgr2=0x7f06ac150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 0x7f06ac150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 msgr2=0x7f06ac1ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 0x7f06ac1ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 -- 172.21.15.45:0/3675516044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0009400 con 0x7f06ac154190 2023-12-08T08:19:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06abfff640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 0x7f06ac150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06b0dbb640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 0x7f06ac1ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06ab7fe640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f06a002bee0 tx=0x7f06a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a003b9f0 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a003bb70 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00453f0 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.817+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0713a0 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.818+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac071960 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.819+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac0c3b70 con 0x7f06ac154190 2023-12-08T08:19:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.820+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06a004e450 con 0x7f06ac154190 2023-12-08T08:19:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.821+0000 7f06a8ff9640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 0x7f069806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.821+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f06a00abc70 con 0x7f06ac154190 2023-12-08T08:19:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.821+0000 7f06abfff640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 0x7f069806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.822+0000 7f06abfff640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 0x7f069806d300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f069c007fd0 tx=0x7f069c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:50.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:50.825+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06a0076880 con 0x7f06ac154190 2023-12-08T08:19:51.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.059+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06ac074600 con 0x7f06ac154190 2023-12-08T08:19:51.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.060+0000 7f06a8ff9640 1 -- 172.21.15.45:0/3675516044 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f06a0035020 con 0x7f06ac154190 2023-12-08T08:19:51.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:51.064 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:51.064 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 msgr2=0x7f069806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 0x7f069806d300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f069c007fd0 tx=0x7f069c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 msgr2=0x7f06ac1ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f06a002bee0 tx=0x7f06a00046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 shutdown_connections 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f069806ae40 0x7f069806d300 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06ac154a20 0x7f06ac1ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ac154190 0x7f06ac1ed3b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 --2- 172.21.15.45:0/3675516044 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f06ac0aa2b0 0x7f06ac150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 >> 172.21.15.45:0/3675516044 conn(0x7f06ac0661f0 msgr2=0x7f06ac154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:51.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 shutdown_connections 2023-12-08T08:19:51.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.063+0000 7f06b281e640 1 -- 172.21.15.45:0/3675516044 wait complete. 2023-12-08T08:19:51.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:51.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.311+0000 7f5a6b59e640 1 Processor -- start 2023-12-08T08:19:51.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.311+0000 7f5a6b59e640 1 -- start start 2023-12-08T08:19:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.312+0000 7f5a6b59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a6c0a7910 0x7f5a6c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.312+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a6c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a6b59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c155850 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a6b59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c0890 con 0x7f5a6c0a7910 2023-12-08T08:19:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a6b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c0b70 con 0x7f5a6c1521b0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a69d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5a6c0c1dc0 0x7f5a6c14f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51498/0 (socket says 172.21.15.45:51498) 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a69d9b640 1 -- 172.21.15.45:0/3448131342 learned_addr learned my addr 172.21.15.45:0/3448131342 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/3448131342 >> v2:172.21.15.114:3300/0 conn(0x7f5a6c0a7910 0x7f5a6c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.313+0000 7f5a6ad9d640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a6c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112777920 0 0) 0x7f5a6c155850 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a58003520 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1378294817 0 0) 0x7f5a58003520 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 msgr2=0x7f5a6c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a6c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 >> v2:172.21.15.114:3300/0 conn(0x7f5a6c0a7910 msgr2=0x7f5a6c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 --2- 172.21.15.45:0/3448131342 >> v2:172.21.15.114:3300/0 conn(0x7f5a6c0a7910 0x7f5a6c0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0c0e50 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5a54001670 con 0x7f5a6c0c1dc0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 >> v1:172.21.15.45:6789/0 conn(0x7f5a6c0c1dc0 legacy=0x7f5a6c14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a58003970 0x7f5a58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a580047c0 0x7f5a58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c0890 con 0x7f5a58003970 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c0b70 con 0x7f5a580047c0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.314+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800ba00 con 0x7f5a6c1521b0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a58003970 0x7f5a58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a69d9b640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a580047c0 0x7f5a58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6ad9d640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 -- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 msgr2=0x7f5a58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c1521b0 0x7f5a58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 -- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a580047c0 msgr2=0x7f5a58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a580047c0 0x7f5a58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.315+0000 7f5a6a59c640 1 -- 172.21.15.45:0/3448131342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58003520 con 0x7f5a58003970 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.317+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a58003970 0x7f5a58003d90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7e57b7236a097d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.317+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c02c710 con 0x7f5a58003970 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.317+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c02c870 con 0x7f5a58003970 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.317+0000 7f5a6959a640 1 -- 172.21.15.45:0/3448131342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c02cc00 con 0x7f5a58003970 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.317+0000 7f5a6b59e640 1 -- 172.21.15.45:0/3448131342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a58003970 msgr2=0x7f5a58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/3448131342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a58003970 0x7f5a58003d90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a580057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6ad9d640 1 -- 172.21.15.45:0/3448131342 reap_dead start 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6b59e640 1 -- 172.21.15.45:0/3448131342 shutdown_connections 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6b59e640 1 -- 172.21.15.45:0/3448131342 >> 172.21.15.45:0/3448131342 conn(0x7f5a6c0c5780 msgr2=0x7f5a6c0c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6b59e640 1 -- 172.21.15.45:0/3448131342 shutdown_connections 2023-12-08T08:19:51.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.318+0000 7f5a6b59e640 1 -- 172.21.15.45:0/3448131342 wait complete. 2023-12-08T08:19:51.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.320+0000 7f5a6b59e640 1 Processor -- start 2023-12-08T08:19:51.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.320+0000 7f5a6b59e640 1 -- start start 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a58003970 0x7f5a6c0bc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c14b5a0 0x7f5a6c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1e5680 con 0x7f5a6c1e7960 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0ba850 con 0x7f5a58003970 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a6b59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0bab30 con 0x7f5a6c14b5a0 2023-12-08T08:19:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a69d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a69d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44516/0 (socket says 172.21.15.45:44516) 2023-12-08T08:19:51.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.321+0000 7f5a69d9b640 1 -- 172.21.15.45:0/137928149 learned_addr learned my addr 172.21.15.45:0/137928149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:51.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a58003970 0x7f5a6c0bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a6ad9d640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c14b5a0 0x7f5a6c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 -- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c14b5a0 msgr2=0x7f5a6c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c14b5a0 0x7f5a6c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 -- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a58003970 msgr2=0x7f5a6c0bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a58003970 0x7f5a6c0bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 -- 172.21.15.45:0/137928149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0bae10 con 0x7f5a6c1e7960 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.322+0000 7f5a69d9b640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e780 tx=0x7f5a5400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.323+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400ee30 con 0x7f5a6c1e7960 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.323+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400c870 con 0x7f5a6c1e7960 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.323+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400cc00 con 0x7f5a6c1e7960 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.323+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0bb0f0 con 0x7f5a6c1e7960 2023-12-08T08:19:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.323+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c0bbe30 con 0x7f5a6c1e7960 2023-12-08T08:19:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.324+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c0bb610 con 0x7f5a6c1e7960 2023-12-08T08:19:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.325+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a5401d460 con 0x7f5a6c1e7960 2023-12-08T08:19:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.326+0000 7f5a62ffd640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 0x7f5a4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.326+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f5a540899a0 con 0x7f5a6c1e7960 2023-12-08T08:19:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.326+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 0x7f5a4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.327+0000 7f5a6a59c640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 0x7f5a4c06d330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a5c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.331+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a6c0bb610 con 0x7f5a6c1e7960 2023-12-08T08:19:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.561+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a6c0bb610 con 0x7f5a6c1e7960 2023-12-08T08:19:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.562+0000 7f5a62ffd640 1 -- 172.21.15.45:0/137928149 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6134 (secure 0 0 0) 0x7f5a6c0bb610 con 0x7f5a6c1e7960 2023-12-08T08:19:51.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:51.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:18:53.238866+0000","modified":"2023-12-08T08:18:56.300062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6747},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6747":{"gid":6747,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/2233278871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2233278871},{"type":"v1","addr":"172.21.15.45:6837","nonce":2233278871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-12-08T08:19:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 msgr2=0x7f5a4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 0x7f5a4c06d330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009ac0 tx=0x7f5a5c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 msgr2=0x7f5a6c0bb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e780 tx=0x7f5a5400ec40 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 shutdown_connections 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5a4c06ae70 0x7f5a4c06d330 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5a6c14b5a0 0x7f5a6c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a6c1e7960 0x7f5a6c0bb8f0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 --2- 172.21.15.45:0/137928149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a58003970 0x7f5a6c0bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.565+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 >> 172.21.15.45:0/137928149 conn(0x7f5a6c0c5780 msgr2=0x7f5a6c150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.566+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 shutdown_connections 2023-12-08T08:19:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.566+0000 7f5a6b59e640 1 -- 172.21.15.45:0/137928149 wait complete. 2023-12-08T08:19:51.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:51.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.815+0000 7fe474e1a640 1 Processor -- start 2023-12-08T08:19:51.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.815+0000 7fe474e1a640 1 -- start start 2023-12-08T08:19:51.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe474e1a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe4700a7910 0x7fe4700c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe474e1a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4700c1dc0 0x7fe47014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe474e1a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe470155850 con 0x7fe4701521b0 2023-12-08T08:19:51.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe474e1a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4700c0890 con 0x7fe4700a7910 2023-12-08T08:19:51.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe474e1a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c0b70 con 0x7fe4700c1dc0 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe46f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe4700a7910 0x7fe4700c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe46f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe4700a7910 0x7fe4700c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44526/0 (socket says 172.21.15.45:44526) 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe46f7fe640 1 -- 172.21.15.45:0/3695861521 learned_addr learned my addr 172.21.15.45:0/3695861521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.817+0000 7fe46effd640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4700c1dc0 0x7fe47014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.818+0000 7fe46f7fe640 1 -- 172.21.15.45:0/3695861521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4700c1dc0 msgr2=0x7fe47014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.818+0000 7fe46f7fe640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4700c1dc0 0x7fe47014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.818+0000 7fe46f7fe640 1 -- 172.21.15.45:0/3695861521 >> v1:172.21.15.114:6789/0 conn(0x7fe4701521b0 legacy=0x7fe470155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.818+0000 7fe46f7fe640 1 -- 172.21.15.45:0/3695861521 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700c0e50 con 0x7fe4700a7910 2023-12-08T08:19:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.819+0000 7fe46f7fe640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700a7910 0x7fe4700c1880 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe460009870 tx=0x7fe46002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22cdfd89787d5bf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.820+0000 7fe46e7fc640 1 -- 172.21.15.45:0/3695861521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600317c0 con 0x7fe4700a7910 2023-12-08T08:19:51.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.820+0000 7fe46e7fc640 1 -- 172.21.15.45:0/3695861521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460031920 con 0x7fe4700a7910 2023-12-08T08:19:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.820+0000 7fe46e7fc640 1 -- 172.21.15.45:0/3695861521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460031cb0 con 0x7fe4700a7910 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.820+0000 7fe474e1a640 1 -- 172.21.15.45:0/3695861521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700a7910 msgr2=0x7fe4700c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.820+0000 7fe474e1a640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700a7910 0x7fe4700c1880 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe460009870 tx=0x7fe46002b860 comp rx=0 tx=0).stop 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 -- 172.21.15.45:0/3695861521 shutdown_connections 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4700c1dc0 0x7fe47014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 --2- 172.21.15.45:0/3695861521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700a7910 0x7fe4700c1880 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 -- 172.21.15.45:0/3695861521 >> 172.21.15.45:0/3695861521 conn(0x7fe4700c5780 msgr2=0x7fe4700c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 -- 172.21.15.45:0/3695861521 shutdown_connections 2023-12-08T08:19:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.821+0000 7fe474e1a640 1 -- 172.21.15.45:0/3695861521 wait complete. 2023-12-08T08:19:51.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.822+0000 7fe474e1a640 1 Processor -- start 2023-12-08T08:19:51.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.823+0000 7fe474e1a640 1 -- start start 2023-12-08T08:19:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4700a7910 0x7fe4700bf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4701521b0 0x7fe470070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe470151590 con 0x7fe4700c1dc0 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700bf760 con 0x7fe4700a7910 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe474e1a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700be780 con 0x7fe4701521b0 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44530/0 (socket says 172.21.15.45:44530) 2023-12-08T08:19:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 -- 172.21.15.45:0/63030220 learned_addr learned my addr 172.21.15.45:0/63030220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46f7fe640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4700a7910 0x7fe4700bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 -- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4701521b0 msgr2=0x7fe470070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4701521b0 0x7fe470070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 -- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4700a7910 msgr2=0x7fe4700bf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4700a7910 0x7fe4700bf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.824+0000 7fe46effd640 1 -- 172.21.15.45:0/63030220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600094d0 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe46effd640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe46400d7d0 tx=0x7fe46400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400b6c0 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400b820 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4701ed970 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400bbb0 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.825+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700bed00 con 0x7fe4700c1dc0 2023-12-08T08:19:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.826+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700bee90 con 0x7fe4700c1dc0 2023-12-08T08:19:51.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.827+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe46400bd10 con 0x7fe4700c1dc0 2023-12-08T08:19:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.828+0000 7fe457fff640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 0x7fe45c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.828+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7fe46408a0b0 con 0x7fe4700c1dc0 2023-12-08T08:19:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.829+0000 7fe46f7fe640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 0x7fe45c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:51.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.829+0000 7fe46f7fe640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 0x7fe45c06d330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe460036000 tx=0x7fe46003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:51.832+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe464054c20 con 0x7fe4700c1dc0 2023-12-08T08:19:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.027+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4700743e0 con 0x7fe4700c1dc0 2023-12-08T08:19:52.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.030+0000 7fe457fff640 1 -- 172.21.15.45:0/63030220 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+20581 (secure 0 0 0) 0x7fe464058240 con 0x7fe4700c1dc0 2023-12-08T08:19:52.033 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:52.033 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:48.757800+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:18:50.840681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-08T08:18:52.232940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.17","mappings":[{"from":1,"to":2}]},{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.1b","mappings":[{"from":1,"to":5}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"16.1b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 msgr2=0x7fe45c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 0x7fe45c06d330 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe460036000 tx=0x7fe46003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 msgr2=0x7fe4701544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe46400d7d0 tx=0x7fe46400dc90 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 shutdown_connections 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe45c06ae70 0x7fe45c06d330 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe4701521b0 0x7fe470070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4700c1dc0 0x7fe4701544f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.032+0000 7fe474e1a640 1 --2- 172.21.15.45:0/63030220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4700a7910 0x7fe4700bf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.033+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 >> 172.21.15.45:0/63030220 conn(0x7fe4700c5780 msgr2=0x7fe470150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.033+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 shutdown_connections 2023-12-08T08:19:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.033+0000 7fe474e1a640 1 -- 172.21.15.45:0/63030220 wait complete. 2023-12-08T08:19:52.054 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:19:52.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.278+0000 7f1f624d1640 1 Processor -- start 2023-12-08T08:19:52.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.278+0000 7f1f624d1640 1 -- start start 2023-12-08T08:19:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.279+0000 7f1f624d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.279+0000 7f1f624d1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.279+0000 7f1f624d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c154c50 con 0x7f1f5c06c670 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.279+0000 7f1f624d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c0c0060 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.279+0000 7f1f624d1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0c0340 con 0x7f1f5c0c06b0 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 -- 172.21.15.45:0/1778125024 learned_addr learned my addr 172.21.15.45:0/1778125024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f61cd0640 1 --1- 172.21.15.45:0/1778125024 >> v1:172.21.15.45:6789/0 conn(0x7f1f5c06c670 0x7f1f5c0c0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51506/0 (socket says 172.21.15.45:51506) 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f60cce640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 -- 172.21.15.45:0/1778125024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 msgr2=0x7f1f5c151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 -- 172.21.15.45:0/1778125024 >> v1:172.21.15.45:6789/0 conn(0x7f1f5c06c670 legacy=0x7f1f5c0c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f53fff640 1 -- 172.21.15.45:0/1778125024 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423887572 0 0) 0x7f1f5c154c50 con 0x7f1f5c06c670 2023-12-08T08:19:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.280+0000 7f1f614cf640 1 -- 172.21.15.45:0/1778125024 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c154600 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.281+0000 7f1f614cf640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009870 tx=0x7f1f5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10789b81fa70cc20 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f53fff640 1 -- 172.21.15.45:0/1778125024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58031640 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f53fff640 1 -- 172.21.15.45:0/1778125024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f580317a0 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f53fff640 1 -- 172.21.15.45:0/1778125024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58031b30 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 -- 172.21.15.45:0/1778125024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06cfc0 msgr2=0x7f1f5c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009870 tx=0x7f1f5802b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 -- 172.21.15.45:0/1778125024 shutdown_connections 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 --2- 172.21.15.45:0/1778125024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c1516a0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.282+0000 7f1f624d1640 1 -- 172.21.15.45:0/1778125024 >> 172.21.15.45:0/1778125024 conn(0x7f1f5c0c2d20 msgr2=0x7f1f5c0c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.283+0000 7f1f624d1640 1 -- 172.21.15.45:0/1778125024 shutdown_connections 2023-12-08T08:19:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.283+0000 7f1f624d1640 1 -- 172.21.15.45:0/1778125024 wait complete. 2023-12-08T08:19:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.284+0000 7f1f624d1640 1 Processor -- start 2023-12-08T08:19:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.284+0000 7f1f624d1640 1 -- start start 2023-12-08T08:19:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c0c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c1e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0abed0 con 0x7f1f5c06c670 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1eca00 con 0x7f1f5c06cfc0 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.285+0000 7f1f624d1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c149b40 con 0x7f1f5c0c06b0 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44544/0 (socket says 172.21.15.45:44544) 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 -- 172.21.15.45:0/2901062830 learned_addr learned my addr 172.21.15.45:0/2901062830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f61cd0640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c1e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f60cce640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c0c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 -- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 msgr2=0x7f1f5c1e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c1e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 -- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 msgr2=0x7f1f5c0c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c0c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.286+0000 7f1f614cf640 1 -- 172.21.15.45:0/2901062830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580094d0 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f60cce640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c0c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f614cf640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1f580090b0 tx=0x7f1f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58004230 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58004390 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5803baa0 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c155260 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.287+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c1eac20 con 0x7f1f5c06c670 2023-12-08T08:19:52.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.288+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0743e0 con 0x7f1f5c06c670 2023-12-08T08:19:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.289+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f58043070 con 0x7f1f5c06c670 2023-12-08T08:19:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.290+0000 7f1f51ffb640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 0x7f1f4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.290+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7030+0+0 (secure 0 0 0) 0x7f1f580ab7f0 con 0x7f1f5c06c670 2023-12-08T08:19:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.291+0000 7f1f60cce640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 0x7f1f4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.291+0000 7f1f60cce640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 0x7f1f4006d330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c006fd0 tx=0x7f1f4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.295+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f580764a0 con 0x7f1f5c06c670 2023-12-08T08:19:52.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.530+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f5c154200 con 0x7f1f5c06c670 2023-12-08T08:19:52.534 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:19:52.531+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:19:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.535+0000 7f1f51ffb640 1 -- 172.21.15.45:0/2901062830 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1f58031e60 con 0x7f1f5c06c670 2023-12-08T08:19:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:19:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 msgr2=0x7f1f4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 0x7f1f4006d330 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c006fd0 tx=0x7f1f4c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 msgr2=0x7f1f5c149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1f580090b0 tx=0x7f1f580046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 shutdown_connections 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f1f4006ae70 0x7f1f4006d330 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f1f5c0c06b0 0x7f1f5c1e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c06cfc0 0x7f1f5c0c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.539+0000 7f1f624d1640 1 --2- 172.21.15.45:0/2901062830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5c06c670 0x7f1f5c149600 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.540+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 >> 172.21.15.45:0/2901062830 conn(0x7f1f5c0c2d20 msgr2=0x7f1f5c153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.541+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 shutdown_connections 2023-12-08T08:19:52.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.541+0000 7f1f624d1640 1 -- 172.21.15.45:0/2901062830 wait complete. 2023-12-08T08:19:52.552 INFO:tasks.ceph.mds.a.smithi045.stderr: -5774> 2023-12-08T08:18:58.903+0000 7f21d6724640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:19:52.564 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:19:52.608 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-08T08:19:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.755+0000 7ffbef17a640 1 Processor -- start 2023-12-08T08:19:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.756+0000 7ffbef17a640 1 -- start start 2023-12-08T08:19:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbef17a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbef17a640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffbe80c4970 0x7ffbe806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbef17a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe80c60c0 con 0x7ffbe806d3e0 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbef17a640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe8152dc0 con 0x7ffbe80c4970 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbef17a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe81521d0 con 0x7ffbe814c280 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbed977640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffbe80c4970 0x7ffbe806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbee178640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbee178640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:60176/0 (socket says 172.21.15.45:60176) 2023-12-08T08:19:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.757+0000 7ffbee178640 1 -- 172.21.15.45:0/44016857 learned_addr learned my addr 172.21.15.45:0/44016857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.758+0000 7ffbee178640 1 -- 172.21.15.45:0/44016857 >> v2:172.21.15.114:3300/0 conn(0x7ffbe80c4970 msgr2=0x7ffbe806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.758+0000 7ffbee178640 1 --2- 172.21.15.45:0/44016857 >> v2:172.21.15.114:3300/0 conn(0x7ffbe80c4970 0x7ffbe806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.758+0000 7ffbee178640 1 -- 172.21.15.45:0/44016857 >> v1:172.21.15.114:6789/0 conn(0x7ffbe806d3e0 legacy=0x7ffbe8155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.758+0000 7ffbee178640 1 -- 172.21.15.45:0/44016857 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe814c660 con 0x7ffbe814c280 2023-12-08T08:19:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.760+0000 7ffbee178640 1 --2- 172.21.15.45:0/44016857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009e50 tx=0x7ffbe402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ad64ca6cb2db595 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.760+0000 7ffbed176640 1 -- 172.21.15.45:0/44016857 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe402ca80 con 0x7ffbe814c280 2023-12-08T08:19:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.760+0000 7ffbed176640 1 -- 172.21.15.45:0/44016857 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe402cbe0 con 0x7ffbe814c280 2023-12-08T08:19:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.760+0000 7ffbed176640 1 -- 172.21.15.45:0/44016857 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40343f0 con 0x7ffbe814c280 2023-12-08T08:19:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 -- 172.21.15.45:0/44016857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 msgr2=0x7ffbe80a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 --2- 172.21.15.45:0/44016857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009e50 tx=0x7ffbe402bee0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 -- 172.21.15.45:0/44016857 shutdown_connections 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 --2- 172.21.15.45:0/44016857 >> v2:172.21.15.114:3300/0 conn(0x7ffbe80c4970 0x7ffbe806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 --2- 172.21.15.45:0/44016857 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe80a4d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 -- 172.21.15.45:0/44016857 >> 172.21.15.45:0/44016857 conn(0x7ffbe8066ce0 msgr2=0x7ffbe80a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 -- 172.21.15.45:0/44016857 shutdown_connections 2023-12-08T08:19:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.761+0000 7ffbef17a640 1 -- 172.21.15.45:0/44016857 wait complete. 2023-12-08T08:19:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.763+0000 7ffbef17a640 1 Processor -- start 2023-12-08T08:19:52.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.763+0000 7ffbef17a640 1 -- start start 2023-12-08T08:19:52.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 0x7ffbe8154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80c1820 con 0x7ffbe806d3e0 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe81ea650 con 0x7ffbe80c4970 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbef17a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80c02a0 con 0x7ffbe814c280 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee178640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee178640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44570/0 (socket says 172.21.15.45:44570) 2023-12-08T08:19:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee178640 1 -- 172.21.15.45:0/3516442410 learned_addr learned my addr 172.21.15.45:0/3516442410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee979640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbed977640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 0x7ffbe8154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee178640 1 -- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 msgr2=0x7ffbe8145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.764+0000 7ffbee178640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe8145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbee178640 1 -- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 msgr2=0x7ffbe8154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbee178640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 0x7ffbe8154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbee178640 1 -- 172.21.15.45:0/3516442410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4009b30 con 0x7ffbe806d3e0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbed977640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 0x7ffbe8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbee178640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000f80 tx=0x7ffbe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe403e450 con 0x7ffbe806d3e0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe403e5f0 con 0x7ffbe806d3e0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe80c0580 con 0x7ffbe806d3e0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe403e9a0 con 0x7ffbe806d3e0 2023-12-08T08:19:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.765+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe80a5c50 con 0x7ffbe806d3e0 2023-12-08T08:19:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.766+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe81ecc80 con 0x7ffbe806d3e0 2023-12-08T08:19:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.767+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbe402cd50 con 0x7ffbe806d3e0 2023-12-08T08:19:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.768+0000 7ffbdeffd640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 0x7ffbcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.768+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7116+0+0 (secure 0 0 0) 0x7ffbe40ac5f0 con 0x7ffbe806d3e0 2023-12-08T08:19:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.769+0000 7ffbed977640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 0x7ffbcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.770+0000 7ffbed977640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 0x7ffbcc06d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffbe814fec0 tx=0x7ffbd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:52.773+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbe81ecc80 con 0x7ffbe806d3e0 2023-12-08T08:19:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.009+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffbe80c0060 con 0x7ffbe806d3e0 2023-12-08T08:19:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.539+0000 7ffbdeffd640 1 -- 172.21.15.45:0/3516442410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffbe80c0060 con 0x7ffbe806d3e0 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 msgr2=0x7ffbcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 0x7ffbcc06d330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffbe814fec0 tx=0x7ffbd8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 msgr2=0x7ffbe81ea110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4000f80 tx=0x7ffbe4004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 shutdown_connections 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ffbcc06ae70 0x7ffbcc06d330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ffbe814c280 0x7ffbe8145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe80c4970 0x7ffbe8154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 --2- 172.21.15.45:0/3516442410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbe806d3e0 0x7ffbe81ea110 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 >> 172.21.15.45:0/3516442410 conn(0x7ffbe8066ce0 msgr2=0x7ffbe81468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.543+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 shutdown_connections 2023-12-08T08:19:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.544+0000 7ffbef17a640 1 -- 172.21.15.45:0/3516442410 wait complete. 2023-12-08T08:19:53.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:19:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.821+0000 7f0fc3339640 1 Processor -- start 2023-12-08T08:19:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.822+0000 7f0fc3339640 1 -- start start 2023-12-08T08:19:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.823+0000 7f0fc3339640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc14e730 0x7f0fbc1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.823+0000 7f0fc3339640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc0c66f0 0x7f0fbc0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.823+0000 7f0fc3339640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc157aa0 con 0x7f0fbc154f30 2023-12-08T08:19:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.823+0000 7f0fc3339640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c5130 con 0x7f0fbc14e730 2023-12-08T08:19:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.823+0000 7f0fc3339640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c4890 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc14e730 0x7f0fbc1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc18d6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc0c66f0 0x7f0fbc0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fbc14e730 0x7f0fbc1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:49482/0 (socket says 172.21.15.45:49482) 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 -- 172.21.15.45:0/111630209 learned_addr learned my addr 172.21.15.45:0/111630209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 -- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc0c66f0 msgr2=0x7f0fbc0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 --2- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc0c66f0 0x7f0fbc0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 -- 172.21.15.45:0/111630209 >> v1:172.21.15.114:6789/0 conn(0x7f0fbc154f30 legacy=0x7f0fbc158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.824+0000 7f0fc10d5640 1 -- 172.21.15.45:0/111630209 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0c4b70 con 0x7f0fbc14e730 2023-12-08T08:19:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.826+0000 7f0fc10d5640 1 --2- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1559a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009870 tx=0x7f0fac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da3e66bc849f9857 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.826+0000 7f0fbbfff640 1 -- 172.21.15.45:0/111630209 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac030840 con 0x7f0fbc14e730 2023-12-08T08:19:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.826+0000 7f0fbbfff640 1 -- 172.21.15.45:0/111630209 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac0309a0 con 0x7f0fbc14e730 2023-12-08T08:19:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.826+0000 7f0fbbfff640 1 -- 172.21.15.45:0/111630209 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac030d30 con 0x7f0fbc14e730 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 -- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 msgr2=0x7f0fbc1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 --2- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1559a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009870 tx=0x7f0fac02b980 comp rx=0 tx=0).stop 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 -- 172.21.15.45:0/111630209 shutdown_connections 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 --2- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc0c66f0 0x7f0fbc0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 --2- 172.21.15.45:0/111630209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1559a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 -- 172.21.15.45:0/111630209 >> 172.21.15.45:0/111630209 conn(0x7f0fbc0abb00 msgr2=0x7f0fbc0abf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 -- 172.21.15.45:0/111630209 shutdown_connections 2023-12-08T08:19:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.827+0000 7f0fc3339640 1 -- 172.21.15.45:0/111630209 wait complete. 2023-12-08T08:19:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.830+0000 7f0fc3339640 1 Processor -- start 2023-12-08T08:19:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.830+0000 7f0fc3339640 1 -- start start 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc154f30 0x7f0fbc153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc150850 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc14a980 con 0x7f0fbc14e730 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc3339640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc151de0 con 0x7f0fbc154f30 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc10d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc10d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44576/0 (socket says 172.21.15.45:44576) 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc10d5640 1 -- 172.21.15.45:0/2609782572 learned_addr learned my addr 172.21.15.45:0/2609782572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc18d6640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc154f30 0x7f0fbc153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.831+0000 7f0fc08d4640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 -- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc154f30 msgr2=0x7f0fbc153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc154f30 0x7f0fbc153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 -- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 msgr2=0x7f0fbc1ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 -- 172.21.15.45:0/2609782572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0094d0 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc10d5640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0fac000c00 tx=0x7f0fac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac039c90 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac039df0 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac043640 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.832+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc14a6f0 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.833+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc1ead50 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.834+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc072530 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.835+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fac0437a0 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.836+0000 7f0fb9ffb640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.836+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7116+0+0 (secure 0 0 0) 0x7f0fac03e070 con 0x7f0fbc0c66f0 2023-12-08T08:19:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.836+0000 7f0fc08d4640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.837+0000 7f0fc08d4640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 0x7f0fa806d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c7290 tx=0x7f0fb0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:53.840+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fac0776e0 con 0x7f0fbc0c66f0 2023-12-08T08:19:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.034+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fbc074730 con 0x7f0fbc0c66f0 2023-12-08T08:19:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.813+0000 7f0fb9ffb640 1 -- 172.21.15.45:0/2609782572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0fac07ad00 con 0x7f0fbc0c66f0 2023-12-08T08:19:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 msgr2=0x7f0fa806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 0x7f0fa806d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c7290 tx=0x7f0fb0009040 comp rx=0 tx=0).stop 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 msgr2=0x7f0fbc149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f0fac000c00 tx=0x7f0fac004730 comp rx=0 tx=0).stop 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 shutdown_connections 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0fa806ae70 0x7f0fa806d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0fbc154f30 0x7f0fbc153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc14e730 0x7f0fbc1ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 --2- 172.21.15.45:0/2609782572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fbc0c66f0 0x7f0fbc149b50 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:54.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.817+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 >> 172.21.15.45:0/2609782572 conn(0x7f0fbc0abb00 msgr2=0x7f0fbc14b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:54.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.818+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 shutdown_connections 2023-12-08T08:19:54.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:54.818+0000 7f0fc3339640 1 -- 172.21.15.45:0/2609782572 wait complete. 2023-12-08T08:19:54.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:19:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.073+0000 7f94f25bc640 1 Processor -- start 2023-12-08T08:19:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.073+0000 7f94f25bc640 1 -- start start 2023-12-08T08:19:55.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.074+0000 7f94f25bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94ec0bf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.074+0000 7f94f25bc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec1543e0 con 0x7f94ec0c0c20 2023-12-08T08:19:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94f25bc640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0c25c0 con 0x7f94ec0bfb90 2023-12-08T08:19:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94f25bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec154160 con 0x7f94ec151680 2023-12-08T08:19:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94f0db9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94ec0c0c20 0x7f94ec154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51720/0 (socket says 172.21.15.45:51720) 2023-12-08T08:19:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94f0db9640 1 -- 172.21.15.45:0/2502124494 learned_addr learned my addr 172.21.15.45:0/2502124494 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94f15ba640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94ec0bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.075+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499795805 0 0) 0x7f94ec1543e0 con 0x7f94ec0c0c20 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d8003520 con 0x7f94ec0c0c20 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645480816 0 0) 0x7f94d8003520 con 0x7f94ec0c0c20 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 msgr2=0x7f94ec0bf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94ec0bf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 >> v1:172.21.15.114:6789/0 conn(0x7f94ec0bfb90 legacy=0x7f94ec15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0c28a0 con 0x7f94ec0c0c20 2023-12-08T08:19:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f94dc001670 con 0x7f94ec0c0c20 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 >> v1:172.21.15.45:6789/0 conn(0x7f94ec0c0c20 legacy=0x7f94ec154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94d80039a0 0x7f94d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80047c0 0x7f94d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800ba80 con 0x7f94d80039a0 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800bbf0 con 0x7f94d80047c0 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800bdb0 con 0x7f94ec151680 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.076+0000 7f94f15ba640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94d80039a0 0x7f94d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f0db9640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80047c0 0x7f94d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f15ba640 1 -- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 msgr2=0x7f94d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f1dbb640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f15ba640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f15ba640 1 -- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80047c0 msgr2=0x7f94d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f15ba640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80047c0 0x7f94d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f15ba640 1 -- 172.21.15.45:0/2502124494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8003520 con 0x7f94d80039a0 2023-12-08T08:19:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f0db9640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80047c0 0x7f94d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.077+0000 7f94f1dbb640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec151680 0x7f94d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.078+0000 7f94f15ba640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94d80039a0 0x7f94d8003dc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009fc0 tx=0x7f94d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450cbcd27a4f99c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e802cbf0 con 0x7f94d80039a0 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e800f040 con 0x7f94d80039a0 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94e3fff640 1 -- 172.21.15.45:0/2502124494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8034440 con 0x7f94d80039a0 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 -- 172.21.15.45:0/2502124494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94d80039a0 msgr2=0x7f94d8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 --2- 172.21.15.45:0/2502124494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94d80039a0 0x7f94d8003dc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009fc0 tx=0x7f94d80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f1dbb640 1 -- 172.21.15.45:0/2502124494 reap_dead start 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 -- 172.21.15.45:0/2502124494 shutdown_connections 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 -- 172.21.15.45:0/2502124494 >> 172.21.15.45:0/2502124494 conn(0x7f94ec0c6220 msgr2=0x7f94ec0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 -- 172.21.15.45:0/2502124494 shutdown_connections 2023-12-08T08:19:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.079+0000 7f94f25bc640 1 -- 172.21.15.45:0/2502124494 wait complete. 2023-12-08T08:19:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.081+0000 7f94f25bc640 1 Processor -- start 2023-12-08T08:19:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.081+0000 7f94f25bc640 1 -- start start 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 0x7f94ec1eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 0x7f94ec1edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1ed580 con 0x7f94ec0a91c0 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1eb020 con 0x7f94d80039a0 2023-12-08T08:19:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.082+0000 7f94f25bc640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec148380 con 0x7f94ec0aa8f0 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34170/0 (socket says 172.21.15.45:34170) 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 -- 172.21.15.45:0/1007732836 learned_addr learned my addr 172.21.15.45:0/1007732836 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f1dbb640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 0x7f94ec1edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f15ba640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 0x7f94ec1eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 -- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 msgr2=0x7f94ec1edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 0x7f94ec1edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 -- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 msgr2=0x7f94ec1eaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 0x7f94ec1eaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f0db9640 1 -- 172.21.15.45:0/1007732836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec148660 con 0x7f94ec0a91c0 2023-12-08T08:19:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f1dbb640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 0x7f94ec1edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.083+0000 7f94f15ba640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 0x7f94ec1eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94f0db9640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00d8b0 tx=0x7f94dc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0074e0 con 0x7f94ec0a91c0 2023-12-08T08:19:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc007640 con 0x7f94ec0a91c0 2023-12-08T08:19:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0049e0 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec148940 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.084+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec149340 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.085+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec0bf8f0 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.086+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94dc004b40 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.087+0000 7f94e1ffb640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 0x7f94d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.087+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6678+0+0 (secure 0 0 0) 0x7f94dc089290 con 0x7f94ec0a91c0 2023-12-08T08:19:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.088+0000 7f94f15ba640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 0x7f94d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.088+0000 7f94f15ba640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 0x7f94d006d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f94e8036000 tx=0x7f94e802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.091+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94dc054000 con 0x7f94ec0a91c0 2023-12-08T08:19:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.300+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94ec148b30 con 0x7f94ec0a91c0 2023-12-08T08:19:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.825+0000 7f94e1ffb640 1 -- 172.21.15.45:0/1007732836 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f94dc057620 con 0x7f94ec0a91c0 2023-12-08T08:19:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-08T08:19:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 msgr2=0x7f94d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 0x7f94d006d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f94e8036000 tx=0x7f94e802e000 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 msgr2=0x7f94ec072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00d8b0 tx=0x7f94dc00dd70 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 shutdown_connections 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f94d006ae70 0x7f94d006d330 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f94ec0aa8f0 0x7f94ec1edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94ec0a91c0 0x7f94ec072210 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 --2- 172.21.15.45:0/1007732836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d80039a0 0x7f94ec1eaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 >> 172.21.15.45:0/1007732836 conn(0x7f94ec0c6220 msgr2=0x7f94ec0c2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.829+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 shutdown_connections 2023-12-08T08:19:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:55.830+0000 7f94f25bc640 1 -- 172.21.15.45:0/1007732836 wait complete. 2023-12-08T08:19:55.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.071+0000 7fc646941640 1 Processor -- start 2023-12-08T08:19:56.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.071+0000 7fc646941640 1 -- start start 2023-12-08T08:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.072+0000 7fc646941640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 0x7fc6400c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.072+0000 7fc646941640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.072+0000 7fc646941640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc640158410 con 0x7fc640151c40 2023-12-08T08:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.072+0000 7fc646941640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6400c5820 con 0x7fc640154600 2023-12-08T08:19:56.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.072+0000 7fc646941640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640158220 con 0x7fc6400c6fd0 2023-12-08T08:19:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.073+0000 7fc6377fe640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 0x7fc6400c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.073+0000 7fc644ede640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.073+0000 7fc644ede640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:58984/0 (socket says 172.21.15.45:58984) 2023-12-08T08:19:56.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.073+0000 7fc644ede640 1 -- 172.21.15.45:0/433807868 learned_addr learned my addr 172.21.15.45:0/433807868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.074+0000 7fc644ede640 1 -- 172.21.15.45:0/433807868 >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 msgr2=0x7fc6400c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.074+0000 7fc644ede640 1 --2- 172.21.15.45:0/433807868 >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 0x7fc6400c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.074+0000 7fc644ede640 1 -- 172.21.15.45:0/433807868 >> v1:172.21.15.114:6789/0 conn(0x7fc640151c40 legacy=0x7fc640157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.074+0000 7fc644ede640 1 -- 172.21.15.45:0/433807868 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6401586f0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.074+0000 7fc6377fe640 1 --2- 172.21.15.45:0/433807868 >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 0x7fc6400c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:56.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.075+0000 7fc644ede640 1 --2- 172.21.15.45:0/433807868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc63802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee369b0c4d23fd99 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.076+0000 7fc63f7fe640 1 -- 172.21.15.45:0/433807868 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638031640 con 0x7fc6400c6fd0 2023-12-08T08:19:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.076+0000 7fc63f7fe640 1 -- 172.21.15.45:0/433807868 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6380317a0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.076+0000 7fc63f7fe640 1 -- 172.21.15.45:0/433807868 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638031b30 con 0x7fc6400c6fd0 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 -- 172.21.15.45:0/433807868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 msgr2=0x7fc6400c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 --2- 172.21.15.45:0/433807868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc63802b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 -- 172.21.15.45:0/433807868 shutdown_connections 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 --2- 172.21.15.45:0/433807868 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc6400c6fd0 0x7fc6400c46a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 --2- 172.21.15.45:0/433807868 >> v2:172.21.15.114:3300/0 conn(0x7fc640154600 0x7fc6400c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 -- 172.21.15.45:0/433807868 >> 172.21.15.45:0/433807868 conn(0x7fc6400ab8b0 msgr2=0x7fc6400abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 -- 172.21.15.45:0/433807868 shutdown_connections 2023-12-08T08:19:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.077+0000 7fc646941640 1 -- 172.21.15.45:0/433807868 wait complete. 2023-12-08T08:19:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.079+0000 7fc646941640 1 Processor -- start 2023-12-08T08:19:56.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.079+0000 7fc646941640 1 -- start start 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.079+0000 7fc646941640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc646941640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc640151c40 0x7fc64014ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc646941640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc640154600 0x7fc64014b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc646941640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401ed780 con 0x7fc6400c6fd0 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc646941640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401eda60 con 0x7fc640151c40 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc646941640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401edd40 con 0x7fc640154600 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34180/0 (socket says 172.21.15.45:34180) 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc63ffff640 1 -- 172.21.15.45:0/151252752 learned_addr learned my addr 172.21.15.45:0/151252752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc6377fe640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc640151c40 0x7fc64014ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.080+0000 7fc644ede640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc640154600 0x7fc64014b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 -- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc640154600 msgr2=0x7fc64014b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc640154600 0x7fc64014b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 -- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc640151c40 msgr2=0x7fc64014ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc640151c40 0x7fc64014ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 -- 172.21.15.45:0/151252752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009400 con 0x7fc6400c6fd0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63ffff640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c790 tx=0x7fc63000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000cea0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630006d50 con 0x7fc6400c6fd0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380094d0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630003bb0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.081+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6401ee300 con 0x7fc6400c6fd0 2023-12-08T08:19:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.083+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc640072370 con 0x7fc6400c6fd0 2023-12-08T08:19:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.084+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc630003d10 con 0x7fc6400c6fd0 2023-12-08T08:19:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.084+0000 7fc63d7fa640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 0x7fc62006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.085+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc6300893f0 con 0x7fc6400c6fd0 2023-12-08T08:19:56.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.085+0000 7fc6377fe640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 0x7fc62006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.085+0000 7fc6377fe640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 0x7fc62006d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6401e8050 tx=0x7fc628008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.089+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc630057d80 con 0x7fc6400c6fd0 2023-12-08T08:19:56.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.283+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc640154d90 con 0x7fc6400c6fd0 2023-12-08T08:19:56.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.286+0000 7fc63d7fa640 1 -- 172.21.15.45:0/151252752 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16864 (secure 0 0 0) 0x7fc630057910 con 0x7fc6400c6fd0 2023-12-08T08:19:56.290 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:56.290 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:55.814825+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2233278871":"2023-12-09T08:19:52.532292+0000","172.21.15.45:6835/2233278871":"2023-12-09T08:19:52.532292+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 msgr2=0x7fc62006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 0x7fc62006d330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6401e8050 tx=0x7fc628008040 comp rx=0 tx=0).stop 2023-12-08T08:19:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 msgr2=0x7fc6400c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc63000c790 tx=0x7fc63000cc50 comp rx=0 tx=0).stop 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 shutdown_connections 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc62006ae70 0x7fc62006d330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc640154600 0x7fc64014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc640151c40 0x7fc64014ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 --2- 172.21.15.45:0/151252752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6400c6fd0 0x7fc6400c8e90 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 >> 172.21.15.45:0/151252752 conn(0x7fc6400ab8b0 msgr2=0x7fc6401526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.289+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 shutdown_connections 2023-12-08T08:19:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.290+0000 7fc646941640 1 -- 172.21.15.45:0/151252752 wait complete. 2023-12-08T08:19:56.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:14:53.770565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-08T08:19:12.067734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-08T08:19:13.403310+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:56.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:56.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.542+0000 7f39ea256640 1 Processor -- start 2023-12-08T08:19:56.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.542+0000 7f39ea256640 1 -- start start 2023-12-08T08:19:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.543+0000 7f39ea256640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.543+0000 7f39ea256640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39e40c8340 0x7f39e406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.543+0000 7f39ea256640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40c5040 con 0x7f39e4151ae0 2023-12-08T08:19:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.543+0000 7f39ea256640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e4155500 con 0x7f39e40c8340 2023-12-08T08:19:56.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.543+0000 7f39ea256640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4154740 con 0x7f39e406c3f0 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39e40c8340 0x7f39e406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39e40c8340 0x7f39e406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34188/0 (socket says 172.21.15.45:34188) 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 -- 172.21.15.45:0/4028195279 learned_addr learned my addr 172.21.15.45:0/4028195279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e2ffd640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 -- 172.21.15.45:0/4028195279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 msgr2=0x7f39e40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 -- 172.21.15.45:0/4028195279 >> v1:172.21.15.114:6789/0 conn(0x7f39e4151ae0 legacy=0x7f39e40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.544+0000 7f39e3fff640 1 -- 172.21.15.45:0/4028195279 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4154a20 con 0x7f39e40c8340 2023-12-08T08:19:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.545+0000 7f39e3fff640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e40c8340 0x7f39e406b080 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009870 tx=0x7f39dc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978501735c32ecda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.546+0000 7f39e27fc640 1 -- 172.21.15.45:0/4028195279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0317c0 con 0x7f39e40c8340 2023-12-08T08:19:56.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.546+0000 7f39e27fc640 1 -- 172.21.15.45:0/4028195279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc031920 con 0x7f39e40c8340 2023-12-08T08:19:56.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.546+0000 7f39e27fc640 1 -- 172.21.15.45:0/4028195279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc031cb0 con 0x7f39e40c8340 2023-12-08T08:19:56.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 -- 172.21.15.45:0/4028195279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e40c8340 msgr2=0x7f39e406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e40c8340 0x7f39e406b080 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009870 tx=0x7f39dc02b860 comp rx=0 tx=0).stop 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 -- 172.21.15.45:0/4028195279 shutdown_connections 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e40c8340 0x7f39e406b080 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 --2- 172.21.15.45:0/4028195279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 -- 172.21.15.45:0/4028195279 >> 172.21.15.45:0/4028195279 conn(0x7f39e4066ba0 msgr2=0x7f39e40ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 -- 172.21.15.45:0/4028195279 shutdown_connections 2023-12-08T08:19:56.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.547+0000 7f39ea256640 1 -- 172.21.15.45:0/4028195279 wait complete. 2023-12-08T08:19:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.549+0000 7f39ea256640 1 Processor -- start 2023-12-08T08:19:56.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.549+0000 7f39ea256640 1 -- start start 2023-12-08T08:19:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e41ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e40c8340 0x7f39e4147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40bfe50 con 0x7f39e4151ae0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40bf820 con 0x7f39e40c8340 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39ea256640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4158a40 con 0x7f39e406c3f0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34196/0 (socket says 172.21.15.45:34196) 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 -- 172.21.15.45:0/685534613 learned_addr learned my addr 172.21.15.45:0/685534613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e37fe640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e41ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e2ffd640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e40c8340 0x7f39e4147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 -- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 msgr2=0x7f39e41ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e41ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 -- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e40c8340 msgr2=0x7f39e4147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e40c8340 0x7f39e4147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.551+0000 7f39e3fff640 1 -- 172.21.15.45:0/685534613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0094d0 con 0x7f39e4151ae0 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39e3fff640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009870 tx=0x7f39dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc032860 con 0x7f39e4151ae0 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc0329c0 con 0x7f39e4151ae0 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc032d70 con 0x7f39e4151ae0 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e4148770 con 0x7f39e4151ae0 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.552+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e40c06e0 con 0x7f39e4151ae0 2023-12-08T08:19:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.554+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e40bff90 con 0x7f39e4151ae0 2023-12-08T08:19:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.554+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39dc0453f0 con 0x7f39e4151ae0 2023-12-08T08:19:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.555+0000 7f39dbfff640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.555+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f39dc0ab9c0 con 0x7f39e4151ae0 2023-12-08T08:19:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.556+0000 7f39e37fe640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.556+0000 7f39e37fe640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 0x7f39c406d300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f39e4148b90 tx=0x7f39d40094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.560+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39dc0769c0 con 0x7f39e4151ae0 2023-12-08T08:19:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.754+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39e4074670 con 0x7f39e4151ae0 2023-12-08T08:19:56.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.755+0000 7f39dbfff640 1 -- 172.21.15.45:0/685534613 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39dc079fe0 con 0x7f39e4151ae0 2023-12-08T08:19:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 msgr2=0x7f39c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 0x7f39c406d300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f39e4148b90 tx=0x7f39d40094d0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 msgr2=0x7f39e4148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009870 tx=0x7f39dc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 shutdown_connections 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e4151ae0 0x7f39e4148230 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e40c8340 0x7f39e4147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 --2- 172.21.15.45:0/685534613 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f39e406c3f0 0x7f39e41ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 >> 172.21.15.45:0/685534613 conn(0x7f39e4066ba0 msgr2=0x7f39e40bd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 shutdown_connections 2023-12-08T08:19:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:56.758+0000 7f39ea256640 1 -- 172.21.15.45:0/685534613 wait complete. 2023-12-08T08:19:56.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-08T08:19:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.022+0000 7f826ab4e640 1 Processor -- start 2023-12-08T08:19:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.022+0000 7f826ab4e640 1 -- start start 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.024+0000 7f826ab4e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 0x7f82640a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.024+0000 7f826ab4e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.024+0000 7f826ab4e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82640c60c0 con 0x7f82640c4970 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.024+0000 7f826ab4e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8264152dc0 con 0x7f826414c280 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.024+0000 7f826ab4e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82641521d0 con 0x7f8264155790 2023-12-08T08:19:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f8269b4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 0x7f82640a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f826a34d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f8269b4c640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 0x7f82640a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:51610/0 (socket says 172.21.15.45:51610) 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f826a34d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:59020/0 (socket says 172.21.15.45:59020) 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f8269b4c640 1 -- 172.21.15.45:0/1730675740 learned_addr learned my addr 172.21.15.45:0/1730675740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f826a34d640 1 -- 172.21.15.45:0/1730675740 >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 msgr2=0x7f82640a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.025+0000 7f826a34d640 1 --2- 172.21.15.45:0/1730675740 >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 0x7f82640a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.026+0000 7f826a34d640 1 -- 172.21.15.45:0/1730675740 >> v1:172.21.15.114:6789/0 conn(0x7f82640c4970 legacy=0x7f826406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.026+0000 7f826a34d640 1 -- 172.21.15.45:0/1730675740 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826414c660 con 0x7f8264155790 2023-12-08T08:19:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.027+0000 7f826a34d640 1 --2- 172.21.15.45:0/1730675740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f825c009d90 tx=0x7f825c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1deab8f4c27f3629 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f8268b4a640 1 -- 172.21.15.45:0/1730675740 <== mon.2 v2:172.21.15.114:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c02cbc0 con 0x7f8264155790 2023-12-08T08:19:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f8268b4a640 1 -- 172.21.15.45:0/1730675740 <== mon.2 v2:172.21.15.114:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c02cd20 con 0x7f8264155790 2023-12-08T08:19:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f8268b4a640 1 -- 172.21.15.45:0/1730675740 <== mon.2 v2:172.21.15.114:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c034660 con 0x7f8264155790 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 -- 172.21.15.45:0/1730675740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 msgr2=0x7f8264155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 --2- 172.21.15.45:0/1730675740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f825c009d90 tx=0x7f825c02be10 comp rx=0 tx=0).stop 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 -- 172.21.15.45:0/1730675740 shutdown_connections 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 --2- 172.21.15.45:0/1730675740 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f8264155be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 --2- 172.21.15.45:0/1730675740 >> v2:172.21.15.114:3300/0 conn(0x7f826414c280 0x7f82640a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 -- 172.21.15.45:0/1730675740 >> 172.21.15.45:0/1730675740 conn(0x7f8264066ce0 msgr2=0x7f82640a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.028+0000 7f826ab4e640 1 -- 172.21.15.45:0/1730675740 shutdown_connections 2023-12-08T08:19:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.029+0000 7f826ab4e640 1 -- 172.21.15.45:0/1730675740 wait complete. 2023-12-08T08:19:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.030+0000 7f826ab4e640 1 Processor -- start 2023-12-08T08:19:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 -- start start 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 0x7f8264154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f826414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826414d610 con 0x7f826414c280 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82641e7750 con 0x7f82640c4970 2023-12-08T08:19:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.031+0000 7f826ab4e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640a68d0 con 0x7f8264155790 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34208/0 (socket says 172.21.15.45:34208) 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 -- 172.21.15.45:0/3396834516 learned_addr learned my addr 172.21.15.45:0/3396834516 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826a34d640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f826414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f8269b4c640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 0x7f8264154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 -- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 msgr2=0x7f826414c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f826414c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 -- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 msgr2=0x7f8264154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 0x7f8264154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f826934b640 1 -- 172.21.15.45:0/3396834516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c009a70 con 0x7f826414c280 2023-12-08T08:19:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.032+0000 7f8269b4c640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 0x7f8264154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f826934b640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f825400c400 tx=0x7f825400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540052d0 con 0x7f826414c280 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254005430 con 0x7f826414c280 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254003830 con 0x7f826414c280 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82641e7f90 con 0x7f826414c280 2023-12-08T08:19:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.033+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82640a55c0 con 0x7f826414c280 2023-12-08T08:19:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.035+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82641e8120 con 0x7f826414c280 2023-12-08T08:19:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.036+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8254003990 con 0x7f826414c280 2023-12-08T08:19:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.037+0000 7f825a7fc640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 0x7f824806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.037+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8254088b20 con 0x7f826414c280 2023-12-08T08:19:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.037+0000 7f8269b4c640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 0x7f824806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.038+0000 7f8269b4c640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 0x7f824806d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8260009ac0 tx=0x7f8260008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.041+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8254053aa0 con 0x7f826414c280 2023-12-08T08:19:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.234+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82640c60c0 con 0x7f826414c280 2023-12-08T08:19:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.235+0000 7f825a7fc640 1 -- 172.21.15.45:0/3396834516 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v88) v1 ==== 105+0+11 (secure 0 0 0) 0x7f82640c60c0 con 0x7f826414c280 2023-12-08T08:19:57.239 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-08T08:19:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 msgr2=0x7f824806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 0x7f824806d300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8260009ac0 tx=0x7f8260008040 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 msgr2=0x7f82640a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f825400c400 tx=0x7f825400c8c0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 shutdown_connections 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f824806ae40 0x7f824806d300 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8264155790 0x7f826414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826414c280 0x7f82640a6a70 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 --2- 172.21.15.45:0/3396834516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82640c4970 0x7f8264154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 >> 172.21.15.45:0/3396834516 conn(0x7f8264066ce0 msgr2=0x7f82640c53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 shutdown_connections 2023-12-08T08:19:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.239+0000 7f826ab4e640 1 -- 172.21.15.45:0/3396834516 wait complete. 2023-12-08T08:19:57.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.475+0000 7f512bfff640 1 Processor -- start 2023-12-08T08:19:57.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.475+0000 7f512bfff640 1 -- start start 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f512bfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f512c14c280 0x7f512c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f512bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f512c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f512bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c0c60c0 con 0x7f512c0c4970 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f512bfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c152dc0 con 0x7f512c14c280 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f512bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1521d0 con 0x7f512c155790 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f5123fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f512c0c4970 0x7f512c06cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51734/0 (socket says 172.21.15.45:51734) 2023-12-08T08:19:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.477+0000 7f5123fff640 1 -- 172.21.15.45:0/1380181518 learned_addr learned my addr 172.21.15.45:0/1380181518 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:57.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500976971 0 0) 0x7f5114001110 con 0x7f512c0c4970 2023-12-08T08:19:57.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512affd640 1 --2- 172.21.15.45:0/1380181518 >> v2:172.21.15.114:3300/0 conn(0x7f512c14c280 0x7f512c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512b7fe640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f512c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5118003520 con 0x7f512c0c4970 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438298240 0 0) 0x7f5118003520 con 0x7f512c0c4970 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 msgr2=0x7f512c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f512c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 >> v2:172.21.15.114:3300/0 conn(0x7f512c14c280 msgr2=0x7f512c0a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.478+0000 7f512a7fc640 1 --2- 172.21.15.45:0/1380181518 >> v2:172.21.15.114:3300/0 conn(0x7f512c14c280 0x7f512c0a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c14c660 con 0x7f512c0c4970 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f5114001800 con 0x7f512c0c4970 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512affd640 1 --2- 172.21.15.45:0/1380181518 >> v2:172.21.15.114:3300/0 conn(0x7f512c14c280 0x7f512c0a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 >> v1:172.21.15.45:6789/0 conn(0x7f512c0c4970 legacy=0x7f512c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f5118003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5118003ef0 0x7f51180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118004d00 0x7f5118005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c152dc0 con 0x7f5118003ef0 2023-12-08T08:19:57.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1521d0 con 0x7f5118004d00 2023-12-08T08:19:57.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511800ba80 con 0x7f512c155790 2023-12-08T08:19:57.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f5123fff640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5118003ef0 0x7f51180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512affd640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f5118003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.479+0000 7f512b7fe640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118004d00 0x7f5118005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f5123fff640 1 -- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 msgr2=0x7f5118003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f5123fff640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c155790 0x7f5118003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f5123fff640 1 -- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118004d00 msgr2=0x7f5118005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f5123fff640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118004d00 0x7f5118005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f5123fff640 1 -- 172.21.15.45:0/1380181518 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118003520 con 0x7f5118003ef0 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.480+0000 7f512b7fe640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118004d00 0x7f5118005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:57.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.481+0000 7f5123fff640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5118003ef0 0x7f51180047c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f511400c240 tx=0x7f51180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf10554a966ca5b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.481+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114005ad0 con 0x7f5118003ef0 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.481+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114005c30 con 0x7f5118003ef0 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.481+0000 7f512a7fc640 1 -- 172.21.15.45:0/1380181518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511402c8b0 con 0x7f5118003ef0 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 -- 172.21.15.45:0/1380181518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5118003ef0 msgr2=0x7f51180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 --2- 172.21.15.45:0/1380181518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5118003ef0 0x7f51180047c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f511400c240 tx=0x7f51180057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512b7fe640 1 -- 172.21.15.45:0/1380181518 reap_dead start 2023-12-08T08:19:57.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 -- 172.21.15.45:0/1380181518 shutdown_connections 2023-12-08T08:19:57.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 -- 172.21.15.45:0/1380181518 >> 172.21.15.45:0/1380181518 conn(0x7f512c066ce0 msgr2=0x7f512c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 -- 172.21.15.45:0/1380181518 shutdown_connections 2023-12-08T08:19:57.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.482+0000 7f512bfff640 1 -- 172.21.15.45:0/1380181518 wait complete. 2023-12-08T08:19:57.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.484+0000 7f512bfff640 1 Processor -- start 2023-12-08T08:19:57.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.484+0000 7f512bfff640 1 -- start start 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118003ef0 0x7f512c0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c151d80 0x7f512c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0c00e0 con 0x7f512c153b00 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c155120 con 0x7f5118003ef0 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c1ea740 con 0x7f512c151d80 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34222/0 (socket says 172.21.15.45:34222) 2023-12-08T08:19:57.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.485+0000 7f512b7fe640 1 -- 172.21.15.45:0/706960391 learned_addr learned my addr 172.21.15.45:0/706960391 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 -- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c151d80 msgr2=0x7f512c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c151d80 0x7f512c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 -- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118003ef0 msgr2=0x7f512c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118003ef0 0x7f512c0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 -- 172.21.15.45:0/706960391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c1eaa20 con 0x7f512c153b00 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f512b7fe640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f512c06c8c0 tx=0x7f5124010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400e050 con 0x7f512c153b00 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.486+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512400f040 con 0x7f512c153b00 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.487+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124003990 con 0x7f512c153b00 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.487+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c0c0330 con 0x7f512c153b00 2023-12-08T08:19:57.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.487+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c0aa190 con 0x7f512c153b00 2023-12-08T08:19:57.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.488+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c0678c0 con 0x7f512c153b00 2023-12-08T08:19:57.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.489+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5124015440 con 0x7f512c153b00 2023-12-08T08:19:57.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.490+0000 7f5128ff9640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 0x7f510c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.490+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5124089d10 con 0x7f512c153b00 2023-12-08T08:19:57.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.490+0000 7f512affd640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 0x7f510c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.491+0000 7f512affd640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 0x7f510c06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f511c006a90 tx=0x7f511c006a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.494+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5124054bf0 con 0x7f512c153b00 2023-12-08T08:19:57.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.687+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f512c1eabb0 con 0x7f512c153b00 2023-12-08T08:19:57.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.687+0000 7f5128ff9640 1 -- 172.21.15.45:0/706960391 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v88) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5124058210 con 0x7f512c153b00 2023-12-08T08:19:57.690 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-08T08:19:57.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 msgr2=0x7f510c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 0x7f510c06d330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f511c006a90 tx=0x7f511c006a20 comp rx=0 tx=0).stop 2023-12-08T08:19:57.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 msgr2=0x7f512c0c1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f512c06c8c0 tx=0x7f5124010590 comp rx=0 tx=0).stop 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 shutdown_connections 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f510c06ae70 0x7f510c06d330 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f512c151d80 0x7f512c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f512c153b00 0x7f512c0c1530 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 --2- 172.21.15.45:0/706960391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5118003ef0 0x7f512c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.690+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 >> 172.21.15.45:0/706960391 conn(0x7f512c066ce0 msgr2=0x7f512c147630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.691+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 shutdown_connections 2023-12-08T08:19:57.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.691+0000 7f512bfff640 1 -- 172.21.15.45:0/706960391 wait complete. 2023-12-08T08:19:57.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.931+0000 7fa3f7547640 1 Processor -- start 2023-12-08T08:19:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.931+0000 7fa3f7547640 1 -- start start 2023-12-08T08:19:57.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.932+0000 7fa3f7547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3f00a7910 0x7fa3f00c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f7547640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3f01521b0 0x7fa3f0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f7547640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f0155850 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f7547640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00c0890 con 0x7fa3f00a7910 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f7547640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00c0b70 con 0x7fa3f01521b0 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3f00a7910 0x7fa3f00c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3f00a7910 0x7fa3f00c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34238/0 (socket says 172.21.15.45:34238) 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 -- 172.21.15.45:0/410419678 learned_addr learned my addr 172.21.15.45:0/410419678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6d46640 1 --2- 172.21.15.45:0/410419678 >> v2:172.21.15.114:3300/0 conn(0x7fa3f01521b0 0x7fa3f0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 -- 172.21.15.45:0/410419678 >> v2:172.21.15.114:3300/0 conn(0x7fa3f01521b0 msgr2=0x7fa3f0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 --2- 172.21.15.45:0/410419678 >> v2:172.21.15.114:3300/0 conn(0x7fa3f01521b0 0x7fa3f0155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 -- 172.21.15.45:0/410419678 >> v1:172.21.15.114:6789/0 conn(0x7fa3f00c1dc0 legacy=0x7fa3f014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:57.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.933+0000 7fa3f6545640 1 -- 172.21.15.45:0/410419678 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00c0e50 con 0x7fa3f00a7910 2023-12-08T08:19:57.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.935+0000 7fa3f6545640 1 --2- 172.21.15.45:0/410419678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00a7910 0x7fa3f00c1880 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fa3f006d960 tx=0x7fa3ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbdd436b0799a3d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.935+0000 7fa3f5543640 1 -- 172.21.15.45:0/410419678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0317e0 con 0x7fa3f00a7910 2023-12-08T08:19:57.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.935+0000 7fa3f5543640 1 -- 172.21.15.45:0/410419678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec031940 con 0x7fa3f00a7910 2023-12-08T08:19:57.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.935+0000 7fa3f5543640 1 -- 172.21.15.45:0/410419678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec031cd0 con 0x7fa3f00a7910 2023-12-08T08:19:57.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 -- 172.21.15.45:0/410419678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00a7910 msgr2=0x7fa3f00c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 --2- 172.21.15.45:0/410419678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00a7910 0x7fa3f00c1880 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fa3f006d960 tx=0x7fa3ec02b880 comp rx=0 tx=0).stop 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 -- 172.21.15.45:0/410419678 shutdown_connections 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 --2- 172.21.15.45:0/410419678 >> v2:172.21.15.114:3300/0 conn(0x7fa3f01521b0 0x7fa3f0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 --2- 172.21.15.45:0/410419678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00a7910 0x7fa3f00c1880 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 -- 172.21.15.45:0/410419678 >> 172.21.15.45:0/410419678 conn(0x7fa3f00c5780 msgr2=0x7fa3f00c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 -- 172.21.15.45:0/410419678 shutdown_connections 2023-12-08T08:19:57.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.936+0000 7fa3f7547640 1 -- 172.21.15.45:0/410419678 wait complete. 2023-12-08T08:19:57.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.938+0000 7fa3f7547640 1 Processor -- start 2023-12-08T08:19:57.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.938+0000 7fa3f7547640 1 -- start start 2023-12-08T08:19:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3f00a7910 0x7fa3f01eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f01521b0 0x7fa3f00a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01eb540 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f009c110 con 0x7fa3f01521b0 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f7547640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f009bb50 con 0x7fa3f00a7910 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34246/0 (socket says 172.21.15.45:34246) 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 -- 172.21.15.45:0/2737540150 learned_addr learned my addr 172.21.15.45:0/2737540150 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f6545640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3f00a7910 0x7fa3f01eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 -- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3f00a7910 msgr2=0x7fa3f01eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f6d46640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f01521b0 0x7fa3f00a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3f00a7910 0x7fa3f01eb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 -- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f01521b0 msgr2=0x7fa3f00a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f01521b0 0x7fa3f00a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.939+0000 7fa3f5d44640 1 -- 172.21.15.45:0/2737540150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0094d0 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3f5d44640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c400 tx=0x7fa3e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00035f0 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0003750 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0003b40 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f009be30 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.940+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f00a7150 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.941+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00a7370 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.942+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3e0003ca0 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.943+0000 7fa3e6ffd640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 0x7fa3d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.943+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa3e00889c0 con 0x7fa3f00c1dc0 2023-12-08T08:19:57.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.943+0000 7fa3f6545640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 0x7fa3d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:57.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.944+0000 7fa3f6545640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 0x7fa3d406d300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec036000 tx=0x7fa3ec03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:57.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:57.947+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3e0053950 con 0x7fa3f00c1dc0 2023-12-08T08:19:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.177+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3f01525c0 con 0x7fa3f00c1dc0 2023-12-08T08:19:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.178+0000 7fa3e6ffd640 1 -- 172.21.15.45:0/2737540150 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fa3e0017090 con 0x7fa3f00c1dc0 2023-12-08T08:19:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:58.181 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7401,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3920740127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3920740127},{"type":"v1","addr":"172.21.15.45:6837","nonce":3920740127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:58.181 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 55 2023-12-08T08:19:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 msgr2=0x7fa3d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 0x7fa3d406d300 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec036000 tx=0x7fa3ec03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 msgr2=0x7fa3f0071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c400 tx=0x7fa3e000c8c0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 shutdown_connections 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa3d406ae40 0x7fa3d406d300 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f01521b0 0x7fa3f00a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f00c1dc0 0x7fa3f0071c80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 --2- 172.21.15.45:0/2737540150 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa3f00a7910 0x7fa3f01eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.180+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 >> 172.21.15.45:0/2737540150 conn(0x7fa3f00c5780 msgr2=0x7fa3f0150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.181+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 shutdown_connections 2023-12-08T08:19:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.181+0000 7fa3f7547640 1 -- 172.21.15.45:0/2737540150 wait complete. 2023-12-08T08:19:58.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:58.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.428+0000 7fab4d87e640 1 Processor -- start 2023-12-08T08:19:58.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.428+0000 7fab4d87e640 1 -- start start 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4d87e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab480c7370 0x7fab48155740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4d87e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab48155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4d87e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480c7ac0 con 0x7fab480af170 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4d87e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab480c6ef0 con 0x7fab480c7370 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4d87e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c7d10 con 0x7fab480bd270 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4c87c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fab480af170 0x7fab480c4540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51750/0 (socket says 172.21.15.45:51750) 2023-12-08T08:19:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.429+0000 7fab4c87c640 1 -- 172.21.15.45:0/154112404 learned_addr learned my addr 172.21.15.45:0/154112404 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:58.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab47fff640 1 --2- 172.21.15.45:0/154112404 >> v2:172.21.15.114:3300/0 conn(0x7fab480c7370 0x7fab48155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245725082 0 0) 0x7fab480c7ac0 con 0x7fab480af170 2023-12-08T08:19:58.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab34003520 con 0x7fab480af170 2023-12-08T08:19:58.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab4d07d640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab48155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705952673 0 0) 0x7fab34003520 con 0x7fab480af170 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 msgr2=0x7fab48155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab48155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 >> v2:172.21.15.114:3300/0 conn(0x7fab480c7370 msgr2=0x7fab48155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 --2- 172.21.15.45:0/154112404 >> v2:172.21.15.114:3300/0 conn(0x7fab480c7370 0x7fab48155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48154360 con 0x7fab480af170 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fab380019f0 con 0x7fab480af170 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 >> v1:172.21.15.45:6789/0 conn(0x7fab480af170 legacy=0x7fab480c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.430+0000 7fab477fe640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab34003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab477fe640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab34003f40 0x7fab340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab477fe640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab34004d00 0x7fab34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c6ef0 con 0x7fab34003f40 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c7d10 con 0x7fab34004d00 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3400bb60 con 0x7fab480bd270 2023-12-08T08:19:58.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab34003f40 0x7fab340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab4c87c640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab34003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 -- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 msgr2=0x7fab34003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab4d07d640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab34004d00 0x7fab34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab34003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 -- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab34004d00 msgr2=0x7fab34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab34004d00 0x7fab34005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab47fff640 1 -- 172.21.15.45:0/154112404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34003520 con 0x7fab34003f40 2023-12-08T08:19:58.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.431+0000 7fab4c87c640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab480bd270 0x7fab34003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.433+0000 7fab47fff640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab34003f40 0x7fab340047c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fab30009a90 tx=0x7fab340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e10b780febcd140 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.433+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3002c6d0 con 0x7fab34003f40 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.433+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3002c830 con 0x7fab34003f40 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.433+0000 7fab477fe640 1 -- 172.21.15.45:0/154112404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3002cbe0 con 0x7fab34003f40 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 -- 172.21.15.45:0/154112404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab34003f40 msgr2=0x7fab340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 --2- 172.21.15.45:0/154112404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab34003f40 0x7fab340047c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fab30009a90 tx=0x7fab340057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d07d640 1 -- 172.21.15.45:0/154112404 reap_dead start 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 -- 172.21.15.45:0/154112404 shutdown_connections 2023-12-08T08:19:58.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 -- 172.21.15.45:0/154112404 >> 172.21.15.45:0/154112404 conn(0x7fab480661f0 msgr2=0x7fab48066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 -- 172.21.15.45:0/154112404 shutdown_connections 2023-12-08T08:19:58.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.434+0000 7fab4d87e640 1 -- 172.21.15.45:0/154112404 wait complete. 2023-12-08T08:19:58.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.436+0000 7fab4d87e640 1 Processor -- start 2023-12-08T08:19:58.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.436+0000 7fab4d87e640 1 -- start start 2023-12-08T08:19:58.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab34003f40 0x7fab48156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab480c1030 0x7fab48156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48155640 con 0x7fab481e9650 2023-12-08T08:19:58.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48155890 con 0x7fab480c1030 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d87e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48155b70 con 0x7fab34003f40 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d07d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d07d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34272/0 (socket says 172.21.15.45:34272) 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4d07d640 1 -- 172.21.15.45:0/4033453681 learned_addr learned my addr 172.21.15.45:0/4033453681 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab47fff640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab480c1030 0x7fab48156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.438+0000 7fab4c87c640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab34003f40 0x7fab48156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 -- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab34003f40 msgr2=0x7fab48156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab34003f40 0x7fab48156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 -- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab480c1030 msgr2=0x7fab48156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab480c1030 0x7fab48156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 -- 172.21.15.45:0/4033453681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48155e50 con 0x7fab481e9650 2023-12-08T08:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d07d640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fab480c67a0 tx=0x7fab4000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000c070 con 0x7fab481e9650 2023-12-08T08:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40013610 con 0x7fab481e9650 2023-12-08T08:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400139c0 con 0x7fab481e9650 2023-12-08T08:19:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.439+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48156130 con 0x7fab481e9650 2023-12-08T08:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.440+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48150b40 con 0x7fab481e9650 2023-12-08T08:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.441+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48156320 con 0x7fab481e9650 2023-12-08T08:19:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.442+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab40013b20 con 0x7fab481e9650 2023-12-08T08:19:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.443+0000 7fab457fa640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 0x7fab2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.443+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fab400891b0 con 0x7fab481e9650 2023-12-08T08:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.443+0000 7fab4c87c640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 0x7fab2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.444+0000 7fab4c87c640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 0x7fab2806d300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fab38001370 tx=0x7fab38009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.447+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab40054130 con 0x7fab481e9650 2023-12-08T08:19:58.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.643+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab480743e0 con 0x7fab481e9650 2023-12-08T08:19:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.646+0000 7fab457fa640 1 -- 172.21.15.45:0/4033453681 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16864 (secure 0 0 0) 0x7fab40006c30 con 0x7fab481e9650 2023-12-08T08:19:58.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:55.814825+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2233278871":"2023-12-09T08:19:52.532292+0000","172.21.15.45:6835/2233278871":"2023-12-09T08:19:52.532292+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 msgr2=0x7fab2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 0x7fab2806d300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fab38001370 tx=0x7fab38009040 comp rx=0 tx=0).stop 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 msgr2=0x7fab48157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fab480c67a0 tx=0x7fab4000e830 comp rx=0 tx=0).stop 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 shutdown_connections 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fab2806ae40 0x7fab2806d300 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab481e9650 0x7fab48157a50 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab480c1030 0x7fab48156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 --2- 172.21.15.45:0/4033453681 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fab34003f40 0x7fab48156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 >> 172.21.15.45:0/4033453681 conn(0x7fab480661f0 msgr2=0x7fab480a95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 shutdown_connections 2023-12-08T08:19:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.649+0000 7fab4d87e640 1 -- 172.21.15.45:0/4033453681 wait complete. 2023-12-08T08:19:58.672 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-08T08:19:58.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.897+0000 7fe651783640 1 Processor -- start 2023-12-08T08:19:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.897+0000 7fe651783640 1 -- start start 2023-12-08T08:19:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.898+0000 7fe651783640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe64c151c10 0x7fe64c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.898+0000 7fe651783640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe64c0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.898+0000 7fe651783640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c0c9290 con 0x7fe64c0c8470 2023-12-08T08:19:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.898+0000 7fe651783640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c0c56a0 con 0x7fe64c151c10 2023-12-08T08:19:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.898+0000 7fe651783640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0c5250 con 0x7fe64c0c9720 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe64b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe64c0c8470 0x7fe64c157b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51758/0 (socket says 172.21.15.45:51758) 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe64b7fe640 1 -- 172.21.15.45:0/3939932805 learned_addr learned my addr 172.21.15.45:0/3939932805 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe64affd640 1 --2- 172.21.15.45:0/3939932805 >> v2:172.21.15.114:3300/0 conn(0x7fe64c151c10 0x7fe64c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe64c0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837877460 0 0) 0x7fe64c0c9290 con 0x7fe64c0c8470 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.899+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe638003520 con 0x7fe64c0c8470 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135869579 0 0) 0x7fe638003520 con 0x7fe64c0c8470 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 msgr2=0x7fe64c0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe64c0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 >> v2:172.21.15.114:3300/0 conn(0x7fe64c151c10 msgr2=0x7fe64c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 --2- 172.21.15.45:0/3939932805 >> v2:172.21.15.114:3300/0 conn(0x7fe64c151c10 0x7fe64c0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c151ff0 con 0x7fe64c0c8470 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fe644001670 con 0x7fe64c0c8470 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 >> v1:172.21.15.45:6789/0 conn(0x7fe64c0c8470 legacy=0x7fe64c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe638003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380047c0 0x7fe638004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe638005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0c56a0 con 0x7fe6380039a0 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0c5250 con 0x7fe6380047c0 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63800b9d0 con 0x7fe64c0c9720 2023-12-08T08:19:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.900+0000 7fe64affd640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe638003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64b7fe640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe638005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380047c0 0x7fe638004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64affd640 1 -- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 msgr2=0x7fe638005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64affd640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe638005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64affd640 1 -- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380047c0 msgr2=0x7fe638004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64affd640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380047c0 0x7fe638004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64affd640 1 -- 172.21.15.45:0/3939932805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638003520 con 0x7fe6380039a0 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6380047c0 0x7fe638004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.901+0000 7fe64b7fe640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c9720 0x7fe638005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.902+0000 7fe64affd640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe638003dc0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00e170 tx=0x7fe6380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32bd5f8192c7640 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.902+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02cc30 con 0x7fe6380039a0 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.902+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c00f040 con 0x7fe6380039a0 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.902+0000 7fe649ffb640 1 -- 172.21.15.45:0/3939932805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c034440 con 0x7fe6380039a0 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 -- 172.21.15.45:0/3939932805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 msgr2=0x7fe638003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 --2- 172.21.15.45:0/3939932805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe638003dc0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00e170 tx=0x7fe6380057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe64b7fe640 1 -- 172.21.15.45:0/3939932805 reap_dead start 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 -- 172.21.15.45:0/3939932805 shutdown_connections 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 -- 172.21.15.45:0/3939932805 >> 172.21.15.45:0/3939932805 conn(0x7fe64c0ab9c0 msgr2=0x7fe64c0abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 -- 172.21.15.45:0/3939932805 shutdown_connections 2023-12-08T08:19:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.903+0000 7fe651783640 1 -- 172.21.15.45:0/3939932805 wait complete. 2023-12-08T08:19:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.905+0000 7fe651783640 1 Processor -- start 2023-12-08T08:19:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.905+0000 7fe651783640 1 -- start start 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 0x7fe64c1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 0x7fe64c1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c152990 con 0x7fe6380039a0 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c152c70 con 0x7fe64c0c0ee0 2023-12-08T08:19:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe651783640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c155360 con 0x7fe64c0c3b80 2023-12-08T08:19:58.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.906+0000 7fe64affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34300/0 (socket says 172.21.15.45:34300) 2023-12-08T08:19:58.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 -- 172.21.15.45:0/3181587559 learned_addr learned my addr 172.21.15.45:0/3181587559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64b7fe640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 0x7fe64c1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 0x7fe64c1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 -- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 msgr2=0x7fe64c1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 0x7fe64c1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 -- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 msgr2=0x7fe64c1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 0x7fe64c1487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 -- 172.21.15.45:0/3181587559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0c20c0 con 0x7fe6380039a0 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64b7fe640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 0x7fe64c1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 0x7fe64c1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.907+0000 7fe64affd640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe63c037040 tx=0x7fe63c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.908+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c040450 con 0x7fe6380039a0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.908+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c0405b0 con 0x7fe6380039a0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.908+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c040960 con 0x7fe6380039a0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.908+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c0c23a0 con 0x7fe6380039a0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.908+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c148d20 con 0x7fe6380039a0 2023-12-08T08:19:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.909+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c074600 con 0x7fe6380039a0 2023-12-08T08:19:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.910+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe63c040ac0 con 0x7fe6380039a0 2023-12-08T08:19:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.912+0000 7fe6437fe640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 0x7fe62c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.912+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe63c0abf90 con 0x7fe6380039a0 2023-12-08T08:19:58.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.912+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 0x7fe62c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.913+0000 7fe64a7fc640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 0x7fe62c06d380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0bd040 tx=0x7fe634008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:58.916+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe63c076ef0 con 0x7fe6380039a0 2023-12-08T08:19:59.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.151+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe64c0c9bb0 con 0x7fe6380039a0 2023-12-08T08:19:59.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.152+0000 7fe6437fe640 1 -- 172.21.15.45:0/3181587559 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fe63c07a510 con 0x7fe6380039a0 2023-12-08T08:19:59.155 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:59.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7401,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3920740127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3920740127},{"type":"v1","addr":"172.21.15.45:6837","nonce":3920740127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:59.155 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 55 2023-12-08T08:19:59.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 msgr2=0x7fe62c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 0x7fe62c06d380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0bd040 tx=0x7fe634008040 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 msgr2=0x7fe64c0c3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe63c037040 tx=0x7fe63c009750 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 shutdown_connections 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe62c06aec0 0x7fe62c06d380 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe64c0c3b80 0x7fe64c1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64c0c0ee0 0x7fe64c1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 --2- 172.21.15.45:0/3181587559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6380039a0 0x7fe64c0c3640 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 >> 172.21.15.45:0/3181587559 conn(0x7fe64c0ab9c0 msgr2=0x7fe64c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 shutdown_connections 2023-12-08T08:19:59.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.155+0000 7fe651783640 1 -- 172.21.15.45:0/3181587559 wait complete. 2023-12-08T08:19:59.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:59.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:59.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.402+0000 7fddfdc56640 1 Processor -- start 2023-12-08T08:19:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.402+0000 7fddfdc56640 1 -- start start 2023-12-08T08:19:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddfdc56640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddf80a6e50 0x7fddf80a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddfdc56640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddfdc56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80706b0 con 0x7fddf8155fb0 2023-12-08T08:19:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddfdc56640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80c6210 con 0x7fddf80a6e50 2023-12-08T08:19:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddfdc56640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80700f0 con 0x7fddf80acb40 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddf6ffd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddf6ffd640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3301/0 says I am v2:172.21.15.45:59120/0 (socket says 172.21.15.45:59120) 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddf6ffd640 1 -- 172.21.15.45:0/45280072 learned_addr learned my addr 172.21.15.45:0/45280072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.403+0000 7fddf7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fddf8155fb0 0x7fddf80c66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51768/0 (socket says 172.21.15.45:51768) 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf77fe640 1 --2- 172.21.15.45:0/45280072 >> v2:172.21.15.114:3300/0 conn(0x7fddf80a6e50 0x7fddf80a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf67fc640 1 -- 172.21.15.45:0/45280072 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900350121 0 0) 0x7fddf80706b0 con 0x7fddf8155fb0 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf67fc640 1 -- 172.21.15.45:0/45280072 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde0003520 con 0x7fddf8155fb0 2023-12-08T08:19:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf77fe640 1 -- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 msgr2=0x7fddf8155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf77fe640 1 --2- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf77fe640 1 -- 172.21.15.45:0/45280072 >> v1:172.21.15.45:6789/0 conn(0x7fddf8155fb0 legacy=0x7fddf80c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.404+0000 7fddf77fe640 1 -- 172.21.15.45:0/45280072 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80703d0 con 0x7fddf80a6e50 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.405+0000 7fddf77fe640 1 --2- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf80a6e50 0x7fddf80a7230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdde80097a0 tx=0x7fdde802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404d742eb8d8a97f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.406+0000 7fddf67fc640 1 -- 172.21.15.45:0/45280072 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde802e070 con 0x7fddf80a6e50 2023-12-08T08:19:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.406+0000 7fddf67fc640 1 -- 172.21.15.45:0/45280072 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde80315a0 con 0x7fddf80a6e50 2023-12-08T08:19:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.406+0000 7fddf67fc640 1 -- 172.21.15.45:0/45280072 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8031930 con 0x7fddf80a6e50 2023-12-08T08:19:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.406+0000 7fddfdc56640 1 -- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf80a6e50 msgr2=0x7fddf80a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.406+0000 7fddfdc56640 1 --2- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf80a6e50 0x7fddf80a7230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdde80097a0 tx=0x7fdde802b840 comp rx=0 tx=0).stop 2023-12-08T08:19:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 -- 172.21.15.45:0/45280072 shutdown_connections 2023-12-08T08:19:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 --2- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 --2- 172.21.15.45:0/45280072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf80a6e50 0x7fddf80a7230 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 -- 172.21.15.45:0/45280072 >> 172.21.15.45:0/45280072 conn(0x7fddf80a98a0 msgr2=0x7fddf80a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 -- 172.21.15.45:0/45280072 shutdown_connections 2023-12-08T08:19:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.407+0000 7fddfdc56640 1 -- 172.21.15.45:0/45280072 wait complete. 2023-12-08T08:19:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.408+0000 7fddfdc56640 1 Processor -- start 2023-12-08T08:19:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.408+0000 7fddfdc56640 1 -- start start 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf8155fb0 0x7fddf8150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81512e0 con 0x7fddf80a6e50 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c3d70 con 0x7fddf8155fb0 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.409+0000 7fddfdc56640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c31c0 con 0x7fddf80acb40 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34308/0 (socket says 172.21.15.45:34308) 2023-12-08T08:19:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 -- 172.21.15.45:0/3467214772 learned_addr learned my addr 172.21.15.45:0/3467214772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf6ffd640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf7fff640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf8155fb0 0x7fddf8150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 -- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 msgr2=0x7fddf8151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 -- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf8155fb0 msgr2=0x7fddf8150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf8155fb0 0x7fddf8150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.410+0000 7fddf77fe640 1 -- 172.21.15.45:0/3467214772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009400 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fddf77fe640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034040 tx=0x7fdde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8032840 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8031f00 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8032c00 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80c37b0 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.411+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80c45d0 con 0x7fddf80a6e50 2023-12-08T08:19:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.413+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80c3610 con 0x7fddf80a6e50 2023-12-08T08:19:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.414+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdde804e430 con 0x7fddf80a6e50 2023-12-08T08:19:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.414+0000 7fdddffff640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 0x7fdde406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.415+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fdde80ab4f0 con 0x7fddf80a6e50 2023-12-08T08:19:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.415+0000 7fddf6ffd640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 0x7fdde406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.416+0000 7fddf6ffd640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 0x7fdde406d300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fddf806f450 tx=0x7fddec009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.419+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddf80c3610 con 0x7fddf80a6e50 2023-12-08T08:19:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.651+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddf80c3610 con 0x7fddf80a6e50 2023-12-08T08:19:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.652+0000 7fdddffff640 1 -- 172.21.15.45:0/3467214772 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fddf80c3610 con 0x7fddf80a6e50 2023-12-08T08:19:59.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:19:59.655 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7401,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3920740127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3920740127},{"type":"v1","addr":"172.21.15.45:6837","nonce":3920740127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:14.387540+0000","modified":"2023-12-08T08:19:17.494014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6744},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6744":{"gid":6744,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.45:6836/1751024054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1751024054},{"type":"v1","addr":"172.21.15.45:6836","nonce":1751024054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-08T08:19:59.655 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 55 2023-12-08T08:19:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.654+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 msgr2=0x7fdde406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.654+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 0x7fdde406d300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fddf806f450 tx=0x7fddec009240 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.654+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 msgr2=0x7fddf8151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.654+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034040 tx=0x7fdde80046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.654+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 shutdown_connections 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdde406ae40 0x7fdde406d300 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fddf80acb40 0x7fddf8151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf8155fb0 0x7fddf8150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 --2- 172.21.15.45:0/3467214772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddf80a6e50 0x7fddf8151960 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 >> 172.21.15.45:0/3467214772 conn(0x7fddf80a98a0 msgr2=0x7fddf80ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 shutdown_connections 2023-12-08T08:19:59.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.655+0000 7fddfdc56640 1 -- 172.21.15.45:0/3467214772 wait complete. 2023-12-08T08:19:59.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:59.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.901+0000 7fadf791d640 1 Processor -- start 2023-12-08T08:19:59.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.901+0000 7fadf791d640 1 -- start start 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf791d640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 0x7fadf0156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf791d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fadf0153880 0x7fadf0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf791d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf014c880 con 0x7fadf014c4a0 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf791d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00c4730 con 0x7fadf0153880 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf791d640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00c56e0 con 0x7fadf00a4d10 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf56b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fadf014c4a0 0x7fadf0155980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51780/0 (socket says 172.21.15.45:51780) 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf5eba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fadf0153880 0x7fadf0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf56b9640 1 -- 172.21.15.45:0/3638177673 learned_addr learned my addr 172.21.15.45:0/3638177673 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.903+0000 7fadf4eb8640 1 --2- 172.21.15.45:0/3638177673 >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 0x7fadf0156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.904+0000 7fadf5eba640 1 -- 172.21.15.45:0/3638177673 >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 msgr2=0x7fadf0156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.904+0000 7fadf5eba640 1 --2- 172.21.15.45:0/3638177673 >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 0x7fadf0156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.904+0000 7fadf5eba640 1 -- 172.21.15.45:0/3638177673 >> v1:172.21.15.45:6789/0 conn(0x7fadf014c4a0 legacy=0x7fadf0155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.904+0000 7fadf5eba640 1 -- 172.21.15.45:0/3638177673 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00c63b0 con 0x7fadf0153880 2023-12-08T08:19:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.904+0000 7fadf4eb8640 1 --2- 172.21.15.45:0/3638177673 >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 0x7fadf0156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.905+0000 7fadf5eba640 1 --2- 172.21.15.45:0/3638177673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf0153c90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fadf00c3540 tx=0x7fade802be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3994e81457ce51ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.905+0000 7fade7fff640 1 -- 172.21.15.45:0/3638177673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade802cbe0 con 0x7fadf0153880 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.905+0000 7fade7fff640 1 -- 172.21.15.45:0/3638177673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade802cd40 con 0x7fadf0153880 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.905+0000 7fade7fff640 1 -- 172.21.15.45:0/3638177673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8034660 con 0x7fadf0153880 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 -- 172.21.15.45:0/3638177673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 msgr2=0x7fadf0153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 --2- 172.21.15.45:0/3638177673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf0153c90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fadf00c3540 tx=0x7fade802be30 comp rx=0 tx=0).stop 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 -- 172.21.15.45:0/3638177673 shutdown_connections 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 --2- 172.21.15.45:0/3638177673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf0153c90 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 --2- 172.21.15.45:0/3638177673 >> v2:172.21.15.114:3300/0 conn(0x7fadf00a4d10 0x7fadf0156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 -- 172.21.15.45:0/3638177673 >> 172.21.15.45:0/3638177673 conn(0x7fadf00661f0 msgr2=0x7fadf0066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 -- 172.21.15.45:0/3638177673 shutdown_connections 2023-12-08T08:19:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.906+0000 7fadf791d640 1 -- 172.21.15.45:0/3638177673 wait complete. 2023-12-08T08:19:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.908+0000 7fadf791d640 1 Processor -- start 2023-12-08T08:19:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.909+0000 7fadf791d640 1 -- start start 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf00a4d10 0x7fadf0070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadf014c4a0 0x7fadf00bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00aa270 con 0x7fadf0153880 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01ea080 con 0x7fadf00a4d10 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf791d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0071070 con 0x7fadf014c4a0 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf5eba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf5eba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34326/0 (socket says 172.21.15.45:34326) 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.910+0000 7fadf5eba640 1 -- 172.21.15.45:0/1546738172 learned_addr learned my addr 172.21.15.45:0/1546738172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf4eb8640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadf014c4a0 0x7fadf00bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf56b9640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf00a4d10 0x7fadf0070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 -- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadf014c4a0 msgr2=0x7fadf00bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadf014c4a0 0x7fadf00bf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 -- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf00a4d10 msgr2=0x7fadf0070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf00a4d10 0x7fadf0070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 -- 172.21.15.45:0/1546738172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8009a70 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.911+0000 7fadf5eba640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.912+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8040650 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.912+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80407d0 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.912+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8040b80 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.912+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf01e9d50 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.912+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00aa7a0 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.913+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf01e9bb0 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.914+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fade8040ce0 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.915+0000 7fade5ffb640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 0x7fadd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.915+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fade80ac6d0 con 0x7fadf0153880 2023-12-08T08:19:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.915+0000 7fadf56b9640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 0x7fadd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.916+0000 7fadf56b9640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 0x7fadd406d300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fadec005880 tx=0x7fadec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:19:59.920+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fadf01e9bb0 con 0x7fadf0153880 2023-12-08T08:20:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.114+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf01e9bb0 con 0x7fadf0153880 2023-12-08T08:20:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.116+0000 7fade5ffb640 1 -- 172.21.15.45:0/1546738172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16864 (secure 0 0 0) 0x7fadf01e9bb0 con 0x7fadf0153880 2023-12-08T08:20:00.122 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:00.122 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:19:55.814825+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_metadata","create_time":"2023-12-08T08:19:12.067734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs2_data","create_time":"2023-12-08T08:19:13.403310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1b","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/2233278871":"2023-12-09T08:19:52.532292+0000","172.21.15.45:6835/2233278871":"2023-12-09T08:19:52.532292+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 msgr2=0x7fadd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 0x7fadd406d300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fadec005880 tx=0x7fadec009040 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 msgr2=0x7fadf01ea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade8004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 shutdown_connections 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fadd406ae40 0x7fadd406d300 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fadf014c4a0 0x7fadf00bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadf0153880 0x7fadf01ea510 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 --2- 172.21.15.45:0/1546738172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf00a4d10 0x7fadf0070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.119+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 >> 172.21.15.45:0/1546738172 conn(0x7fadf00661f0 msgr2=0x7fadf0153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.120+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 shutdown_connections 2023-12-08T08:20:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.120+0000 7fadf791d640 1 -- 172.21.15.45:0/1546738172 wait complete. 2023-12-08T08:20:00.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-08T08:20:00.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.366+0000 7f36a3e48640 1 Processor -- start 2023-12-08T08:20:00.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.367+0000 7f36a3e48640 1 -- start start 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.368+0000 7f36a3e48640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 0x7f369c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.368+0000 7f36a3e48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f369c0c8910 0x7f369c0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.368+0000 7f36a3e48640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c151fc0 con 0x7f369c151be0 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.368+0000 7f36a3e48640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369c0c5170 con 0x7f369c0c8910 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.368+0000 7f36a3e48640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369c154540 con 0x7f369c0c7e90 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f369c0c8910 0x7f369c0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a1be4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f369c151be0 0x7f369c0c46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51786/0 (socket says 172.21.15.45:51786) 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a1be4640 1 -- 172.21.15.45:0/314240124 learned_addr learned my addr 172.21.15.45:0/314240124 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f369c0c8910 0x7f369c0c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34340/0 (socket says 172.21.15.45:34340) 2023-12-08T08:20:00.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a13e3640 1 --2- 172.21.15.45:0/314240124 >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 0x7f369c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 -- 172.21.15.45:0/314240124 >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 msgr2=0x7f369c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 --2- 172.21.15.45:0/314240124 >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 0x7f369c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 -- 172.21.15.45:0/314240124 >> v1:172.21.15.45:6789/0 conn(0x7f369c151be0 legacy=0x7f369c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a23e5640 1 -- 172.21.15.45:0/314240124 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c154750 con 0x7f369c0c8910 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a0be2640 1 -- 172.21.15.45:0/314240124 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411995748 0 0) 0x7f369c151fc0 con 0x7f369c151be0 2023-12-08T08:20:00.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.369+0000 7f36a13e3640 1 --2- 172.21.15.45:0/314240124 >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 0x7f369c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.370+0000 7f36a23e5640 1 --2- 172.21.15.45:0/314240124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c0c8910 0x7f369c0c8da0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f369c0cade0 tx=0x7f369402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76921f880c61772e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a0be2640 1 -- 172.21.15.45:0/314240124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369402cc80 con 0x7f369c0c8910 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a0be2640 1 -- 172.21.15.45:0/314240124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369402cde0 con 0x7f369c0c8910 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a0be2640 1 -- 172.21.15.45:0/314240124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694034660 con 0x7f369c0c8910 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 -- 172.21.15.45:0/314240124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c0c8910 msgr2=0x7f369c0c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 --2- 172.21.15.45:0/314240124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c0c8910 0x7f369c0c8da0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f369c0cade0 tx=0x7f369402bed0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 -- 172.21.15.45:0/314240124 shutdown_connections 2023-12-08T08:20:00.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 --2- 172.21.15.45:0/314240124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c0c8910 0x7f369c0c8da0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 --2- 172.21.15.45:0/314240124 >> v2:172.21.15.114:3300/0 conn(0x7f369c0c7e90 0x7f369c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 -- 172.21.15.45:0/314240124 >> 172.21.15.45:0/314240124 conn(0x7f369c0ab8e0 msgr2=0x7f369c0abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.371+0000 7f36a3e48640 1 -- 172.21.15.45:0/314240124 shutdown_connections 2023-12-08T08:20:00.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.372+0000 7f36a3e48640 1 -- 172.21.15.45:0/314240124 wait complete. 2023-12-08T08:20:00.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.373+0000 7f36a3e48640 1 Processor -- start 2023-12-08T08:20:00.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.373+0000 7f36a3e48640 1 -- start start 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f369c0c7e90 0x7f369c1ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c0c8910 0x7f369c1ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c1ecf30 con 0x7f369c151be0 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0ac9d0 con 0x7f369c0c8910 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.374+0000 7f36a3e48640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0accb0 con 0x7f369c0c7e90 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34348/0 (socket says 172.21.15.45:34348) 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 -- 172.21.15.45:0/1209361188 learned_addr learned my addr 172.21.15.45:0/1209361188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a1be4640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f369c0c7e90 0x7f369c1ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a13e3640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c0c8910 0x7f369c1ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 -- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f369c0c7e90 msgr2=0x7f369c1ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f369c0c7e90 0x7f369c1ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 -- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c0c8910 msgr2=0x7f369c1ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c0c8910 0x7f369c1ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.375+0000 7f36a23e5640 1 -- 172.21.15.45:0/1209361188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009a70 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36a23e5640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3694009e80 tx=0x7f3694004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694040650 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940407b0 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694040b60 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c1ecbc0 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.376+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c1ed900 con 0x7f369c151be0 2023-12-08T08:20:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.377+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c1ed0a0 con 0x7f369c151be0 2023-12-08T08:20:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.378+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3694040cc0 con 0x7f369c151be0 2023-12-08T08:20:00.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.379+0000 7f36927fc640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 0x7f368006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.379+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f36940ac650 con 0x7f369c151be0 2023-12-08T08:20:00.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.379+0000 7f36a1be4640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 0x7f368006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.380+0000 7f36a1be4640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 0x7f368006d300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f60 tx=0x7f3698007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.384+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36940775f0 con 0x7f369c151be0 2023-12-08T08:20:00.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.616+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f369c074600 con 0x7f369c151be0 2023-12-08T08:20:00.619 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-08T08:20:00.617+0000 7fa1c1cde640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:20:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.620+0000 7f36927fc640 1 -- 172.21.15.45:0/1209361188 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7f369407ac10 con 0x7f369c151be0 2023-12-08T08:20:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:20:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.623+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 msgr2=0x7f368006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.623+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 0x7f368006d300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f60 tx=0x7f3698007c00 comp rx=0 tx=0).stop 2023-12-08T08:20:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.623+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 msgr2=0x7f369c1ec100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.623+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3694009e80 tx=0x7f3694004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 shutdown_connections 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f368006ae40 0x7f368006d300 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f369c151be0 0x7f369c1ec100 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c0c8910 0x7f369c1ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 --2- 172.21.15.45:0/1209361188 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f369c0c7e90 0x7f369c1ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.624+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 >> 172.21.15.45:0/1209361188 conn(0x7f369c0ab8e0 msgr2=0x7f369c152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.625+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 shutdown_connections 2023-12-08T08:20:00.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.625+0000 7f36a3e48640 1 -- 172.21.15.45:0/1209361188 wait complete. 2023-12-08T08:20:00.639 INFO:tasks.ceph.mds.c.smithi045.stderr: -4932> 2023-12-08T08:19:17.886+0000 7fad1245b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:00.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-08T08:20:00.692 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-08T08:20:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.834+0000 7fefeb59e640 1 Processor -- start 2023-12-08T08:20:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.835+0000 7fefeb59e640 1 -- start start 2023-12-08T08:20:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.836+0000 7fefeb59e640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fefec06e160 0x7fefec1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.836+0000 7fefeb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec0c7170 con 0x7fefec06e720 2023-12-08T08:20:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.836+0000 7fefeb59e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec14fa60 con 0x7fefec14f680 2023-12-08T08:20:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.836+0000 7fefeb59e640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefec06d1b0 con 0x7fefec06e160 2023-12-08T08:20:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.837+0000 7fefe1d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fefec06e720 0x7fefec06a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51796/0 (socket says 172.21.15.45:51796) 2023-12-08T08:20:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.837+0000 7fefe1d9b640 1 -- 172.21.15.45:0/958365966 learned_addr learned my addr 172.21.15.45:0/958365966 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.837+0000 7fefead9d640 1 --2- 172.21.15.45:0/958365966 >> v2:172.21.15.114:3300/0 conn(0x7fefec06e160 0x7fefec1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.837+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226466715 0 0) 0x7fefec0c7170 con 0x7fefec06e720 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.837+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd8003520 con 0x7fefec06e720 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575925538 0 0) 0x7fefd8003520 con 0x7fefec06e720 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 >> v2:172.21.15.114:3300/0 conn(0x7fefec06e160 msgr2=0x7fefec1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 --2- 172.21.15.45:0/958365966 >> v2:172.21.15.114:3300/0 conn(0x7fefec06e160 0x7fefec1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 >> v1:172.21.15.114:6789/0 conn(0x7fefec14f680 legacy=0x7fefec152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0c76a0 con 0x7fefec06e720 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fefd4001670 con 0x7fefec06e720 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 >> v1:172.21.15.45:6789/0 conn(0x7fefec06e720 legacy=0x7fefec06a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd8003970 0x7fefd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 0x7fefd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefd80052a0 0x7fefd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec06d1b0 con 0x7fefd80047c0 2023-12-08T08:20:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd800c170 con 0x7fefd8003970 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd800c330 con 0x7fefd80052a0 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefead9d640 1 --2- 172.21.15.45:0/958365966 >> v2:172.21.15.114:3300/0 conn(0x7fefec06e160 0x7fefec1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.838+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 0x7fefd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefe1d9b640 1 -- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefd80052a0 msgr2=0x7fefd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefd80052a0 0x7fefd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefe1d9b640 1 -- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd8003970 msgr2=0x7fefd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefea59c640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd8003970 0x7fefd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd8003970 0x7fefd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefe1d9b640 1 -- 172.21.15.45:0/958365966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8003520 con 0x7fefd80047c0 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefead9d640 1 -- 172.21.15.45:0/958365966 reap_dead start 2023-12-08T08:20:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.839+0000 7fefea59c640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd8003970 0x7fefd8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.840+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 0x7fefd8004c40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fefec06eb60 tx=0x7fefd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf02956b093804b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.840+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4005ad0 con 0x7fefd80047c0 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.840+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4005c30 con 0x7fefd80047c0 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.840+0000 7fefe9d9b640 1 -- 172.21.15.45:0/958365966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd402ca50 con 0x7fefd80047c0 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 -- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 msgr2=0x7fefd8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 0x7fefd8004c40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fefec06eb60 tx=0x7fefd80057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 -- 172.21.15.45:0/958365966 shutdown_connections 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 --2- 172.21.15.45:0/958365966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefd80047c0 0x7fefd8004c40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 -- 172.21.15.45:0/958365966 >> 172.21.15.45:0/958365966 conn(0x7fefec0a85a0 msgr2=0x7fefec0a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 -- 172.21.15.45:0/958365966 shutdown_connections 2023-12-08T08:20:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.841+0000 7fefeb59e640 1 -- 172.21.15.45:0/958365966 wait complete. 2023-12-08T08:20:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.842+0000 7fefeb59e640 1 Processor -- start 2023-12-08T08:20:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.843+0000 7fefeb59e640 1 -- start start 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 0x7fefec14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefec149000 0x7fefec1edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec1edb10 con 0x7fefec072280 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec070ac0 con 0x7fefd80047c0 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefeb59e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec0726e0 con 0x7fefec149000 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34378/0 (socket says 172.21.15.45:34378) 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 -- 172.21.15.45:0/2022306295 learned_addr learned my addr 172.21.15.45:0/2022306295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefea59c640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 0x7fefec14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefead9d640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefec149000 0x7fefec1edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 -- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefec149000 msgr2=0x7fefec1edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefec149000 0x7fefec1edfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 -- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 msgr2=0x7fefec14c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 0x7fefec14c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefe1d9b640 1 -- 172.21.15.45:0/2022306295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0ac2f0 con 0x7fefec072280 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.844+0000 7fefea59c640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 0x7fefec14c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefe1d9b640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fefd4001930 tx=0x7fefd402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd403c040 con 0x7fefec072280 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd402cc20 con 0x7fefec072280 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec0ac5d0 con 0x7fefec072280 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4007070 con 0x7fefec072280 2023-12-08T08:20:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.845+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefec0ac8b0 con 0x7fefec072280 2023-12-08T08:20:00.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.846+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefec0673e0 con 0x7fefec072280 2023-12-08T08:20:00.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.847+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefd4032070 con 0x7fefec072280 2023-12-08T08:20:00.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.848+0000 7fefe37fe640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 0x7fefcc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.848+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fefd40aacf0 con 0x7fefec072280 2023-12-08T08:20:00.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.849+0000 7fefea59c640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 0x7fefcc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.849+0000 7fefea59c640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 0x7fefcc06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefec04fab0 tx=0x7fefdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:00.852+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fefd4075ca0 con 0x7fefec072280 2023-12-08T08:20:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.086+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fefec0a61d0 con 0x7fefec072280 2023-12-08T08:20:01.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.624+0000 7fefe37fe640 1 -- 172.21.15.45:0/2022306295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7fefd40792c0 con 0x7fefec072280 2023-12-08T08:20:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 msgr2=0x7fefcc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 0x7fefcc06d330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fefec04fab0 tx=0x7fefdc009040 comp rx=0 tx=0).stop 2023-12-08T08:20:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 msgr2=0x7fefec0a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fefd4001930 tx=0x7fefd402e070 comp rx=0 tx=0).stop 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 shutdown_connections 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fefcc06ae70 0x7fefcc06d330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fefec149000 0x7fefec1edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefec072280 0x7fefec0a9880 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 --2- 172.21.15.45:0/2022306295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fefd80047c0 0x7fefec14c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.628+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 >> 172.21.15.45:0/2022306295 conn(0x7fefec0a85a0 msgr2=0x7fefec0c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.629+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 shutdown_connections 2023-12-08T08:20:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.629+0000 7fefeb59e640 1 -- 172.21.15.45:0/2022306295 wait complete. 2023-12-08T08:20:01.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-08T08:20:01.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.926+0000 7f6069d6c640 1 Processor -- start 2023-12-08T08:20:01.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.927+0000 7f6069d6c640 1 -- start start 2023-12-08T08:20:01.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.928+0000 7f6069d6c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60640c7a60 0x7f6064154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.928+0000 7f6069d6c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f60640c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.928+0000 7f6069d6c640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6064157890 con 0x7f60640c44e0 2023-12-08T08:20:01.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.928+0000 7f6069d6c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6064155300 con 0x7f60640c7a60 2023-12-08T08:20:01.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.928+0000 7f6069d6c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640c7f70 con 0x7f6064158430 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60640c7a60 0x7f6064154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60640c7a60 0x7f6064154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34380/0 (socket says 172.21.15.45:34380) 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 -- 172.21.15.45:0/2792861172 learned_addr learned my addr 172.21.15.45:0/2792861172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f606956b640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f60640c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 -- 172.21.15.45:0/2792861172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 msgr2=0x7f60640c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f60640c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 -- 172.21.15.45:0/2792861172 >> v1:172.21.15.114:6789/0 conn(0x7f60640c44e0 legacy=0x7f6064157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.929+0000 7f6063fff640 1 -- 172.21.15.45:0/2792861172 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640ca040 con 0x7f60640c7a60 2023-12-08T08:20:01.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.931+0000 7f6063fff640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c7a60 0x7f6064154d20 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6050009870 tx=0x7f605002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98cc6a2ec5a43c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.931+0000 7f60637fe640 1 -- 172.21.15.45:0/2792861172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050031640 con 0x7f60640c7a60 2023-12-08T08:20:01.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.931+0000 7f60637fe640 1 -- 172.21.15.45:0/2792861172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60500317a0 con 0x7f60640c7a60 2023-12-08T08:20:01.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.931+0000 7f60637fe640 1 -- 172.21.15.45:0/2792861172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050031b30 con 0x7f60640c7a60 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 -- 172.21.15.45:0/2792861172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c7a60 msgr2=0x7f6064154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c7a60 0x7f6064154d20 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6050009870 tx=0x7f605002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 -- 172.21.15.45:0/2792861172 shutdown_connections 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f60640c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2792861172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c7a60 0x7f6064154d20 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 -- 172.21.15.45:0/2792861172 >> 172.21.15.45:0/2792861172 conn(0x7f60640663d0 msgr2=0x7f60640667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 -- 172.21.15.45:0/2792861172 shutdown_connections 2023-12-08T08:20:01.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.932+0000 7f6069d6c640 1 -- 172.21.15.45:0/2792861172 wait complete. 2023-12-08T08:20:01.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.934+0000 7f6069d6c640 1 Processor -- start 2023-12-08T08:20:01.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.935+0000 7f6069d6c640 1 -- start start 2023-12-08T08:20:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60640c7a60 0x7f60641537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f6064156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6064144af0 con 0x7f60640c44e0 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641edc80 con 0x7f60640c7a60 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6069d6c640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60641eb330 con 0x7f6064158430 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6068d6a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6068d6a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34390/0 (socket says 172.21.15.45:34390) 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6068d6a640 1 -- 172.21.15.45:0/2585242763 learned_addr learned my addr 172.21.15.45:0/2585242763 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f6063fff640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60640c7a60 0x7f60641537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.936+0000 7f606956b640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f6064156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 -- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 msgr2=0x7f6064156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f6064156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 -- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60640c7a60 msgr2=0x7f60641537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60640c7a60 0x7f60641537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 -- 172.21.15.45:0/2585242763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500094d0 con 0x7f60640c44e0 2023-12-08T08:20:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6068d6a640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f605800c4b0 tx=0x7f605800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580052d0 con 0x7f60640c44e0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058005430 con 0x7f60640c44e0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058012870 con 0x7f60640c44e0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.937+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60641ed930 con 0x7f60640c44e0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.938+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6064144d40 con 0x7f60640c44e0 2023-12-08T08:20:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.939+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6064074450 con 0x7f60640c44e0 2023-12-08T08:20:01.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.940+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60580129d0 con 0x7f60640c44e0 2023-12-08T08:20:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.941+0000 7f60617fa640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 0x7f604806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.941+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f6058089330 con 0x7f60640c44e0 2023-12-08T08:20:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.941+0000 7f6063fff640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 0x7f604806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.942+0000 7f6063fff640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 0x7f604806d300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6050036000 tx=0x7f605003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:01.945+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6058054130 con 0x7f60640c44e0 2023-12-08T08:20:02.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.138+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60641eddc0 con 0x7f60640c44e0 2023-12-08T08:20:02.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.877+0000 7f60617fa640 1 -- 172.21.15.45:0/2585242763 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v90) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6058057750 con 0x7f60640c44e0 2023-12-08T08:20:02.880 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_metadata' removed 2023-12-08T08:20:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.880+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 msgr2=0x7f604806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.880+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 0x7f604806d300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6050036000 tx=0x7f605003c040 comp rx=0 tx=0).stop 2023-12-08T08:20:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.880+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 msgr2=0x7f60641eadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.880+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f605800c4b0 tx=0x7f605800c970 comp rx=0 tx=0).stop 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 shutdown_connections 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f604806ae40 0x7f604806d300 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f6064158430 0x7f6064156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60640c7a60 0x7f60641537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 --2- 172.21.15.45:0/2585242763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60640c44e0 0x7f60641eadf0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 >> 172.21.15.45:0/2585242763 conn(0x7f60640663d0 msgr2=0x7f606414a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.881+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 shutdown_connections 2023-12-08T08:20:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:02.882+0000 7f6069d6c640 1 -- 172.21.15.45:0/2585242763 wait complete. 2023-12-08T08:20:02.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-08T08:20:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.135+0000 7fca8b6d3640 1 Processor -- start 2023-12-08T08:20:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.136+0000 7fca8b6d3640 1 -- start start 2023-12-08T08:20:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.137+0000 7fca8b6d3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca8414e800 0x7fca84155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.137+0000 7fca8b6d3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca840ca0e0 0x7fca840ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.137+0000 7fca8b6d3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca84155540 con 0x7fca841581c0 2023-12-08T08:20:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.137+0000 7fca8b6d3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840c4880 con 0x7fca8414e800 2023-12-08T08:20:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.137+0000 7fca8b6d3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca840c4b60 con 0x7fca840ca0e0 2023-12-08T08:20:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.138+0000 7fca89c70640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca841581c0 0x7fca840c6800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51808/0 (socket says 172.21.15.45:51808) 2023-12-08T08:20:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.138+0000 7fca89c70640 1 -- 172.21.15.45:0/354459367 learned_addr learned my addr 172.21.15.45:0/354459367 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.138+0000 7fca8946f640 1 --2- 172.21.15.45:0/354459367 >> v2:172.21.15.114:3300/0 conn(0x7fca8414e800 0x7fca84155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.138+0000 7fca88c6e640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca840ca0e0 0x7fca840ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.138+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225724416 0 0) 0x7fca84155540 con 0x7fca841581c0 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6c003520 con 0x7fca841581c0 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca8946f640 1 -- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca840ca0e0 msgr2=0x7fca840ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca8946f640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca840ca0e0 0x7fca840ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca8946f640 1 -- 172.21.15.45:0/354459367 >> v1:172.21.15.45:6789/0 conn(0x7fca841581c0 legacy=0x7fca840c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851788062 0 0) 0x7fca6c003520 con 0x7fca841581c0 2023-12-08T08:20:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.139+0000 7fca8946f640 1 -- 172.21.15.45:0/354459367 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840c4e40 con 0x7fca8414e800 2023-12-08T08:20:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.140+0000 7fca8946f640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca8414e800 0x7fca84155000 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca74009d90 tx=0x7fca7402bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380477007a306467 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c001670 con 0x7fca8414e800 2023-12-08T08:20:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7402c780 con 0x7fca8414e800 2023-12-08T08:20:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca83fff640 1 -- 172.21.15.45:0/354459367 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7402caf0 con 0x7fca8414e800 2023-12-08T08:20:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 -- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca8414e800 msgr2=0x7fca84155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca8414e800 0x7fca84155000 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca74009d90 tx=0x7fca7402bc50 comp rx=0 tx=0).stop 2023-12-08T08:20:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 -- 172.21.15.45:0/354459367 shutdown_connections 2023-12-08T08:20:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca840ca0e0 0x7fca840ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/354459367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca8414e800 0x7fca84155000 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.141+0000 7fca8b6d3640 1 -- 172.21.15.45:0/354459367 >> 172.21.15.45:0/354459367 conn(0x7fca840663d0 msgr2=0x7fca840667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.142+0000 7fca8b6d3640 1 -- 172.21.15.45:0/354459367 shutdown_connections 2023-12-08T08:20:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.142+0000 7fca8b6d3640 1 -- 172.21.15.45:0/354459367 wait complete. 2023-12-08T08:20:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.143+0000 7fca8b6d3640 1 Processor -- start 2023-12-08T08:20:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.143+0000 7fca8b6d3640 1 -- start start 2023-12-08T08:20:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca840ca0e0 0x7fca840aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 0x7fca841eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8414f4e0 con 0x7fca841581c0 2023-12-08T08:20:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca840abf70 con 0x7fca840ca0e0 2023-12-08T08:20:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.144+0000 7fca8b6d3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8414ee40 con 0x7fca8414e800 2023-12-08T08:20:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34404/0 (socket says 172.21.15.45:34404) 2023-12-08T08:20:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 -- 172.21.15.45:0/2292696565 learned_addr learned my addr 172.21.15.45:0/2292696565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca8946f640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca840ca0e0 0x7fca840aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca88c6e640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 0x7fca841eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 -- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 msgr2=0x7fca841eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 0x7fca841eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 -- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca840ca0e0 msgr2=0x7fca840aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca840ca0e0 0x7fca840aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca89c70640 1 -- 172.21.15.45:0/2292696565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74009a70 con 0x7fca841581c0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.145+0000 7fca88c6e640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 0x7fca841eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca89c70640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c520 tx=0x7fca7c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c005ce0 con 0x7fca841581c0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c005e40 con 0x7fca841581c0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c007290 con 0x7fca841581c0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca840be880 con 0x7fca841581c0 2023-12-08T08:20:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.146+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca840be5a0 con 0x7fca841581c0 2023-12-08T08:20:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.147+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca84074600 con 0x7fca841581c0 2023-12-08T08:20:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.148+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca7c0073f0 con 0x7fca841581c0 2023-12-08T08:20:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.149+0000 7fca81ffb640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 0x7fca7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.149+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5794+0+0 (secure 0 0 0) 0x7fca7c088bf0 con 0x7fca841581c0 2023-12-08T08:20:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.149+0000 7fca8946f640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 0x7fca7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.150+0000 7fca8946f640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 0x7fca7006d300 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fca74036000 tx=0x7fca74030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.154+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca7c053cd0 con 0x7fca841581c0 2023-12-08T08:20:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.351+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca840c7e50 con 0x7fca841581c0 2023-12-08T08:20:03.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.889+0000 7fca81ffb640 1 -- 172.21.15.45:0/2292696565 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v91) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca7c017070 con 0x7fca841581c0 2023-12-08T08:20:03.893 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs2_data' removed 2023-12-08T08:20:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.893+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 msgr2=0x7fca7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.893+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 0x7fca7006d300 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fca74036000 tx=0x7fca74030000 comp rx=0 tx=0).stop 2023-12-08T08:20:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.893+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 msgr2=0x7fca84149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.893+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00c520 tx=0x7fca7c00c9e0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 shutdown_connections 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fca7006ae40 0x7fca7006d300 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fca8414e800 0x7fca841eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca841581c0 0x7fca84149de0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 --2- 172.21.15.45:0/2292696565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca840ca0e0 0x7fca840aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.894+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 >> 172.21.15.45:0/2292696565 conn(0x7fca840663d0 msgr2=0x7fca84155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:03.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.896+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 shutdown_connections 2023-12-08T08:20:03.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:03.896+0000 7fca8b6d3640 1 -- 172.21.15.45:0/2292696565 wait complete. 2023-12-08T08:20:03.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.141+0000 7ff660bc9640 1 Processor -- start 2023-12-08T08:20:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.142+0000 7ff660bc9640 1 -- start start 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff660bc9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff65c151ec0 0x7ff65c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff660bc9640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 0x7ff65c06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff660bc9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0c16b0 con 0x7ff65c0c4d30 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff660bc9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0a8b30 con 0x7ff65c151ec0 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff660bc9640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0c65d0 con 0x7ff65c0c1d60 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff65b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff65c151ec0 0x7ff65c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff65b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff65c151ec0 0x7ff65c0c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34406/0 (socket says 172.21.15.45:34406) 2023-12-08T08:20:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.143+0000 7ff65b7fe640 1 -- 172.21.15.45:0/218166860 learned_addr learned my addr 172.21.15.45:0/218166860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65affd640 1 --2- 172.21.15.45:0/218166860 >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 0x7ff65c06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65b7fe640 1 -- 172.21.15.45:0/218166860 >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 msgr2=0x7ff65c06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/218166860 >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 0x7ff65c06ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65b7fe640 1 -- 172.21.15.45:0/218166860 >> v1:172.21.15.45:6789/0 conn(0x7ff65c0c4d30 legacy=0x7ff65c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65b7fe640 1 -- 172.21.15.45:0/218166860 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0c5810 con 0x7ff65c151ec0 2023-12-08T08:20:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65a7fc640 1 -- 172.21.15.45:0/218166860 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159280613 0 0) 0x7ff65c0c16b0 con 0x7ff65c0c4d30 2023-12-08T08:20:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.144+0000 7ff65affd640 1 --2- 172.21.15.45:0/218166860 >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 0x7ff65c06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.145+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/218166860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0c47f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff65c06de70 tx=0x7ff64c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5a4e62fc39bf97 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.145+0000 7ff65a7fc640 1 -- 172.21.15.45:0/218166860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c031870 con 0x7ff65c151ec0 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.145+0000 7ff65a7fc640 1 -- 172.21.15.45:0/218166860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c0319d0 con 0x7ff65c151ec0 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.145+0000 7ff65a7fc640 1 -- 172.21.15.45:0/218166860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c031d60 con 0x7ff65c151ec0 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 -- 172.21.15.45:0/218166860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 msgr2=0x7ff65c0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 --2- 172.21.15.45:0/218166860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0c47f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff65c06de70 tx=0x7ff64c02b910 comp rx=0 tx=0).stop 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 -- 172.21.15.45:0/218166860 shutdown_connections 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 --2- 172.21.15.45:0/218166860 >> v2:172.21.15.114:3300/0 conn(0x7ff65c0c1d60 0x7ff65c06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 --2- 172.21.15.45:0/218166860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0c47f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 -- 172.21.15.45:0/218166860 >> 172.21.15.45:0/218166860 conn(0x7ff65c066ce0 msgr2=0x7ff65c0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 -- 172.21.15.45:0/218166860 shutdown_connections 2023-12-08T08:20:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.146+0000 7ff660bc9640 1 -- 172.21.15.45:0/218166860 wait complete. 2023-12-08T08:20:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.148+0000 7ff660bc9640 1 Processor -- start 2023-12-08T08:20:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.148+0000 7ff660bc9640 1 -- start start 2023-12-08T08:20:04.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 0x7ff65c1dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c4d30 0x7ff65c0a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c1dc910 con 0x7ff65c151ec0 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c070c80 con 0x7ff65c0c4d30 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff660bc9640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c06fd60 con 0x7ff65c0c1d60 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff65bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34408/0 (socket says 172.21.15.45:34408) 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff65bfff640 1 -- 172.21.15.45:0/2081803111 learned_addr learned my addr 172.21.15.45:0/2081803111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff65affd640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c4d30 0x7ff65c0a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.149+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 0x7ff65c1dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 -- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 msgr2=0x7ff65c1dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 0x7ff65c1dcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 -- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c4d30 msgr2=0x7ff65c0a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c4d30 0x7ff65c0a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 -- 172.21.15.45:0/2081803111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c0094d0 con 0x7ff65c151ec0 2023-12-08T08:20:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 0x7ff65c1dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff65bfff640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c430 tx=0x7ff65400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540035f0 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654003770 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c070020 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654003b20 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.150+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c14ffa0 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.152+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0701b0 con 0x7ff65c151ec0 2023-12-08T08:20:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.153+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff654003c80 con 0x7ff65c151ec0 2023-12-08T08:20:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.154+0000 7ff653fff640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 0x7ff63c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.154+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff654088a40 con 0x7ff65c151ec0 2023-12-08T08:20:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.154+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 0x7ff63c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.155+0000 7ff65b7fe640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 0x7ff63c06d300 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.158+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff65408ae60 con 0x7ff65c151ec0 2023-12-08T08:20:04.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.353+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff65c0678c0 con 0x7ff65c151ec0 2023-12-08T08:20:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.361+0000 7ff653fff640 1 -- 172.21.15.45:0/2081803111 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6540170a0 con 0x7ff65c151ec0 2023-12-08T08:20:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 msgr2=0x7ff63c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 0x7ff63c06d300 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c03c040 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 msgr2=0x7ff65c0a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c430 tx=0x7ff65400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 shutdown_connections 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff63c06ae40 0x7ff63c06d300 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff65c151ec0 0x7ff65c0a6d80 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c4d30 0x7ff65c0a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 --2- 172.21.15.45:0/2081803111 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff65c0c1d60 0x7ff65c1dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 >> 172.21.15.45:0/2081803111 conn(0x7ff65c066ce0 msgr2=0x7ff65c150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 shutdown_connections 2023-12-08T08:20:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.364+0000 7ff660bc9640 1 -- 172.21.15.45:0/2081803111 wait complete. 2023-12-08T08:20:04.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-08T08:20:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.616+0000 7fc03a2bb640 1 Processor -- start 2023-12-08T08:20:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.616+0000 7fc03a2bb640 1 -- start start 2023-12-08T08:20:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc03414e0c0 0x7fc0340c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0340c0a70 0x7fc034150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 0x7fc034151090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03414e4a0 con 0x7fc0340c0a70 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc034154100 con 0x7fc0340c03a0 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.617+0000 7fc03a2bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341543e0 con 0x7fc03414e0c0 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0340c0a70 0x7fc034150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0340c0a70 0x7fc034150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34414/0 (socket says 172.21.15.45:34414) 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 -- 172.21.15.45:0/2941957239 learned_addr learned my addr 172.21.15.45:0/2941957239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc038858640 1 --2- 172.21.15.45:0/2941957239 >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 0x7fc034151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc033fff640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc03414e0c0 0x7fc0340c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 -- 172.21.15.45:0/2941957239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc03414e0c0 msgr2=0x7fc0340c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc03414e0c0 0x7fc0340c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 -- 172.21.15.45:0/2941957239 >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 msgr2=0x7fc034151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 --2- 172.21.15.45:0/2941957239 >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 0x7fc034151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc0337fe640 1 -- 172.21.15.45:0/2941957239 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0341546c0 con 0x7fc0340c0a70 2023-12-08T08:20:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.618+0000 7fc038858640 1 --2- 172.21.15.45:0/2941957239 >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 0x7fc034151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.620+0000 7fc0337fe640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0340c0a70 0x7fc034150b50 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc0340bfb30 tx=0x7fc02802ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b61da6abd48571 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.620+0000 7fc032ffd640 1 -- 172.21.15.45:0/2941957239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02802eb70 con 0x7fc0340c0a70 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.620+0000 7fc032ffd640 1 -- 172.21.15.45:0/2941957239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02802ecd0 con 0x7fc0340c0a70 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.620+0000 7fc032ffd640 1 -- 172.21.15.45:0/2941957239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028036660 con 0x7fc0340c0a70 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2941957239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0340c0a70 msgr2=0x7fc034150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0340c0a70 0x7fc034150b50 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc0340bfb30 tx=0x7fc02802ddc0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2941957239 shutdown_connections 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2941957239 >> v2:172.21.15.114:3300/0 conn(0x7fc0340c03a0 0x7fc034151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0340c0a70 0x7fc034150b50 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2941957239 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc03414e0c0 0x7fc0340c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2941957239 >> 172.21.15.45:0/2941957239 conn(0x7fc0340661f0 msgr2=0x7fc034066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2941957239 shutdown_connections 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.621+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2941957239 wait complete. 2023-12-08T08:20:04.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.623+0000 7fc03a2bb640 1 Processor -- start 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.623+0000 7fc03a2bb640 1 -- start start 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0340c03a0 0x7fc03406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 0x7fc0340a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341e5d00 con 0x7fc03414e0c0 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034071020 con 0x7fc0340c03a0 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc03a2bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc034071300 con 0x7fc0340c0a70 2023-12-08T08:20:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34428/0 (socket says 172.21.15.45:34428) 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 -- 172.21.15.45:0/2559348266 learned_addr learned my addr 172.21.15.45:0/2559348266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc033fff640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0340c03a0 0x7fc03406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc0337fe640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 0x7fc0340a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 -- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 msgr2=0x7fc0340a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 0x7fc0340a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 -- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0340c03a0 msgr2=0x7fc03406fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0340c03a0 0x7fc03406fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.624+0000 7fc038858640 1 -- 172.21.15.45:0/2559348266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02800a670 con 0x7fc03414e0c0 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc0337fe640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 0x7fc0340a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc038858640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00afd0 tx=0x7fc02c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004440 con 0x7fc03414e0c0 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c003610 con 0x7fc03414e0c0 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0039c0 con 0x7fc03414e0c0 2023-12-08T08:20:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0340715e0 con 0x7fc03414e0c0 2023-12-08T08:20:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.625+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0341e58d0 con 0x7fc03414e0c0 2023-12-08T08:20:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.627+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0341e5e40 con 0x7fc03414e0c0 2023-12-08T08:20:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.628+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc02c003b20 con 0x7fc03414e0c0 2023-12-08T08:20:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.628+0000 7fc030ff9640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 0x7fc02006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.629+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc02c0895e0 con 0x7fc03414e0c0 2023-12-08T08:20:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.629+0000 7fc033fff640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 0x7fc02006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.630+0000 7fc033fff640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 0x7fc02006d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc0240070b0 tx=0x7fc024007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.633+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0341e5e40 con 0x7fc03414e0c0 2023-12-08T08:20:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:04.899+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7fc0341e5e40 con 0x7fc03414e0c0 2023-12-08T08:20:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.895+0000 7fc030ff9640 1 -- 172.21.15.45:0/2559348266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v301) v1 ==== 159+0+0 (secure 0 0 0) 0x7fc0341e5e40 con 0x7fc03414e0c0 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 msgr2=0x7fc02006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 0x7fc02006d330 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc0240070b0 tx=0x7fc024007040 comp rx=0 tx=0).stop 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 msgr2=0x7fc0341e6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00afd0 tx=0x7fc02c00ca20 comp rx=0 tx=0).stop 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 shutdown_connections 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc02006ae70 0x7fc02006d330 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc0340c0a70 0x7fc0340a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc03414e0c0 0x7fc0341e6120 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 --2- 172.21.15.45:0/2559348266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0340c03a0 0x7fc03406fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.899+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 >> 172.21.15.45:0/2559348266 conn(0x7fc0340661f0 msgr2=0x7fc03414faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.900+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 shutdown_connections 2023-12-08T08:20:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:05.900+0000 7fc03a2bb640 1 -- 172.21.15.45:0/2559348266 wait complete. 2023-12-08T08:20:05.925 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-08T08:20:05.925 INFO:tasks.cephfs_test_runner: 2023-12-08T08:20:05.925 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:20:05.925 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:20:05.925 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-08T08:20:05.926 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner:Ran 3 tests in 245.887s 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-08T08:20:05.927 INFO:tasks.cephfs_test_runner: 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-08T08:20:05.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:20:05.929 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:20:05.929 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:20:05.929 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:20:05.929 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-08T08:20:05.929 INFO:tasks.cephfs_test_runner: 2023-12-08T08:20:05.929 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:20:06.027 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=55c1ebd1b8a84f1eabd418a9fe98118a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-08T08:20:06.028 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-08T08:20:06.039 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-08T08:20:06.099 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-08T08:20:06.099 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-08T08:20:06.099 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:06.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-08T08:20:06.203 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-12-08T08:20:06.203 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:06.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-08T08:20:06.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.265 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-08T08:20:06.329 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:20:06.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:06.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-08T08:20:06.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.575 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-12-08T08:20:06.637 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:20:06.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.638 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:20:06.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:06.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-12-08T08:20:07.015 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-08T08:20:07.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:20:07.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.262+0000 7f3c93b05640 1 Processor -- start 2023-12-08T08:20:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.262+0000 7f3c93b05640 1 -- start start 2023-12-08T08:20:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c93b05640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c8c0c0a70 0x7f3c8c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c93b05640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c03a0 0x7f3c8c151090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c93b05640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c14e4a0 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c93b05640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c154100 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c93b05640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1543e0 con 0x7f3c8c0c03a0 2023-12-08T08:20:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c918a1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3c8c14e0c0 0x7f3c8c0c3900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43946/0 (socket says 172.21.15.45:43946) 2023-12-08T08:20:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.263+0000 7f3c918a1640 1 -- 172.21.15.45:0/2839410742 learned_addr learned my addr 172.21.15.45:0/2839410742 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:07.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c910a0640 1 --2- 172.21.15.45:0/2839410742 >> v2:172.21.15.45:3300/0 conn(0x7f3c8c0c0a70 0x7f3c8c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c9089f640 1 -- 172.21.15.45:0/2839410742 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066302550 0 0) 0x7f3c88001110 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c9089f640 1 -- 172.21.15.45:0/2839410742 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c78003520 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c910a0640 1 -- 172.21.15.45:0/2839410742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c03a0 msgr2=0x7f3c8c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c910a0640 1 --2- 172.21.15.45:0/2839410742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c03a0 0x7f3c8c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c910a0640 1 -- 172.21.15.45:0/2839410742 >> v1:172.21.15.45:6789/0 conn(0x7f3c8c14e0c0 legacy=0x7f3c8c0c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.264+0000 7f3c910a0640 1 -- 172.21.15.45:0/2839410742 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c1546c0 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.265+0000 7f3c910a0640 1 --2- 172.21.15.45:0/2839410742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c0c0a70 0x7f3c8c150b50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097a0 tx=0x7f3c7c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de4d4f53d219cf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.266+0000 7f3c9089f640 1 -- 172.21.15.45:0/2839410742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c02f050 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.266+0000 7f3c9089f640 1 -- 172.21.15.45:0/2839410742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c031700 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.266+0000 7f3c9089f640 1 -- 172.21.15.45:0/2839410742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c031a90 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.266+0000 7f3c93b05640 1 -- 172.21.15.45:0/2839410742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c0c0a70 msgr2=0x7f3c8c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.266+0000 7f3c93b05640 1 --2- 172.21.15.45:0/2839410742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c0c0a70 0x7f3c8c150b50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097a0 tx=0x7f3c7c02b7a0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 -- 172.21.15.45:0/2839410742 shutdown_connections 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 --2- 172.21.15.45:0/2839410742 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c03a0 0x7f3c8c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 --2- 172.21.15.45:0/2839410742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c0c0a70 0x7f3c8c150b50 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 -- 172.21.15.45:0/2839410742 >> 172.21.15.45:0/2839410742 conn(0x7f3c8c0661f0 msgr2=0x7f3c8c066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:07.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 -- 172.21.15.45:0/2839410742 shutdown_connections 2023-12-08T08:20:07.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.267+0000 7f3c93b05640 1 -- 172.21.15.45:0/2839410742 wait complete. 2023-12-08T08:20:07.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.269+0000 7f3c93b05640 1 Processor -- start 2023-12-08T08:20:07.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.269+0000 7f3c93b05640 1 -- start start 2023-12-08T08:20:07.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0c03a0 0x7f3c8c14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c0a70 0x7f3c8c1e9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1476e0 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c147400 con 0x7f3c8c0c03a0 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c93b05640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c06fb80 con 0x7f3c8c0c0a70 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c920a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c920a2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40976/0 (socket says 172.21.15.45:40976) 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c920a2640 1 -- 172.21.15.45:0/934233218 learned_addr learned my addr 172.21.15.45:0/934233218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:07.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.270+0000 7f3c918a1640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0c03a0 0x7f3c8c14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 -- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c0a70 msgr2=0x7f3c8c1e9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c910a0640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c0a70 0x7f3c8c1e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c0a70 0x7f3c8c1e9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 -- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0c03a0 msgr2=0x7f3c8c14cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0c03a0 0x7f3c8c14cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 -- 172.21.15.45:0/934233218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009400 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c920a2640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b970 tx=0x7f3c8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400cb40 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8400ccc0 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84014680 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c1e8e00 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.271+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c072910 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.272+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c074600 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.273+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c8401d3b0 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.275+0000 7f3c827fc640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 0x7f3c7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.275+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3c84089460 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.275+0000 7f3c918a1640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 0x7f3c7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.276+0000 7f3c918a1640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 0x7f3c7006d300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3c88007fd0 tx=0x7f3c88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.280+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c84054660 con 0x7f3c8c14e0c0 2023-12-08T08:20:07.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.468+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c8c154c80 con 0x7f3c7006ae40 2023-12-08T08:20:07.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.474+0000 7f3c827fc640 1 -- 172.21.15.45:0/934233218 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48541 (secure 0 0 0) 0x7f3c88001c90 con 0x7f3c7006ae40 2023-12-08T08:20:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:07.478 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:20:07.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 msgr2=0x7f3c7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 0x7f3c7006d300 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3c88007fd0 tx=0x7f3c88009040 comp rx=0 tx=0).stop 2023-12-08T08:20:07.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 msgr2=0x7f3c8c1e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b970 tx=0x7f3c8400be30 comp rx=0 tx=0).stop 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 shutdown_connections 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3c7006ae40 0x7f3c7006d300 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3c8c0c0a70 0x7f3c8c1e9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c8c14e0c0 0x7f3c8c1e9860 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 --2- 172.21.15.45:0/934233218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0c03a0 0x7f3c8c14cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 >> 172.21.15.45:0/934233218 conn(0x7f3c8c0661f0 msgr2=0x7f3c8c14fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.477+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 shutdown_connections 2023-12-08T08:20:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.478+0000 7f3c93b05640 1 -- 172.21.15.45:0/934233218 wait complete. 2023-12-08T08:20:07.499 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2023-12-08T08:20:05.808543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259296,"kb_used_data":9856,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715424,"statfs":{"total":773094113280,"available":772828594176,"internally_reserved":0,"allocated":10092544,"data_stored":5404512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001856"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":227,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-12-08T08:19:55.835375+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:19:55.835375+0000","last_peered":"2023-12-08T08:19:55.835375+0000","last_clean":"2023-12-08T08:19:55.835375+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:19:55.835375+0000","last_undegraded":"2023-12-08T08:19:55.835375+0000","last_fullsized":"2023-12-08T08:19:55.835375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1703936,"data_stored":1115404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.016},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4219999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.671,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.671}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.127,"15min":1.1499999999999999},"min":{"1min":0.82799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.694,"5min":1.794,"15min":1.794},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.69599999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.145,"15min":2.145},"last":1.2529999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.149,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.716},{"interface":"front","average":{"1min":1.147,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.78800000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.4259999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2849999999999999,"15min":1.319},"min":{"1min":0.80800000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6399999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.345,"15min":1.399},"min":{"1min":0.876,"5min":0.75,"15min":0.75},"max":{"1min":1.702,"5min":3.524,"15min":3.524},"last":1.5069999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3700000000000001,"15min":1.399},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.855,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.591},{"interface":"front","average":{"1min":1.379,"5min":1.371,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.97,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.875}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.504,"15min":1.4530000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.923,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.78},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.5209999999999999,"15min":1.5089999999999999},"min":{"1min":0.72099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0739999999999998,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.9830000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5980000000000001,"15min":1.6419999999999999},"min":{"1min":0.84099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.0430000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.845},{"interface":"front","average":{"1min":1.585,"5min":1.599,"15min":1.605},"min":{"1min":0.65400000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.157,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.0920000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542208,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1130496,"data_stored":536928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.444,"15min":1.7549999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.6319999999999997,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4910000000000001,"15min":1.8600000000000001},"min":{"1min":0.749,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.835,"5min":19.364999999999998,"15min":19.364999999999998},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.179,"15min":1.127},"min":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":6.5620000000000003,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.82399999999999995,"5min":0.495,"15min":0.495},"max":{"1min":7.2539999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.232}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.2490000000000001,"15min":1.2450000000000001},"min":{"1min":0.754,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.296,"15min":1.276},"min":{"1min":0.83599999999999997,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":6.6040000000000001,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.407}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.319,"15min":1.399},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.8919999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.528,"5min":1.347,"15min":1.385},"min":{"1min":0.85199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":8.6150000000000002,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.5549999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.3620000000000001,"15min":1.3560000000000001},"min":{"1min":0.87,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6.4370000000000003,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.044},{"interface":"front","average":{"1min":1.544,"5min":1.4059999999999999,"15min":1.4159999999999999},"min":{"1min":0.80800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.0430000000000001,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.4450000000000001,"15min":1.486},"min":{"1min":0.73799999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":8.0039999999999996,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.367},{"interface":"front","average":{"1min":1.496,"5min":1.4890000000000001,"15min":1.4910000000000001},"min":{"1min":0.95699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.4770000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6379999999999999,"5min":1.5029999999999999,"15min":1.492},"min":{"1min":0.99199999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":7.1989999999999998,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.776,"5min":1.579,"15min":1.609},"min":{"1min":1.0800000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":8.532,"5min":8.532,"15min":8.532},"last":1.45}]}]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1101824,"data_stored":524876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98799999999999999,"15min":0.95699999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8100000000000001,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.0549999999999999,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.036}]},{"osd":1,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.0800000000000001,"15min":1.0229999999999999},"min":{"1min":0.73299999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.8049999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.046,"5min":1.1579999999999999,"15min":1.216},"min":{"1min":0.53300000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.5,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.3819999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.1859999999999999,"15min":1.1899999999999999},"min":{"1min":0.67700000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.212},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2849999999999999,"15min":1.3029999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.486}]},{"osd":3,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3260000000000001,"15min":1.3460000000000001},"min":{"1min":0.95999999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.923,"5min":1.96,"15min":1.96},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.4019999999999999,"15min":1.4219999999999999},"min":{"1min":0.88800000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.96,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.6639999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.2549999999999999,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.665,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.3759999999999999,"15min":1.3740000000000001},"min":{"1min":0.80300000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.571}]},{"osd":6,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.411,"15min":1.403},"min":{"1min":0.73599999999999999,"5min":0.5,"15min":0.5},"max":{"1min":3.0459999999999998,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.393,"15min":1.421},"min":{"1min":0.84299999999999997,"5min":0.621,"15min":0.621},"max":{"1min":1.7549999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.6120000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:02 2023","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":1.514,"15min":1.4790000000000001},"min":{"1min":0.86499999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4950000000000001,"5min":3.242,"15min":3.242},"last":1.306},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.536,"15min":1.518},"min":{"1min":0.82399999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":3.5169999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.798}]}]},{"osd":4,"up_from":14,"seq":60129542208,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":524968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0549999999999999,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.0860000000000001,"15min":1.1359999999999999},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.583,"5min":2.335,"15min":2.335},"last":1.2509999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.149,"15min":1.1859999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.8999999999999999,"5min":1.958,"15min":1.958},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2190000000000001,"15min":1.242},"min":{"1min":0.94199999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7070000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.347,"15min":1.393},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.875,"5min":2.456,"15min":2.456},"last":1.637}]},{"osd":3,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2270000000000001,"15min":1.2170000000000001},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.764,"5min":1.871,"15min":1.871},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.751,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.526}]},{"osd":5,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.357,"15min":1.4470000000000001},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":2.097,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.3300000000000001,"15min":1.4099999999999999},"min":{"1min":0.83899999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.647,"5min":2.137,"15min":2.137},"last":1.4630000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.468},"min":{"1min":0.68999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6559999999999999,"5min":3.016,"15min":3.016},"last":1.389},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4590000000000001,"15min":1.5509999999999999},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.5700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.569},"min":{"1min":0.79000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.917,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5660000000000001,"15min":1.6539999999999999},"min":{"1min":0.82099999999999995,"5min":0.5,"15min":0.5},"max":{"1min":2.1970000000000001,"5min":3.141,"15min":3.141},"last":1.6080000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":525596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.85299999999999998,"15min":0.93100000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2589999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":1.004},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.97299999999999998},"min":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5880000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.375,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0609999999999999,"15min":1.107},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.716,"5min":2.121,"15min":2.121},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.135,"15min":1.161},"min":{"1min":0.56100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6870000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1439999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7470000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.042},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3560000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.806,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3520000000000001,"15min":1.458},"min":{"1min":0.81200000000000006,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.9019999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.367},"min":{"1min":0.748,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.056,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.405,"15min":1.4350000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9410000000000001,"5min":2.25,"15min":2.25},"last":1.51},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.45,"15min":1.548},"min":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9710000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.427,"15min":1.4730000000000001},"min":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.036,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.403},{"interface":"front","average":{"1min":1.413,"5min":1.5149999999999999,"15min":1.591},"min":{"1min":0.85999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0859999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6339999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1105920,"data_stored":524910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.79000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5549999999999999,"5min":1.948,"15min":1.948},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96599999999999997,"15min":0.91200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6220000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6759999999999999,"5min":2.996,"15min":2.996},"last":1.288},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.01,"15min":0.97099999999999997},"min":{"1min":0.52800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4039999999999999,"5min":2.238,"15min":2.238},"last":1.119}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.631,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.103,"15min":1.0649999999999999},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3120000000000001,"15min":1.3140000000000001},"min":{"1min":0.81399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9059999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":0.749,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8460000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.1579999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.371,"15min":1.375},"min":{"1min":0.82399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.6339999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.53},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.86099999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9139999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9410000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4119999999999999,"15min":1.417},"min":{"1min":0.80500000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.748,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.177}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.49,"15min":1.47},"min":{"1min":0.98699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.044,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.508,"15min":1.5069999999999999},"min":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.089,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.202}]}]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1105920,"data_stored":524910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.748},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.089},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.298},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.355}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1724416,"data_stored":1126920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.92300000000000004,"15min":0.88600000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.0389999999999997,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.048,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":8.3140000000000001},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1140000000000001,"15min":1.1559999999999999},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.423,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98799999999999999,"15min":1.087},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.2609999999999999,"15min":1.3029999999999999},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3260000000000001,"15min":1.46},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.2709999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.748,"5min":1.343,"15min":1.351},"min":{"1min":0.90100000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":10.208,"5min":10.208,"15min":10.208},"last":1.018}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3420000000000001,"15min":1.423},"min":{"1min":0.84799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.319,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.633,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":2.085,"5min":1.607,"15min":1.571},"min":{"1min":0.84599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":12.779,"5min":12.779,"15min":12.779},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.81899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":1.589,"15min":1.661},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":8.2569999999999997,"5min":8.2569999999999997,"15min":8.2569999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.508,"5min":1.4630000000000001,"15min":1.5369999999999999},"min":{"1min":0.97299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":0.97299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:07.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.715+0000 7fe5dd078640 1 Processor -- start 2023-12-08T08:20:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.716+0000 7fe5dd078640 1 -- start start 2023-12-08T08:20:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 0x7fe5d80c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 0x7fe5d8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d8155850 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d80c0890 con 0x7fe5d80a7910 2023-12-08T08:20:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5dd078640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c0b70 con 0x7fe5d81521b0 2023-12-08T08:20:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.717+0000 7fe5d77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40980/0 (socket says 172.21.15.45:40980) 2023-12-08T08:20:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 -- 172.21.15.45:0/3113421933 learned_addr learned my addr 172.21.15.45:0/3113421933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d7fff640 1 --2- 172.21.15.45:0/3113421933 >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 0x7fe5d80c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5dc877640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 0x7fe5d8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 -- 172.21.15.45:0/3113421933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 msgr2=0x7fe5d8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 0x7fe5d8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 -- 172.21.15.45:0/3113421933 >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 msgr2=0x7fe5d80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 --2- 172.21.15.45:0/3113421933 >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 0x7fe5d80c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d77fe640 1 -- 172.21.15.45:0/3113421933 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80c0e50 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5d7fff640 1 --2- 172.21.15.45:0/3113421933 >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 0x7fe5d80c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.718+0000 7fe5dc877640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 0x7fe5d8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.719+0000 7fe5d77fe640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806ac30 tx=0x7fe5cc02b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ec7fed4fd556e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5d6ffd640 1 -- 172.21.15.45:0/3113421933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0317f0 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5d6ffd640 1 -- 172.21.15.45:0/3113421933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc031950 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5d6ffd640 1 -- 172.21.15.45:0/3113421933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc031ce0 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 -- 172.21.15.45:0/3113421933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d80c1dc0 msgr2=0x7fe5d814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806ac30 tx=0x7fe5cc02b890 comp rx=0 tx=0).stop 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 -- 172.21.15.45:0/3113421933 shutdown_connections 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d81521b0 0x7fe5d8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3113421933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d814f5e0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3113421933 >> v2:172.21.15.114:3300/0 conn(0x7fe5d80a7910 0x7fe5d80c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 -- 172.21.15.45:0/3113421933 >> 172.21.15.45:0/3113421933 conn(0x7fe5d80c5780 msgr2=0x7fe5d80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 -- 172.21.15.45:0/3113421933 shutdown_connections 2023-12-08T08:20:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.720+0000 7fe5dd078640 1 -- 172.21.15.45:0/3113421933 wait complete. 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.723+0000 7fe5dd078640 1 Processor -- start 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.723+0000 7fe5dd078640 1 -- start start 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d80a7910 0x7fe5d81ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d81da9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81e9ff0 con 0x7fe5d81521b0 2023-12-08T08:20:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81dc450 con 0x7fe5d80c1dc0 2023-12-08T08:20:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dd078640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81dc9d0 con 0x7fe5d80a7910 2023-12-08T08:20:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dc877640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dc877640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40996/0 (socket says 172.21.15.45:40996) 2023-12-08T08:20:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.724+0000 7fe5dc877640 1 -- 172.21.15.45:0/3225283378 learned_addr learned my addr 172.21.15.45:0/3225283378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:07.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5d7fff640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d80a7910 0x7fe5d81ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5d77fe640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d81da9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 -- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d80a7910 msgr2=0x7fe5d81ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d80a7910 0x7fe5d81ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 -- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d80c1dc0 msgr2=0x7fe5d81da9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d81da9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 -- 172.21.15.45:0/3225283378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0094d0 con 0x7fe5d81521b0 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5dc877640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c7f0 tx=0x7fe5d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.725+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0007820 con 0x7fe5d81521b0 2023-12-08T08:20:07.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.726+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0007980 con 0x7fe5d81521b0 2023-12-08T08:20:07.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.726+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d81dc6f0 con 0x7fe5d81521b0 2023-12-08T08:20:07.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.726+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0007d30 con 0x7fe5d81521b0 2023-12-08T08:20:07.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.726+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d81e9c10 con 0x7fe5d81521b0 2023-12-08T08:20:07.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.727+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d81ea130 con 0x7fe5d81521b0 2023-12-08T08:20:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.728+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5d00113f0 con 0x7fe5d81521b0 2023-12-08T08:20:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.729+0000 7fe5d4ff9640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 0x7fe5c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.729+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe5d00896f0 con 0x7fe5d81521b0 2023-12-08T08:20:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.729+0000 7fe5d7fff640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 0x7fe5c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.730+0000 7fe5d7fff640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 0x7fe5c406d300 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007fc0 tx=0x7fe5c8007550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:07.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.734+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5d81ea130 con 0x7fe5d81521b0 2023-12-08T08:20:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.926+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5d80a7cf0 con 0x7fe5c406ae40 2023-12-08T08:20:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.931+0000 7fe5d4ff9640 1 -- 172.21.15.45:0/3225283378 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48396 (secure 0 0 0) 0x7fe5c8013070 con 0x7fe5c406ae40 2023-12-08T08:20:07.935 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.934+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 msgr2=0x7fe5c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.934+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 0x7fe5c406d300 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007fc0 tx=0x7fe5c8007550 comp rx=0 tx=0).stop 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.934+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 msgr2=0x7fe5d81dce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.934+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000c7f0 tx=0x7fe5d000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 shutdown_connections 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe5c406ae40 0x7fe5c406d300 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5d81521b0 0x7fe5d81dce90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d80c1dc0 0x7fe5d81da9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 --2- 172.21.15.45:0/3225283378 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe5d80a7910 0x7fe5d81ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 >> 172.21.15.45:0/3225283378 conn(0x7fe5d80c5780 msgr2=0x7fe5d8150770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 shutdown_connections 2023-12-08T08:20:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:07.935+0000 7fe5dd078640 1 -- 172.21.15.45:0/3225283378 wait complete. 2023-12-08T08:20:07.957 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-12-08T08:20:07.809062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":259392,"kb_used_data":9948,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715328,"statfs":{"total":773094113280,"available":772828495872,"internally_reserved":0,"allocated":10186752,"data_stored":5442750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.184387"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-08T08:20:03.767994+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:20:03.767994+0000","last_peered":"2023-12-08T08:20:03.767994+0000","last_clean":"2023-12-08T08:20:03.767994+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:20:03.767994+0000","last_undegraded":"2023-12-08T08:20:03.767994+0000","last_fullsized":"2023-12-08T08:20:03.767994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.016},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4219999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.671,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.127,"15min":1.1499999999999999},"min":{"1min":0.82799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.694,"5min":1.794,"15min":1.794},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.69599999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.145,"15min":2.145},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.149,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.78800000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2849999999999999,"15min":1.319},"min":{"1min":0.80800000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6399999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.345,"15min":1.399},"min":{"1min":0.876,"5min":0.75,"15min":0.75},"max":{"1min":1.702,"5min":3.524,"15min":3.524},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3700000000000001,"15min":1.399},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.855,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.379,"5min":1.371,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.97,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.504,"15min":1.4530000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.923,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.5209999999999999,"15min":1.5089999999999999},"min":{"1min":0.72099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0739999999999998,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5980000000000001,"15min":1.6419999999999999},"min":{"1min":0.84099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.0430000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.599,"15min":1.605},"min":{"1min":0.65400000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.157,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.71899999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.6970000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.298,"15min":1.796},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.615,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.1299999999999999},"min":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.611,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.66400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.867,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.867}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.226,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4830000000000001,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.266},"min":{"1min":0.76400000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6599999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.79800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2789999999999999,"15min":1.385},"min":{"1min":0.754,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8109999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.304,"15min":1.371},"min":{"1min":0.85799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5820000000000001,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":0.85799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3400000000000001,"15min":1.349},"min":{"1min":0.63100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.792,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.077},{"interface":"front","average":{"1min":1.274,"5min":1.377,"15min":1.4059999999999999},"min":{"1min":0.54200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0939999999999999,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":2.0939999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3959999999999999,"15min":1.47},"min":{"1min":0.66100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.639,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.464,"15min":1.482},"min":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.177}]},{"osd":7,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4830000000000001,"15min":1.4850000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9970000000000001,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5289999999999999,"15min":1.5920000000000001},"min":{"1min":0.82399999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.726,"5min":8.532,"15min":8.532},"last":1.234}]}]},{"osd":5,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.002,"15min":0.96199999999999997},"min":{"1min":0.64600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.51,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.048,"15min":1.036},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.397,"5min":2.004,"15min":2.004},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.0269999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.641,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.171,"5min":1.143,"15min":1.2110000000000001},"min":{"1min":0.71099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.621,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2589999999999999,"15min":1.294},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.667,"5min":2.827,"15min":2.827},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.347},"min":{"1min":0.91600000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7969999999999999,"5min":1.96,"15min":1.96},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.377,"5min":1.391,"15min":1.419},"min":{"1min":0.88300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.792,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2470000000000001,"15min":1.282},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.839,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.621},{"interface":"front","average":{"1min":1.393,"5min":1.3799999999999999,"15min":1.375},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.9059999999999999,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.403,"15min":1.401},"min":{"1min":0.67900000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.7430000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.395,"5min":1.385,"15min":1.4179999999999999},"min":{"1min":0.66400000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.2730000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.52,"15min":1.4810000000000001},"min":{"1min":0.64800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2410000000000001,"5min":3.242,"15min":3.242},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5349999999999999,"15min":1.518},"min":{"1min":0.745,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.3879999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.745}]}]},{"osd":4,"up_from":14,"seq":60129542208,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":524968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0549999999999999,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.0860000000000001,"15min":1.1359999999999999},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.583,"5min":2.335,"15min":2.335},"last":1.2509999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.149,"15min":1.1859999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.8999999999999999,"5min":1.958,"15min":1.958},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2190000000000001,"15min":1.242},"min":{"1min":0.94199999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7070000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.347,"15min":1.393},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.875,"5min":2.456,"15min":2.456},"last":1.637}]},{"osd":3,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2270000000000001,"15min":1.2170000000000001},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.764,"5min":1.871,"15min":1.871},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.751,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.526}]},{"osd":5,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.357,"15min":1.4470000000000001},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":2.097,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.3300000000000001,"15min":1.4099999999999999},"min":{"1min":0.83899999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.647,"5min":2.137,"15min":2.137},"last":1.4630000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.468},"min":{"1min":0.68999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6559999999999999,"5min":3.016,"15min":3.016},"last":1.389},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4590000000000001,"15min":1.5509999999999999},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.5700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.569},"min":{"1min":0.79000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.917,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5660000000000001,"15min":1.6539999999999999},"min":{"1min":0.82099999999999995,"5min":0.5,"15min":0.5},"max":{"1min":2.1970000000000001,"5min":3.141,"15min":3.141},"last":1.6080000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":525596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.85299999999999998,"15min":0.93100000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2589999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":1.004},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.97299999999999998},"min":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5880000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.375,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0609999999999999,"15min":1.107},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.716,"5min":2.121,"15min":2.121},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.135,"15min":1.161},"min":{"1min":0.56100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6870000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1439999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7470000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.042},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3560000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.806,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3520000000000001,"15min":1.458},"min":{"1min":0.81200000000000006,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.9019999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.367},"min":{"1min":0.748,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.056,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.405,"15min":1.4350000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9410000000000001,"5min":2.25,"15min":2.25},"last":1.51},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.45,"15min":1.548},"min":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9710000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.427,"15min":1.4730000000000001},"min":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.036,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.403},{"interface":"front","average":{"1min":1.413,"5min":1.5149999999999999,"15min":1.591},"min":{"1min":0.85999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0859999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6339999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.79000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5549999999999999,"5min":1.948,"15min":1.948},"last":0.748},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96599999999999997,"15min":0.91200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6220000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.292}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6759999999999999,"5min":2.996,"15min":2.996},"last":0.497},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.01,"15min":0.97099999999999997},"min":{"1min":0.52800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4039999999999999,"5min":2.238,"15min":2.238},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.631,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.103,"15min":1.0649999999999999},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3120000000000001,"15min":1.3140000000000001},"min":{"1min":0.81399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9059999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":0.749,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8460000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.371,"15min":1.375},"min":{"1min":0.82399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.6339999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.86099999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9139999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.399}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9410000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.042},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4119999999999999,"15min":1.417},"min":{"1min":0.80500000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.748,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.871}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.49,"15min":1.47},"min":{"1min":0.98699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.044,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.127},{"interface":"front","average":{"1min":1.464,"5min":1.508,"15min":1.5069999999999999},"min":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.089,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1105920,"data_stored":524910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.748},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.089},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.298},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.355}]}]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.92300000000000004,"15min":0.88600000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.0389999999999997,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.048,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":8.3140000000000001},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1140000000000001,"15min":1.1559999999999999},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.423,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.628}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98799999999999999,"15min":1.087},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.2609999999999999,"15min":1.3029999999999999},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3260000000000001,"15min":1.46},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.2709999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.121},{"interface":"front","average":{"1min":1.748,"5min":1.343,"15min":1.351},"min":{"1min":0.90100000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":10.208,"5min":10.208,"15min":10.208},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3420000000000001,"15min":1.423},"min":{"1min":0.84799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.319,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.177},{"interface":"front","average":{"1min":1.633,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":1.208}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":2.085,"5min":1.607,"15min":1.571},"min":{"1min":0.84599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":12.779,"5min":12.779,"15min":12.779},"last":1.26},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.81899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":0.94399999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":1.589,"15min":1.661},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":8.2569999999999997,"5min":8.2569999999999997,"15min":8.2569999999999997},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.4630000000000001,"15min":1.5369999999999999},"min":{"1min":0.97299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":1.321}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:07.959 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:20:07.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.182+0000 7f376a378640 1 Processor -- start 2023-12-08T08:20:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.182+0000 7f376a378640 1 -- start start 2023-12-08T08:20:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f376a378640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f37640aa2b0 0x7f37640a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f376a378640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3764154a20 0x7f3764154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f376a378640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640c63b0 con 0x7f3764154190 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f376a378640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640a9f20 con 0x7f3764154a20 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f376a378640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640a9580 con 0x7f37640aa2b0 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f3763fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3764154190 0x7f37640c42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43954/0 (socket says 172.21.15.45:43954) 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f3763fff640 1 -- 172.21.15.45:0/3764958187 learned_addr learned my addr 172.21.15.45:0/3764958187 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f3768915640 1 --2- 172.21.15.45:0/3764958187 >> v2:172.21.15.45:3300/0 conn(0x7f3764154a20 0x7f3764154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.184+0000 7f375bfff640 1 --2- 172.21.15.45:0/3764958187 >> v2:172.21.15.114:3300/0 conn(0x7f37640aa2b0 0x7f37640a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f37637fe640 1 -- 172.21.15.45:0/3764958187 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697276080 0 0) 0x7f37640c63b0 con 0x7f3764154190 2023-12-08T08:20:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f37637fe640 1 -- 172.21.15.45:0/3764958187 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3750005730 con 0x7f3764154190 2023-12-08T08:20:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f3768915640 1 -- 172.21.15.45:0/3764958187 >> v2:172.21.15.114:3300/0 conn(0x7f37640aa2b0 msgr2=0x7f37640a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f3768915640 1 --2- 172.21.15.45:0/3764958187 >> v2:172.21.15.114:3300/0 conn(0x7f37640aa2b0 0x7f37640a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f3768915640 1 -- 172.21.15.45:0/3764958187 >> v1:172.21.15.45:6789/0 conn(0x7f3764154190 legacy=0x7f37640c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.185+0000 7f3768915640 1 -- 172.21.15.45:0/3764958187 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640a9860 con 0x7f3764154a20 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.186+0000 7f3768915640 1 --2- 172.21.15.45:0/3764958187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3764154a20 0x7f3764154e70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f376406e0d0 tx=0x7f375c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47670852dd0bef2f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.186+0000 7f37637fe640 1 -- 172.21.15.45:0/3764958187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c02cbf0 con 0x7f3764154a20 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.186+0000 7f37637fe640 1 -- 172.21.15.45:0/3764958187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c02cd50 con 0x7f3764154a20 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.186+0000 7f37637fe640 1 -- 172.21.15.45:0/3764958187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c034660 con 0x7f3764154a20 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 -- 172.21.15.45:0/3764958187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3764154a20 msgr2=0x7f3764154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 --2- 172.21.15.45:0/3764958187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3764154a20 0x7f3764154e70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f376406e0d0 tx=0x7f375c02be40 comp rx=0 tx=0).stop 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 -- 172.21.15.45:0/3764958187 shutdown_connections 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 --2- 172.21.15.45:0/3764958187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3764154a20 0x7f3764154e70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 --2- 172.21.15.45:0/3764958187 >> v2:172.21.15.114:3300/0 conn(0x7f37640aa2b0 0x7f37640a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 -- 172.21.15.45:0/3764958187 >> 172.21.15.45:0/3764958187 conn(0x7f37640661f0 msgr2=0x7f3764066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 -- 172.21.15.45:0/3764958187 shutdown_connections 2023-12-08T08:20:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.187+0000 7f376a378640 1 -- 172.21.15.45:0/3764958187 wait complete. 2023-12-08T08:20:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.189+0000 7f376a378640 1 Processor -- start 2023-12-08T08:20:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.189+0000 7f376a378640 1 -- start start 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 0x7f37641550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3764154a20 0x7f37641ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37641e9fe0 con 0x7f37640aa2b0 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640a6a70 con 0x7f3764154190 2023-12-08T08:20:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f376a378640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37641ed0b0 con 0x7f3764154a20 2023-12-08T08:20:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f3763fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f3763fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41004/0 (socket says 172.21.15.45:41004) 2023-12-08T08:20:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.190+0000 7f3763fff640 1 -- 172.21.15.45:0/774143491 learned_addr learned my addr 172.21.15.45:0/774143491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 -- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3764154a20 msgr2=0x7f37641ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3764154a20 0x7f37641ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 -- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 msgr2=0x7f37641550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f375bfff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 0x7f37641550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 0x7f37641550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 -- 172.21.15.45:0/774143491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c009a70 con 0x7f37640aa2b0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f375bfff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 0x7f37641550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f3763fff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f375400c3b0 tx=0x7f375400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.191+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754005ce0 con 0x7f37640aa2b0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.192+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754005e40 con 0x7f37640aa2b0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.192+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37641dc210 con 0x7f37640aa2b0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.192+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754007310 con 0x7f37640aa2b0 2023-12-08T08:20:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.192+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37641dc7d0 con 0x7f37640aa2b0 2023-12-08T08:20:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.193+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37641ed6c0 con 0x7f37640aa2b0 2023-12-08T08:20:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.194+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3754007470 con 0x7f37640aa2b0 2023-12-08T08:20:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.195+0000 7f37617fa640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 0x7f374406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.195+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3754088ab0 con 0x7f37640aa2b0 2023-12-08T08:20:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.195+0000 7f375bfff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 0x7f374406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.196+0000 7f375bfff640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 0x7f374406d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f374c006fd0 tx=0x7f374c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.199+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3754053cb0 con 0x7f37640aa2b0 2023-12-08T08:20:08.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.393+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37640a9230 con 0x7f374406ae70 2023-12-08T08:20:08.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.395+0000 7f37617fa640 1 -- 172.21.15.45:0/774143491 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48396 (secure 0 0 0) 0x7f374c009530 con 0x7f374406ae70 2023-12-08T08:20:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:08.399 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:20:08.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 msgr2=0x7f374406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 0x7f374406d330 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f374c006fd0 tx=0x7f374c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:08.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 msgr2=0x7f37641e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f375400c3b0 tx=0x7f375400c870 comp rx=0 tx=0).stop 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 shutdown_connections 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f374406ae70 0x7f374406d330 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3764154a20 0x7f37641ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3764154190 0x7f37641550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 --2- 172.21.15.45:0/774143491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37640aa2b0 0x7f37641e9aa0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 >> 172.21.15.45:0/774143491 conn(0x7f37640661f0 msgr2=0x7f37640665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 shutdown_connections 2023-12-08T08:20:08.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.398+0000 7f376a378640 1 -- 172.21.15.45:0/774143491 wait complete. 2023-12-08T08:20:08.421 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2023-12-08T08:20:07.809062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":259392,"kb_used_data":9948,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715328,"statfs":{"total":773094113280,"available":772828495872,"internally_reserved":0,"allocated":10186752,"data_stored":5442750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.184387"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-08T08:20:03.767994+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:20:03.767994+0000","last_peered":"2023-12-08T08:20:03.767994+0000","last_clean":"2023-12-08T08:20:03.767994+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:20:03.767994+0000","last_undegraded":"2023-12-08T08:20:03.767994+0000","last_fullsized":"2023-12-08T08:20:03.767994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.016},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4219999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.139,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.671,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.127,"15min":1.1499999999999999},"min":{"1min":0.82799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.694,"5min":1.794,"15min":1.794},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.69599999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.145,"15min":2.145},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.149,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.78800000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2849999999999999,"15min":1.319},"min":{"1min":0.80800000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6399999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.345,"15min":1.399},"min":{"1min":0.876,"5min":0.75,"15min":0.75},"max":{"1min":1.702,"5min":3.524,"15min":3.524},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3700000000000001,"15min":1.399},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.855,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.379,"5min":1.371,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.97,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.504,"15min":1.4530000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.923,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.5209999999999999,"15min":1.5089999999999999},"min":{"1min":0.72099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0739999999999998,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5980000000000001,"15min":1.6419999999999999},"min":{"1min":0.84099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.0430000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.599,"15min":1.605},"min":{"1min":0.65400000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.157,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.71899999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.6970000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":19.065999999999999,"15min":19.065999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.298,"15min":1.796},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.615,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.1299999999999999},"min":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.611,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.66400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.867,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.867}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.226,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4830000000000001,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.266},"min":{"1min":0.76400000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6599999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":0.79800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2789999999999999,"15min":1.385},"min":{"1min":0.754,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8109999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.304,"15min":1.371},"min":{"1min":0.85799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5820000000000001,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":0.85799999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3400000000000001,"15min":1.349},"min":{"1min":0.63100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.792,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.077},{"interface":"front","average":{"1min":1.274,"5min":1.377,"15min":1.4059999999999999},"min":{"1min":0.54200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0939999999999999,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":2.0939999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3959999999999999,"15min":1.47},"min":{"1min":0.66100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.639,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.464,"15min":1.482},"min":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.177}]},{"osd":7,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4830000000000001,"15min":1.4850000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9970000000000001,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5289999999999999,"15min":1.5920000000000001},"min":{"1min":0.82399999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.726,"5min":8.532,"15min":8.532},"last":1.234}]}]},{"osd":5,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.002,"15min":0.96199999999999997},"min":{"1min":0.64600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.51,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.048,"15min":1.036},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.397,"5min":2.004,"15min":2.004},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.0269999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.641,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.171,"5min":1.143,"15min":1.2110000000000001},"min":{"1min":0.71099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.621,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2589999999999999,"15min":1.294},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.667,"5min":2.827,"15min":2.827},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.347},"min":{"1min":0.91600000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7969999999999999,"5min":1.96,"15min":1.96},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.377,"5min":1.391,"15min":1.419},"min":{"1min":0.88300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.792,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2470000000000001,"15min":1.282},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.839,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.621},{"interface":"front","average":{"1min":1.393,"5min":1.3799999999999999,"15min":1.375},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.9059999999999999,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.403,"15min":1.401},"min":{"1min":0.67900000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.7430000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.395,"5min":1.385,"15min":1.4179999999999999},"min":{"1min":0.66400000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.2730000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.52,"15min":1.4810000000000001},"min":{"1min":0.64800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2410000000000001,"5min":3.242,"15min":3.242},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5349999999999999,"15min":1.518},"min":{"1min":0.745,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.3879999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":0.745}]}]},{"osd":4,"up_from":14,"seq":60129542208,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":524968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0549999999999999,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.0860000000000001,"15min":1.1359999999999999},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.583,"5min":2.335,"15min":2.335},"last":1.2509999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.149,"15min":1.1859999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.8999999999999999,"5min":1.958,"15min":1.958},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2190000000000001,"15min":1.242},"min":{"1min":0.94199999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7070000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.347,"15min":1.393},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.875,"5min":2.456,"15min":2.456},"last":1.637}]},{"osd":3,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2270000000000001,"15min":1.2170000000000001},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.764,"5min":1.871,"15min":1.871},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.751,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.526}]},{"osd":5,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.357,"15min":1.4470000000000001},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":2.097,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.3300000000000001,"15min":1.4099999999999999},"min":{"1min":0.83899999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.647,"5min":2.137,"15min":2.137},"last":1.4630000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.468},"min":{"1min":0.68999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6559999999999999,"5min":3.016,"15min":3.016},"last":1.389},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4590000000000001,"15min":1.5509999999999999},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.5700000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.569},"min":{"1min":0.79000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.917,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5660000000000001,"15min":1.6539999999999999},"min":{"1min":0.82099999999999995,"5min":0.5,"15min":0.5},"max":{"1min":2.1970000000000001,"5min":3.141,"15min":3.141},"last":1.6080000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":525596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.85299999999999998,"15min":0.93100000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2589999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":1.004},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.97299999999999998},"min":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5880000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.375,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.92800000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0609999999999999,"15min":1.107},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.716,"5min":2.121,"15min":2.121},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.135,"15min":1.161},"min":{"1min":0.56100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6870000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.1439999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7470000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.042},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3560000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.806,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3520000000000001,"15min":1.458},"min":{"1min":0.81200000000000006,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.9019999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.367},"min":{"1min":0.748,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.056,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.405,"15min":1.4350000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9410000000000001,"5min":2.25,"15min":2.25},"last":1.51},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.45,"15min":1.548},"min":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9710000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.55}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.427,"15min":1.4730000000000001},"min":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.036,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.403},{"interface":"front","average":{"1min":1.413,"5min":1.5149999999999999,"15min":1.591},"min":{"1min":0.85999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0859999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.6339999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.79000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5549999999999999,"5min":1.948,"15min":1.948},"last":0.748},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96599999999999997,"15min":0.91200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6220000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.292}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6759999999999999,"5min":2.996,"15min":2.996},"last":0.497},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.01,"15min":0.97099999999999997},"min":{"1min":0.52800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4039999999999999,"5min":2.238,"15min":2.238},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.631,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.103,"15min":1.0649999999999999},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3120000000000001,"15min":1.3140000000000001},"min":{"1min":0.81399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9059999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":0.749,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8460000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.371,"15min":1.375},"min":{"1min":0.82399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.6339999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.86099999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9139999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.399}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9410000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.042},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4119999999999999,"15min":1.417},"min":{"1min":0.80500000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.748,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.871}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.49,"15min":1.47},"min":{"1min":0.98699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.044,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.127},{"interface":"front","average":{"1min":1.464,"5min":1.508,"15min":1.5069999999999999},"min":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.089,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1105920,"data_stored":524910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85199999999999998,"15min":0.876},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93600000000000005,"15min":0.97099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.4670000000000001,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.88800000000000001,"15min":0.91200000000000003},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.748},{"interface":"front","average":{"1min":1.147,"5min":1.0680000000000001,"15min":1.113},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.151,"15min":1.1850000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.999,"5min":1.0600000000000001,"15min":1.1180000000000001},"min":{"1min":0.47699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.631,"5min":2.327,"15min":2.327},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.25,"15min":1.306},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.972,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.089},{"interface":"front","average":{"1min":1.389,"5min":1.3879999999999999,"15min":1.478},"min":{"1min":0.73499999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.2719999999999998,"5min":2.552,"15min":2.552},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.365,"15min":1.4670000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.994,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.298},{"interface":"front","average":{"1min":1.355,"5min":1.3560000000000001,"15min":1.4339999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.25,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.476,"15min":1.5740000000000001},"min":{"1min":0.67600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8799999999999999,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.46,"15min":1.5509999999999999},"min":{"1min":0.82799999999999996,"5min":0.746,"15min":0.746},"max":{"1min":2.1600000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5169999999999999,"15min":1.583},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3439999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.575,"15min":1.6519999999999999},"min":{"1min":0.754,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.1579999999999999,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.355}]}]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.92300000000000004,"15min":0.88600000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.0389999999999997,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.048,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":8.3140000000000001},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1140000000000001,"15min":1.1559999999999999},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.423,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.628}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98799999999999999,"15min":1.087},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.2609999999999999,"15min":1.3029999999999999},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3260000000000001,"15min":1.46},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.2709999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.121},{"interface":"front","average":{"1min":1.748,"5min":1.343,"15min":1.351},"min":{"1min":0.90100000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":10.208,"5min":10.208,"15min":10.208},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3420000000000001,"15min":1.423},"min":{"1min":0.84799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.319,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.177},{"interface":"front","average":{"1min":1.633,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":1.208}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":2.085,"5min":1.607,"15min":1.571},"min":{"1min":0.84599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":12.779,"5min":12.779,"15min":12.779},"last":1.26},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.81899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":0.94399999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":1.589,"15min":1.661},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":8.2569999999999997,"5min":8.2569999999999997,"15min":8.2569999999999997},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.4630000000000001,"15min":1.5369999999999999},"min":{"1min":0.97299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":1.321}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:08.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:08.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.630+0000 7fc43ad1d640 1 Processor -- start 2023-12-08T08:20:08.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.630+0000 7fc43ad1d640 1 -- start start 2023-12-08T08:20:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc43ad1d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc434070310 0x7fc4340c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc43ad1d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4340a6d30 con 0x7fc434151f20 2023-12-08T08:20:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc43ad1d640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4340a6f80 con 0x7fc4340c5a90 2023-12-08T08:20:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc43ad1d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4340a7260 con 0x7fc434070310 2023-12-08T08:20:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc438ab9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc434151f20 0x7fc434158640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43960/0 (socket says 172.21.15.45:43960) 2023-12-08T08:20:08.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc438ab9640 1 -- 172.21.15.45:0/271291235 learned_addr learned my addr 172.21.15.45:0/271291235 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:08.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4392ba640 1 --2- 172.21.15.45:0/271291235 >> v2:172.21.15.45:3300/0 conn(0x7fc434070310 0x7fc4340c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4337fe640 1 -- 172.21.15.45:0/271291235 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198141881 0 0) 0x7fc4340a6d30 con 0x7fc434151f20 2023-12-08T08:20:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4337fe640 1 -- 172.21.15.45:0/271291235 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc420003520 con 0x7fc434151f20 2023-12-08T08:20:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4392ba640 1 -- 172.21.15.45:0/271291235 >> v1:172.21.15.114:6789/0 conn(0x7fc4340c5a90 legacy=0x7fc434154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4392ba640 1 -- 172.21.15.45:0/271291235 >> v1:172.21.15.45:6789/0 conn(0x7fc434151f20 legacy=0x7fc434158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.633+0000 7fc4392ba640 1 -- 172.21.15.45:0/271291235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434157e40 con 0x7fc434070310 2023-12-08T08:20:08.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.635+0000 7fc4392ba640 1 --2- 172.21.15.45:0/271291235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434070310 0x7fc4340c2510 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0097a0 tx=0x7fc42c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a10200e2947593 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.636+0000 7fc4337fe640 1 -- 172.21.15.45:0/271291235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c031830 con 0x7fc434070310 2023-12-08T08:20:08.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.636+0000 7fc4337fe640 1 -- 172.21.15.45:0/271291235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c031990 con 0x7fc434070310 2023-12-08T08:20:08.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.636+0000 7fc4337fe640 1 -- 172.21.15.45:0/271291235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c031d20 con 0x7fc434070310 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.636+0000 7fc43ad1d640 1 -- 172.21.15.45:0/271291235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434070310 msgr2=0x7fc4340c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.636+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/271291235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434070310 0x7fc4340c2510 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0097a0 tx=0x7fc42c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.637+0000 7fc43ad1d640 1 -- 172.21.15.45:0/271291235 shutdown_connections 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.637+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/271291235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434070310 0x7fc4340c2510 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.637+0000 7fc43ad1d640 1 -- 172.21.15.45:0/271291235 >> 172.21.15.45:0/271291235 conn(0x7fc4340a98a0 msgr2=0x7fc4340a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.637+0000 7fc43ad1d640 1 -- 172.21.15.45:0/271291235 shutdown_connections 2023-12-08T08:20:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.637+0000 7fc43ad1d640 1 -- 172.21.15.45:0/271291235 wait complete. 2023-12-08T08:20:08.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.639+0000 7fc43ad1d640 1 Processor -- start 2023-12-08T08:20:08.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.640+0000 7fc43ad1d640 1 -- start start 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 0x7fc434157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 0x7fc4341564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434155a50 con 0x7fc434151f20 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43406f410 con 0x7fc4340c5a90 2023-12-08T08:20:08.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc43ad1d640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341eaa00 con 0x7fc434070310 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.641+0000 7fc4392ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41014/0 (socket says 172.21.15.45:41014) 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 -- 172.21.15.45:0/1115945959 learned_addr learned my addr 172.21.15.45:0/1115945959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc438ab9640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 0x7fc434157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc433fff640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 0x7fc4341564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 -- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 msgr2=0x7fc434157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 0x7fc434157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 -- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 msgr2=0x7fc4341564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 0x7fc4341564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 -- 172.21.15.45:0/1115945959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009400 con 0x7fc434151f20 2023-12-08T08:20:08.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc438ab9640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 0x7fc434157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:08.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc433fff640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 0x7fc4341564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:08.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.642+0000 7fc4392ba640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fc42c034040 tx=0x7fc42c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.643+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c004230 con 0x7fc434151f20 2023-12-08T08:20:08.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.643+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c004390 con 0x7fc434151f20 2023-12-08T08:20:08.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.643+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c03a870 con 0x7fc434151f20 2023-12-08T08:20:08.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.643+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc434155cf0 con 0x7fc434151f20 2023-12-08T08:20:08.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.643+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4341eace0 con 0x7fc434151f20 2023-12-08T08:20:08.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.644+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc434156210 con 0x7fc434151f20 2023-12-08T08:20:08.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.648+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc42c03a9d0 con 0x7fc434151f20 2023-12-08T08:20:08.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.648+0000 7fc4317fa640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 0x7fc41406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.648+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc42c0ab5e0 con 0x7fc434151f20 2023-12-08T08:20:08.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.648+0000 7fc438ab9640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 0x7fc41406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.649+0000 7fc438ab9640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 0x7fc41406d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc424001560 tx=0x7fc424009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.652+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc434156210 con 0x7fc434151f20 2023-12-08T08:20:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.850+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc434156210 con 0x7fc434151f20 2023-12-08T08:20:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.852+0000 7fc4317fa640 1 -- 172.21.15.45:0/1115945959 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13298 (secure 0 0 0) 0x7fc434156210 con 0x7fc434151f20 2023-12-08T08:20:08.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:08.855 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"fsid":"0b2c17c3-2c01-4e93-b2e1-3af017d5ebd2","created":"2023-12-08T08:14:40.644722+0000","modified":"2023-12-08T08:20:03.878620+0000","last_up_change":"2023-12-08T08:14:52.229994+0000","last_in_change":"2023-12-08T08:14:44.143889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:14:53.770565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b16b74ac-7336-4c05-ba6c-83ef92715556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6801","nonce":672344515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6803","nonce":672344515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6807","nonce":672344515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":672344515},{"type":"v1","addr":"172.21.15.45:6805","nonce":672344515}]},"public_addr":"172.21.15.45:6801/672344515","cluster_addr":"172.21.15.45:6803/672344515","heartbeat_back_addr":"172.21.15.45:6807/672344515","heartbeat_front_addr":"172.21.15.45:6805/672344515","state":["exists","up"]},{"osd":1,"uuid":"f25d4e8d-6011-4ecf-beaf-19d993c8fb83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6809","nonce":1115540168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6811","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6813","nonce":1115540168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6819","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6821","nonce":1115540168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6815","nonce":1115540168},{"type":"v1","addr":"172.21.15.45:6817","nonce":1115540168}]},"public_addr":"172.21.15.45:6809/1115540168","cluster_addr":"172.21.15.45:6813/1115540168","heartbeat_back_addr":"172.21.15.45:6821/1115540168","heartbeat_front_addr":"172.21.15.45:6817/1115540168","state":["exists","up"]},{"osd":2,"uuid":"e99577bd-c584-497f-93eb-8b0113d5044a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6812","nonce":1587878241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6816","nonce":1587878241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6823","nonce":1587878241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":1587878241},{"type":"v1","addr":"172.21.15.45:6820","nonce":1587878241}]},"public_addr":"172.21.15.45:6812/1587878241","cluster_addr":"172.21.15.45:6816/1587878241","heartbeat_back_addr":"172.21.15.45:6823/1587878241","heartbeat_front_addr":"172.21.15.45:6820/1587878241","state":["exists","up"]},{"osd":3,"uuid":"e8c7d5c6-f66c-43a3-98f9-7bd30de4f7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6825","nonce":1638448391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6827","nonce":1638448391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6831","nonce":1638448391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1638448391},{"type":"v1","addr":"172.21.15.45:6829","nonce":1638448391}]},"public_addr":"172.21.15.45:6825/1638448391","cluster_addr":"172.21.15.45:6827/1638448391","heartbeat_back_addr":"172.21.15.45:6831/1638448391","heartbeat_front_addr":"172.21.15.45:6829/1638448391","state":["exists","up"]},{"osd":4,"uuid":"7c27b34e-7830-48a0-b421-1b486bdd118e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6825","nonce":257103469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6827","nonce":257103469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6831","nonce":257103469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":257103469},{"type":"v1","addr":"172.21.15.114:6829","nonce":257103469}]},"public_addr":"172.21.15.114:6825/257103469","cluster_addr":"172.21.15.114:6827/257103469","heartbeat_back_addr":"172.21.15.114:6831/257103469","heartbeat_front_addr":"172.21.15.114:6829/257103469","state":["exists","up"]},{"osd":5,"uuid":"392cd1c2-94e7-4711-9810-3df34267722d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6817","nonce":1412870860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6819","nonce":1412870860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6823","nonce":1412870860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":1412870860},{"type":"v1","addr":"172.21.15.114:6821","nonce":1412870860}]},"public_addr":"172.21.15.114:6817/1412870860","cluster_addr":"172.21.15.114:6819/1412870860","heartbeat_back_addr":"172.21.15.114:6823/1412870860","heartbeat_front_addr":"172.21.15.114:6821/1412870860","state":["exists","up"]},{"osd":6,"uuid":"e692ef1c-8c64-4bfa-a34a-8142b8cb1f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6804","nonce":345910373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6805","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6806","nonce":345910373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6811","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6812","nonce":345910373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":345910373},{"type":"v1","addr":"172.21.15.114:6809","nonce":345910373}]},"public_addr":"172.21.15.114:6804/345910373","cluster_addr":"172.21.15.114:6806/345910373","heartbeat_back_addr":"172.21.15.114:6812/345910373","heartbeat_front_addr":"172.21.15.114:6809/345910373","state":["exists","up"]},{"osd":7,"uuid":"a34a659f-5fa8-468c-9e93-f0fadf7c8c35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6801","nonce":1867013460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6803","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6807","nonce":1867013460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6815","nonce":1867013460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1867013460},{"type":"v1","addr":"172.21.15.114:6813","nonce":1867013460}]},"public_addr":"172.21.15.114:6801/1867013460","cluster_addr":"172.21.15.114:6807/1867013460","heartbeat_back_addr":"172.21.15.114:6815/1867013460","heartbeat_front_addr":"172.21.15.114:6813/1867013460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.704159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.690124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.410711+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.485030+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.504288+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:48.750850+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.474825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:14:49.491992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6836/1751024054":"2023-12-09T08:20:00.618359+0000","172.21.15.45:6834/1751024054":"2023-12-09T08:20:00.618359+0000","172.21.15.45:6837/2233278871":"2023-12-09T08:19:52.532292+0000","172.21.15.45:6835/2233278871":"2023-12-09T08:19:52.532292+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 msgr2=0x7fc41406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 0x7fc41406d330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc424001560 tx=0x7fc424009040 comp rx=0 tx=0).stop 2023-12-08T08:20:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 msgr2=0x7fc43406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fc42c034040 tx=0x7fc42c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 shutdown_connections 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fc41406ae70 0x7fc41406d330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc434151f20 0x7fc43406ed30 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4340c5a90 0x7fc4341564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 --2- 172.21.15.45:0/1115945959 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fc434070310 0x7fc434157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 >> 172.21.15.45:0/1115945959 conn(0x7fc4340a98a0 msgr2=0x7fc43406be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 shutdown_connections 2023-12-08T08:20:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:08.854+0000 7fc43ad1d640 1 -- 172.21.15.45:0/1115945959 wait complete. 2023-12-08T08:20:09.877 INFO:tasks.ceph:Scrubbing osd.0 2023-12-08T08:20:09.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.121+0000 7fa53e8bb640 1 Processor -- start 2023-12-08T08:20:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.122+0000 7fa53e8bb640 1 -- start start 2023-12-08T08:20:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.123+0000 7fa53e8bb640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5380a6140 0x7fa5380a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.123+0000 7fa53e8bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa538151ae0 0x7fa538070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.123+0000 7fa53e8bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53814ed00 con 0x7fa5380abb40 2023-12-08T08:20:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.123+0000 7fa53e8bb640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380a6520 con 0x7fa5380a6140 2023-12-08T08:20:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.123+0000 7fa53e8bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa538155030 con 0x7fa538151ae0 2023-12-08T08:20:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.124+0000 7fa537fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5380a6140 0x7fa5380a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.124+0000 7fa537fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5380a6140 0x7fa5380a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.45:38202/0 (socket says 172.21.15.45:38202) 2023-12-08T08:20:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.124+0000 7fa537fff640 1 -- 172.21.15.45:0/3525476279 learned_addr learned my addr 172.21.15.45:0/3525476279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.124+0000 7fa53ce58640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa538151ae0 0x7fa538070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.125+0000 7fa537fff640 1 -- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa538151ae0 msgr2=0x7fa538070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.125+0000 7fa537fff640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa538151ae0 0x7fa538070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.125+0000 7fa537fff640 1 -- 172.21.15.45:0/3525476279 >> v1:172.21.15.114:6789/0 conn(0x7fa5380abb40 legacy=0x7fa5381547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.125+0000 7fa537fff640 1 -- 172.21.15.45:0/3525476279 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538155310 con 0x7fa5380a6140 2023-12-08T08:20:10.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.126+0000 7fa537fff640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5380a6140 0x7fa5380a9a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa528009870 tx=0x7fa52802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a8766083484e75 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.127+0000 7fa5377fe640 1 -- 172.21.15.45:0/3525476279 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280317c0 con 0x7fa5380a6140 2023-12-08T08:20:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.127+0000 7fa5377fe640 1 -- 172.21.15.45:0/3525476279 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528031920 con 0x7fa5380a6140 2023-12-08T08:20:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.127+0000 7fa5377fe640 1 -- 172.21.15.45:0/3525476279 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528031cb0 con 0x7fa5380a6140 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 -- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5380a6140 msgr2=0x7fa5380a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5380a6140 0x7fa5380a9a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa528009870 tx=0x7fa52802b860 comp rx=0 tx=0).stop 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 -- 172.21.15.45:0/3525476279 shutdown_connections 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa538151ae0 0x7fa538070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/3525476279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5380a6140 0x7fa5380a9a80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 -- 172.21.15.45:0/3525476279 >> 172.21.15.45:0/3525476279 conn(0x7fa5380a8960 msgr2=0x7fa5380a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 -- 172.21.15.45:0/3525476279 shutdown_connections 2023-12-08T08:20:10.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.128+0000 7fa53e8bb640 1 -- 172.21.15.45:0/3525476279 wait complete. 2023-12-08T08:20:10.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.130+0000 7fa53e8bb640 1 Processor -- start 2023-12-08T08:20:10.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.130+0000 7fa53e8bb640 1 -- start start 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 0x7fa53814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5380abb40 0x7fa5380c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa538151ae0 0x7fa53814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53814f920 con 0x7fa5380a6140 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa538149f00 con 0x7fa538151ae0 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53e8bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa538149c20 con 0x7fa5380abb40 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa537fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 0x7fa53814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa537fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 0x7fa53814fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41028/0 (socket says 172.21.15.45:41028) 2023-12-08T08:20:10.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa537fff640 1 -- 172.21.15.45:0/2520139086 learned_addr learned my addr 172.21.15.45:0/2520139086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:10.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa53ce58640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa538151ae0 0x7fa53814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.131+0000 7fa52ffff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5380abb40 0x7fa5380c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 -- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5380abb40 msgr2=0x7fa5380c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fa5380abb40 0x7fa5380c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 -- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa538151ae0 msgr2=0x7fa53814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa538151ae0 0x7fa53814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280094d0 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa537fff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 0x7fa53814fdb0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa5280090b0 tx=0x7fa5280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528032860 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280329c0 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528032d70 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.132+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5381edaa0 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.133+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5380c5300 con 0x7fa5380a6140 2023-12-08T08:20:10.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.133+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa538151270 con 0x7fa5380a6140 2023-12-08T08:20:10.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.135+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa52804d3f0 con 0x7fa5380a6140 2023-12-08T08:20:10.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa5357fa640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa51806ae40 0x7fa51806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa5280ab270 con 0x7fa5380a6140 2023-12-08T08:20:10.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa5357fa640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7fa5180711e0 0x7fa518073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa518073cf0 con 0x7fa5180711e0 2023-12-08T08:20:10.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5280ad850 con 0x7fa5380a6140 2023-12-08T08:20:10.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa52ffff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa51806ae40 0x7fa51806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.136+0000 7fa53ce58640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7fa5180711e0 0x7fa518073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.137+0000 7fa52ffff640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa51806ae40 0x7fa51806d300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa520007fd0 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.137+0000 7fa53ce58640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7fa5180711e0 0x7fa518073620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.138+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== osd.0 v2:172.21.15.45:6800/672344515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa518073cf0 con 0x7fa5180711e0 2023-12-08T08:20:10.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.153+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 --> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5381515c0 con 0x7fa5180711e0 2023-12-08T08:20:10.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.153+0000 7fa5357fa640 1 -- 172.21.15.45:0/2520139086 <== osd.0 v2:172.21.15.45:6800/672344515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa53000f040 con 0x7fa5180711e0 2023-12-08T08:20:10.155 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:10.155 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:10.155 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.153+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7fa5180711e0 msgr2=0x7fa518073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.153+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6800/672344515,v1:172.21.15.45:6801/672344515] conn(0x7fa5180711e0 0x7fa518073620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.153+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa51806ae40 msgr2=0x7fa51806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fa51806ae40 0x7fa51806d300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa520007fd0 tx=0x7fa520009040 comp rx=0 tx=0).stop 2023-12-08T08:20:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 msgr2=0x7fa53814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 --2- 172.21.15.45:0/2520139086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5380a6140 0x7fa53814fdb0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa5280090b0 tx=0x7fa5280046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53ce58640 1 -- 172.21.15.45:0/2520139086 reap_dead start 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 shutdown_connections 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 >> 172.21.15.45:0/2520139086 conn(0x7fa5380a8960 msgr2=0x7fa5380bfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 shutdown_connections 2023-12-08T08:20:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.154+0000 7fa53e8bb640 1 -- 172.21.15.45:0/2520139086 wait complete. 2023-12-08T08:20:10.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-08T08:20:10.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.388+0000 7f2b3db88640 1 Processor -- start 2023-12-08T08:20:10.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.388+0000 7f2b3db88640 1 -- start start 2023-12-08T08:20:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.389+0000 7f2b3db88640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b380c4590 0x7f2b381584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.389+0000 7f2b3db88640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b380c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.389+0000 7f2b3db88640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b380c50d0 con 0x7f2b38151ca0 2023-12-08T08:20:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.389+0000 7f2b3db88640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b380c5470 con 0x7f2b380c4590 2023-12-08T08:20:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.389+0000 7f2b3db88640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38157a60 con 0x7f2b380c7b10 2023-12-08T08:20:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b3cb86640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2b38151ca0 0x7f2b38154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43968/0 (socket says 172.21.15.45:43968) 2023-12-08T08:20:10.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b3cb86640 1 -- 172.21.15.45:0/3582127497 learned_addr learned my addr 172.21.15.45:0/3582127497 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b380c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3582127497 >> v2:172.21.15.114:3300/0 conn(0x7f2b380c4590 0x7f2b381584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676104449 0 0) 0x7f2b380c50d0 con 0x7f2b38151ca0 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.390+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b24003520 con 0x7f2b38151ca0 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474610264 0 0) 0x7f2b24003520 con 0x7f2b38151ca0 2023-12-08T08:20:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 msgr2=0x7f2b380c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b380c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 >> v2:172.21.15.114:3300/0 conn(0x7f2b380c4590 msgr2=0x7f2b381584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 --2- 172.21.15.45:0/3582127497 >> v2:172.21.15.114:3300/0 conn(0x7f2b380c4590 0x7f2b381584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38158020 con 0x7f2b38151ca0 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f2b20001670 con 0x7f2b38151ca0 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 >> v1:172.21.15.45:6789/0 conn(0x7f2b38151ca0 legacy=0x7f2b38154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b24003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b24003f40 0x7f2b240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380c5470 con 0x7f2b24004d00 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38157a60 con 0x7f2b24003f40 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400ba30 con 0x7f2b380c7b10 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b3cb86640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b24003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.391+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b24003f40 0x7f2b240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b3d387640 1 -- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 msgr2=0x7f2b24003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380c7b10 0x7f2b24003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b3d387640 1 -- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b24003f40 msgr2=0x7f2b240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b24003f40 0x7f2b240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b3d387640 1 -- 172.21.15.45:0/3582127497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24003520 con 0x7f2b24004d00 2023-12-08T08:20:10.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.392+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b24003f40 0x7f2b240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.393+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b24005180 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009ac0 tx=0x7f2b240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f87927ddd5ec9c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.393+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3002c6b0 con 0x7f2b24004d00 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.393+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3002c810 con 0x7f2b24004d00 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.393+0000 7f2b377fe640 1 -- 172.21.15.45:0/3582127497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3002cba0 con 0x7f2b24004d00 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 -- 172.21.15.45:0/3582127497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 msgr2=0x7f2b24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3582127497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b24005180 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009ac0 tx=0x7f2b240057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3d387640 1 -- 172.21.15.45:0/3582127497 reap_dead start 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 -- 172.21.15.45:0/3582127497 shutdown_connections 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 -- 172.21.15.45:0/3582127497 >> 172.21.15.45:0/3582127497 conn(0x7f2b3806b850 msgr2=0x7f2b3806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 -- 172.21.15.45:0/3582127497 shutdown_connections 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.394+0000 7f2b3db88640 1 -- 172.21.15.45:0/3582127497 wait complete. 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.396+0000 7f2b3db88640 1 Processor -- start 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.396+0000 7f2b3db88640 1 -- start start 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380aec70 0x7f2b380c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 0x7f2b3814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3814b010 con 0x7f2b24004d00 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380c2510 con 0x7f2b3814a0e0 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3db88640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380c27f0 con 0x7f2b380aec70 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41058/0 (socket says 172.21.15.45:41058) 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 -- 172.21.15.45:0/3203941738 learned_addr learned my addr 172.21.15.45:0/3203941738 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380aec70 0x7f2b380c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 0x7f2b3814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 -- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380aec70 msgr2=0x7f2b380c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380aec70 0x7f2b380c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 -- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 msgr2=0x7f2b3814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 0x7f2b3814a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3cb86640 1 -- 172.21.15.45:0/3203941738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380c2ad0 con 0x7f2b24004d00 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.397+0000 7f2b3d387640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 0x7f2b3814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b3cb86640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2b20001050 tx=0x7f2b200077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000f990 con 0x7f2b24004d00 2023-12-08T08:20:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000faf0 con 0x7f2b24004d00 2023-12-08T08:20:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380c3530 con 0x7f2b24004d00 2023-12-08T08:20:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000fe60 con 0x7f2b24004d00 2023-12-08T08:20:10.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.398+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b380af0f0 con 0x7f2b24004d00 2023-12-08T08:20:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.400+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b380743e0 con 0x7f2b24004d00 2023-12-08T08:20:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.400+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b2001d460 con 0x7f2b24004d00 2023-12-08T08:20:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.402+0000 7f2b357fa640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 0x7f2b1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.402+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2b20089740 con 0x7f2b24004d00 2023-12-08T08:20:10.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.402+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 0x7f2b1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.403+0000 7f2b37fff640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 0x7f2b1806d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2b38151920 tx=0x7f2b2800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.406+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b20054940 con 0x7f2b24004d00 2023-12-08T08:20:10.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.601+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b380c2680 con 0x7f2b1806ae70 2023-12-08T08:20:10.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.602+0000 7f2b357fa640 1 -- 172.21.15.45:0/3203941738 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b380c2680 con 0x7f2b1806ae70 2023-12-08T08:20:10.604 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-12-08T08:20:10.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 msgr2=0x7f2b1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 0x7f2b1806d330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2b38151920 tx=0x7f2b2800b040 comp rx=0 tx=0).stop 2023-12-08T08:20:10.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 msgr2=0x7f2b380c0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f2b20001050 tx=0x7f2b200077a0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 shutdown_connections 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f2b1806ae70 0x7f2b1806d330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f2b380aec70 0x7f2b380c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b3814a0e0 0x7f2b3814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 --2- 172.21.15.45:0/3203941738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b24004d00 0x7f2b380c0ce0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.604+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 >> 172.21.15.45:0/3203941738 conn(0x7f2b3806b850 msgr2=0x7f2b380c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.605+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 shutdown_connections 2023-12-08T08:20:10.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.605+0000 7f2b3db88640 1 -- 172.21.15.45:0/3203941738 wait complete. 2023-12-08T08:20:10.624 INFO:tasks.ceph:Scrubbing osd.1 2023-12-08T08:20:10.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.846+0000 7f732bfff640 1 Processor -- start 2023-12-08T08:20:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.846+0000 7f732bfff640 1 -- start start 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732c0c1640 0x7f732c0c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c0a9810 con 0x7f732c0c5c10 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732bfff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c0a5040 con 0x7f732c0c57b0 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732bfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0a52e0 con 0x7f732c0c1640 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732c0c1640 0x7f732c0c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f732c0c1640 0x7f732c0c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41066/0 (socket says 172.21.15.45:41066) 2023-12-08T08:20:10.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.848+0000 7f732affd640 1 -- 172.21.15.45:0/1585759068 learned_addr learned my addr 172.21.15.45:0/1585759068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:10.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.849+0000 7f732affd640 1 -- 172.21.15.45:0/1585759068 >> v1:172.21.15.114:6789/0 conn(0x7f732c0c57b0 legacy=0x7f732c0a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.849+0000 7f732affd640 1 -- 172.21.15.45:0/1585759068 >> v1:172.21.15.45:6789/0 conn(0x7f732c0c5c10 legacy=0x7f732c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.849+0000 7f732affd640 1 -- 172.21.15.45:0/1585759068 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0a94a0 con 0x7f732c0c1640 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.850+0000 7f732affd640 1 --2- 172.21.15.45:0/1585759068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c0c4dd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f731c009870 tx=0x7f731c02dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b5378f4c07347 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.850+0000 7f732a7fc640 1 -- 172.21.15.45:0/1585759068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c02e950 con 0x7f732c0c1640 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.850+0000 7f732a7fc640 1 -- 172.21.15.45:0/1585759068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c02eab0 con 0x7f732c0c1640 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.850+0000 7f732a7fc640 1 -- 172.21.15.45:0/1585759068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c02ee40 con 0x7f732c0c1640 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 -- 172.21.15.45:0/1585759068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 msgr2=0x7f732c0c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 --2- 172.21.15.45:0/1585759068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c0c4dd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f731c009870 tx=0x7f731c02dba0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 -- 172.21.15.45:0/1585759068 shutdown_connections 2023-12-08T08:20:10.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 --2- 172.21.15.45:0/1585759068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c0c4dd0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 -- 172.21.15.45:0/1585759068 >> 172.21.15.45:0/1585759068 conn(0x7f732c066df0 msgr2=0x7f732c0a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 -- 172.21.15.45:0/1585759068 shutdown_connections 2023-12-08T08:20:10.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.851+0000 7f732bfff640 1 -- 172.21.15.45:0/1585759068 wait complete. 2023-12-08T08:20:10.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.853+0000 7f732bfff640 1 Processor -- start 2023-12-08T08:20:10.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.853+0000 7f732bfff640 1 -- start start 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c1dab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f732c0c57b0 0x7f732c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732c153730 0x7f732c14e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c152890 con 0x7f732c0c1640 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c151c80 con 0x7f732c0c57b0 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732bfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c151f60 con 0x7f732c153730 2023-12-08T08:20:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c1dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c1dab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41080/0 (socket says 172.21.15.45:41080) 2023-12-08T08:20:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.854+0000 7f732affd640 1 -- 172.21.15.45:0/404107166 learned_addr learned my addr 172.21.15.45:0/404107166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:10.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 -- 172.21.15.45:0/404107166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732c153730 msgr2=0x7f732c14e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f732c153730 0x7f732c14e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 -- 172.21.15.45:0/404107166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f732c0c57b0 msgr2=0x7f732c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f73227fc640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f732c0c57b0 0x7f732c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f732c0c57b0 0x7f732c1531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0094d0 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732affd640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c1dab80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f731c009870 tx=0x7f731c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c041650 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0417b0 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c041b60 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.855+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c152240 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.856+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c1db0c0 con 0x7f732c0c1640 2023-12-08T08:20:10.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.856+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f732c0c4070 con 0x7f732c0c1640 2023-12-08T08:20:10.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.857+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f731c03d070 con 0x7f732c0c1640 2023-12-08T08:20:10.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.858+0000 7f7323fff640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f730c06ae40 0x7f730c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f731c0ac0a0 con 0x7f732c0c1640 2023-12-08T08:20:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f7323fff640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7f730c0711e0 0x7f730c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f730c073cf0 con 0x7f730c0711e0 2023-12-08T08:20:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f731c0ae680 con 0x7f732c0c1640 2023-12-08T08:20:10.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f73227fc640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f730c06ae40 0x7f730c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.859+0000 7f732b7fe640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7f730c0711e0 0x7f730c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.860+0000 7f73227fc640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f730c06ae40 0x7f730c06d300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7314007fd0 tx=0x7f7314009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.860+0000 7f732b7fe640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7f730c0711e0 0x7f730c073620 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.861+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== osd.1 v2:172.21.15.45:6808/1115540168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f730c073cf0 con 0x7f730c0711e0 2023-12-08T08:20:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.875+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 --> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f732c1520d0 con 0x7f730c0711e0 2023-12-08T08:20:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f7323fff640 1 -- 172.21.15.45:0/404107166 <== osd.1 v2:172.21.15.45:6808/1115540168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f732c1520d0 con 0x7f730c0711e0 2023-12-08T08:20:10.877 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:10.878 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:10.878 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7f730c0711e0 msgr2=0x7f730c073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6808/1115540168,v1:172.21.15.45:6809/1115540168] conn(0x7f730c0711e0 0x7f730c073620 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f730c06ae40 msgr2=0x7f730c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f730c06ae40 0x7f730c06d300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7314007fd0 tx=0x7f7314009040 comp rx=0 tx=0).stop 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 msgr2=0x7f732c1dab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 --2- 172.21.15.45:0/404107166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f732c0c1640 0x7f732c1dab80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f731c009870 tx=0x7f731c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732b7fe640 1 -- 172.21.15.45:0/404107166 reap_dead start 2023-12-08T08:20:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 shutdown_connections 2023-12-08T08:20:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.876+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 >> 172.21.15.45:0/404107166 conn(0x7f732c066df0 msgr2=0x7f732c0a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.877+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 shutdown_connections 2023-12-08T08:20:10.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:10.877+0000 7f732bfff640 1 -- 172.21.15.45:0/404107166 wait complete. 2023-12-08T08:20:10.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-08T08:20:11.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.119+0000 7ff8d7b25640 1 Processor -- start 2023-12-08T08:20:11.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.120+0000 7ff8d7b25640 1 -- start start 2023-12-08T08:20:11.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 0x7ff8d00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 0x7ff8d00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8d00c8470 0x7ff8d0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d00c56a0 con 0x7ff8d00c8470 2023-12-08T08:20:11.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d00c5250 con 0x7ff8d0151c10 2023-12-08T08:20:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.121+0000 7ff8d7b25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d00c9290 con 0x7ff8d00c9720 2023-12-08T08:20:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8d00c8470 0x7ff8d0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8d00c8470 0x7ff8d0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41082/0 (socket says 172.21.15.45:41082) 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 -- 172.21.15.45:0/3237301569 learned_addr learned my addr 172.21.15.45:0/3237301569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d50c0640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 0x7ff8d00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d58c1640 1 --2- 172.21.15.45:0/3237301569 >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 0x7ff8d00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 -- 172.21.15.45:0/3237301569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 msgr2=0x7ff8d00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 0x7ff8d00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 -- 172.21.15.45:0/3237301569 >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 msgr2=0x7ff8d00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 --2- 172.21.15.45:0/3237301569 >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 0x7ff8d00c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d60c2640 1 -- 172.21.15.45:0/3237301569 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0151ff0 con 0x7ff8d00c8470 2023-12-08T08:20:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d50c0640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 0x7ff8d00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.122+0000 7ff8d58c1640 1 --2- 172.21.15.45:0/3237301569 >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 0x7ff8d00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.123+0000 7ff8d60c2640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c8470 0x7ff8d0157b10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009e80 tx=0x7ff8c802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffac45648f529697 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d48bf640 1 -- 172.21.15.45:0/3237301569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c802caf0 con 0x7ff8d00c8470 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d48bf640 1 -- 172.21.15.45:0/3237301569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c802cc50 con 0x7ff8d00c8470 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d48bf640 1 -- 172.21.15.45:0/3237301569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80343f0 con 0x7ff8d00c8470 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 -- 172.21.15.45:0/3237301569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c8470 msgr2=0x7ff8d0157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c8470 0x7ff8d0157b10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009e80 tx=0x7ff8c802bf50 comp rx=0 tx=0).stop 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 -- 172.21.15.45:0/3237301569 shutdown_connections 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c8470 0x7ff8d0157b10 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/3237301569 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c9720 0x7ff8d00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/3237301569 >> v2:172.21.15.114:3300/0 conn(0x7ff8d0151c10 0x7ff8d00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.124+0000 7ff8d7b25640 1 -- 172.21.15.45:0/3237301569 >> 172.21.15.45:0/3237301569 conn(0x7ff8d00ab9c0 msgr2=0x7ff8d00abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.125+0000 7ff8d7b25640 1 -- 172.21.15.45:0/3237301569 shutdown_connections 2023-12-08T08:20:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.125+0000 7ff8d7b25640 1 -- 172.21.15.45:0/3237301569 wait complete. 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.126+0000 7ff8d7b25640 1 Processor -- start 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.126+0000 7ff8d7b25640 1 -- start start 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c8470 0x7ff8d01ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 0x7ff8d0144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d014fae0 con 0x7ff8d00c9720 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d014f800 con 0x7ff8d0151c10 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.127+0000 7ff8d7b25640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01ee290 con 0x7ff8d00c8470 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41098/0 (socket says 172.21.15.45:41098) 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 -- 172.21.15.45:0/2189290276 learned_addr learned my addr 172.21.15.45:0/2189290276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d58c1640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c8470 0x7ff8d01ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d60c2640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 0x7ff8d0144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 -- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c8470 msgr2=0x7ff8d01ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c8470 0x7ff8d01ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 -- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 msgr2=0x7ff8d0144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 0x7ff8d0144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 -- 172.21.15.45:0/2189290276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009b30 con 0x7ff8d00c9720 2023-12-08T08:20:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d60c2640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 0x7ff8d0144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.128+0000 7ff8d50c0640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c7c0 tx=0x7ff8c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.129+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4007a30 con 0x7ff8d00c9720 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.129+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4007b90 con 0x7ff8d00c9720 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.129+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400ce70 con 0x7ff8d00c9720 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.129+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d01ee570 con 0x7ff8d00c9720 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.129+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d01450b0 con 0x7ff8d00c9720 2023-12-08T08:20:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.130+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d00c1980 con 0x7ff8d00c9720 2023-12-08T08:20:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.131+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8c40113f0 con 0x7ff8d00c9720 2023-12-08T08:20:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.132+0000 7ff8c27fc640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 0x7ff8b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.132+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff8c4089510 con 0x7ff8d00c9720 2023-12-08T08:20:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.132+0000 7ff8d58c1640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 0x7ff8b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.133+0000 7ff8d58c1640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 0x7ff8b406d300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00a950 tx=0x7ff8cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.137+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8d00c1980 con 0x7ff8d00c9720 2023-12-08T08:20:11.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.332+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8d014f970 con 0x7ff8b406ae40 2023-12-08T08:20:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.333+0000 7ff8c27fc640 1 -- 172.21.15.45:0/2189290276 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8d014f970 con 0x7ff8b406ae40 2023-12-08T08:20:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-12-08T08:20:11.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 msgr2=0x7ff8b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 0x7ff8b406d300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00a950 tx=0x7ff8cc008040 comp rx=0 tx=0).stop 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 msgr2=0x7ff8d0144580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c7c0 tx=0x7ff8c400cc80 comp rx=0 tx=0).stop 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 shutdown_connections 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff8b406ae40 0x7ff8b406d300 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8d0151c10 0x7ff8d0144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8d00c9720 0x7ff8d0144580 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 --2- 172.21.15.45:0/2189290276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff8d00c8470 0x7ff8d01ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 >> 172.21.15.45:0/2189290276 conn(0x7ff8d00ab9c0 msgr2=0x7ff8d006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 shutdown_connections 2023-12-08T08:20:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.336+0000 7ff8d7b25640 1 -- 172.21.15.45:0/2189290276 wait complete. 2023-12-08T08:20:11.356 INFO:tasks.ceph:Scrubbing osd.2 2023-12-08T08:20:11.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:11.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.575+0000 7f9a7759e640 1 Processor -- start 2023-12-08T08:20:11.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.576+0000 7f9a7759e640 1 -- start start 2023-12-08T08:20:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a78151a50 0x7f9a78151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a7759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a780c7b10 0x7f9a780c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a7759e640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780c8780 con 0x7f9a780c9010 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a7759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a780c6f60 con 0x7f9a780c7b10 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a7759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780c4630 con 0x7f9a78151a50 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a6ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a780c7b10 0x7f9a780c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a6ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a780c7b10 0x7f9a780c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41108/0 (socket says 172.21.15.45:41108) 2023-12-08T08:20:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.577+0000 7f9a6ffff640 1 -- 172.21.15.45:0/4238356807 learned_addr learned my addr 172.21.15.45:0/4238356807 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.578+0000 7f9a7659c640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a78151a50 0x7f9a78151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.578+0000 7f9a6ffff640 1 -- 172.21.15.45:0/4238356807 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a78151a50 msgr2=0x7f9a78151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.578+0000 7f9a6ffff640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a78151a50 0x7f9a78151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.578+0000 7f9a6ffff640 1 -- 172.21.15.45:0/4238356807 >> v1:172.21.15.114:6789/0 conn(0x7f9a780c9010 legacy=0x7f9a78157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.578+0000 7f9a6ffff640 1 -- 172.21.15.45:0/4238356807 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780c7160 con 0x7f9a780c7b10 2023-12-08T08:20:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.579+0000 7f9a6ffff640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a780c7b10 0x7f9a780c8240 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a6002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27c8f76f56e73bc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.579+0000 7f9a75d9b640 1 -- 172.21.15.45:0/4238356807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600317c0 con 0x7f9a780c7b10 2023-12-08T08:20:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.579+0000 7f9a75d9b640 1 -- 172.21.15.45:0/4238356807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60031920 con 0x7f9a780c7b10 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.579+0000 7f9a75d9b640 1 -- 172.21.15.45:0/4238356807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60031cb0 con 0x7f9a780c7b10 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 -- 172.21.15.45:0/4238356807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a780c7b10 msgr2=0x7f9a780c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a780c7b10 0x7f9a780c8240 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a6002b860 comp rx=0 tx=0).stop 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 -- 172.21.15.45:0/4238356807 shutdown_connections 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a780c7b10 0x7f9a780c8240 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 --2- 172.21.15.45:0/4238356807 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a78151a50 0x7f9a78151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 -- 172.21.15.45:0/4238356807 >> 172.21.15.45:0/4238356807 conn(0x7f9a7806b850 msgr2=0x7f9a7806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 -- 172.21.15.45:0/4238356807 shutdown_connections 2023-12-08T08:20:11.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.580+0000 7f9a7759e640 1 -- 172.21.15.45:0/4238356807 wait complete. 2023-12-08T08:20:11.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.582+0000 7f9a7759e640 1 Processor -- start 2023-12-08T08:20:11.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.582+0000 7f9a7759e640 1 -- start start 2023-12-08T08:20:11.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a780c7b10 0x7f9a78155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a780c9010 0x7f9a780c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 0x7f9a780c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78154f90 con 0x7f9a78151a50 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7814a860 con 0x7f9a780c7b10 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7759e640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a781eab10 con 0x7f9a780c9010 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 0x7f9a780c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 0x7f9a780c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41122/0 (socket says 172.21.15.45:41122) 2023-12-08T08:20:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a76d9d640 1 -- 172.21.15.45:0/996284876 learned_addr learned my addr 172.21.15.45:0/996284876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a7659c640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a780c7b10 0x7f9a78155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.583+0000 7f9a6ffff640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a780c9010 0x7f9a780c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 -- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a780c9010 msgr2=0x7f9a780c0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9a780c9010 0x7f9a780c0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 -- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a780c7b10 msgr2=0x7f9a78155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a780c7b10 0x7f9a78155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600094d0 con 0x7f9a78151a50 2023-12-08T08:20:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a76d9d640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 0x7f9a780c2850 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c780 tx=0x7f9a7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70004b60 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7000ce90 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000a850 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a780aa8a0 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.584+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7814a580 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.585+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a781558f0 con 0x7f9a78151a50 2023-12-08T08:20:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.587+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a7000a9b0 con 0x7f9a78151a50 2023-12-08T08:20:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6effd640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9a5806ae70 0x7f9a5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9a70089de0 con 0x7f9a78151a50 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a7659c640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9a5806ae70 0x7f9a5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6effd640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f9a58071210 0x7f9a58073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a58073d20 con 0x7f9a58071210 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a7008a150 con 0x7f9a78151a50 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.588+0000 7f9a6ffff640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f9a58071210 0x7f9a58073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.589+0000 7f9a7659c640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9a5806ae70 0x7f9a5806d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.589+0000 7f9a6ffff640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f9a58071210 0x7f9a58073650 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.590+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== osd.2 v2:172.21.15.45:6810/1587878241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9a58073d20 con 0x7f9a58071210 2023-12-08T08:20:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.605+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 --> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a780c5010 con 0x7f9a58071210 2023-12-08T08:20:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a6effd640 1 -- 172.21.15.45:0/996284876 <== osd.2 v2:172.21.15.45:6810/1587878241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a60031b10 con 0x7f9a58071210 2023-12-08T08:20:11.608 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:11.608 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:11.608 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f9a58071210 msgr2=0x7f9a58073650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6810/1587878241,v1:172.21.15.45:6812/1587878241] conn(0x7f9a58071210 0x7f9a58073650 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9a5806ae70 msgr2=0x7f9a5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f9a5806ae70 0x7f9a5806d330 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9a68006fd0 tx=0x7f9a68008040 comp rx=0 tx=0).stop 2023-12-08T08:20:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 msgr2=0x7f9a780c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a7759e640 1 --2- 172.21.15.45:0/996284876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a78151a50 0x7f9a780c2850 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c780 tx=0x7f9a7000cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.606+0000 7f9a76d9d640 1 -- 172.21.15.45:0/996284876 reap_dead start 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.607+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 shutdown_connections 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.607+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 >> 172.21.15.45:0/996284876 conn(0x7f9a7806b850 msgr2=0x7f9a7806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.607+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 shutdown_connections 2023-12-08T08:20:11.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.607+0000 7f9a7759e640 1 -- 172.21.15.45:0/996284876 wait complete. 2023-12-08T08:20:11.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-08T08:20:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.843+0000 7f5c41581640 1 Processor -- start 2023-12-08T08:20:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.843+0000 7f5c41581640 1 -- start start 2023-12-08T08:20:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c41581640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c41581640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c3c06b820 0x7f5c3c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c41581640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c0c5160 con 0x7f5c3c0c59f0 2023-12-08T08:20:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c41581640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c5440 con 0x7f5c3c0c4770 2023-12-08T08:20:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c41581640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c1578a0 con 0x7f5c3c06b820 2023-12-08T08:20:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c3bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41138/0 (socket says 172.21.15.45:41138) 2023-12-08T08:20:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.844+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2894022812 learned_addr learned my addr 172.21.15.45:0/2894022812 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.845+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2894022812 >> v2:172.21.15.114:3300/0 conn(0x7f5c3c06b820 msgr2=0x7f5c3c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.845+0000 7f5c3bfff640 1 --2- 172.21.15.45:0/2894022812 >> v2:172.21.15.114:3300/0 conn(0x7f5c3c06b820 0x7f5c3c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.845+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2894022812 >> v1:172.21.15.45:6789/0 conn(0x7f5c3c0c59f0 legacy=0x7f5c3c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.845+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2894022812 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c157b80 con 0x7f5c3c0c4770 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.846+0000 7f5c3bfff640 1 --2- 172.21.15.45:0/2894022812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0c76d0 tx=0x7f5c2c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a71a01b89fa637 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.847+0000 7f5c3affd640 1 -- 172.21.15.45:0/2894022812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c02c9f0 con 0x7f5c3c0c4770 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.847+0000 7f5c3affd640 1 -- 172.21.15.45:0/2894022812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c02cb50 con 0x7f5c3c0c4770 2023-12-08T08:20:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.847+0000 7f5c3affd640 1 -- 172.21.15.45:0/2894022812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0343f0 con 0x7f5c3c0c4770 2023-12-08T08:20:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.847+0000 7f5c41581640 1 -- 172.21.15.45:0/2894022812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c0c4770 msgr2=0x7f5c3c0c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.847+0000 7f5c41581640 1 --2- 172.21.15.45:0/2894022812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0c76d0 tx=0x7f5c2c02be50 comp rx=0 tx=0).stop 2023-12-08T08:20:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 -- 172.21.15.45:0/2894022812 shutdown_connections 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 --2- 172.21.15.45:0/2894022812 >> v2:172.21.15.114:3300/0 conn(0x7f5c3c06b820 0x7f5c3c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 --2- 172.21.15.45:0/2894022812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c0c7a80 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 -- 172.21.15.45:0/2894022812 >> 172.21.15.45:0/2894022812 conn(0x7f5c3c0c9b80 msgr2=0x7f5c3c0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 -- 172.21.15.45:0/2894022812 shutdown_connections 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.848+0000 7f5c41581640 1 -- 172.21.15.45:0/2894022812 wait complete. 2023-12-08T08:20:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.849+0000 7f5c41581640 1 Processor -- start 2023-12-08T08:20:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 -- start start 2023-12-08T08:20:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 0x7f5c3c0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c14bc00 con 0x7f5c3c06b820 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.850+0000 7f5c41581640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0ae950 con 0x7f5c3c0c4770 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c41581640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0ae370 con 0x7f5c3c0c59f0 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41140/0 (socket says 172.21.15.45:41140) 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2220970780 learned_addr learned my addr 172.21.15.45:0/2220970780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c40d80640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 0x7f5c3c0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 msgr2=0x7f5c3c0aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3b7fe640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 0x7f5c3c0aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c3c0c4770 msgr2=0x7f5c3c14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c3bfff640 1 -- 172.21.15.45:0/2220970780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c009b30 con 0x7f5c3c06b820 2023-12-08T08:20:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.851+0000 7f5c40d80640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 0x7f5c3c0aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c3bfff640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0093e0 tx=0x7f5c2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c03e450 con 0x7f5c3c06b820 2023-12-08T08:20:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c03e5b0 con 0x7f5c3c06b820 2023-12-08T08:20:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c03e960 con 0x7f5c3c06b820 2023-12-08T08:20:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c14be10 con 0x7f5c3c06b820 2023-12-08T08:20:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.852+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c14d3a0 con 0x7f5c3c06b820 2023-12-08T08:20:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.853+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c0743e0 con 0x7f5c3c06b820 2023-12-08T08:20:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.854+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c2c03eac0 con 0x7f5c3c06b820 2023-12-08T08:20:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.855+0000 7f5c38ff9640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 0x7f5c2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.855+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5c2c0ac3e0 con 0x7f5c3c06b820 2023-12-08T08:20:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.856+0000 7f5c3b7fe640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 0x7f5c2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.856+0000 7f5c3b7fe640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 0x7f5c2806d300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c14b700 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:11.860+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c2c0775e0 con 0x7f5c3c06b820 2023-12-08T08:20:12.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.053+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c3c0c6280 con 0x7f5c2806ae40 2023-12-08T08:20:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.053+0000 7f5c38ff9640 1 -- 172.21.15.45:0/2220970780 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c30004020 con 0x7f5c2806ae40 2023-12-08T08:20:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-12-08T08:20:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 msgr2=0x7f5c2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 0x7f5c2806d300 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c14b700 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2023-12-08T08:20:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 msgr2=0x7f5c3c14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0093e0 tx=0x7f5c2c004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 shutdown_connections 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f5c2806ae40 0x7f5c2806d300 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f5c3c0c59f0 0x7f5c3c0aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c3c0c4770 0x7f5c3c14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 --2- 172.21.15.45:0/2220970780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3c06b820 0x7f5c3c14e9f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 >> 172.21.15.45:0/2220970780 conn(0x7f5c3c0c9b80 msgr2=0x7f5c3c150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 shutdown_connections 2023-12-08T08:20:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.056+0000 7f5c41581640 1 -- 172.21.15.45:0/2220970780 wait complete. 2023-12-08T08:20:12.077 INFO:tasks.ceph:Scrubbing osd.3 2023-12-08T08:20:12.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:12.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.311+0000 7f8ca59c1640 1 Processor -- start 2023-12-08T08:20:12.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.311+0000 7f8ca59c1640 1 -- start start 2023-12-08T08:20:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8ca59c1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca00c7b10 0x7f8ca0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8ca59c1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8ca59c1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca00c4630 con 0x7f8ca0151a50 2023-12-08T08:20:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8ca59c1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca00c6f60 con 0x7f8ca00c7b10 2023-12-08T08:20:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8ca59c1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00c86f0 con 0x7f8ca00c8240 2023-12-08T08:20:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.313+0000 7f8c97fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca00c7b10 0x7f8ca0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8ca49bf640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8ca0151a50 0x7f8ca00c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44000/0 (socket says 172.21.15.45:44000) 2023-12-08T08:20:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c97fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ca00c7b10 0x7f8ca0151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41152/0 (socket says 172.21.15.45:41152) 2023-12-08T08:20:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8ca49bf640 1 -- 172.21.15.45:0/4003341713 learned_addr learned my addr 172.21.15.45:0/4003341713 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8ca51c0640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c97fff640 1 -- 172.21.15.45:0/4003341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 msgr2=0x7f8ca0157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c97fff640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca0157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c97fff640 1 -- 172.21.15.45:0/4003341713 >> v1:172.21.15.45:6789/0 conn(0x7f8ca0151a50 legacy=0x7f8ca00c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c97fff640 1 -- 172.21.15.45:0/4003341713 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00c7160 con 0x7f8ca00c7b10 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.314+0000 7f8c977fe640 1 -- 172.21.15.45:0/4003341713 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011573644 0 0) 0x7f8ca00c4630 con 0x7f8ca0151a50 2023-12-08T08:20:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.315+0000 7f8c97fff640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca00c7b10 0x7f8ca0151e30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8c900097d0 tx=0x7f8c9002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5508ca12148bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8c977fe640 1 -- 172.21.15.45:0/4003341713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90031770 con 0x7f8ca00c7b10 2023-12-08T08:20:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8c977fe640 1 -- 172.21.15.45:0/4003341713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900318d0 con 0x7f8ca00c7b10 2023-12-08T08:20:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8c977fe640 1 -- 172.21.15.45:0/4003341713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90031c60 con 0x7f8ca00c7b10 2023-12-08T08:20:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 -- 172.21.15.45:0/4003341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca00c7b10 msgr2=0x7f8ca0151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca00c7b10 0x7f8ca0151e30 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8c900097d0 tx=0x7f8c9002b810 comp rx=0 tx=0).stop 2023-12-08T08:20:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 -- 172.21.15.45:0/4003341713 shutdown_connections 2023-12-08T08:20:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca0157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/4003341713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca00c7b10 0x7f8ca0151e30 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.316+0000 7f8ca59c1640 1 -- 172.21.15.45:0/4003341713 >> 172.21.15.45:0/4003341713 conn(0x7f8ca006b850 msgr2=0x7f8ca006bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.317+0000 7f8ca59c1640 1 -- 172.21.15.45:0/4003341713 shutdown_connections 2023-12-08T08:20:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.317+0000 7f8ca59c1640 1 -- 172.21.15.45:0/4003341713 wait complete. 2023-12-08T08:20:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.318+0000 7f8ca59c1640 1 Processor -- start 2023-12-08T08:20:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.318+0000 7f8ca59c1640 1 -- start start 2023-12-08T08:20:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca00c7b10 0x7f8ca01ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca00aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 0x7f8ca01462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca00aa440 con 0x7f8ca0151a50 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca01ed8e0 con 0x7f8ca00c7b10 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.319+0000 7f8ca59c1640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0147bb0 con 0x7f8ca00c8240 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 0x7f8ca01462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 0x7f8ca01462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41162/0 (socket says 172.21.15.45:41162) 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 -- 172.21.15.45:0/3905190607 learned_addr learned my addr 172.21.15.45:0/3905190607 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8c97fff640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca00aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca49bf640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca00c7b10 0x7f8ca01ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 -- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 msgr2=0x7f8ca00aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8ca00c8240 0x7f8ca00aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 -- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca00c7b10 msgr2=0x7f8ca01ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca00c7b10 0x7f8ca01ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.320+0000 7f8ca51c0640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009400 con 0x7f8ca0151a50 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8ca51c0640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 0x7f8ca01462c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800d800 tx=0x7f8c9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800b6c0 con 0x7f8ca0151a50 2023-12-08T08:20:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800b840 con 0x7f8ca0151a50 2023-12-08T08:20:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bbf0 con 0x7f8ca0151a50 2023-12-08T08:20:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca0147e90 con 0x7f8ca0151a50 2023-12-08T08:20:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.321+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca014f340 con 0x7f8ca0151a50 2023-12-08T08:20:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.322+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ca00c5010 con 0x7f8ca0151a50 2023-12-08T08:20:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.323+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c9800bd50 con 0x7f8ca0151a50 2023-12-08T08:20:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8c957fa640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c8c06ae40 0x7f8c8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f8c98089a90 con 0x7f8ca0151a50 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8ca49bf640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c8c06ae40 0x7f8c8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8c957fa640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7f8c8c0711e0 0x7f8c8c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c8c073cf0 con 0x7f8c8c0711e0 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.324+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c9808e2a0 con 0x7f8ca0151a50 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.325+0000 7f8c97fff640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7f8c8c0711e0 0x7f8c8c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.325+0000 7f8ca49bf640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c8c06ae40 0x7f8c8c06d300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c007ed0 tx=0x7f8c9c007e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.326+0000 7f8c97fff640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7f8c8c0711e0 0x7f8c8c073620 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.326+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== osd.3 v2:172.21.15.45:6824/1638448391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8c8c073cf0 con 0x7f8c8c0711e0 2023-12-08T08:20:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.341+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 --> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ca00c1520 con 0x7f8c8c0711e0 2023-12-08T08:20:12.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.341+0000 7f8c957fa640 1 -- 172.21.15.45:0/3905190607 <== osd.3 v2:172.21.15.45:6824/1638448391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8ca00c1520 con 0x7f8c8c0711e0 2023-12-08T08:20:12.344 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:12.344 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:12.344 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:12.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7f8c8c0711e0 msgr2=0x7f8c8c073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6824/1638448391,v1:172.21.15.45:6825/1638448391] conn(0x7f8c8c0711e0 0x7f8c8c073620 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c8c06ae40 msgr2=0x7f8c8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8c8c06ae40 0x7f8c8c06d300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c007ed0 tx=0x7f8c9c007e60 comp rx=0 tx=0).stop 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 msgr2=0x7f8ca01462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 --2- 172.21.15.45:0/3905190607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ca0151a50 0x7f8ca01462c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800d800 tx=0x7f8c9800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca51c0640 1 -- 172.21.15.45:0/3905190607 reap_dead start 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 shutdown_connections 2023-12-08T08:20:12.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 >> 172.21.15.45:0/3905190607 conn(0x7f8ca006b850 msgr2=0x7f8ca00c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.342+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 shutdown_connections 2023-12-08T08:20:12.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.343+0000 7f8ca59c1640 1 -- 172.21.15.45:0/3905190607 wait complete. 2023-12-08T08:20:12.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-08T08:20:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.589+0000 7fdf1f535640 1 Processor -- start 2023-12-08T08:20:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.590+0000 7fdf1f535640 1 -- start start 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1f535640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 0x7fdf181475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1f535640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf18154cf0 con 0x7fdf180c5740 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1f535640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180a9c60 con 0x7fdf180a6640 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1f535640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18155520 con 0x7fdf180c5b20 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1e533640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdf180c5740 0x7fdf181545e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44012/0 (socket says 172.21.15.45:44012) 2023-12-08T08:20:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.591+0000 7fdf1e533640 1 -- 172.21.15.45:0/2936143134 learned_addr learned my addr 172.21.15.45:0/2936143134 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 0x7fdf181475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655766568 0 0) 0x7fdf18154cf0 con 0x7fdf180c5740 2023-12-08T08:20:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf04003520 con 0x7fdf180c5740 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4027703632 0 0) 0x7fdf04003520 con 0x7fdf180c5740 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 msgr2=0x7fdf181475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 0x7fdf181475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 >> v1:172.21.15.114:6789/0 conn(0x7fdf180a6640 legacy=0x7fdf180aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18154f60 con 0x7fdf180c5740 2023-12-08T08:20:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fdf14001670 con 0x7fdf180c5740 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 >> v1:172.21.15.45:6789/0 conn(0x7fdf180c5740 legacy=0x7fdf181545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf040039a0 0x7fdf04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 0x7fdf040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf04004d00 0x7fdf04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18155520 con 0x7fdf04004d00 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0400ba60 con 0x7fdf040039a0 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.592+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0400bc20 con 0x7fdf180c5b20 2023-12-08T08:20:12.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf04004d00 0x7fdf04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1e533640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf040039a0 0x7fdf04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 msgr2=0x7fdf040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf180c5b20 0x7fdf040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf040039a0 msgr2=0x7fdf04003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf040039a0 0x7fdf04003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.593+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2936143134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04003520 con 0x7fdf04004d00 2023-12-08T08:20:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.594+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf04004d00 0x7fdf04005180 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009f90 tx=0x7fdf040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2dc2eb25faf33c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.594+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1002cc20 con 0x7fdf04004d00 2023-12-08T08:20:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.594+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1000f040 con 0x7fdf04004d00 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.594+0000 7fdf1d531640 1 -- 172.21.15.45:0/2936143134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10034440 con 0x7fdf04004d00 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 -- 172.21.15.45:0/2936143134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf04004d00 msgr2=0x7fdf04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2936143134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf04004d00 0x7fdf04005180 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009f90 tx=0x7fdf040057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2936143134 reap_dead start 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 -- 172.21.15.45:0/2936143134 shutdown_connections 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 -- 172.21.15.45:0/2936143134 >> 172.21.15.45:0/2936143134 conn(0x7fdf180a88b0 msgr2=0x7fdf180a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 -- 172.21.15.45:0/2936143134 shutdown_connections 2023-12-08T08:20:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.595+0000 7fdf1f535640 1 -- 172.21.15.45:0/2936143134 wait complete. 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.597+0000 7fdf1f535640 1 Processor -- start 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.597+0000 7fdf1f535640 1 -- start start 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf04004d00 0x7fdf1814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf1814ab20 0x7fdf180beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180c2e20 con 0x7fdf180bf0e0 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180c0210 con 0x7fdf04004d00 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1f535640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180c2860 con 0x7fdf1814ab20 2023-12-08T08:20:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1ed34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1ed34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41180/0 (socket says 172.21.15.45:41180) 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.598+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2669693027 learned_addr learned my addr 172.21.15.45:0/2669693027 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1dd32640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf1814ab20 0x7fdf180beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1e533640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf04004d00 0x7fdf1814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf1814ab20 msgr2=0x7fdf180beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf1814ab20 0x7fdf180beba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf04004d00 msgr2=0x7fdf1814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf04004d00 0x7fdf1814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 -- 172.21.15.45:0/2669693027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf180c2b40 con 0x7fdf180bf0e0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf1ed34640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fdf10037040 tx=0x7fdf10009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.599+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10034bd0 con 0x7fdf180bf0e0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.600+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10034d30 con 0x7fdf180bf0e0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.600+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10034ea0 con 0x7fdf180bf0e0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.600+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf180c04b0 con 0x7fdf180bf0e0 2023-12-08T08:20:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.600+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf180bf720 con 0x7fdf180bf0e0 2023-12-08T08:20:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.601+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf181ecc00 con 0x7fdf180bf0e0 2023-12-08T08:20:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.602+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf10047460 con 0x7fdf180bf0e0 2023-12-08T08:20:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.603+0000 7fdf0effd640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 0x7fdefc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.603+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdf100ab330 con 0x7fdf180bf0e0 2023-12-08T08:20:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.603+0000 7fdf1e533640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 0x7fdefc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.604+0000 7fdf1e533640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 0x7fdefc06d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000ff0 tx=0x7fdf14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.607+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf181ecc00 con 0x7fdf180bf0e0 2023-12-08T08:20:12.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.801+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf181ecc00 con 0x7fdefc06ae70 2023-12-08T08:20:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.802+0000 7fdf0effd640 1 -- 172.21.15.45:0/2669693027 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdf181ecc00 con 0x7fdefc06ae70 2023-12-08T08:20:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 msgr2=0x7fdefc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 0x7fdefc06d330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdf14000ff0 tx=0x7fdf14009040 comp rx=0 tx=0).stop 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 msgr2=0x7fdf181ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fdf10037040 tx=0x7fdf10009750 comp rx=0 tx=0).stop 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 shutdown_connections 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fdefc06ae70 0x7fdefc06d330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fdf1814ab20 0x7fdf180beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf180bf0e0 0x7fdf181ecee0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 --2- 172.21.15.45:0/2669693027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf04004d00 0x7fdf1814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 >> 172.21.15.45:0/2669693027 conn(0x7fdf180a88b0 msgr2=0x7fdf180c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 shutdown_connections 2023-12-08T08:20:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:12.805+0000 7fdf1f535640 1 -- 172.21.15.45:0/2669693027 wait complete. 2023-12-08T08:20:12.828 INFO:tasks.ceph:Scrubbing osd.4 2023-12-08T08:20:12.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.058+0000 7f3e517db640 1 Processor -- start 2023-12-08T08:20:13.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.059+0000 7f3e517db640 1 -- start start 2023-12-08T08:20:13.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.060+0000 7f3e517db640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 0x7f3e4c0c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.060+0000 7f3e517db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.060+0000 7f3e517db640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0a9810 con 0x7f3e4c0c5c10 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.060+0000 7f3e517db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0a5040 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.060+0000 7f3e517db640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0a52e0 con 0x7f3e4c0c1640 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41184/0 (socket says 172.21.15.45:41184) 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 -- 172.21.15.45:0/2559222960 learned_addr learned my addr 172.21.15.45:0/2559222960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e4bfff640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 0x7f3e4c0c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 -- 172.21.15.45:0/2559222960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 msgr2=0x7f3e4c0c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:13.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 0x7f3e4c0c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 -- 172.21.15.45:0/2559222960 >> v1:172.21.15.114:6789/0 conn(0x7f3e4c0c5c10 legacy=0x7f3e4c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:13.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e43fff640 1 -- 172.21.15.45:0/2559222960 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0a94a0 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.061+0000 7f3e4bfff640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 0x7f3e4c0c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:13.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.062+0000 7f3e43fff640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009870 tx=0x7f3e3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe07a3e35716a0f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.063+0000 7f3e4b7fe640 1 -- 172.21.15.45:0/2559222960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34031640 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.063+0000 7f3e4b7fe640 1 -- 172.21.15.45:0/2559222960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340317a0 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.063+0000 7f3e4b7fe640 1 -- 172.21.15.45:0/2559222960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34031b30 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.063+0000 7f3e517db640 1 -- 172.21.15.45:0/2559222960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c57b0 msgr2=0x7f3e4c0a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.063+0000 7f3e517db640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009870 tx=0x7f3e3402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 -- 172.21.15.45:0/2559222960 shutdown_connections 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c57b0 0x7f3e4c0a9ca0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 --2- 172.21.15.45:0/2559222960 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c1640 0x7f3e4c0c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 -- 172.21.15.45:0/2559222960 >> 172.21.15.45:0/2559222960 conn(0x7f3e4c066df0 msgr2=0x7f3e4c0a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 -- 172.21.15.45:0/2559222960 shutdown_connections 2023-12-08T08:20:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.064+0000 7f3e517db640 1 -- 172.21.15.45:0/2559222960 wait complete. 2023-12-08T08:20:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.066+0000 7f3e517db640 1 Processor -- start 2023-12-08T08:20:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.066+0000 7f3e517db640 1 -- start start 2023-12-08T08:20:13.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 0x7f3e4c0bef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c57b0 0x7f3e4c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4c1ecf00 0x7f3e4c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c14a9f0 con 0x7f3e4c0c1640 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c154200 con 0x7f3e4c1ecf00 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.067+0000 7f3e517db640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0710b0 con 0x7f3e4c0c57b0 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 0x7f3e4c0bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 0x7f3e4c0bef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41198/0 (socket says 172.21.15.45:41198) 2023-12-08T08:20:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 -- 172.21.15.45:0/3706760148 learned_addr learned my addr 172.21.15.45:0/3706760148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e43fff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c57b0 0x7f3e4c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e50fda640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4c1ecf00 0x7f3e4c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 -- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c57b0 msgr2=0x7f3e4c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f3e4c0c57b0 0x7f3e4c1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 -- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4c1ecf00 msgr2=0x7f3e4c1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4c1ecf00 0x7f3e4c1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340094d0 con 0x7f3e4c0c1640 2023-12-08T08:20:13.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e50fda640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e4c1ecf00 0x7f3e4c1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.068+0000 7f3e4bfff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 0x7f3e4c0bef60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d7d0 tx=0x7f3e3c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.069+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c004030 con 0x7f3e4c0c1640 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.069+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c004190 con 0x7f3e4c0c1640 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.069+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c004520 con 0x7f3e4c0c1640 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.069+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c071390 con 0x7f3e4c0c1640 2023-12-08T08:20:13.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.069+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0724e0 con 0x7f3e4c0c1640 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.070+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e4c0c4070 con 0x7f3e4c0c1640 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.071+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e3c0096a0 con 0x7f3e4c0c1640 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e497fa640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e2c06ae70 0x7f3e2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3e3c089690 con 0x7f3e4c0c1640 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e497fa640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f3e2c071210 0x7f3e2c073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e2c073d20 con 0x7f3e2c071210 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e3c08bc70 con 0x7f3e4c0c1640 2023-12-08T08:20:13.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.072+0000 7f3e43fff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e2c06ae70 0x7f3e2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.073+0000 7f3e50fda640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f3e2c071210 0x7f3e2c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.073+0000 7f3e43fff640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e2c06ae70 0x7f3e2c06d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3e34036000 tx=0x7f3e3403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.074+0000 7f3e50fda640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f3e2c071210 0x7f3e2c073650 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.076+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== osd.4 v2:172.21.15.114:6824/257103469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e2c073d20 con 0x7f3e2c071210 2023-12-08T08:20:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.091+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 --> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e4c0743e0 con 0x7f3e2c071210 2023-12-08T08:20:13.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.092+0000 7f3e497fa640 1 -- 172.21.15.45:0/3706760148 <== osd.4 v2:172.21.15.114:6824/257103469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3e4c0743e0 con 0x7f3e2c071210 2023-12-08T08:20:13.094 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:13.094 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:13.094 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:13.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.092+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f3e2c071210 msgr2=0x7f3e2c073650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.092+0000 7f3e517db640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.114:6824/257103469,v1:172.21.15.114:6825/257103469] conn(0x7f3e2c071210 0x7f3e2c073650 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e2c06ae70 msgr2=0x7f3e2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f3e2c06ae70 0x7f3e2c06d330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3e34036000 tx=0x7f3e3403c040 comp rx=0 tx=0).stop 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 msgr2=0x7f3e4c0bef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 --2- 172.21.15.45:0/3706760148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e4c0c1640 0x7f3e4c0bef60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d7d0 tx=0x7f3e3c00dc90 comp rx=0 tx=0).stop 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e50fda640 1 -- 172.21.15.45:0/3706760148 reap_dead start 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 shutdown_connections 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 >> 172.21.15.45:0/3706760148 conn(0x7f3e4c066df0 msgr2=0x7f3e4c06c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 shutdown_connections 2023-12-08T08:20:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.093+0000 7f3e517db640 1 -- 172.21.15.45:0/3706760148 wait complete. 2023-12-08T08:20:13.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-08T08:20:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.330+0000 7f0bd97f4640 1 Processor -- start 2023-12-08T08:20:13.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.330+0000 7f0bd97f4640 1 -- start start 2023-12-08T08:20:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd97f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bd41584b0 0x7f0bd40c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd97f4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd40c50d0 con 0x7f0bd40c4590 2023-12-08T08:20:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd97f4640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd4157a60 con 0x7f0bd4151ca0 2023-12-08T08:20:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd97f4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd40c5470 con 0x7f0bd41584b0 2023-12-08T08:20:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0bd40c4590 0x7f0bd40c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44026/0 (socket says 172.21.15.45:44026) 2023-12-08T08:20:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd37fe640 1 -- 172.21.15.45:0/163827744 learned_addr learned my addr 172.21.15.45:0/163827744 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.332+0000 7f0bd8ff3640 1 --2- 172.21.15.45:0/163827744 >> v2:172.21.15.45:3300/0 conn(0x7f0bd41584b0 0x7f0bd40c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.333+0000 7f0bd2ffd640 1 -- 172.21.15.45:0/163827744 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293796977 0 0) 0x7f0bd40c50d0 con 0x7f0bd40c4590 2023-12-08T08:20:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.333+0000 7f0bd2ffd640 1 -- 172.21.15.45:0/163827744 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc0003520 con 0x7f0bd40c4590 2023-12-08T08:20:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.333+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/163827744 >> v1:172.21.15.114:6789/0 conn(0x7f0bd4151ca0 legacy=0x7f0bd4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.333+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/163827744 >> v1:172.21.15.45:6789/0 conn(0x7f0bd40c4590 legacy=0x7f0bd40c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.333+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/163827744 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4158020 con 0x7f0bd41584b0 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.334+0000 7f0bd8ff3640 1 --2- 172.21.15.45:0/163827744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41584b0 0x7f0bd40c9ba0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097a0 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c9f78b1c0f6f38 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.334+0000 7f0bd2ffd640 1 -- 172.21.15.45:0/163827744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc031830 con 0x7f0bd41584b0 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.334+0000 7f0bd2ffd640 1 -- 172.21.15.45:0/163827744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc031990 con 0x7f0bd41584b0 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.334+0000 7f0bd2ffd640 1 -- 172.21.15.45:0/163827744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc031d20 con 0x7f0bd41584b0 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 -- 172.21.15.45:0/163827744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41584b0 msgr2=0x7f0bd40c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/163827744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41584b0 0x7f0bd40c9ba0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097a0 tx=0x7f0bcc02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 -- 172.21.15.45:0/163827744 shutdown_connections 2023-12-08T08:20:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/163827744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41584b0 0x7f0bd40c9ba0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 -- 172.21.15.45:0/163827744 >> 172.21.15.45:0/163827744 conn(0x7f0bd406b850 msgr2=0x7f0bd406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 -- 172.21.15.45:0/163827744 shutdown_connections 2023-12-08T08:20:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.335+0000 7f0bd97f4640 1 -- 172.21.15.45:0/163827744 wait complete. 2023-12-08T08:20:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.337+0000 7f0bd97f4640 1 Processor -- start 2023-12-08T08:20:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.337+0000 7f0bd97f4640 1 -- start start 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bd40c4590 0x7f0bd40aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bd41584b0 0x7f0bd41eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd41ead50 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd41560a0 con 0x7f0bd41584b0 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.338+0000 7f0bd97f4640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd4155770 con 0x7f0bd40c4590 2023-12-08T08:20:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41218/0 (socket says 172.21.15.45:41218) 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/3722775012 learned_addr learned my addr 172.21.15.45:0/3722775012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd37fe640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bd41584b0 0x7f0bd41eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd3fff640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bd40c4590 0x7f0bd40aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bd40c4590 msgr2=0x7f0bd40aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bd40c4590 0x7f0bd40aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bd41584b0 msgr2=0x7f0bd41eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bd41584b0 0x7f0bd41eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.339+0000 7f0bd8ff3640 1 -- 172.21.15.45:0/3722775012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009400 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd8ff3640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc034040 tx=0x7f0bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc03a830 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc03a9b0 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc03ad60 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd4155a50 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.340+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd40aadf0 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.341+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd4156210 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.342+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bcc04d450 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.343+0000 7f0bd0ff9640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 0x7f0bb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.343+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0bcc0ab440 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.343+0000 7f0bd3fff640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 0x7f0bb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.344+0000 7f0bd3fff640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 0x7f0bb406d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ab670 tx=0x7f0bc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.347+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bcc076640 con 0x7f0bd41ea7e0 2023-12-08T08:20:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.544+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bd4157cb0 con 0x7f0bb406ae70 2023-12-08T08:20:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.545+0000 7f0bd0ff9640 1 -- 172.21.15.45:0/3722775012 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0bc4001c70 con 0x7f0bb406ae70 2023-12-08T08:20:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-12-08T08:20:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.547+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 msgr2=0x7f0bb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.547+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 0x7f0bb406d330 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ab670 tx=0x7f0bc4009040 comp rx=0 tx=0).stop 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.547+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 msgr2=0x7f0bd41eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.547+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc034040 tx=0x7f0bcc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 shutdown_connections 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f0bb406ae70 0x7f0bb406d330 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bd41ea7e0 0x7f0bd41eb790 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0bd41584b0 0x7f0bd41eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 --2- 172.21.15.45:0/3722775012 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0bd40c4590 0x7f0bd40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 >> 172.21.15.45:0/3722775012 conn(0x7f0bd406b850 msgr2=0x7f0bd4150840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 shutdown_connections 2023-12-08T08:20:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.548+0000 7f0bd97f4640 1 -- 172.21.15.45:0/3722775012 wait complete. 2023-12-08T08:20:13.569 INFO:tasks.ceph:Scrubbing osd.5 2023-12-08T08:20:13.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:13.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.791+0000 7fe07f3f0640 1 Processor -- start 2023-12-08T08:20:13.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.791+0000 7fe07f3f0640 1 -- start start 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.792+0000 7fe07f3f0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe078153780 0x7fe078156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07f3f0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe078152290 con 0x7fe07814f740 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07f3f0640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe078153180 con 0x7fe0780a4d10 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07f3f0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780c16f0 con 0x7fe078153780 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07e3ee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe07814f740 0x7fe078152a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44040/0 (socket says 172.21.15.45:44040) 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07e3ee640 1 -- 172.21.15.45:0/1427877139 learned_addr learned my addr 172.21.15.45:0/1427877139 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07dbed640 1 --2- 172.21.15.45:0/1427877139 >> v2:172.21.15.45:3300/0 conn(0x7fe078153780 0x7fe078156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.793+0000 7fe07d3ec640 1 -- 172.21.15.45:0/1427877139 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926840712 0 0) 0x7fe078152290 con 0x7fe07814f740 2023-12-08T08:20:13.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.794+0000 7fe07d3ec640 1 -- 172.21.15.45:0/1427877139 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003520 con 0x7fe07814f740 2023-12-08T08:20:13.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.794+0000 7fe07dbed640 1 -- 172.21.15.45:0/1427877139 >> v1:172.21.15.114:6789/0 conn(0x7fe0780a4d10 legacy=0x7fe07806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.794+0000 7fe07dbed640 1 -- 172.21.15.45:0/1427877139 >> v1:172.21.15.45:6789/0 conn(0x7fe07814f740 legacy=0x7fe078152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.794+0000 7fe07dbed640 1 -- 172.21.15.45:0/1427877139 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780c19d0 con 0x7fe078153780 2023-12-08T08:20:13.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.795+0000 7fe07dbed640 1 --2- 172.21.15.45:0/1427877139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078153780 0x7fe078156290 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe0680097a0 tx=0x7fe06802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6fe47686415c95 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.795+0000 7fe07d3ec640 1 -- 172.21.15.45:0/1427877139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031830 con 0x7fe078153780 2023-12-08T08:20:13.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.795+0000 7fe07d3ec640 1 -- 172.21.15.45:0/1427877139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe068031990 con 0x7fe078153780 2023-12-08T08:20:13.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.795+0000 7fe07d3ec640 1 -- 172.21.15.45:0/1427877139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031d20 con 0x7fe078153780 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 -- 172.21.15.45:0/1427877139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078153780 msgr2=0x7fe078156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 --2- 172.21.15.45:0/1427877139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078153780 0x7fe078156290 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe0680097a0 tx=0x7fe06802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 -- 172.21.15.45:0/1427877139 shutdown_connections 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 --2- 172.21.15.45:0/1427877139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe078153780 0x7fe078156290 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 -- 172.21.15.45:0/1427877139 >> 172.21.15.45:0/1427877139 conn(0x7fe078066df0 msgr2=0x7fe0780a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 -- 172.21.15.45:0/1427877139 shutdown_connections 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.796+0000 7fe07f3f0640 1 -- 172.21.15.45:0/1427877139 wait complete. 2023-12-08T08:20:13.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.798+0000 7fe07f3f0640 1 Processor -- start 2023-12-08T08:20:13.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.798+0000 7fe07f3f0640 1 -- start start 2023-12-08T08:20:13.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0780a4d10 0x7fe0780bef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 0x7fe0780a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe078153780 0x7fe0780a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781ea6d0 con 0x7fe07814f740 2023-12-08T08:20:13.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781eac00 con 0x7fe0780a4d10 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07f3f0640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07814ab20 con 0x7fe078153780 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.799+0000 7fe07dbed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 0x7fe0780a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 0x7fe0780a8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41240/0 (socket says 172.21.15.45:41240) 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 -- 172.21.15.45:0/2438221403 learned_addr learned my addr 172.21.15.45:0/2438221403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07e3ee640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0780a4d10 0x7fe0780bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07ebef640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe078153780 0x7fe0780a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 -- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe078153780 msgr2=0x7fe0780a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fe078153780 0x7fe0780a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 -- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0780a4d10 msgr2=0x7fe0780bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0780a4d10 0x7fe0780bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068009400 con 0x7fe07814f740 2023-12-08T08:20:13.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.800+0000 7fe07dbed640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 0x7fe0780a8c20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe068009890 tx=0x7fe0680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.801+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06803b980 con 0x7fe07814f740 2023-12-08T08:20:13.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.801+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06803bb00 con 0x7fe07814f740 2023-12-08T08:20:13.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.801+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068045400 con 0x7fe07814f740 2023-12-08T08:20:13.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.801+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0781ea920 con 0x7fe07814f740 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.801+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780bf4a0 con 0x7fe07814f740 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.802+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe07806da50 con 0x7fe07814f740 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.803+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe06804e430 con 0x7fe07814f740 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.804+0000 7fe06effd640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe05c06ae40 0x7fe05c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.804+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe0680aba80 con 0x7fe07814f740 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.804+0000 7fe07e3ee640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe05c06ae40 0x7fe05c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.804+0000 7fe06effd640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7fe05c0711e0 0x7fe05c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.805+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe05c073cf0 con 0x7fe05c0711e0 2023-12-08T08:20:13.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.805+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0680abdf0 con 0x7fe07814f740 2023-12-08T08:20:13.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.805+0000 7fe07e3ee640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe05c06ae40 0x7fe05c06d300 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0740011e0 tx=0x7fe074009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.805+0000 7fe07ebef640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7fe05c0711e0 0x7fe05c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.806+0000 7fe07ebef640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7fe05c0711e0 0x7fe05c073620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.808+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== osd.5 v2:172.21.15.114:6816/1412870860 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe05c073cf0 con 0x7fe05c0711e0 2023-12-08T08:20:13.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.823+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 --> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe07814ac60 con 0x7fe05c0711e0 2023-12-08T08:20:13.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe06effd640 1 -- 172.21.15.45:0/2438221403 <== osd.5 v2:172.21.15.114:6816/1412870860 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe07814ac60 con 0x7fe05c0711e0 2023-12-08T08:20:13.827 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:13.827 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:13.827 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:13.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7fe05c0711e0 msgr2=0x7fe05c073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.114:6816/1412870860,v1:172.21.15.114:6817/1412870860] conn(0x7fe05c0711e0 0x7fe05c073620 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe05c06ae40 msgr2=0x7fe05c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fe05c06ae40 0x7fe05c06d300 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0740011e0 tx=0x7fe074009040 comp rx=0 tx=0).stop 2023-12-08T08:20:13.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 msgr2=0x7fe0780a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 --2- 172.21.15.45:0/2438221403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07814f740 0x7fe0780a8c20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe068009890 tx=0x7fe0680046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07ebef640 1 -- 172.21.15.45:0/2438221403 reap_dead start 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 shutdown_connections 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.825+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 >> 172.21.15.45:0/2438221403 conn(0x7fe078066df0 msgr2=0x7fe0780a8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.826+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 shutdown_connections 2023-12-08T08:20:13.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:13.826+0000 7fe07f3f0640 1 -- 172.21.15.45:0/2438221403 wait complete. 2023-12-08T08:20:13.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-08T08:20:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.060+0000 7ff42b2bb640 1 Processor -- start 2023-12-08T08:20:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.060+0000 7ff42b2bb640 1 -- start start 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff42b2bb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4240aa2d0 0x7ff4240aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff42b2bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240c28d0 con 0x7ff4240a98c0 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff42b2bb640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240aa060 con 0x7ff4240c5310 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff42b2bb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240a9d80 con 0x7ff4240aa2d0 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff42a2b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4240aa2d0 0x7ff4240aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff429ab8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff4240a98c0 0x7ff4240c4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44048/0 (socket says 172.21.15.45:44048) 2023-12-08T08:20:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.061+0000 7ff429ab8640 1 -- 172.21.15.45:0/358991918 learned_addr learned my addr 172.21.15.45:0/358991918 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.062+0000 7ff42a2b9640 1 -- 172.21.15.45:0/358991918 >> v1:172.21.15.114:6789/0 conn(0x7ff4240c5310 legacy=0x7ff42415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.062+0000 7ff42a2b9640 1 -- 172.21.15.45:0/358991918 >> v1:172.21.15.45:6789/0 conn(0x7ff4240a98c0 legacy=0x7ff4240c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.062+0000 7ff4292b7640 1 -- 172.21.15.45:0/358991918 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476476126 0 0) 0x7ff4240c28d0 con 0x7ff4240a98c0 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.062+0000 7ff42a2b9640 1 -- 172.21.15.45:0/358991918 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42406cf70 con 0x7ff4240aa2d0 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.063+0000 7ff42a2b9640 1 --2- 172.21.15.45:0/358991918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240aa2d0 0x7ff4240aa6b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1843ad2b252dab9e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.063+0000 7ff4292b7640 1 -- 172.21.15.45:0/358991918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42002e070 con 0x7ff4240aa2d0 2023-12-08T08:20:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.063+0000 7ff4292b7640 1 -- 172.21.15.45:0/358991918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200315a0 con 0x7ff4240aa2d0 2023-12-08T08:20:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.063+0000 7ff4292b7640 1 -- 172.21.15.45:0/358991918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420031930 con 0x7ff4240aa2d0 2023-12-08T08:20:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 -- 172.21.15.45:0/358991918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240aa2d0 msgr2=0x7ff4240aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/358991918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240aa2d0 0x7ff4240aa6b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002b840 comp rx=0 tx=0).stop 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 -- 172.21.15.45:0/358991918 shutdown_connections 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/358991918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240aa2d0 0x7ff4240aa6b0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 -- 172.21.15.45:0/358991918 >> 172.21.15.45:0/358991918 conn(0x7ff4240a88b0 msgr2=0x7ff4240a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 -- 172.21.15.45:0/358991918 shutdown_connections 2023-12-08T08:20:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.064+0000 7ff42b2bb640 1 -- 172.21.15.45:0/358991918 wait complete. 2023-12-08T08:20:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.066+0000 7ff42b2bb640 1 Processor -- start 2023-12-08T08:20:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.066+0000 7ff42b2bb640 1 -- start start 2023-12-08T08:20:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 0x7ff424070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4240c5310 0x7ff4241ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4241dc930 con 0x7ff4240a98c0 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424070470 con 0x7ff4240aa2d0 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42b2bb640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff424072840 con 0x7ff4240c5310 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42a2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42a2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41268/0 (socket says 172.21.15.45:41268) 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42a2b9640 1 -- 172.21.15.45:0/2597494346 learned_addr learned my addr 172.21.15.45:0/2597494346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff429ab8640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 0x7ff424070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42a2b9640 1 -- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4240c5310 msgr2=0x7ff4241ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.067+0000 7ff42aaba640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4240c5310 0x7ff4241ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42a2b9640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4240c5310 0x7ff4241ea6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42a2b9640 1 -- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 msgr2=0x7ff424070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42a2b9640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 0x7ff424070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42a2b9640 1 -- 172.21.15.45:0/2597494346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009400 con 0x7ff4240a98c0 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff429ab8640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 0x7ff424070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42a2b9640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff420034040 tx=0x7ff4200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032980 con 0x7ff4240a98c0 2023-12-08T08:20:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420032ae0 con 0x7ff4240a98c0 2023-12-08T08:20:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032e90 con 0x7ff4240a98c0 2023-12-08T08:20:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff424072560 con 0x7ff4240a98c0 2023-12-08T08:20:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.068+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4241e15b0 con 0x7ff4240a98c0 2023-12-08T08:20:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.070+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4241dcaa0 con 0x7ff4240a98c0 2023-12-08T08:20:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.070+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff42003b3f0 con 0x7ff4240a98c0 2023-12-08T08:20:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.071+0000 7ff41affd640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 0x7ff40806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.072+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff4200ab660 con 0x7ff4240a98c0 2023-12-08T08:20:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.072+0000 7ff429ab8640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 0x7ff40806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.073+0000 7ff429ab8640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 0x7ff40806d300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff4240bfab0 tx=0x7ff414009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.076+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4200767d0 con 0x7ff4240a98c0 2023-12-08T08:20:14.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.267+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff42406d810 con 0x7ff40806ae40 2023-12-08T08:20:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.268+0000 7ff41affd640 1 -- 172.21.15.45:0/2597494346 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4140013d0 con 0x7ff40806ae40 2023-12-08T08:20:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-12-08T08:20:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.270+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 msgr2=0x7ff40806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.270+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 0x7ff40806d300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff4240bfab0 tx=0x7ff414009040 comp rx=0 tx=0).stop 2023-12-08T08:20:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 msgr2=0x7ff4240a6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff420034040 tx=0x7ff4200046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 shutdown_connections 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7ff40806ae40 0x7ff40806d300 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7ff4240c5310 0x7ff4241ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4240aa2d0 0x7ff424070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 --2- 172.21.15.45:0/2597494346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4240a98c0 0x7ff4240a6750 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 >> 172.21.15.45:0/2597494346 conn(0x7ff4240a88b0 msgr2=0x7ff4240beba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 shutdown_connections 2023-12-08T08:20:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.271+0000 7ff42b2bb640 1 -- 172.21.15.45:0/2597494346 wait complete. 2023-12-08T08:20:14.290 INFO:tasks.ceph:Scrubbing osd.6 2023-12-08T08:20:14.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:14.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.522+0000 7f8d4b8d3640 1 Processor -- start 2023-12-08T08:20:14.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.522+0000 7f8d4b8d3640 1 -- start start 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4b8d3640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d440ca560 0x7f8d4415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4b8d3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d440c4880 con 0x7f8d4414e800 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4b8d3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d440c4b60 con 0x7f8d440ca0e0 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4b8d3640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d440ca990 con 0x7f8d440ca560 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4966f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8d4414e800 0x7f8d44155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44062/0 (socket says 172.21.15.45:44062) 2023-12-08T08:20:14.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.524+0000 7f8d4966f640 1 -- 172.21.15.45:0/1018723404 learned_addr learned my addr 172.21.15.45:0/1018723404 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d49e70640 1 --2- 172.21.15.45:0/1018723404 >> v2:172.21.15.114:3300/0 conn(0x7f8d440ca560 0x7f8d4415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256699259 0 0) 0x7f8d440c4880 con 0x7f8d4414e800 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d30003520 con 0x7f8d4414e800 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044542305 0 0) 0x7f8d30003520 con 0x7f8d4414e800 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 >> v2:172.21.15.114:3300/0 conn(0x7f8d440ca560 msgr2=0x7f8d4415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 --2- 172.21.15.45:0/1018723404 >> v2:172.21.15.114:3300/0 conn(0x7f8d440ca560 0x7f8d4415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 >> v1:172.21.15.114:6789/0 conn(0x7f8d440ca0e0 legacy=0x7f8d441581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440c4e40 con 0x7f8d4414e800 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f8d40001670 con 0x7f8d4414e800 2023-12-08T08:20:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 >> v1:172.21.15.45:6789/0 conn(0x7f8d4414e800 legacy=0x7f8d44155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d300052a0 0x7f8d3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440ca990 con 0x7f8d300039c0 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3000c1a0 con 0x7f8d300047c0 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.525+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3000c360 con 0x7f8d300052a0 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d48e6e640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d49e70640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d300052a0 0x7f8d3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 -- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d300052a0 msgr2=0x7f8d3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d300052a0 0x7f8d3000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 -- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300047c0 msgr2=0x7f8d30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300047c0 0x7f8d30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d4966f640 1 -- 172.21.15.45:0/1018723404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30003520 con 0x7f8d300039c0 2023-12-08T08:20:14.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.526+0000 7f8d49e70640 1 -- 172.21.15.45:0/1018723404 reap_dead start 2023-12-08T08:20:14.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.527+0000 7f8d4966f640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c0e0 tx=0x7f8d300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d4ba6b4ce547bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.527+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40005ad0 con 0x7f8d300039c0 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.527+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40005c30 con 0x7f8d300039c0 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.527+0000 7f8d3bfff640 1 -- 172.21.15.45:0/1018723404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4002c790 con 0x7f8d300039c0 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 msgr2=0x7f8d30003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c0e0 tx=0x7f8d300057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/1018723404 shutdown_connections 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 --2- 172.21.15.45:0/1018723404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d300039c0 0x7f8d30003de0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/1018723404 >> 172.21.15.45:0/1018723404 conn(0x7f8d440663d0 msgr2=0x7f8d440667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/1018723404 shutdown_connections 2023-12-08T08:20:14.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.528+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/1018723404 wait complete. 2023-12-08T08:20:14.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.530+0000 7f8d4b8d3640 1 Processor -- start 2023-12-08T08:20:14.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.530+0000 7f8d4b8d3640 1 -- start start 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300039c0 0x7f8d4414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 0x7f8d440ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d440c1340 0x7f8d441490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440aae50 con 0x7f8d441e9b70 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440ab060 con 0x7f8d300039c0 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d4b8d3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440ab340 con 0x7f8d440c1340 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.531+0000 7f8d48e6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 0x7f8d440ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 0x7f8d440ac100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41274/0 (socket says 172.21.15.45:41274) 2023-12-08T08:20:14.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 -- 172.21.15.45:0/180757596 learned_addr learned my addr 172.21.15.45:0/180757596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 -- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d440c1340 msgr2=0x7f8d441490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d4966f640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300039c0 0x7f8d4414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f8d440c1340 0x7f8d441490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 -- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300039c0 msgr2=0x7f8d4414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d300039c0 0x7f8d4414fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440ab620 con 0x7f8d441e9b70 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d48e6e640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 0x7f8d440ac100 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e440 tx=0x7f8d3400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.532+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340052e0 con 0x7f8d441e9b70 2023-12-08T08:20:14.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.533+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34005440 con 0x7f8d441e9b70 2023-12-08T08:20:14.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.533+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34003810 con 0x7f8d441e9b70 2023-12-08T08:20:14.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.533+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d440ab900 con 0x7f8d441e9b70 2023-12-08T08:20:14.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.533+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d441501d0 con 0x7f8d441e9b70 2023-12-08T08:20:14.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.534+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d440c5120 con 0x7f8d441e9b70 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.535+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d34003970 con 0x7f8d441e9b70 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d39ffb640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8d2806ae70 0x7f8d2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f8d34089670 con 0x7f8d441e9b70 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d39ffb640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f8d28071210 0x7f8d28073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d28073d20 con 0x7f8d28071210 2023-12-08T08:20:14.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d340899e0 con 0x7f8d441e9b70 2023-12-08T08:20:14.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.536+0000 7f8d4966f640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8d2806ae70 0x7f8d2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.537+0000 7f8d49e70640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f8d28071210 0x7f8d28073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.537+0000 7f8d4966f640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8d2806ae70 0x7f8d2806d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8d40034000 tx=0x7f8d40009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.538+0000 7f8d49e70640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f8d28071210 0x7f8d28073650 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.540+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== osd.6 v2:172.21.15.114:6802/345910373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8d28073d20 con 0x7f8d28071210 2023-12-08T08:20:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.555+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 --> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8d440c7e80 con 0x7f8d28071210 2023-12-08T08:20:14.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.556+0000 7f8d39ffb640 1 -- 172.21.15.45:0/180757596 <== osd.6 v2:172.21.15.114:6802/345910373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8d3c009c30 con 0x7f8d28071210 2023-12-08T08:20:14.558 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:14.558 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:14.558 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:14.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f8d28071210 msgr2=0x7f8d28073650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.114:6802/345910373,v1:172.21.15.114:6804/345910373] conn(0x7f8d28071210 0x7f8d28073650 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8d2806ae70 msgr2=0x7f8d2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f8d2806ae70 0x7f8d2806d330 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8d40034000 tx=0x7f8d40009030 comp rx=0 tx=0).stop 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 msgr2=0x7f8d440ac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 --2- 172.21.15.45:0/180757596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d441e9b70 0x7f8d440ac100 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e440 tx=0x7f8d3400e900 comp rx=0 tx=0).stop 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d49e70640 1 -- 172.21.15.45:0/180757596 reap_dead start 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 shutdown_connections 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 >> 172.21.15.45:0/180757596 conn(0x7f8d440663d0 msgr2=0x7f8d4414da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 shutdown_connections 2023-12-08T08:20:14.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.557+0000 7f8d4b8d3640 1 -- 172.21.15.45:0/180757596 wait complete. 2023-12-08T08:20:14.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-08T08:20:14.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.798+0000 7f040d1b3640 1 Processor -- start 2023-12-08T08:20:14.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.799+0000 7f040d1b3640 1 -- start start 2023-12-08T08:20:14.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f040d1b3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0408151ca0 0x7f04081584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f040d1b3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080c50d0 con 0x7f04080c4590 2023-12-08T08:20:14.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f040d1b3640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0408157a60 con 0x7f04080c7b10 2023-12-08T08:20:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f040d1b3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080c5470 con 0x7f0408151ca0 2023-12-08T08:20:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f03fffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f04080c4590 0x7f0408154ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44076/0 (socket says 172.21.15.45:44076) 2023-12-08T08:20:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.800+0000 7f03fffff640 1 -- 172.21.15.45:0/3115973241 learned_addr learned my addr 172.21.15.45:0/3115973241 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:14.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f0407fff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0408151ca0 0x7f04081584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068428186 0 0) 0x7f04080c50d0 con 0x7f04080c4590 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f4003520 con 0x7f04080c4590 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848138685 0 0) 0x7f03f4003520 con 0x7f04080c4590 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0408151ca0 msgr2=0x7f04081584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f0408151ca0 0x7f04081584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 >> v1:172.21.15.114:6789/0 conn(0x7f04080c7b10 legacy=0x7f04080c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408158020 con 0x7f04080c4590 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.801+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f03f0001670 con 0x7f04080c4590 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 >> v1:172.21.15.45:6789/0 conn(0x7f04080c4590 legacy=0x7f0408154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40039a0 0x7f03f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f40047c0 0x7f03f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f4005180 0x7f03f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04080c5470 con 0x7f03f40047c0 2023-12-08T08:20:14.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f400bec0 con 0x7f03f40039a0 2023-12-08T08:20:14.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f400c050 con 0x7f03f4005180 2023-12-08T08:20:14.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f40047c0 0x7f03f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f0407fff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40039a0 0x7f03f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f040c9b2640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f4005180 0x7f03f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 -- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f4005180 msgr2=0x7f03f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f03f4005180 0x7f03f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 -- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40039a0 msgr2=0x7f03f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40039a0 0x7f03f4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.802+0000 7f03fffff640 1 -- 172.21.15.45:0/3115973241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4003520 con 0x7f03f40047c0 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f03fffff640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f40047c0 0x7f03f4004c40 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c210 tx=0x7f03f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f552f2cc5f0bc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0005ad0 con 0x7f03f40047c0 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0005c30 con 0x7f03f40047c0 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f04077fe640 1 -- 172.21.15.45:0/3115973241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f002c890 con 0x7f03f40047c0 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f040d1b3640 1 -- 172.21.15.45:0/3115973241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f40047c0 msgr2=0x7f03f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f040d1b3640 1 --2- 172.21.15.45:0/3115973241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03f40047c0 0x7f03f4004c40 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c210 tx=0x7f03f40057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.804+0000 7f040c9b2640 1 -- 172.21.15.45:0/3115973241 reap_dead start 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.805+0000 7f040d1b3640 1 -- 172.21.15.45:0/3115973241 shutdown_connections 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.805+0000 7f040d1b3640 1 -- 172.21.15.45:0/3115973241 >> 172.21.15.45:0/3115973241 conn(0x7f040806b850 msgr2=0x7f040806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.805+0000 7f040d1b3640 1 -- 172.21.15.45:0/3115973241 shutdown_connections 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.805+0000 7f040d1b3640 1 -- 172.21.15.45:0/3115973241 wait complete. 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.806+0000 7f040d1b3640 1 Processor -- start 2023-12-08T08:20:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.807+0000 7f040d1b3640 1 -- start start 2023-12-08T08:20:14.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.807+0000 7f040d1b3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40047c0 0x7f04081ea110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.807+0000 7f040d1b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f040d1b3640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f040814d3f0 0x7f04080c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f040d1b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04081ea650 con 0x7f0408150290 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f040d1b3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040814f560 con 0x7f03f40047c0 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f040d1b3640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040814f840 con 0x7f040814d3f0 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41284/0 (socket says 172.21.15.45:41284) 2023-12-08T08:20:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 -- 172.21.15.45:0/966562973 learned_addr learned my addr 172.21.15.45:0/966562973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 -- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f040814d3f0 msgr2=0x7f04080c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f040814d3f0 0x7f04080c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f0407fff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40047c0 0x7f04081ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 -- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40047c0 msgr2=0x7f04081ea110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40047c0 0x7f04081ea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.808+0000 7f03fffff640 1 -- 172.21.15.45:0/966562973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040814fb20 con 0x7f0408150290 2023-12-08T08:20:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f03fffff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f03f002c430 tx=0x7f0408157f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0039070 con 0x7f0408150290 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f002dd30 con 0x7f0408150290 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f003c040 con 0x7f0408150290 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040814c6b0 con 0x7f0408150290 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.809+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040814bf40 con 0x7f0408150290 2023-12-08T08:20:14.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.810+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04080ca290 con 0x7f0408150290 2023-12-08T08:20:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.811+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03f0032070 con 0x7f0408150290 2023-12-08T08:20:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.812+0000 7f04057fa640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 0x7f03e806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.812+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f03f00aa930 con 0x7f0408150290 2023-12-08T08:20:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.813+0000 7f0407fff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 0x7f03e806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.813+0000 7f0407fff640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 0x7f03e806d380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009950 tx=0x7f03f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:14.816+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04080ca290 con 0x7f0408150290 2023-12-08T08:20:15.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.007+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0408157cb0 con 0x7f03e806aec0 2023-12-08T08:20:15.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.008+0000 7f04057fa640 1 -- 172.21.15.45:0/966562973 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03f80095c0 con 0x7f03e806aec0 2023-12-08T08:20:15.010 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-12-08T08:20:15.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.010+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 msgr2=0x7f03e806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.010+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 0x7f03e806d380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009950 tx=0x7f03f8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.010+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 msgr2=0x7f040814ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.010+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f03f002c430 tx=0x7f0408157f90 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 shutdown_connections 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f03e806aec0 0x7f03e806d380 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f040814d3f0 0x7f04080c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0408150290 0x7f040814ceb0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 --2- 172.21.15.45:0/966562973 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03f40047c0 0x7f04081ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 >> 172.21.15.45:0/966562973 conn(0x7f040806b850 msgr2=0x7f04081522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 shutdown_connections 2023-12-08T08:20:15.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.011+0000 7f040d1b3640 1 -- 172.21.15.45:0/966562973 wait complete. 2023-12-08T08:20:15.032 INFO:tasks.ceph:Scrubbing osd.7 2023-12-08T08:20:15.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:20:15.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.258+0000 7fcc58f8a640 1 Processor -- start 2023-12-08T08:20:15.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.258+0000 7fcc58f8a640 1 -- start start 2023-12-08T08:20:15.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc58f8a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc54156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc58f8a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5414c880 con 0x7fcc540a4d10 2023-12-08T08:20:15.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc58f8a640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc540c63b0 con 0x7fcc5414c4a0 2023-12-08T08:20:15.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc58f8a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c4730 con 0x7fcc54153f90 2023-12-08T08:20:15.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc4bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcc540a4d10 0x7fcc54153880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44766/0 (socket says 172.21.15.45:44766) 2023-12-08T08:20:15.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc4bfff640 1 -- 172.21.15.45:0/374257312 learned_addr learned my addr 172.21.15.45:0/374257312 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:15.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.260+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc54156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821705459 0 0) 0x7fcc5414c880 con 0x7fcc540a4d10 2023-12-08T08:20:15.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc40003520 con 0x7fcc540a4d10 2023-12-08T08:20:15.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264700182 0 0) 0x7fcc40003520 con 0x7fcc540a4d10 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 msgr2=0x7fcc54156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc54156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 >> v1:172.21.15.114:6789/0 conn(0x7fcc5414c4a0 legacy=0x7fcc54155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc540a5210 con 0x7fcc540a4d10 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7fcc3c001670 con 0x7fcc540a4d10 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 >> v1:172.21.15.45:6789/0 conn(0x7fcc540a4d10 legacy=0x7fcc54153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc400039a0 0x7fcc40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc40004d00 0x7fcc40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c4730 con 0x7fcc40004d00 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4000bab0 con 0x7fcc400039a0 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.261+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4000bc70 con 0x7fcc54153f90 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc40004d00 0x7fcc40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc5259c640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc400039a0 0x7fcc40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc4bfff640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 -- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 msgr2=0x7fcc400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc54153f90 0x7fcc400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 -- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc400039a0 msgr2=0x7fcc40003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc400039a0 0x7fcc40003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.262+0000 7fcc52d9d640 1 -- 172.21.15.45:0/374257312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40003520 con 0x7fcc40004d00 2023-12-08T08:20:15.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.263+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc40004d00 0x7fcc40005180 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009fc0 tx=0x7fcc400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3df3cc7daacf4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c02cc20 con 0x7fcc40004d00 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c00f040 con 0x7fcc40004d00 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc51d9b640 1 -- 172.21.15.45:0/374257312 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c034440 con 0x7fcc40004d00 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc58f8a640 1 -- 172.21.15.45:0/374257312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc40004d00 msgr2=0x7fcc40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc58f8a640 1 --2- 172.21.15.45:0/374257312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc40004d00 0x7fcc40005180 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009fc0 tx=0x7fcc400057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc52d9d640 1 -- 172.21.15.45:0/374257312 reap_dead start 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc58f8a640 1 -- 172.21.15.45:0/374257312 shutdown_connections 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.264+0000 7fcc58f8a640 1 -- 172.21.15.45:0/374257312 >> 172.21.15.45:0/374257312 conn(0x7fcc540661f0 msgr2=0x7fcc54066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.265+0000 7fcc58f8a640 1 -- 172.21.15.45:0/374257312 shutdown_connections 2023-12-08T08:20:15.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.265+0000 7fcc58f8a640 1 -- 172.21.15.45:0/374257312 wait complete. 2023-12-08T08:20:15.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.266+0000 7fcc58f8a640 1 Processor -- start 2023-12-08T08:20:15.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.266+0000 7fcc58f8a640 1 -- start start 2023-12-08T08:20:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc40004d00 0x7fcc54150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc541516d0 0x7fcc54145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 0x7fcc541eada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541507d0 con 0x7fcc541525a0 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54145650 con 0x7fcc40004d00 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.267+0000 7fcc58f8a640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5414cac0 con 0x7fcc541516d0 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 0x7fcc541eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 0x7fcc541eada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38770/0 (socket says 172.21.15.45:38770) 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 -- 172.21.15.45:0/2709166276 learned_addr learned my addr 172.21.15.45:0/2709166276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc5259c640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc40004d00 0x7fcc54150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc4bfff640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc541516d0 0x7fcc54145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 -- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc541516d0 msgr2=0x7fcc54145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7fcc541516d0 0x7fcc54145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 -- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc40004d00 msgr2=0x7fcc54150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc40004d00 0x7fcc54150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.268+0000 7fcc52d9d640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5414f6d0 con 0x7fcc541525a0 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc52d9d640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 0x7fcc541eada0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c037040 tx=0x7fcc4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c034d50 con 0x7fcc541525a0 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c003990 con 0x7fcc541525a0 2023-12-08T08:20:15.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5414f9b0 con 0x7fcc541525a0 2023-12-08T08:20:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c003d40 con 0x7fcc541525a0 2023-12-08T08:20:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.269+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc541eba00 con 0x7fcc541525a0 2023-12-08T08:20:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.270+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc540c5e90 con 0x7fcc541525a0 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.271+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc4c004030 con 0x7fcc541525a0 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc4affd640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc3406ae40 0x7fcc3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcc4c0aadb0 con 0x7fcc541525a0 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc4affd640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7fcc340711e0 0x7fcc34073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc34073cf0 con 0x7fcc340711e0 2023-12-08T08:20:15.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc5259c640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc3406ae40 0x7fcc3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.272+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc4c0ad390 con 0x7fcc541525a0 2023-12-08T08:20:15.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.273+0000 7fcc5259c640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc3406ae40 0x7fcc3406d300 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007fd0 tx=0x7fcc44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.273+0000 7fcc4bfff640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7fcc340711e0 0x7fcc34073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.274+0000 7fcc4bfff640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7fcc340711e0 0x7fcc34073620 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.276+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== osd.7 v2:172.21.15.114:6800/1867013460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcc34073cf0 con 0x7fcc340711e0 2023-12-08T08:20:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.291+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 --> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc540c5bb0 con 0x7fcc340711e0 2023-12-08T08:20:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc4affd640 1 -- 172.21.15.45:0/2709166276 <== osd.7 v2:172.21.15.114:6800/1867013460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcc3c005a20 con 0x7fcc340711e0 2023-12-08T08:20:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-08T08:20:15.295 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:20:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-08T08:20:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7fcc340711e0 msgr2=0x7fcc34073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.114:6800/1867013460,v1:172.21.15.114:6801/1867013460] conn(0x7fcc340711e0 0x7fcc34073620 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc3406ae40 msgr2=0x7fcc3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7fcc3406ae40 0x7fcc3406d300 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007fd0 tx=0x7fcc44009040 comp rx=0 tx=0).stop 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 msgr2=0x7fcc541eada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc58f8a640 1 --2- 172.21.15.45:0/2709166276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc541525a0 0x7fcc541eada0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c037040 tx=0x7fcc4c009750 comp rx=0 tx=0).stop 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.293+0000 7fcc52d9d640 1 -- 172.21.15.45:0/2709166276 reap_dead start 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.294+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 shutdown_connections 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.294+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 >> 172.21.15.45:0/2709166276 conn(0x7fcc540661f0 msgr2=0x7fcc54146040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.294+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 shutdown_connections 2023-12-08T08:20:15.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.294+0000 7fcc58f8a640 1 -- 172.21.15.45:0/2709166276 wait complete. 2023-12-08T08:20:15.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-08T08:20:15.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.527+0000 7f47fb0e6640 1 Processor -- start 2023-12-08T08:20:15.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.528+0000 7f47fb0e6640 1 -- start start 2023-12-08T08:20:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.529+0000 7f47fb0e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47f41584b0 0x7f47f40c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.529+0000 7f47fb0e6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40c50d0 con 0x7f47f40c4590 2023-12-08T08:20:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.529+0000 7f47fb0e6640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f4157a60 con 0x7f47f4151ca0 2023-12-08T08:20:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.529+0000 7f47fb0e6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40c5470 con 0x7f47f41584b0 2023-12-08T08:20:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.529+0000 7f47fa8e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47f41584b0 0x7f47f40c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47f98e3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f47f40c4590 0x7f47f40c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44770/0 (socket says 172.21.15.45:44770) 2023-12-08T08:20:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47f98e3640 1 -- 172.21.15.45:0/2631981340 learned_addr learned my addr 172.21.15.45:0/2631981340 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47f90e2640 1 -- 172.21.15.45:0/2631981340 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785497553 0 0) 0x7f47f40c50d0 con 0x7f47f40c4590 2023-12-08T08:20:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47f90e2640 1 -- 172.21.15.45:0/2631981340 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e4003520 con 0x7f47f40c4590 2023-12-08T08:20:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2631981340 >> v1:172.21.15.114:6789/0 conn(0x7f47f4151ca0 legacy=0x7f47f4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2631981340 >> v1:172.21.15.45:6789/0 conn(0x7f47f40c4590 legacy=0x7f47f40c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.530+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2631981340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f4158020 con 0x7f47f41584b0 2023-12-08T08:20:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.531+0000 7f47fa8e5640 1 --2- 172.21.15.45:0/2631981340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41584b0 0x7f47f40c9ba0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0097a0 tx=0x7f47ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf04b17a3e30201a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47f90e2640 1 -- 172.21.15.45:0/2631981340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec031830 con 0x7f47f41584b0 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47f90e2640 1 -- 172.21.15.45:0/2631981340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec031990 con 0x7f47f41584b0 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47f90e2640 1 -- 172.21.15.45:0/2631981340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec031d20 con 0x7f47f41584b0 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2631981340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41584b0 msgr2=0x7f47f40c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2631981340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41584b0 0x7f47f40c9ba0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0097a0 tx=0x7f47ec02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2631981340 shutdown_connections 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2631981340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41584b0 0x7f47f40c9ba0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.532+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2631981340 >> 172.21.15.45:0/2631981340 conn(0x7f47f406b850 msgr2=0x7f47f406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.533+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2631981340 shutdown_connections 2023-12-08T08:20:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.533+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2631981340 wait complete. 2023-12-08T08:20:15.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.534+0000 7f47fb0e6640 1 Processor -- start 2023-12-08T08:20:15.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.534+0000 7f47fb0e6640 1 -- start start 2023-12-08T08:20:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f40c4590 0x7f47f40aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 0x7f47f41eb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41ead50 con 0x7f47f41ea7e0 2023-12-08T08:20:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41560a0 con 0x7f47f40c4590 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.535+0000 7f47fb0e6640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4155770 con 0x7f47f41584b0 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38784/0 (socket says 172.21.15.45:38784) 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2228100161 learned_addr learned my addr 172.21.15.45:0/2228100161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa0e4640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f40c4590 0x7f47f40aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47f98e3640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 0x7f47f41eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 msgr2=0x7f47f41eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 0x7f47f41eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f40c4590 msgr2=0x7f47f40aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f40c4590 0x7f47f40aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47fa8e5640 1 -- 172.21.15.45:0/2228100161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009400 con 0x7f47f41ea7e0 2023-12-08T08:20:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.536+0000 7f47f98e3640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 0x7f47f41eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47fa8e5640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f47ec034040 tx=0x7f47ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec03a830 con 0x7f47f41ea7e0 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec03a9b0 con 0x7f47f41ea7e0 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f4155a50 con 0x7f47f41ea7e0 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec03ad60 con 0x7f47f41ea7e0 2023-12-08T08:20:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.537+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40aadf0 con 0x7f47f41ea7e0 2023-12-08T08:20:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.538+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f4156210 con 0x7f47f41ea7e0 2023-12-08T08:20:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.539+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47ec04d450 con 0x7f47f41ea7e0 2023-12-08T08:20:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.540+0000 7f47f2ffd640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.540+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f47ec0ab3a0 con 0x7f47f41ea7e0 2023-12-08T08:20:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.541+0000 7f47fa0e4640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.541+0000 7f47fa0e4640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 0x7f47d806d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47f40ab670 tx=0x7f47e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.546+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47ec076640 con 0x7f47f41ea7e0 2023-12-08T08:20:15.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.743+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f47f4157cb0 con 0x7f47d806ae70 2023-12-08T08:20:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.745+0000 7f47f2ffd640 1 -- 172.21.15.45:0/2228100161 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47e8003970 con 0x7f47d806ae70 2023-12-08T08:20:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-12-08T08:20:15.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 msgr2=0x7f47d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 0x7f47d806d330 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47f40ab670 tx=0x7f47e8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:15.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 msgr2=0x7f47f41eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f47ec034040 tx=0x7f47ec0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 shutdown_connections 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f47f41584b0 0x7f47f41eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47f41ea7e0 0x7f47f41eb790 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 --2- 172.21.15.45:0/2228100161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f40c4590 0x7f47f40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.747+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 >> 172.21.15.45:0/2228100161 conn(0x7f47f406b850 msgr2=0x7f47f4150840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.748+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 shutdown_connections 2023-12-08T08:20:15.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.748+0000 7f47fb0e6640 1 -- 172.21.15.45:0/2228100161 wait complete. 2023-12-08T08:20:15.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.993+0000 7f4f1c861640 1 Processor -- start 2023-12-08T08:20:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.993+0000 7f4f1c861640 1 -- start start 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 0x7f4f18156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f180a4d10 0x7f4f18155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180c4730 con 0x7f4f180a4d10 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180c56e0 con 0x7f4f1814c4a0 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.994+0000 7f4f1c861640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180a54f0 con 0x7f4f18155ec0 2023-12-08T08:20:15.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f180a4d10 0x7f4f18155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f180a4d10 0x7f4f18155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38798/0 (socket says 172.21.15.45:38798) 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3893298208 learned_addr learned my addr 172.21.15.45:0/3893298208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f1659c640 1 --2- 172.21.15.45:0/3893298208 >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 0x7f4f18156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f16d9d640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3893298208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 msgr2=0x7f4f18153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3893298208 >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 msgr2=0x7f4f18156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3893298208 >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 0x7f4f18156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3893298208 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1814c880 con 0x7f4f180a4d10 2023-12-08T08:20:15.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.995+0000 7f4f1659c640 1 --2- 172.21.15.45:0/3893298208 >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 0x7f4f18156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.996+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f180a4d10 0x7f4f18155980 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f4f180aae70 tx=0x7f4f0002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8724f5f07a8b7f30 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.997+0000 7f4f15d9b640 1 -- 172.21.15.45:0/3893298208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000317e0 con 0x7f4f180a4d10 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.997+0000 7f4f15d9b640 1 -- 172.21.15.45:0/3893298208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00031940 con 0x7f4f180a4d10 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.997+0000 7f4f15d9b640 1 -- 172.21.15.45:0/3893298208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00031cd0 con 0x7f4f180a4d10 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.997+0000 7f4f1c861640 1 -- 172.21.15.45:0/3893298208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f180a4d10 msgr2=0x7f4f18155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.997+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f180a4d10 0x7f4f18155980 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f4f180aae70 tx=0x7f4f0002b880 comp rx=0 tx=0).stop 2023-12-08T08:20:16.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 -- 172.21.15.45:0/3893298208 shutdown_connections 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3893298208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f180a4d10 0x7f4f18155980 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3893298208 >> v2:172.21.15.114:3300/0 conn(0x7f4f1814c4a0 0x7f4f18156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 -- 172.21.15.45:0/3893298208 >> 172.21.15.45:0/3893298208 conn(0x7f4f180661f0 msgr2=0x7f4f18066600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 -- 172.21.15.45:0/3893298208 shutdown_connections 2023-12-08T08:20:16.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.998+0000 7f4f1c861640 1 -- 172.21.15.45:0/3893298208 wait complete. 2023-12-08T08:20:16.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:15.999+0000 7f4f1c861640 1 Processor -- start 2023-12-08T08:20:16.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.000+0000 7f4f1c861640 1 -- start start 2023-12-08T08:20:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180a4d10 0x7f4f180bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18070580 con 0x7f4f1814c4a0 2023-12-08T08:20:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18072260 con 0x7f4f180a4d10 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1c861640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18072520 con 0x7f4f18155ec0 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38804/0 (socket says 172.21.15.45:38804) 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3367143203 learned_addr learned my addr 172.21.15.45:0/3367143203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f1659c640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180a4d10 0x7f4f180bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 msgr2=0x7f4f18070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180a4d10 msgr2=0x7f4f180bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180a4d10 0x7f4f180bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.001+0000 7f4f0ffff640 1 -- 172.21.15.45:0/3367143203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000094d0 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f0ffff640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4f000090b0 tx=0x7f4f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00032940 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00032aa0 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00032e50 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f181ebe30 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.002+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f181eba50 con 0x7f4f1814c4a0 2023-12-08T08:20:16.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.004+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18070730 con 0x7f4f1814c4a0 2023-12-08T08:20:16.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.004+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f0004e450 con 0x7f4f1814c4a0 2023-12-08T08:20:16.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.005+0000 7f4f0effd640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 0x7f4ef806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.005+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4f000ab660 con 0x7f4f1814c4a0 2023-12-08T08:20:16.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.006+0000 7f4f1659c640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 0x7f4ef806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.006+0000 7f4f1659c640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 0x7f4ef806d300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4f08006fd0 tx=0x7f4f08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.010+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f18070730 con 0x7f4f1814c4a0 2023-12-08T08:20:16.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.202+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f181543c0 con 0x7f4ef806ae40 2023-12-08T08:20:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.208+0000 7f4f0effd640 1 -- 172.21.15.45:0/3367143203 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48269 (secure 0 0 0) 0x7f4f181543c0 con 0x7f4ef806ae40 2023-12-08T08:20:16.210 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:16.211 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:20:16.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 msgr2=0x7f4ef806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 0x7f4ef806d300 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4f08006fd0 tx=0x7f4f08008040 comp rx=0 tx=0).stop 2023-12-08T08:20:16.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 msgr2=0x7f4f181eb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4f000090b0 tx=0x7f4f000046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 shutdown_connections 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f4ef806ae40 0x7f4ef806d300 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f4f18155ec0 0x7f4f18070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1814c4a0 0x7f4f181eb510 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 --2- 172.21.15.45:0/3367143203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f180a4d10 0x7f4f180bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 >> 172.21.15.45:0/3367143203 conn(0x7f4f180661f0 msgr2=0x7f4f181550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.211+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 shutdown_connections 2023-12-08T08:20:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:16.212+0000 7f4f1c861640 1 -- 172.21.15.45:0/3367143203 wait complete. 2023-12-08T08:20:16.234 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2023-12-08T08:20:15.811050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259468,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715252,"statfs":{"total":773094113280,"available":772828418048,"internally_reserved":0,"allocated":10264576,"data_stored":5479200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.914408"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":229,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-08T08:20:03.767994+0000","last_change":"2023-12-08T08:14:55.628686+0000","last_active":"2023-12-08T08:20:03.767994+0000","last_peered":"2023-12-08T08:20:03.767994+0000","last_clean":"2023-12-08T08:20:03.767994+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:20:03.767994+0000","last_undegraded":"2023-12-08T08:20:03.767994+0000","last_fullsized":"2023-12-08T08:20:03.767994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:14:54.238703+0000","last_clean_scrub_stamp":"2023-12-08T08:14:54.238703+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:37.474150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.016},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4219999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.671,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.85999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.127,"15min":1.1499999999999999},"min":{"1min":0.82799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.694,"5min":1.794,"15min":1.794},"last":1.427},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.69599999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.145,"15min":2.145},"last":1.171}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.149,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.78800000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2849999999999999,"15min":1.319},"min":{"1min":0.80800000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6399999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.345,"15min":1.399},"min":{"1min":0.876,"5min":0.75,"15min":0.75},"max":{"1min":1.702,"5min":3.524,"15min":3.524},"last":1.556}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3700000000000001,"15min":1.399},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.855,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.371,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.97,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.504,"15min":1.4530000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.923,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.5209999999999999,"15min":1.5089999999999999},"min":{"1min":0.72099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0739999999999998,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.23}]},{"osd":6,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5980000000000001,"15min":1.6419999999999999},"min":{"1min":0.84099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.0430000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.599,"15min":1.605},"min":{"1min":0.65400000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.157,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.3839999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.6970000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.26},{"interface":"front","average":{"1min":1.079,"5min":1.298,"15min":1.796},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.615,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.587}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.1299999999999999},"min":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.611,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.554},{"interface":"front","average":{"1min":1.103,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.66400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.867,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.171}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.226,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4830000000000001,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.113},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.266},"min":{"1min":0.76400000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6599999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2789999999999999,"15min":1.385},"min":{"1min":0.754,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8109999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.419},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.304,"15min":1.371},"min":{"1min":0.85799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5820000000000001,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3400000000000001,"15min":1.349},"min":{"1min":0.63100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.792,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.379},{"interface":"front","average":{"1min":1.274,"5min":1.377,"15min":1.4059999999999999},"min":{"1min":0.54200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0939999999999999,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":1.355}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3959999999999999,"15min":1.47},"min":{"1min":0.66100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.639,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.464,"15min":1.482},"min":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.653}]},{"osd":7,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4830000000000001,"15min":1.4850000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9970000000000001,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.508},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5289999999999999,"15min":1.5920000000000001},"min":{"1min":0.82399999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.726,"5min":8.532,"15min":8.532},"last":1.3240000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.002,"15min":0.96199999999999997},"min":{"1min":0.64600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.51,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.048,"15min":1.036},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.397,"5min":2.004,"15min":2.004},"last":1.0069999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.0269999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.641,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.143,"15min":1.2110000000000001},"min":{"1min":0.71099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.621,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.2490000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.2589999999999999,"15min":1.294},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.667,"5min":2.827,"15min":2.827},"last":1.462}]},{"osd":3,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.347},"min":{"1min":0.91600000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7969999999999999,"5min":1.96,"15min":1.96},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.391,"15min":1.419},"min":{"1min":0.88300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.792,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.7470000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2470000000000001,"15min":1.282},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.839,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.3799999999999999,"15min":1.375},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.9059999999999999,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.6599999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.403,"15min":1.401},"min":{"1min":0.67900000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.7430000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.385,"15min":1.4179999999999999},"min":{"1min":0.66400000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.2730000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.5269999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.52,"15min":1.4810000000000001},"min":{"1min":0.64800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2410000000000001,"5min":3.242,"15min":3.242},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5349999999999999,"15min":1.518},"min":{"1min":0.745,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.3879999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.8320000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0549999999999999,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.0860000000000001,"15min":1.1359999999999999},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.583,"5min":2.335,"15min":2.335},"last":0.92800000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.149,"15min":1.1859999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.8999999999999999,"5min":1.958,"15min":1.958},"last":0.876},{"interface":"front","average":{"1min":1.155,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2190000000000001,"15min":1.242},"min":{"1min":0.94199999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7070000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.361,"5min":1.347,"15min":1.393},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.875,"5min":2.456,"15min":2.456},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2270000000000001,"15min":1.2170000000000001},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.764,"5min":1.871,"15min":1.871},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.751,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.357,"15min":1.4470000000000001},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":2.097,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.3300000000000001,"15min":1.4099999999999999},"min":{"1min":0.83899999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.647,"5min":2.137,"15min":2.137},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.468},"min":{"1min":0.68999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6559999999999999,"5min":3.016,"15min":3.016},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4590000000000001,"15min":1.5509999999999999},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.569},"min":{"1min":0.79000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.917,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5660000000000001,"15min":1.6539999999999999},"min":{"1min":0.82099999999999995,"5min":0.5,"15min":0.5},"max":{"1min":2.1970000000000001,"5min":3.141,"15min":3.141},"last":0.623}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.85299999999999998,"15min":0.93100000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2589999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":1.004},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.97299999999999998},"min":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5880000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.375,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0609999999999999,"15min":1.107},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.716,"5min":2.121,"15min":2.121},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.135,"15min":1.161},"min":{"1min":0.56100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6870000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.0149999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7470000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3560000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.806,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3520000000000001,"15min":1.458},"min":{"1min":0.81200000000000006,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.9019999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.109},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.367},"min":{"1min":0.748,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.056,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.1970000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.405,"15min":1.4350000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9410000000000001,"5min":2.25,"15min":2.25},"last":1.29},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.45,"15min":1.548},"min":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9710000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.3879999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.427,"15min":1.4730000000000001},"min":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.036,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.5149999999999999,"15min":1.591},"min":{"1min":0.85999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0859999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.341}]}]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.79000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5549999999999999,"5min":1.948,"15min":1.948},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96599999999999997,"15min":0.91200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6220000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6759999999999999,"5min":2.996,"15min":2.996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.01,"15min":0.97099999999999997},"min":{"1min":0.52800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4039999999999999,"5min":2.238,"15min":2.238},"last":0.623}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.631,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.103,"15min":1.0649999999999999},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3120000000000001,"15min":1.3140000000000001},"min":{"1min":0.81399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9059999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":0.749,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8460000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.0600000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.371,"15min":1.375},"min":{"1min":0.82399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.6339999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.755},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.86099999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9139999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9410000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4119999999999999,"15min":1.417},"min":{"1min":0.80500000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.748,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.49,"15min":1.47},"min":{"1min":0.98699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.044,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.464,"5min":1.508,"15min":1.5069999999999999},"min":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.089,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.96199999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84399999999999997,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.266,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.93700000000000006,"15min":0.97099999999999997},"min":{"1min":0.59299999999999997,"5min":0.308,"15min":0.308},"max":{"1min":1.728,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86099999999999999,"15min":0.90300000000000002},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.218,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0469999999999999,"15min":1.1060000000000001},"min":{"1min":0.54600000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1539999999999999,"15min":1.1859999999999999},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.722,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0489999999999999,"15min":1.115},"min":{"1min":0.62,"5min":0.437,"15min":0.437},"max":{"1min":1.552,"5min":2.327,"15min":2.327},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.212,"15min":1.2929999999999999},"min":{"1min":0.78100000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.609,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.006},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.345,"15min":1.464},"min":{"1min":0.873,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8260000000000001,"5min":2.552,"15min":2.552},"last":1.196}]},{"osd":5,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.331,"15min":1.456},"min":{"1min":1.0329999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7490000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.3009999999999999,"15min":1.415},"min":{"1min":0.753,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":1.075}]},{"osd":6,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4410000000000001,"15min":1.5620000000000001},"min":{"1min":0.96099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.97,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.383},{"interface":"front","average":{"1min":1.284,"5min":1.397,"15min":1.53},"min":{"1min":0.83399999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.6299999999999999,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.4670000000000001,"15min":1.5669999999999999},"min":{"1min":0.85799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":2.0289999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5409999999999999,"15min":1.641},"min":{"1min":1.024,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0880000000000001,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.2949999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.92300000000000004,"15min":0.88600000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.0389999999999997,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":1.093},{"interface":"front","average":{"1min":1.296,"5min":1.048,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":8.3140000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1140000000000001,"15min":1.1559999999999999},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.423,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98799999999999999,"15min":1.087},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.2609999999999999,"15min":1.3029999999999999},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":1.1830000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3260000000000001,"15min":1.46},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.2709999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.343,"15min":1.351},"min":{"1min":0.90100000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":10.208,"5min":10.208,"15min":10.208},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3420000000000001,"15min":1.423},"min":{"1min":0.84799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.319,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.157},{"interface":"front","average":{"1min":1.633,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":1.421}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":2.085,"5min":1.607,"15min":1.571},"min":{"1min":0.84599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":12.779,"5min":12.779,"15min":12.779},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.81899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.3340000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":1.589,"15min":1.661},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":8.2569999999999997,"5min":8.2569999999999997,"15min":8.2569999999999997},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.4630000000000001,"15min":1.5369999999999999},"min":{"1min":0.97299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":1.3799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:16.237 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-08T08:14:54.238703+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=14, tm_sec=54, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=20, tm_sec=8, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T08:20:16.237 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T08:20:29.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:29.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:36.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.470+0000 7f9607fff640 1 Processor -- start 2023-12-08T08:20:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.471+0000 7f9607fff640 1 -- start start 2023-12-08T08:20:36.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f9607fff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96080a5140 0x7f9608153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f9607fff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96080a59a0 con 0x7f960814d7f0 2023-12-08T08:20:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f9607fff640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9608150840 con 0x7f960806d450 2023-12-08T08:20:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f9607fff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960814e330 con 0x7f96080a5140 2023-12-08T08:20:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f96077fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f960814d7f0 0x7f960814dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38258/0 (socket says 172.21.15.45:38258) 2023-12-08T08:20:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f96077fe640 1 -- 172.21.15.45:0/4208782658 learned_addr learned my addr 172.21.15.45:0/4208782658 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.473+0000 7f95fe7fc640 1 --2- 172.21.15.45:0/4208782658 >> v2:172.21.15.114:3300/0 conn(0x7f96080a5140 0x7f9608153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283134646 0 0) 0x7f96080a59a0 con 0x7f960814d7f0 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f4003440 con 0x7f960814d7f0 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394862446 0 0) 0x7f95f4003440 con 0x7f960814d7f0 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 >> v2:172.21.15.114:3300/0 conn(0x7f96080a5140 msgr2=0x7f9608153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 --2- 172.21.15.45:0/4208782658 >> v2:172.21.15.114:3300/0 conn(0x7f96080a5140 0x7f9608153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 >> v1:172.21.15.114:6789/0 conn(0x7f960806d450 legacy=0x7f9608150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608154b40 con 0x7f960814d7f0 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 867779649 0 0) 0x7f9600001670 con 0x7f960814d7f0 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 >> v1:172.21.15.45:6789/0 conn(0x7f960814d7f0 legacy=0x7f960814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f4003ab0 0x7f95f4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95f4008850 0x7f95f400ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 0x7f95f400da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f400e340 con 0x7f95f400b5d0 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f400e4b0 con 0x7f95f4003ab0 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.474+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f400e670 con 0x7f95f4008850 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 0x7f95f400da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f9606ffd640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f4003ab0 0x7f95f4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 -- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95f4008850 msgr2=0x7f95f400ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f95f4008850 0x7f95f400ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 -- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f4003ab0 msgr2=0x7f95f4003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f4003ab0 0x7f95f4003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.475+0000 7f96077fe640 1 -- 172.21.15.45:0/4208782658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4003440 con 0x7f95f400b5d0 2023-12-08T08:20:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.476+0000 7f96077fe640 1 -- 172.21.15.45:0/4208782658 reap_dead start 2023-12-08T08:20:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.476+0000 7f96077fe640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 0x7f95f400da90 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9600001050 tx=0x7f95f40036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8e44b9ae4e8ee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.476+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600005ad0 con 0x7f95f400b5d0 2023-12-08T08:20:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.476+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600005c70 con 0x7f95f400b5d0 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.476+0000 7f96067fc640 1 -- 172.21.15.45:0/4208782658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960002c7c0 con 0x7f95f400b5d0 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 -- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 msgr2=0x7f95f400da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 0x7f95f400da90 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9600001050 tx=0x7f95f40036f0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 -- 172.21.15.45:0/4208782658 shutdown_connections 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 --2- 172.21.15.45:0/4208782658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f400b5d0 0x7f95f400da90 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 -- 172.21.15.45:0/4208782658 >> 172.21.15.45:0/4208782658 conn(0x7f96080c5780 msgr2=0x7f96080c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 -- 172.21.15.45:0/4208782658 shutdown_connections 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.477+0000 7f9607fff640 1 -- 172.21.15.45:0/4208782658 wait complete. 2023-12-08T08:20:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.479+0000 7f9607fff640 1 Processor -- start 2023-12-08T08:20:36.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.479+0000 7f9607fff640 1 -- start start 2023-12-08T08:20:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f400b5d0 0x7f96080718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9608146f80 0x7f9608071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960806ff30 con 0x7f96081462a0 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9608072350 con 0x7f95f400b5d0 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f9607fff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96081ea1b0 con 0x7f9608146f80 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f96077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f96077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47922/0 (socket says 172.21.15.45:47922) 2023-12-08T08:20:36.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.480+0000 7f96077fe640 1 -- 172.21.15.45:0/2699973611 learned_addr learned my addr 172.21.15.45:0/2699973611 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f9606ffd640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f400b5d0 0x7f96080718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f95fe7fc640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9608146f80 0x7f9608071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 -- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9608146f80 msgr2=0x7f9608071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9608146f80 0x7f9608071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 -- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f400b5d0 msgr2=0x7f96080718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f400b5d0 0x7f96080718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 -- 172.21.15.45:0/2699973611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96081ea490 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f96077fe640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9600000c00 tx=0x7f9600000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600039040 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960002cbd0 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600007070 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.481+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960806f8e0 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.482+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96080aacf0 con 0x7f96081462a0 2023-12-08T08:20:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.483+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96080743e0 con 0x7f96081462a0 2023-12-08T08:20:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.484+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9600032070 con 0x7f96081462a0 2023-12-08T08:20:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.485+0000 7f95fffff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 0x7f95e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.485+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f96000aa230 con 0x7f96081462a0 2023-12-08T08:20:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.485+0000 7f9606ffd640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 0x7f95e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.486+0000 7f9606ffd640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 0x7f95e806d300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007fd0 tx=0x7f95f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.490+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9600075430 con 0x7f96081462a0 2023-12-08T08:20:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.685+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 --> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9608154860 con 0x7f95e806ae40 2023-12-08T08:20:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.687+0000 7f95fffff640 1 -- 172.21.15.45:0/2699973611 <== mgr.4098 v2:172.21.15.45:6832/3986782065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48104 (secure 0 0 0) 0x7f95f80013b0 con 0x7f95e806ae40 2023-12-08T08:20:36.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-08T08:20:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.690+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 msgr2=0x7f95e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.690+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 0x7f95e806d300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f95f8007fd0 tx=0x7f95f8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.690+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 msgr2=0x7f9608146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.690+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9600000c00 tx=0x7f9600000fe0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 shutdown_connections 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f95e806ae40 0x7f95e806d300 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f9608146f80 0x7f9608071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96081462a0 0x7f9608146720 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 --2- 172.21.15.45:0/2699973611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95f400b5d0 0x7f96080718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 >> 172.21.15.45:0/2699973611 conn(0x7f96080c5780 msgr2=0x7f9608152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 shutdown_connections 2023-12-08T08:20:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.691+0000 7f9607fff640 1 -- 172.21.15.45:0/2699973611 wait complete. 2023-12-08T08:20:36.714 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2023-12-08T08:20:35.817014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":259456,"kb_used_data":10024,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715264,"statfs":{"total":773094113280,"available":772828430336,"internally_reserved":0,"allocated":10264576,"data_stored":5479200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003658"},"pg_stats":[{"pgid":"1.0","version":"91'119","reported_seq":240,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-08T08:20:16.618900+0000","last_change":"2023-12-08T08:20:16.618969+0000","last_active":"2023-12-08T08:20:16.618900+0000","last_peered":"2023-12-08T08:20:16.618900+0000","last_clean":"2023-12-08T08:20:16.618900+0000","last_became_active":"2023-12-08T08:14:55.626420+0000","last_became_peered":"2023-12-08T08:14:55.626420+0000","last_unstale":"2023-12-08T08:20:16.618900+0000","last_undegraded":"2023-12-08T08:20:16.618900+0000","last_fullsized":"2023-12-08T08:20:16.618900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'119","last_scrub_stamp":"2023-12-08T08:20:16.618746+0000","last_deep_scrub":"91'119","last_deep_scrub_stamp":"2023-12-08T08:20:16.618746+0000","last_clean_scrub_stamp":"2023-12-08T08:20:16.618746+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:39.105678+0000","scrub_duration":0.010262327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.02,"15min":1.016},"min":{"1min":0.64400000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4219999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.887},{"interface":"front","average":{"1min":1.139,"5min":1.1120000000000001,"15min":1.0880000000000001},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.671,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.089}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.127,"15min":1.1499999999999999},"min":{"1min":0.82799999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.694,"5min":1.794,"15min":1.794},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1779999999999999,"15min":1.224},"min":{"1min":0.69599999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5249999999999999,"5min":2.145,"15min":2.145},"last":1.1879999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.149,"15min":1.169},"min":{"1min":0.76200000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.861,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.345},{"interface":"front","average":{"1min":1.147,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.78800000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.756}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2849999999999999,"15min":1.319},"min":{"1min":0.80800000000000005,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6399999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.345,"15min":1.399},"min":{"1min":0.876,"5min":0.75,"15min":0.75},"max":{"1min":1.702,"5min":3.524,"15min":3.524},"last":1.4359999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3700000000000001,"15min":1.399},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.855,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.379,"5min":1.371,"15min":1.357},"min":{"1min":0.72399999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.97,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.5029999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.504,"15min":1.4530000000000001},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.923,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.5209999999999999,"15min":1.5089999999999999},"min":{"1min":0.72099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.0739999999999998,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.5980000000000001,"15min":1.6419999999999999},"min":{"1min":0.84099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.0430000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.298},{"interface":"front","average":{"1min":1.585,"5min":1.599,"15min":1.605},"min":{"1min":0.65400000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.157,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.7250000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.2709999999999999,"15min":1.6970000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":19.065999999999999,"15min":19.065999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.079,"5min":1.298,"15min":1.796},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.615,"5min":19.364999999999998,"15min":19.364999999999998},"last":1.1499999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.1299999999999999},"min":{"1min":0.73299999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.611,"5min":6.5620000000000003,"15min":6.5620000000000003},"last":1.208},{"interface":"front","average":{"1min":1.103,"5min":1.212,"15min":1.2370000000000001},"min":{"1min":0.66400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.867,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.5269999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.226,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4830000000000001,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.268,"15min":1.266},"min":{"1min":0.76400000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.6599999999999999,"5min":6.6040000000000001,"15min":6.6040000000000001},"last":1.3560000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2789999999999999,"15min":1.385},"min":{"1min":0.754,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.8109999999999999,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.304,"15min":1.371},"min":{"1min":0.85799999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5820000000000001,"5min":8.6150000000000002,"15min":8.6150000000000002},"last":1.105}]},{"osd":4,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3400000000000001,"15min":1.349},"min":{"1min":0.63100000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.792,"5min":6.4370000000000003,"15min":6.4370000000000003},"last":1.486},{"interface":"front","average":{"1min":1.274,"5min":1.377,"15min":1.4059999999999999},"min":{"1min":0.54200000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.0939999999999999,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":1.5800000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3959999999999999,"15min":1.47},"min":{"1min":0.66100000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.639,"5min":8.0039999999999996,"15min":8.0039999999999996},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.464,"15min":1.482},"min":{"1min":0.71999999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7490000000000001,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":1.5569999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:20:02 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4830000000000001,"15min":1.4850000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.9970000000000001,"5min":7.1989999999999998,"15min":7.1989999999999998},"last":1.446},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5289999999999999,"15min":1.5920000000000001},"min":{"1min":0.82399999999999995,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.726,"5min":8.532,"15min":8.532},"last":0.95599999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.002,"15min":0.96199999999999997},"min":{"1min":0.64600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.51,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.048,"15min":1.036},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.397,"5min":2.004,"15min":2.004},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.0269999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.641,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.143,"15min":1.2110000000000001},"min":{"1min":0.71099999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.621,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.0629999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.169,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4670000000000001,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.872},{"interface":"front","average":{"1min":1.179,"5min":1.2589999999999999,"15min":1.294},"min":{"1min":0.79100000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.667,"5min":2.827,"15min":2.827},"last":1.0860000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.347},"min":{"1min":0.91600000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.7969999999999999,"5min":1.96,"15min":1.96},"last":1.113},{"interface":"front","average":{"1min":1.377,"5min":1.391,"15min":1.419},"min":{"1min":0.88300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.792,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.1799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2470000000000001,"15min":1.282},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.839,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.3799999999999999,"15min":1.375},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.9059999999999999,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.403,"15min":1.401},"min":{"1min":0.67900000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.7430000000000001,"5min":3.0459999999999998,"15min":3.0459999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.395,"5min":1.385,"15min":1.4179999999999999},"min":{"1min":0.66400000000000003,"5min":0.621,"15min":0.621},"max":{"1min":2.2730000000000001,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.52,"15min":1.4810000000000001},"min":{"1min":0.64800000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2410000000000001,"5min":3.242,"15min":3.242},"last":1.04},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5349999999999999,"15min":1.518},"min":{"1min":0.745,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.3879999999999999,"5min":3.5169999999999999,"15min":3.5169999999999999},"last":1.2809999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0549999999999999,"15min":1.018},"min":{"1min":0.68300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.155},{"interface":"front","average":{"1min":1.048,"5min":1.0860000000000001,"15min":1.1359999999999999},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.583,"5min":2.335,"15min":2.335},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.149,"15min":1.1859999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.8999999999999999,"5min":1.958,"15min":1.958},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.155,"5min":1.1140000000000001,"15min":1.113},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.0189999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.2190000000000001,"15min":1.242},"min":{"1min":0.94199999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7070000000000001,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.347,"15min":1.393},"min":{"1min":0.94399999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.875,"5min":2.456,"15min":2.456},"last":1.218}]},{"osd":3,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2270000000000001,"15min":1.2170000000000001},"min":{"1min":0.745,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.764,"5min":1.871,"15min":1.871},"last":1.286},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.751,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.3029999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.357,"15min":1.4470000000000001},"min":{"1min":0.56299999999999994,"5min":0.501,"15min":0.501},"max":{"1min":2.097,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.995},{"interface":"front","average":{"1min":1.298,"5min":1.3300000000000001,"15min":1.4099999999999999},"min":{"1min":0.83899999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.647,"5min":2.137,"15min":2.137},"last":1.171}]},{"osd":6,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.468},"min":{"1min":0.68999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6559999999999999,"5min":3.016,"15min":3.016},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.4590000000000001,"15min":1.5509999999999999},"min":{"1min":0.63,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.948,"5min":2.54,"15min":2.54},"last":1.091}]},{"osd":7,"last update":"Fri Dec 8 08:19:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4870000000000001,"15min":1.569},"min":{"1min":0.79000000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.917,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.5660000000000001,"15min":1.6539999999999999},"min":{"1min":0.82099999999999995,"5min":0.5,"15min":0.5},"max":{"1min":2.1970000000000001,"5min":3.141,"15min":3.141},"last":1.254}]}]},{"osd":3,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.85299999999999998,"15min":0.93100000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2589999999999999,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.046},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.90800000000000003,"15min":1.004},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.4570000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.97299999999999998},"min":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5880000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":1.0349999999999999,"15min":1.099},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.375,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":1.236}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0609999999999999,"15min":1.107},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.716,"5min":2.121,"15min":2.121},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.135,"15min":1.161},"min":{"1min":0.56100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6870000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4279999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.21,"15min":1.1870000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7470000000000001,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.321,"15min":1.3560000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.806,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.083}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3520000000000001,"15min":1.458},"min":{"1min":0.81200000000000006,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.9019999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.333,"15min":1.367},"min":{"1min":0.748,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.056,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.347}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.405,"15min":1.4350000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.9410000000000001,"5min":2.25,"15min":2.25},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.45,"15min":1.548},"min":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.9710000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.494}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.427,"15min":1.4730000000000001},"min":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.036,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.198},{"interface":"front","average":{"1min":1.413,"5min":1.5149999999999999,"15min":1.591},"min":{"1min":0.85999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.0859999999999999,"5min":3.3039999999999998,"15min":3.3039999999999998},"last":1.2949999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81599999999999995,"15min":0.79000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.5549999999999999,"5min":1.948,"15min":1.948},"last":0.755},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96599999999999997,"15min":0.91200000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6220000000000001,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":1.347}]},{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.6759999999999999,"5min":2.996,"15min":2.996},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.01,"15min":0.97099999999999997},"min":{"1min":0.52800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.4039999999999999,"5min":2.238,"15min":2.238},"last":0.96799999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.631,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.139},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.103,"15min":1.0649999999999999},"min":{"1min":0.57699999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.252}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.3120000000000001,"15min":1.3140000000000001},"min":{"1min":0.81399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.9059999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":0.749,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8460000000000001,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.3120000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.371,"15min":1.375},"min":{"1min":0.82399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.6339999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.379},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.383,"15min":1.401},"min":{"1min":0.86099999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.9139999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.518}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.89400000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.9410000000000001,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.4119999999999999,"15min":1.417},"min":{"1min":0.80500000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.748,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.4910000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.49,"15min":1.47},"min":{"1min":0.98699999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.044,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.508,"15min":1.5069999999999999},"min":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.089,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":1.4139999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542214,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1134592,"data_stored":537308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84399999999999997,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.266,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.085},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.93700000000000006,"15min":0.97099999999999997},"min":{"1min":0.59299999999999997,"5min":0.308,"15min":0.308},"max":{"1min":1.728,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86099999999999999,"15min":0.90300000000000002},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.218,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0469999999999999,"15min":1.1060000000000001},"min":{"1min":0.54600000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4810000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":1.256}]},{"osd":3,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1539999999999999,"15min":1.1859999999999999},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.722,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0489999999999999,"15min":1.115},"min":{"1min":0.62,"5min":0.437,"15min":0.437},"max":{"1min":1.552,"5min":2.327,"15min":2.327},"last":1.4830000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.212,"15min":1.2929999999999999},"min":{"1min":0.78100000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.609,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":1.665},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.345,"15min":1.464},"min":{"1min":0.873,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.8260000000000001,"5min":2.552,"15min":2.552},"last":1.5209999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.331,"15min":1.456},"min":{"1min":1.0329999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.7490000000000001,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.157},{"interface":"front","average":{"1min":1.196,"5min":1.3009999999999999,"15min":1.415},"min":{"1min":0.753,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5349999999999999,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":2.0049999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4410000000000001,"15min":1.5620000000000001},"min":{"1min":0.96099999999999997,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.97,"5min":3.2690000000000001,"15min":3.2690000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.397,"15min":1.53},"min":{"1min":0.83399999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.6299999999999999,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:03 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.4670000000000001,"15min":1.5669999999999999},"min":{"1min":0.85799999999999998,"5min":0.622,"15min":0.622},"max":{"1min":2.0289999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":2.036},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5409999999999999,"15min":1.641},"min":{"1min":1.024,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0880000000000001,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":1.726}]}]},{"osd":0,"up_from":14,"seq":60129542214,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1728512,"data_stored":1127676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.92300000000000004,"15min":0.88600000000000001},"min":{"1min":0.39000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":6.0389999999999997,"5min":6.0389999999999997,"15min":6.0389999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.296,"5min":1.048,"15min":1.087},"min":{"1min":0.60199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":8.3140000000000001,"5min":8.3140000000000001,"15min":8.3140000000000001},"last":0.84499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1140000000000001,"15min":1.1559999999999999},"min":{"1min":0.57799999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.056,"15min":1.1439999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.423,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.96499999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":0.98799999999999999,"15min":1.087},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.2609999999999999,"15min":1.3029999999999999},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":5.7190000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":1.133}]},{"osd":4,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3260000000000001,"15min":1.46},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.2709999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.645},{"interface":"front","average":{"1min":1.748,"5min":1.343,"15min":1.351},"min":{"1min":0.90100000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":10.208,"5min":10.208,"15min":10.208},"last":1.573}]},{"osd":5,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3420000000000001,"15min":1.423},"min":{"1min":0.84799999999999998,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.319,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.633,"5min":1.4339999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":1.3959999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":2.085,"5min":1.607,"15min":1.571},"min":{"1min":0.84599999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":12.779,"5min":12.779,"15min":12.779},"last":1.518},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.5229999999999999,"15min":1.595},"min":{"1min":0.81899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.3300000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":1.589,"15min":1.661},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":8.2569999999999997,"5min":8.2569999999999997,"15min":8.2569999999999997},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.4630000000000001,"15min":1.5369999999999999},"min":{"1min":0.97299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":3.3730000000000002,"5min":3.3730000000000002,"15min":3.3730000000000002},"last":1.7949999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:36.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-08T08:20:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.932+0000 7f49d8d75640 1 Processor -- start 2023-12-08T08:20:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.932+0000 7f49d8d75640 1 -- start start 2023-12-08T08:20:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d8d75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49d4157a20 0x7f49d4154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d8d75640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f49d406c230 0x7f49d4154e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d8d75640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d4151eb0 con 0x7f49d4151ad0 2023-12-08T08:20:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d8d75640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d40c56a0 con 0x7f49d4157a20 2023-12-08T08:20:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d8d75640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d40c80d0 con 0x7f49d406c230 2023-12-08T08:20:36.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49d4157a20 0x7f49d4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49d4157a20 0x7f49d4154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47934/0 (socket says 172.21.15.45:47934) 2023-12-08T08:20:36.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.934+0000 7f49d2ffd640 1 -- 172.21.15.45:0/2970629155 learned_addr learned my addr 172.21.15.45:0/2970629155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:36.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.935+0000 7f49d3fff640 1 --2- 172.21.15.45:0/2970629155 >> v2:172.21.15.114:3300/0 conn(0x7f49d406c230 0x7f49d4154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.935+0000 7f49d2ffd640 1 -- 172.21.15.45:0/2970629155 >> v2:172.21.15.114:3300/0 conn(0x7f49d406c230 msgr2=0x7f49d4154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.935+0000 7f49d2ffd640 1 --2- 172.21.15.45:0/2970629155 >> v2:172.21.15.114:3300/0 conn(0x7f49d406c230 0x7f49d4154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.935+0000 7f49d2ffd640 1 -- 172.21.15.45:0/2970629155 >> v1:172.21.15.114:6789/0 conn(0x7f49d4151ad0 legacy=0x7f49d40ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.935+0000 7f49d2ffd640 1 -- 172.21.15.45:0/2970629155 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4154430 con 0x7f49d4157a20 2023-12-08T08:20:36.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.936+0000 7f49d2ffd640 1 --2- 172.21.15.45:0/2970629155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d4157a20 0x7f49d4154930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f49d406bca0 tx=0x7f49c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bfebf04939b1ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d27fc640 1 -- 172.21.15.45:0/2970629155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8031870 con 0x7f49d4157a20 2023-12-08T08:20:36.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d27fc640 1 -- 172.21.15.45:0/2970629155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c80319d0 con 0x7f49d4157a20 2023-12-08T08:20:36.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d27fc640 1 -- 172.21.15.45:0/2970629155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8031d60 con 0x7f49d4157a20 2023-12-08T08:20:36.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 -- 172.21.15.45:0/2970629155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d4157a20 msgr2=0x7f49d4154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 --2- 172.21.15.45:0/2970629155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d4157a20 0x7f49d4154930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f49d406bca0 tx=0x7f49c802b910 comp rx=0 tx=0).stop 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 -- 172.21.15.45:0/2970629155 shutdown_connections 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 --2- 172.21.15.45:0/2970629155 >> v2:172.21.15.114:3300/0 conn(0x7f49d406c230 0x7f49d4154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 --2- 172.21.15.45:0/2970629155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d4157a20 0x7f49d4154930 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.937+0000 7f49d8d75640 1 -- 172.21.15.45:0/2970629155 >> 172.21.15.45:0/2970629155 conn(0x7f49d4066610 msgr2=0x7f49d4066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.938+0000 7f49d8d75640 1 -- 172.21.15.45:0/2970629155 shutdown_connections 2023-12-08T08:20:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.938+0000 7f49d8d75640 1 -- 172.21.15.45:0/2970629155 wait complete. 2023-12-08T08:20:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.939+0000 7f49d8d75640 1 Processor -- start 2023-12-08T08:20:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.939+0000 7f49d8d75640 1 -- start start 2023-12-08T08:20:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49d4151ad0 0x7f49d40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4157a20 0x7f49d40aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d41eab90 con 0x7f49d406c230 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4152da0 con 0x7f49d4157a20 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.940+0000 7f49d8d75640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c0480 con 0x7f49d4151ad0 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47950/0 (socket says 172.21.15.45:47950) 2023-12-08T08:20:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 -- 172.21.15.45:0/1018069946 learned_addr learned my addr 172.21.15.45:0/1018069946 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d2ffd640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49d4151ad0 0x7f49d40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d3fff640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4157a20 0x7f49d40aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 -- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49d4151ad0 msgr2=0x7f49d40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49d4151ad0 0x7f49d40c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 -- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4157a20 msgr2=0x7f49d40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4157a20 0x7f49d40aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.941+0000 7f49d37fe640 1 -- 172.21.15.45:0/1018069946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80094d0 con 0x7f49d406c230 2023-12-08T08:20:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49d37fe640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c7c0 tx=0x7f49c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400aa50 con 0x7f49d406c230 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400abb0 con 0x7f49d406c230 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4012420 con 0x7f49d406c230 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d41eae30 con 0x7f49d406c230 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.942+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d40c0760 con 0x7f49d406c230 2023-12-08T08:20:36.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.943+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d40743e0 con 0x7f49d406c230 2023-12-08T08:20:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.944+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49c4012580 con 0x7f49d406c230 2023-12-08T08:20:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.945+0000 7f49bbfff640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 0x7f49c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.945+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f49c4089460 con 0x7f49d406c230 2023-12-08T08:20:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.946+0000 7f49d2ffd640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 0x7f49c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.946+0000 7f49d2ffd640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 0x7f49c006d300 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f49c8036000 tx=0x7f49c803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:36.950+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49c4054660 con 0x7f49d406c230 2023-12-08T08:20:37.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.145+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f49d4152270 con 0x7f49d406c230 2023-12-08T08:20:37.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.150+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f49d4152270 con 0x7f49d406c230 2023-12-08T08:20:37.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.151+0000 7f49bbfff640 1 -- 172.21.15.45:0/1018069946 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f49c4054660 con 0x7f49d406c230 2023-12-08T08:20:37.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 msgr2=0x7f49c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 0x7f49c006d300 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f49c8036000 tx=0x7f49c803c040 comp rx=0 tx=0).stop 2023-12-08T08:20:37.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 msgr2=0x7f49d40c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c7c0 tx=0x7f49c400cc80 comp rx=0 tx=0).stop 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 shutdown_connections 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f49c006ae40 0x7f49c006d300 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f49d4151ad0 0x7f49d40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49d4157a20 0x7f49d40aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 --2- 172.21.15.45:0/1018069946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d406c230 0x7f49d40c11c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 >> 172.21.15.45:0/1018069946 conn(0x7f49d4066610 msgr2=0x7f49d40c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 shutdown_connections 2023-12-08T08:20:37.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.154+0000 7f49d8d75640 1 -- 172.21.15.45:0/1018069946 wait complete. 2023-12-08T08:20:37.178 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:20:37.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:37.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.395+0000 7f43abfff640 1 Processor -- start 2023-12-08T08:20:37.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.395+0000 7f43abfff640 1 -- start start 2023-12-08T08:20:37.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43abfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f43ac0a5e40 0x7f43ac154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43abfff640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43ac0c4820 0x7f43ac154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43abfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac158a90 con 0x7f43ac151aa0 2023-12-08T08:20:37.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43abfff640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac157e80 con 0x7f43ac0a5e40 2023-12-08T08:20:37.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43abfff640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac158160 con 0x7f43ac0c4820 2023-12-08T08:20:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43aaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f43ac151aa0 0x7f43ac06a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38270/0 (socket says 172.21.15.45:38270) 2023-12-08T08:20:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43aaffd640 1 -- 172.21.15.45:0/3468757642 learned_addr learned my addr 172.21.15.45:0/3468757642 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-08T08:20:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.397+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/3468757642 >> v2:172.21.15.45:3300/0 conn(0x7f43ac0a5e40 0x7f43ac154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43ab7fe640 1 --2- 172.21.15.45:0/3468757642 >> v2:172.21.15.114:3300/0 conn(0x7f43ac0c4820 0x7f43ac154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43a9ffb640 1 -- 172.21.15.45:0/3468757642 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976149005 0 0) 0x7f43ac158a90 con 0x7f43ac151aa0 2023-12-08T08:20:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43a9ffb640 1 -- 172.21.15.45:0/3468757642 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4398003520 con 0x7f43ac151aa0 2023-12-08T08:20:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43aa7fc640 1 -- 172.21.15.45:0/3468757642 >> v2:172.21.15.114:3300/0 conn(0x7f43ac0c4820 msgr2=0x7f43ac154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/3468757642 >> v2:172.21.15.114:3300/0 conn(0x7f43ac0c4820 0x7f43ac154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43aa7fc640 1 -- 172.21.15.45:0/3468757642 >> v1:172.21.15.45:6789/0 conn(0x7f43ac151aa0 legacy=0x7f43ac06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.398+0000 7f43aa7fc640 1 -- 172.21.15.45:0/3468757642 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac158440 con 0x7f43ac0a5e40 2023-12-08T08:20:37.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.399+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/3468757642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0a5e40 0x7f43ac154830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c2d80 tx=0x7f439c02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c955b7cf0fd96dd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43a9ffb640 1 -- 172.21.15.45:0/3468757642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c02cb50 con 0x7f43ac0a5e40 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43a9ffb640 1 -- 172.21.15.45:0/3468757642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f439c02ccb0 con 0x7f43ac0a5e40 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43a9ffb640 1 -- 172.21.15.45:0/3468757642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c034680 con 0x7f43ac0a5e40 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 -- 172.21.15.45:0/3468757642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0a5e40 msgr2=0x7f43ac154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 --2- 172.21.15.45:0/3468757642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0a5e40 0x7f43ac154830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c2d80 tx=0x7f439c02bda0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 -- 172.21.15.45:0/3468757642 shutdown_connections 2023-12-08T08:20:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 --2- 172.21.15.45:0/3468757642 >> v2:172.21.15.114:3300/0 conn(0x7f43ac0c4820 0x7f43ac154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 --2- 172.21.15.45:0/3468757642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0a5e40 0x7f43ac154830 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 -- 172.21.15.45:0/3468757642 >> 172.21.15.45:0/3468757642 conn(0x7f43ac0a87f0 msgr2=0x7f43ac0a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.400+0000 7f43abfff640 1 -- 172.21.15.45:0/3468757642 shutdown_connections 2023-12-08T08:20:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.401+0000 7f43abfff640 1 -- 172.21.15.45:0/3468757642 wait complete. 2023-12-08T08:20:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.402+0000 7f43abfff640 1 Processor -- start 2023-12-08T08:20:37.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.402+0000 7f43abfff640 1 -- start start 2023-12-08T08:20:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 --2- >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43ac0a5e40 0x7f43ac0a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43ac151aa0 0x7f43ac155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac071fe0 con 0x7f43ac0c4820 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0713d0 con 0x7f43ac151aa0 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.403+0000 7f43abfff640 1 -- --> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0716b0 con 0x7f43ac0a5e40 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47962/0 (socket says 172.21.15.45:47962) 2023-12-08T08:20:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 -- 172.21.15.45:0/2456378782 learned_addr learned my addr 172.21.15.45:0/2456378782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aaffd640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43ac0a5e40 0x7f43ac0a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43ab7fe640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43ac151aa0 0x7f43ac155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 -- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43ac0a5e40 msgr2=0x7f43ac0a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43ac0a5e40 0x7f43ac0a7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 -- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43ac151aa0 msgr2=0x7f43ac155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43ac151aa0 0x7f43ac155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 -- 172.21.15.45:0/2456378782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009a70 con 0x7f43ac0c4820 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.404+0000 7f43aa7fc640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f439c02bde0 tx=0x7f439c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.405+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c040650 con 0x7f43ac0c4820 2023-12-08T08:20:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.405+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f439c0407f0 con 0x7f43ac0c4820 2023-12-08T08:20:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.405+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac071990 con 0x7f43ac0c4820 2023-12-08T08:20:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.405+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c040bc0 con 0x7f43ac0c4820 2023-12-08T08:20:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.405+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1575c0 con 0x7f43ac0c4820 2023-12-08T08:20:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.406+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac0678a0 con 0x7f43ac0c4820 2023-12-08T08:20:37.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.407+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f439c040d20 con 0x7f43ac0c4820 2023-12-08T08:20:37.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.409+0000 7f43a37fe640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 0x7f438c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.409+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f439c0ac2a0 con 0x7f43ac0c4820 2023-12-08T08:20:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.409+0000 7f43aaffd640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 0x7f438c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.410+0000 7f43aaffd640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 0x7f438c06d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43940011e0 tx=0x7f4394009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.413+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f439c077410 con 0x7f43ac0c4820 2023-12-08T08:20:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.649+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43ac0743e0 con 0x7f43ac0c4820 2023-12-08T08:20:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.650+0000 7f43a37fe640 1 -- 172.21.15.45:0/2456378782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f439c079340 con 0x7f43ac0c4820 2023-12-08T08:20:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-08T08:20:37.653 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5195,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/498160261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":498160261},{"type":"v1","addr":"172.21.15.114:6833","nonce":498160261}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":5701,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/493445221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":493445221},{"type":"v1","addr":"172.21.15.114:6835","nonce":493445221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7401,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3920740127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3920740127},{"type":"v1","addr":"172.21.15.45:6837","nonce":3920740127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7479,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1768718663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1768718663},{"type":"v1","addr":"172.21.15.45:6836","nonce":1768718663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[]} 2023-12-08T08:20:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 57 2023-12-08T08:20:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.652+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 msgr2=0x7f438c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.652+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 0x7f438c06d330 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43940011e0 tx=0x7f4394009040 comp rx=0 tx=0).stop 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.652+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 msgr2=0x7f43ac1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.652+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f439c02bde0 tx=0x7f439c004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 shutdown_connections 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:6832/3986782065,v1:172.21.15.45:6833/3986782065] conn(0x7f438c06ae70 0x7f438c06d330 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43ac151aa0 0x7f43ac155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ac0c4820 0x7f43ac1553d0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 --2- 172.21.15.45:0/2456378782 >> [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] conn(0x7f43ac0a5e40 0x7f43ac0a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 >> 172.21.15.45:0/2456378782 conn(0x7f43ac0a87f0 msgr2=0x7f43ac06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 shutdown_connections 2023-12-08T08:20:37.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-08T08:20:37.653+0000 7f43abfff640 1 -- 172.21.15.45:0/2456378782 wait complete. 2023-12-08T08:20:37.675 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-08T08:20:37.675 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-08T08:20:37.676 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:20:37.676 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.694 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:20:37.694 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:20:37.694 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.768 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:20:37.769 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:20:37.769 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.790 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:20:37.791 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:20:37.791 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.858 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:20:37.858 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-08T08:20:37.858 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-08T08:20:37.858 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.909 INFO:tasks.ceph.osd.0:Stopped 2023-12-08T08:20:37.910 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-08T08:20:37.910 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:37.987 INFO:tasks.ceph.osd.1:Stopped 2023-12-08T08:20:37.988 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-08T08:20:37.988 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.063 INFO:tasks.ceph.osd.2:Stopped 2023-12-08T08:20:38.063 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-08T08:20:38.064 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.132 INFO:tasks.ceph.osd.3:Stopped 2023-12-08T08:20:38.133 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-08T08:20:38.133 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.197 INFO:tasks.ceph.osd.4:Stopped 2023-12-08T08:20:38.197 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-08T08:20:38.197 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.264 INFO:tasks.ceph.osd.5:Stopped 2023-12-08T08:20:38.264 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-08T08:20:38.264 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.316 INFO:tasks.ceph.osd.6:Stopped 2023-12-08T08:20:38.316 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-08T08:20:38.316 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.370 INFO:tasks.ceph.osd.7:Stopped 2023-12-08T08:20:38.370 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-08T08:20:38.370 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-08T08:20:38.370 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.450 INFO:tasks.ceph.mgr.y:Stopped 2023-12-08T08:20:38.450 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-08T08:20:38.451 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.538 INFO:tasks.ceph.mgr.x:Stopped 2023-12-08T08:20:38.539 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-08T08:20:38.539 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-08T08:20:38.539 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.592 INFO:tasks.ceph.mon.a:Stopped 2023-12-08T08:20:38.592 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-08T08:20:38.592 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.621 INFO:tasks.ceph.mon.b:Stopped 2023-12-08T08:20:38.621 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-08T08:20:38.621 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:38.707 INFO:tasks.ceph.mon.c:Stopped 2023-12-08T08:20:38.708 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-08T08:20:38.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-08T08:20:38.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-08T08:20:38.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:20:38.821 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-08T08:20:39.080 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:20:39.080 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-08T08:20:39.245 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:20:39.245 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-08T08:20:39.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:20:39.414 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-08T08:20:39.637 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:20:39.638 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-08T08:20:39.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:20:39.921 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-08T08:20:40.096 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:20:40.096 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-08T08:20:40.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:20:40.252 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-08T08:20:40.421 INFO:tasks.ceph:Archiving mon data... 2023-12-08T08:20:40.422 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/data/mon.a.tgz 2023-12-08T08:20:40.422 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-08T08:20:40.487 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.wNNjZiqKLE 2023-12-08T08:20:40.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wNNjZiqKLE 2023-12-08T08:20:40.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.wNNjZiqKLE 2023-12-08T08:20:40.869 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.wNNjZiqKLE is 502KB 2023-12-08T08:20:40.985 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.wNNjZiqKLE 2023-12-08T08:20:41.049 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/data/mon.b.tgz 2023-12-08T08:20:41.049 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-12-08T08:20:41.105 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.ry8Wyrri7g 2023-12-08T08:20:41.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ry8Wyrri7g 2023-12-08T08:20:41.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.ry8Wyrri7g 2023-12-08T08:20:41.509 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.ry8Wyrri7g is 640KB 2023-12-08T08:20:41.624 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.ry8Wyrri7g 2023-12-08T08:20:41.683 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/data/mon.c.tgz 2023-12-08T08:20:41.683 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-12-08T08:20:41.735 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.AHuWilljLO 2023-12-08T08:20:41.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AHuWilljLO 2023-12-08T08:20:41.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.AHuWilljLO 2023-12-08T08:20:42.122 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.AHuWilljLO is 640KB 2023-12-08T08:20:42.232 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.AHuWilljLO 2023-12-08T08:20:42.291 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-08T08:20:42.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:20:42.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:20:42.460 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:20:42.518 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:20:42.518 INFO:tasks.ceph:Archiving crash dumps... 2023-12-08T08:20:42.520 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi045/crash 2023-12-08T08:20:42.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:20:42.617 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi114/crash 2023-12-08T08:20:42.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:20:42.718 INFO:tasks.ceph:Shutting down logrotate 2023-12-08T08:20:42.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:42.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:42.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:42.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:43.051 INFO:tasks.ceph:Compressing logs... 2023-12-08T08:20:43.051 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:20:43.060 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:20:43.151 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-08T08:20:43.152 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95634.log 2023-12-08T08:20:43.153 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88500.log 2023-12-08T08:20:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.95634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95634.log.gz 2023-12-08T08:20:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88620.log 2023-12-08T08:20:43.156 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95153.log 2023-12-08T08:20:43.156 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88500.log.gz 2023-12-08T08:20:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117395.log 2023-12-08T08:20:43.157 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88620.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88620.log.gz 2023-12-08T08:20:43.157 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:20:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96571.log 2023-12-08T08:20:43.158 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.95153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95153.log.gz 2023-12-08T08:20:43.158 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-08T08:20:43.159 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108929.log 2023-12-08T08:20:43.160 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117395.log.gz 2023-12-08T08:20:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95985.log 2023-12-08T08:20:43.160 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96571.log.gz 2023-12-08T08:20:43.161 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-08T08:20:43.161 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.97233.log 2023-12-08T08:20:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108929.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108929.log.gz 2023-12-08T08:20:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103550.log 2023-12-08T08:20:43.163 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88580.log 2023-12-08T08:20:43.163 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:20:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95985.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95985.log.gz 2023-12-08T08:20:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94921.log 2023-12-08T08:20:43.164 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-08T08:20:43.164 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.97233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94306.log 2023-12-08T08:20:43.164 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.97233.log.gz 2023-12-08T08:20:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116890.log 2023-12-08T08:20:43.166 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103550.log.gz 2023-12-08T08:20:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111298.log 2023-12-08T08:20:43.166 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94921.log.gz 2023-12-08T08:20:43.167 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88580.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-08T08:20:43.167 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88580.log.gz 2023-12-08T08:20:43.167 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.94306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94306.log.gz 2023-12-08T08:20:43.167 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-08T08:20:43.168 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88380.log 2023-12-08T08:20:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116890.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116890.log.gz 2023-12-08T08:20:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112669.log 2023-12-08T08:20:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117540.log 2023-12-08T08:20:43.169 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111298.log.gz 2023-12-08T08:20:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112669.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.112669.log.gz /var/log/ceph/ceph-client.admin.117353.log 2023-12-08T08:20:43.170 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96728.log 2023-12-08T08:20:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88540.log 2023-12-08T08:20:43.172 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88380.log.gz 2023-12-08T08:20:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117540.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117540.log.gz 2023-12-08T08:20:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95313.log 2023-12-08T08:20:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115438.log 2023-12-08T08:20:43.173 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117353.log.gz 2023-12-08T08:20:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95313.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95313.log.gz 2023-12-08T08:20:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-08T08:20:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.96728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96728.log.gz 2023-12-08T08:20:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-08T08:20:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88540.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88540.log.gz 2023-12-08T08:20:43.176 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88340.log 2023-12-08T08:20:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94179.log 2023-12-08T08:20:43.177 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115438.log.gz 2023-12-08T08:20:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105039.log 2023-12-08T08:20:43.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94179.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94179.log.gz -5 2023-12-08T08:20:43.178 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104745.log 2023-12-08T08:20:43.178 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.96421.log 2023-12-08T08:20:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95131.log 2023-12-08T08:20:43.179 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105039.log.gz 2023-12-08T08:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88340.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:20:43.180 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88340.log.gz 2023-12-08T08:20:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.96421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.96421.log.gz 2023-12-08T08:20:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94836.log 2023-12-08T08:20:43.181 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98915.log 2023-12-08T08:20:43.182 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104745.log.gz 2023-12-08T08:20:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107733.log 2023-12-08T08:20:43.182 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95131.log.gz 2023-12-08T08:20:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115751.log 2023-12-08T08:20:43.183 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98915.log.gz 2023-12-08T08:20:43.183 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88420.log 2023-12-08T08:20:43.183 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.94836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94836.log.gz 2023-12-08T08:20:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107733.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107733.log.gz 2023-12-08T08:20:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114224.log 2023-12-08T08:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-08T08:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88420.log: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-08T08:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.88460.log -- replaced with /var/log/ceph/ceph-client.admin.88420.log.gz 2023-12-08T08:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-12-08T08:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-08T08:20:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96907.log 2023-12-08T08:20:43.187 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115751.log.gz 2023-12-08T08:20:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102042.log 2023-12-08T08:20:43.188 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114224.log.gz 2023-12-08T08:20:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107229.log 2023-12-08T08:20:43.189 INFO:teuthology.orchestra.run.smithi045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.96907.log.gz 2023-12-08T08:20:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104180.log 2023-12-08T08:20:43.189 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.88460.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88460.log.gz 2023-12-08T08:20:43.189 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95959.log 2023-12-08T08:20:43.190 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102042.log.gz 2023-12-08T08:20:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116379.log 2023-12-08T08:20:43.190 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107229.log.gz 2023-12-08T08:20:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104180.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104180.log.gz 2023-12-08T08:20:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110737.log 2023-12-08T08:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-08T08:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.1.95959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.95959.log.gz 2023-12-08T08:20:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108803.log 2023-12-08T08:20:43.193 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116379.log.gz 2023-12-08T08:20:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115354.log 2023-12-08T08:20:43.194 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110737.log.gz 2023-12-08T08:20:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108803.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.108803.log.gz -- 2023-12-08T08:20:43.195 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.95973.log 2023-12-08T08:20:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101746.log 2023-12-08T08:20:43.196 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115354.log.gz 2023-12-08T08:20:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116087.log 2023-12-08T08:20:43.198 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95973.log.gz 2023-12-08T08:20:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98510.log 2023-12-08T08:20:43.199 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101746.log.gz 2023-12-08T08:20:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94693.log 2023-12-08T08:20:43.200 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116087.log.gz 2023-12-08T08:20:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98510.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.92606.log 2023-12-08T08:20:43.201 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98510.log.gz 2023-12-08T08:20:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112837.log 2023-12-08T08:20:43.202 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94693.log.gz 2023-12-08T08:20:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105680.log 2023-12-08T08:20:43.204 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92606.log.gz 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112837.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.112837.log.gz /var/log/ceph/ceph-client.admin.105730.log 2023-12-08T08:20:43.205 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105680.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.105680.log.gz -5 2023-12-08T08:20:43.206 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.0.97349.log 2023-12-08T08:20:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112963.log 2023-12-08T08:20:43.207 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105730.log.gz 2023-12-08T08:20:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.97349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97349.log.gz 2023-12-08T08:20:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115480.log 2023-12-08T08:20:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111086.log 2023-12-08T08:20:43.210 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112963.log.gz 2023-12-08T08:20:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115480.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.115480.log.gz -- 2023-12-08T08:20:43.211 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.97904.log 2023-12-08T08:20:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96865.log 2023-12-08T08:20:43.212 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111086.log.gz 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117016.log 2023-12-08T08:20:43.213 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97904.log.gz 2023-12-08T08:20:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96865.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96865.log.gz 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113354.log 2023-12-08T08:20:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117016.log: gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.113005.log -- replaced with /var/log/ceph/ceph-client.admin.117016.log.gz 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107271.log 2023-12-08T08:20:43.217 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113354.log.gz 2023-12-08T08:20:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117269.log 2023-12-08T08:20:43.218 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113005.log.gz 2023-12-08T08:20:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107271.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107271.log.gz 2023-12-08T08:20:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116974.log 2023-12-08T08:20:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107775.log 2023-12-08T08:20:43.220 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117269.log.gz 2023-12-08T08:20:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93099.log 2023-12-08T08:20:43.222 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116974.log.gz 2023-12-08T08:20:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95312.log 2023-12-08T08:20:43.223 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107775.log.gz 2023-12-08T08:20:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111130.log 2023-12-08T08:20:43.224 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93099.log.gz 2023-12-08T08:20:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106152.log 2023-12-08T08:20:43.225 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95312.log.gz 2023-12-08T08:20:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107965.log 2023-12-08T08:20:43.226 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111130.log.gz 2023-12-08T08:20:43.227 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114350.log 2023-12-08T08:20:43.228 INFO:teuthology.orchestra.run.smithi045.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.106152.log.gz 2023-12-08T08:20:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107965.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107965.log.gz 2023-12-08T08:20:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94861.log 2023-12-08T08:20:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110058.log 2023-12-08T08:20:43.230 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114350.log.gz 2023-12-08T08:20:43.231 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93269.log 2023-12-08T08:20:43.231 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94861.log.gz 2023-12-08T08:20:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110058.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110058.log.gz 2023-12-08T08:20:43.232 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114441.log 2023-12-08T08:20:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117458.log 2023-12-08T08:20:43.234 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93269.log.gz 2023-12-08T08:20:43.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105816.log 2023-12-08T08:20:43.235 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114441.log.gz 2023-12-08T08:20:43.236 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108719.log 2023-12-08T08:20:43.236 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117458.log.gz 2023-12-08T08:20:43.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105816.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105816.log.gz 2023-12-08T08:20:43.237 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106026.log 2023-12-08T08:20:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105424.log 2023-12-08T08:20:43.238 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108719.log.gz 2023-12-08T08:20:43.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106026.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106026.log.gz 2023-12-08T08:20:43.239 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103424.log 2023-12-08T08:20:43.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103508.log 2023-12-08T08:20:43.241 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105424.log.gz 2023-12-08T08:20:43.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103424.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103424.log.gzgzip 2023-12-08T08:20:43.242 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105081.log 2023-12-08T08:20:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.c.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-08T08:20:43.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103508.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103508.log.gz 2023-12-08T08:20:43.244 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116003.log 2023-12-08T08:20:43.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105858.log 2023-12-08T08:20:43.245 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105081.log.gz 2023-12-08T08:20:43.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116003.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116003.log.gz 2023-12-08T08:20:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113047.log 2023-12-08T08:20:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108887.log 2023-12-08T08:20:43.247 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105858.log.gz 2023-12-08T08:20:43.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113047.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113047.log.gz 2023-12-08T08:20:43.249 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105340.log 2023-12-08T08:20:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108887.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108887.log.gz 2023-12-08T08:20:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105550.log 2023-12-08T08:20:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104054.log 2023-12-08T08:20:43.251 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105340.log.gz 2023-12-08T08:20:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105550.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105550.log.gz 2023-12-08T08:20:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111044.log 2023-12-08T08:20:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101534.log 2023-12-08T08:20:43.253 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104054.log.gz 2023-12-08T08:20:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111044.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111044.log.gz 2023-12-08T08:20:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95649.log 2023-12-08T08:20:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99287.log 2023-12-08T08:20:43.256 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101534.log.gz 2023-12-08T08:20:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95649.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95649.log.gz 2023-12-08T08:20:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102462.log 2023-12-08T08:20:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106483.log 2023-12-08T08:20:43.258 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99287.log.gz 2023-12-08T08:20:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102462.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102462.log.gz 2023-12-08T08:20:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101958.log 2023-12-08T08:20:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117143.log 2023-12-08T08:20:43.261 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106483.log.gz 2023-12-08T08:20:43.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101958.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.101958.log.gz --verbose 2023-12-08T08:20:43.262 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.109764.log 2023-12-08T08:20:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117143.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117143.log.gz 2023-12-08T08:20:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114525.log 2023-12-08T08:20:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101035.log 2023-12-08T08:20:43.264 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109764.log.gz 2023-12-08T08:20:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114525.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114525.log.gz 2023-12-08T08:20:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98030.log 2023-12-08T08:20:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108007.log 2023-12-08T08:20:43.267 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101035.log.gz 2023-12-08T08:20:43.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98030.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98030.log.gz 2023-12-08T08:20:43.268 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116295.log 2023-12-08T08:20:43.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99749.log 2023-12-08T08:20:43.269 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108007.log.gz 2023-12-08T08:20:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116295.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116295.log.gz 2023-12-08T08:20:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102084.log 2023-12-08T08:20:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96613.log 2023-12-08T08:20:43.272 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99749.log.gz 2023-12-08T08:20:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105202.log 2023-12-08T08:20:43.273 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102084.log.gz 2023-12-08T08:20:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96613.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96613.log.gz 2023-12-08T08:20:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109223.log 2023-12-08T08:20:43.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102546.log 2023-12-08T08:20:43.276 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105202.log.gz 2023-12-08T08:20:43.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109223.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109223.log.gz 2023-12-08T08:20:43.276 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99371.log 2023-12-08T08:20:43.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102504.log 2023-12-08T08:20:43.278 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102546.log.gz 2023-12-08T08:20:43.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99371.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99371.log.gz 2023-12-08T08:20:43.279 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115961.log 2023-12-08T08:20:43.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106651.log 2023-12-08T08:20:43.280 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102504.log.gz 2023-12-08T08:20:43.281 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115961.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115961.log.gz 2023-12-08T08:20:43.281 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116147.log 2023-12-08T08:20:43.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96655.log 2023-12-08T08:20:43.282 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106651.log.gz 2023-12-08T08:20:43.283 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116147.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116147.log.gz 2023-12-08T08:20:43.283 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115919.log 2023-12-08T08:20:43.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104325.log 2023-12-08T08:20:43.285 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96655.log.gz 2023-12-08T08:20:43.286 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104871.log 2023-12-08T08:20:43.286 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115919.log.gz 2023-12-08T08:20:43.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104325.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104325.log.gz 2023-12-08T08:20:43.287 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112025.log 2023-12-08T08:20:43.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.103319.log 2023-12-08T08:20:43.289 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104871.log.gz 2023-12-08T08:20:43.289 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112025.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112025.log.gz 2023-12-08T08:20:43.290 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97694.log 2023-12-08T08:20:43.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.testuser.103319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.103319.log.gz 2023-12-08T08:20:43.291 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96445.log 2023-12-08T08:20:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100741.log 2023-12-08T08:20:43.292 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97694.log.gz 2023-12-08T08:20:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96445.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96445.log.gz 2023-12-08T08:20:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113438.log 2023-12-08T08:20:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104451.log 2023-12-08T08:20:43.295 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100741.log.gz 2023-12-08T08:20:43.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113438.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113438.log.gz 2023-12-08T08:20:43.296 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98552.log 2023-12-08T08:20:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104451.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104451.log.gz 2023-12-08T08:20:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109553.log 2023-12-08T08:20:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103466.log 2023-12-08T08:20:43.299 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98552.log.gz 2023-12-08T08:20:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109553.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109553.log.gz 2023-12-08T08:20:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93545.log 2023-12-08T08:20:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103634.log 2023-12-08T08:20:43.301 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103466.log.gz 2023-12-08T08:20:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106693.log 2023-12-08T08:20:43.302 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93545.log.gz 2023-12-08T08:20:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103634.log.gz 2023-12-08T08:20:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114897.log 2023-12-08T08:20:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101618.log 2023-12-08T08:20:43.305 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106693.log.gz 2023-12-08T08:20:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99665.log 2023-12-08T08:20:43.306 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114897.log.gz 2023-12-08T08:20:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115877.log 2023-12-08T08:20:43.307 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101618.log.gz 2023-12-08T08:20:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99665.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99665.log.gz 2023-12-08T08:20:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92855.log 2023-12-08T08:20:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101660.log 2023-12-08T08:20:43.309 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115877.log.gz 2023-12-08T08:20:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104661.log 2023-12-08T08:20:43.310 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92855.log.gz 2023-12-08T08:20:43.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111905.log 2023-12-08T08:20:43.312 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101660.log.gz 2023-12-08T08:20:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102880.log 2023-12-08T08:20:43.313 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104661.log.gz 2023-12-08T08:20:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.111905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111905.log.gz 2023-12-08T08:20:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100331.log 2023-12-08T08:20:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97568.log 2023-12-08T08:20:43.315 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102880.log.gz 2023-12-08T08:20:43.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100825.log 2023-12-08T08:20:43.316 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100331.log.gz 2023-12-08T08:20:43.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97568.log.gz 2023-12-08T08:20:43.317 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106609.log 2023-12-08T08:20:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102694.log 2023-12-08T08:20:43.319 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100825.log.gz 2023-12-08T08:20:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104829.log 2023-12-08T08:20:43.320 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106609.log.gz 2023-12-08T08:20:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102694.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102694.log.gz 2023-12-08T08:20:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115709.log 2023-12-08T08:20:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106567.log 2023-12-08T08:20:43.322 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104829.log.gz 2023-12-08T08:20:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113396.log 2023-12-08T08:20:43.323 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115709.log.gz 2023-12-08T08:20:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106567.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106567.log.gz 2023-12-08T08:20:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105900.log 2023-12-08T08:20:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110455.log 2023-12-08T08:20:43.326 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113396.log.gz 2023-12-08T08:20:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116764.log 2023-12-08T08:20:43.327 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105900.log.gz 2023-12-08T08:20:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106068.log 2023-12-08T08:20:43.328 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110455.log.gz 2023-12-08T08:20:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116764.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116764.log.gz 2023-12-08T08:20:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100655.log 2023-12-08T08:20:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106110.log 2023-12-08T08:20:43.331 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106068.log.gz 2023-12-08T08:20:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98156.log 2023-12-08T08:20:43.332 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100655.log.gz 2023-12-08T08:20:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106110.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.109307.log 2023-12-08T08:20:43.333 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106110.log.gz 2023-12-08T08:20:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104703.log 2023-12-08T08:20:43.334 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98156.log.gz 2023-12-08T08:20:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104096.log 2023-12-08T08:20:43.335 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109307.log.gz 2023-12-08T08:20:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99119.log 2023-12-08T08:20:43.336 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104703.log.gz 2023-12-08T08:20:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104096.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104096.log.gz 2023-12-08T08:20:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103844.log 2023-12-08T08:20:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107017.log 2023-12-08T08:20:43.339 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99119.log.gz 2023-12-08T08:20:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103928.log 2023-12-08T08:20:43.340 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103844.log.gz 2023-12-08T08:20:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107017.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107017.log.gz 2023-12-08T08:20:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103970.log 2023-12-08T08:20:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103928.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103928.log.gz 2023-12-08T08:20:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98426.log 2023-12-08T08:20:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110371.log 2023-12-08T08:20:43.344 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103970.log.gz 2023-12-08T08:20:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106821.log 2023-12-08T08:20:43.345 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98426.log.gz 2023-12-08T08:20:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110371.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110371.log.gz 2023-12-08T08:20:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117058.log 2023-12-08T08:20:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115102.log 2023-12-08T08:20:43.347 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106821.log.gz 2023-12-08T08:20:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112151.log 2023-12-08T08:20:43.348 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117058.log.gz 2023-12-08T08:20:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115102.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115102.log.gz 2023-12-08T08:20:43.350 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115270.log 2023-12-08T08:20:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112151.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.112151.log.gz /var/log/ceph/ceph-client.admin.100247.log 2023-12-08T08:20:43.351 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110016.log 2023-12-08T08:20:43.352 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115270.log.gz 2023-12-08T08:20:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103592.log 2023-12-08T08:20:43.353 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100247.log.gz 2023-12-08T08:20:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110016.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110016.log.gz 2023-12-08T08:20:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93395.log 2023-12-08T08:20:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114771.log 2023-12-08T08:20:43.356 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103592.log.gz 2023-12-08T08:20:43.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98300.log 2023-12-08T08:20:43.357 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93395.log.gz 2023-12-08T08:20:43.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109409.log 2023-12-08T08:20:43.358 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.114771.log.gz 2023-12-08T08:20:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98300.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98300.log.gz 2023-12-08T08:20:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111568.log 2023-12-08T08:20:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99997.log 2023-12-08T08:20:43.361 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109409.log.gz 2023-12-08T08:20:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110994.log 2023-12-08T08:20:43.362 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111568.log.gz 2023-12-08T08:20:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99997.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99997.log.gz 2023-12-08T08:20:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101832.log 2023-12-08T08:20:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115835.log 2023-12-08T08:20:43.364 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110994.log.gz 2023-12-08T08:20:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95005.log 2023-12-08T08:20:43.365 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101832.log.gz 2023-12-08T08:20:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115835.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115835.log.gz 2023-12-08T08:20:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102378.log 2023-12-08T08:20:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95005.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.95005.log.gz 2023-12-08T08:20:43.368 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.115186.log 2023-12-08T08:20:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115666.log 2023-12-08T08:20:43.369 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102378.log.gz 2023-12-08T08:20:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98072.log 2023-12-08T08:20:43.370 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115186.log.gz 2023-12-08T08:20:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115666.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115666.log.gz 2023-12-08T08:20:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:20:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93479.log 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98072.log.gz 2023-12-08T08:20:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105592.log 2023-12-08T08:20:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104138.log 2023-12-08T08:20:43.375 INFO:teuthology.orchestra.run.smithi045.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93479.log.gz 2023-12-08T08:20:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97484.log 2023-12-08T08:20:43.376 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:20:43.377 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105592.log.gz 2023-12-08T08:20:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104138.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104138.log.gz 2023-12-08T08:20:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99581.log 2023-12-08T08:20:43.379 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108049.log 2023-12-08T08:20:43.379 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97484.log.gz 2023-12-08T08:20:43.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95047.log 2023-12-08T08:20:43.380 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99581.log.gz 2023-12-08T08:20:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108049.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108049.log.gz 2023-12-08T08:20:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100909.log 2023-12-08T08:20:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95047.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95047.log.gz 2023-12-08T08:20:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107103.log 2023-12-08T08:20:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101408.log 2023-12-08T08:20:43.384 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100909.log.gz 2023-12-08T08:20:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107103.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107103.log.gz 2023-12-08T08:20:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102754.log 2023-12-08T08:20:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101408.log.gz 2023-12-08T08:20:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107061.log 2023-12-08T08:20:43.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115396.log 2023-12-08T08:20:43.388 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102754.log.gz 2023-12-08T08:20:43.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107061.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107061.log.gz 2023-12-08T08:20:43.389 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100867.log 2023-12-08T08:20:43.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115396.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115396.log.gz 2023-12-08T08:20:43.391 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102652.log 2023-12-08T08:20:43.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100867.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100867.log.gzgzip 2023-12-08T08:20:43.392 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.112585.log 2023-12-08T08:20:43.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102652.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102652.log.gz 2023-12-08T08:20:43.393 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109265.log 2023-12-08T08:20:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112585.log.gz 2023-12-08T08:20:43.394 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94615.log 2023-12-08T08:20:43.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109265.log.gz 2023-12-08T08:20:43.396 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109013.log 2023-12-08T08:20:43.397 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95642.log 2023-12-08T08:20:43.397 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94615.log.gz 2023-12-08T08:20:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109013.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109013.log.gz 2023-12-08T08:20:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97610.log 2023-12-08T08:20:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95642.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95642.log.gz 2023-12-08T08:20:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107565.log 2023-12-08T08:20:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100951.log 2023-12-08T08:20:43.401 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97610.log.gz 2023-12-08T08:20:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107565.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107565.log.gz 2023-12-08T08:20:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108091.log 2023-12-08T08:20:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100951.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100951.log.gz 2023-12-08T08:20:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94405.log 2023-12-08T08:20:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115228.log 2023-12-08T08:20:43.405 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108091.log.gz 2023-12-08T08:20:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94405.log.gz 2023-12-08T08:20:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96223.log 2023-12-08T08:20:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115228.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115228.log.gz 2023-12-08T08:20:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107355.log 2023-12-08T08:20:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96781.log 2023-12-08T08:20:43.409 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96223.log.gz 2023-12-08T08:20:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107355.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107355.log.gz 2023-12-08T08:20:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99161.log 2023-12-08T08:20:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96781.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96781.log.gz 2023-12-08T08:20:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111610.log 2023-12-08T08:20:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99161.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99161.log.gz 2023-12-08T08:20:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99875.log 2023-12-08T08:20:43.414 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111610.log.gz 2023-12-08T08:20:43.414 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116045.log 2023-12-08T08:20:43.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114056.log 2023-12-08T08:20:43.415 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99875.log.gz 2023-12-08T08:20:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112921.log 2023-12-08T08:20:43.416 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116045.log.gz 2023-12-08T08:20:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114056.log.gz 2023-12-08T08:20:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112277.log 2023-12-08T08:20:43.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112921.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.112921.log.gz -- 2023-12-08T08:20:43.419 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.110695.log 2023-12-08T08:20:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112277.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112277.log.gz 2023-12-08T08:20:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108175.log 2023-12-08T08:20:43.421 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110695.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110695.log.gz 2023-12-08T08:20:43.421 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96181.log 2023-12-08T08:20:43.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108175.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108175.log.gz 2023-12-08T08:20:43.423 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-08T08:20:43.423 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99917.log 2023-12-08T08:20:43.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96181.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.96181.log.gz 2023-12-08T08:20:43.424 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.98342.log 2023-12-08T08:20:43.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99917.log.gz 2023-12-08T08:20:43.425 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92510.log 2023-12-08T08:20:43.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98342.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98342.log.gz 2023-12-08T08:20:43.426 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101492.log 2023-12-08T08:20:43.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92510.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92510.log.gz 2023-12-08T08:20:43.428 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100120.log 2023-12-08T08:20:43.429 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101492.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101492.log.gz 2023-12-08T08:20:43.429 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116806.log 2023-12-08T08:20:43.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100120.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100120.log.gz 2023-12-08T08:20:43.431 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114098.log 2023-12-08T08:20:43.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116806.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116806.log.gz 2023-12-08T08:20:43.432 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95634.log 2023-12-08T08:20:43.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114098.log.gz 2023-12-08T08:20:43.433 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95644.log 2023-12-08T08:20:43.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95634.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95634.log.gz 2023-12-08T08:20:43.434 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106865.log 2023-12-08T08:20:43.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95644.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95644.log.gz 2023-12-08T08:20:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98594.log 2023-12-08T08:20:43.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116421.log 2023-12-08T08:20:43.437 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106865.log.gz 2023-12-08T08:20:43.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98594.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98594.log.gz 2023-12-08T08:20:43.438 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93353.log 2023-12-08T08:20:43.439 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100499.log 2023-12-08T08:20:43.439 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116421.log.gz 2023-12-08T08:20:43.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93353.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93353.log.gz 2023-12-08T08:20:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96266.log 2023-12-08T08:20:43.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100499.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100499.log.gz 2023-12-08T08:20:43.442 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96487.log 2023-12-08T08:20:43.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96266.log.gz 2023-12-08T08:20:43.443 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115522.log 2023-12-08T08:20:43.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96487.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96487.log.gz 2023-12-08T08:20:43.444 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114939.log 2023-12-08T08:20:43.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115522.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115522.log.gz 2023-12-08T08:20:43.446 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111652.log 2023-12-08T08:20:43.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114939.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114939.log.gz 2023-12-08T08:20:43.447 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117311.log 2023-12-08T08:20:43.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104787.log 2023-12-08T08:20:43.448 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.111652.log.gz 2023-12-08T08:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117311.log.gz 2023-12-08T08:20:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93057.log 2023-12-08T08:20:43.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104787.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104787.log.gz 2023-12-08T08:20:43.451 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112627.log 2023-12-08T08:20:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93057.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93057.log.gz 2023-12-08T08:20:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102126.log 2023-12-08T08:20:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112627.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112627.log.gz 2023-12-08T08:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109139.log 2023-12-08T08:20:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102126.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.102126.log.gz 2023-12-08T08:20:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93013.log 2023-12-08T08:20:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109139.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109139.log.gz 2023-12-08T08:20:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101077.log 2023-12-08T08:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93013.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93013.log.gz 2023-12-08T08:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94347.log 2023-12-08T08:20:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101450.log 2023-12-08T08:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.101077.log.gz 2023-12-08T08:20:43.460 INFO:teuthology.orchestra.run.smithi114.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-08T08:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113582.log 2023-12-08T08:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94347.log.gz 2023-12-08T08:20:43.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101450.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101450.log.gz 2023-12-08T08:20:43.461 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113089.log 2023-12-08T08:20:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113582.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113582.log.gz 2023-12-08T08:20:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104240.log 2023-12-08T08:20:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113089.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113089.log.gz 2023-12-08T08:20:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92745.log 2023-12-08T08:20:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104240.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104240.log.gz 2023-12-08T08:20:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102168.log 2023-12-08T08:20:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92745.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92745.log.gz 2023-12-08T08:20:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107439.log 2023-12-08T08:20:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102168.log.gz 2023-12-08T08:20:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94489.log 2023-12-08T08:20:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107439.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107439.log.gz 2023-12-08T08:20:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99203.log 2023-12-08T08:20:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94489.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94489.log.gz 2023-12-08T08:20:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97988.log 2023-12-08T08:20:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99203.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99203.log.gz 2023-12-08T08:20:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-08T08:20:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97988.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97988.log.gz 2023-12-08T08:20:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111526.log 2023-12-08T08:20:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109890.log 2023-12-08T08:20:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111526.log.gz 2023-12-08T08:20:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114567.log 2023-12-08T08:20:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109890.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109890.log.gz 2023-12-08T08:20:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93185.log 2023-12-08T08:20:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114567.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114567.log.gz 2023-12-08T08:20:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104409.log 2023-12-08T08:20:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93185.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93185.log.gz 2023-12-08T08:20:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107859.log 2023-12-08T08:20:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104409.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104409.log.gz 2023-12-08T08:20:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82641.log 2023-12-08T08:20:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107859.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107859.log.gz 2023-12-08T08:20:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98831.log 2023-12-08T08:20:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.82641.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82641.log.gz 2023-12-08T08:20:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99623.log 2023-12-08T08:20:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98831.log.gz 2023-12-08T08:20:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95981.log 2023-12-08T08:20:43.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99623.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99623.log.gz 2023-12-08T08:20:43.486 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105636.log 2023-12-08T08:20:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95981.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95981.log.gz 2023-12-08T08:20:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117227.log 2023-12-08T08:20:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105636.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105636.log.gz 2023-12-08T08:20:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104997.log 2023-12-08T08:20:43.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117227.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117227.log.gz 2023-12-08T08:20:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95984.log 2023-12-08T08:20:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104997.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104997.log.gz 2023-12-08T08:20:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98957.log 2023-12-08T08:20:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95984.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95984.log.gz 2023-12-08T08:20:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95956.log 2023-12-08T08:20:43.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98957.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98957.log.gz 2023-12-08T08:20:43.493 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113312.log 2023-12-08T08:20:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95956.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95956.log.gz 2023-12-08T08:20:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100697.log 2023-12-08T08:20:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113312.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.115793.log -- replaced with /var/log/ceph/ceph-client.admin.113312.log.gz 2023-12-08T08:20:43.496 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100697.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100697.log.gz 2023-12-08T08:20:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104619.log 2023-12-08T08:20:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115793.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115793.log.gz 2023-12-08T08:20:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.108614.log 2023-12-08T08:20:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104619.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104619.log.gz 2023-12-08T08:20:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105382.log 2023-12-08T08:20:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.testuser.108614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.108614.log.gz 2023-12-08T08:20:43.501 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107523.log 2023-12-08T08:20:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105382.log.gz 2023-12-08T08:20:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102294.log 2023-12-08T08:20:43.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107523.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107523.log.gz 2023-12-08T08:20:43.503 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112365.log 2023-12-08T08:20:43.505 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102294.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102294.log.gz 2023-12-08T08:20:43.505 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116337.log 2023-12-08T08:20:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112365.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112365.log.gz 2023-12-08T08:20:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103760.log 2023-12-08T08:20:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116337.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116337.log.gz 2023-12-08T08:20:43.508 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109596.log 2023-12-08T08:20:43.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103760.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103760.log.gz 2023-12-08T08:20:43.509 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102922.log 2023-12-08T08:20:43.510 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109596.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109596.log.gz 2023-12-08T08:20:43.510 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109806.log 2023-12-08T08:20:43.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102922.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102922.log.gz 2023-12-08T08:20:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96697.log 2023-12-08T08:20:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109806.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109806.log.gz 2023-12-08T08:20:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116542.log 2023-12-08T08:20:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96697.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96697.log.gz 2023-12-08T08:20:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99329.log 2023-12-08T08:20:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116542.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116542.log.gz 2023-12-08T08:20:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115606.log 2023-12-08T08:20:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99329.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99329.log.gz 2023-12-08T08:20:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99077.log 2023-12-08T08:20:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115606.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115606.log.gz 2023-12-08T08:20:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111484.log 2023-12-08T08:20:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99077.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99077.log.gz 2023-12-08T08:20:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94221.log 2023-12-08T08:20:43.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111484.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111484.log.gz -5 2023-12-08T08:20:43.521 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.112321.log 2023-12-08T08:20:43.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94221.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94221.log.gz 2023-12-08T08:20:43.522 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97736.log 2023-12-08T08:20:43.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112321.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112321.log.gz 2023-12-08T08:20:43.523 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92901.log 2023-12-08T08:20:43.525 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105466.log 2023-12-08T08:20:43.525 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97736.log.gz 2023-12-08T08:20:43.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92901.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92901.log.gz 2023-12-08T08:20:43.526 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99245.log 2023-12-08T08:20:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104367.log 2023-12-08T08:20:43.527 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105466.log.gz 2023-12-08T08:20:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99245.log.gz 2023-12-08T08:20:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107187.log 2023-12-08T08:20:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88889.log 2023-12-08T08:20:43.530 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104367.log.gz 2023-12-08T08:20:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107187.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107187.log.gz 2023-12-08T08:20:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99035.log 2023-12-08T08:20:43.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.88889.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88889.log.gz 2023-12-08T08:20:43.533 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98216.log 2023-12-08T08:20:43.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99035.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99035.log.gz 2023-12-08T08:20:43.534 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107607.log 2023-12-08T08:20:43.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102336.log 2023-12-08T08:20:43.535 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98216.log.gz 2023-12-08T08:20:43.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107607.log.gz 2023-12-08T08:20:43.537 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111214.log 2023-12-08T08:20:43.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94531.log 2023-12-08T08:20:43.538 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102336.log.gz 2023-12-08T08:20:43.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111214.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111214.log.gz 2023-12-08T08:20:43.540 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105942.log 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92687.log 2023-12-08T08:20:43.541 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94531.log.gz 2023-12-08T08:20:43.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105942.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105942.log.gz 2023-12-08T08:20:43.542 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95311.log 2023-12-08T08:20:43.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111718.log 2023-12-08T08:20:43.543 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92687.log.gz 2023-12-08T08:20:43.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95311.log.gz 2023-12-08T08:20:43.545 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108845.log 2023-12-08T08:20:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117498.log 2023-12-08T08:20:43.546 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111718.log.gz 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108845.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108845.log.gz 2023-12-08T08:20:43.547 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-08T08:20:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110161.log 2023-12-08T08:20:43.549 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117498.log.gz 2023-12-08T08:20:43.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98384.log 2023-12-08T08:20:43.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110161.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.110161.log.gz --verbose 2023-12-08T08:20:43.552 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.112501.log 2023-12-08T08:20:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98384.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98384.log.gz -5 2023-12-08T08:20:43.554 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109349.log 2023-12-08T08:20:43.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104913.log 2023-12-08T08:20:43.555 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112501.log.gz 2023-12-08T08:20:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109349.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109349.log.gz 2023-12-08T08:20:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96360.log 2023-12-08T08:20:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105508.log 2023-12-08T08:20:43.558 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104913.log.gz 2023-12-08T08:20:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111256.log 2023-12-08T08:20:43.560 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96360.log.gz 2023-12-08T08:20:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112067.log 2023-12-08T08:20:43.562 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105508.log.gz 2023-12-08T08:20:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111256.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111256.log.gz 2023-12-08T08:20:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94735.log 2023-12-08T08:20:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97652.log 2023-12-08T08:20:43.565 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112067.log.gz 2023-12-08T08:20:43.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96823.log 2023-12-08T08:20:43.567 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94735.log.gz 2023-12-08T08:20:43.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117100.log 2023-12-08T08:20:43.569 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97652.log.gz 2023-12-08T08:20:43.570 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96823.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96823.log.gz 2023-12-08T08:20:43.570 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109181.log 2023-12-08T08:20:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110203.log 2023-12-08T08:20:43.572 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117100.log.gz 2023-12-08T08:20:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109181.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109181.log.gz 2023-12-08T08:20:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106915.log 2023-12-08T08:20:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110203.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110203.log.gz 2023-12-08T08:20:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117185.log 2023-12-08T08:20:43.576 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110118.log 2023-12-08T08:20:43.577 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106915.log.gz 2023-12-08T08:20:43.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.117185.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.117185.log.gz 2023-12-08T08:20:43.578 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108217.log 2023-12-08T08:20:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93227.log 2023-12-08T08:20:43.580 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110118.log.gz 2023-12-08T08:20:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100457.log 2023-12-08T08:20:43.582 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108217.log.gz 2023-12-08T08:20:43.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115312.log 2023-12-08T08:20:43.584 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93227.log.gz 2023-12-08T08:20:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100457.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100457.log.gz 2023-12-08T08:20:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106777.log 2023-12-08T08:20:43.587 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113206.log 2023-12-08T08:20:43.587 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115312.log.gz 2023-12-08T08:20:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112753.log 2023-12-08T08:20:43.588 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106777.log.gz 2023-12-08T08:20:43.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110287.log 2023-12-08T08:20:43.590 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113206.log.gz 2023-12-08T08:20:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106218.log 2023-12-08T08:20:43.591 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112753.log.gz 2023-12-08T08:20:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112879.log 2023-12-08T08:20:43.593 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110287.log.gz 2023-12-08T08:20:43.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97778.log 2023-12-08T08:20:43.594 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106218.log.gz 2023-12-08T08:20:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112879.log.gz 2023-12-08T08:20:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101576.log 2023-12-08T08:20:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94305.log 2023-12-08T08:20:43.598 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97778.log.gz 2023-12-08T08:20:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101576.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101576.log.gz 2023-12-08T08:20:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101330.log 2023-12-08T08:20:43.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94305.log.gz 2023-12-08T08:20:43.600 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109493.log 2023-12-08T08:20:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.101330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101330.log.gz 2023-12-08T08:20:43.602 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96316.log 2023-12-08T08:20:43.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109493.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.109493.log.gz -- 2023-12-08T08:20:43.603 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.114693.log 2023-12-08T08:20:43.604 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96316.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96316.log.gz 2023-12-08T08:20:43.604 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107817.log 2023-12-08T08:20:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100993.log 2023-12-08T08:20:43.606 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114693.log.gz 2023-12-08T08:20:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107817.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107817.log.gz 2023-12-08T08:20:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98789.log 2023-12-08T08:20:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100993.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100993.log.gz 2023-12-08T08:20:43.609 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108971.log 2023-12-08T08:20:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102210.log 2023-12-08T08:20:43.610 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98789.log.gz 2023-12-08T08:20:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108971.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108971.log.gz 2023-12-08T08:20:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93141.log 2023-12-08T08:20:43.613 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115144.log 2023-12-08T08:20:43.614 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102210.log.gz 2023-12-08T08:20:43.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93141.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93141.log.gz 2023-12-08T08:20:43.615 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116627.log 2023-12-08T08:20:43.616 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99707.log 2023-12-08T08:20:43.616 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115144.log.gz 2023-12-08T08:20:43.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116627.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116627.log.gz 2023-12-08T08:20:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99413.log 2023-12-08T08:20:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99707.log.gz 2023-12-08T08:20:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106405.log 2023-12-08T08:20:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99413.log.gz 2023-12-08T08:20:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97862.log 2023-12-08T08:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.106405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110780.log 0.0% 2023-12-08T08:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.0.106405.log.gz 2023-12-08T08:20:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97862.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97862.log.gz 2023-12-08T08:20:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107397.log 2023-12-08T08:20:43.626 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95302.log 2023-12-08T08:20:43.627 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110780.log.gz 2023-12-08T08:20:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107397.log.gz 2023-12-08T08:20:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100289.log 2023-12-08T08:20:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100605.log 2023-12-08T08:20:43.630 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95302.log.gz 2023-12-08T08:20:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100289.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100289.log.gz 2023-12-08T08:20:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-08T08:20:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100605.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100605.log.gz 2023-12-08T08:20:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100415.log 2023-12-08T08:20:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103886.log 2023-12-08T08:20:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100415.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100415.log.gz 2023-12-08T08:20:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97820.log 2023-12-08T08:20:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103886.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103886.log.gz 2023-12-08T08:20:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111983.log 2023-12-08T08:20:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106525.log 2023-12-08T08:20:43.638 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97820.log.gz 2023-12-08T08:20:43.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108677.log 2023-12-08T08:20:43.640 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111983.log.gz 2023-12-08T08:20:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106525.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.106525.log.gz --verbose 2023-12-08T08:20:43.642 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.101916.log 2023-12-08T08:20:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98114.log 2023-12-08T08:20:43.643 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108677.log.gz 2023-12-08T08:20:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102000.log 2023-12-08T08:20:43.645 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101916.log.gz 2023-12-08T08:20:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103676.log 2023-12-08T08:20:43.647 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98114.log.gz 2023-12-08T08:20:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112795.log 2023-12-08T08:20:43.648 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102000.log.gz 2023-12-08T08:20:43.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109722.log 2023-12-08T08:20:43.650 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103676.log.gz 2023-12-08T08:20:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109680.log 2023-12-08T08:20:43.652 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112795.log.gz 2023-12-08T08:20:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109722.log.gz 2023-12-08T08:20:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103718.log 2023-12-08T08:20:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109680.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109680.log.gz 2023-12-08T08:20:43.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109932.log 2023-12-08T08:20:43.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103718.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103718.log.gz 2023-12-08T08:20:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94447.log 2023-12-08T08:20:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109932.log.gz 2023-12-08T08:20:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111442.log 2023-12-08T08:20:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94447.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94447.log.gz 2023-12-08T08:20:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99455.log 2023-12-08T08:20:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111442.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111442.log.gz 2023-12-08T08:20:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112193.log 2023-12-08T08:20:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99455.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99455.log.gz 2023-12-08T08:20:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114609.log 2023-12-08T08:20:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112193.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112193.log.gz 2023-12-08T08:20:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114855.log 2023-12-08T08:20:43.667 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97035.log 2023-12-08T08:20:43.667 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114609.log.gz 2023-12-08T08:20:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101702.log 2023-12-08T08:20:43.669 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114855.log.gz 2023-12-08T08:20:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110245.log 2023-12-08T08:20:43.670 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97035.log.gz 2023-12-08T08:20:43.672 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116252.log 2023-12-08T08:20:43.672 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101702.log.gz 2023-12-08T08:20:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116670.log 2023-12-08T08:20:43.674 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110245.log.gz 2023-12-08T08:20:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116252.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116252.log.gz 2023-12-08T08:20:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98258.log 2023-12-08T08:20:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109451.log 2023-12-08T08:20:43.677 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116670.log.gz 2023-12-08T08:20:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98258.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98258.log.gz 2023-12-08T08:20:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104283.log 2023-12-08T08:20:43.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99539.log 2023-12-08T08:20:43.680 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109451.log.gz 2023-12-08T08:20:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104283.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104283.log.gz 2023-12-08T08:20:43.681 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102420.log 2023-12-08T08:20:43.682 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89000.log 2023-12-08T08:20:43.682 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99539.log.gz 2023-12-08T08:20:43.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102420.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102420.log.gz 2023-12-08T08:20:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92799.log 2023-12-08T08:20:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.89000.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89000.log.gz 2023-12-08T08:20:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95636.log 2023-12-08T08:20:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92799.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92799.log.gz 2023-12-08T08:20:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-08T08:20:43.688 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110614.log 2023-12-08T08:20:43.688 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95636.log.gz 2023-12-08T08:20:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96529.log 2023-12-08T08:20:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110822.log 2023-12-08T08:20:43.691 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110614.log.gz 2023-12-08T08:20:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96529.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.100205.log 2023-12-08T08:20:43.692 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96529.log.gz 2023-12-08T08:20:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110822.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110822.log.gz 2023-12-08T08:20:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101790.log 2023-12-08T08:20:43.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110864.log 2023-12-08T08:20:43.697 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100205.log.gz 2023-12-08T08:20:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113540.log 2023-12-08T08:20:43.698 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101790.log.gz 2023-12-08T08:20:43.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110950.log 2023-12-08T08:20:43.699 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110864.log.gz 2023-12-08T08:20:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112415.log 2023-12-08T08:20:43.700 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113540.log.gz 2023-12-08T08:20:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110950.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110950.log.gz 2023-12-08T08:20:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100078.log 2023-12-08T08:20:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112415.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112415.log.gz 2023-12-08T08:20:43.704 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116848.log 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105772.log 2023-12-08T08:20:43.705 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100078.log.gz 2023-12-08T08:20:43.707 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116848.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116848.log.gz 2023-12-08T08:20:43.707 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112457.log 2023-12-08T08:20:43.708 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105984.log 2023-12-08T08:20:43.708 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105772.log.gz 2023-12-08T08:20:43.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-08T08:20:43.710 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.113979.log 2023-12-08T08:20:43.710 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112457.log.gz 2023-12-08T08:20:43.711 INFO:teuthology.orchestra.run.smithi045.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-08T08:20:43.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104493.log 2023-12-08T08:20:43.711 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105984.log.gz 2023-12-08T08:20:43.712 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.testuser.113979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.113979.log.gz 2023-12-08T08:20:43.712 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102838.log 2023-12-08T08:20:43.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104493.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104493.log.gz 2023-12-08T08:20:43.714 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88632.log 2023-12-08T08:20:43.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94819.log 2023-12-08T08:20:43.716 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102838.log.gz 2023-12-08T08:20:43.716 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.88632.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88632.log.gz 2023-12-08T08:20:43.717 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105123.log 2023-12-08T08:20:43.718 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114266.log 2023-12-08T08:20:43.718 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94819.log.gz 2023-12-08T08:20:43.719 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.105123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105123.log.gz 2023-12-08T08:20:43.719 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95633.log 2023-12-08T08:20:43.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114266.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:20:43.721 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114266.log.gz 2023-12-08T08:20:43.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111172.log 2023-12-08T08:20:43.722 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95633.log.gz 2023-12-08T08:20:43.723 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100543.log 2023-12-08T08:20:43.725 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111172.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:20:43.725 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98747.log 2023-12-08T08:20:43.726 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111172.log.gz 2023-12-08T08:20:43.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95980.log 2023-12-08T08:20:43.728 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100543.log.gz 2023-12-08T08:20:43.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98747.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98747.log.gz 2023-12-08T08:20:43.728 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95298.log 2023-12-08T08:20:43.729 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99791.log 2023-12-08T08:20:43.729 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95980.log.gz 2023-12-08T08:20:43.730 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95298.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95298.log.gz 2023-12-08T08:20:43.730 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114308.log 2023-12-08T08:20:43.731 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99791.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-08T08:20:43.732 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99791.log.gz 2023-12-08T08:20:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114308.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.114308.log.gz -5 2023-12-08T08:20:43.733 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94963.log 2023-12-08T08:20:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95647.log 2023-12-08T08:20:43.736 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94963.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-08T08:20:43.736 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94963.log.gz 2023-12-08T08:20:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109638.log 2023-12-08T08:20:43.738 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95647.log.gz 2023-12-08T08:20:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99497.log 2023-12-08T08:20:43.739 INFO:teuthology.orchestra.run.smithi045.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-08T08:20:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109638.log.gz 2023-12-08T08:20:43.741 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111340.log 2023-12-08T08:20:43.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116932.log 2023-12-08T08:20:43.743 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99497.log.gz 2023-12-08T08:20:43.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104535.log 2023-12-08T08:20:43.745 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111340.log.gz 2023-12-08T08:20:43.746 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97946.log 2023-12-08T08:20:43.746 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116932.log.gz 2023-12-08T08:20:43.748 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114483.log 2023-12-08T08:20:43.748 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104535.log.gz 2023-12-08T08:20:43.749 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115564.log 2023-12-08T08:20:43.749 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97946.log.gz 2023-12-08T08:20:43.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98468.log 2023-12-08T08:20:43.751 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114483.log.gz 2023-12-08T08:20:43.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115564.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115564.log.gz 2023-12-08T08:20:43.752 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93437.log 2023-12-08T08:20:43.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98468.log.gz 2023-12-08T08:20:43.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116190.log 2023-12-08T08:20:43.756 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93437.log.gz 2023-12-08T08:20:43.756 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110329.log 2023-12-08T08:20:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109097.log 2023-12-08T08:20:43.758 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116190.log.gz 2023-12-08T08:20:43.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103802.log 2023-12-08T08:20:43.759 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110329.log.gz 2023-12-08T08:20:43.761 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94777.log 2023-12-08T08:20:43.761 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109097.log.gz 2023-12-08T08:20:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110534.log 2023-12-08T08:20:43.762 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103802.log.gz 2023-12-08T08:20:43.764 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94777.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94777.log.gz 2023-12-08T08:20:43.764 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114651.log 2023-12-08T08:20:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110534.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110534.log.gz 2023-12-08T08:20:43.766 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111382.log 2023-12-08T08:20:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112109.log 2023-12-08T08:20:43.768 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114651.log.gz 2023-12-08T08:20:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.111382.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111382.log.gz 2023-12-08T08:20:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100373.log 2023-12-08T08:20:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112109.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112109.log.gz 2023-12-08T08:20:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99833.log 2023-12-08T08:20:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110906.log 2023-12-08T08:20:43.772 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100373.log.gz 2023-12-08T08:20:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.99833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94137.log 2023-12-08T08:20:43.774 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99833.log.gz 2023-12-08T08:20:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102796.log 2023-12-08T08:20:43.775 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110906.log.gz 2023-12-08T08:20:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92961.log 2023-12-08T08:20:43.777 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94137.log.gz 2023-12-08T08:20:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95982.log 2023-12-08T08:20:43.778 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102796.log.gz 2023-12-08T08:20:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.92961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114813.log 2023-12-08T08:20:43.780 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92961.log.gz 2023-12-08T08:20:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114182.log 2023-12-08T08:20:43.781 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95982.log.gz 2023-12-08T08:20:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114813.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114813.log.gz -5 2023-12-08T08:20:43.783 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.113498.log 2023-12-08T08:20:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114182.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114182.log.gzgzip 2023-12-08T08:20:43.784 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108311.log 2023-12-08T08:20:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107649.log 2023-12-08T08:20:43.786 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113498.log.gz 2023-12-08T08:20:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98873.log 2023-12-08T08:20:43.787 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108311.log.gz 2023-12-08T08:20:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103016.log 2023-12-08T08:20:43.790 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107649.log.gz 2023-12-08T08:20:43.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95089.log 2023-12-08T08:20:43.790 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98873.log.gz 2023-12-08T08:20:43.792 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108761.log 2023-12-08T08:20:43.792 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103016.log.gz 2023-12-08T08:20:43.793 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113676.log 2023-12-08T08:20:43.793 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95089.log.gz 2023-12-08T08:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108761.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108761.log.gz 2023-12-08T08:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108133.log 2023-12-08T08:20:43.796 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113676.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113676.log.gz 2023-12-08T08:20:43.797 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114981.log 2023-12-08T08:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.108133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109848.log 2023-12-08T08:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108133.log.gz 2023-12-08T08:20:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98636.log 2023-12-08T08:20:43.800 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114981.log.gz 2023-12-08T08:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94573.log 2023-12-08T08:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109848.log.gz 2023-12-08T08:20:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.98636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102252.log 2023-12-08T08:20:43.803 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98636.log.gz 2023-12-08T08:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112711.log 2023-12-08T08:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94573.log.gz 2023-12-08T08:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.102252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102252.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116584.log 2023-12-08T08:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:43.807 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112711.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107313.log 2023-12-08T08:20:43.807 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112711.log.gz 2023-12-08T08:20:43.808 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100783.log 2023-12-08T08:20:43.809 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116584.log.gz 2023-12-08T08:20:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112235.log 2023-12-08T08:20:43.810 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107313.log.gz 2023-12-08T08:20:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114140.log 2023-12-08T08:20:43.812 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100783.log.gz 2023-12-08T08:20:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112235.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112235.log.gz 2023-12-08T08:20:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96739.log 2023-12-08T08:20:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.114140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110413.log 2023-12-08T08:20:43.815 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114140.log.gz 2023-12-08T08:20:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95969.log 2023-12-08T08:20:43.816 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96739.log.gz 2023-12-08T08:20:43.817 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.110413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110413.log.gzgzip 2023-12-08T08:20:43.817 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95305.log 2023-12-08T08:20:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101143.log 2023-12-08T08:20:43.819 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95969.log.gz 2023-12-08T08:20:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95305.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95305.log.gz 2023-12-08T08:20:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109055.log 2023-12-08T08:20:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101143.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101143.log.gz 2023-12-08T08:20:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113164.log 2023-12-08T08:20:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93965.log 2023-12-08T08:20:43.824 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109055.log.gz 2023-12-08T08:20:43.825 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.113164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104577.log 2023-12-08T08:20:43.825 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113164.log.gz 2023-12-08T08:20:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101874.log 2023-12-08T08:20:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104577.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104577.log.gz 2023-12-08T08:20:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 92.3% -- replaced with /var/log/ceph/ceph-client.admin.93965.log.gz -5 2023-12-08T08:20:43.829 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106957.log 2023-12-08T08:20:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.101874.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101874.log.gz 2023-12-08T08:20:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107145.log 2023-12-08T08:20:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107691.log 2023-12-08T08:20:43.832 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106957.log.gz 2023-12-08T08:20:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107481.log 2023-12-08T08:20:43.833 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107145.log.gz 2023-12-08T08:20:43.834 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107691.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-08T08:20:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94263.log 2023-12-08T08:20:43.835 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107691.log.gz 2023-12-08T08:20:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.107481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95306.log 2023-12-08T08:20:43.836 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107481.log.gz 2023-12-08T08:20:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.94263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103382.log 2023-12-08T08:20:43.838 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94263.log.gz 2023-12-08T08:20:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95306.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.95306.log.gz 2023-12-08T08:20:43.839 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104955.log 2023-12-08T08:20:43.841 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.103382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100163.log 2023-12-08T08:20:43.841 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103382.log.gz 2023-12-08T08:20:43.842 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109974.log 2023-12-08T08:20:43.842 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104955.log.gz 2023-12-08T08:20:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.100163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104012.log 2023-12-08T08:20:43.843 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100163.log.gz 2023-12-08T08:20:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.109974.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-08T08:20:43.845 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109974.log.gz 2023-12-08T08:20:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.104012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112543.log 2023-12-08T08:20:43.847 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104012.log.gz 2023-12-08T08:20:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96403.log 2023-12-08T08:20:43.849 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.112543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97526.log 88.5% 2023-12-08T08:20:43.849 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112543.log.gz 2023-12-08T08:20:43.851 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.96403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95648.log 2023-12-08T08:20:43.851 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96403.log.gz 2023-12-08T08:20:43.852 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.97526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93311.log 2023-12-08T08:20:43.852 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97526.log.gz 2023-12-08T08:20:43.854 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115023.log 2023-12-08T08:20:43.854 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95648.log.gz 2023-12-08T08:20:43.855 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.93311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95301.log 2023-12-08T08:20:43.855 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93311.log.gz 2023-12-08T08:20:43.857 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.115023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116722.log 2023-12-08T08:20:43.857 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115023.log.gz 2023-12-08T08:20:43.858 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.95301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106735.log 2023-12-08T08:20:43.858 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95301.log.gz 2023-12-08T08:20:43.859 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.116722.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116722.log.gz 2023-12-08T08:20:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.106735.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106735.log.gz 2023-12-08T08:20:43.917 INFO:teuthology.orchestra.run.smithi045.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-08T08:20:44.163 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-08T08:20:44.228 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-08T08:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-08T08:20:44.302 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-08T08:20:44.307 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-12-08T08:20:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m1.194s 2023-12-08T08:20:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m4.515s 2023-12-08T08:20:44.307 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.519s 2023-12-08T08:20:44.669 INFO:teuthology.orchestra.run.smithi045.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-08T08:20:44.692 INFO:teuthology.orchestra.run.smithi045.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-08T08:20:44.800 INFO:teuthology.orchestra.run.smithi045.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-08T08:20:44.884 INFO:teuthology.orchestra.run.smithi045.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-08T08:20:44.890 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-08T08:20:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m1.778s 2023-12-08T08:20:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m5.232s 2023-12-08T08:20:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m1.839s 2023-12-08T08:20:44.891 INFO:tasks.ceph:Archiving logs... 2023-12-08T08:20:44.891 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi045/log 2023-12-08T08:20:44.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:20:46.018 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi114/log 2023-12-08T08:20:46.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:20:46.731 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-08T08:20:46.740 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-08T08:20:46.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:20:46.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:20:46.909 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-08T08:20:46.918 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-08T08:20:46.919 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:20:46.928 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:20:46.979 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:20:46.986 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:20:46.992 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:20:46.992 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-12-08T08:20:46.992 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 +469us[ +469us] +/- 71ms 2023-12-08T08:20:46.992 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -140us[ -137us] +/- 71ms 2023-12-08T08:20:46.993 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -348us[ -348us] +/- 65ms 2023-12-08T08:20:46.993 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:20:46.995 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:20:46.995 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2023-12-08T08:20:46.995 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 +515us[ +515us] +/- 71ms 2023-12-08T08:20:46.996 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -117us[ -81us] +/- 71ms 2023-12-08T08:20:46.996 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -319us[ -283us] +/- 65ms 2023-12-08T08:20:46.996 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:20:46.997 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-08T08:20:47.006 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-08T08:20:47.007 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-08T08:20:47.041 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T08:20:47.341 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T08:20:47.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:20:47.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:47.725 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:20:47.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:47.835 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-08T08:20:47.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-08T08:20:47.884 INFO:teuthology.task.internal:Duration was 1405.965143 seconds 2023-12-08T08:20:47.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-08T08:20:47.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-08T08:20:47.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:20:47.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:20:48.114 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:20:48.124 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:20:48.604 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-08T08:20:48.604 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-12-08T08:20:48.605 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:20:48.688 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2023-12-08T08:20:48.689 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:20:48.766 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-08T08:20:48.766 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:20:48.776 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:20:48.878 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-08T08:20:48.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:20:48.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:20:49.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-08T08:20:49.094 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-08T08:20:49.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:20:49.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:20:49.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-08T08:20:49.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:20:49.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:20:49.425 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2023-12-08T08:20:49.434 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-12-08T08:20:49.495 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:20:49.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:49.548 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:20:49.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:49.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-08T08:20:49.618 INFO:teuthology.task.internal:Transferring archived files... 2023-12-08T08:20:49.619 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi045 2023-12-08T08:20:49.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:20:49.738 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761/remote/smithi114 2023-12-08T08:20:49.738 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:20:49.850 INFO:teuthology.task.internal:Removing archive directory... 2023-12-08T08:20:49.851 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:20:49.860 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:20:49.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-08T08:20:49.933 INFO:teuthology.task.internal:Not uploading archives. 2023-12-08T08:20:49.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-08T08:20:49.960 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-08T08:20:49.960 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:20:49.970 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:20:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: 524611 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:20 /home/ubuntu/cephtest 2023-12-08T08:20:50.029 INFO:teuthology.orchestra.run.smithi114.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:20 /home/ubuntu/cephtest 2023-12-08T08:20:50.032 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-08T08:20:50.043 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-08T08:20:50.124 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T08:20:50.144 DEBUG:teuthology.nuke:shortname: smithi045 2023-12-08T08:20:50.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:20:50.167 DEBUG:teuthology.nuke:shortname: smithi114 2023-12-08T08:20:50.167 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:20:50.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:48:26.701898', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsSvy4Fb/xX6H8FmY89MqFUF5fwpGjpzvmHRVTcBGUvI0uw0q5i2MHhst/uft6mqIQFl+LCZfctE3ZeLwq7Glk='} 2023-12-08T08:20:50.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483761', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:48:26.699851', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoKPSIe36hn0B+dMRBoYZ/SYYbG5k41Gt8k88sLS+yJOPafC2Cnk4UJj2MUp7VXCwJ3wADi5iWo9MjmfeQa4fk='} 2023-12-08T08:20:50.222 INFO:teuthology.orchestra.console.smithi045:Power off 2023-12-08T08:20:50.222 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:20:50.248 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-12-08T08:20:50.249 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:50.270 INFO:teuthology.orchestra.console.smithi114:Power off 2023-12-08T08:20:50.270 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:20:50.280 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-08T08:20:50.293 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-12-08T08:20:50.293 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:50.318 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-12-08T08:20:54.281 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:54.319 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:54.391 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-08T08:20:54.430 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-12-08T08:20:58.397 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:58.430 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:20:58.509 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-08T08:20:58.542 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-12-08T08:20:58.610 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-12-08T08:21:02.546 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:02.657 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-12-08T08:21:02.757 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-12-08T08:21:02.863 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 6bcacf46b7888ce2bf7abad8aec37024810025d4 client.1-kernel-sha1: 6bcacf46b7888ce2bf7abad8aec37024810025d4 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1405.9651427268982 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=55c1ebd1b8a84f1eabd418a9fe98118a status: fail success: false 2023-12-08T08:21:02.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T08:21:02.947 INFO:teuthology.run:FAIL